JP6610925B2 - Image classification apparatus, image classification method, and program - Google Patents

Description

  The present invention relates to a technique for classifying a plurality of images acquired by photographing.

  2. Description of the Related Art Conventionally, when a plurality of captured images are classified, a technique for performing classification so that related images belong to the same group based on the date / time and position distribution at the time of shooting is known (for example, Patent Document 1 below). reference).

JP 2012-195679 A

  However, in the above-described prior art, it is assumed that the photographer moves while shooting, but since the actual classification process is based only on the date / time and position distribution information at the time of shooting, shooting is performed. There is a problem that a plurality of photographed images taken by a person moving cannot always be properly classified.

  The present invention has been made in view of such conventional problems, and is an image classification device and an image classification method that can more appropriately classify a plurality of captured images obtained by photographing while moving by a photographer. And to provide a program.

In order to solve the above problems, in the present invention, an image classification device for classifying a plurality of captured images taken by a user, the positioning means for periodically positioning the current position of the user, and the positioning A movement history acquisition means for acquiring a correspondence between a series of positioning results obtained by the means and date and time information as an indication of the movement history of the user, and this shooting instruction for a shot image shot according to the shooting instruction When the position information at the time of photographing is recorded by the photographing recording means, the photographing recording means for associating and recording the positioning result by the positioning means at the time as position information, and based on the periodic positioning by the positioning means instead get movement history, and control means for controlling the movement history acquiring means to acquire the movement history based on the position information at the time of the shooting, by the movement history acquiring means By analyzing the obtained movement history information, action period determination means for determining an action period corresponding to a photographed image to be classified as the same period in the past movement history of the user, and each of the plurality of photographed images Image classification means for classifying according to the action period determined by the action period determination means based on the shooting date and time .

  According to the present invention, it is possible to more appropriately classify a plurality of images obtained by photographing while a photographer moves.

1 is a block diagram of a digital camera according to the present invention. It is a conceptual diagram which shows the structure of movement history data. It is a flowchart which shows the process in the imaging | photography mode while using a regular positioning mode. It is a flowchart which shows the process in image classification mode. It is a flowchart which shows a period discrimination | determination process. It is explanatory drawing which shows an example of the movement locus | trajectory shown by movement history data. It is a conceptual diagram which shows the storage structure of the still image file in an image memory | storage part.

  Hereinafter, embodiments of the present invention will be described. FIG. 1 is a block diagram showing a schematic configuration of a digital camera 1 having a function as an image classification device according to an embodiment of the present invention.

  As shown in FIG. 1, a digital camera 1 includes a CPU (Central Processing Unit) 2 that mainly controls the entire apparatus, an imaging unit 3 connected to the CPU 2, a working memory 4, an image processing unit 5, and an image storage unit. 6, a display unit 7, an input unit 8, a GPS unit 9, a movement history storage unit 10, a program storage unit 11, and a map data storage unit 12. The CPU 2 includes a built-in clock 2a having a calendar function for obtaining the current date and time.

  The imaging unit 3 amplifies an imaging signal output from an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Meta10xide Semiconductor) that captures an object via a photographic lens (not shown), and a digital signal. AFE (Analog Front End) etc. for performing the conversion. The work memory 4 is a memory for temporarily storing data captured by the imaging unit 3, that is, image data captured by the image sensor, and is, for example, an SDRAM (Synchronous Dynamic Random Access Memory).

  The image processing unit 5 is configured by, for example, a DSP (Digital Signal Processor), temporarily stores the work data in the work memory 4, converts the image data supplied via the CPU 2 into RGB data, and further converts the RGB data into luminance ( Y) Conversion into YUV data comprising a component and a color difference (UV) component. The converted YUV data is supplied to the display unit 7 via the CPU 2 and is displayed as a live view image on the display unit 7 while in the shooting standby state in the shooting mode. Further, the image processing unit 5 compresses the image data converted into YUV data by the JPEG (Joint Photographic Expert Group) method and stores the image data in the image storage unit 6 when the shutter key is pressed in the shooting mode. Decompresses image data in a compressed state.

  The image storage unit 6 includes various memory cards that are detachable from the digital camera 1 and built-in flash memory built in the digital camera 1, for example. After being compressed by the image processing unit 5, the image storage unit 6 is attached by the CPU 2 with additional information including shooting date and time, position information (latitude and longitude) indicating the shooting point, subject distance, lens F value, exposure control mode, and the like. A still image file conforming to the Exif (Exchangeable Image File Format) standard is stored. However, the position information (latitude and longitude) can be set by the user as to whether or not to add the position information, and is added only when the position information is set to be valid.

  The display unit 7 includes a liquid crystal monitor and the like, displays the live view image, and reads an image based on the image data read by the CPU 2 from the image storage unit 6 and expanded by the image processing unit 5, that is, a recorded image. Display the captured image. In addition, the display unit 7 displays various types of information including a shooting condition, function selection when using various functions of the digital camera 1, and a setting screen for setting operation contents of the various functions.

  The input unit 8 includes a plurality of operation keys such as a power key, a shutter key, a mode switching key used for switching between a shooting mode and a reproduction mode, a cursor key, and a determination key. Be monitored. The cursor key and the enter key are used for displaying the menu screen, selecting setting items, changing setting contents, and the like when the user performs settings related to various functions of the digital camera 1. The GPS unit 9 measures a current position using a known GPS (Global Positioning System), and supplies the measurement result, that is, position data of latitude and longitude indicating a shooting point to the CPU 2.

  The program storage unit 11 is a memory in which stored contents can be rewritten, and is a built-in flash memory, for example. The program storage unit 11 stores a program for causing the CPU 2 to control each unit described above and setting data regarding the operation content of the digital camera 1.

  The program includes a program for causing the CPU 2 to execute various kinds of control required for photographing such as AE (Auto Exposure) control and AWB (Auto White Balance) control at the time of photographing, and various processes described later. The setting data includes the use contents of various functions set by the user and the setting contents regarding the details of the various functions. The setting contents include contents indicating whether or not the addition of the above-described position information (latitude and longitude) to the photographed image acquired at the time of photographing is valid or invalid. Further, the setting data includes position data composed of latitude and longitude indicating a specific point such as a home registered as a reference point by the user, and time data set as a specified time described later by the user.

  The movement history storage unit 10 is composed of a built-in flash memory built in the digital camera 1 and stores the measurement result of the GPS unit 9 as movement history data indicating the movement history of the user. FIG. 2 is a conceptual diagram showing the movement history data 101 stored in the movement history storage unit 10. As shown in FIG. 2, the movement history data 101 is a series of data in which one record is a set of data consisting of serial number (No.) indicating the storage order of data, date and time, latitude and longitude. is there.

  The map data storage unit 12 is a memory composed of a built-in flash memory or the like for storing map data including prefectural name, municipality name, sightseeing spot or tourist facility name, etc. at any point specified by topographic information, latitude and longitude It is.

  The digital camera 1 having the above configuration is provided with a point registration function for registering a desired point as a reference point. When the user designates point registration from the setting screen described above by a predetermined key operation, the CPU 2 causes the GPS unit 9 to perform a measurement operation, and the positioning result is stored in the program storage unit 11 together with other setting data as position data indicating the reference point. Remember. As a result, the user can register home or the like as the reference point.

  In addition, the digital camera 1 is provided with a constant positioning mode as an operation mode that can be used by the user, in addition to the shooting mode and the reproduction mode, and an image classification mode as an operation mode lower than the reproduction mode. The constant positioning mode is an operation mode that can be used in combination with the shooting mode and the playback mode, and the current position measurement operation (hereinafter referred to as periodic positioning) is periodically performed while the main power is on. This is an operation mode for accumulating the movement history data 101 described above in the movement history storage unit 10. The image classification mode is an operation mode for automatically classifying a plurality of captured images stored as still image files in the image storage unit 6.

  Hereinafter, the operation according to the present invention of the digital camera 1 of the present embodiment will be described. First, in the digital camera 1, the operation when the user always uses the positioning mode and the shooting mode is set while the addition of the position information (latitude and longitude) to the shot image is set to be valid. Will be described. FIG. 3 is a flowchart showing the processing of the CPU 2 in that case.

  As shown in FIG. 3, when the CPU 2 starts processing together with the setting of the shooting mode, it confirms whether or not the periodic positioning in the GPS unit 9 is stopped, and the periodic positioning is not stopped at the beginning of the processing. (Step SA1: NO) Immediately it is confirmed whether or not the timing is the positioning timing at which the position measurement by the regular positioning should be performed (Step SA2).

  If it is the positioning timing (step SA2: YES), the CPU 2 causes the GPS unit 9 to measure the current position, and the movement history storage unit as the movement history data 101 described above together with the date and time data obtained from the built-in clock 2a. 10 (step SA3).

  Next, the CPU 2 confirms whether or not there is a photographing instruction by the user operating the shutter key (step SA5). If it is not the positioning timing in the process of step SA2 (step SA2: NO), the CPU 2 immediately checks whether there is a shooting instruction (step SA5).

  If there is no shooting instruction (step SA5: NO), the CPU 2 returns to the process of step SA1, and if there is a shooting instruction (step SA5: YES), the CPU 2 performs a shooting process (step SA6). Further, the GPS unit 9 is caused to measure the current position regardless of whether or not the positioning timing has arrived. Thereafter, the CPU adds the measurement result (position information) by the measurement operation to the captured image acquired by the imaging process in step SA6 and stores it in the image storage unit 6 (step SA7). That is, the image storage unit 6 stores a still image file to which attached information including the latitude and longitude of the shooting point, the shooting date and time, and the like is added. In the process of step SA7, the latitude and longitude added to the photographed image and the photographing date / time are also stored in the movement history storage unit 10 as the movement history data 101.

  Subsequently, if the regular positioning is not stopped (step SA9: YES), the CPU 2 stops the regular positioning at that time (step SA10) and counts the elapsed time after the stop by the timer function using the internal clock. Start (step SA11). Thereafter, the CPU 2 returns to the process of step SA1.

  While stopping the regular positioning (step SA1: YES), the CPU 2 sequentially checks whether or not the elapsed time has reached a predetermined time (for example, 30 minutes) determined in advance (step SA12). . Then, until the specified time is reached (step SA12: NO), the CPU 2 sequentially checks the presence / absence of shooting instructions while maintaining the periodic positioning stopped state, and every time there is a shooting instruction (step SA5: YES), as described above. The storage of the photographed image to which the information such as the photographing date and time including the photographing process, the position measurement, and the position information is added is repeated (steps SA6 to SA8).

  In addition, if the stoppage elapsed time of the regular positioning reaches the specified time while repeating the above process (step SA12: YES), the CPU 2 resumes the regular positioning by the GPS unit 9 at that time (step SA13).

  Thereafter, the CPU 2 performs the above-described processing until the shooting mode ends, that is, until the user switches the operation mode from the shooting mode to the playback mode or the power is turned off (step SA14: NO). repeat. Then, the CPU 2 ends the processing in the shooting mode when the shooting mode ends (step SA14: YES). Although not shown in the figure, the CPU 2 resumes the regular positioning at that time when the regular positioning is stopped at the end of the photographing mode.

  As described above, in the digital camera 1, while the constant positioning mode is used by the user, the above-described movement history data 101 is accumulated in the movement history storage unit 10 by performing regular positioning in the GPS unit 9. Is done. In addition, in the shooting mode during that time, if the addition of position information (latitude and longitude) to the captured image is valid, when shooting is performed by the user, the current position is not limited to the current positioning timing in the regular positioning. The position is measured and the measurement result is added to the captured image. In addition, after the shooting, the regular positioning in the GPS unit 9 is stopped until the specified time elapses, and is restarted when the specified time elapses.

  Next, an operation when the above-described image classification mode is set by the user in the state where the user's home is set as the reference point by the above-described point registration function in the digital camera 1 will be described. FIG. 4 is a flowchart showing processing executed by the CPU 2 in the image classification mode.

  As shown in FIG. 4, when the CPU 2 starts the process together with the setting of the image classification mode, the CPU 2 reads the movement history data 101 from the movement history storage unit 10 (step SB1), and executes the period determination process shown in FIG. Step SB2). The period determination process is a process of determining an event period that is an action period that should be distinguished from other periods in the user's past movement period by analyzing the movement history data 101. Further, the event period determined here is, for example, a period during which the user is traveling.

  Hereinafter, the content of the period determination process will be specifically described with reference to FIG. 6 according to the flowchart of FIG. FIG. 6 is an explanatory diagram showing an example of the user's movement route indicated by the movement history data 101 for the sake of convenience. Each day's movement route (k1, k2, k3, k4 in the figure) is indicated by an arrow. It is shown by.

  As shown in FIG. 5, in the period determination process, the CPU 2 first starts from the registered home in the user's past movement paths (all movement paths) indicated by the latitude and longitude data in the movement history data 101. One or a plurality of movement paths are specified (step SB101). More specifically, one or a plurality of movement routes starting from a certain range of points centered on a specific point specified by position data indicating the home is specified. That is, when the user's past travel routes (all travel routes) are as shown in FIG. 6, a series of travel routes for three days consisting of a travel route k1 for one day and travel routes k2 to k4; Are specified.

  Next, the CPU 2 refers to the date / time data of the movement history data 101 from the one or more movement paths, and excludes the movement path whose home is the end point on the same day (step SB102). That is, a route whose home is the starting point and the ending point, such as the moving route k1 shown in FIG. 6, and which has the same date and time at the starting point and the ending point is excluded. Then, if there is no movement route that remains unexcluded in the process (step SB103: NO), the CPU 2 immediately ends the period determination process and returns to the process of FIG.

  On the other hand, when one or a plurality of travel routes remain (step SB103: YES), the date / time data of the travel history data 101 is referred to, and from one or a plurality of travel periods corresponding to the one or more travel routes, One or a plurality of periods excluding the day of returning home at the set specified time are set as candidate periods (step SB104). This candidate period is a period that is a candidate event period to be determined.

  For example, if the arrival time at the end (home) of the travel route k4 shown in FIG. 6 is before the specified time, the period corresponding to the travel routes k2, k3 for two days is a candidate period, and the travel route k4 If the arrival time at the end of the period is after the specified time, a period corresponding to a series of travel routes including a series of travel routes k2 to k4 for three days is a candidate period.

  Subsequently, the CPU 2 sequentially sets the candidate periods set as described above as confirmation targets (step SB105), and performs the following processing. That is, in the candidate period to be confirmed, it is confirmed whether there is a set of photographed images that were photographed one after the other at a point separated by a predetermined distance or more (step SB106).

  In such processing, the CPU 2 calculates the distance between the shooting points while sequentially switching a set of shot images with shooting dates and times that are the same for all the shot images shot during the candidate period to be checked, The process of confirming whether or not it is greater than or equal to a predetermined distance is repeated, and it is confirmed whether or not there is one or a plurality of corresponding captured images. At that time, if the position information indicating the shooting point is not added to one or both of the corresponding shot images, the CPU 2 refers to the movement history data 101 and takes a positioning point corresponding to the shooting date and time. A point. Note that the distance between the shooting points calculated here may be a linear distance on the map or a distance on the moving route.

  If there is no set of captured images that meet the above conditions (step SB106: NO) and there is another candidate period that should be confirmed (step SB108: YES), the CPU 2 sets a new candidate period. After being set as a confirmation target (step SB105), the confirmation processing in step SB106 is repeated.

  If there is one or more sets of captured images that meet the above conditions (step SB106: YES), the CPU 2 sets a period divided by the shooting date and time of each captured image as the final candidate period (step SB106). SB107).

  For example, the candidate period to be confirmed is a period corresponding to a series of travel routes k2 to k4 for 3 days shown in FIG. 6, and a corresponding set of captured images is indicated by p1 and p2 shown in FIG. In the case where only the image was taken at the point, the next period is individually set as a candidate period.

  That is, a period with the start date and time of the movement route k2 as the head and the shooting date and time at the point p1 as the end, and a period with the shooting date and time at the point p2 as the head and the start date and time as the movement path k4 as the end Set as a candidate period individually. Although not shown in the drawing, if there are two sets of captured images corresponding to the above-described conditions in all the captured images captured in the candidate period for confirmation, four periods different from the candidate period for confirmation are included. Are individually set as candidate periods.

  In other words, for example, if there is a period in which the distance traveled without shooting during the travel period is greater than or equal to a predetermined distance, it is considered that the user has moved from one tourist area to another, so the candidate period Only the period that is considered to be staying at each sightseeing spot is individually set as the final candidate period.

  Thereafter, if there is another candidate period to be confirmed (step SB108: YES), the CPU 2 sets a new candidate period as the confirmation target (step SB105), and repeats the above-described processing. Then, when there is no other candidate period to be confirmed (step SB108: NO), the CPU 2 specifies the candidate period (one or more candidate periods) specified by the above-described process as the event period (step SB109). ), The period discrimination process is terminated and the process returns to the process of FIG.

  Subsequently, in the image classification mode, when the event period cannot be specified (determined) by the above-described period determining process (step SB3: NO), the CPU 2 displays on the display unit 7 that the captured image cannot be classified. (Step SB10), and all the processes are terminated.

  On the other hand, when the event period can be specified (determined) (step SB3: YES), the CPU 2 determines the stay period of the user during the event period based on the movement history data 101 for one or more event periods that can be determined. Acquires the place name of the longest place (step SB4).

  In this process, the CPU 2 confirms the place name corresponding to each position measurement point in the event period in the map data, and the place name that has been confirmed as the corresponding place name is the longest stay period of the user. The place name of the place. In addition, the place name corresponding to each position measurement point is a tourist place name when there is a corresponding tourist place name (name of temple, shrine, ruins, scenic spot, tourist facility, etc.), and there is no corresponding tourist place name. The name of the municipality.

  Thereafter, the CPU 2 creates an event folder for each event period to which the name including the acquired place name (tourist place name or city name) is assigned in the image storage unit 6 (step SB5). A specific folder name is a folder name consisting of only “location name” (for example, “ATAMI”), or a folder name consisting of “date” and “location name” (for example, “201510101 ATAMI”). However, if the number of characters such as “location name” exceeds the prescribed number that can be used as the folder name, the number of characters at the beginning is assumed.

  Next, the CPU 2 confirms the shooting date and time by sequentially processing a plurality of captured images (still image files) stored in the image storage unit 6 (step SB6), and it is not within any event period (step SB6). If there is another captured image (step SB9: YES), the same processing is performed on the next captured image as a processing target (step SB6, step SB7).

  On the other hand, if the confirmed shooting date / time is within any event period (step SB7: YES), the CPU 2 includes the captured image to be processed in the event folder corresponding to the shooting date / time, that is, the shooting date / time. Stored in the event folder corresponding to the specific event period (step SB8). Note that specific processing for storing the captured image in the event folder may be movement or copying.

  Then, the CPU 2 completes the processing in the image classification mode when the processing after step SB6 is completed for all the captured images stored in the image storage unit 6 (step SB9: YES). Through the above processing, a plurality of captured images stored in the image storage unit 6 are stored in a grouped state in folders created for each event period.

  FIG. 7 is a conceptual diagram showing a storage structure of a still image file (captured image) in the image storage unit 6 after the processing in the image classification mode described above is executed, and a plurality of periods are determined as event periods. It is the figure which showed the case. In other words, in accordance with the processing in the image classification mode, the event folder 202 in which a name such as “location name” is attached to a lower level of the camera folder 201 in which a still image file generated at the time of shooting is stored is assigned according to a specific event period. Are created individually. Then, a still image file (0025.JPG, 0026.JPG, 0027.JPG,...) Of a group of photographed images taken during the corresponding event period is stored in the event folder 202.

  As described above, in the image classification mode, by analyzing the movement history data indicating the movement history of the user, an event period such as a period during which the user is traveling is determined, and a plurality of captured images are captured. Classify according to event period based on date and time. Therefore, compared with the case where classification is based only on the date / time and position distribution information at the time of photographing of each photographed image, for example, the photographed images photographed during the same trip are not classified more precisely. Therefore, a plurality of captured images can be classified more accurately.

  In addition, when determining the event period, if there is a set of captured images that have a shooting distance that is greater than or equal to the determined distance between the shooting points, A period with the shooting date and time as the end and a period with the shooting date and time of the shot image taken later as the head are individually set as event periods. Therefore, it is possible to more specifically determine the event period in accordance with the user's actual behavior during travel or the like, and it is possible to classify a plurality of captured images more accurately.

  Further, when determining the event period, the event period is specified from the movement period corresponding to the movement route excluding the movement route whose home ends at the same day. That is, in the user's past movement route, the movement period of the section excluding the section where the home starts and ends during the same day is set as the event period. This also makes it possible to more accurately determine an event period that should be distinguished from other periods, and to classify a plurality of captured images more accurately.

  In determining the event period, a period excluding the day when the user returns to the home at a specified time from the movement period corresponding to the past movement route of the user is set as the event period. That is, in the past movement period of the user, the movement period including the day when the user has not returned to the home at the specified time is set as the event period. This also makes it possible to more accurately determine an event period that should be distinguished from other periods, and to classify a plurality of captured images more accurately.

  In addition, in the image classification mode described above, when creating a folder for each event period, the location name of the place where the user's stay period in the corresponding event period is the longest is acquired, and a name including the acquired location name is given. Create a folder. Therefore, after classifying a plurality of captured images, it is possible to improve workability when reproducing captured images during an event period desired by the user.

  In the present embodiment, when the above-described event period is determined, it is a movement period of a section excluding a section where the home starts and ends on the same day on the user's past movement route (hereinafter referred to as the first period). And a period excluding the day when the user returns to the home at the specified time from the travel period corresponding to the user's past travel route (hereinafter referred to as the second condition). Was determined as the event period. However, when implementing the present invention, a period that satisfies only one of the first condition and the second condition may be set as the event period.

  Also, for example, it is expected that the event period is different from the period of travel, for example, after leaving home, and then returning to the home on the same day, or the time to return to home is irregular. When the action period is such that the event period may be determined without providing the first condition or the second condition. Even in that case, it is possible to classify a plurality of captured images more accurately as compared with the case of simply classifying based on the date / time and position distribution information at the time of capturing each captured image.

  In addition, if there is a set of captured images that have a shooting date and time that is greater than or equal to a predetermined distance between the respective shooting points, the captured image that was captured first in the set of captured images The period with the last shooting date and time and the period with the first shooting date and time of the captured image taken later as the event period were individually set as event periods. However, also in this regard, when the present invention is implemented, it is not always necessary to use individual event periods. Even in that case, it is possible to classify a plurality of captured images more accurately as compared with the case of simply classifying based on the date / time and position distribution information at the time of capturing each captured image.

  On the other hand, in the digital camera 1 of the present embodiment, while the constant positioning mode is being used by the user as described above, the GPS unit 9 performs a regular positioning operation, whereby the movement history data described above is performed. 101 is accumulated in the movement history storage unit 10. In addition, in the shooting mode during that time, if the addition of position information (latitude and longitude) to the shot image is valid, when shooting is performed by the user, the current position of the current position is determined at that time regardless of the positioning timing in the regular positioning. Measurement is performed, and the measurement result is added to the captured image. In addition, after the shooting, the regular positioning in the GPS unit 9 is stopped until the specified time elapses, and is restarted when the specified time elapses.

  That is, while the movement history data 101 used for the determination of the event period is acquired, the acquisition of the movement history data 101 is stopped within a range that does not affect the determination of the event period. Thereby, the data amount of the movement history data 101 accumulated in the movement history storage unit 10 can be reduced, and at the same time, the power required for obtaining the movement history data 101 can be reduced.

  Unlike the present embodiment, in order to reduce the data amount of the movement history data 101 and the power required to acquire the movement history data 101 within a range that does not affect the determination of the event period, the following may be performed. For example, while the constant positioning mode is used, the measurement interval of the current position by the GPS unit 9 may be increased in proportion to the distance from a registered reference point such as a home. In that case, every time the CPU 2 causes the GPS unit 9 to measure the current position, the CPU 2 calculates the distance between the current position and the position of the registered reference point, and in proportion to that, until the next position measurement. What is necessary is just to perform the process which lengthens time. The above distance may be a linear distance on the map or the distance of the user's travel route up to that point.

  Furthermore, unlike the above, while the constant positioning mode is used, the measurement interval of the current position in the GPS unit 9 may be increased or decreased in consideration of the shortest required time to the reference point. In that case, every time the GPS unit 9 measures the current position, the CPU 2 calculates the shortest required time from the current position to the position of the registered reference point. What is necessary is just to perform the process which shortens the time to position measurement.

  Moreover, although this embodiment demonstrated the case where this invention was implement | achieved in the digital camera 1 provided with the GPS part 9, not only this but this invention is realizable also in a smart phone, for example. In that case, it is only necessary to perform the same processing as the processing in the image classification mode described above on the smartphone, and the plurality of captured images to be classified may be captured by a camera included in the smartphone, or arbitrarily from the digital camera 1. What was acquired by the method of. Also, the movement history data 101 described above may be acquired by the GPS function of the smartphone or may be acquired by the digital camera 1.

  Further, when the present invention is realized in a smartphone, the location name corresponding to each position measurement time point is acquired via a communication line from another device in which map data is stored, for example, a server operated by a communication carrier. It doesn't matter. Furthermore, the place name data corresponding to each position measurement time may be stored as movement history data together with the date, latitude, and longitude data.

  In addition, the present invention is not limited to a smartphone and can be realized in other devices such as a personal computer. In such a case as well, a process similar to the process in the image classification mode described above may be performed in a personal computer or the like. However, in that case, the plurality of captured images to be classified and the movement history data 101 described above are obtained from the digital camera 1 or the like (including a smartphone). In addition, when only a plurality of captured images to be classified are acquired from the digital camera 1 or the like, the above-described movement history data 101 is another mobile device having a positioning function that can be carried by the user together with the digital camera 1 such as a smartphone. Obtained from information equipment.

As mentioned above, although embodiment of this invention and its modification were demonstrated, as long as these are in the range with which the effect of this invention is obtained, it can change suitably, and embodiment after change is also in a claim. It is included in the scope of the invention described and equivalent invention. The invention described in the scope of the claims of the present application will be appended below.
[Claim 1]
An image classification device for classifying a plurality of captured images taken by a user,
A movement history acquisition means for acquiring movement history information including a series of date and time information and position information indicating the movement history of the user;
An action period determining means for determining an action period to be distinguished from other periods in the past movement period of the user by analyzing the movement history information acquired by the movement history acquiring means;
An image classification device comprising: an image classification unit that classifies the plurality of captured images according to an action period determined by the action period determination unit based on each shooting date and time.
[Claim 2]
The image classification apparatus according to claim 1, wherein the movement history acquisition unit acquires movement history information including a date and time that is different from a date and time or position at which the captured image was taken.
[Claim 3]
In the plurality of captured images, the action period determination unit is equal to or longer than a distance determined between shooting points corresponding to shooting dates and times indicated by the movement history information. When a set of captured images is included, a period having the shooting date and time of the previously captured image as the end and a period having the captured image captured at the beginning as the action period are individually determined as the action period The image classification device according to claim 1 or 2.
[Claim 4]
A registration means for registering a specific point on the map as a reference point;
The action period determination means is a section of a section excluding a section in which the reference point registered by the registration means is a starting point and an ending point on the same day on the movement route of the user indicated by a series of position information in the movement history information. The image classification apparatus according to claim 1, wherein a movement period is determined as the action period.
[Claim 5]
A registration means for registering a specific point on the map as a reference point;
The action period determination means includes a movement period including a date that has not returned to the reference point registered by the registration means by a specified time among the movement periods indicated by a series of date and time information in the movement history information. The image classification device according to claim 1, wherein the image classification device is determined as a period.
[Claim 6]
6. The image classification apparatus according to claim 5, wherein the specified time is a time immediately before a date change.
[Claim 7]
Based on a series of position information in the movement history information acquired by the movement history acquisition means, a place name acquisition means for acquiring a place name of a place having the longest user stay period in the action period determined by the action period determination means Further comprising
The image classifying unit stores a photographed image whose photographing date and time is included in the action period among the plurality of photographed images in a storage location to which a name including the place name obtained by the place name obtaining unit is assigned. The image classification device according to claim 1, wherein the image classification device is an image classification device.
[Claim 8]
A positioning means for periodically measuring the current position;
A measurement result storage means for storing a series of measurement results by the positioning means in association with date and time information; and
The movement history acquisition means acquires a series of date and time information and position information stored in association with each other in the measurement result storage means as the movement history information. The image classification device according to item.
[Claim 9]
The image classification apparatus according to claim 2, wherein the movement history acquisition unit acquires movement history information including date and time information acquired asynchronously with the shooting timing of the captured image. .
[Claim 10]
A shooting recording unit that records and associates position information acquired at the time of shooting with respect to a shot image shot in accordance with a user's shooting instruction;
9. The positioning device according to claim 8, wherein when the position information at the time of shooting is acquired by the shooting and recording unit, the positioning unit stops measuring the current position during a predetermined period corresponding to the shooting. Image classification device.
[Claim 11]
Imaging means for acquiring the captured image;
Image storage means for storing captured images acquired by the imaging means,
The image classification unit classifies the plurality of captured images stored in the image storage unit according to the action period determined by the action period determination unit based on each shooting date and time. The image classification device according to any one of 1 to 10.
[Claim 12]
The image classification unit generates a folder with a name including the location name in the image storage unit as the storage location, and stores a plurality of captured images whose shooting dates and times are included in the action period in the folder. The image classification device according to claim 11, wherein
[Claim 13]
A setting unit is provided for setting whether to add the measurement result of the positioning unit to the captured image together with the shooting date when storing the captured image acquired by the imaging unit in the image storage unit. The image classification apparatus according to claim 11 or 12, wherein
[Claim 14]
While the setting means is set to add the measurement result of the positioning means to the photographed image, the positioning means stops the periodic measurement operation until the prescribed time elapses from the time of photographing, and the prescribed time 14. The image classification apparatus according to claim 13, further comprising a positioning control unit that causes the positioning unit to resume a periodic measurement operation after a lapse of time.
[Claim 15]
15. The positioning interval control means for further increasing the measurement interval of the current position in the positioning means in proportion to the distance from the reference point registered by the registration means. The image classification device according to item.
[Claim 16]
It further comprises positioning interval control means for increasing or decreasing the current position measurement interval in the positioning means in consideration of the shortest required time from the point indicated by the measurement result of the positioning means to the reference point registered by the registration means. The image classification device according to claim 11, wherein the image classification device is an image classification device.
[Claim 17]
An image classification method for classifying a plurality of captured images taken by a user,
A movement history acquisition process for acquiring movement history information including a series of date and time information and position information indicating the movement history of the user;
An action period determination process for determining an action period to be distinguished from other periods in the past movement period of the user by analyzing the movement history information acquired by the movement history acquisition process;
An image classification method, comprising: an image classification process for classifying the plurality of captured images according to the action period determined by the action period determination process based on each shooting date and time.
[Claim 18]
In a computer having an image classification device that classifies a plurality of captured images taken by a user,
A movement history acquisition function for acquiring movement history information including a series of date and time information and position information indicating the movement history of the user;
An action period determination function for determining an action period to be distinguished from other periods in the past movement period of the user by analyzing the movement history information acquired by the movement history acquisition function;
An image classification function for classifying the plurality of captured images according to an action period determined by the action period determination function based on each shooting date and time.

1 Digital camera 2 CPU
2a built-in clock 3 imaging unit 4 working memory 5 image processing unit 6 image storage unit 7 display unit 8 input unit 9 GPS unit 10 movement history storage unit 11 program storage unit 12 map data storage unit 101 movement history data 201 camera folder 202 event Folder k1 to k4 Travel route for one day

Claims (15)

An image classification device for classifying a plurality of captured images taken by a user,
Positioning means for periodically measuring the current position of the user;
A movement history acquisition means for acquiring a correspondence between a series of positioning results by the positioning means and date and time information as indicating the movement history of the user ;
Photographing recording means for associating and recording, as position information, a positioning result by the positioning means at the time of the photographing instruction with respect to a photographed image photographed in accordance with the photographing instruction;
When the position information at the time of shooting is recorded by the shooting and recording means, the movement history based on the position information at the time of shooting is acquired instead of acquiring the movement history based on the regular positioning by the positioning means. Control means for controlling the movement history acquisition means,
Analyzing the movement history information acquired by the movement history acquisition means, action period determination means for determining an action period corresponding to a photographed image to be classified as the same period in the past movement history of the user;
Image classification means for classifying the plurality of captured images according to the action period determined by the action period determination means based on each shooting date;
An image classification apparatus comprising:   The image classification apparatus according to claim 1, wherein the movement history acquisition unit acquires movement history information including a date and time that is different from a date and time or position at which the captured image was taken.   In the plurality of captured images, the action period determination unit is equal to or longer than a distance determined between shooting points corresponding to shooting dates and times indicated by the movement history information. When a set of captured images is included, a period having the shooting date and time of the previously captured image as the end and a period having the captured image captured at the beginning as the action period are individually determined as the action period The image classification device according to claim 1 or 2. A registration means for registering a specific point on the map as a reference point;
The action period determination means includes a section excluding a section in which the reference point registered by the registration means is a starting point and an ending point on the same day on the movement route of the user indicated by a series of position information in the movement history information. Distinguishing it from the action period;
4. The image classification apparatus according to claim 1, 2, or 3. A registration means for registering a specific point on the map as a reference point;
The action period determination means determines, as the action period, a section including a date that has not returned to the reference point registered by the registration means by a specified time in a series of date and time information in the movement history information.
4. The image classification apparatus according to claim 1, 2, or 3 .   6. The image classification apparatus according to claim 5, wherein the specified time is a time immediately before a date change. Based on a series of position information in the movement history information acquired by the movement history acquisition means, a place name acquisition means for acquiring a place name of a place having the longest user stay period in the action period determined by the action period determination means Further comprising
The image classifying unit stores a photographed image whose photographing date and time is included in the action period among the plurality of photographed images in a storage location to which a name including the place name obtained by the place name obtaining unit is assigned. ,
The image classification device according to claim 1, wherein the image classification device is an image classification device. Imaging means for acquiring the captured image;
Image storage means for storing captured images acquired by the imaging means,
The image classification means classifies the plurality of captured images stored in the image storage means according to the action period determined by the action period determination means based on each shooting date and time.
The image classification device according to claim 1, wherein the image classification device is an image classification device. The image classification unit generates a folder with a name including the location name in the image storage unit as the storage location, and stores a plurality of captured images whose shooting date and time are included in the action period in the folder.
The image classification apparatus according to claim 8, wherein: Setting means is provided for setting whether or not to add the positioning result of the positioning means to the captured image together with the shooting date when storing the captured image acquired by the imaging means in the image storage means. The image classification apparatus according to claim 8 or 9, wherein When the setting means is set to add the positioning result of the positioning means to the captured image, the positioning means stops the positioning operation periodically until a specified time elapses from the time of shooting, and the specified time Positioning control means for causing the positioning means to resume periodic positioning operation after elapse of time.
The image classification apparatus according to claim 10, further comprising: The positioning interval of the current position before Symbol positioning means, any one of claims 4 to 6, further comprising a positioning interval control unit configured to increase in proportion to the distance from the reference point registered by the registration means The image classification device according to item 1 . It further comprises positioning interval control means for increasing or decreasing the positioning interval of the current position in the positioning means in consideration of the shortest required time from the point indicated by the positioning result of the positioning means to the reference point registered by the registration means. The image classification device according to claim 4, wherein the image classification device is an image classification device. An image classification device for classifying a plurality of captured images taken by a user,
A positioning process for periodically measuring the current position of the user;
A movement history acquisition process for acquiring a series of positioning results and date / time information associated with the positioning process as an indication of the movement history of the user ;
Shooting and recording processing for recording, as a positional information, a positioning result obtained by the positioning processing at the time of the shooting instruction with respect to a shot image shot according to the shooting instruction;
When the position information at the time of shooting is recorded by the shooting and recording process, the movement history based on the position information at the time of shooting is acquired instead of acquiring the movement history based on the regular positioning by the positioning process. A control process for controlling the movement history acquisition process to
By analyzing the movement history information acquired by the movement history acquisition process, an action period determination process for determining an action period corresponding to a photographed image to be classified as the same period in the past movement history of the user;
An image classification process for classifying the plurality of captured images according to the action period determined by the action period determination process based on each shooting date;
An image classification method comprising: In a computer having an image classification device that classifies a plurality of captured images taken by a user,
A positioning function for periodically measuring the current position of the user;
A movement history acquisition function for acquiring a correspondence between a series of positioning results and date / time information by the positioning function as an indication of the user's movement history;
A shooting recording function for recording a position of the positioning result obtained by the positioning function at the time of the shooting instruction in association with the position of the shot image shot according to the shooting instruction;
When position information at the time of shooting is recorded by the shooting and recording function, a movement history based on the position information at the time of shooting is acquired instead of acquiring a movement history based on periodic positioning by the positioning function. A control function for controlling the movement history acquisition function,
An action period determination function for determining an action period corresponding to a photographed image to be classified as the same period in the past movement history of the user by analyzing the movement history information acquired by the movement history acquisition function;
An image classification function for classifying the plurality of captured images according to an action period determined by the action period determination function based on each shooting date and time;
A program characterized by realizing.

Images