JP2007018408A - Image retrieval apparatus having function for retrieving image by periodical date and time, and image retrieval program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain new image retrieval by introducing the new retrieval conditions such as periodically repetitive date and time. <P>SOLUTION: An image retrieval apparatus is provided with a reference time input part, an interval period input part and a retrieval part. The reference time input part is a means for accepting data input for the reference time. The interval period input part is a means for accepting data input for an interval period. The retrieval part retrieves image data from among an image data group, under the retrieval condition that the shooting date and time of the image data matches or is closest to the periodical date and time sequentially obtained by adding an integral multiple of the interval period to the reference time. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image search technique based on date and time.

Conventionally, a general search technique for performing a file search using a file name, date / time, or period as a search condition is known.
Patent Document 1 discloses a technique for image search based on the date of birth and age. That is, in a situation where “Birth date: September 7, 2000” is registered as personal information of Mr. A, “when Mr. A is three years old” is input as a search key. From these pieces of information, the image retrieval apparatus obtains a period “September 7, 2003 to September 6, 2004” when Mr. A is three years old as a retrieval condition. The image search apparatus can search for an image when Mr. A is three years old by executing an image search according to the search condition. By such an operation, the user can easily search for an image of the desired age without having to perform troublesome conversions such as the year and the number of years only by using the desired age of the family as a search key. .
JP 2004-78801 A

  In recent years, with the spread of digital cameras, images after photographing are gradually accumulated, and as a result, there are cases where a large number of images are privately held. It is very cumbersome and difficult to manage such a large number of images and find a desired image.

  In particular, a digital camera with excellent continuous shooting performance shoots a lot of continuous images with almost the same pattern in a short time. For this reason, when images are browsed one by one later, continuous shot images having almost the same pattern must be browsed many times, which is inefficient and takes time to browse.

  Therefore, an object of the present invention is to realize an image search that has not existed before by introducing a new search condition of a date and time that is periodically repeated.

<< 1 >> The image search apparatus of the present invention includes a reference time input unit, an interval period input unit, and a search unit.
The reference time input unit is means for receiving data input of the reference time.
The interval period input unit is means for receiving data input of the interval period.
The search unit retrieves image data from the image data group under a search condition that the shooting date and time of the image data matches or is closest to any one of the periodic dates and times sequentially obtained by adding an integral multiple of the interval period to the reference time. Search for.

<< 2 >> Preferably, the search unit gives an approximate width to the periodic date and time for a predetermined approximate period. The search unit searches for the image data on the condition that the photographing date and time falls within this approximate width.

<< 3 >> Also preferably, the search unit has a function of registering a search condition determined from the reference time and the interval period. The search unit searches the image data according to the designation of the registered search condition.

<< 4 >> Preferably, when there is no image data that satisfies the condition for the cycle date and time, the search unit displays a message indicating that it cannot be found.

<< 5 >> The image search program of the present invention is a program for causing a computer to function as the reference time input unit, the interval period input unit, and the search unit according to any one of the above << 1 >> to << 4 >>. is there.

  In the present invention, a periodic date and time obtained by adding an integer multiple of the interval period to the reference time is used, and the image data is searched under a search condition such that the shooting date and time matches or is closest to any of these periodic dates and times. Therefore, it is possible to search for image data photographed at a substantially constant interval from the reference date and time.

<< Description of Configuration of this Embodiment >>
FIG. 1 is a block diagram illustrating a configuration of the image search apparatus 11.
The image search apparatus 11 performs an image search from the image data group 15 of still images stored in advance according to the search condition input by the input device 10 or the like, and displays the search result on the display unit 16.

The image search device 11 is configured with the following internal configuration.
(1) Reference time input unit 12 .. Accepts data input of a reference time.
(2) Interval period input unit 13 .. Accepts data input for the interval period.
(3) Search unit 14 ..Searches for image data corresponding to a periodic date determined from the reference time and the interval period.

  In addition, you may implement | achieve these internal structures 12-14 by software by running an image search program on a computer. Moreover, it is also possible to implement | achieve part or all of these internal structures 12-14 by hardware. Furthermore, it is also possible to realize these internal configurations 12 to 14 by integrating database systems and client terminals arranged on the Internet.

<< Explanation of operation of this embodiment >>
FIG. 2 is a flowchart showing the operation of the present embodiment.
3 and 4 are diagrams showing an example of the screen display of this embodiment.
Hereinafter, the operation of this embodiment will be described with reference to these drawings.

Step S1: The search unit 14 reads out a file identifier (file name and the like) and shooting date / time information from the image data group 15 to be searched. The search unit 14 creates a shooting date list on the internal memory by sorting these pieces of information in order of shooting date. If there is no change in the image data group 15 since the previous creation of the shooting date list, the search unit 14 can omit the list creation again.

Step S2: The search unit 14 reads the search condition registration list recorded so far. This registration list is a list in which a search condition including a reference time and an interval period and a title of a registration button (hereinafter referred to as “caption”) are registered.
The search unit 14 sequentially creates registration buttons as shown in FIG. 4 on the internal memory as GUI objects according to the registration list, and prepares for button display.
If there is no change in the registration list since the previous GUI object creation, the search unit 14 can omit the object creation again.

Step S3: The search unit 14 displays a screen as shown in FIG. Through this screen display, a GUI operation from the user is accepted. The operation branches to steps S4 to S7 according to the type of GUI operation received.
As the input device 10 for GUI operation, general input devices such as a keyboard, a mouse, a touch panel, and a cross key can be used.
As the input device 10, the image search apparatus 11 may be provided with a tilt sensor or an acceleration sensor. In this case, the tilt state, acceleration direction, and the like of the image search device 11 are detected, and the focus (focused) position on the screen (for example, the position of the registration button displayed in highlight) is virtually set in the direction of force application. Operation rules such as changing by moving can be adopted. As a result, an input operation based on the tilt direction or acceleration can be realized.

Step S4: Here, a reference time input operation is performed. For example, when the reference input button shown in FIG. 3 is operated, the reference time input unit 12 displays an edit box such as year / month / day / hour / hour / minute / second on the screen and accepts data input of the reference time.
The reference time input unit 12 can also read the shooting date and time of the selected image shown in FIG. 3 and accept the shooting date and time as the reference time.
After these operations, the search unit 14 shifts the operation to step S7.

Step S5: Here, the unit of the interval period is changed. For example, the interval period input unit 13 selects any one of year, month, week, day, hour, minute, and second as a unit of the interval period by a radio button selection operation (including focus movement) shown in FIG. . Depending on the unit selection of the interval period, the input unit and input range of the slide bar shown in FIG. 3 change. After this operation, the search unit 14 shifts the operation to step S7.

Step S6: Here, an operation input for the interval period is performed. For example, by moving the slide bar shown in FIG. 3, the interval period input unit 13 increases or decreases the interval period to determine the value of the interval period. After this operation, the search unit 14 shifts the operation to step S7.

Step S7: The search unit 14 determines whether or not (reference time, interval period) is set as the search condition.
When the search unit 14 determines that the search can be executed when the search conditions are met, the operation proceeds to step S9.
On the other hand, if the search unit 14 determines that the search is not possible because the search conditions are not yet met, the search unit 14 returns the operation to step S3.

Step S8: Here, a search condition is selected by a registration button. To display this registration button, first, the registration list button is operated in the screen state shown in FIG. Then, the search unit 14 displays the registration button prepared in step S2 on the screen as shown in FIG. This registration button displays a caption that briefly represents a search condition such as “marriage anniversary”. The user selects a desired caption and operates the registration button. Then, the search unit 14 reads and sets the search condition corresponding to the registration button from the registration list. After this operation, the search unit 14 shifts the operation to step S9.

Step S9: The search unit 14 acquires a reference time and an interval period from the search conditions. The search unit 14 sequentially obtains the periodic date and time by adding an integer multiple of the interval period to the reference time. This periodic date and time is a date and time periodically arranged from the reference time to the past and the future.
It should be noted that it may be determined in advance whether “period” / “future” / “both past and future” will be used to expand the periodic date and time.
Further, a period covering the shooting date and time of the image data group 15 is obtained from the shooting date and time list created in step S1, and only the period date and time effective for image search can be efficiently obtained by limiting to this period. .

Step S10: Here, the search unit 14 determines whether or not “approximate search” is selected. For example, as shown in FIG. 3 and FIG. 4, it is preferable to accept the approximate search GUI setting by displaying a check box for approximate search.
Here, when the approximate search is selected, the search unit 14 shifts the operation to step S12. On the other hand, when the approximate search is not selected, the search unit 14 shifts the operation to step S11.

Step S11: The search unit 14 refers to the shooting date / time list for each cycle date / time obtained in step S9 and searches for image data whose shooting date / time matches the cycle date / time.
Note that the search unit 14 may search for an image whose shooting date / time is closest to the periodic date / time instead of the image data whose shooting date / time matches the cycle date / time.
In addition, the search unit 14 may perform the matching determination by ignoring a fine time unit difference between the cycle date and time and the shooting date and time according to the unit of the interval period. For example, if the unit of the interval period is minutes, it is preferable to perform the coincidence determination while ignoring the unit of seconds or less.
After completing such a search operation, the search unit 14 shifts the operation to step S13.

Step S12: The search unit 14 sets an approximate period. This approximate period may be set in advance by user input.
In addition, the search unit 14 may obtain a predetermined ratio (such as 0.1 times) of the interval period as an approximate period.
Further, the search unit 14 may determine the approximate period corresponding to the unit of the interval period. For example, if the unit of the interval period is a month, one month may be set as the approximate period.
The search unit 14 has an approximate width corresponding to the approximate period before and / or after the periodic date and time obtained in step S9, and searches for image data on the condition that the photographing date and time falls within this approximate width.
When a plurality of images fall within one approximate width, any one of the plurality of images may be selected as a search image. Further, a predetermined number of images may be selected from a plurality of images as search images. Further, all of the plurality of images may be used as the search image.
After such a search operation, the search unit 14 shifts the operation to step S13.

Step S13: The search unit 14 arranges the searched image data in order of the cycle date and time and displays the thumbnails on the display unit 16.
At this time, for example, image data shot on the wedding anniversary two years ago is found, but image data shot on the wedding anniversary one year ago cannot be found. As described above, a predetermined thumbnail (see FIGS. 3 and 4) indicating “not applicable to the period date” is displayed for the period date and time when the corresponding image data was not found. It should be noted that an information display such as a period date is preferably added to the predetermined thumbnail.
Furthermore, if the search condition (reference time, interval period) is far from the shooting date and time of the image data group 15 and there is no search image, a display indicating “no corresponding image” is displayed.

Step S14: The retrieval unit 14 determines whether or not the button for condition registration (see FIG. 3) has been pressed. When the condition registration button is pressed, the search unit 14 proceeds to step S15. On the other hand, if the condition registration button is not pressed, the search unit 14 returns the operation to step S1.

Step S15: The search unit 14 displays a registration dialog (see FIG. 3) on the display unit 16, and accepts the caption of the registration button as a registration comment. Note that a selection of a caption prepared in advance (such as “Marriage Day” or “Christmas”) may be received by a combo box.
The search unit 14 adds the current search condition and the accepted caption to the registration list. After this registration operation, the search unit 14 returns the operation to step S1.

<< Effects of this embodiment >>
With the operation described above, in the present embodiment, it is possible to immediately search for image data related to a periodic event by simply specifying a search condition.
Further, in this embodiment, it is possible to seamlessly execute an image search based on the periodic date and time while finely adjusting the periodic date and time. By adjusting the period date and time, it is possible to perform flexible image search such as narrowing down to desired image data while checking the search result.

  Furthermore, the image search of this embodiment can set arbitrary interval periods, such as every 11 seconds, every 22 minutes, and every 3 days. With such a flexible setting of the interval period, it is possible to easily realize a new sense of image search such as arbitrarily thinning out image data.

  Furthermore, in this embodiment, approximate search (steps S10 and S12) can also be executed. As a result, it is possible to roughly search image data with a constant period.

  Further, the present embodiment has a function of registering a search condition for the periodic date and time. The above-described image search based on the periodic date and time is an effective image search for shooting date and time added in the future. Therefore, it is possible to easily execute image search by preparing an environment in which search conditions for periodic dates and times can be registered and executed. For example, once the cycle date and time related to the wedding anniversary is registered, image searches related to the wedding anniversary can be executed effectively in the future.

  Further, in the present embodiment, an image search is performed for each of a plurality of periodic dates and times, and “not applicable to the periodic dates and times” is displayed for the periodic dates and times when image data is not found. Therefore, the user can clearly know the partial omission of periodic image data.

  Further, the image search of the present embodiment is suitable for browsing image data including a number of continuous shot image groups. That is, the shooting date and time of a set of continuous shot images are close to each other. Therefore, if a discrete image search is performed based on periodic dates such as seconds, minutes, or hours, a representative image can be roughly selected for each group of continuously shot images. As a result, it is no longer necessary to browse continuously shot images with almost the same pattern, and efficient image browsing becomes possible.

<< Additional items of embodiment >>
In the present embodiment described above, (reference time, interval period) is stored as a search condition at the time of registration. However, the embodiment is not limited to this. For example, as a search condition, any information may be used as long as it is information necessary to determine a periodic date and time determined from a reference time and an interval period. For example, at least two periodic dates and times that are temporally adjacent may be stored as search conditions. Image retrieval similar to that described above can also be performed by deriving the previous and subsequent cycle dates and times from these adjacent cycle dates and times.

  As described above, the present invention is a technique that can be used for an image search apparatus or the like.

2 is a block diagram illustrating a configuration of an image search device 11. FIG. It is a flowchart which shows operation | movement of this embodiment. It is a figure which shows an example of the screen display of this embodiment. It is a figure which shows an example of the screen display of this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Image search device, 12 ... Reference time input part, 13 ... Interval period input part, 14 ... Search part, 15 ... Image data group, 16 ... Display part

Claims (5)

A reference time input unit for receiving reference time data input;
An interval period input unit for receiving data input of the interval period;
The image data is searched from the image data group under a search condition that the shooting date / time of the image data matches or is closest to any one of the periodic dates / times sequentially obtained by adding an integral multiple of the interval period to the reference time. An image search apparatus comprising: a search unit. The image search device according to claim 1,
The search unit gives the approximate width to the periodic date and time for a predetermined approximate period, and searches for the image data on the condition that the photographing date and time falls within the approximate width. Search device. In the image search device according to claim 1 or 2,
The search unit has a function of registering the search condition determined from the reference time and the interval period, and searches the image data according to designation of the registered search condition. . The image search device according to any one of claims 1 to 3,
The image search apparatus according to claim 1, wherein the search unit displays a message indicating that no image data is found when there is no image data that satisfies the condition for the cycle date and time. An image search program for causing a computer to function as the reference time input unit, the interval period input unit, and the search unit according to any one of claims 1 to 4.

Images