JP2010044580A - Camera and retrieval system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera and a retrieval system which can efficiently retrieve photographic subjects. <P>SOLUTION: The system is constituted so that photographic subject retrieval data are stored in a built-in flash memory 109 of the camera 1. The system is constituted so that a retrieval object in an image obtained by image pickup in addition to narrowing down of the photographic subject retrieval data using the current position information acquired from a GPS unit 104 and the current date-and-time information acquired from RTC 105. Thereby, since the photographic subject retrieval data unrelated to the retrieval object can be excluded from the retrieval object, efficient retrieval can be achieved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a camera and a search system that can search for an object based on an image obtained by imaging.

  2. Description of the Related Art An apparatus that captures an image of a subject and retrieves information related to the subject based on an image obtained by capturing the image is known. In this apparatus, when an arbitrary part of the subject displayed on the display device is designated, the shape of the subject is extracted based on the hue of the part. Then, the image data file is narrowed down based on the hue of the subject, and then the image data is narrowed down based on the shape of the subject (see Patent Document 1).

JP 2005-100012 A

  In the device described in the above-mentioned patent document, the image data file is narrowed down based on the hue of the designated part of the subject, but the image data file to be narrowed down includes many that are not related to the subject. Is inefficient.

(1) The camera according to the first aspect of the present invention is an image capturing unit that captures an image of a subject, data for specifying an object, information about a region related to the object, and information about time related to the object Data storage means for storing data having at least one as a search item, and acquisition-time information acquisition for acquiring at least one of imaging point information and imaging timing information when the subject image is captured by the imaging means And a data narrowing-down means for narrowing down data to be used for search out of data stored in the data storage means, using at least one of the information on the imaging point and the information on the imaging time acquired by the information acquisition means at the time of imaging The characteristics of the object (search object) included in the data narrowed down by the data narrowing means and the subject image captured by the imaging means. And a display means for displaying a search result by the search means.
(2) According to the invention of claim 2, in the camera according to claim 1, as a result of searching the search object by the communication means for communicating with the outside of the camera and the search means, the data corresponding to the search object is data In the case where it is not stored in the storage means, it further comprises communication control means for transmitting information related to the characteristics of the search object to the outside via the communication means in order to make the search object search externally, and the display means includes the search When data related to the object is received from the outside via the communication means, information about the search object is displayed based on the received data related to the search object.
(3) The invention of claim 3 is the camera according to claim 1 or 2, wherein the ratio calculation means for calculating the ratio of the search object to the image of the subject image captured by the imaging means, and the imaging means Based on the focal length information acquisition means for acquiring the focal length information of the taking lens when capturing the subject image, the ratio calculated by the ratio calculation means, and the focal length information acquired by the focal length information acquisition means, A size calculating means for calculating the size of the search object is further provided, the data further includes information about the size related to the object as a search item, and the data narrowing means is a search calculated by the size calculating means. The data stored in the data storage unit is narrowed down based on the size of the object.
(4) According to a fourth aspect of the present invention, there is provided a camera according to a fourth aspect of the present invention, an imaging unit that captures a subject image, and an imaging unit that acquires at least one of information on an imaging point and information on an imaging timing when the subject unit captures the subject image. Time information acquisition means, communication means for communicating with the outside of the camera, and at least one of the information on the imaging point and the information on the imaging time acquired by the imaging time information acquisition means in order to make the search target search outside. Communication control means for transmitting information relating to the characteristics of the search object included in the image of the subject image captured by the imaging means to the outside via the communication means, and data relating to the search object from the outside via the communication means And display means for displaying information about the search object based on the received data related to the search object.
(5) A search system according to the invention of claim 5 is a camera according to claim 4, a server for searching for a search object, data for specifying the object, and information on a region related to the object and And a data storage device that stores data including at least one of information about the time concerning the object as a search item, and the server transmits an imaging point acquired by the imaging time information acquisition unit transmitted from the camera. When at least one of the information and the information of the imaging time and the information on the characteristics of the search target included in the image of the subject image captured by the imaging unit are received, the received information and the data stored in the data storage device The search object is searched based on the above and the search result is transmitted to the camera.

  According to the present invention, it is possible to search efficiently.

  An embodiment of a camera and a search system according to the present invention will be described with reference to FIGS. FIG. 1 is a diagram showing the overall configuration of the search system of the present embodiment, and FIG. 2 is a diagram showing the overall configuration of the camera of the present embodiment. The search system according to the present embodiment includes a camera 1, a server 3, and a database 4. The camera 1 includes a lens unit 101, an image sensor 102, a processing unit 103, a GPS unit 104, a real-time clock (RTC) 105, and a wireless LAN unit 106. The camera 1 also includes a memory card interface 107, a display unit 108, a built-in flash memory 109, an operation switch 110, a lens driving unit 111, and a lens position detection unit 112.

  The lens unit 101 includes a zoom lens and a focus lens (not shown). The zoom lens is driven back and forth in the optical axis direction by the lens driving unit 111 to adjust the focal length of the lens unit 101. The focus lens is driven back and forth in the optical axis direction by the lens driving unit 111 to adjust the focal position of the lens unit 101. The lens driving unit 111 drives the zoom lens and the focus lens, respectively, according to a lens control signal sent from the processing unit 103 described later. The lens position detection unit 112 detects the positions of the zoom lens and the focus lens in the optical axis direction.

  The image sensor 102 is configured by, for example, a CCD image sensor. The image sensor 102 captures an image of subject light that has passed through the lens unit 101 and outputs an image signal to the processing unit 103. The processing unit 103 includes a CPU and peripheral circuits of the CPU such as a ROM and a RAM. The processing unit 103 inputs a signal output from each unit, performs a predetermined calculation, and outputs a control signal based on the calculation result to each unit. The GPS unit 104 receives a GPS signal from a GPS satellite, detects its current position (for example, latitude, longitude, altitude), and outputs information on the current position to the processing unit 103. The RTC 105 outputs information on the current date and time to the processing unit 103.

  The wireless LAN unit 106 is connected to a wireless LAN network constructed in advance, such as a wireless LAN base station 2 described later, and performs wireless communication (wireless communication) with other devices connected to the network. The memory card interface 107 holds, for example, a storage medium such as the memory card 120 in a detachable manner, and reads and erases data recorded on the attached storage medium and writes data to the storage medium. Display unit 108 includes a display device such as a liquid crystal display device (LCD) and a touch panel switch. The built-in flash memory 109 stores subject search data described later. The operation switch 110 is a switch group that outputs a signal to the processing unit 103 in conjunction with a button for operating each part of the camera 1, and includes the touch panel switch of the display unit 108 described above.

  The server 3 is connected to the wireless LAN base station 2 and the database 4. As will be described later, when the server 3 receives an inquiry about the subject from the camera 1 via the wireless LAN base station 2, the server 3 refers to the subject search data stored in the database 4 and obtains information on the subject related to the inquiry via the wireless LAN. Transmit to the camera 1 via the base station 2. The wireless LAN base station 2 is a wireless LAN network base station constructed in advance. The database 4 stores subject search data.

  In the camera 1 and the search system configured as described above, when a subject image is captured by the camera 1, the subject-related data is checked against subject search data stored in the built-in flash memory 109 of the camera 1. Search for. Further, as a result of searching for data as described above, when there is no data corresponding to the subject, the camera 1 inquires the server 3 about the subject image. Details will be described below.

---- Subject search data ---
FIG. 3 is a diagram illustrating a configuration of subject search data regarding flowers as an example of subject search data. The subject search data includes a plurality of information items, each of which is classified for each type of flower (plant name). Examples of information items include position information, altitude information, time information, size information, feature amount information, and picture book information. The position information is information related to the area where the flowers are distributed, and is represented by latitude and longitude, for example. The altitude information is information relating to the altitude at which the flowers are distributed, and is represented by altitude, for example. The time information is information related to the time when the flower blooms, and is expressed by, for example, the date. The size information is information relating to the size of the flower, and for example, the range of the size of the flower is represented by a numerical value.

  The feature amount information is information related to the appearance of the flower such as the color, pattern, and shape of the flower. In the color information, for example, the hue range is represented by a numerical value. The pattern and shape information includes, for example, information such as the number of petals and the shape pattern of the flower. The pictorial book information is image data representing the appearance of a flower, such as a photograph or picture of a flower.

  As described above, the subject search data is stored in the built-in flash memory 109 and the database 4 of the camera 1, respectively. Note that the subject search data stored in the database 4 includes more flower type information than the subject search data stored in the built-in flash memory 109 because of the storage capacity.

--- About imaging and retrieval ---
After the power button (not shown) is operated and the power of the camera 1 is turned on, when the zoom button (not shown) is pressed by the operator, for example, the operation switch 110 is pressed while the zoom button is pressed. A zoom operation signal (a telephoto instruction signal or a wide-angle instruction signal) is output from. The processing unit 103 that has received the zoom operation signal outputs a signal to the lens driving unit 111 so as to drive the zoom lens forward and backward. Thereby, the focal length of the lens unit 101 is set to an arbitrary focal length.

  In this way, when the operator sets the focal length of the lens unit 101 to an arbitrary focal length and then fully presses a release button (not shown), a full-press operation signal is output from the operation switch 110. When the full-press operation signal is received, the processing unit 103 performs a known photometry and distance measurement calculation, and calculates a shutter speed (in the shutter speed) and a control aperture value. Then, a control signal (aperture control signal) is output to an aperture drive unit (not shown) so that the aperture value of the aperture (not shown) becomes the calculated control aperture value, and a lens control signal for driving the focus lens is output to the lens. Output to the drive unit 111.

  Thereafter, the processing unit 103 controls each unit so that the image sensor 102 captures a subject image. The processing unit 103 performs predetermined image processing on the image data of the subject image obtained by imaging with the image sensor 102 and controls each unit so as to write the image data after the image processing to the memory card 120. Further, as shown in FIG. 4, the processing unit 103 displays an image (captured image) 201 obtained by imaging and a display (inquiry display) 202 for inquiring whether or not to search for the name of the subject. Each part is controlled to display for a certain period of time. Note that after capturing the subject image, the processing unit 103 controls each unit so as to start resetting each unit of the camera 1. FIG. 4 shows an example in which a flower is a subject. 201a is a flower of the subject.

  The inquiry display 202 includes a display for inquiring whether or not to search for the name of the subject, and a “Yes” button 202a for the operator to instruct the search for the subject name. While the captured image 201 and the inquiry display 202 are displayed on the display unit 108 for a certain period of time, the “Yes” button 202a is not pressed, that is, after the captured image 201 and the inquiry display 202 are displayed on the display unit 108. When the operation signal indicating that the “Yes” button 202a is pressed within a predetermined time cannot be received, the processing unit 103 sets each unit to end the display of the captured image 201 and the inquiry display 202. Control. As a result, the camera 1 returns to the shooting standby state.

  When the “Yes” button 202a is pressed while the captured image 201 and the inquiry display 202 are displayed on the display unit 108 for a certain period of time, that is, the captured image 201 and the inquiry display 202 are displayed on the display unit 108. Thereafter, when an operation signal indicating that the “Yes” button 202a is pressed within a predetermined time can be received, the processing unit 103 shifts to a search mode described below to search for a subject image. Control each part. When the processing unit 103 shifts to the search mode, as shown in FIG. 5, the display of the inquiry display 202 is ended (stopped), and an area in which the subject image to be searched is displayed in the captured image 201 is designated. Each unit is controlled so as to display on the display unit 108 a display 203 for prompting the user to perform (region-specific guidance display).

  For example, as shown in FIG. 6, the operator traces the surface of the display unit 108 with his / her finger so as to surround the area where the subject image (search target) to be searched is displayed. The area where the object is displayed can be indicated. In the example of FIG. 6, the operator traces the surface of the display unit 108 with a finger so as to surround the flower 201 a in the captured image 201. When receiving a signal indicating a predetermined area of the display unit 108, the processing unit 103 controls each unit to display on the display unit 108 a display 204 indicating that the search is being performed as shown in FIG. Based on the image, the region where the search object is displayed in the captured image 201 is specified, and the subject image (that is, the search object) in the specified region is recognized. Then, the processing unit 103 recognizes (extracts) a hue, a pattern, a shape, or the like as feature amount information for the recognized search object and stores it in the RAM.

  The processing unit 103 acquires information on the current position output from the GPS unit 104 and information on the current date and time output from the RTC 105. Further, the processing unit 103 acquires information on the position of the zoom lens and the focus lens in the optical axis direction output from the lens position detection unit 112. Then, the processing unit 103 calculates the size of the recognized search target object in the captured image 201, and based on the acquired information on the position of the zoom lens and the focus lens in the optical axis direction, the actual search target object is calculated. The size is calculated and stored in the RAM. That is, the processing unit 103 calculates the focal length from the information on the position of the zoom lens, and calculates the distance to the subject that is the detection target from the information on the position of the focus lens. Then, the processing unit 103 calculates the size of the search object in the captured image 201 (the ratio of the search object to the captured image 201), and refers to the focal distance and the distance to the subject to determine the actual search object. Is calculated, and the calculated value is stored in the RAM.

  Next, the processing unit 103 searches for a search object based on subject search data stored in the built-in flash memory 109. First, the processing unit 103 narrows down the subject search data by comparing the current position information acquired from the GPS unit 104 with the position information of the subject search data. For example, the processing unit 103 compares the current position information acquired from the GPS unit 104 with the position information of the subject search data, and uses a flag (not search target) for the types of flowers that are determined not to be search targets. Set 1 to (Flag).

  The processing unit 103 narrows down the subject search data by comparing the altitude information of the current position acquired from the GPS unit 104 with the altitude information of the subject search data. For example, the processing unit 103 compares the altitude information of the current position acquired from the GPS unit 104 with the altitude information of the subject search data, and uses a flag (search for the type of flower that is determined not to be a search target. 1 is set to the non-target flag. The processing unit 103 narrows down the subject search data by comparing the current date and time information acquired from the RTC 105 with the time information of the subject search data. For example, the processing unit 103 compares the current date and time information acquired from the RTC 105 with the time information of the subject search data, and sets a flag (non-search target flag) for a flower type that is determined not to be searched. ) Is set to 1.

  The processing unit 103 narrows down the subject search data by comparing the actual size of the search target obtained by calculation as described above with the size information of the subject search data. For example, the processing unit 103 compares the actual size of the search target obtained by calculation with the size information of the subject search data, and determines the type of flower that is determined not to be the search target. 1 is set to (non-search target flag). After narrowing down the subject search data as described above, the processing unit 103 refers to the subject search data in which 1 is not set in the non-search target flag, and uses the feature amount information of the search target stored in the RAM. Search the search object.

  As a result of the search, when there is no subject search data that matches the feature amount information of the search target stored in the RAM, the processing unit 103 searches the external server 3 for the search target as described later. Let

  As a result of the search, when there is subject search data that matches the feature quantity information of the search target stored in the RAM, the processing unit 103, as shown in FIG. Each unit is controlled to display a display 205 of the search data and a display 206 for confirming the quality of the result on the display unit 108. The display 205 includes, for example, a display 205a indicating the type of flower read from the subject search data and an image 205b of the flower. That is, for example, the processing unit 103 reads out flower type information and picture book information from the matching subject search data, and displays a display 205a indicating the flower type and an image 205b of the flower. The display 206 includes a “Yes” button 206a for the operator to press when the search result is correct, and a “No” button 206b for the operator to press when the search result is incorrect. included.

  When the “Yes” button 206 a is pressed, that is, when an operation signal indicating that the “Yes” button 206 a is pressed can be received, the processing unit 103 searches the image data of the captured image 201 and searches. Each part is controlled so as to correlate the result. For example, in the image file of the image data of the captured image 201, the processing unit 103 controls each unit so as to add information indicating the type of flower of the subject search data to, for example, a maker note in the Exif file format. The processing unit 103 controls each unit so that the image data of the captured image 201 and the search result are associated with each other, and then returns to the normal shooting mode from the search mode and enters a shooting standby state.

  When the “NO” button 206b is pressed, that is, when an operation signal indicating that the “NO” button 206b is pressed can be received, the processing unit 103 sends the search target object to the external server 3. Each unit is controlled to transmit the following information to the server 3 via the wireless LAN unit 106. As described above, the same applies to the case where there is no subject search data that matches the feature amount information of the search target stored in the RAM as a result of the search on the camera 1 side. First, the processing unit 103 establishes a connection with the server 3 via the wireless LAN unit 106. If the connection with the server 3 can be established, the processing unit 103 has the subject image feature amount information, the current position information output from the GPS unit 104, the current date and time information output from the RTC 105, and as described above. The calculated value of the actual size of the calculated search object is transmitted to the server 3 via the wireless LAN unit 106. If the connection with the server 3 can be established, the processing unit 103 controls each unit so as to display on the display unit 108 a display 207 indicating that the search target object is being searched for, as shown in FIG.

  When the server 3 receives the above-mentioned information necessary for the search from the camera 1 via the wireless LAN base station 2, the server 3 searches for the search object based on the subject search data stored in the database 4. The processing contents in the server 3 will be described later. If there is matching subject search data as a result of the search, the server 3 transmits the information on the type of flower of the matching subject search data, which is the search result, to the camera 1 via the wireless LAN base station 2. To do. If there is no matching subject search data as a result of the search, the server 3 transmits information indicating that there is no matching subject search data to the camera 1 via the wireless LAN base station 2.

  When the processing unit 103 receives the flower type information of the matching subject search data from the server 3 via the wireless LAN unit 106, as shown in FIG. 8, the matching subject search data display 205 and the result pass / fail are displayed. Each unit is controlled to display on the display unit 108 a display 206 for confirming.

  When the “Yes” button 206a is pressed, that is, when an operation signal indicating that the “Yes” button 206a is pressed can be received, the processing unit 103 receives the image data of the captured image 201, Each unit is controlled so as to correlate with the received search result. For example, in the image file of the image data of the captured image 201, the processing unit 103 controls each unit so as to add information indicating the type of flower of the subject search data to, for example, a maker note in the Exif file format. The processing unit 103 controls each unit so that the image data of the captured image 201 and the search result are associated with each other, and then returns to the normal shooting mode from the search mode and enters a shooting standby state.

  When the “NO” button 206b is pressed, that is, when an operation signal indicating that the “NO” button 206b is pressed can be received, the processing unit 103 searches the image data of the captured image 201 and searches. Without associating the result with each other, each unit is controlled to return to the normal shooting mode from the search mode and enter a shooting standby state.

  When the processing unit 103 receives information indicating that there is no matching subject search data from the server 3 via the wireless LAN unit 106, as shown in FIG. 10, a display 208 indicating that there is no matching subject search data. Are controlled so as to be displayed on the display unit 108 for a predetermined time. Thereafter, the processing unit 103 returns from the search mode to the normal shooting mode and controls each unit so as to enter a shooting standby state.

  If the connection with the server 3 cannot be established, the processing unit 103 displays on the display unit 108 a display 209 indicating that the connection with the server 3 cannot be established as shown in FIG. Control each part to do. Thereafter, the processing unit 103 returns from the search mode to the normal shooting mode and controls each unit so as to enter a shooting standby state.

--- Search processing in server 3 ---
When the server 3 receives the above-described information necessary for the search from the camera 1 via the wireless LAN base station 2, the server 3 searches for the search object based on the subject search data stored in the database 4 as follows. The server 3 narrows down the subject search data by comparing the current position information received from the camera 1 with the position information of the subject search data stored in the database 4. For example, the server 3 compares the current position information received from the camera 1 with the position information of the subject search data, and sets a flag (non-search target flag) for a flower type that is determined not to be a search target. Set 1 to.

  The server 3 narrows down the subject search data by comparing the altitude information of the current position received from the camera 1 with the altitude information of the subject search data. For example, the server 3 compares the altitude information of the current position received from the camera 1 with the altitude information of the subject search data, and for the types of flowers that are determined not to be searched, Set 1 to (Flag). The server 3 narrows down the subject search data by comparing the date and time information received from the camera 1 with the time information of the subject search data. For example, the server 3 compares the date and time information received from the camera 1 with the time information of the subject search data, and uses a flag (non-search target flag) for a flower type that is determined not to be a search target. Set 1

  The server 3 narrows down the subject search data by comparing the calculated value of the actual size of the search target received from the camera 1 with the size information of the subject search data. For example, the server 3 compares the calculated value of the actual size of the search target received from the camera 1 with the size information of the subject search data, and determines the type of flower that is determined not to be the search target. , 1 is set to the flag (non-search target flag). After narrowing down the subject search data as described above, the server 3 refers to the subject search data for which 1 is not set in the non-search target flag, and uses the feature amount information of the search target received from the camera 1 as a search target. Search for things.

  As a result of the search, if there is subject search data that matches the feature amount information of the search target received from the camera 1, the server 3 uses the information on the type of flower that matches the subject search data as described above. And transmitted to the camera 1 via the wireless LAN base station 2. As a result of the search, if there is no subject search data that matches the feature amount information of the search target received from the camera 1, the server 3 sets information indicating that there is no matching subject search data as described above. And transmitted to the camera 1 via the wireless LAN base station 2.

--- Flow chart ---
FIG. 12 is a flowchart showing the processing contents of a program for searching for a search object as described above after shooting. When a power switch (not shown) of the camera 1 is turned on, the camera 1 is activated in a normal shooting mode and enters a shooting standby state. When a power switch (not shown) of the camera 1 is turned on, a program for performing this process is activated and executed by the processing unit 103. In step S1, the process waits until a full-press operation signal is received from the operation switch 110. If an affirmative determination is made in step S1, the process proceeds to step S3, where known photometry and distance measurement calculations are performed, and the process proceeds to step S5. In step S5, an aperture control signal and a lens control signal are output based on the calculation result of step S3, and the process proceeds to step S7.

  In step S7, each unit is controlled so as to capture a subject image with the image sensor 102, and the process proceeds to step S9. In step S9, predetermined image processing is performed on the image data of the subject image obtained by imaging with the image sensor 102, and each unit is controlled to write the image data after the image processing to the memory card 120. move on. In step S11, each unit is controlled to display the captured image 201 obtained by imaging and the inquiry display 202 on the display unit 108, and the process proceeds to step S13. In step S13, each part is controlled to start resetting each part of the camera 1, and the process proceeds to step S15.

  In step S15, it is determined whether or not an operation signal indicating that the “Yes” button 202a shown in FIG. 4 has been pressed is received. If an affirmative determination is made in step S15, the process proceeds to step S17, the search mode is entered, and the process proceeds to step S25. In step S25, each unit is controlled to stop the display of the inquiry display 202, and the process proceeds to step S27. In step S27, each unit is controlled to display the area designation guidance display 203 on the display unit 108, and the process proceeds to step S29. In step S29, the process waits until a signal indicating a predetermined area of the display unit 108 is received.

  If an affirmative determination is made in step S29, the process proceeds to step S31, where each unit is controlled to display a display 204 indicating that the search is being performed on the display unit 108, and the search target in the captured image 201 is based on the received operation signal. The area where the object is displayed is specified, and the process proceeds to step S33. In step S33, the subject image of the search target in the area specified in step S31 is recognized, and the process proceeds to step S35. In step S35, the feature amount information for the hue, pattern, shape, etc. is extracted from the search object recognized in step S33, stored in the RAM, and the process proceeds to step S37. In step S37, the current position information output from the GPS unit 104 and the current date information output from the RTC 105 are acquired, and the process proceeds to step S39.

  In step S39, information on the position of the zoom lens and focus lens in the optical axis direction output from the lens position detector 112 is acquired, and the process proceeds to step S41. In step S41, the actual size of the search object is calculated, the calculated value is stored in the RAM, and the process proceeds to a subroutine of search processing and search result display processing in step S100. The subroutine of step S100 will be described later. When the subroutine of step S100 is executed, the process proceeds to step S43, returns from the search mode to the normal photographing mode, and proceeds to step S45. In step S45, it is determined whether a power switch (not shown) of the camera 1 is turned off. If a positive determination is made in step S45, the program is terminated. If a negative determination is made in step S45, the process returns to step S1.

  If a negative determination is made in step S15, the process proceeds to step S19, and it is determined whether or not a predetermined time has elapsed since the captured image 201 and the inquiry display 202 are displayed on the display unit 108 in step S11. If a negative determination is made in step S19, the process returns to step S15. If an affirmative determination is made in step S19, the process proceeds to step S21, each part is controlled to stop displaying the captured image 201 and the inquiry display 202, and the process returns to step S1.

--- Subroutine of step S100 ---
FIG. 13 is a flowchart showing a subroutine of search processing and search result display processing in step S100. When step S41 of FIG. 12 is executed, the process proceeds to step S101, where the current position information acquired in step S37 of FIG. 12 is compared with the position information of the subject search data stored in the built-in flash memory 109. The subject search data is narrowed down and the process proceeds to step S103. In step S103, by comparing the altitude information of the current position acquired in step S37 of FIG. 12 with the altitude information of the subject search data stored in the built-in flash memory 109, the subject search data is narrowed down to step S105. move on. In step S105, by comparing the date information acquired in step S37 of FIG. 12 with the time information of the subject search data stored in the built-in flash memory 109, the subject search data is narrowed down and the process proceeds to step S107.

  In step S107, the subject search data is compared by comparing the calculated value of the actual size of the search target calculated in step S41 of FIG. 12 with the size information of the subject search data stored in the built-in flash memory 109. And the process proceeds to step S109. In step S109, referring to the subject search data after being narrowed down in steps S101 to S107, the search target is searched with the feature amount information of the search target stored in the RAM, and the process proceeds to step S111. In step S111, as a result of the search in step S109, it is determined whether there is subject search data that matches the feature amount information of the search target stored in the RAM.

  If an affirmative determination is made in step S111, the process proceeds to step S113, and each unit is controlled to display on the display unit 108 a display 205 of matching subject search data and a display 206 for confirming whether the result is good or not, and step S115. Proceed to In step S115, it is determined whether or not an operation signal indicating that the “Yes” button 206a shown in FIG. 8 has been pressed is received. If an affirmative determination is made in step S115, the process proceeds to step S119, and each unit is controlled to associate the image data of the captured image 201 with the search result, and the process proceeds to step S121. In step S121, each unit is controlled so as to stop the display 205 of the matching subject search data displayed in step S113 and the display 206 of the display 206 for confirming the quality of the result. The process returns to step S43 in FIG.

  If a negative determination is made in step S115, the process proceeds to step S117, and it is determined whether or not an operation signal indicating that the “NO” button 206b shown in FIG. 8 has been pressed is received. If a negative determination is made in step S117, the process returns to step S115. If an affirmative determination is made in step S117, the process proceeds to step 123, and processing for connecting to the external server 3 via the wireless LAN unit 106 (external connection processing) is performed. Since this external connection process is a known process, a detailed description thereof will be omitted. If the external connection process of step S123 is performed, it will progress to step S125 and it will be judged whether the connection with the server 3 was established.

  When an affirmative determination is made in step S125, the process proceeds to step S127, and each unit is controlled to display on the display unit 108 a display 207 indicating that the search target object is being searched for as shown in FIG. Then, the feature value information of the subject image, the current position information output from the GPS unit 104, the current date and time information output from the RTC 105, and the calculated value of the actual size of the search object are obtained. The information is transmitted to the server 3 via 106, and the process proceeds to step S129. In step S129, the process waits until a search result is received from the server 3 via the wireless LAN unit 106.

  If an affirmative determination is made in step S129, the process proceeds to step S130, and a process (disconnection process) for terminating the connection with the server 3 is performed. Since this cutting process is a known process, a detailed description thereof will be omitted. When the cutting process of step S130 is executed, the process proceeds to step S131, and it is determined whether or not there is matching subject search data as a result of searching by the server 3.

  If an affirmative determination is made in step S131, the process proceeds to step S133, and each part is controlled to display the display 205 of the subject search data received from the server 3 and the display 206 for confirming the quality of the result on the display unit 108. Then, the process proceeds to step S135. In step S135, it is determined whether or not an operation signal indicating that the “Yes” button 206a shown in FIG. 8 has been pressed is received. If an affirmative determination is made in step S135, the process proceeds to step S139, and each unit is controlled to associate the image data of the captured image 201 with the search result, and the process proceeds to step S121.

  If a negative determination is made in step S135, the process proceeds to step S137, and it is determined whether or not an operation signal indicating that the “NO” button 206b shown in FIG. 8 has been pressed is received. If a negative determination is made in step S137, the process returns to step S135. If a positive determination is made in step S137, the process proceeds to step 121.

  If a negative determination is made in step S131, the process proceeds to step S143, and each part is controlled so that the display 208 (FIG. 10) indicating that no matching subject search data exists is displayed on the display unit 108 for a certain period of time. Return to step S43.

  If a negative determination is made in step S125, the process proceeds to step S141, and each unit is controlled so that a display 209 (FIG. 11) indicating that the connection with the server 3 cannot be established is displayed on the display unit 108 for a certain period of time. Return to step S43.

  If a negative determination is made in step S111, the process proceeds to step S123.

--- Flowchart of server 3 ---
FIG. 14 is a flowchart showing the processing contents of a program for searching for a search object in the server 3. When the server 3 is powered on, a program for performing this process is activated. In step S501, the process waits until a connection request from the camera 1 is received via the wireless LAN base station 2. If an affirmative determination is made in step S501, the process proceeds to step S503, and processing for connecting to the camera 1 via the wireless LAN base station 2 (external connection processing) is performed. Since this external connection process is a known process, a detailed description thereof will be omitted. When the external connection process of step S503 is executed, the process proceeds to step S505, and it is determined whether or not a connection with the camera 1 has been established.

  If a negative determination is made in step S505, the process returns. If an affirmative determination is made in step S505, the process proceeds to step S507 and waits until various information necessary for the search, such as the feature amount information of the subject image and the current position information transmitted from the camera 1, are received. If an affirmative determination is made in step S507, the process proceeds to step S509, where the current position information received (acquired) in step S507 is compared with the position information of the subject search data stored in the database 4 to obtain subject search data. Narrow down and go to step S511. In step S511, the subject search data is narrowed down by comparing the altitude information of the current position acquired in step S507 with the altitude information of the subject search data stored in the database 4, and the process proceeds to step S513. In step S513, by comparing the date information acquired in step S507 with the time information of the subject search data stored in the database 4, the subject search data is narrowed down and the process proceeds to step S515.

  In step S515, the calculated value of the actual size of the search object acquired in step S507 is compared with the size information of the subject search data stored in the database 4, thereby narrowing down the subject search data and step S517. Proceed to In step S517, the subject search data after narrowing down in steps S509 to S515 is referred to, the search target is searched with the feature amount information of the search target acquired in step S507, and the process proceeds to step S519. In step S519, the search result in step S519 is transmitted to the camera 1 via the wireless LAN base station 2, and the process proceeds to step S521. In step S521, a process for terminating the connection with the camera 1 (disconnection process) is performed. Since this cutting process is a known process, a detailed description thereof will be omitted. When the cutting process of step S521 is executed, the process returns.

The above-described camera and search system have the following operational effects.
(1) The camera 1 is configured to store subject search data in the built-in flash memory 109 of the camera 1. Then, the subject search data is narrowed down using the current position information acquired from the GPS unit 104, the current date and time information acquired from the RTC 105, and the like in the image obtained by imaging. Configured to search. Thus, subject search data that is not related to the search target can be excluded from the search target, so that the search can be performed efficiently.

(2) When it is determined that subject search data corresponding to the search target does not exist in the built-in flash memory 109 of the camera 1, the external server 3 is configured to search for the search target. As a result, the search object can be searched using the database 4 storing more subject search data than the built-in flash memory 109 of the camera 1 whose storage capacity is limited due to cost and the like. Therefore, a search corresponding to more subjects can be performed, and convenience is improved. In addition, by configuring the search target in the image obtained by imaging with the camera 1 so that the external server 3 searches the search target, an inexpensive and highly portable search system can be provided.

(3) The processing unit 103 calculates the size of the recognized subject image in the captured image 201, and based on the acquired information on the position of the zoom lens and the focus lens in the optical axis direction, the actual size of the search target object It was configured to calculate the thickness. The subject search data is narrowed down based on the calculated actual size of the search object. As a result, the search can be performed efficiently and the search accuracy can be improved.

---- Modified example ---
(1) In the above description, the object search data is narrowed down by each item of position information, altitude information, time information, and size information before searching by feature amount information. It is not limited to. For example, when narrowing down subject search data, it may be configured to narrow down at least one item among position information, altitude information, time information, and size information. Further, the items to be narrowed down are only examples, and items other than the information described above may be provided as items of subject search data information, and subject search data may be narrowed down for those items.

(2) In the above description, as shown in FIG. 8, when the search result is displayed, the display 205a indicating the type of flower and the image 205b of the flower are displayed. Is not limited to this. For example, only the display 205a indicating the type of flower may be displayed, or information on other items regarding the type of flower matched as a result of the search may be displayed.

(3) In the above description, the image data of the captured image 201 and the search result are associated with each other, but the present invention is not limited to this. For example, information on the current position output from the GPS unit 104 at the time of imaging, information on the current date and time output from the RTC 105, a calculated value of the actual size of the search object, extracted feature amount information, and the like are obtained during imaging. The various pieces of information may be associated with the image data of the captured image 201. Specifically, for example, the processing unit 103 may be configured to add various types of information obtained in the imaging to the maker note in the Exif file format in the image file of the captured image 201, for example.

(4) In the above description, the object search data is narrowed down by each item of position information, altitude information, time information, and size information before searching by feature amount information. It is not limited to. For example, in the case of flowers, there are various types of plants in certain facilities such as botanical gardens, regardless of the original distribution range of plants, and they are flowering at a time different from the original flowering time. It is done. Therefore, information on the position of a predetermined facility relating to animals and plants such as a botanical garden or a zoo is stored in the built-in flash memory 109, and the information on the current position output from the GPS unit 104 is within these facilities (site). If it is confirmed, the processing unit 103 may be configured not to narrow down by position information, altitude information, and time information when searching for subject search data.

(5) In the above description, the object search data is first searched on the camera 1 side, and when there is no matching data, the object search data is searched on the server 3 side. Is not limited to this. For example, the configuration may be such that subject search data is searched only on the camera 1 side. In this case, the processing unit 103 does not make an inquiry to the server 3 side even if there is no matching subject search data as a result of searching the subject search data on the camera 1 side. That is, in this case, the search on the server 3 side is not essential, and the server 3 and the database 4 may not exist. Even in this case, subject search data that is not related to the search target can be excluded from the search target, so that the search can be efficiently performed as described above.

  Further, the subject search data may be searched only on the server 3 side. In this case, the processing unit 103 makes an inquiry to the server 3 side without performing the above-described search process on the camera 1 side after taking a subject image with the image sensor 102. In other words, in this case, the search on the camera 1 side is not essential, and the subject search data may not be stored in the built-in flash memory 109. Even in this case, subject search data that is not related to the search target can be excluded from the search target, so that the search can be efficiently performed as described above.

  Further, it may be configured such that the subject search data is searched on the camera 1 side and the subject search data is also searched on the server 3 side regardless of whether or not there is matching data on the camera 1 side. . In this case, it is desirable to display the search results on both the camera 1 side and the server 3 side on the display unit 108, respectively. Even in this case, subject search data that is not related to the search target can be excluded from the search target, so that the search can be efficiently performed as described above.

(6) In the above description, the flower (plant) is exemplified as an example of the search target, but the present invention is not limited to this. For example, you may make it search a plant from a leaf and a fruit instead of a flower. In addition, the present invention can be applied to a case where other organisms such as animals and insects are not limited to plants.
(7) You may combine each embodiment and modification which were mentioned above, respectively.

  Note that the present invention is not limited to the above-described embodiment, and relates to imaging means for capturing a subject image, data for specifying a target object, information about a region related to the target object, and the target object. Data storage means for storing data having at least one of information about time as a search item, and at least one of information on an imaging point and information on imaging time when the subject image is taken by the imaging means And at least one of the information on the imaging point and the information on the imaging time acquired by the imaging information acquisition unit, and is used for searching among the data stored in the data storage unit. Data narrowing means for narrowing down data, data narrowed down by the data narrowing means, and objects included in the image of the subject image captured by the imaging means ( Search means for searching for the search object by collating the information on the characteristics of the search target), is intended to include cameras for various structures, comprising a display means for displaying a search result by the search unit.

  Further, the present invention is not limited to the above-described embodiment, and includes an imaging unit that captures a subject image, and information on an imaging point and an imaging timing information when the subject image is captured by the imaging unit. Imaging time information acquisition means for acquiring at least one, communication means for communicating with the outside of the camera, and imaging point information and imaging time acquired by the imaging time information acquisition means in order to search the search target outside Communication control means for transmitting to the outside via communication means at least one of the information and information relating to the characteristics of the search object included in the image of the subject image captured by the imaging means, and data relating to the search object Display means for displaying information about the search object based on the received data related to the search object when received from outside via the communication means It is intended to include the camera structure.

  Furthermore, the present invention is not limited to the above-described embodiment, and the above-described camera, a server that searches for a search target, data for specifying the target, and a region related to the target A data storage device that stores data including at least one of information and time information related to the target object as a search item, and the server captures the image acquired by the imaging information acquisition means transmitted from the camera When at least one of the information on the point and the information on the imaging time and the information on the characteristics of the search object included in the image of the subject image captured by the imaging unit are received, the received information is stored in the data storage device. It includes a search system with various structures characterized in that a search object is searched based on the data and the search result is transmitted to the camera.

It is a figure which shows the whole structure of the search system of this Embodiment. It is a figure which shows the whole structure of the camera of this Embodiment. It is a figure which shows the structure of the subject search data regarding a flower as an example of subject search data. 6 is a diagram illustrating a display example of the display unit 108. FIG. 6 is a diagram illustrating a display example of the display unit 108. FIG. It is a figure which shows the example which instruct | indicates the area | region where the search target object is displayed. 6 is a diagram illustrating a display example of the display unit 108. FIG. 6 is a diagram illustrating a display example of the display unit 108. FIG. 6 is a diagram illustrating a display example of the display unit 108. FIG. 6 is a diagram illustrating a display example of the display unit 108. FIG. 6 is a diagram illustrating a display example of the display unit 108. FIG. It is a flowchart which shows the processing content of the program which searches a search target object after imaging | photography. It is a flowchart which shows the subroutine of the search process of step S100 of FIG. 12, and the display process of a search result. It is a flowchart which shows the processing content of the program which searches the search target object in the server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Camera 3 Server 4 Database 101 Lens unit 102 Image pick-up element 103 Processing unit 104 GPS unit 105 Real-time clock (RTC)
106 Wireless LAN unit 108 Display unit 109 Built-in flash memory 110 Operation switch 111 Lens drive unit 112 Lens position detection unit

Claims (5)

Imaging means for capturing a subject image;
Data storage means for storing data for specifying an object, the data including at least one of information about a region about the object and information about a time about the object as a search item;
An imaging time information acquisition unit for acquiring at least one of information on an imaging point and information on an imaging time when the subject image is captured by the imaging unit;
Data refinement for narrowing down the data used for the search from among the data stored in the data storage means using at least one of the information on the imaging point and the information on the imaging time acquired by the information acquisition means at the time of imaging Means,
Retrieval means for retrieving the retrieval object by collating the data narrowed down by the data narrowing means and information relating to the characteristics of the object (retrieval object) included in the image of the subject image captured by the imaging means. When,
A camera comprising: display means for displaying a search result obtained by the search means. The camera of claim 1,
Communication means for communicating with the outside of the camera;
As a result of searching the search object by the search means, if the data corresponding to the search object is not stored in the data storage means, the search object is externally searched for the search object. Further comprising communication control means for transmitting information on the characteristics of the object to the outside through the communication means,
The display means displays information on the search object based on the received data on the search object when data related to the search object is received from the outside via the communication means. camera. The camera according to claim 1 or 2,
A ratio calculating means for calculating the ratio of the search object to the image of the subject image captured by the imaging means;
Focal length information acquisition means for acquiring information on the focal length of the taking lens when the subject image is picked up by the imaging means;
Based on the ratio calculated by the ratio calculating unit and the focal length information acquired by the focal length information acquiring unit, further comprising a size calculating unit that calculates the size of the search object,
The data further includes information about the size of the object as a search item,
The data narrowing means narrows down the data stored in the data storage means based on the size of the search object calculated by the size calculating means. Imaging means for capturing a subject image;
An imaging time information acquisition unit for acquiring at least one of information on an imaging point and information on an imaging time when the subject image is captured by the imaging unit;
Communication means for communicating with the outside of the camera;
In order to search for the search object to the outside, at least one of the information on the imaging point and the information on the imaging timing acquired by the imaging information acquisition unit, and an image of the subject image captured by the imaging unit Communication control means for transmitting information related to the characteristics of the search object included to the outside via the communication means;
And display means for displaying information about the search object based on the received data related to the search object when data related to the search object is received from the outside via the communication means. camera. A camera according to claim 4;
A server for searching for the search object;
A data storage device for storing data that is data for specifying the object and includes at least one of information about a region related to the object and information about a time related to the object as a search item; ,
The server includes at least one of the imaging point information and the imaging timing information acquired by the imaging time information acquisition unit and the image of the subject image captured by the imaging unit, transmitted from the camera. Receiving information related to the characteristics of the search object to be searched, searching the search object based on the received information and the data stored in the data storage device, and transmitting a search result to the camera. Feature search system.

Images