JP5458411B2 - Photographed image display device, photographed image display method, and electronic map output by photographed image display method - Google Patents

Description

  The present invention relates to a photographed image display device that displays a photographed image of a digital camera in association with an electronic map, a photographed image display method, and an electronic map output by the method, and in particular, information on a photographing position and a photographing direction at the time of photographing. The present invention relates to a technique for easily displaying on an electronic map.

  In recent years, mobile phone terminals have become more sophisticated, and most models have a data communication function for connecting to the Internet and a camera function having the same function as a digital camera. Further, there are models equipped with a position measuring function for measuring the terminal position by GPS and a function for detecting the inclination of the terminal.

Uploading a captured image to a server device on the Internet using a camera function is often performed on an image bulletin board or the like. Furthermore, the present inventor has proposed to send a photograph taken, a photographing position, a photographing direction, an elevation angle, and the like to the server device by using the position measuring function of the mobile phone terminal and the function of detecting the tilt of the terminal. (Non-Patent Document 1).
By using such a system, it is possible to easily display what kind of scenery can be seen from each point on the map by combining the map stored in the server device and the photograph. A method of displaying the map information and the captured image in an overlapping manner on a server on the Internet, such as Patent Document 1 by the present applicant, is common.

  On the other hand, on a mobile phone or a digital camera, information on the shooting position and shooting direction measured at the time of shooting is recorded together with the image as shooting data and can be referred to as numerical data. However, there is a problem that it is difficult to grasp intuitively if the values of latitude and longitude and the value of elevation angle remain as they are, and the measurement function cannot be fully utilized.

  Further, in the configuration in which the image is arranged and displayed on the above map, for example, the captured image, its position, and orientation can be displayed in a sensuous and easy-to-understand manner by displaying a straight line indicating the captured direction in three dimensions. There is a purpose. For example, in Patent Document 1, corresponding photographic image data is displayed as a panel photograph, arranged at a position on the map corresponding to the photographing point of the photograph, and in a direction on the map corresponding to the photographing direction of the photograph. There has been proposed a configuration in which an orientation angle icon indicating the photographing elevation angle of the photograph is additionally displayed on the panel photograph.

  Since this method directly displays a panel on a map, it has an advantage that it is intuitively easy to understand what kind of scenery is seen when viewing from which point. However, in order to publish a large number of photos, it is difficult to see many panels, and the elevation angle is indicated by an elevation angle icon, so it is difficult to understand sensuously. There were problems such as requiring processing power.

In addition to the above, there are the following documents as a system for associating a photograph having geographical information such as a photograph of a landscape or a building with an electronic map according to the photographing point.
For example, in Patent Document 2, a photograph image with photographing identification information in which photographing identification information including time information, a photographing direction, and a photographing position is added to a photograph image photographed with a mobile terminal with a digital camera is transmitted to a server. There has been disclosed a photo providing system with a position orientation in which a server provides a map including a shooting position and a photo image at the shooting point to a user terminal.
The present inventors have also disclosed in Patent Documents 3 and 4 a method of associating a photograph having geographic information with a map according to the shooting point, and a system for implementing the photograph mapping method.

  On the other hand, regarding electronic maps, there are Patent Documents 4 to 7, and services (Google Map and Google Earth) (Non-Patent Documents 2 and 3) for viewing the map in three dimensions are known.

JP 2010-39583 A JP 2007-52809 JP 2009-176262 A JP 2009-157897 Special table 2008-501161 Special table 2007-531004 Special table 2007-524113

Rieko Kadobayashi, A Gaze-based Guidance System based on aReal-world 3D Photo Logging System, in Proceedings of the Joint Workshop MobileInteraction with the Real World and 5th Workshop on "HCI in MobileGuides", pp. 37-40, September 2007 Internet URL http://maps.google.co.jp/ (searched on February 26, 2010) Internet URL http://earth.google.com/intl/en/ (searched on February 26, 2010)

  The present invention was created in view of the above-described problems of the prior art, and when displaying a captured image of a digital camera in association with an electronic map, information on the shooting position and shooting direction at the time of shooting is displayed electronically. The purpose is to provide a technique for displaying on a map in an easy-to-understand manner.

In order to solve the above problems, the present invention uses the following configuration.
That is, the present invention provides a captured image display device that displays a captured image of a digital camera in association with an electronic map. The apparatus stores map data input means for inputting map data including a correspondence relationship between the map and position information stored on the first storage means, and a position stored on the second storage means and recorded at least at the time of image capturing. Each piece of data is input with a photographic image input means for inputting a photographic image including information and direction information.

Also, shooting information extraction means for extracting position information and direction information from the shot image, display position determination means for determining a display position on the electronic map from the extracted position information, and a direction corresponding to the direction information from the extracted direction information And a head image generating means for generating a head image in which the direction of the character's face is matched.
And while outputting an electronic map image from map data, the head image output means which outputs and outputs a head image on the determined display position on an electronic map image, and the picked-up image display means which displays a picked-up image A photographed image display device characterized by comprising:

  The direction information is the azimuth and elevation angle of the digital camera at the time of image capture, and the front direction of the face of the head image is directed to the azimuth, and when the elevation angle is 0 degrees, the front of the face of the head image is If the elevation angle is positive, the front of the face is facing upward and the face can be visually recognized.If the elevation angle is negative, the front of the face is facing downward and the back of the head is It can also be made visible.

  In the photographed image display device, a plurality of head images can be simultaneously displayed on the electronic map image, and the photographed image display device includes image designation receiving means for accepting designation of an arbitrary head image from the input means. The display means may be configured to display the captured image in accordance with the designation.

  The above photographing information may include photographer identification information that can identify the photographer or the photographer's attributes, and the head image may be changed according to the photographer identification information. In addition, the shooting information includes shooting situation information indicating the weather at the time of shooting, the atmosphere of the shooting place, and the like, and the head image can be changed according to the shooting situation information.

The present invention can provide a captured image display method for displaying a captured image of a digital camera in association with an electronic map.
That is,
(S1) A map data input step in which map data input means inputs map data that is stored on the first storage means and includes the correspondence between the map and position information;
(S2) A photographed image input step in which the photographed image input means inputs a photographed image that is stored on the second storage means and includes at least position information and direction information recorded at the time of image photographing,
(S3) An imaging information extraction step in which imaging information extraction means extracts position information and direction information from the captured image;
(S4) a display position determining step in which the display position determining means determines a display position on the electronic map from the extracted position information;
(S5) A head image generation step in which the head image generation means generates a head image in which the direction of the character's face is matched with the direction corresponding to the direction information from the extracted direction information;
(S6) a head image output step in which the head image output means outputs an electronic map image from the map data and outputs the head image superimposed on the determined display position on the electronic map image;
(S7) The captured image display means includes each step of a captured image display step for displaying a captured image.

  The direction information is the azimuth and elevation angle of the digital camera at the time of image capture, and the front direction of the face of the head image is directed to the azimuth, and when the elevation angle is 0 degrees, the front of the face of the head image is When facing a direction parallel to the ground surface of the electronic map, when the elevation angle is positive, the front of the face faces upward and the face can be seen. When the elevation angle is negative, the front of the face faces downward and the back of the head can be seen It can also be done.

  In the head image output step, a plurality of head images can be simultaneously displayed on the electronic map image. After the head image output step, the image designation receiving means receives an arbitrary head from the input means. An image designation receiving step for accepting designation of a partial image may be provided, and in the photographed image display step, the photographed image display means may display the photographed image according to the designation.

  The above-described photographing information includes photographer identification information that can identify the photographer or the photographer's attribute, and the head image can be changed in the head image generation step according to the photographer identification information. Similarly, the shooting information includes shooting situation information indicating the weather at the time of shooting, the atmosphere of the shooting place, and the like, and the head image can be changed according to the shooting situation information.

  The present invention can also be provided as an electronic map that is displayed by the above-described captured image display method or that is output as image data.

By providing the above configuration, the present invention has the following effects.
That is, a head image generating means for generating a head image in which the direction of the character's face is matched with the direction corresponding to the direction information from the extracted direction information, and the head image is displayed on the electronic map in an overlapping manner. Thus, the shooting position can be displayed on the map and the orientation of the head can be visually expressed. In particular, the head image is easy to intuitively grasp not only the orientation but also the elevation angle, and is an optimal configuration for transmitting the captured image and the captured information.

  When displaying a plurality of head images on an electronic map, it can be displayed with a small icon as compared with a conventional panel, so that even a large number of photographs can be displayed well. In addition, regarding the shooting position and shooting direction, it is easy to understand the relationship between each photo, when selecting a photo of the surrounding situation from one point, or selecting a photo when viewing one subject from multiple points In some cases, it is particularly suitable.

It is a block diagram of the image photographing device of the present invention. 3 is a flowchart of processing according to the present invention. It is an example of the head image which a head image generation process part produces | generates. It is explanatory drawing which shows rotation of a head image. It is an example of a display of the electronic map by this invention. It is a flowchart at the time of the image photography which concerns on this invention. It is an example of a display at the time of image capturing according to the present invention.

Hereinafter, embodiments of the present invention will be described based on examples shown in the drawings. The embodiment is not limited to the following.
FIG. 1 is a configuration diagram of a captured image display device (1) according to the present invention. In this embodiment, the device (1) will be described as an example of mounting on a known mobile phone terminal. In the mobile phone terminal, as is well known, a CPU (10) that performs various processes operates in cooperation with a memory. The present invention uses at least two types of data, that is, map data of an electronic map and a photographed image taken by a digital camera. In this embodiment, these data are first stored on a server on the Internet, and are transmitted by data communication. A method of inputting will be described. A configuration in which both data are provided on the apparatus will also be described as needed.

  As is well known, the present device (1), which is a mobile phone terminal, can be connected to the Internet (20) and includes a communication adapter (11) for this purpose. The communication adapter (11) includes an antenna and a communication module for connecting to a mobile phone network. Actually, packets in the mobile phone network are transmitted / received to / from the Internet via an exchange, but the detailed configuration will be described. Is omitted.

  The device (1) includes a camera (12) including a CMOS sensor and an image processing circuit, a keyboard (13) such as a dial button, a posture sensor (14) for detecting the posture of the device (1), and a GPS satellite. A GPS antenna (15) for receiving radio waves from the monitor, a monitor (16) for displaying a subject to be photographed or displaying a photographed image, and a storage unit (17) for storing the photographed image. .

  In the CPU (10), the data communication unit (100) that transmits / receives data to / from the map / photographed image server (21) on the Internet (20) via the communication adapter (11), and the photographing information is extracted from the photographed image. A shooting information extraction processing unit (101), a display position determination processing unit (102) for determining a display position on the electronic map for the shot image, and a head image generation processing unit (103) for generating a head image representing the face of the character A head image output unit (104) for outputting the head image superimposed on the determined display position on the electronic map image, and a captured image display unit (105) for displaying the captured image by a predetermined display method.

  In addition, although not an essential component in the present invention, a GPS processing unit (106) that processes a signal received by the GPS antenna (15), and a posture sensor processing unit (107) that performs signal processing of the posture sensor (14). The image processing unit (108) that processes the image data acquired by the camera (12), the information acquisition control unit (109) that controls the operation of the GPS processing unit (101) and the attitude sensor processing unit (102).

Hereinafter, the processing of the present invention will be described with reference to the flowchart shown in FIG.
In the present invention, first, in the map data input step (S10), map data of the electronic map is input to the CPU (10). In this embodiment, it is acquired from the map / photographed image server (21), which is an external computer connected via the Internet (20), by processing of the data communication unit (100). Here, the map / photographed image server (21) is configured by a server device or the like that provides a known web service, and the map data (22) on the storage means in response to a request from the web browser of the device (1). Is sent out. The map data may be the entire range of the map to be stored, but recently it is common to have a detailed map of the whole world and send out a small part of the specified area at the specified scale. It has become.

  Since the present invention can provide map data in any first storage means, the map data (22) is stored on an external server as in this embodiment, and data communication is performed as map data input means. Part (100). As another embodiment, the storage unit (17) of the device (1) can be provided with map data and read directly from the storage unit (17). In this case, a read processing unit (not shown) in the CPU (10) can be used as the map data input means.

  The map data includes correspondence information between an electronic map to be displayed and position information at each point on the map. For example, if the latitude / longitude information of a predetermined point on the map is prepared and the latitude / longitude is specified, the difference from the predetermined point can be calculated to calculate which point on the map corresponds to the specified point. Keep it like that. In addition, when the map code is given by a unique code called a map code, the point may be indicated. Further, the designated point can be indicated from the place name and address information. These configurations are known, and any method can be used.

Next, in the photographed image input step (S11), data of the photographed image (23) in the storage means of the map / photographed image server (21) is acquired. Again, the data communication unit (100) functions as a captured image input unit, and performs processing for capturing the captured image into the CPU (10).
The captured image data includes position information and direction information indicating the position at the time of shooting and the shooting direction, which are features of the present invention.

According to the present invention, since the photographed image can be provided in any second storage means, the photographed image (23) is stored on an external server as in this embodiment, and data communication is performed as the photographed image input means. Part (100). As another embodiment, a photographed image photographed by the camera (12) provided in the present apparatus (1) can be input. In this case, the camera (12) and an imaging processing unit (108) described later are photographed. It can also be an image input means.
Furthermore, the storage unit (17) of the apparatus (1) can be provided with photographed image data and read directly from the storage unit (17). In this case, a reading processing unit (not shown) in the CPU (10) can be used as the photographed image input means.

As described above, the present invention is characterized in that the map data is provided in the first storage means and the photographed image is provided in the second storage means. That is, these two data may be stored in separate external storage devices, or the first and second storage means may be configured in one external storage device.
When storing in a separate external storage device, one may be stored in the present device, and the other may be stored on a server via the Internet or the like.

  In this device (1), the order of the map data input step (S10) and the captured image input step (S11) is not limited. The reverse order may be sufficient, or simultaneous.

A shooting information extraction processing unit (101) extracts shooting information from the input shot image. (Photographing information extraction step (S12))
As is well known, a format called Exif (Exchangeable image file format) is widely used in captured images of digital cameras, and also in this embodiment, shooting information is recorded in accordance with captured image data in this manner. be able to. The shooting information extraction processing unit (101) may extract shooting information according to the Exif method.
As another example, the shooting information relating to each image can be stored in association with each other as data separately from the shooting image and shooting information. In this case, the shooting information extraction processing unit (101) searches and extracts shooting information from the shooting image according to this association.

The shooting information in the present invention can include at least position information and direction information at the time of shooting.
That is, as the position information, in addition to the latitude / longitude information of the shooting point, information indicating the position such as the map code, the place name, and the address may be provided as described above. In the following description, latitude and longitude, which are measurement results of the GPS antenna (15) provided in the present apparatus (1), will be described as position information.

  As the direction information, an elevation angle or direction at the time of photographing can be used. In this embodiment, the angle sensor or deviation information at a predetermined position such as the tilt and orientation at the time of shooting and the step between both ends is acquired by the attitude sensor (14), and the elevation angle and direction at the time of shooting are obtained from these information. Measured and output as direction information of the present invention.

In the present invention, arbitrary information can be added and used in addition to the shooting information.
For example, as is well known, the date and time at the time of shooting, the camera settings, and the camera model number are recorded by Exif, and these can be used in subsequent processing. In addition, photographer identification information such as a photographer's name, weather information such as weather, temperature, and humidity at the time of photographing, atmosphere information indicating a photographer's mood and the atmosphere at the spot, and the like can also be used as photographing information. These utilization methods will be described later.

  Next, in the display position determination step (S13), the display position determination processing unit (102) determines a position on the electronic map for displaying the head image that is the head image of the present invention. This process is a process of calculating and determining which position on the electronic map of the input map data (22) from the position information extracted by the photographing information extraction processing unit (101). With this process, the relative positional relationship between the electronic map and the head image is determined.

The head image generation processing unit (103) executes the head image generation step (S14) after, before or simultaneously with the display position determination step (S13).
FIG. 3 is an example of a head image generated by the head image generation processing unit (103). In the present embodiment, a character image (3) in which the cat's head is enlarged and the torso and tail portions are expressed small is used, and a head image with different face angles is generated as shown.

  That is, in the shooting information, the elevation angle at the time of shooting is expressed by the face direction, and when the elevation angle is positive, that is, when looking up at the time of shooting, the front (30) of the face can be seen. This is represented by state (a). When the elevation angle is 0 degree, that is, when looking in the horizontal direction at the time of photographing, it is represented by a state (31) (b) looking at the direction parallel to the ground surface of the electronic map. When the elevation angle is negative, that is, when the subject is looking down at the time of photographing, the front of the face faces downward and the state (c) is visible.

  Here, the selection of the head image with respect to the elevation angle can be appropriately set. For example, the elevation angle ± 15 degrees is (b), the elevation angle +15 degrees to +120 degrees is (a), the elevation angle is −15 degrees to −120 degrees (c) It is desirable to define with a width like

  Further, the relationship between the elevation angle and the head image is not limited to these three patterns, and a plurality of patterns can be used according to the elevation angle. For example, a different pattern may be prepared every 30 degrees, or three-dimensional shape information of the head image may be prepared to reproduce an accurate appearance according to the elevation angle according to the calculation.

It is preferable that the front image of the head image is directed in a direction parallel to the ground surface of the electronic map. That is, when the electronic map is displayed from an oblique direction as in a bird's-eye view, the head image when the elevation angle is 0 degrees is set to an angle that matches the inclination angle of the map, and the inclination is also relative to the inclination angle when tilting up and down. You may display according to an angle.
Thereby, even when displayed in a bird's eye view, it is possible to generate a head image oriented in a direction that is easy to understand intuitively.

  The head image generation processing unit (103) further performs a rotation process for directing the front direction of the face of the head image in accordance with the orientation at the time of shooting. FIG. 4 is an explanatory diagram for explaining this processing. For example, when the map to be displayed has north as the top, when the orientation included in the shooting information is represented clockwise with north as 0 degree, the orientation is 0. When the angle is 30 degrees, the front of the face faces true north (upward) as shown in FIG. 4A. When it is 30 degrees, it rotates north-northeast as shown in FIG. 4B. When the direction is 210 degrees, FIG. ) To the south-southeast.

  The rotation angle can be set as appropriate depending on the orientation of the input electronic map. In addition, when the orientation can be arbitrarily changed when displaying the electronic map, the processing here may be set at a relative angle with the electronic map so that the orientation can be changed in conjunction with the electronic map. .

  In the present invention, the head image generation processing unit (103) generates a head image to be displayed by selecting or performing image processing from several patterns according to at least the elevation angle, and further performing rotation according to the orientation. In the present invention, the head image may be generated with a change based on the photographing information.

  For example, when photographer identification information such as a photographer's name is used as the photograph information, the character can be changed according to the photographer identification information. As a simple method, the color of the character may be changed for each photographer so that the photographer can be identified by colors such as black for the photographer A, red for the photographer B, and blue for the photographer C. Alternatively, the character image created by the photographer himself / herself may be registered, and the head image generation processing unit (103) may select the character image from the photographer identification information. As a method for creating one's own character on the network, a service called an avatar is known and can be used in the present invention.

  When weather information such as weather, temperature, and humidity at the time of shooting is used, a mark representing the weather can be loaded next to the head image, and the clothes of the head image can be changed according to the temperature and humidity. For example, if the weather at the time of shooting is sunny, wear a hat, wear an umbrella when it is raining, wear light clothes when the temperature is high, or wear a scarf when it is low, etc. It is possible to display so that the situation at the time of shooting can be understood.

Alternatively, the photographer may set the mood and the atmosphere at the time of shooting as atmosphere information and record it in the shooting information, and change the character according to the information. For example, when you are excited or happy, you can define a color such as red for a photo with a positive impression and blue for a photo when you are depressed or in an unfavorable situation. You can also change the color of your outfit. Also, the facial expression may be changed, such as laughing, angry, crying, or chilling.
Atmosphere information and weather information can also be used separately or in combination as shooting status information indicating the situation around the shooting location.

  Furthermore, general date and time, camera settings, and camera model numbers may be used as shooting information. The color of the head image may be changed according to the date and time, or the sun or stars may be displayed on the background of the head image. Further, the head image may be provided with a camera so that the camera is an image of an actual model, or the distinction between a single-lens reflex camera and a compact camera can be recognized. Numerical values such as exposure time and aperture may be displayed, or the aperture may be displayed as an image to indicate the degree of aperture.

As described above, the head image generation processing unit (103) can generate a head image that reflects not only the elevation angle but also various shooting information. Next, the process proceeds to a head image output step (S15) for displaying the generated head image on the electronic map.
In this step (S15), the head image output unit (104) creates an electronic map image from the input map data, and the head image generation process is performed at the display position determined by the display position determination processing unit (102). The head image generated by the unit (103) is superimposed and output.

FIG. 5 shows an example of a screen output from the monitor (16) by the head image output unit (104). An electronic map (4) in a range designated by the user is displayed on the monitor (16) of the apparatus (1), and a plurality of character images (3) corresponding to the photographed image are superimposed on the electronic map (4). It is displayed.
In the present invention, a single captured image may be displayed as one captured image, but a configuration in which a plurality of captured images are handled simultaneously will be described below.

  As shown in the figure, character images (3) are displayed at a number of points on the electronic map (4), and each character image (3) represents an azimuth and elevation angle at the time of shooting by the head image generation processing unit (103). ing. For example, the character image (3a) in the upper right indicates that the elevation angle is negative and downward when looking at the northwest direction from the point where the image is placed. Further, the character image (3b) in the vicinity of the center indicates that the photographed image is directed to the west from the same point and viewed in the horizontal direction.

  In the present invention, since a plurality of character images (3) can be listed on the electronic map (4), it can be seen at a glance from which point, in which direction, at what elevation angle, and close. It is possible to easily select a photographed image overlooking the surroundings from a point or a photographed image obtained by photographing one subject from a plurality of points. This makes it easy to grasp the landscape spatially even for still images.

  Finally, in the captured image display step (S16), the designated captured image is displayed on the monitor (16). Although the display method is arbitrary, for example, by designating the character image (3) of the point that the viewer wants to see, the captured image display unit (105) may open another screen to display the captured image. it can. It can also be displayed pop-up on the electronic map (4).

Through the series of processes described above, the captured image display device and the captured image display method according to the present invention are provided.
In addition, the electronic map on which the head image output by this method is superimposed is not only displayed on the monitor (16), but also printed by a printer or via the Internet (20) from the communication adapter (11). Image data may be output to an arbitrary terminal. For example, the map data (22) and the photographed image (23) are stored in the storage unit (17) of the device (1), and the designation of the electronic map or photographed image displayed from the terminal device (not shown) is accepted. The processing method of the present invention may be executed, and the output result from the head image output unit (104) may be returned to the terminal. In that case, a captured image can be further transmitted based on designation from the terminal.

In this embodiment, the photographed image display device (1) is also provided with a mechanism for photographing a photographed image to be displayed on the device (1). Hereinafter, this mechanism will be described.
At the time of shooting, the apparatus (1) performs the processing of the flowchart shown in FIG. 6 with the configuration of FIG.
That is, when an application program that causes the CPU (10) to execute the present embodiment is started, position measurement (S20) and photographing direction measurement (S21) are performed under the control of the information acquisition control unit (109).
In the position measurement (S20), the GPS processing unit (106) receives signals from a plurality of satellites by the GPS antenna (15), and calculates the current location by the signal processing. This process is known.
In the case of a mobile phone terminal, an accurate current location is calculated using other information such as base station information. The present invention can use any technique as position information acquisition means.

In the photographing direction measurement (S21), the posture sensor processing unit (107) acquires the information from the posture sensor (14). Here, the posture refers to angle information or deviation information at a predetermined position such as the inclination and orientation of the device (1), the step between both ends, and the elevation angle and direction at the time of shooting are measured from the posture information, Output as direction information of the present invention.
Any known sensor can be used as the attitude sensor (14).
The direction can also be acquired from the GPS processing unit (106), but here it is functionally classified and described as the attitude sensor processing unit (107) and processing.

  The apparatus (1) includes a camera (12), an imaging processing unit (103), a monitor (16), and a storage unit (17), which are known digital camera mechanisms. As a result, the photographed image can be taken by the camera means including the camera (12) and the imaging processing unit (108).

  In this embodiment, the photographed image is input from the camera means (S22), and the photographing information including the position information and the direction information is displayed so as to overlap the photographed image (S23). FIG. 7 is an explanatory diagram of the screen display of the device (1) at this time. The device (1) shown in the figure is a commercially available mobile phone terminal, which has a large-screen touch panel type liquid crystal screen and is a monitor (16), and also acts as a keyboard (13). Therefore, the camera icon (160) is displayed on the screen and the shutter is released by touching this part.

An image area (161) above the camera icon (160) is an image being photographed by the camera (12) provided on the back surface, and the composition can be freely determined by moving the device (1). .
A shooting information display area (162) is provided in an upper part of the image area (161) so as to transmit the shot image, so that the photographer can visually recognize the shooting information while looking at the shot image.

  In the photographing information display area, the azimuth (162a), the latitude / longitude (162b), and the elevation angle (162c) are displayed in order from the right. In particular, the present invention is characterized in that an analog needle type display is performed for displaying the azimuth and the elevation angle.

Conventionally, devices that can acquire azimuth and elevation information have been known, but it is rare to check these during shooting, and no suitable method for displaying these shooting information during shooting has been proposed. .
However, in recent years, with the spread of the Internet, opportunities for showing images taken by people to have increased dramatically, and it has become possible to easily refer to photos taken with a digital camera. In that case, there are many cases in which it is easy to compare by photographing in the same direction from the same position as a photograph taken in the past, or in a desired direction different from other photographs.

In response to such requests, even if information is displayed numerically as in the past, when deciding on the composition of the camera, it is necessary to look at the state of the subject and shoot in consideration of the surrounding situation. There was a problem that it was difficult to understand the shooting information sequentially.
On the other hand, in the present invention, for example, the compass-like image is displayed with the azimuth (162a) facing north, and the azimuth (162a) is displayed intuitively and easily by the red pointer. Further, the elevation angle (162c) is displayed by the blue pointer indicating the angle from the horizontal direction so that, for example, accurate horizontal shooting, vertical upward, vertical downward, etc. can be easily performed. It is particularly suitable for those who are not good at shooting or when taking continuous panoramic photos.
In the present invention, it is proposed that a part of the photographing information is an analog needle type, and information other than the azimuth and the elevation angle, for example, arbitrary information such as the inclination and deviation information of the apparatus can be displayed.

The latitude / longitude (162b) is displayed as a numerical value, and can be used as a clue when shooting at the same position as the position where the previous shooting was taken or the position taken by another person.
It is also possible to define the latitude and longitude of the designated shooting position in advance with this device (1) and indicate the direction of the designated shooting position with an analog needle type from the difference from the position being measured. When the designated photographing position (difference is 0) is displayed. This method makes it easy for the photographer to stand at exactly the same latitude and longitude.

  In the above description, the photographing information display area (162) is displayed so as to be transparent and overlapped with the photographed image. However, in the present invention, the photographing information display area (162) may be arranged in the vicinity. Further, the arrangement position does not have to be on the image area (161), and the position may be freely changed either up, down, left, or right. Furthermore, the orientation of the photographing information may be automatically changed according to the orientation of the main body of the apparatus (1).

It is desirable that the photographed image and the photographed information are constantly updated until the photographing, and the processes after the position measurement (S20) can be repeatedly executed while displaying both pieces of information simultaneously (S23).
In addition, since more time is required for position measurement (S20), a configuration in which measurement is performed once at a predetermined number of times during repeated shooting direction measurement (S21) or a configuration in which measurement is performed at a predetermined time may be employed.

  In the image photographing device (1), the photographer performs photographing (S24) by pressing a shutter such as a camera icon (160) while viewing the photographed image and photographing information on the monitor (16). When an image is taken, the imaging processing unit (108) performs image processing and compression processing as is well known, and stores it in the storage unit (17) (S25). The storage unit (17) is realized as a memory mounted on the apparatus (1) or an external memory card mounted on the apparatus (1).

  As another embodiment, after taking an image (S24), it is converted into an e-mail format by the action of the data communication unit (100) regardless of whether or not it is recorded in the storage unit (17), or by ftp It can also be transmitted from the communication adapter (11) to an arbitrary server device or terminal device on the Internet (20) by communication.

  The present invention can be arbitrarily changed within the scope of the claims. The head image of the present invention can use various characters such as a person, an animal, and an animated character. In the case of a person's head image, a photograph of a photographer or a celebrity or a portrait may be used. In the case of animals, not only dogs and cats, but also birds and fish may be used.

The following can be considered as applications to which the present invention is applied.
First, it is used as a system for displaying a list of damage situations at the time of a disaster, and images taken of the damaged parts are accumulated. At this time, the shooting location and the shooting direction are displayed according to the present invention, which can contribute to the identification of the damage location.

  In a system that guides tourist spots, photos of recommended tourist spots are stored together with information on position, azimuth, and elevation angle, and tourists can easily click on a character image to specify a picture of a tourist spot. Can be displayed.

1 Image photographing device 10 CPU
DESCRIPTION OF SYMBOLS 11 Communication adapter 12 Camera 13 Keyboard 14 Attitude sensor 15 GPS antenna 16 Monitor 17 Memory | storage part 20 Internet 21 Map and imaging | photography image server 22 Map data 23 Captured image 100 Data communication part 101 Shooting information extraction process part 102 Display position determination process part 103 Head Partial image generation processing unit 104 Head image output unit 105 Captured image display unit 106 GPS processing unit 107 Attitude sensor processing unit 108 Imaging processing unit 109 Information acquisition control unit

Claims (9)

A captured image display device that displays a captured image of a digital camera in association with an electronic map,
Map data input means for inputting map data stored on the first storage means and including the correspondence between the map and the position information;
A photographed image input means for inputting a photographed image that is stored on the second storage means and includes at least position information and direction information recorded at the time of image photographing;
Photographing information extraction means for extracting the position information and the direction information from the photographed image;
Display position determining means for determining a display position on the electronic map from the extracted position information;
Head image generation means for generating a head image in which the orientation of the character's face is matched with the direction corresponding to the direction information from the extracted direction information;
A head image output means for outputting an electronic map image from the map data, and outputting the head image superimposed on the determined display position on the electronic map image;
In a configuration comprising a captured image display means for displaying a captured image ,
The direction information is the azimuth and elevation angle of the digital camera at the time of image capture,
Directing the front direction of the face of the head image to the orientation,
When the elevation angle is 0 degree, the front of the face of the head image faces in a direction parallel to the ground surface of the electronic map, and when the elevation angle is positive, the front of the face faces upward and the face can be visually recognized. When the elevation angle is negative, the photographed image display device is configured such that the front of the face faces downward and the back of the head can be seen . In the captured image display device, the plurality of head images can be simultaneously displayed on the electronic map image,
Image designation accepting means for accepting designation of the arbitrary head image from the input means,
The photographed image display device according to claim 1 , wherein the photographed image display means displays the photographed image in accordance with the designation. In the captured image display device,
The photograph information includes photographer identification information that can identify the photographer or the photographer's attributes,
In response to the photographer identity, the captured image display device according to claim 1 or 2 changing the head image. In the captured image display device,
The shooting information includes shooting situation information indicating the weather at the time of shooting, the atmosphere of the shooting location, etc.
In accordance with the shooting conditions information, the captured image display device according to any one of 3 claims 1 changing the head image. A captured image display method for displaying a captured image of a digital camera in association with an electronic map,
A map data input step in which map data input means inputs map data which is stored on the first storage means and includes the correspondence between the map and the position information;
A photographed image input step in which a photographed image input means inputs a photographed image that is stored on the second storage means and includes at least position information and direction information recorded during image photographing;
A shooting information extraction step in which shooting information extraction means extracts the position information and the direction information from the shot image;
A display position determining step for determining a display position on the electronic map from the extracted position information;
A head image generation step in which the head image generation means generates a head image in which the orientation of the character's face is matched with the direction corresponding to the direction information from the extracted direction information;
A head image output step in which a head image output means outputs an electronic map image from the map data and outputs the head image superimposed on the determined display position on the electronic map image;
The captured image display means includes a captured image display step for displaying a captured image ,
The direction information is the azimuth and elevation angle of the digital camera at the time of image capture,
Directing the front direction of the face of the head image to the orientation,
When the elevation angle is 0 degree, the front of the face of the head image faces in a direction parallel to the ground surface of the electronic map. When the angle of elevation is negative, the front of the face faces down and the back of the head can be seen
A photographed image display method characterized by the above. In the head image output step, the plurality of head images can be simultaneously displayed on the electronic map image, and after the head image output step,
The image designation receiving means has an image designation receiving step of accepting designation of the arbitrary head image from the input means,
In the captured image display step,
The captured image display method according to claim 5 , wherein the captured image display means displays the captured image in accordance with the designation. In the head image generation step of the captured image display method,
The photograph information includes photographer identification information that can identify the photographer or the photographer's attributes,
The captured image display method according to claim 5 or 6 , wherein the head image is changed according to the photographer identification information. In the head image generation step of the captured image display method,
The shooting information includes shooting situation information indicating the weather at the time of shooting, the atmosphere of the shooting location, etc.
The captured image display method according to claim 5 , wherein the head image is changed in accordance with the imaging state information. An electronic map that is output by the captured image display method according to claim 5 .

Images