JP2015126243A - Imaging device, method of controlling display control device, and method of controlling recording device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device which displays an image in a correct rotation state without reference to the attitude of the imaging device even when displaying a normal image.SOLUTION: There is provided an imaging device having first imaging means and second imaging means for taking a photograph in the opposite direction from the first imaging means. The imaging device has detecting means of detecting the attitude of the imaging device, and control means of performing control to display an image photographed by the first imaging means and an image photographed by the second imaging means simultaneously on display means, and when the image photographed by the second imaging means is displayed together with the image photographed by the first imaging means without mirror image inversion, the control means rotates and displays the image photographed by the second imaging means on condition that the detecting means detects the imaging device being in a predetermined attitude.

Description

  The present invention relates to an imaging apparatus that captures an image and a display control apparatus that displays the captured image. The present invention relates to a recording apparatus for recording a photographed image.

  In an imaging apparatus, there is a camera that can shoot a photographer by having not only a normal camera (out-camera) for photographing a subject but also another camera (in-camera) on the display unit side. In Patent Document 1, an image including a photographer is also taken in a group photograph or the like by simultaneously shooting with an out-camera and an in-camera in one shooting and combining and recording both images. A mobile terminal that can be obtained is described.

Japanese Patent Application No. 2010-83337

  By the way, regarding the camera (in-camera) arranged on the display device side, when the through image is displayed on the display device, the left and right of the through image can be mirror-reversed in a mirror image so that the photographer can easily perform framing. Generally done.

  Although it is a mirror image display that facilitates framing at the time of shooting, if the recorded image remains a mirror image, unlike the original image, characters and the like will be displayed in a mirror-reverse display. Therefore, the user's desire to display and record the in-camera image as a normal image instead of a mirror image may be considered. However, when displaying and recording with a normal image, there is no problem when the imaging device is held in the normal position (horizontal posture), but the imaging device is held in the vertical position (vertical posture) of 90 degrees or 270 degrees. It has been found that problems occur. That is, when the image pickup apparatus is held in a vertical position when displaying and recording a normal image, the in-camera image is displayed and recorded upside down with respect to the out-camera image.

  Accordingly, an object of the present invention is to provide an apparatus for displaying or recording an image in a correct rotation state even when displaying or recording a normal image.

An imaging apparatus according to the present invention
An image pickup apparatus having a first image pickup means and a second image pickup means for shooting in a direction opposite to the first image pickup means, a detection means for detecting an attitude of the image pickup apparatus, and a first image pickup means Control means for performing control for simultaneously displaying the image photographed by the second imaging means and the image photographed by the second imaging means on the display means, without reversing the mirror image of the image photographed by the second imaging means When displaying together with the image taken by the first image pickup means, if the posture of the image pickup apparatus is determined to be a predetermined posture from the detection result of the detection means, the control means takes the image taken by the second image pickup means. It is characterized by controlling to display the rotated image.

In addition, an imaging apparatus according to the present invention includes:
An image pickup apparatus having a first image pickup means and a second image pickup means for shooting in a direction opposite to the shooting direction of the first image pickup means, a detection means for detecting an attitude of the image pickup apparatus, and a first Control means for combining the image photographed by the imaging means and the image photographed by the second imaging means and recording them on a recording medium, the control means being an image photographed by the first imaging means When the image captured by the second imaging means is combined and recorded without being mirror-inverted, and the orientation of the imaging device is detected to be a predetermined orientation, the image captured by the second imaging means It is characterized by controlling to rotate and synthesize.

In addition, an imaging apparatus according to the present invention includes:
An imaging device, an imaging means for photographing the photographer side, a detection means for detecting the attitude of the imaging device,
And a control unit that controls the image captured by the imaging unit to be rotated 180 degrees and displayed when the detection unit detects that the imaging device is in a posture rotated 90 degrees or 270 degrees. It is characterized by.

In addition, an imaging apparatus according to the present invention includes:
An image pickup apparatus having a first image pickup means and a second image pickup means for shooting in a direction opposite to the first image pickup means, a detection means for detecting an attitude of the image pickup apparatus, and a first image pickup means Control means for adding rotation information corresponding to the orientation of the imaging device detected by the detection means to the image taken by the second imaging means and the image taken by the second imaging means, and performing control for recording on the recording medium. When the image pickup apparatus is in the vertical posture, the control means includes, in the image taken by the second image pickup means, rotation information that is 180 degrees out of phase with the rotation information added to the image taken by the first image pickup means. It is controlled to add and record.

  According to the present invention, it is possible to provide an apparatus for displaying or recording an image in a correct rotation state even when displaying or recording a normal image.

1 is a view showing the back of a digital camera 100. FIG. 2 is a diagram illustrating a hardware configuration of the digital camera 100. FIG. 3 is a flowchart showing processing at the time of shooting by the digital camera 100. 3 is a flowchart showing recording processing at the time of shooting by the digital camera 100. It is a display example at the time of displaying the image image | photographed with the out camera and the image image | photographed with the in camera. It is a figure for demonstrating the display state in a normal image display and a mirror image display. It is an example of a display when the digital camera 100 is in a vertical posture in the normal image display mode.

  Preferred embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 shows an external view of a digital camera as an example of an embodiment of an imaging apparatus of the present invention.

  The display unit 28 is a display unit that displays images and various types of information. The shutter button 61 is an operation unit for issuing a shooting instruction. The mode dial 60 is an operation unit for switching various mode settings. The connector 112 is a connector between the connection cable and the digital camera 100. The operation unit 70 is an operation unit including operation members such as various switches, buttons, and a touch panel for receiving various operations from the user. The controller wheel 73 is a rotatable operation member included in the operation unit 70. Reference numeral 72 denotes a power switch that switches between power on and power off. The in-camera 300 is an imaging unit for photographing a photographer who is photographing a subject or photographing a viewer who is viewing an image displayed on the display unit 28. The in-camera 300 is arranged so as to photograph the side on which the display unit 28 of the digital camera is provided in order to photograph the viewer or the photographer. 1 is an external view of the back side of the digital camera 100 in which the display unit 28 is provided. On the front side of the digital camera 100, an out camera that is an imaging unit for photographing the subject side is provided. It has been. The optical axis (imaging direction) of the out camera and the sub camera is substantially parallel to each other, and the optical axis (imaging direction) of the out camera is set to be opposite to the optical axis (imaging direction) of the sub camera. The recording medium 200 is a recording medium such as a memory card or a hard disk. The recording medium slot 201 is a slot for storing the recording medium 200. The recording medium 200 stored in the recording medium slot 201 can communicate with the digital camera 100, and images taken by the out camera and the in camera are recorded. A lid 203 is a lid of the recording medium slot 201.

  FIG. 2 is a diagram showing a configuration of a digital camera 100 that is an embodiment of the present invention.

  Reference numeral 10 denotes a barrier that prevents the imaging unit from being stained or damaged by covering the imaging unit including the photographing lens 11 of the digital camera 100. Reference numeral 11 denotes a photographing lens, 12 denotes a shutter having a diaphragm function, 13 denotes an image sensor composed of a CCD or CMOS element for converting an optical image into an electric signal, and 15 denotes an analog signal output from the image sensor 13 to a digital signal. It is an A / D converter. The barrier 10, the taking lens 11, the shutter 12, and the image sensor 13 constitute an out camera.

  Similarly, a photographing lens 101 is a lens group including a zoom lens and a focus lens that are installed in a direction capable of photographing the photographer using the digital camera 100 separately from the photographing lens 11. Reference numeral 102 denotes a shutter having an aperture function. Reference numeral 103 denotes an image pickup device composed of a CCD or CMOS device that converts an optical image on the photographer side into an electric signal. The photographing lens 101, the shutter 102, and the image sensor 103 constitute an in-camera.

  A timing generation circuit 14 supplies a clock signal and a control signal to the imaging elements 13 and 103, the A / D converter 15, and the D / A converter 21, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 15 or the data from the memory control circuit 22.

  The image processing circuit 20 performs predetermined calculation processing using the captured image data, and the system control circuit 50 controls the exposure control means 40 and the distance measurement control means 41 based on the obtained calculation result. I do. The exposure control means 40 and the distance measurement control means 41 perform AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing.

  The image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs AWB (auto white balance) processing based on the obtained arithmetic result.

  Further, the image processing circuit 20 reads an image stored in the memory 25 to read the JPEG format or MPEG-4 AVC / H. H.264 compression or expansion processing is performed, and the processed data is written into the memory 25.

  A memory control circuit 22 controls the A / D converter 15, the timing generation circuit 14, the image processing circuit 20, the image display memory 24, the D / A converter 21, and the memory 25.

  The data of the A / D converter 15 is written to the image display memory 24 or the memory 25 via the image processing circuit 20 and the memory control circuit 22, or the data of the A / D converter 15 is directly written via the memory control circuit 22. It is.

  Reference numeral 24 is an image display memory, 21 is a D / A converter, 28 is a display unit comprising a TFT LCD, and the display image data written in the image display memory 24 is displayed via the D / A converter 21. Displayed on the unit 28.

  An electronic viewfinder function for displaying live video can be realized by sequentially displaying image data captured by the out-camera or in-camera using the display unit 28.

  Reference numeral 25 denotes a memory for storing still images and moving images taken by the out-camera and in-camera, and has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. The memory 25 can also be used as a work area for the system control circuit 50.

  Reference numeral 40 denotes exposure control means for individually controlling the shutters 12 and 102 having an aperture function.

  Reference numeral 41 denotes a distance measuring control means for individually controlling the focusing of the photographing lenses 11 and 101, reference numeral 42 denotes a zoom control means for individually controlling the zooming of the photographing lenses 11 and 101, and reference numeral 43 denotes a barrier control means for controlling the operation of the barrier 10. is there.

  Reference numeral 44 denotes an attitude detection sensor that periodically detects the attitude of the digital camera 100 using an acceleration sensor. When the posture detection sensor 44 detects a rotation angle around the shooting direction of the out-camera, information indicating the detected angle is input to the system control circuit 50. The system control unit 50 determines the attitude (rotation angle) of the digital camera based on the input information, and performs control so as to perform processing according to the attitude. In this embodiment, the shooting directions of the out camera and the in camera are substantially parallel and opposite to each other, and the rotation angle around the shooting direction of the out camera and the rotation angle around the shooting direction of the in camera are the same. When the shooting directions of the in-camera and the out-camera are not parallel, the posture of the in-camera (the rotation angle around the shooting direction) may also be detected.

  Reference numeral 50 denotes a system control circuit ((system control unit)) for controlling the entire digital camera.

  Reference numeral 51 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM. Programs and various setting information are recorded.

  Reference numerals 60, 61, and 62 denote operation units for inputting various operation instructions of the system control circuit 50. The operation unit includes a power switch, a mode change switch, a menu button, a cross key, a touch panel, pointing by line of sight detection, a voice recognition device, or a combination of one or more.

  Reference numeral 60 denotes a shutter switch SW1, which is turned on during operation of a shutter button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash) processing, and the like. Instruct to start operation.

  Reference numeral 61 denotes a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed (completely pressed). When the shutter switch SW2 is turned on, an exposure process is performed in which a signal read from the image sensor 13 or the image sensor 103 is written into the memory 25 via the A / D converter 15 and the memory control circuit 22. Then, development processing is performed on the image data written in the memory 25 by using an operation in the image processing circuit 20 or the memory control circuit 22, and the developed image data is read from the memory 25 and compressed by the image processing circuit 20. Is stored in the memory 25. Thereafter, a recording process for writing the compressed image data in the memory 25 to the external recording medium 91 via the card controller 90 is performed. As described above, the imaging process and the recording process including the exposure process and the development process are executed in response to the shutter switch SW2 being turned on.

  Reference numeral 62 denotes an operation unit composed of various buttons, a touch panel, etc., a power button, a menu button, a mode switching switch for switching between a shooting mode / playback mode / other special shooting mode, a cross key, a set button, a macro button, a multi-screen playback function Page button, flash setting button, single-shot / continuous-shot / self-timer switching button, menu movement + (plus) button, menu movement-(minus) button, playback image movement + (plus) button, playback image-(minus) button , An image quality selection button, an exposure compensation button, a date / time setting button, and the like.

  Reference numeral 81 denotes power supply control means.

  Reference numeral 80 denotes a power source including a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

  A card controller 90 transmits and receives data to and from an external recording medium such as a memory card.

  Reference numeral 91 denotes an external recording medium such as a memory card.

  Next, a display mode in the case of displaying the live video (through image) captured by the out camera or the in camera on the display unit 28 will be described.

  Image data obtained by photographing with an out-camera or in-camera is trimmed or resized according to the resolution of the display area on the display unit 28, stored in the image display memory, and displayed on the display unit 28. When taking an image using the in-camera and recording the image taken by the in-camera, the image taken by the in-camera is displayed simultaneously with the image taken by the out-camera. As shown in FIG. 5A, the display mode of the simultaneous display mode in which the out-camera image and the out-camera image are displayed at the same time is obtained by superimposing a small-size in-camera through image on the out-camera through image. And display. The display form is not limited to this, and a through image of a small out camera may be superimposed and displayed on the through image of the in camera as shown in FIG. Alternatively, as shown in FIG. 5C, both through images may be displayed side by side.

  FIG. 6A shows a through image 601 of the out camera photographed by the out camera and a through image 602 photographed by the in camera. Here, the shooting direction of the out-camera and the in-camera is opposite, and the in-camera shoots the photographer side where the display unit 28 is provided. Such a situation occurs. In FIG. 6A, since the through image captured by the in-camera is displayed without performing mirror image reversal or rotation processing, the viewing direction in which the photographer 600 views the in-camera through image. However, this is in the direction opposite to the shooting direction of the in-camera. Therefore, when the photographer 600 moves in the A direction, the photographer 600a in the in-camera through image 601 moves in the direction B opposite to the direction A. In the case of such a display method, the user may be confused. Therefore, in the digital camera 100 of the present embodiment, a mirror image display in which an image captured by the in-camera is displayed as a mirror image so that the image captured by the in-camera appears as a mirror image when displayed on the display unit 28. Has a mode.

  FIG. 6B shows an example of display in the mirror image display mode. In the mirror image display mode, a mirror image through image 603 of the in-camera is displayed in which an image captured by the in-camera is reversed (mirror image inversion) in the left-right direction of the digital camera 100 main body. Since the left and right are displayed in reverse, when the photographer 600 moves in the direction A, the photographer 600b of the in-camera mirror image through image 603 moves in the direction C, which is the same direction as the direction A. The in-camera mirror image 603 looks the same as when looking in the mirror, and the moving direction of the photographer 600 is the same as the moving direction of the photographer 600b in the in-camera mirror image 603. The photographer can see the in-camera image without confusion.

  The digital camera 100 has not only a mirror image display mode but also a normal image display mode in which an image captured by the in-camera is displayed as shown in FIG. In the mirror image display mode, the movement direction of the actual photographer is the same as the movement direction of the photographer in the through-image, but the through-image is the reverse of the actually captured image, so it feels strange. In some cases, there is a desire to display a correct through image that is not reversed. Therefore, the digital camera 100 has two display modes, a normal image display mode and a mirror image display mode, and can be switched by performing a display mode switching operation using an operation unit for setting the display mode of the user. Yes.

  In this way, in the normal image display mode and the mirror image display mode, the through image 602 and the through image 603 are displayed in the same direction in the short side direction but in the reverse direction in the long side direction. The

  FIG. 6D is a diagram showing a display when the digital camera 100 is rotated 90 degrees around the optical axis in the mirror image display mode. In the mirror image display mode, since the through-image 603 of the in-camera is a mirror image, even if the digital camera 100 is rotated, the vertical direction and the actual direction of the photographer (subject) 600d of the through-image 603 of the in-camera The vertical direction of the photographer 600 is the same.

  FIG. 6C is a diagram illustrating an example in which the digital camera 100 is rotated 90 degrees around the optical axis in a normal image display state. Here, the vertical direction of the photographer 600c of the in-camera through-image 602 when the digital camera 100 is rotated about 90 degrees around the optical axis is the horizontal direction when the photographer 600c is not rotated around the optical axis of the digital camera. 28 is the same direction. Therefore, when the digital camera 100 is rotated 90 degrees around the optical axis in the normal image display state, the up-down direction of the photographer 600c of the in-camera through-image 602 is opposite to the up-down direction of the actual photographer 600. become. For this reason, when the digital camera is rotated around the optical axis in the normal image display state, the in-camera through-image 604 in which the vertical direction is reversed is displayed. The through image 602 in the normal image display is opposite in the long side direction to the through image 603 in the mirror image display. You can see when the top and bottom are reversed when rotated 90 degrees around the axis. Therefore, in the normal image display mode, when the digital camera 100 is rotated 90 degrees around the optical axis in the normal image display mode, the in-camera through image 604 is 180 degrees as shown in FIG. It is rotated and displayed. With this configuration, the vertical direction of the photographer (subject) 600e of the through image can be matched with the vertical direction of the actual photographer (subject) 600. A through image 604 of the in-camera in FIG. 7 is displayed as a normal image that is the original figure because the image taken by the in-camera is rotated but not inverted.

  Next, with reference to FIG. 3, processing at the time of shooting with the digital camera 100 in the present embodiment will be described. In this process, a through image (live video) of the out-camera and the in-camera is displayed at the same time, and a still image moving image is generated by synthesizing them with the same configuration as the display by a single shooting instruction. FIG. 3 is a flowchart showing a display and shooting recording process when the digital camera 100 is shooting. Note that these processes are realized by performing control of each unit, arithmetic processing, determination, and the like based on a program read from the nonvolatile memory 51 by the system control unit 50.

  In step S101, the digital camera 100 determines whether or not it is a simultaneous display mode in which images taken using both the out camera and the in camera are displayed on the display unit 28 at the same time. In the simultaneous display mode, an image taken by the out camera and an image taken by the in camera are combined and displayed on the display unit 28 at the same time. Further, the image captured by the out camera and the image captured by the in camera are synthesized and recorded in the external recording medium 91 with the same configuration as that displayed on the display unit. Instead of the simultaneous display mode, it may be determined whether it is a simultaneous recording mode in which images from both the out-camera and the in-camera are combined and recorded. Here, in the simultaneous recording mode, processing equivalent to that in the simultaneous display mode is performed. These modes can be switched by a user operation for recording mode setting. If it is determined in step S101 that the mode is not the simultaneous display mode, the process proceeds to step S114 and only a normal camera operation is performed. In the normal camera operation (S114), only the image photographed by the out camera is displayed on the display unit 28, the shutter button is pressed (SW2 is ON), and the photographing instruction is input by the out camera. The captured image is recorded on the external recording medium 91. If it is determined in step S101 that the display mode is the simultaneous display mode, the process proceeds to step S102. In step S102, it is determined whether the display mode is the normal image display mode or the mirror image display mode. If it is determined that the display mode is not the mirror image display mode but the normal image display mode, the process proceeds to step S103 to determine whether the posture of the digital camera 100 is the vertical posture. Specifically, rotation angle information that is a detection result of the posture detection sensor 44 is acquired, and the posture of the digital camera is determined based on the rotation angle information. Since the vertical orientation is when the rotation angle around the photographing direction (around the optical axis) is 90 degrees or 270, in this embodiment, the acquired rotation angle information is 50 to 130 degrees or 230 to 310 degrees. In addition, it is determined that the digital camera 100 is in the vertical posture. And when the acquired rotation angle information is not included in the range of 50 to 130 degrees and 230 to 310 degrees (in the case of 0 to 50 degrees, 130 to 230 degrees, 310 to 360 degrees), it is determined that the posture is horizontal. . If it is determined in step S103 that the digital camera 100 is not in the vertical posture, the display unit 28 is not subjected to rotation or mirror image reversal processing in step S104 without rotating the through image of the out camera and the through image of the in camera. To display. If it is determined in step S103 that the digital camera 100 is in the vertical position, the process proceeds to step S105. In step S105, the in-camera through image is rotated 180 degrees and displayed on the display unit 28 together with the out-camera through image.

  If it is determined in step S102 that the display mode is the mirror image display mode, the process proceeds to S106, where the image data obtained by photographing with the in-camera is subjected to mirror image reversal processing that is reversed left and right and displayed on the display unit 28. In the mirror image display mode, even when the digital camera 100 is rotated around the optical axis, the vertical direction and the vertical direction of the subject of the image captured by the in-camera are not reversed, so the digital camera 100 is in a vertical posture. However, the in-camera live image is not rotated 180 degrees. In S104, S105, and S106, when displaying the through-image of the out-camera and the through-image of the in-camera, the image data obtained by photographing with the out-camera as shown in FIG. The image data obtained by photographing with the in-camera is synthesized and displayed in a smaller size than the image of the out-camera. Here, the image data obtained from the out-camera is displayed without being subjected to mirror image reversal or rotation processing.

  Subsequently, in step S107, the digital camera 100 determines whether the shutter button has been pressed. If the digital camera 100 determines in step S107 that the shutter button has been pressed, the digital camera 100 proceeds to step S108. In step S108, a still image is taken by the out camera and the in camera, and the still image of the out camera and the in camera is synthesized and recorded as a still image file on the external recording medium 91 with the same configuration as the through image display state. . Then, it returns to step S101 and repeats this process. This process is repeatedly executed until the digital camera is turned off until the shooting mode is changed to another mode. If it is determined in step S107 that the shutter button has not been pressed, the process advances to step S109 to determine whether or not the moving image recording button has been pressed. If it is determined in step S109 that the moving image recording button has not been pressed, the process returns to step S101 to repeat this process. If it is determined in step S109 that the moving image button has been pressed, the process proceeds to step S110 to start recording the moving image. When recording of a moving image is started, shooting and recording processing of the moving image is performed in step S111. In the shooting and recording of moving images, a moving image shot by the out-camera and a moving image shot by the in-camera are combined with the displayed layout, and the combined moving image obtained by combining is recorded on the external recording medium 91. In step S112, it is determined whether the moving image button has been pressed again while continuing to record and record the moving image. Until the moving image button is pressed again in step S112, the process returns to step S111 to continue recording the moving image. If it is determined in step S112 that the moving image button has been pressed, moving image recording is stopped in step S113, and the combined moving image recorded so far is recorded as one moving image file. And it returns to step S101 and repeats a process.

  When a still image or a moving image is shot and recorded in S108 and S111, an image shot by the out-camera and an image shot by the in-camera are combined with a layout equivalent to the display on the display unit 28. . That is, in S108 and S111, the same determination as in S102 and S103 is performed, and in accordance with the determination result, the image captured by the in-camera is reversed and rotated in the same manner as in S104, S105, and S106. It will be combined with the captured image. The determination of whether to reverse or rotate the image captured by the in-camera when recording an image (S108, S111) is the same as in the case of display (S102 to S106), and thus the description thereof is omitted.

  By performing the above processing, when displaying and recording a composite image of the out-camera and the in-camera, it depends on the posture of the digital camera (vertical posture / horizontal posture) and the normal image / mirror image display mode of the in-camera image. In-camera images can be displayed and recorded in the correct vertical position.

  In the above-described embodiment, when the display mode of the in-camera is the mirror image display mode, the still image / movie to be recorded is recorded as a mirror image, but only the through image of the in-camera is displayed as a mirror image. Recording may be performed with a normal image. In that case, in step S108 and step S111, even in the mirror image display mode, the image captured by the in-camera is combined with the image captured by the out-camera and recorded without being mirror-inverted. If it is determined that the digital camera is in the vertical orientation, the image captured by the in-camera is rotated 180 degrees and combined with the image captured by the out-camera even if the display mode is the mirror image display mode. To record.

  In the above-described embodiment, the case where the image captured by the out-camera and the image captured by the in-camera are combined and displayed has been described. However, the present invention is also applicable to the case where only the image captured by the in-camera is displayed. Can do. In this case, when the image display mode of the in-camera is the mirror image display mode, the image captured by the in-camera is horizontally reversed (mirror image reversed) and displayed on the display unit 28. Then, in the normal image display mode, the posture of the digital camera 100 is determined, and when it is determined as the horizontal posture, the image captured by the in-camera is displayed on the display unit 28 without being rotated or inverted. Then, if it is determined that the posture is vertical, the image taken by the in-camera is rotated 180 degrees without being inverted and displayed on the display unit 28.

(Second Embodiment)
Next, another example of a preferred example of the digital camera 100 according to the present embodiment will be described with reference to FIG. This embodiment has the same configuration as that of the first embodiment, and simultaneously captures and records images from the out-camera and the in-camera in response to one photographing instruction. However, in the second embodiment, the images captured by the out camera and the in camera are not combined into a single still image or a moving image file. Record as a movie or movie file. At that time, angle information is added to each still image or moving image file.

  FIG. 4 is a flowchart and chart showing image capturing and recording processing when the digital camera 100 is capturing in the present embodiment. These processes are also realized by performing control of each unit, arithmetic processing, determination, and the like based on a program read from the nonvolatile memory 51 by the system control unit 50. Further, although description of display processing at the time of shooting is omitted, display processing similar to that in the first embodiment may be performed.

  First, in step S201, it is determined whether or not it is a simultaneous recording mode in which images are taken and recorded by both the out-camera and the in-camera in accordance with a photographing instruction. If it is determined in step S201 that it is not the simultaneous recording mode, the process proceeds to step S202, and the normal camera operation similar to that in step S114 is performed. After performing the normal camera operation, the process returns to step S201. If it is determined in step S201 that the recording mode is the simultaneous recording mode, the process proceeds to step S203, and it is determined whether the digital camera 100 is in the vertical posture as in step S103. If it is determined in step S203 that the digital camera 100 is not in the vertical posture but in the horizontal posture, 0 degrees or 180 degrees is recorded and held in the memory 25 as the out-camera angle information in step S205. If it is determined in step S203 that the digital camera 100 is in the vertical position, 90 degrees or 270 degrees as out-camera angle information is recorded and held in the memory 25 in step S204. That is, when the rotation angle of the digital camera acquired from the attitude detection sensor 44 is 0 to 50 degrees or 310 to 360 degrees (-50 to 50 degrees), the out-camera angle information is 0 degrees and the rotation angle is 130 to 230 degrees. In this case, the out-camera angle information is 180 degrees. When the rotation angle is 50 to 130 degrees, the out-camera angle information is 90 degrees, and when the rotation angle is 230 to 310 degrees, the out-camera angle information is 270 degrees.

  If it is determined in step S203 that the posture is the horizontal posture, the angle information of the out-camera is held in step S205, and then the angle information of the in-camera is the same as the angle information of the out-camera in step S208. Is stored in the memory 25. If it is determined in step S203 that the posture is vertical, in step S205, a normal image recording mode in which an image captured by the in-camera is recorded as a normal image or a mirror image in which the left and right are reversed (mirror image reversal) is recorded. It is determined whether it is a mirror image recording mode. Here, it may be determined whether it is the normal image display mode or the mirror image display mode instead of the recording mode. In the normal image display mode, a normal image is recorded, and in the mirror image display mode, a mirror image is recorded. If it is determined in step S206 that it is the mirror image recording mode, the process proceeds to step S208, and the angle information of the in-camera is held the same as the angle information of the out-camera. If it is determined in step S206 that the mode is not the mirror image recording mode but the normal image recording mode, the angle information of the in-camera is held with a phase difference of 180 degrees with respect to the angle information of the out-camera. That is, in-camera angle information = out-camera angle information + 180, or in-camera angle information = out-camera angle information−180, and in-camera angle information when the out-camera angle information is 90 degrees. Is 270 degrees, and when the out-camera angle information is 270 degrees, the in-camera angle information is 90 degrees. As described above, the angle information of each of the out-camera and the in-camera is determined according to the attitude of the digital camera 100 and the normal image / mirror image recording mode by the processing of S203 to S208. The process of determining the angle information of the out-camera and the in-camera is repeated until the shutter button is pressed in step S209 or the moving image recording button is pressed in step S212, and the memory 25 stores the latest angle information. Updated to

  In step S209, it is determined whether the shutter button has been pressed. If the digital camera 100 determines in step S209 that the shutter button has been pressed, the digital camera 100 captures a still image in each of the out camera and the in camera in step S210. In step S211, the out-camera angle information and the in-camera angle information held in the memory 25 are read. Then, the angle information of the out-camera is added to the still image taken by the out-camera and recorded as one still image file. Further, angle information of the in-camera is added to the still image taken by the in-camera and is recorded as one still image file. Thereafter, the process returns to step S201 to repeat the process. If it is determined in step S210 that the shutter button has not been pressed, the process proceeds to step S212 to determine whether or not the moving image recording button has been pressed. If it is determined in step S212 that the moving image recording button has not been pressed, the process returns to step S201 and the process is repeated. If it is determined in step S212 that the moving image recording button has been pressed, the process proceeds to step S213, and moving image recording is started in each of the out camera and the in camera. In step S214, the digital camera 100 continues the moving image recording of each of the out camera and the in camera, and determines whether the moving image recording button has been pressed again in step S215. If it is determined in step S215 that the moving image recording button has not been pressed, the process returns to step S214 to continue recording the moving image. If it is determined in step S215 that the movie recording button has been pressed, movie recording is stopped in step S216. The digital camera 100 proceeds to step S217, and reads out out-camera and in-camera angle information held in the memory 25. Then, the angle information of the out-camera is added to the video shot by the out-camera and recorded as one video file, and the video information shot by the in-camera is recorded as the single video file with the angle information of the in-camera added. Then, return to step S201 and repeat the process.

  When recording images taken with the out-camera and the in-camera by performing the recording process as described above, regardless of the posture of the digital camera (vertical posture / horizontal posture) and the normal / mirror image recording mode of the in-camera image An image to which correct angle information is added can be recorded.

(Other embodiments)
The digital camera has been described as an example of the embodiment of the present invention, but the present invention is not limited to this. You may implement | achieve with the mobile telephone, PC, etc. which have an imaging part. Further, the present invention may be realized by a system configured by separate devices such as an imaging unit, a control unit, a display unit, and a recording unit, and connecting these devices. Further, the present invention may be implemented by combining the above embodiments. That is, a display control device for displaying not only an imaging device that captures an image but also a captured image. A recording apparatus for recording a photographed image is also included in the present invention.

  In the above embodiment, when shooting using the out camera and the in camera, when shooting a still image with the out camera, a still image is shot with the in camera, and when shooting a video with the out camera, the in camera is used. I also took a video with my camera. However, it is not always necessary to shoot and record still images or moving images between the out-camera and the in-camera. For example, a single shooting instruction (pressing the shutter button) may shoot a still image with the out-camera and a relatively short video with a few seconds with the in-camera. In that case, if the digital camera 100 determines that the shutter button has been pressed in S209, the out-camera takes a still image, the in-camera takes a video for a predetermined time, and then the still image taken in S217. The angle information may be added to the moving image and recorded.

  In the above-described embodiment, the case of having both the normal image display (recording) mode and the mirror image display (recording) mode has been described. However, in the case of having only the normal image display (recording) mode, You may make it display (record) by rotating 180 degree | times. In the above-described embodiment, when the rotation angle detected by the posture detection sensor 44 is 50 to 130 degrees or 230 to 310 degrees, the digital camera 100 is determined to be in the vertical posture. However, if the digital camera 100 is in a state of a rotation angle near the threshold (50 degrees, 130 degrees, 230 degrees, 310 degrees) at which the determination of whether the digital camera 100 is in the vertical position or the horizontal position is switched, camera shake or minute The vertical posture and the horizontal posture are frequently switched by a simple rotation operation. In particular, when the through-image of the in-camera is displayed, if the vertical / horizontal posture judgment is frequently switched, the rotation angle of the through-image is changed and displayed each time the switching is performed. It becomes difficult to check the image. Therefore, it is desirable that the determination of the vertical / horizontal posture does not change very frequently. Therefore, the angle at which the digital camera 100 is determined to be in the vertical posture when changing from the horizontal posture to the vertical posture and the angle at which the digital camera 100 is determined to have returned to the horizontal posture when returning from the vertical posture to the horizontal posture are determined. It may be different. For example, when the posture changes from the horizontal posture to the vertical posture, it is determined that the vertical posture has been reached in accordance with the change from 50 to 130 degrees and 230 to 310 degrees. Once in the vertical position, the digital camera 100 is determined to be in the vertical position when the rotation angle is 40 to 140 degrees or 220 to 320 degrees, and is in the horizontal position when the angle is other than that. You may make it judge that it was. In this case, when the posture changes from the horizontal posture to the vertical posture, it is determined that the vertical posture is set in response to the rotation angle being 50 degrees or more, but when returning to the horizontal posture, the rotation angle is 50 degrees or less (less than). ) Is not determined to be a horizontal posture, and is not determined to be a horizontal posture unless the angle is 40 degrees or less. Therefore, even if the digital camera is slightly rotated, the determination of the vertical / horizontal posture does not change.

  In the above embodiment, information about the rotation angle corresponding to the attitude of the digital camera 100 is added to the image and recorded. However, instead of the angle, for example, when the rotation angle is 0 degree, it is 0, when it is 90 degrees, 2 when it is 180 degrees, and 3 when it is 270 degrees. It may be recorded as information.

  The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (28)

An image pickup apparatus comprising: a first image pickup unit; and the second image pickup unit for shooting a direction opposite to the first image pickup unit,
Detecting means for detecting a posture of the imaging device;
Control means for performing control for simultaneously displaying an image photographed by the first imaging means and an image photographed by the second imaging means on a display means;
When the image captured by the second imaging unit is displayed together with the image captured by the first imaging unit without being mirror-inverted, the orientation of the imaging device is a predetermined orientation based on the detection result of the detection unit. When it is determined that the image pickup apparatus is an image pickup apparatus, the control means controls the image picked up by the second image pickup means to be rotated and displayed.   The control unit rotates the imaging device 90 degrees or 270 degrees around the imaging direction of the first imaging unit when displaying the image captured by the second imaging unit without mirror image reversal. 2. The imaging apparatus according to claim 1, wherein the control unit performs control so that an image captured by the second imaging unit is rotated and displayed. .   3. The imaging apparatus according to claim 1, wherein when the image captured by the second imaging unit is rotated and displayed, the control unit performs control so that the image is rotated by 180 degrees.   Switchable between a first display mode for displaying an image photographed by the second imaging means without mirror image reversal and a second display mode for displaying an image photographed by the second imaging means by mirror inversion. The imaging apparatus according to claim 1, further comprising a display mode setting unit.   In the first display mode, the control unit rotates and displays an image captured by the second imaging unit when it is detected that the posture of the imaging device is a predetermined posture. And when the attitude of the imaging device is detected to be a predetermined attitude in the second display mode, the image taken by the second imaging means is controlled to be displayed without being rotated. The imaging apparatus according to claim 1, wherein:   6. The apparatus according to claim 1, further comprising: the display unit, wherein the display unit is provided on a direction side in which the second imaging unit of the imaging apparatus is photographed. The imaging device described.   The control means has a vertical posture in which the image pickup apparatus is rotated 90 degrees or 270 degrees around the shooting direction of the first image pickup means when displaying the image picked up by the second image pickup means without inverting the mirror image. 2. The image pickup apparatus according to claim 1, wherein when it is detected that the image is detected, the control unit performs control so as to rotate and display an image photographed by the second image pickup unit.   The detection means determines that the imaging device has changed from a horizontal posture to a vertical posture in response to an angle around the shooting direction of the imaging device exceeding a first angle, and then from the vertical posture to the first The image pickup apparatus according to claim 7, wherein the image pickup apparatus is determined to be in the horizontal posture in response to the second angle being smaller than the first angle.   The detection unit determines that the imaging device has changed from a horizontal posture to a vertical posture in response to an angle around the photographing direction of the imaging device exceeding a predetermined angle, and then a state equal to or less than the predetermined angle The imaging apparatus according to claim 7, wherein it is determined that the camera is in a horizontal posture in response to a continuous period of time. An image pickup apparatus comprising: a first image pickup unit; and the second image pickup unit for shooting a direction opposite to a shooting direction of the first image pickup unit,
Detecting means for detecting a posture of the imaging device;
Control means for combining the image photographed by the first imaging means and the image photographed by the second imaging means and recording them on a recording medium;
The control unit is configured so that the orientation of the imaging device is a predetermined orientation when the image captured by the first imaging unit is combined with the image captured by the second imaging unit without recording a mirror image and recorded. When it is detected that there is an image, the image pickup apparatus controls to rotate and synthesize the image taken by the second image pickup means.   In the case where the control unit synthesizes an image captured by the second imaging unit without mirror image reversal, the imaging device rotates 90 degrees or 270 degrees around the imaging direction of the first imaging unit. The image pickup apparatus according to claim 10, wherein the image pickup apparatus controls to rotate and synthesize an image taken by the second image pickup means when it is detected.   The control means controls to rotate and synthesize the image photographed by the second imaging means when the image photographed by the second imaging means is rotated and synthesized. The imaging device according to claim 10 or 11.   Switchable between a first recording mode for recording an image captured by the second imaging means without mirror image reversal and a second recording mode for recording an image captured by the second imaging means by mirror inversion. The imaging apparatus according to claim 10, further comprising a recording mode setting unit.   The control unit is configured so that the posture of the imaging device is a predetermined posture when the image captured by the second imaging unit is combined with the image captured by the first imaging unit and recorded without being mirror-inverted. When it is detected that there is an image, the image captured by the second imaging unit is controlled to be rotated and combined, and the image captured by the first imaging unit is added to the image captured by the second imaging unit. When the image is reversed and combined and recorded, the image captured by the second image capturing unit is not rotated even when the image capturing apparatus is detected to have a predetermined position. The imaging apparatus according to claim 10, wherein the imaging apparatus is controlled to synthesize. An imaging device,
Imaging means capable of photographing the photographer side;
Detecting means for detecting a posture of the imaging device;
Control means for controlling the image taken by the imaging means to be rotated 180 degrees and displayed when the detection means detects that the imaging apparatus is in a posture rotated 90 degrees or 270 degrees; An imaging device comprising: The control means includes a selection means for selecting a first display mode for displaying an image captured by the imaging means without mirror image reversal and a second mode for displaying a mirror image reversal.
In the first mode, control is performed so as to rotate and display an image captured by the imaging unit according to the attitude of the imaging device based on the detection result of the detection unit, and in the second mode, the image is rotated. The image pickup apparatus according to claim 15, wherein the image pickup apparatus is controlled so as to display the image.   The imaging apparatus according to claim 15, further comprising another imaging unit different from the imaging unit for imaging a subject opposite to the imaging person.   18. The display device according to claim 15, further comprising a display unit on a side where the imaging unit captures the image, and the control unit controls the display unit to display an image captured by the imaging unit. The imaging device according to any one of the above. An image pickup apparatus comprising: a first image pickup unit; and the second image pickup unit for shooting a direction opposite to the first image pickup unit,
Detecting means for detecting a posture of the imaging device;
Control for adding rotation information corresponding to the orientation of the imaging device detected by the detection means to the image taken by the first imaging means and the image taken by the second imaging means, and recording them on a recording medium Control means for performing,
When the image pickup apparatus is in a vertical posture, the control means has a 180 degree phase difference between the image taken by the second image pickup means and the rotation information added to the image taken by the first image pickup means. An image pickup apparatus that performs control so that rotation information is added and recorded. Control method of display control apparatus for displaying on display means image taken by first imaging means and image taken by second imaging means for photographing in opposite direction to first imaging means Because
A determination step of determining an attitude of the first imaging means or the second imaging means;
A display control step for simultaneously displaying on the display means an image photographed by the first imaging means and an image photographed by the second imaging means, together with the image photographed by the first imaging means; When displaying an image captured by the second imaging unit without mirror image reversal, if it is determined in the determination step that the posture is a predetermined posture, the image captured by the second imaging unit is rotated. And a display control step of controlling the display so as to display the display control method. A recording apparatus for synthesizing and recording an image photographed by a first imaging means and an image photographed by the second imaging means for photographing a direction opposite to the photographing direction of the first imaging means. A control method,
A determination step of determining an attitude of the first imaging means or the second imaging means;
A recording control step for combining an image photographed by the first imaging means and an image photographed by the second imaging means and recording them on a recording medium, the image photographed by the first imaging means When the image captured by the second imaging means is combined and recorded without being mirror-inverted, and is determined to be in a predetermined posture in the determination step, the image is captured by the second imaging means. And a recording control step of controlling the rotated image to be synthesized. A control method of a display control device for displaying an image taken by an imaging means on a display means,
An acquisition step of acquiring rotation information around the imaging direction of the imaging means;
When it is determined that the imaging unit is rotated 90 degrees or 270 degrees based on the rotation information acquired in the acquisition step, the image captured by the imaging unit is rotated 180 degrees and displayed on the display unit And a display control step for controlling the display control method. A recording apparatus for recording an image captured by a first imaging unit and an image captured by the second imaging unit for capturing a direction opposite to the imaging direction of the first imaging unit on a recording medium. A control method,
An acquisition step of acquiring information indicating rotation around the imaging direction of the first imaging means;
A recording step of adding rotation information corresponding to the information acquired in the acquisition step to the image captured by the first imaging unit and the image captured by the second imaging unit, and recording on the recording medium; Have
In the recording step, when it is determined that the imaging unit is rotated 90 degrees or 270 degrees based on the information acquired in the acquisition step, the image captured by the second imaging unit includes A method for controlling a recording apparatus, comprising: adding rotation information that is 180 degrees out of phase with rotation information to be added to an image photographed by the first imaging means, and recording the image.   The program for functioning a computer as each means of the imaging device of Claims 1 thru | or 19.   A computer-readable storage medium storing a program for causing a computer to function as each unit of the imaging apparatus according to claim 1.   A program for causing a computer to execute the control method of the display control device according to claim 20 or 22.   24. A program for causing a computer to execute the control method for a recording apparatus according to claim 21 or 23.   A computer-readable storage medium storing the program according to claim 26 or 27.

Images