JP5383356B2 - IMAGING DEVICE, INFORMATION PROCESSING DEVICE, IMAGING DEVICE CONTROL METHOD, INFORMATION PROCESSING DEVICE CONTROL METHOD, AND COMPUTER PROGRAM - Google Patents

Description

  The present invention relates to an imaging apparatus, an information processing apparatus, an imaging apparatus control method, an information processing apparatus control method, and a computer program.

There has been proposed a stereo camera that can execute stereoscopic image shooting (stereo shooting) using a plurality of imaging optical systems and can execute normal planar image shooting using a predetermined imaging optical system.
For example, Patent Literature 1 discloses a stereo camera including a plurality of imaging optical systems arranged in the horizontal direction. This stereo camera automatically detects the vertical position to issue a shooting warning or invalidates the release button when shooting in the vertical position during stereo shooting.
For example, Patent Document 2 discloses a camera in which a flash light emitting unit is disposed at a position where a subject can be irradiated with light with an equal amount of light when viewed from two photographing lenses.
Further, for example, Patent Literature 3 discloses a compound-eye digital camera that records an image obtained from some of the plurality of imaging units when a vertical shooting is detected on a recording medium. Vertical shooting is shooting at a so-called vertical position in which imaging means are arranged in the vertical direction.

JP-A-6-148774 JP 2001-290227 A JP 2008-141514 A

A stereo camera is a camera that enables stereoscopic viewing by reproducing parallax when viewed with both eyes by photographing with two or more imaging optical systems. In order to stereoscopically view a photographed image, it is necessary to photograph so that the arrangement of the imaging optical system is in the same horizontal positional relationship as both eyes.
Here, there are cases where it is desired to use a stereo camera to shoot with a composition other than the positional relationship in which the imaging optical systems are arranged horizontally. In this case, if the image is rotated and displayed on the monitor according to the taken posture, the display becomes uncomfortable when viewed by a person, and a desired three-dimensional display cannot be obtained. Therefore, conventionally, a photographer (user) manually switches the shooting mode from the stereo mode to the planar image shooting mode. In addition, stereo cameras have dealt with failed shooting by displaying warnings according to the posture of the camera or disabling the release button. However, depending on how the user switches to the shooting mode and how the stereo camera displays a warning or the like, failed shooting cannot be prevented. In addition, for example, some compound-eye digital cameras disclosed in Patent Document 3 can capture a planar image when the vertical position is detected, but then the posture is changed from the vertical position to the horizontal position. However, it is not possible to automatically return to stereoscopic image shooting. In other words, it is not possible to automatically switch between planar image shooting and stereoscopic image shooting quickly according to changes in the camera posture. As a result, it becomes impossible to perform a desired stereoscopic image display or flat image display without a sense of incongruity according to the camera posture at the time of imaging.

Conventionally, there has not been proposed an imaging apparatus that displays a stereoscopic image taken in a vertical position without causing a sense of incongruity in a horizontal position. Furthermore, no imaging device has been proposed that displays a predetermined image included in a stereoscopic image in a vertical position when the orientation at the time of shooting the stereoscopic image is the vertical position.
The present invention relates to an imaging apparatus, an information processing apparatus, an imaging apparatus control method, and an information processing apparatus capable of performing a desired stereoscopic image display or planar image display without a sense of incongruity according to the posture of the imaging apparatus during imaging. It is an object to provide a control method and a computer program.

An imaging apparatus according to an embodiment of the present invention is an imaging apparatus including first and second imaging optical systems, based on attitude detection means for detecting the attitude of the imaging apparatus, and the detected attitude. And control means for controlling the image capturing operation. When the detected posture is a vertical position, the control means can execute planar image shooting for a subject image that has passed through one of the first and second imaging optical systems, When the posture is changed from the vertical position to the horizontal position, stereoscopic image shooting can be executed from the subject images that have passed through the first and second imaging optical systems. When a light emitting unit that emits light in accordance with image shooting is provided at a predetermined distance from a position where each imaging optical system is provided, and the control unit is configured so that the detected posture is a vertical position. In addition, the planar image photographing is executed for the subject image that has passed through the imaging optical system provided at a position lower than the position where the light emitting means is provided.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to perform desired three-dimensional image display or plane image display without the sense of incongruity according to the attitude | position at the time of imaging.

It is a figure which shows the structural example of the imaging device of this embodiment. It is a figure which shows the example of an external appearance of the imaging device of this embodiment. It is a figure which shows the example of the operation processing flow of the imaging device which concerns on Example 1 of this invention. It is a figure which shows the example of the operation processing flow of the imaging device which concerns on Example 2 of this invention. It is a figure explaining the operation | movement process of the imaging device which concerns on Example 3 of this invention. It is a figure which shows the example of the operation processing flow of the imaging device which concerns on Example 4 of this invention. It is a figure which shows the operation processing flow of the imaging device which concerns on Example 5 of this invention.

  FIG. 1 is a diagram illustrating a configuration example of an imaging apparatus according to the present embodiment. An imaging apparatus 1 illustrated in FIG. 1 is an information processing apparatus including, for example, a digital camera, a video camera, and a display unit that control a plurality of imaging optical systems to perform planar image shooting or stereoscopic image shooting. The imaging apparatus 1 includes a first imaging optical system 11, a second imaging optical system 12, gain amplifiers 13 and 15, and A / D (Analog / Digital) converters 14 and 16. The imaging apparatus 1 also includes a D / A (Digital / Analog) converter 17, a timing generation circuit 18, a memory control circuit 19, and a system control circuit 20. Further, the imaging apparatus 1 includes an image processing circuit 21, exposure control circuits 22 and 30, focus control circuits 23 and 31, image display memory 24, memories 25 and 42, compression / decompression circuit 26, stereo image display unit 27, and zoom control circuit. 28, 32 and barrier control circuits 29, 33. The imaging apparatus 1 includes a display unit 34, an optical viewfinder 35, a nonvolatile memory 36, a shutter switch (SW1) 37, a shutter switch (SW2) 38, an image display on / off switch 39, a quick review on / off switch 40, An operation unit 41 is provided. The imaging device 1 includes a mode dial 43, a flash light emitting unit 44, an attitude determination circuit 45, a power supply control circuit 46, connectors 48, 52, 57, and 58, a recording medium attachment / detachment detection device 50, a communication device 51, an I / F 55, 56.

  The first imaging optical system 11 and the second imaging optical system 12 are imaging means for performing image imaging processing. The first imaging optical system 11 includes a variable power lens (hereinafter referred to as zoom lens) 111, a focus lens (hereinafter referred to as focus lens) 112, an aperture shutter unit 113, an image sensor 114, and a protection member 115. The second imaging optical system 11 includes a zoom lens 121, a focus lens 122, an aperture shutter unit 123, an imaging element 124, and a protection member 125. The zoom lenses 111 and 121 are controlled by zoom control circuits 28 and 32, respectively, to perform zooming. As a result, the subject image is scaled. The focus lenses 112 and 122 are controlled by the focus control circuits 23 and 31, respectively, to perform focusing. The aperture shutter units 113 and 123 incorporate an aperture and a shutter. The aperture shutter units 113 and 123 are controlled by the exposure control circuits 22 and 30, respectively, to perform exposure control, that is, control of the exposure amount for the image sensor. The image sensors 114 and 124 convert the optical image into an analog electric signal and output it. The protection members 115 and 125 are controlled by the barrier control circuits 29 and 33, respectively, and function as barriers for the first imaging optical system 11 and the second imaging optical system 12. Specifically, the protection members 115 and 125 cover the imaging unit including the zoom lenses 111 and 121 included in the imaging device 1 to prevent the imaging unit from being dirty or damaged.

The gain amplifier 13 amplifies the analog signal output from the imaging element 114 and sets the sensitivity of the imaging device 1. The A / D converter 16 converts the amplified analog signal into a digital signal. Similarly, the gain amplifier 15 amplifies the analog signal output from the image sensor 124 and sets the sensitivity of the imaging device 1. The A / D converter 16 converts the amplified analog signal into a digital signal. The D / A converter 17 receives digital image data from the memory control circuit 19 and converts the received image data into analog image data based on the clock signal and control signal supplied from the timing generation circuit 18. To do. The timing generation circuit 18 supplies a clock signal and a control signal to the D / A converter 17. The timing generation circuit 18 is controlled by a system control circuit 20 and a memory control circuit 19.
The memory control circuit 19 controls the A / D converters 14 and 16, the timing generation circuit 18, the image processing circuit 21, the image display memory 24, the D / A converter 17, the memory 25, and the compression / decompression circuit 26. For example, the memory control circuit 19 controls the A / D converters 14 and 16 and causes the image processing circuit 21 to input image data indicated by signals output from the A / D converters 14 and 16. The memory control circuit 19 controls the image processing circuit 21 to perform image processing on the image data input from the A / D converters 14 and 16. Further, the memory control circuit 19 receives image data output as a result of image processing by the image processing circuit 21, and writes it in the image display memory 24 and the memory 25. Further, the memory control circuit 19 extracts image data from the image display memory 24, passes the extracted image data to the image rotation processing circuit 211 of the image processing circuit 21, and rotates the image data. The memory control circuit 19 receives image data from the recording medium 53 via the connector 57 and the I / F 55, and writes the received image data in the image display memory 24 and the memory 25. The memory control circuit 19 receives image data from the recording medium 54 via the connector 58 and the I / F 56, and writes the received image data in the image display memory 24 and the memory 25. The processing of the memory control circuit 19 described above is controlled by the system control circuit 20.

  The system control circuit 20 functions as a control unit that controls the entire imaging apparatus 1 and instructs each processing unit included in the imaging apparatus 1 to execute processing of each processing unit. Further, the system control circuit 20 performs timing control for controlling each of the first imaging optical system 11 and the second imaging optical system 12 simultaneously or individually. The image processing circuit 21 performs predetermined image processing on the image data indicated by the signals output from the A / D converters 14 and 16 or the image data read out from the image display memory 24 or the memory 25 by the memory control circuit 19. Run. For example, the image processing circuit 21 performs pixel interpolation processing and color conversion processing. Further, the image processing circuit 21 includes an image rotation processing circuit 211, and the image rotation processing circuit 211 rotates the image data extracted from the memory 25 by the memory control circuit 19. The image rotation processing circuit 211 performs image rotation processing based on, for example, posture information recorded in the image data. The image data after the rotation processing is stored in the image display memory 24 through the memory control circuit 19 and then passed through the D / A converter 17 to the stereo image display unit 28 having TFT, LCD, and the like. Is displayed. TFT and LCD are abbreviations for Thin Film Transistor and Liquid Crystal Display, respectively. Further, the image processing circuit 21 performs a predetermined calculation process using the input image data. The system control circuit 20 controls the exposure control circuit 22 and the focus control circuit 23 or the exposure control circuit 30 and the focus control circuit 31 based on the calculation result. As a result, through-the-lens (TTL) autofocus (AF) processing, automatic exposure (AE) processing, and flash pre-flash processing are performed on the first imaging optical system 11 or the second imaging optical system 12. Is called. AF, AE, and TTL are abbreviations for Auto Focus, Auto Exposure, and Through The Lens, respectively. Further, the image processing circuit 21 performs predetermined arithmetic processing using the image data obtained from the first imaging optical system 11 and the second imaging optical system 12, and based on the obtained arithmetic result, the TTL method. Auto White Balance (AWB) processing is performed.

The exposure control circuits 22 and 30 control the aperture shutter units 113 and 123, respectively, in accordance with instructions from the system control circuit 20, and execute AE processing. Specifically, the system control circuit 20 obtains the brightness (photometric value) of the subject based on the calculation result by the image processing circuit 21, and performs exposure setting based on the obtained photometric value. That is, the system control circuit 20 determines whether or not the flash light emitting unit 44 needs to emit light (whether or not flash photography is necessary) and instructs the exposure control circuit 22 or the exposure control circuit 30 to set the exposure amount to an appropriate exposure amount. Control to be. The focus control circuits 23 and 31 execute the AF process by controlling the focus lenses 112 and 122, respectively, in accordance with instructions from the system control circuit 20.
In the image display memory 24, the image data processed by the image processing circuit 21 is written. The image display memory 24 stores image data received from the recording medium 53 by the memory control circuit 19 via the connector 57 and I / F (Interface) 55. The image display memory 24 stores image data received from the recording medium 54 by the memory control circuit 19 via the connector 58 and the I / F 56.

The memory 25 is a storage unit that stores still images and moving images captured by the first imaging optical system 11 or the second imaging optical system 12. The memory 30 has a sufficient storage capacity for storing a predetermined number of still images and a moving image for a predetermined time. Even when the imaging apparatus 1 performs stereo image capturing, panoramic image capturing, or continuous image capturing in which a plurality of still images are continuously captured, a large amount of image writing can be performed on the memory 25 at high speed. The memory 25 can also be used as a work area for processing performed by the system control circuit 20. The memory 25 functions as a storage unit that stores relative information of the focus control circuit 23 with respect to the operation of the zoom control circuit 28 and relative information of the focus control circuit 31 with respect to the operation of the zoom control circuit 32. The image data stored in the memory 25 is stored in the recording medium 53 or the recording medium 54 by the system control circuit 20. In other words, the image display memory 24, the memory 25, and the recording media 53 and 54 described above function as an image storage unit that stores captured images.
The compression / decompression circuit 26 compresses / decompresses image data by adaptive discrete cosine transform (ADCT) or the like. Specifically, the compression / decompression circuit 26 reads an image stored in the memory 25, performs compression processing or decompression processing, and writes data that has undergone compression processing or decompression processing to the memory 25.

The stereo image display unit 27 displays the image data output from the D / A converter 17. The stereo image display unit 27 displays a stereoscopic image or a planar image, for example. A stereoscopic image is a stereo image including a plurality of images. A planar image is an image composed of a single image. An electronic viewfinder function can be realized by sequentially displaying image data using the stereo image display unit 27. In addition, the stereo image display unit 28 can arbitrarily turn on / off the display in accordance with an instruction from the system control circuit 20. When the stereo image display unit 27 turns off the display, the power consumption of the imaging device 1 can be significantly reduced.
The zoom control circuits 28 and 32 control zooming of the zoom lenses 111 and 121, respectively. The barrier control circuits 29 and 33 control the operation of the protection members 115 and 125, respectively. The display unit 34 includes an LCD, a speaker, and the like. The display unit 34 displays information, a message, and the like indicating an operation state with characters, images, sounds, and the like in accordance with execution of processing of the system control circuit 20. The display unit 34 is installed at one or a plurality of locations in the vicinity of an operation unit such as SW1, which will be described later. Further, the display unit 34 is provided with a part of its function in the optical viewfinder 35. Examples of the display on the LCD provided in the display unit 34 include single shot / continuous shooting imaging display, self-timer display, compression rate display, recording pixel number display, recording number display, remaining image pickup number display, shutter speed display, aperture There are value display and exposure compensation display. In addition, LCD display includes LED flash mode display, red-eye reduction display, macro imaging display, buzzer setting display, clock battery level display, battery level display, error display, and multi-digit number information display. . Further, the display of the attachment / detachment status of the recording media 53, 54, the display indicating that the I / Fs 55, 56 are operating, the date / time display, and the like are displayed on the LCD. The optical viewfinder 35 has functions such as in-focus display, camera shake warning display, strobe charge display, shutter speed display, aperture value display, and exposure correction display.

The nonvolatile memory 36 is an electrically erasable and recordable storage means such as an EEPROM (Electrically Erasable Programmable Read only Memory). SW1 (37), SW2 (38), image display on / off switch 39, quick review on / off switch 40, and operation unit 41 are operations for the user to input various operation instructions to the system control circuit 20. It functions as a part. These are configured by a combination of a switch, a dial, a touch panel, pointing by eye-gaze detection, a voice recognition device, and the like.
SW1 (37) is turned on during the operation of a shutter switch member (not shown), and instructs the system control circuit 20 to start imaging preparation operations such as AF processing, AE processing, AWB processing, and flash pre-flash processing. . SW2 (38) is turned on when the operation of a shutter switch member (not shown) is completed, and instructs the system control circuit 20 to start a series of imaging processes.
Upon receiving the instruction to start the imaging process, the system control circuit 20 causes the flash light emitting unit 44 to emit light, and instructs the first imaging optical system 11 or the second imaging optical system 12 to execute the imaging process. Further, the system control circuit 20 passes the captured image data to the image processing circuit 21 for image processing, and instructs the memory control circuit 19 to send the image processed image data to the image display memory 24 and the memory 25. Let it be written. The system control circuit 20 receives the attitude of the imaging apparatus at the time of imaging image data from the attitude determination circuit 45, writes attitude information indicating this attitude into the image data, and then stores the image data in the image display memory 24 or the memory 25. Write. The image data is written into the image display memory 24 and the memory 25 in a file format corresponding to the shooting mode when the image data is captured. Therefore, when the captured image is a stereoscopic image, a stereoscopic image in which posture information indicating the posture at the time of shooting is written is written in a file format corresponding to the stereo mode. Further, when the captured image is a planar image, the planar image in which the posture information indicating the posture at the time of photographing is written is written in a file format corresponding to the planar image photographing mode.

Further, when the quick review function is set to ON by a quick review on / off switch 40 described later, the system control circuit 20 displays the image data written in the image display memory 24 as a stereo image immediately after imaging. This is displayed on the unit 27. Further, the system control circuit 20 instructs the compression / decompression circuit 26 to compress and decompress the image data written in the memory 25. Then, the system control circuit 20 writes the compressed / decompressed image data in the recording medium 53 or 54.
The image display on / off switch 39 has a function of setting on / off of the stereo image display unit 27. With this function, when imaging is performed using the optical viewfinder 35, it is possible to cut power supply to the stereo image display unit 28 to save power. The quick review on / off switch 40 sets on / off of a quick review function that automatically reproduces captured image data immediately after imaging.

  The operation unit 41 includes various buttons and a touch panel. For example, the operation unit 41 includes a menu button, a set button, a macro button, a multi-screen playback page break button, a strobe setting button, and a single shooting / continuous shooting / self-timer switching button. Further, the operation unit 41 includes a menu movement + (plus) button, a menu movement − (minus) button, a reproduction image movement + (plus) button, a reproduction image − (minus) button, an image quality selection button, an exposure correction button, a date. / Has a time setting button. When the user instructs to reproduce image data using, for example, a menu button, the system control circuit 20 executes image data reproduction processing as follows. That is, for example, the system control circuit 20 receives image data from the recording medium 53 via the I / F 55 and develops the received image data in the memory 25. The system control circuit 20 passes the image data expanded in the memory 25 to the image processing circuit 21 via the memory control circuit 19, and performs image processing (for example, image rotation processing) according to the posture information written in the image data. ) Is executed. The system control circuit 20 develops the image data processed by the image processing circuit 21 in the image display memory 24 via the memory control circuit 19 and causes the stereo image display unit 27 to display the image data. The system control circuit 20 executes the same reproduction process as described above even when the image data stored in the recording medium 53 is obtained by an imaging device other than the imaging device 1.

  The memory 42 stores constants, variables, programs, and the like for operating the system control circuit 20. The mode dial 43 sets a stereo mode and a planar image shooting mode. The stereo mode is a shooting mode in which stereoscopic image shooting can be performed from a subject image that has passed through the first imaging optical system 11 and the second imaging optical system 12, respectively. The planar image shooting mode is a shooting mode in which planar image shooting can be performed on a subject image that has passed through one of the first and second imaging optical systems. The mode dial 43 further has shooting modes corresponding to various shooting scenes such as an auto mode, a program mode, an aperture priority mode, a shutter speed priority mode, a night view mode, a child shooting mode, a fireworks shooting mode, and an underwater shooting mode. Settings can be made. The flash light emitting unit 44 is a light emitting unit that emits light when taking an image in accordance with an instruction from the system control circuit 20. The attitude determination circuit 45 functions as an attitude detection unit that detects the attitude of the imaging apparatus 1. The posture determination circuit 45 includes an acceleration sensor that detects gravity and the like, and detects the posture based on the output value of the acceleration sensor. Specifically, the posture determination circuit 45 determines whether the posture of the imaging device 1 is the horizontal position or the vertical position. In the present embodiment, the posture in the horizontal position is a posture in which the first imaging optical system 11 and the second imaging optical system 12 are arranged side by side at the time of imaging. Further, the vertical posture is a posture in which the first imaging optical system 11 and the second imaging optical system 12 are arranged side by side at the time of imaging. Note that the posture determination circuit 45 may detect a posture other than the horizontal position or the vertical position. For example, the posture determination circuit 45 may detect a posture inclined at a predetermined angle with respect to the horizontal position or the vertical position.

  The posture determination circuit 45 passes posture information indicating the detected posture of the imaging device 1 to the system control circuit 20. For example, the system control circuit 20 controls the image capturing operation by the imaging optical system based on the posture indicated by the posture information passed from the posture determination circuit 45. When performing stereoscopic image shooting, the system control circuit 20 causes both the first imaging optical system 11 and the second imaging optical system 12 to perform imaging processing. When performing planar image shooting, the system control circuit 20 causes one of the first imaging optical system 11 and the second imaging optical system 12 to perform imaging processing. The power control circuit 46 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches blocks to be energized, and the like. The power supply control circuit 46 detects the presence / absence of a battery, the type of battery, the remaining battery level, and the power supply voltage, and controls the DC-DC converter based on the detection result and an instruction from the system control circuit 20, and is necessary. Is supplied to each processing unit of the imaging apparatus 1 for a necessary period.

  The power source 47 shown in FIG. 1 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The power supply control circuit 46 and the power supply 47 are connected via connectors 48 and 49. The recording medium attachment / detachment detection device 50 detects whether the recording medium 53 is attached to the connector 57 or whether the recording medium 54 is attached to the connector 58. The communication device 51 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN (Local Area Network), and wireless communication. The connector 52 is a communication interface between the communication device 51 and an external device of the imaging device 1. When the communication device 51 performs wireless communication, the connector 52 may be an antenna. Recording media 53 and 54 shown in FIG. 1 are recording media such as a memory card and a hard disk. On the recording media 53 and 54, an image captured by the image capturing apparatus 1 is recorded in a file format corresponding to the shooting mode when the image is captured, together with attitude information of the image capturing apparatus 1 when the image is captured. Remembered. Note that the images stored in the recording media 53 and 54 may be captured and stored by another imaging device different from the imaging device 1. In the present embodiment, when the images stored in the recording media 53 and 54 are captured by another imaging device, the image includes orientation information of the imaging device when the image is captured. Is written. The image is stored in a file format corresponding to the shooting mode when the image is captured.

The recording medium 53 includes a recording unit 531 that stores image data and the like, an I / F 532 that is an interface with the imaging apparatus 1, and a connector 533 that connects the recording medium 53 to the imaging apparatus 1. The recording unit 531 includes a semiconductor memory, a magnetic disk, and the like. The recording medium 54 includes a recording unit 541 having the same function as the recording unit 531, an I / F 542 that is an interface with the imaging apparatus 1, and a connector 543 that connects the recording medium 54 to the imaging apparatus 1. The I / Fs 55 and 56 are communication interfaces that execute communication with the recording media 53 and 54, respectively. The I / Fs 55 and 56 are connected to the recording media 53 and 54 via connectors 57 and 533 and connectors 58 and 543, respectively. The number of connectors for attaching the recording media 53 and 54 to the imaging apparatus 1 and the number of communication interfaces connected to the recording media 53 and 54 via the connectors can be arbitrary. The imaging device 1 may be configured to include a combination of communication interfaces and connectors of different standards. The communication interface and connector may be compliant with a standard such as a PCMCIA card or an SD (registered trademark) card (Secure Digital Card). When using a communication interface and a connector conforming to a standard such as a PCMCIA card or an SD card, there are the following advantages by connecting various communication cards. That is, image data and management information attached to the image data can be transferred to and from other computers and peripheral devices such as a printer. The various communication cards are, for example, a LAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 card, a SCSI card, a PHS, and the like.
The imaging apparatus control method and the computer program thereof according to the present embodiment are realized by the functions of the processing unit included in the imaging apparatus 1 described above.

  FIG. 2 is a diagram illustrating an appearance example of the imaging apparatus according to the present embodiment. In the present embodiment, as shown in FIG. 2A, the posture of the imaging device 1 when the first imaging optical system 11 and the second imaging optical system 12 included in the imaging device 1 are aligned in the horizontal direction. Is called the horizontal position. Further, as shown in FIG. 2B, the orientation of the imaging apparatus 1 when the first imaging optical system 11 and the second imaging optical system 12 included in the imaging apparatus 1 are arranged in the vertical direction is the vertical position. That's it. A flash light emitting unit 44 is provided at a position (for example, an equidistant position) at a predetermined distance from the position where each imaging optical system is provided.

  FIG. 3 is a diagram illustrating an example of an operation processing flow of the imaging apparatus according to the first embodiment of the present invention. The operation processing flow in FIG. 3 shows an example of image capturing processing of the imaging apparatus 1. First, the attitude determination circuit 45 of the imaging apparatus 1 detects the attitude of the imaging apparatus 1 and passes attitude information indicating the detected attitude to the system control circuit 20. Then, the system control circuit 20 determines whether the posture of the imaging device 1 is the horizontal position based on the posture information received from the posture determination circuit 45 (step S1). When the system control circuit 20 determines that the posture is the horizontal position, the system control circuit 20 determines whether the shooting mode currently set by the mode dial 43 is the stereo mode (step S2). When the system control circuit 20 determines that the shooting mode is the stereo mode, the system control circuit 20 activates (controls) both the first imaging optical system 11 and the second imaging optical system 12 (step S3). ). The activation of the imaging optical system referred to here indicates that the imaging optical systems 11 and 12 are ready for imaging. Then, when the SW2 (38) is turned on, the system control circuit 20 executes stereoscopic image shooting with the first imaging optical system 11 and the second imaging optical system 12 (step S4). In step S4, the system control circuit 20 further writes posture information indicating the lateral position in the metadata in association with the captured image, and captures the image in the memory 25 and the recording medium 53 in a file format corresponding to the stereo mode. The recorded image is stored. When reproducing this stereoscopic image according to the user's operation, the system control circuit 20 stereoscopically displays the stereoscopic image in the horizontal position based on the posture information written in the metadata in association with the stereoscopic image. Stereoscopic display of a stereoscopic image in a horizontal position is to display the stereoscopic image without rotating.

  When the system control circuit 20 determines that the posture is not the horizontal position but the vertical position in step S1, the system control circuit 20 sets the shooting mode to the plane regardless of the shooting mode set by the mode dial 43. The image shooting mode is set (step S6). Subsequently, the system control circuit 20 activates a predetermined imaging optical system (step S7). For example, the system control circuit 20 has an imaging optical system provided in a position below the position where the flash light emitting unit 44 is provided (first imaging optical system 11 in the example shown in FIG. 2B). Start up. The imaging optical system to be activated may be an imaging optical system farther from the grip among the plurality of imaging optical systems. If the imaging optical system far from the grip is activated, the imaging optical system can be prevented from being caught on the finger when the user holds the imaging device 1. In consideration of ease of framing, for example, the imaging optical system closer to the center of the monitor on the back of the imaging apparatus may be activated. Then, the system control circuit 20 instructs the imaging optical system activated in step S7 to perform planar image shooting (step S8). For example, the imaging optical system provided at a position lower than the position where the flash light emitting unit 44 is provided performs planar image shooting, thereby reducing the reflection of shadows on the background and natural shadowing of the subject. It becomes possible to pick up the image which becomes.

If the system control circuit 20 determines in step S2 that the shooting mode is not the stereo mode but the planar image shooting mode, the system control circuit 20 activates the predetermined imaging optical system as described above (step S2). S5). Then, in accordance with an instruction from the system control circuit 20, planar image shooting is performed by the activated imaging optical system (step S8). In step S8, the system control circuit 20 writes posture information indicating a posture (lateral position) at the time of photographing in a part of the metadata in association with the photographed planar image. Then, the flat image is stored in, for example, the memory 25 and the recording medium 53 in a file format corresponding to the flat image photographing mode. When reproducing this planar image in accordance with a user operation, the system control circuit 20 displays the planar image in a horizontal position on the basis of the posture information written in the metadata related to the planar image. Displaying a planar image in a horizontal position is to display the stored planar image without rotating.
According to the imaging apparatus according to the first embodiment, stereoscopic image shooting can be performed when the orientation of the imaging apparatus 1 is the horizontal position, and a planar image can be captured when the orientation is the vertical position. it can. Accordingly, by displaying the captured image in the posture at the time of shooting, the imaging device 1 can perform a desired three-dimensional image display or planar image display without a sense of incongruity according to the posture of the imaging device 1 at the time of shooting. Become.

FIG. 4 is a diagram illustrating an example of an operation processing flow of the imaging apparatus according to the second embodiment of the present invention. The operation processing flow in FIG. 4 shows an example of image capturing processing of the imaging apparatus 1. The posture determination circuit 45 of the imaging device 1 detects the posture of the imaging device 1, and the system control circuit 20 determines whether the detected posture is a lateral position (step S11). When the system control circuit 20 determines that the detected posture is the horizontal position, the system control circuit 20 determines whether the currently set shooting mode is the stereo mode (step S12). When the system control circuit 20 determines that the shooting mode is the stereo mode, the system control circuit 20 activates both the first imaging optical system 11 and the second imaging optical system 12 (step S13), and step Proceed to S14. Subsequently, the posture determination circuit 45 detects the posture of the imaging device 1, and the system control circuit 20 determines whether the posture of the imaging device 1 has changed to the vertical position based on the detection result of the posture (step). S14). When the system control circuit 20 determines that the posture of the imaging device 1 has not changed to the vertical position, the system control circuit 20 performs stereoscopic image shooting using the imaging optical system activated in step S13 (step S15). .
If the system control circuit 20 determines in step S11 that the detected posture is not the horizontal position but the vertical position, the shooting mode is set to the plane image regardless of the shooting mode set by the mode dial 43. The shooting mode is set (step S16). The system control circuit 20 activates the imaging optical system provided at a position below the position where the flash light emitting unit 44 is provided (step S17). Subsequently, the posture determination circuit 45 detects the posture of the imaging device 1, and the system control circuit 20 determines whether the posture of the imaging device 1 has changed to the horizontal position based on the detection result of the posture (step). S18). When the system control circuit 20 determines that the posture of the imaging device 1 has not changed to the horizontal position, the process proceeds to step S20. When the system control circuit 20 determines that the posture of the imaging device 1 has changed to the horizontal position, the system control circuit 20 determines whether the shooting mode set by the mode dial 43 is the stereo mode (step). S19). When the system control circuit 20 determines that the shooting mode is not the stereo mode, the process proceeds to step S20. When the system control circuit 20 determines that the shooting mode is the stereo mode, the process proceeds to step S13 described above.

The system control circuit 20 determines whether or not to perform flash photography when the SW1 (37) is turned on (step S20). If the system control circuit 20 determines not to perform flash photography, the process proceeds to step S23. When the system control circuit 20 determines that the flash photography is to be performed, the system control circuit 20 determines whether the imaging optical system to be photographed is provided at a position below the position where the flash light emitting unit 44 is provided. (Step S21). When the system control circuit 20 determines that the imaging optical system to be photographed is provided at a position below the position where the flash light emitting unit 44 is provided, the process proceeds to step S23. When the system control circuit 20 determines that the imaging optical system is not provided at a position below the position where the flash light emitting unit 44 is provided, the system control circuit 20 is located below the position where the flash light emitting unit 44 is provided. The imaging optical system provided at the position is activated (step S22). Then, the system control circuit 20 performs planar image shooting (step S23).
If the system control circuit 20 determines in step S14 that the orientation of the imaging apparatus 1 has changed to the vertical position, the upper imaging optical system is turned off (step S25), and the imaging mode is set to planar image imaging. The mode is set (step S26), and the process proceeds to step S20.
When the posture is the vertical position, the imaging apparatus 1 according to the second embodiment instructs a predetermined imaging optical system among a plurality of imaging optical systems to perform planar image shooting (Steps S11 and S16 in FIG. 4). To S23). In addition, the imaging apparatus 1 can execute stereoscopic image shooting from subject images that have passed through the first imaging optical system 11 and the second imaging optical system 12 when the posture has changed from the vertical position to the horizontal position. (See S18, S19, and S13 to S15 in FIG. 4). Therefore, according to the imaging apparatus 1 according to the second embodiment, it is possible to automatically switch between planar image shooting and stereoscopic image shooting quickly in accordance with a change in posture.

FIG. 5 is a diagram for explaining operation processing of the imaging apparatus according to the third embodiment of the present invention. Although an example applied to an imaging device is shown here, any information processing device provided with a display means can be applied to a portable digital photo frame (PDF) or a portable information terminal. FIG. 5A shows an example of an image reproduction processing flow of the imaging apparatus 1. In this example, in particular, a reproduction process of an image captured by another imaging device 1 different from the imaging device 1 and stored in the recording medium 53 will be described. Therefore, it is particularly effective when stereoscopic image shooting at a vertical position, which is not performed in the above-described first and second embodiments, is executed and the stereoscopic image is stored in the storage medium 53. Note that the reproduction process of the image captured by the imaging apparatus 1 and stored in the recording medium can also be executed according to the same procedure as the image reproduction process shown in FIG.
The system control circuit 20 starts an image reproduction process in accordance with an operation input to the operation unit 41 by the user. The system control circuit 20 determines whether the display target image is a stereoscopic image (step S31). Specifically, the system control circuit 20 determines whether the image is a stereoscopic image or a planar image based on metadata related to the display target image stored in the recording medium 53. . When the system control circuit 20 determines that the image to be displayed is a stereoscopic image, the system control circuit 20 uses the two images to be displayed to display the stereoscopic display based on the parallax information of the metadata in the horizontal position. (Step S32). In step S <b> 32, the system control circuit 20 controls the display unit to stereoscopically display the image in the horizontal position regardless of whether the display target image is captured in the horizontal position or the vertical position. The stereoscopic display at the horizontal position means that the stored stereoscopic image is displayed without being rotated. Therefore, for example, when the image of the building that is the main subject is an image taken in the horizontal position, the standing building is stereoscopically displayed in the horizontal position as shown in FIG. When the building image is an image taken in a vertical position, as shown in FIG. 5C, the building image in a state of falling sideways is three-dimensionally displayed. Accordingly, since the stereoscopic display is performed as shown in FIG. 5C, the observer can view the image observed with the neck tilted 90 ° sideways with respect to the building.

  In step S31, when the system control circuit 20 determines that the image to be displayed is a planar image based on the related metadata, the planar image is in the horizontal position based on the posture information similarly written in the metadata. It is determined whether the image is a photographed image (step S33). When the system control circuit 20 determines that the planar image is an image taken in the lateral position, the planar image is displayed in a planar manner in the lateral position (step S34). In step S34, the system control circuit 20 displays the captured planar image on the screen without rotating, as shown in FIG. 5D, for example. When the system control circuit 20 determines that the image is not an image captured in the horizontal position but an image captured in the vertical position, the system control circuit 20 instructs the image processing circuit 21 to display the image. The rotation process is performed (step S35). In step S35, the system control circuit 20 rotates the image 90 ° counterclockwise, for example, so that the main subject in the image stands. Then, the system control circuit 20 displays the rotated image on a plane in the vertical position (step S36). For example, the captured planar image is displayed on the screen as shown in FIG. Note that a black area in FIG. 5E is an area that is not displayed on the screen because the image captured in the vertical position is rotated and displayed in the vertical position.

FIG. 6 is a diagram illustrating an example of an operation processing flow of the imaging apparatus according to the fourth embodiment of the present invention. Although an example applied to an imaging device is shown here, any information processing device provided with a display means can be applied to a portable digital photo frame (PDF) or a portable information terminal. Therefore, it is particularly effective when stereoscopic image shooting at a vertical position, which is not performed in the above-described first and second embodiments, is executed and the stereoscopic image is stored in the storage medium 53. The example of the operation processing flow shown in FIG. 6 shows a reproduction process of an image captured by another imaging device 1 different from the imaging device 1 and stored in the recording medium 53. In the operation processing flow shown in FIG. 6, steps S41, S46, S47, S48, and S49 are the same as steps S31, S33, S34, S35, and S36 shown in FIG. A description of the contents of the general process is omitted. In the fourth embodiment, the system control circuit 20 determines whether or not the stereoscopic image is captured in the horizontal position based on the posture information written in the metadata in relation to the stereoscopic image to be displayed (step S42). ). If the system control circuit 20 determines that the stereoscopic image has been taken in the horizontal position, the stereoscopic image is stereoscopically displayed in the horizontal position (step S43). When the system control circuit 20 determines that the stereoscopic image has been shot in the vertical position, the system control circuit 20 instructs the image rotation processing circuit 211 to select one of the two images recorded as the stereoscopic image. The predetermined one image is subjected to image rotation processing (step S44). Then, the system control circuit 20 displays the rotated image (planar image) on a plane in the vertical position (step S45).
The system control circuit 20 of the imaging apparatus 1 according to the fourth embodiment uses a stereoscopic image when the image stored in the recording medium 53 is a stereoscopic image and the attitude when the image is captured is the vertical position. The display means is controlled so that one of the two images included in the image is displayed in a plane in the vertical position.
Therefore, according to the imaging apparatus 1 according to the fourth embodiment, when the image instructed to be reproduced according to the user's operation is a stereoscopic image captured in the vertical position, the planar image that does not feel strange when viewed by the user. Can be displayed.

  FIG. 7 is a diagram illustrating an operation processing flow of the imaging apparatus according to the fifth embodiment of the present invention. The operation process flow shown in FIG. 7 shows the imaging process of the imaging apparatus 1. First, the system control circuit 20 determines whether the shooting mode is a stereo mode (step S1). When the system control circuit 20 determines that the shooting mode is the stereo mode, the system control circuit 20 captures a stereoscopic image (step S52). Subsequently, the system control circuit 20 writes posture information indicating the horizontal position in association with the stereoscopic image as posture information indicating the posture at the time of photographing (step S53). For example, posture information is written in a part of metadata. In step S53, the system control circuit 20 stores the stereoscopic image in the recording medium 53 in a file format corresponding to the stereo mode. When the imaging apparatus 1 captures a stereoscopic image with an upside down posture, the system control circuit 20 may write posture information indicating the upside down posture in association with the stereoscopic image. The system control circuit 20 may write information indicating a posture inclined by a predetermined angle with respect to the posture of the lateral position as a piece of metadata as posture information.

When the system control circuit 20 determines that the shooting mode is not the stereo mode but the planar image shooting mode, the system control circuit 20 captures a planar image (step S54). Subsequently, the posture determination circuit 45 of the imaging device 1 detects the posture of the imaging device 1, and the system control circuit 20 determines whether or not the detected posture is a lateral position (step S55). When the system control circuit 20 determines that the detected posture is the horizontal position, the process proceeds to step S53. When the system control circuit 20 determines that the detected posture is the vertical position, the system control circuit 20 associates the posture information indicating the vertical position with the planar image as the posture information indicating the posture at the time of shooting. Writing is performed (step S56). For example, posture information is written in a part of metadata. In step S56, the system control circuit 20 also stores the planar image in the recording medium 53 in a file format corresponding to the planar image photographing mode.
The imaging apparatus according to the fifth embodiment writes posture information indicating the horizontal position in the metadata in association with the captured image data regardless of whether the posture at the time of stereoscopic image shooting is the vertical position or the horizontal position. (See step S53 in FIG. 7). Therefore, for example, the image pickup apparatus performs image reproduction processing according to the posture indicated by the posture information that is conventionally written in the metadata as image data, so that even a stereoscopic image captured in the vertical position is in the horizontal position. 3D display is possible.

(Other examples)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 11 1st imaging optical system 12 2nd imaging optical system 20 System control circuit 21 Image processing circuit 27 Stereo image display part

Claims (3)

An imaging apparatus including first and second imaging optical systems,
Attitude detection means for detecting the attitude of the imaging device;
Control means for controlling the image capturing operation based on the detected posture;
When the detected posture is a vertical position, the control means can execute planar image shooting for a subject image that has passed through one of the first and second imaging optical systems, With the posture changed from the vertical position to the horizontal position, stereoscopic image shooting can be executed from the subject images that have passed through the first and second imaging optical systems ,
A light emitting means for emitting light accompanying image shooting is provided at a predetermined distance from the position where each imaging optical system is provided,
When the detected posture is a vertical position, the control means captures the planar image of a subject image that has passed through an imaging optical system provided at a position below the position where the light emitting means is provided. An imaging device characterized by executing A method for controlling an imaging apparatus including first and second imaging optical systems,
A detection step of detecting the orientation of the imaging device;
A control step of controlling an image capturing operation based on the detected posture;
In the control step, when the detected posture is a vertical position, planar image shooting can be performed on the subject image that has passed through the first and second imaging optical systems, and the posture is changed from the vertical position to the horizontal position. Triggered by the change in position, stereoscopic image shooting can be performed from subject images that have passed through the first and second imaging optical systems ,
The imaging device is provided with a light-emitting means that emits light when the image is photographed at a predetermined distance from the position where each imaging optical system is provided.
In the control step, when the detected posture is a vertical position, the planar image shooting is performed on a subject image that has passed through an imaging optical system provided at a position lower than the position where the light emitting unit is provided. The control method characterized by performing . A computer program for causing a computer to execute the control method according to claim 2 .

Images