JP2013062557A - Digital imaging apparatus and 3d imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To take a desired stereoscopic image without repetitive imaging.SOLUTION: A digital camera takes a stereoscopic image by taking plural still images from different view points, continuously in terms of time. In the case, the digital camera displays on a liquid crystal monitor a predictive image of a still image to be taken second or later. The predictive image in this case means a still image generated on the basis of a first still image among the still images to be taken continuously in terms of time. The digital camera assists imaging by the user, by displaying the predictive image on the liquid crystal monitor.

Description

  The present invention relates to a digital photographing apparatus and a 3D photographing method, and more particularly to a digital photographing apparatus and a 3D photographing method that generate a stereo image by time difference photographing using a single photographing apparatus.

  With the improvement of image display technology, an environment for viewing high-quality stereo images with a large screen and high resolution is being prepared. At the same time, the need for stereo images is increasing. Under such circumstances, various stereo image capturing methods have been proposed.

  Mainly, stereo image photographing methods include a twin-lens photographing method and a single-lens photographing method.

  In the two-lens photographing method, a stereo image can be photographed by photographing image data of different viewpoints with a camera equipped with two camera lenses. However, the apparatus becomes large and there are aspects that are not suitable for use by general users.

  The single-lens photographing method is a method of photographing image data of different viewpoints with a camera having one camera lens as in the past. In this method, it is necessary to move the camera body in a substantially horizontal direction in order to capture image data from different viewpoints.

  As a monocular imaging method, for example, there is an imaging method described in Patent Document 1.

JP 2000-228778 A

  However, the photographing method disclosed in Patent Document 1 is a method of performing continuous photographing while horizontally moving the camera and extracting the most appropriate two images as stereo images. Therefore, the degree of freedom when the user selects image data constituting a stereo image is low, and at least two appropriate images must be taken. Further, blurred image data or image data with a large deviation in the vertical direction may be captured due to the speed or direction in which the user moves the camera.

  In order to solve the above-described problems, the present invention is a digital imaging device that images a subject and generates recorded image data having a predetermined standard, and includes an optical system that images a subject and forms a subject image, and the optical system. An image capturing unit that generates image data based on a subject image that is generated, an image processing unit that generates recorded image data by performing image processing on the image data, and the image data or the image data A display unit that displays the recorded image data generated by processing in real time, a viewing environment condition when viewing the recorded image data, a memory that stores an image size when the subject is imaged, and a first viewpoint A control unit having a 3D imaging mode in which a first viewpoint image is acquired by imaging at a second viewpoint, and then a second viewpoint image is acquired by imaging at a second viewpoint. A control unit configured to control the optical system to form a first subject image at the first viewpoint, control the imaging unit, generate first image data based on the first subject image, and A processing unit is controlled to perform image processing on the first image data to generate a first viewpoint image, and based on the viewing environment condition, the image size, and the first image data or the first viewpoint image. , Generating a predicted image of the second viewpoint image, the image data obtained by being captured in real time on the display unit, or recorded image data obtained by processing the image data in the image processing unit, It is a digital imaging device that controls to display a predicted image simultaneously.

  As described above, according to the present invention, after the first viewpoint image is captured, a predicted image of the second viewpoint image can be generated. Further, by displaying the predicted image on the display unit, it is possible to present to the user how much the camera is moved to obtain an appropriate stereo image. Thereby, the user can capture a desired stereo image without repeatedly capturing images.

The block diagram which shows the structure of the digital camera 100 Flowchart showing predicted image creation operation in 3D shooting mode The figure which shows the imaging | photography environment at the time of image | photographing using the digital camera 100. The figure which shows the viewing environment at the time of viewing and listening to the 1st viewpoint image image | photographed with the digital camera 100, and a 2nd viewpoint image. The flowchart which shows the operation | movement at the time of producing | generating the estimated image of the digital camera 100. The figure explaining the operation | movement which shifts the whole 1st viewpoint image and produces | generates an estimated image. The figure explaining the operation | movement which shifts the partial area | region of a 1st viewpoint image, and produces | generates an estimated image. Operation flowchart when photographing second viewpoint image

  The digital photographing apparatus according to the present embodiment is a digital photographing apparatus that photographs a subject and generates recorded image data having a predetermined standard. The digital photographing device includes an optical system that photographs a subject and forms a subject image, and the optical system. An image capturing unit that generates image data based on a subject image, an image processing unit that generates recorded image data by performing image processing on the image data, and the image data or the image data in the image processing unit. In a first viewpoint, a display unit that displays recorded image data generated by processing in real time, a viewing environment condition when viewing the recorded image data, a memory that stores an image size when shooting a subject, and the first viewpoint A control unit having a 3D shooting mode for acquiring a first viewpoint image by shooting and then acquiring a second viewpoint image by shooting at the second viewpoint. The control unit controls the optical system to form a first subject image at the first viewpoint, controls the photographing unit, and generates first image data based on the first subject image; The image processing unit is controlled to perform image processing on the first image data to generate a first viewpoint image, and the viewing environment condition, the image size, and the first image data or the first viewpoint image. Based on this, the predicted image of the second viewpoint image is generated, and the display unit captures and acquires image data acquired in real time, or recorded image data obtained by processing the image data in the image processing unit The prediction image is controlled to be displayed simultaneously.

  Further, the control unit calculates a parallax amount of the subject at the time of shooting from the viewing environment condition and the image size, and shifts the first image data or the entire first viewpoint image by the calculated parallax amount. Thus, the prediction image may be generated.

  Further, the control unit calculates a parallax amount of the subject at the time of shooting from the viewing environment condition and the image size, and selects one of the first image data or the first viewpoint image by the calculated parallax amount. It may be configured to generate a predicted image by shifting the area of the part.

  Furthermore, the partial area may be an area including at least a focus position focused in the optical system.

  In addition, the control unit may set arbitrary data for an area without data as a result of shifting the first image data or the first viewpoint image by the amount of parallax. It doesn't matter.

  Further, the control unit determines that the image data acquired by being captured in real time or the recorded image data obtained by processing the image data in the image processing unit overlaps the predicted image. In this case, the image data at the time when it is determined that the images overlap each other may be processed by the image processing unit to generate the second viewpoint image, or the recording image data may be controlled to be the second viewpoint image.

  When the control unit further determines that the image data acquired by capturing in real time or the recorded image data obtained by processing the image data in the image processing unit overlaps the predicted image The display unit may be controlled to display an alert.

  Also, a 3D imaging method in a digital imaging device that captures a subject and generates recorded image data having a predetermined standard, the digital imaging device includes an optical system that captures a subject and forms a subject image, and the optical system. An image capturing unit that generates image data based on a formed subject image, an image processing unit that generates recorded image data by performing image processing on the image data, and the image data or the image data A display unit that displays recorded image data generated by processing in real time, a viewing environment condition when viewing the recorded image data, a memory that stores an image size when shooting a subject, and a first Control provided with a 3D shooting mode in which the first viewpoint image is acquired by shooting at the viewpoint, and then the second viewpoint image is acquired by shooting at the second viewpoint. The 3D imaging method controls the optical system via the controller, forms a first subject image at the first viewpoint, controls the imaging unit, and controls the first subject image. Based on this, the first image data is generated, the image processing unit is controlled, the first image data is subjected to image processing to generate a first viewpoint image, the viewing environment condition, the image size, and the first Based on the image data or the first viewpoint image, a predicted image of the second viewpoint image is generated, and the display unit captures the image data acquired in real time or the image data as the image processing. It may be a 3D imaging method that simultaneously displays the recorded image data obtained by processing in the unit and the predicted image.

[1. Embodiment 1]
Hereinafter, a first embodiment in which a digital photographing apparatus according to the present invention is applied to a digital camera will be described with reference to the drawings.

[1-1. Overview〕
The digital camera 100 according to the present embodiment can capture a stereo image signal when performing 3D playback. When the digital camera 100 captures a stereo image, the digital camera 100 continuously captures a plurality of still images from different viewpoints. At that time, the digital camera 100 displays on the liquid crystal monitor 270 a predicted image of a still image to be taken at least for the second time or later. Here, the predicted image is a still image generated on the basis of the first still image among the still images taken continuously in time. The digital camera 100 assists the user in photographing by displaying the predicted image on the liquid crystal monitor 270.

  The digital camera 100 according to the present embodiment generates the predicted image only when necessary.

  Hereinafter, for convenience of explanation, among images constituting a stereo image, an image taken from the first viewpoint is referred to as a first viewpoint image. Furthermore, an image taken at a second viewpoint different from the first viewpoint is referred to as a second viewpoint image.

[1-2. Constitution]
[1-2-1. Electrical configuration)
The electrical configuration of the digital camera 100 according to this embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration of the digital camera 100. The digital camera 100 includes an optical system 110, a zoom motor 120, an OIS actuator 130, a focus motor 140, a CCD image sensor 150, an image processing unit 160, a memory 200, a controller 210, a gyro sensor 220, a card slot 230, a memory card 240, and an operation. The configuration includes a member 250, a zoom lever 260, a liquid crystal monitor 270, an internal memory 280, and a shooting mode setting button 290.

  The optical system 110 includes a zoom lens 111, an OIS 112, and a focus lens 113.

  The zoom lens 111 can enlarge or reduce the subject image by moving along the optical axis of the optical system. The zoom lens 111 is controlled by a zoom motor 120.

  The OIS 112 has a correction lens that can move in a plane perpendicular to the optical axis. The OIS 112 reduces the blur of the subject image by driving the correction lens in a direction that cancels out the blur of the digital camera 100. The correction lens can move from the center by a maximum L within the OIS 112. The OIS 112 is controlled by the OIS actuator 130.

  The focus lens 113 adjusts the focus of the subject image by moving along the optical axis of the optical system. The focus lens 113 is controlled by the focus motor 140.

  The zoom motor 120 controls driving of the zoom lens 111. The zoom motor 120 may be realized by a pulse motor, a DC motor, a linear motor, a servo motor, or the like. The zoom motor 120 may drive the zoom lens 111 via a mechanism such as a cam mechanism or a ball screw.

  The OIS actuator 130 drives and controls the correction lens in the OIS 112 in a plane perpendicular to the optical axis. The OIS actuator 130 can be realized by a planar coil or an ultrasonic motor.

  The focus motor 140 drives and controls the focus lens 113. The focus motor 140 may be realized by a pulse motor, a DC motor, a linear motor, a servo motor, or the like. The focus motor 140 may drive the focus lens 113 via a mechanism such as a cam mechanism or a ball screw.

  The CCD image sensor 150 captures a subject image formed by the optical system 110 and generates image data. The CCD image sensor 150 performs various operations such as exposure, transfer, and electronic shutter.

  The image processing unit 160 performs various processes on the image data generated by the CCD image sensor 150. The image processing unit 160 processes the image data generated by the CCD image sensor 150 to generate image data (hereinafter referred to as a review image) to be displayed on the liquid crystal monitor 270, or to the memory card 240. Or generating image data for re-storage. For example, the image processing unit 160 performs various processes such as gamma correction, white balance correction, and flaw correction on the image data generated by the CCD image sensor 150. In addition, the image processing unit 160 compresses the image data with respect to the image data generated by the CCD image sensor 150 in a compression format or the like conforming to the JPEG standard. The image processing unit 160 can be realized by a DSP, a microcomputer, or the like. The resolution of the review image may be set to the screen resolution of the liquid crystal monitor 270, or may be set to the resolution of image data that is compressed and formed by a compression format or the like conforming to the JPEG standard.

  The memory 200 functions as a work memory for the image processing unit 160 and the controller 210. For example, the memory 200 temporarily stores image data processed by the image processing unit 160 or image data input from the CCD image sensor 150 before being processed by the image processing unit 160. In addition, the memory 200 temporarily stores shooting conditions of the optical system 110 and the CCD image sensor 150 at the time of shooting. The shooting conditions indicate subject distance, field angle information, ISO sensitivity, shutter speed, EV value, F value, and the like. The memory 200 can be realized by, for example, a DRAM or a ferroelectric memory.

  The controller 210 is a control means for controlling the whole. The controller 210 can be realized by a semiconductor element or the like. The controller 210 may be configured only by hardware, or may be realized by combining hardware and software. The controller 210 can be realized by a microcomputer or the like.

  The gyro sensor 220 is composed of a vibration material such as a piezoelectric element. The gyro sensor 220 vibrates a vibration material such as a piezoelectric element at a constant frequency, converts a force generated by the Coriolis force into a voltage, and obtains angular velocity information. By obtaining angular velocity information from the gyro sensor 220 and driving the correction lens in the OIS in a direction that cancels the shaking, the camera shake given to the digital camera 100 by the user is corrected. The gyro sensor 220 may be any device that can measure at least the angular velocity information of the pitch angle. Further, when the gyro sensor 220 can measure the angular velocity information of the roll angle, it is possible to consider the rotation when the digital camera 100 moves in a substantially horizontal direction.

  The card slot 230 is detachable from the memory card 240. The card slot 230 can be mechanically and electrically connected to the memory card 240.

  The memory card 240 includes a flash memory, a ferroelectric memory, and the like, and can store data.

  The operation member 250 is a member that receives an image capturing instruction from the user. The operation member 250 includes viewing environment conditions such as a viewing distance, a display size, and a target parallax amount of a subject when a still image taken by a user is viewed on a predetermined display device such as a liquid crystal television or a plasma television, and a CCD. The image size of image data captured by the image sensor 150 is received. Note that the viewing distance may be set from the display size of the display device. When setting the viewing distance based on the display size, for example, a distance of about three times the height of the display size is set as the viewing distance. The method for setting the viewing distance from the display size is not limited to the above method, and other general methods may be used.

  The operation member 250 includes a release button. The release button receives a user's pressing operation. When the release button is pressed halfway, AF control and AE control are started via the controller 210. When the release button is fully pressed, the subject is photographed.

  The zoom lever 260 is a member that receives a zoom magnification change instruction from the user.

  The liquid crystal monitor 270 can display an image indicated by image data generated by the CCD image sensor 150 or an image indicated by image data read from the memory card 240. The liquid crystal monitor 270 can display various setting information of the digital camera 100. For example, the liquid crystal monitor 270 can display EV values, F values, shutter speeds, ISO sensitivity, and the like, which are shooting conditions at the time of shooting.

  The internal memory 280 is configured by a flash memory, a ferroelectric low memory, or the like. The internal memory 280 stores the viewing environment conditions received by the operation member 250 and the image size. The internal memory 280 stores a control program for controlling the entire digital camera 100 and the like.

  The shooting mode setting button 290 is a button for setting a shooting mode when shooting with the digital camera 100. The “shooting mode” indicates a shooting scene assumed by the user. For example, (1) portrait mode, (2) child mode, (3) pet mode, (4) macro mode, (5) landscape mode And (6) 3D shooting mode. The digital camera 100 performs shooting by setting appropriate shooting parameters based on this shooting mode. Note that an automatic camera setting mode in which the digital camera 100 performs automatic setting may be included.

[1-2-2. Viewing environment conditions and image size stored in internal memory 280]
Hereinafter, viewing distances, display sizes, viewing environment conditions that are target parallax amounts, and image sizes stored in the internal memory 280 will be described with reference to the drawings.

The display size indicates the vertical and horizontal sizes of a display device that displays JPEG image data captured by the digital camera 100. For convenience of explanation, among the display size, the vertical display size h1, the horizontal display size and w _1.

  The viewing distance L indicates the distance between the display device that displays the stereo image and the viewer. The viewing distance L may be set when the user takes a picture. Also, the viewing distance L may be a value that allows the manufacturer to determine a standard value when the digital camera 100 is shipped. Further, when the viewing distance L is set from the display size, it may be configured to be set to about 3 times h1, that is, 3 * h1.

Target parallax amount d ₁ indicates the amount of parallax on a subject to be photographed by a digital camera 100 that the user desires. The target parallax amount d ₁ may be set when the user takes a picture. Further, the target parallax amount d ₁ may be a value automatically set by the digital camera 100 in accordance with a predetermined reference. For example, when the user places importance on safety, the target parallax amount d ₁ is the amount of parallax that allows the viewer to recognize the stereo image as a three-dimensional image when viewing the captured stereo image, or view the stereo image. The amount of parallax that ensures the safety of the viewer's body.

At least a display size and a configuration comprising a target parallax amount d ₁ is as imaging environment conditions.

The image size indicates the size of image data compressed by the image processing unit 160 in a compression format or the like conforming to the JPEG standard. The image size may be, for example, information indicated by the number of vertical and horizontal pixels of the image data, such as 1920 × 1080 pixels, or may be indicated by the total number of pixels of the image data, such as 5M, 1M, etc. It may be information. Image size in this embodiment is assumed to have an information about the image size w ₂ of at least the horizontal direction.

[1-3.3D Prediction Image Display Operation in 3D Shooting Mode]
Next, a predicted image display operation in the 3D shooting mode of the digital camera 100 according to the present embodiment will be described with reference to the drawings.

  FIG. 2 is a flowchart showing the operation of creating a predicted image in the 3D shooting mode.

  (S101) When the shooting mode setting button 290 is set to the 3D shooting mode by the user, the digital camera 100 shifts to the 3D shooting mode.

  (S102) When the 3D shooting mode is set, the controller 210 waits until the release button on the operation member 250 is fully pressed.

  (S103) When the release button is fully pressed, the controller 210 performs a photographing operation via the optical system 110 and the CCD image sensor 150 to form image data.

  (S104) When image data is formed, the image processing unit 160 performs image processing such as compression processing on the formed image data to generate JPEG image data (hereinafter referred to as a first viewpoint image). To do.

  (S105) When the first viewpoint image is generated, the controller 210 stores the generated first viewpoint image in the memory card 240.

  (S106) On the other hand, when the first viewpoint image is generated, the controller 210 generates a predicted image from the generated first viewpoint image.

  (S107) When the predicted image is generated, the controller 210 displays the generated predicted image on the liquid crystal monitor 270.

  Although the controller 210 has been described with respect to the configuration for generating the predicted image from the first viewpoint image that is JPEG image data, the controller 210 may be configured to use image data generated by the CCD image sensor 150 stored in the memory 200. . In that case, the operation flow of S106 and S107 is configured to be performed after S103.

[1-4. Predictive image generation operation]
Next, a predicted image generation operation of the digital camera 100 in the present embodiment will be described with reference to the drawings.

  FIG. 3 is a diagram illustrating a shooting environment when shooting using the digital camera 100.

The subject distance l indicates the distance from the digital camera 100 to the subject to be photographed. The subject distance l is a parameter that can be acquired at the time of shooting. The horizontal image size w ₂ and the viewing distance L are information stored in the internal memory 280 in advance. The distance from the shooting position of the digital camera to the virtual screen is set as the viewing distance L. Parallax amount d ₂ indicates the amount of parallax of a subject at the time of shooting. Camera distance S indicates viewing distance L, subject distance l, the distance from the first viewpoint required to meet the parallax amount d ₂ to the second view point.

  FIG. 4 is a diagram illustrating a viewing environment when viewing the first viewpoint image and the second viewpoint image captured by the digital camera 100.

The viewing distance L, the target parallax amount d ₁ , and the horizontal display size w ₁ are information stored in the internal memory 280 in advance.

  Next, a predicted image generation operation of the digital camera 100 will be described with reference to the drawings.

  FIG. 5 is a flowchart showing an operation when the predicted image of the digital camera 100 is generated.

  (S201) When the shooting mode setting button 290 is set to the 3D shooting mode by the user and the first viewpoint image is generated, the process proceeds to a predicted image generation operation.

(S202) After the transition to the operation of generating the predicted image, the controller 210 includes a horizontal display size _{w 1,} the target parallax amount _{d 1,} based on the image size _{w 2} in the horizontal direction, and the parallax amount _{d 2} calculate. Specifically, the controller 210 calculates a parallax amount d ₂ on the basis of the following equation.

例えば、水平方向のディスプレイサイズｗ_１が１０８０画素、目標視差量ｄ_１が１２画素、水平方向の画像サイズｗ_２が６４０画素である場合、コントローラ２１０は、視差量ｄ_２を８画素と算出する。

For example, when the horizontal display size w ₁ is 1080 pixels, the target parallax amount d ₁ is 12 pixels, and the horizontal image size w ₂ is 640 pixels, the controller 210 calculates the parallax amount d ₂ as 8 pixels. .

(S203) After calculating the parallax amount _{d 2,} the controller 210, based on the first viewpoint image, the parallax amount _{d 2,} and generates the prediction image.

  The controller 210 may be configured to use image data generated by the CCD image sensor 150 when generating a predicted image as described above.

[1-5. Predicted image]
Next, the controller 210 generates the parallax amount d ₂ based on the predicted image to generate and, a description will be given of the display operation of the prediction image.

<Predicted image generated by shifting the entire first viewpoint image>
FIG. 6 is a diagram for explaining the operation of generating the predicted image by shifting the entire first viewpoint image.

When the amount of parallax d ₂ is generated, the controller 210 is configured to generate a predicted image by shifting the entire first viewpoint image obtained in advance by the amount of parallax d ₂ . In this case, the result obtained by shifting the first viewpoint by parallax amount d _2, with respect to data is not area 601, the controller 210 has a configuration to set an arbitrary value. For example, the controller 210 may be configured to set black data, gray data, white data, or the like for the area 601 where there is no data. The controller 210 is configured to shift the first viewpoint image in a substantially horizontal direction when generating the predicted image.

<Predicted image generated by shifting a part of the first viewpoint image>
FIG. 7 is a diagram for explaining an operation of generating a predicted image by shifting a partial region of the first viewpoint image.

When the amount of parallax d ₂ is generated, the controller 210 is configured to generate a predicted image by shifting the partial region of the first viewpoint image obtained in advance by the amount of parallax d ₂ . The partial area may be an area including at least the entire subject or an area including a part of the subject. For example, when the object 701 shown in FIG. 7 is a subject, the controller 210 shifts the object 701 in a substantially horizontal direction and generates a predicted image 702. The controller 210 may be configured to set black data, gray data, white data, or the like for the region 703 other than the partial region of the first viewpoint image. Note that the area 703 is not limited to the above-described configuration, and for example, a rectangular area centering on a position focused when the digital camera 100 captures an image may be set as the area 703.

  Note that the method of generating the predicted image is not limited to the above method, and any method can be used as long as the image data obtained by shifting the whole or part of the first viewpoint image can be obtained. I do not care.

<Prediction image display operation>
Next, a display operation when the predicted image is displayed on the liquid crystal monitor 270 by the controller 210 will be described.

  When the second viewpoint image is captured, the controller 210 controls to display the review image of the second viewpoint image and the predicted image on the liquid crystal monitor 270 at the same time. When displaying the predicted image simultaneously with the review image, the controller 210 displays, for example, the review image and the predicted image by alpha blending. When the review image and the predicted image are displayed on the liquid crystal monitor 270, the controller 210 displays the predicted image after performing edge enhancement processing, conversion to a contour-extracted image, or negative / positive inversion processing. It doesn't matter. By processing in this way, it is possible to improve the visibility of the predicted image when the review image and the predicted image are displayed simultaneously.

  When the review image is displayed on the liquid crystal monitor 270, if the resolution of the review image is larger or smaller than the screen resolution of the liquid crystal monitor 270, the controller 210 sets the resolution of the review image to the screen resolution of the liquid crystal monitor 270. It becomes the composition to do.

Further, when displaying the review image and the predicted image at the same time, the controller 210 may be configured to display the parallax amount d ₂ on the liquid crystal monitor 270. The controller 210 may be configured to display by converting the parallax amount d ₂ that is calculated in pixel units into units of length in International System of Units (SI). The controller 210 converts the pixel into a unit of length based on the geometric characteristics obtained from the position of the digital camera 100, the position of the subject, the virtual screen position, the parallax amount d ₂ , and the inter-camera distance S.

[1-6. Shooting operation of second viewpoint image]
Next, an operation when the digital camera 100 captures the second viewpoint image will be described with reference to the drawings.

  FIG. 8 shows an operation flow when shooting the second viewpoint image. Hereinafter, for convenience of explanation, it is assumed that the review image and the predicted image have the same resolution.

  (S801) When the 3D shooting mode is set by the user and the first viewpoint image is shot, the digital camera 100 shifts to a mode for shooting the second viewpoint image.

  (S802) When the mode is switched to the mode for photographing the second viewpoint image, the digital camera 100 acquires the review image generated by the image processing unit 160. The review image is image data to be converted according to the position of the digital camera 100.

  (S803) When the review image is acquired, the digital camera 100 performs pixel matching based on the review image and the predicted image, and acquires a parallax amount between the review image and the predicted image. Pixel matching can be realized by the sum of absolute values of differences between screens. Here, the pixel data at (x, y) of the review image is F (x, y), and the pixel data at (x, y) of the predicted image is P (x, y). Furthermore, the offset values of x and y are set to offset_x and offset_y, respectively. When set as described above, the controller 210 obtains the values of offset_x and offset_y that minimize the values obtained by the following equations as the parallax amount V when the offset_x and offset_y are changed within a predetermined range.

なお、ＳＡＤ（ｘ、ｙ）は、ｘと、ｙとの絶対値差分を示す演算記号である。

SAD (x, y) is an arithmetic symbol indicating an absolute value difference between x and y.

(S804) After performing pixel matching, the digital camera 100 determines, based on the parallax amount V, whether the review image and the predicted image overlap each other. The method for determining the overlap between the review image and the predicted image can be realized by determining whether or not the parallax amount V is equal to or less than a predetermined value. For example, if the parallax amount V is approximately zero, it can be determined that the review image and the predicted image overlap. The value of the parallax amount V may be set any value may be adapted to be set 10% or the like of the parallax amount d _2, the parallax amount d ₂ to the reference. Moreover, you may make it the structure which a user can change the precision which the review image and the prediction image have overlapped in multiple steps. For example, the user can change from overlapping large, overlapping, and small overlapping. In this case, the criteria for determining that the parallax amount V is equal to or less than a predetermined value are set to different values.

  (S805) If it is determined that the review image and the predicted image overlap, the digital camera 100 performs a photographing operation via the CCD image sensor 150 to automatically form image data. Further, the digital camera 100 performs image processing such as compression processing on the formed image data via the image processing unit 160 to generate JPEG image data (hereinafter referred to as a second viewpoint image).

  (S806) When the second viewpoint image is generated, the controller 210 stores the generated second viewpoint image in the memory card 240.

  Note that the digital camera 100 may be configured to generate the second viewpoint image when it is determined that the review image and the predicted image overlap each other and the release button is further pressed by the user. The digital camera 100 may be configured to display an alert on the liquid crystal monitor 270 when it is determined that the review image and the predicted image overlap. In this case, the user can intuitively recognize that the review image and the predicted image overlap each other.

  The digital camera 100 may be configured to output sound according to the amount of the parallax amount V when the review image and the predicted image are displayed simultaneously. With this configuration, the user can intuitively recognize how close the review image and the predicted image are.

  The present invention can be applied to a photographing apparatus for photographing a digital image such as a digital still camera or a digital camera.

100 Digital Camera 110 Optical System 111 Zoom Lens 112 OIS
113 Focus lens 120 Zoom motor 130 OIS actuator 140 Focus motor 150 CCD
160 Image processing unit 200 Memory 210 Controller 220 Gyro sensor 230 Card slot 240 Memory card 250 Operation member 260 Zoom lever 270 Liquid crystal monitor 280 Internal memory 290 Shooting mode setting button 601 No data area 701 Object 702 Predictive image 703 area

Claims (8)

In a digital photographing apparatus for photographing a subject and generating recorded image data having a predetermined standard,
An optical system for photographing a subject and forming a subject image;
An imaging unit that generates image data based on a subject image formed by the optical system;
An image processing unit that generates recorded image data by performing image processing on the image data;
A display unit that displays the image data or recorded image data generated by processing the image data in the image processing unit in real time;
A viewing environment condition for viewing the recorded image data, and a memory for storing an image size for photographing the subject;
A control unit having a 3D shooting mode for acquiring a first viewpoint image by shooting at the first viewpoint and then acquiring a second viewpoint image by shooting at the second viewpoint;
The controller is
Controlling the optical system to form a first subject image at the first viewpoint;
Controlling the photographing unit to generate first image data based on the first subject image;
Controlling the image processing unit, image-processing the first image data, generating a first viewpoint image,
Generating a predicted image of the second viewpoint image based on the viewing environment condition, the image size, and the first image data or the first viewpoint image;
Controlling the display unit to display simultaneously the image data captured and acquired in real time, or the recorded image data obtained by processing the image data in the image processing unit, and the predicted image;
Digital photography device. The controller is
A parallax amount of the subject at the time of shooting is calculated from the viewing environment condition and the image size;
The digital image capturing apparatus according to claim 1, wherein the predicted image is generated by shifting the first image data or the entire first viewpoint image by the calculated amount of parallax. The controller is
A parallax amount of the subject at the time of shooting is calculated from the viewing environment condition and the image size;
The digital photographing apparatus according to claim 1, wherein a predicted image is generated by shifting a part of the first image data or the first viewpoint image by the calculated amount of parallax.   The digital photographing apparatus according to claim 3, wherein the partial area is an area including at least a focus position focused in the optical system.   3. The control unit according to claim 2, wherein the control unit sets arbitrary data for a region having no data as a result of shifting the first image data or the first viewpoint image by the amount of parallax. Item 5. The digital photographing device according to Item 4. The control unit further includes:
When it is determined that the image data acquired by capturing in real time or the recorded image data obtained by processing the image data in the image processing unit and the predicted image overlap, 6. The digital photographing apparatus according to claim 1, wherein the image data is processed by the image processing unit to generate a second viewpoint image, or the recorded image data is controlled to be a second viewpoint image. 7. The control unit further includes:
When it is determined that image data captured and acquired in real time, or recorded image data obtained by processing the image data in the image processing unit, and the predicted image overlap, the display unit is alerted The digital photographing device according to claim 1, wherein the digital photographing device is controlled to display. A 3D image capturing method in a digital image capturing apparatus for capturing a subject and generating recorded image data having a predetermined standard,
The digital photographing device includes:
An optical system for photographing a subject and forming a subject image;
An imaging unit that generates image data based on a subject image formed by the optical system;
An image processing unit that generates recorded image data by performing image processing on the image data;
A display unit that displays the image data or recorded image data generated by processing the image data in the image processing unit in real time;
A viewing environment condition for viewing the recorded image data, and a memory for storing an image size for photographing the subject;
A control unit having a 3D shooting mode for acquiring a first viewpoint image by shooting at the first viewpoint and then acquiring a second viewpoint image by shooting at the second viewpoint;
In the 3D imaging method, the optical system is controlled via the control unit to form a first subject image at the first viewpoint,
Controlling the photographing unit to generate first image data based on the first subject image;
Controlling the image processing unit, image-processing the first image data, generating a first viewpoint image,
Generating a predicted image of the second viewpoint image based on the viewing environment condition, the image size, and the first image data or the first viewpoint image;
A 3D imaging method in which the display unit simultaneously displays image data acquired by capturing in real time, or recorded image data obtained by processing the image data in the image processing unit, and the predicted image.

Images