JP2007194694A - Three-dimensional video photographing apparatus and program thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a three-dimensional photographing apparatus for generating a three-dimensional video less causing a burden on a viewer. <P>SOLUTION: A left video photographing section 1 and a right video photographing section 3 photograph an object and respectively output a left video and a right video. A left video data input section 2 and a right video data input section 4 respectively receive the left video and the right video from the left video photographing section 1 and the right video photographing section 3. A distance measurement 5 is installed between the left video photographing section 1 and the right video photographing section 3 to sequentially measure a distance up to the object. A segmented width calculation processing 7 sequentially calculates a segmented width on the basis of the distance received by the distance data input section 6 and the arrangement relation between the left video photographing section 1 and the right video photographing section 3. An image segmenting processing 8 receives the segmented width from the segmented width calculation processing 7, segments a video image by the segmented width from a right end of the left video and from a left end of the right video. A three-dimensional video composite processing 9 generates a three-dimensional video from the video images segmented by the image segmenting processing 8. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a stereoscopic video imaging apparatus that captures a real stereoscopic video by two cameras and a program thereof.

Conventionally, various stereoscopic display devices have been invented, and a method of reproducing stereoscopic data with a stereoscopic display device has been tried. When displaying 3D data on a 3D display using glasses such as a barrier 3D display or polarized glasses / shutter glasses, two viewpoint images corresponding to the left and right eyes are prepared in advance. Humans can perceive three-dimensionally by compositing on the display. In order to create an image to be displayed on these displays, as shown in FIG. 5, two cameras are photographed in parallel, and the left camera image and the right camera image according to the position of the target, It is necessary to perform a process of cutting out the image of the cut-out area from the cut-out position where the left and right angles of view intersect so that the positions of the objects to be photographed are the same.
In the prior art, the distance from the camera to the object to be photographed is measured in advance, the images photographed by the two cameras are taken into a computer or memory, and the size of the cut-out area where the angle of view of the left and right cameras overlaps based on the measured distance The three-dimensional live-action video is created to be displayed on a three-dimensional display by cutting out the image and extracting it from the captured video. For this reason, even in a scene where the subject to be photographed changes dynamically, it is a three-dimensional live-action image targeted at a certain distance. Moreover, in patent document 1, the cut-out area | region is calculated | required so that a difference may become the minimum from the correlation of a video on either side.
JP 2002-223458 A

  However, in the conventional stereoscopic image creation device that measures the distance from the camera to the shooting target in advance, the shooting target is dynamically changed because it is a three-dimensional live-action video for a certain distance. In a scene that changes, the position of the subject to be photographed may be separated between the left-eye and right-eye images. Further, in the stereoscopic image creating apparatus shown in Patent Document 1, since the background correlation is high in a scene in which the background occupies a large amount, the position of the background is the same in the left-eye and right-eye images. The position of the object may be separated. Therefore, when viewing this object in the stereoscopic video generated by these stereoscopic video creation devices, the viewpoint of the left eye and the viewpoint of the right eye may be separated, which is a burden on the viewer and is tiring. .

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a stereoscopic video photographing apparatus that generates a stereoscopic image with less burden on a viewer and a program therefor.

  The present invention has been made to solve the above-described problems, and the invention according to claim 1 is directed to a left image capturing unit that captures an image of a subject and outputs a left eye image, and the left image capturing unit outputs the left image. Left video data input means that accepts the input of the left-eye video and outputs it by separating the left image into one frame at a time, and is located near the right side of the left video photographing means and at the position for photographing the subject Right image photographing means for photographing a right eye image, and right image data inputting means for receiving an input of a right eye image output from the right image photographing means and separating and outputting the right image for each frame. A distance measuring unit that is installed in the vicinity of the left image capturing unit and the right image capturing unit and that sequentially measures the distance to the subject; and distance data that sequentially receives an input of the distance measured by the distance measuring unit. An extraction unit that sequentially calculates an extraction width of an image based on an input unit, a distance received by the distance data input unit, and an arrangement relationship between the left image capturing unit and the right image capturing unit; A left cut-out image obtained by cutting out an image corresponding to the cut-out width from the right end of the left image output by the left video data input means and the left end of the right image output by the right video data input means in response to the cut-out width calculated by the calculation means An image cutting means for outputting a right cut image obtained by cutting an image of a cut width from the image, and a stereoscopic video synthesizing means for generating and outputting a stereoscopic video from the left cut image and the right cut image cut by the image cutting means A stereoscopic video imaging apparatus comprising:

  The invention described in claim 2 is the stereoscopic image capturing apparatus according to claim 1, wherein the left image capturing unit captures an image of a pixel number Nd in the horizontal direction at an angle of view θc, and the right image capturing device. The image capturing means captures an image of a horizontal pixel number Nd at an angle of view θc, and is disposed in parallel to the left image capturing means at an arrangement interval Bc on the right side of the left image capturing means. Is calculated by the cutting width Nc = Nd × {2 · Dc · tan (θc / 2) −Bc} / {2 · Dc · tan (θc / 2)}, where Dc is the distance received by the distance data input means. It is characterized by doing.

  The invention described in claim 3 is the stereoscopic image capturing apparatus according to claim 1 or 2, wherein the distance data input means determines the distance measured by the distance measuring unit as the left image capturing means. And the right video photographing means focuses on the distance received from the distance data input means, and the right video photographing means focuses on the distance received from the distance data input means. It is characterized by matching.

  According to a fourth aspect of the present invention, there is provided a left video photographing means for photographing a subject and outputting a left video, and a right side of the left video photographing means, disposed at a position for photographing the subject, In the computer to which the right image photographing means for photographing an image and the distance measuring means for measuring the distance to the subject are connected in the vicinity of the left image photographing means and the right image photographing means, the left image photographing The left image data input means for receiving the left-eye video output outputted by the means, separating and outputting the left image for each frame, the right-eye video input outputted by the right video photographing means, Right video data input means for separating and outputting right images frame by frame, distance data input means for sequentially receiving input of distances measured by the distance measuring unit, and distance data input means for receiving Based on the attached distance and the arrangement relationship between the left video photographing means and the right video photographing means, the cut width calculating means for sequentially calculating the cut width of the image, the cut width calculated by the cut width calculating means, Left cut-out image obtained by cutting out an image corresponding to the cut-out width from the right end of the left image output by the left video data input means, and right cut-out obtained by cutting out an image corresponding to the cut-out width from the left end of the right image output by the right video data input means An image cutting means for outputting an image, and a program for functioning as a stereoscopic video composition means for generating and outputting a stereoscopic video from a left cut image and a right cut image cut out by the image cut out means.

  According to the present invention, since the cut-out width calculating unit calculates the cut-out width based on the distance to the subject measured by the distance measuring unit, the subject is the same place in the video for the left eye and the video for the right eye, and the viewer's A stereoscopic image with less burden can be generated.

  Further, according to the present invention, the left image capturing unit and the right image capturing unit obtain the distance to the subject measured by the distance measuring unit via the distance data input unit, and focus on this distance. A focused stereoscopic image can be obtained.

  First, the outline of the embodiment of the present invention shown in FIG. 1 will be described. In the present embodiment, a distance measuring device that measures the distance to the subject is arranged at the center of the two left and right cameras, and the processing unit dynamically calculates the cutout width according to the distance of the measurement result. By using this cutout width, the processing unit cuts out the cutout area from the images taken by the two cameras so that the subject is in the optimal position in the left and right images even in a dynamic scene. This is a device that generates a live-action stereoscopic video to be displayed on the original display.

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of a stereoscopic video imaging apparatus according to an embodiment of the present invention. Reference numeral 1 denotes a left image capturing unit such as a video camera that captures an object with an angle of view θc and a horizontal pixel number Nd and outputs left image data that is image data for the left eye. Reference numeral 2 denotes a left video data input unit that receives input of left video data output from the left video photographing unit 1 and separates and outputs the left video data frame by frame. 3 is an arrangement interval Bc on the right side of the left image capturing unit 1 and is arranged in parallel with the left image capturing unit 1. As with the left image capturing unit 1, the subject is imaged at the angle of view θc and the number of pixels Nd in the horizontal direction. And a right image capturing unit such as a video camera that outputs right image data that is image data for the right eye. Reference numeral 4 denotes a right video data input unit that receives the input of the right video data output from the right video photographing unit 3 and outputs the right video data separated into one frame at a time. Reference numeral 5 denotes a distance measuring unit such as an infrared distance measuring device that is installed between the left image capturing unit 1 and the right image capturing unit 3 and measures the distance Dc to the subject and outputs the distance data. Reference numeral 6 denotes a distance data input unit that receives an input of the distance measured by the distance measuring unit 5.
Reference numeral 7 denotes cutout width calculation processing for receiving the distance data from the distance data input unit 6 and calculating the cutout width Nc according to Expression (1). Formula (1) will be described later in detail.
Nc = Nd × {2 · Dc · tan (θc / 2) −Bc} / {2 · Dc · tan (θc / 2)} (1)
8 shows the cut-out width Nc calculated by the cut-out width calculation processing 7, the left cut-out image data obtained by cutting out the image of the cut-out width Nc from the right end of the left image data output by the left video data input unit 2, and the right video data input This is an image cut-out process for outputting right cut-out image data obtained by cutting out an image having a cut-out width Nc from the left end of the right image data output by the unit 4. Reference numeral 9 denotes a stereoscopic video composition process for generating and outputting stereoscopic video data from the left cut-out image data and the right cut-out image data cut out by the image cut-out process. 10 is a stereoscopic image display device such as a three-dimensional display or a barrier-type three-dimensional display using glasses such as polarized glasses and shutter-type glasses that receives the stereoscopic image data output from the stereoscopic image composition processing 9 and displays the stereoscopic image. It is.
Here, the expression (1) used in the cut-out width calculation process will be described. As shown in FIG. 3, consider a case where a subject located at a distance Dc is photographed from the left image capturing unit 1, the right image capturing unit 3, and the distance measuring unit 5. At this time, the width Wd of the shooting area at the position away from the right video shooting unit 3 by the distance Dc is the width Wc of the cutout area at the same position, the left video shooting unit 1 and the right video shooting as shown in Expression (2). It is represented by the sum of the installation intervals Bc of the part 3.
Wd = Wc + Bc (2)
The half length of the shooting range Wd is determined by using the angle of view θc of the left video shooting unit 1 and the right video shooting unit 3 and the distance Dc from the left video shooting unit 1 and the right video shooting unit 3 to the subject. It can be expressed by equation (3).
Wd / 2 = Dc · tan (θc / 2) (3)
In addition, since the ratio between the number of pixels Nd in the horizontal direction of the video data output from the right video photographing unit 3 and the cutout width Nc and the ratio between the width Wd of the photographing region of the right video photographing unit 3 and the cutout region Wc are equal, (4) holds.
Nd: Nc = Wd: Wc (4)
When the product of the inner term and the outer term in equation (4) are taken and both sides are divided by the width Wd of the imaging region, equation (5) is obtained. If equation (2) is modified and assigned to Wc in equation (5), equation (6) is obtained. Further, when Expression (3) is transformed and substituted into Wd of Expression (6), Expression (7), that is, Expression (1) is obtained.
Nc = Nd · Wc / Wd (5)
= Nd · (Wd−Bc) / Wd (6)
= Nd · {2 · Dc · tan (θc / 2) −Bc} / {2 · Dc · tan (θc / 2)} (7)
Next, the operation of this stereoscopic video imaging apparatus will be described using the flowchart of FIG. First, the distance measuring unit 5 measures the distance Dc to the subject and outputs it to the distance data input unit 6. Upon receiving the distance Dc (S1), the distance data input unit 6 outputs this to the cutout width calculation process 7. In the cut-out width acquisition process 7, the angle of view θc of the left image capturing unit 1 and the right image capturing unit 2, the installation interval Bc, and the number of horizontal pixels Nd of the generated image data are set in advance, and when the distance Dc is received. Then, the cropping width Nc is calculated by the equation (1) and output to the image cropping process 8 (S2).
On the other hand, the left video photographing unit 1 photographs a subject and outputs left video data, which is video data for the left eye, to the left video data input unit 2. Upon receiving the left video data, the left video data input unit 2 separates the left video data into left image data for each frame and outputs the left image data to the image cutout process 8.
On the other hand, the right video photographing unit 3 photographs a subject and outputs right video data, which is video data for the right eye, to the right video data input unit 4. Upon receiving the right video data, the right video data input unit 4 separates the right video data into right image data for each frame, and outputs the right image data to the image cutout process 8.
The image cutout process 8 receives the cutout width from the cutout width calculation process 7, the left image data from the left video data input unit 2, the right image data from the right video data input unit 4, and the left image data from the right end. The left cut-out image obtained by cutting out the image corresponding to the cut-out width is output to the stereoscopic video composition processing 9, and the right cut-out image obtained by cutting the image corresponding to the cut-out width from the left end is output to the stereoscopic video composition processing 9 for the right image data. (S3). The stereoscopic video composition process 9 synthesizes a stereoscopic video from the left cut-out image and the right cut-out image, and outputs it to the stereoscopic video display device 10 (S4).
The stereoscopic video imaging apparatus repeats the operations from step S1 to S4 until the imaging is completed (S5).

  As described above, the embodiment uses the cutout width calculated based on the distance to the subject measured by the distance measuring unit 5, and therefore, the left-eye video and the right-eye video are displayed on the screen of the stereoscopic video display device 10. Thus, it is possible to generate a stereoscopic image with the same subject position and less burden on the viewer.

In the embodiment, the left image capturing unit 1 and the right image capturing unit 3 are installed in parallel. However, the left image capturing unit 1 and the right image capturing unit 3 do not have to be set in parallel, for example, installed at an angle inward. However, in that case, it is necessary to change Formula (1) according to the installation relationship between the left image capturing unit 1 and the right image capturing unit 3.
The distance data input unit 6 outputs the distance information received from the distance measurement unit 5 to the left image capturing unit 1 and the right image capturing unit 3, and the left image capturing unit 1 and the right image capturing unit 3 The distance information may be received to focus on the distance. Thereby, it is possible to obtain a stereoscopic image focused on the subject.

  Further, a program for realizing the functions of the cutout width calculation process 7, the image cutout process 8 and the stereoscopic video composition process 9 in FIG. 2 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded. The cut-out width calculation process 7, the image cut-out process 8, and the stereoscopic video composition process 9 may be performed by being read and executed by a computer system. The “computer system” here includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes a design and the like within the scope not departing from the gist of the present invention.

It is a figure explaining the outline | summary of the stereo image imaging device by one Embodiment of this invention. It is a block diagram which shows the structure of the stereoscopic video imaging device by the same embodiment. It is a figure explaining the relationship between the width Wd of the imaging region, the width Wc of the cutout region, the distance Dc to the subject, and the angle of view θc in the same embodiment. It is a flowchart explaining operation | movement of the stereoscopic video imaging device in the same embodiment. It is a figure explaining the prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Left video imaging part 2 ... Left video data input part 3 ... Right video imaging part 4 ... Right video data input part 5 ... Distance measurement part 6 ... Distance data input part 7 ... Extraction width calculation process 8 ... Image extraction process 9 ... 3D image composition processing 10 ... 3D image display device

Claims (4)

A left image photographing means for photographing a subject and outputting a left eye image;
Left video data input means for receiving an input of a left-eye video output by the left video photographing means and separating and outputting a left image frame by frame;
Right video photographing means that is located near the right side of the left video photographing means and is set at a position for photographing the subject, and that photographs a right eye video;
Right video data input means for receiving an input of a right-eye video output by the right video photographing means and separating and outputting the right image frame by frame;
Distance measuring means installed in the vicinity of the left image capturing means and the right image capturing means, and sequentially measuring the distance to the subject;
Distance data input means for sequentially receiving input of distances measured by the distance measuring means;
Based on the distance received by the distance data input means and the arrangement relationship between the left video photographing means and the right video photographing means, a cutout width calculating means for sequentially calculating a cutout width of the image;
A left cut-out image obtained by cutting out the image corresponding to the cut-out width from the right end of the left image output by the left video data input means and receiving the cut width calculated by the cut-out width calculation means, and the right output from the right video data input means Image cutting means for outputting a right cut image obtained by cutting an image corresponding to the cut width from the left end of the image;
A stereoscopic video imaging apparatus comprising: a stereoscopic video composition unit that generates and outputs a stereoscopic video from a left cut image and a right cut image cut out by the image cutout unit. The left image capturing means captures an image of a horizontal pixel number Nd at an angle of view θc,
The right image capturing means captures an image of a horizontal number of pixels Nd at an angle of view θc, and is disposed in parallel to the left image capturing means at an arrangement interval Bc on the right side of the left image capturing means.
The cut-out width calculation means uses the distance received by the distance data input means as Dc, and the cut-out width Nc = Nd × {2 · Dc · tan (θc / 2) −Bc} / {2 · Dc · tan (θc / 2)}. The stereoscopic video imaging apparatus according to claim 1, wherein The distance data input means outputs the distance measured by the distance measurement unit to the left image capturing means and the right image capturing means,
The left image photographing means focuses on the distance received from the distance data input means,
The stereoscopic video imaging apparatus according to claim 1, wherein the right video imaging unit focuses on the distance received from the distance data input unit. A left video photographing means for photographing a subject and outputting a left video; a right video photographing means for photographing a right video, located near a right side of the left video photographing means, at a position for photographing the subject; A computer installed in the vicinity of the left image capturing means and the right image capturing means and connected to a distance measuring means for measuring the distance to the subject;
Left video data input means for accepting input of left-eye video output by the left video photographing means and separating and outputting the left image frame by frame;
Right video data input means for receiving an input of a right-eye video output from the right video photographing means and separating and outputting the right image for each frame;
Distance data input means for sequentially receiving input of distances measured by the distance measuring unit;
Based on the distance received by the distance data input means and the arrangement relationship between the left video photographing means and the right video photographing means, a cutout width calculating means for sequentially calculating a cutout width of the image,
A left cut-out image obtained by cutting out the image corresponding to the cut-out width from the right end of the left image output by the left video data input means and receiving the cut width calculated by the cut-out width calculation means, and the right output from the right video data input means Image cutting means for outputting a right cut image obtained by cutting an image for the cut width from the left end of the image,
A program for functioning as a stereoscopic video composition unit for generating and outputting a stereoscopic video from a left cut image and a right cut image cut out by the image cut out unit.

Images