JP4634863B2 - Stereoscopic image generation apparatus and stereoscopic image generation program - Google Patents

Description

  The present invention relates to a stereoscopic image generation apparatus and a stereoscopic image generation program for generating an image for displaying a binocular stereoscopic video from an image for a right eye and an image for a left eye.

  As a display technology for a binocular stereoscopic image that displays an image that gives a stereoscopic view with an image for the right eye and an image for the left eye, a method using glasses such as a filter glasses method, a time division method, a lenticular method, There is a method that does not use glasses such as a parallax barrier method.

  In the filter glasses method, polarizing plates are attached to two projectors, and an image for the right eye and an image for the left eye are projected onto the screen. The observer can then wear a pair of glasses with a polarizing plate in the same direction as the polarizing plate of the projector and look at the screen so that the right eye can see the right eye image and the left eye can see the left eye image. 3D images can be seen by parallax.

  In the time-sharing method, right-eye images and left-eye images are alternately displayed on the display screen, and the observer views the display screen with a liquid crystal shutter glass. Images for the left eye can be viewed alternately with the left eye.

  In the lenticular method, a lenticular lens with a plurality of saddle-shaped lenses arranged in the horizontal direction is installed in front of the display screen, and right-eye images and left-eye images are displayed alternately in the horizontal direction on the display screen. . When viewed from the right eye, the image for the right eye is focused, and when viewed from the left eye, the image for the left eye is focused, so that the observer can view a stereoscopic image.

  In the parallax barrier method, a parallax barrier with a plurality of slits arranged in the horizontal direction is installed in front of the display screen, and the image for the right eye and the image for the left eye are alternately displayed in the horizontal direction on the display screen. To do. The right eye can see the right-eye image from between the slits, and the left eye can see the left-eye image from between the slits, so that the observer can see a stereoscopic image.

Further, when displaying these two-lens stereoscopic images, if the display device set in advance for shooting the two images and the display device for actual display have different display screen sizes, An apparatus is disclosed that shifts and displays an eye image and a right eye image to adjust the stereoscopic effect of the image (see Patent Document 1).
JP 2004-180069 (paragraph numbers 0010 to 0063)

  However, in the conventional binocular stereoscopic video display method, the distance between the pupils of the left and right eyes of the human and the size of the display screen for displaying the image are set in advance, and the image for the right eye and the image for the left eye are set. When the size of the display screen that is actually displayed differs from the set size, the size and depth of the stereoscopic image are not displayed correctly. For example, when the image is displayed on a display screen smaller than the set size, there is a problem that a parallax on the display screen is reduced, a depth is small, and a so-called miniature garden effect is produced in which the object itself can be felt small. And even if the distance from the observer to the display screen (viewing distance) is shortened and the image on the retina of the observer is enlarged, the subjective size does not increase because the convergence changes. .

  On the other hand, when the image is displayed on a display screen larger than the set display screen, the parallax on the display screen is increased, and a so-called divergent state occurs in which the parallax of the object at infinity exceeds the interval between the pupils. For this reason, in order to display a 3D image without distortion, it is assumed that the screen size and the viewing distance are preliminarily taken at the time of shooting, and the display screen of the assumed size is viewed from the set viewing distance. There is a need.

  However, stereoscopic television images have different display screen sizes and may be displayed on a display screen of tens to hundreds of inches, so the screen size and viewing distance are assumed in advance when shooting. It is difficult to shoot. Further, when the observer does not face the display screen and views the binocular stereoscopic image from an oblique direction, geometric distortion occurs.

  Further, when the observer views a stereoscopic image, the size of the image on the display screen is determined not only by the size of the image on the retina but also by the distance to the display screen. That is, even if the size is the same on the retina, it is determined that the near one is small and the far one is large. Then, the distance to the display screen is determined by the position of the frame of the display screen. However, in the apparatus described in Patent Document 1, since the image is displayed on the entire display screen without changing the frame of the display screen, the observer can set the distance to the display screen from the actual distance even if the image is displayed with an offset. It is hard to feel far away or near. Therefore, there is a problem that it becomes easy for an observer to feel fatigue and distortion of a sense of distance. Furthermore, the geometric distortion of the image when observed from an oblique direction cannot be solved by the apparatus described in Patent Document 1.

  The present invention has been made to solve the above-described problems of the prior art, and is displayed on a display screen having a size different from the size assumed at the time of video shooting, and is different from the set viewing distance. 2D stereoscopic images that can accurately represent the sense of distance of what was photographed and that do not cause the observer to be tired or distort the sense of distance without being aware of the frame of the display screen It is an object of the present invention to provide a stereoscopic image generation apparatus and a stereoscopic image generation program that can generate an image for the purpose.

  In order to solve the above problem, the stereoscopic image generation device according to claim 1 converts an image for the right eye and an image for the left eye based on the size of the display screen and the viewing distance, A stereoscopic image generation apparatus that generates a stereoscopic image for an eye and a stereoscopic image for a left eye, wherein the virtual space setting unit, the right-eye image region setting unit, the left-eye image region setting unit, and the right An ophthalmic image generation unit and a left-eye image generation unit are provided.

  According to such a configuration, the stereoscopic image generating device uses the virtual space setting unit to display the size of the display screen for displaying the right-eye stereoscopic image and the left-eye stereoscopic image, the position of the observer, and the display screen. Based on the display screen information indicating the position of the right eye, the position of the right eye and the left eye of the observer, the area of the display screen, the image for the right eye and the left eye set in advance corresponding to the position of the observer The image display area is set as a virtual right eye position, a virtual left eye position, a virtual display screen area, and a virtual standard display area in the virtual space.

  Further, the stereoscopic image generation device performs a perspective projection of the virtual standard display area from the virtual right eye position to the virtual display screen area on the virtual space by the right-eye image area setting unit, and the virtual right-eye image area. Is set in the virtual display screen area, and the virtual left display image is transparently projected from the virtual left eye position to the virtual display screen area on the virtual space by the left eye image area setting means. Set the area within the virtual display screen area.

  Furthermore, the stereoscopic image generation apparatus performs conversion for performing perspective projection of the virtual standard display region from the virtual right eye position on the virtual display screen region to the right eye image by the right eye image generation unit, and performs the virtual display screen. A right-eye stereoscopic image is generated by fitting into the virtual right-eye image region in the region, and the left-eye image generating means performs perspective projection of the virtual standard display region from the virtual left-eye position on the virtual display screen region. The conversion to be performed is performed on the image for the left eye, and the left eye stereoscopic image is generated by fitting into the image area for the virtual left eye in the virtual display screen area.

  As a result, the stereoscopic image generation device displays the right-eye image and the left-eye image on a display screen that is different from the size assumed when the right-eye image and the left-eye image are captured, and from a position different from the set viewing distance. Even when viewed, the right eye image and the left eye image of the right eye image and the left eye image are assumed to be taken at the time of shooting, and are set at a position away from the observer by a set distance. It is possible to generate a right-eye stereoscopic image and a left-eye stereoscopic image that can be viewed in the same manner as when displayed.

  The stereoscopic image generation device according to claim 2 is the stereoscopic image generation device according to claim 1, wherein the virtual space setting unit is configured to start the observer based on the display screen information. A line-of-sight direction, which is a direction toward the center of the display screen, is set as a virtual line-of-sight direction on the virtual space, and a straight line connecting the virtual right eye position and the virtual left eye position on the virtual space The virtual right eye position and the virtual left eye position are set so as to be orthogonal to the virtual line-of-sight direction, and the virtual standard display area is set in a direction orthogonal to the virtual line-of-sight direction.

  Thereby, the stereoscopic image generation device generates a right-eye stereoscopic image and a left-eye stereoscopic image in which distortion generated when the observer sees the display screen from an oblique direction is corrected. Can do.

  The stereoscopic image generation program according to claim 3 converts an image for the right eye and an image for the left eye based on the size of the display screen and the viewing distance, so as to convert the stereoscopic image for the right eye. A virtual space setting means, a right eye image area setting means, a left eye image area setting means, a right eye image generating means, and a left eye image generating means. It was decided to function as.

  According to this configuration, the stereoscopic image generation program uses the virtual space setting unit to display the size of the display screen for displaying the right-eye stereoscopic image and the left-eye stereoscopic image, the position of the observer, and the display screen. Based on the display screen information indicating the position of the right eye, the position of the right eye and the left eye of the observer, the area of the display screen, the image for the right eye and the left eye set in advance corresponding to the position of the observer The image display area is set as a virtual right eye position, a virtual left eye position, a virtual display screen area, and a virtual standard display area in the virtual space.

  Further, the stereoscopic image generation program is configured to perform a perspective projection of the virtual standard display area from the virtual right eye position to the virtual display screen area on the virtual space by the right eye image area setting unit. Is set in the virtual display screen area, and the virtual left display image is transparently projected from the virtual left eye position to the virtual display screen area on the virtual space by the left eye image area setting means. Set the area within the virtual display screen area.

  Furthermore, the stereoscopic image generation program performs conversion for performing a perspective projection of the virtual standard display area from the virtual right eye position on the virtual display screen area to the right eye image by the right eye image generation unit, and performs the virtual display screen. A right-eye stereoscopic image is generated by fitting into the virtual right-eye image region in the region, and the left-eye image generating means performs perspective projection of the virtual standard display region from the virtual left-eye position on the virtual display screen region. The conversion to be performed is performed on the image for the left eye, and the left eye stereoscopic image is generated by fitting into the image area for the virtual left eye in the virtual display screen area.

  Accordingly, the stereoscopic image generation program displays the right eye image and the left eye image on a display screen different from the size assumed when the right eye image and the left eye image are captured, and starts from a position different from the set viewing distance. Even when viewed, the right eye image and the left eye image of the right eye image and the left eye image are assumed to be taken at the time of shooting, and are set at a position away from the observer by a set distance. It is possible to generate a right-eye stereoscopic image and a left-eye stereoscopic image that can be viewed in the same manner as when displayed.

  The stereoscopic image generation device and the stereoscopic image generation program according to the present invention have the following excellent effects.

  According to the invention described in claim 1 or claim 3, even when the right-eye image and the left-eye image are displayed on a display screen different from the size assumed when the right-eye image and the left-eye image are captured, A right-eye stereoscopic image and a left-eye stereoscopic image that can be viewed in the same manner as when a stereoscopic image is displayed at a position assumed to be taken at a set distance away from the observer. Can be generated.

  Further, when the observer views the right-eye stereoscopic image and the left-eye stereoscopic image displayed on the display screen, the right-eye image and the left-eye image are respectively fitted to the observer. And the area where the image for the left eye is inserted can be seen. Then, the observer sees a display area in which two areas of the set display screen size overlap each other at a position away from the observer by a distance set at the time of shooting by the parallax between the right eye and the left eye. Can do. Then, the viewer is not the distance from the display screen frame displaying the right-eye stereoscopic image and the left-eye stereoscopic image to the viewer, but the display region frame virtually formed by this parallax. The size of the entire stereoscopic image can be determined based on the distance to the right, so that the observer can correctly recognize the sense of distance without being aware of the frame of the display screen and the left-eye stereoscopic image. A stereoscopic image is obtained.

  According to the second aspect of the present invention, even when the observer is at an oblique position that does not face the display screen that displays the right-eye stereoscopic image and the left-eye stereoscopic image, The right eye and the left eye can see an area in which an image for the right eye is fitted and an area in which an image for the left eye is fitted. Then, the viewer can see the display area in a direction facing the viewer at a position away from the viewer by a distance set at the time of shooting by the parallax between the right eye and the left eye. Therefore, it is possible to generate a right-eye stereoscopic image and a left-eye stereoscopic image that can present a stereoscopic image without distortion to the observer.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Configuration of stereoscopic image generation apparatus]
With reference to FIG. 1, the structure of the stereoscopic image generation device 1 which is embodiment of this invention is demonstrated. FIG. 1 is a block diagram showing a configuration of a stereoscopic image generation apparatus according to the present invention. The stereoscopic image generating device 1 inputs an image for the right eye (image for the right eye) and an image for the left eye (image for the left eye) from the outside, and matches the size of the display screen (not shown). The converted right-eye stereoscopic image and left-eye stereoscopic image are generated. The stereoscopic image generation apparatus 1 includes an information input unit 10, a virtual space setting unit 11, a right eye image region setting unit 12, a left eye image region setting unit 13, and a right eye image generation unit 14. And left-eye image generation means 15. Further, here, a stereoscopic display device (not shown) is connected to the stereoscopic image generation device 1 and a right-eye stereoscopic image and a left-eye stereoscopic image are displayed on the display screen of the stereoscopic display device. It was decided.

  The right-eye image and the left-eye image include a size of a display screen (standard display screen) assumed to display the right-eye image and the left-eye image at the time of shooting, and a standard display screen from the observer. Is displayed in advance as a standard condition, and the viewer can view an image having a size and depth intended by the creator of the image by displaying the standard distance. Here, the stereoscopic image generation device 1 inputs the standard condition information indicating the standard conditions from the outside.

  The information input means 10 determines the size of the display screen for displaying the right-eye stereoscopic image and the left-eye stereoscopic image generated by the stereoscopic image generation device 1 and the positions of the observer and the display screen. Display screen information that is information to be displayed, the size of a standard display screen that displays the two images preset by the producer when the right-eye image and the left-eye image are captured, and the standard display screen from the observer Standard condition information, which is information indicating the distance to the outside, is input from the outside. The display screen information and standard condition information input here are output to the virtual space setting means 11.

  Based on the display screen information and the standard condition information input from the information input unit 10, the virtual space setting unit 11 is a display screen area for displaying the right-eye stereoscopic image and the left-eye stereoscopic image, and the observer's The line-of-sight direction to the display screen, the position of the right eye, the position of the left eye, and the area of the standard display screen indicated by the standard conditions in the virtual space are the virtual display screen area, the virtual line-of-sight direction, the virtual right-eye position, The virtual left eye position and the virtual standard display area are set. Here, the virtual space setting unit 11 includes a display screen region setting unit 11a, a line-of-sight direction setting unit 11b, a binocular position setting unit 11c, and a standard display region setting unit 11d.

  The display screen area setting unit 11a sets the coordinate axis of the virtual space based on the display screen information input from the information input unit 10, and the observer's position in the real space and the area of the display screen are set on the virtual space. The virtual observer position and the virtual display screen area corresponding to are set. The information of the virtual observer position and the virtual display screen area set here includes a line-of-sight direction setting unit 11b, a binocular position setting unit 11c, a standard display region setting unit 11d, a right-eye image region setting unit 12, and a left-eye image. It is output to the image area setting means 13.

  The line-of-sight direction setting unit 11b sets a virtual line-of-sight direction, which is a direction from the virtual observer position to the virtual display screen, set by the display screen area setting unit 11a on the virtual space. Here, the gaze direction setting unit 11b sets the direction from the virtual observer position in the virtual space to the center of the virtual display screen area as the virtual gaze direction. The information on the virtual line-of-sight direction set here is output to the binocular position setting unit 11c and the standard display area setting unit 11d.

  The binocular position setting unit 11c is based on the virtual observer position set by the display screen area setting unit 11a and the virtual line-of-sight direction set by the line-of-sight direction setting unit 11b. The virtual right eye position and the virtual left eye position corresponding to the left eye are set on the virtual space. Here, the binocular position setting unit 11c sets the positions of two points separated by a certain interval in the horizontal direction orthogonal to the virtual viewing direction with the virtual observer position interposed therebetween, and faces the virtual viewing direction toward the right side. Is the virtual right eye position, and the left side is the virtual left eye position. The interval between the virtual right eye position and the virtual left eye position may be a predetermined value (for example, 65 mm), or may be input from the outside. The information on the virtual right eye position and the virtual left eye position set here is output to the right eye image area setting means 12 and the left eye image area setting means 13.

  The standard display area setting unit 11d includes the standard condition information input from the information input unit 10, the virtual observer position set by the display screen area setting unit 11a, and the virtual line-of-sight direction set by the line-of-sight direction setting unit 11b. Based on the above, the virtual standard display area corresponding to the area of the standard display screen preset by the producer at the time of photographing the right eye image and the left eye image is set on the virtual space. Here, the standard display area setting unit 11d uses the standard condition information so as to be orthogonal to the virtual line-of-sight direction at a position separated from the virtual observer position in the virtual line-of-sight direction by the viewing distance indicated by the standard condition information. The area of the standard display screen shown is set as the virtual standard display area. The virtual standard display area information set here is output to the right-eye image area setting means 12 and the left-eye image area setting means 13.

  The right-eye image region setting unit 12 displays a virtual right-eye image region obtained by perspectively projecting the virtual standard display region with respect to the virtual display screen region from the virtual right-eye position set by the virtual space setting unit 11. It is set in the area. The information of the virtual right-eye image region set here is output to the right-eye image generation unit 14.

  The left-eye image region setting unit 13 displays a virtual left-eye image region obtained by perspectively projecting the virtual standard display region from the virtual left-eye position set by the virtual space setting unit 11 with respect to the virtual display screen. It is set in the area. The information of the virtual left-eye image region set here is output to the left-eye image generation means 15.

  Here, referring to FIG. 2 (refer to FIG. 1 as appropriate), the right-eye image region setting unit 12 and the left-eye image region setting unit 13 virtually convert the virtual right-eye image region and the virtual left-eye image region. A method for setting in the display screen area will be described. FIG. 2 shows that in the virtual space, the right-eye image area setting means and the left-eye image area setting means include a virtual right eye position, a virtual left eye position, a virtual display screen area, and a virtual standard display area. FIG. 6 is an explanatory diagram for explaining a method of setting a virtual right eye image region and a virtual left eye image region based on the virtual space, and FIG. FIG. 5B is a schematic diagram schematically showing an example viewed from above. FIG. 5B is a virtual right-eye image region and virtual image set by the right-eye image region setting unit and the left-eye image region setting unit in FIG. (C) is a schematic diagram schematically showing an image region for the left eye, (c) is a schematic diagram schematically showing an example of the virtual space viewed from above when the observer does not face the display screen, (d) , (C), the right eye image area setting means and the left eye image area setting means. An image area and a virtual left-eye image area for the virtual right-eye set it is a schematic diagram illustrating schematically.

  First, with reference to FIG. 2A and FIG. 2B, a case where the observer is facing the display screen will be described. As shown in FIG. 2A, the virtual space setting means 11 sets the virtual observer position V and the virtual display screen area Dv on the virtual space based on the display screen information. A virtual line-of-sight direction Av which is a direction toward the center c of the virtual display screen area Dv is set. Further, the virtual space setting means 11 sets a virtual right eye position R and a virtual left eye position L that are separated by a certain interval in a direction orthogonal to the virtual viewing direction Av across the virtual observer position V. Based on the information, the virtual standard display area Cv is set in a direction orthogonal to the virtual line-of-sight direction Av. Since FIG. 2A is a view from above, the virtual display screen area Dv and the virtual standard display area Cv are shown as straight lines, but these are areas of a rectangular plane in the virtual space. .

  Then, the right eye image area setting unit 12 perspectively projects the virtual standard display area Cv from the virtual right eye position R to the virtual display screen area Dv. Then, as shown in FIG. 2B, the right-eye image region setting unit 12 converts the virtual right-eye image region Rv, which is a rectangular region obtained by perspective projection of the virtual standard display region Cv, to the virtual display screen region Dv. Can be set within. Further, as shown in FIG. 2A, the left eye image area setting means 13 perspectively projects the virtual standard display area Cv from the virtual left eye position L to the virtual display screen area Dv. Then, the left-eye image area setting unit 13 can set the virtual left-eye image area Lv in the virtual display screen area Dv, as shown in FIG.

  The perspective projection by the right-eye image region setting unit 12 and the left-eye image region setting unit 13 can be realized by applying a general perspective projection conversion algorithm.

  The virtual right eye image region Rv and the virtual left eye image set by the right eye image region setting unit 12 and the left eye image region setting unit 13 as the viewing distance becomes longer than the size of the display screen. Although the area Lv becomes large and a part of the virtual display screen area Dv may be missing, in practice, if the display screen is small, the viewer approaches the display screen and the viewing distance becomes small. Therefore, in the standard condition information, if the size of the standard display screen and the viewing distance are appropriately set, the right-eye image region setting unit 12 and the left-eye image region setting unit 13 Rv and the virtual left-eye image area Lv can be set in the virtual display screen area Dv without any loss.

  Next, with reference to FIG. 2C and FIG. 2D, a case where the observer does not face the display screen will be described. As shown in FIG. 2C, the virtual space setting means 11 sets the virtual observer position V and the virtual display screen area Dv on the virtual space based on the display screen information. A virtual line-of-sight direction Av which is a direction toward the center c of the virtual display screen area Dv is set. Here, since the observer does not face the display screen, the virtual display screen area Dv is not orthogonal to the virtual viewing direction Av. Further, the virtual space setting means 11 sets a virtual right eye position R and a virtual left eye position L that are separated by a certain interval in a direction orthogonal to the virtual viewing direction Av across the virtual observer position V. Based on the information, the virtual standard display area Cv is set in a direction orthogonal to the virtual line-of-sight direction Av.

  Then, the right eye image area setting unit 12 perspectively projects the virtual standard display area Cv from the virtual right eye position R to the virtual display screen area Dv. Then, as shown in FIG. 2D, the right-eye image region setting unit 12 converts the virtual right-eye image region Rv, which is a quadrangular region obtained by perspective projection of the virtual standard display region Cv, to the virtual display screen region Dv. Can be set within. Further, as shown in FIG. 2C, the left eye image area setting means 13 perspectively projects the virtual standard display area Cv from the virtual left eye position L to the virtual display screen area Dv. Then, the left-eye image area setting unit 13 can set the virtual left-eye image area Lv in the virtual display screen area Dv as shown in FIG.

  Thus, the virtual space setting means 11 sets the virtual visual line direction Av, sets the virtual standard display area Cv orthogonal to the virtual visual line direction Av, and sets the right-eye image area setting means 12 and the left-eye image area. Since the setting means 13 perspectively projects the virtual standard display area Cv onto the virtual display screen area Dv, the virtual right-eye image area Rv is created by the right-eye image generation means 14 and the left-eye image generation means 15 described later. When the right-eye stereoscopic image and the left-eye stereoscopic image in which the right-eye image and the left-eye image are fitted in the area corresponding to the virtual left-eye image area Lv are displayed on the display screen, the observer displays Even when not facing the screen, the area where the right-eye image and the left-eye image are fitted is observed at the viewing distance indicated in the standard condition information because of the parallax between the right eye and the left eye. Facing the person It seems to form a standard display screen. Therefore, a stereoscopic image without distortion can be presented to the observer.

  Returning to FIG. 1, the description will be continued. The right-eye image generation unit 14 applies the virtual right-eye image region set by the right-eye image region setting unit 12 within the image region corresponding to the virtual display screen region set by the display screen region setting unit 11a. A right-eye stereoscopic image is generated by projecting and fitting a right-eye image input from the outside into a corresponding region. Note that the right-eye image generating unit 14 projects and converts the right-eye image under the same projection conditions as the perspective projection of the virtual standard display region by the right-eye image region setting unit 12. The right-eye stereoscopic image generated here is output to a stereoscopic display device (not shown).

  The left-eye image generating unit 15 applies the virtual left-eye image region set by the left-eye image region setting unit 13 within the image region corresponding to the virtual display screen region set by the display screen region setting unit 11a. A left eye stereoscopic image is generated by projecting and fitting a left eye image input from the outside into a corresponding region. The left-eye image generating unit 15 projects and converts the left-eye image under the same projection conditions as the perspective projection of the virtual standard display area by the left-eye image region setting unit 13. The left-eye stereoscopic image generated here is output to a stereoscopic display device (not shown).

  If the image for the right eye and the image for the left eye are not displayed under the standard conditions set in advance at the time of shooting, the observer can view a stereoscopic image of the size and depth of the subject intended by the creator of the image. Although it was not possible, by configuring the stereoscopic image generation device 1 as described above, even when displaying on a display screen different from the size assumed at the time of shooting, the same stereoscopic video as that displayed under standard conditions is seen A right-eye stereoscopic image and a left-eye stereoscopic image can be generated.

  Here, referring to FIG. 3, when the right-eye stereoscopic image and the left-eye stereoscopic image generated by the stereoscopic image generating device 1 are displayed on a display screen of a stereoscopic display device (not shown), an observer is displayed. 3D images that can be seen by FIG. 3 shows the positions of the right and left eyes of the observer and the arrangement of the stereoscopic image formed by the subject on the right-eye image and the left-eye image when viewed from this position, as viewed from above. It is a schematic diagram, (a) is an explanatory diagram for explaining the case where the image for the right eye and the image for the left eye are displayed under standard conditions, (b) is a display smaller than the display screen set by the standard conditions An explanatory diagram for explaining a case in which an image for the right eye and an image for the left eye are displayed on the screen and observed at a viewing distance shorter than the set viewing distance, (c) is from a display screen set according to standard conditions Explanation for explaining a case where the right-eye stereoscopic image and the left-eye stereoscopic image generated by the stereoscopic image generation device are displayed on a small display screen and observed at a viewing distance shorter than the set viewing distance. FIG.

  First, referring to FIG. 3A, the right eye image and the left eye are displayed on a standard display screen (not shown) having a preset size when the right eye image and the left eye image are taken. An example will be described in which an ophthalmic image is displayed in an overlapping manner and an observer views the image from a set viewing distance (standard viewing distance). Here, as shown in FIG. 3A, the image Ra for the right eye and the image La for the left eye are displayed on the standard display screen, and the observer uses, for example, polarized glasses or the like to The right-eye image Ra can be seen from the right-eye position Rp that is the position of the eye, and the left-eye image La can be seen from the left-eye position Lp that is the position of the left eye.

Here, it is assumed that the subjects Ra ₁ and Ra ₂ are present on the right-eye image Ra, and the subjects La ₁ and La ₂ are displayed on the left-eye image La. Then, the binocular parallax allows the observer to perform standard display from the subject Ra ₁ displayed to the right of the center of the right-eye image Ra and the subject La ₁ displayed to the left of the center of the left-eye image La. The stereoscopic image Ia ₁ can be seen further behind the screen. From the subject Ra ₂ displayed at the center of the right-eye image Ra and the subject La ₂ displayed at the center of the left-eye image La, the observer can view a stereoscopic image (not shown) at the center of the standard display screen. You can see The stereoscopic video that can be seen by the observer is the video intended by the producer.

  Next, referring to FIG. 3B, the right eye image and the left eye are displayed on a display screen (not shown) smaller than a preset size when the right eye image and the left eye image are taken. An example will be described in which an ophthalmic image is displayed in an overlapping manner and an observer views the image from a position closer than the standard viewing distance. Here, as shown in FIG. 3B, the right-eye image Rb and the left-eye image Lb are displayed on the display screen (not shown), and the observer can use the right-eye position Rp from the right-eye position Rp. From the left eye position Lp, the left eye image Lb in which the left eye image La is reduced can be seen from the right eye image Rb in which the image Ra has been reduced.

Then, there are reduced subjects Rb ₁ and Rb ₂ on the right-eye image Rb, and reduced subjects Lb ₁ and Lb ₂ are displayed on the left-eye image Lb. Then, the binocular parallax becomes smaller than that in FIG. 3A, and the observer views the reduced stereoscopic image Ib ₁ at a position closer to the stereoscopic image Ia ₁ from the subjects Rb ₁ and Lb _1. be able to. From the subject Rb ₂ and the subject Lb ₂ , the observer can see a reduced stereoscopic image (not shown) at the center of the display screen located at a position closer than the standard viewing distance. In this way, when a stereoscopic image is displayed by the conventional binocular stereoscopic image display method in which the right-eye image and the left-eye image are displayed as they are on a display screen that is smaller than a preset size, the observation is performed by the miniature garden effect. The person feels the depth is small and the object itself is small.

  Subsequently, referring to FIG. 3C, the stereoscopic image generating device 1 displays a display screen (not shown) smaller than a preset size when the right-eye image and the left-eye image are captured. A description will be given of an example in which the generated right-eye stereoscopic image and left-eye stereoscopic image are superimposed and displayed, and an observer views the image from a position closer than the standard viewing distance. Here, as shown in FIG. 3C, the display screen includes a right-eye stereoscopic image (not shown) in which the right-eye image Rc is inserted in a part of the area, and a part of the area. A left-eye stereoscopic image (not shown) in which the left-eye image Lc is inserted is displayed, and the viewer can reduce the right-eye image Ra from the right-eye position Rp and reduce or deform the right-eye image Rc. From the left eye position Lp, the left eye image Lc obtained by reducing or deforming the left eye image La can be viewed.

  Here, the right-eye stereoscopic image has a position corresponding to the virtual right-eye image region Rv (FIG. 2) set on the virtual space by the right-eye image region setting unit 12 as described above. The right-eye image Rc is inserted. Further, the left-eye image Lc is fitted into the left-eye stereoscopic image at a position corresponding to the virtual left-eye image region Lv (FIG. 2) set in the virtual space by the left-eye image region setting means 13. It is. The virtual right eye position R and the virtual left eye position L (FIG. 2) in the virtual space correspond to the right eye position Rp and the left eye position Lp, and the virtual standard display area Cv (FIG. 2) is a standard display screen. (Not shown). Therefore, by binocular parallax, from the right-eye image Rc and the left-eye image Lc, the observer is displayed at the position of the standard display screen (not shown) with the size of the standard display screen. A right-eye image and a left-eye image (not shown) can be seen.

Then, the binocular parallax allows the observer to see the stereoscopic image Ic ₁ further from the position of the standard display screen from the subject Rc ₁ and the subject Lc ₁ . Further, from the subject Rc ₂ and the subject Lc ₂ , the observer can see the stereoscopic image Ic ₂ at the center of the position of the standard display screen. Here, the stereoscopic video that the observer can see is the same as the stereoscopic video that can be seen from the right-eye image Ra and the left-eye image La displayed on the standard display screen in FIG. It will be the same as the video intended by the producer. Then, unlike the image generated by the conventional method of shifting the right-eye image and the left-eye image by setting an offset, the right-eye stereoscopic image and the left-eye image generated by the stereoscopic image generating device 1 are used. According to the stereoscopic image, the observer can see a stereoscopic image in which the depth and the size of the object are correctly expressed.

  Here, the stereoscopic image generating apparatus 1 inputs the display screen information and the standard condition information from the outside by the information input unit 10. However, among the preset display screen information and the standard condition information, A storage device (not shown) for storing a part or all of the information may be provided, and the virtual screen setting unit 11 may refer to display screen information and standard condition information stored in the storage device.

  In addition, the stereoscopic image generation apparatus 1 includes position detection means (not shown) for detecting the position of the observer. The position of the observer detected by the position detection means, the size of the display screen, and standard conditions Based on the information, the virtual space setting unit 11 may set the virtual line-of-sight direction, the virtual right eye position, the virtual left eye position, the virtual display screen area, and the virtual standard display area. Further, the stereoscopic image generating apparatus 1 inputs the positions of the right eye and left eye of the observer set or detected in advance from the outside, and the observer is determined according to the positions of the right eye and left eye of the observer. The position of may be indicated.

  Furthermore, the line-of-sight direction setting unit 11b may set a direction perpendicular to the plane including the virtual display screen area as the virtual line-of-sight direction. Further, the virtual space setting unit 11 does not include the line-of-sight direction setting unit 11b, and the binocular position setting unit 11c is virtualized on the virtual space based on the preset right or left eye positions detected. The right eye position and the virtual left eye position may be set, and the standard display area setting unit 11d may set the virtual standard display area based on the virtual right eye position and the virtual left eye position.

  The right-eye image and the left-eye image are frame images or field images, and the stereoscopic image generation device 1 generates a frame image or a field image of the right-eye stereoscopic image and the left-eye stereoscopic image. However, it is also possible to generate a 3D video image.

  Further, here, the stereoscopic image generation device 1 displays the right-eye stereoscopic image and the left-eye stereoscopic image on the display screen of a stereoscopic display device (not shown) connected to the outside. It is good also as outputting to two projectors provided with the polarizing plate of a different direction which each projects the right-eye stereoscopic image and the left-eye stereoscopic image.

  Note that the stereoscopic image generating apparatus 1 of the present invention is a stereoscopic image for the right eye corresponding to various binocular stereoscopic video display methods such as a filter glasses method, a time division method, a lenticular method, and a parallax barrier method. And a left-eye stereoscopic image can be generated.

  In addition, the stereoscopic image generation apparatus 1 can also realize each unit as a function program in a computer, and can also be operated as a stereoscopic image generation program by combining the function programs.

[Operation of Stereoscopic Image Generation Device]
Next, referring to FIG. 4 (refer to FIG. 1 as appropriate), the operation of the stereoscopic image generating apparatus 1 according to the present invention will be described. FIG. 4 is a flowchart showing an operation in which the stereoscopic image generating apparatus according to the present invention generates a right-eye stereoscopic image and a left-eye stereoscopic image.

  The stereoscopic image generating apparatus 1 inputs display screen information and standard condition information from the outside by the information input means 10 (step S10). Then, the stereoscopic image generating apparatus 1 sets the coordinate axis of the virtual space based on the display screen information input in step S10 by the display screen region setting unit 11a of the virtual space setting unit 11, and virtually displays the virtual space on the virtual space. An observer position and a virtual display screen area are set (step S11). Subsequently, the stereoscopic image generation device 1 changes the direction from the virtual observer position set in step S11 to the center of the virtual display screen area on the virtual space by the gaze direction setting unit 11b of the virtual space setting unit 11. The virtual line-of-sight direction is set (step S12).

  Then, the stereoscopic image generation apparatus 1 sandwiches the virtual observer position set in step S11 on the virtual space by the binocular position setting unit 11c of the virtual space setting unit 11, and the virtual line of sight set in step S12. Positions separated by a certain interval in a direction orthogonal to the direction are set as the virtual right eye position and the virtual left eye position (step S13). Further, the stereoscopic image generating apparatus 1 uses the virtual visual line set in step S12 on the virtual space based on the standard condition information input in step S10 by the standard display area setting unit 11d of the virtual space setting unit 11. A virtual standard display area is set in a direction orthogonal to the direction (step S14).

  Subsequently, the stereoscopic image generation apparatus 1 performs the virtual display screen region set in step S11 from the virtual right eye position set in step S13 by the right-eye image region setting unit 12 in step S14. A virtual right-eye image area obtained by perspective projection of the set virtual standard display area is set in the virtual display screen area (step S15).

  Further, the stereoscopic image generating apparatus 1 sets the virtual display screen region set in step S11 from the virtual left eye position set in step S13 by the left eye image region setting unit 13 in step S14. A virtual left-eye image area obtained by perspective projection of the virtual standard display area is set in the virtual display screen area (step S16).

  Then, the stereoscopic image generating apparatus 1 uses the right-eye image generating unit 14 to convert the virtual right-eye image region set in step S15 into the image region corresponding to the virtual display screen region set in step S11. The right-eye image input from the outside is fitted into the corresponding area by perspective projection conversion to generate a right-eye stereoscopic image (step S17).

  Further, the stereoscopic image generating apparatus 1 uses the left eye image generating unit 15 to convert the virtual left eye image region set in step S16 into the image region corresponding to the virtual display screen region set in step S11. A left-eye stereoscopic image is generated by fitting the left-eye image input from the outside into the corresponding region by perspective projection conversion (step S18).

It is the block diagram which showed the structure of the stereoscopic vision image generation apparatus in this invention. The right-eye image region setting unit and the left-eye image region setting unit of the stereoscopic image generation device according to the present invention are, on the virtual space, a virtual right eye position, a virtual left eye position, a virtual display screen region, It is explanatory drawing for demonstrating the method to set the image area for virtual right eyes and the image area for virtual left eyes based on a virtual standard display area, (a) is a case where an observer faces a display screen directly FIG. 5B is a schematic diagram schematically showing an example of the virtual space viewed from above, and FIG. 5B is a virtual right eye set by the right-eye image region setting unit and the left-eye image region setting unit in FIG. The schematic diagram which shows typically the image area for images and the image area for virtual left eyes, (c) is a schematic diagram which shows typically the example which looked at the virtual space from the top, when an observer does not face the display screen , (D) is the right eye image region setting means and (c). The virtual right-eye image area and the virtual image for the left eye area is set by the left-eye image area setting means is a schematic diagram illustrating schematically. It is the schematic diagram which looked at the arrangement | positioning of the three-dimensional image formed with the object on the image for right eyes and the image for left eyes when it sees from the position of an observer's right eye and left eye from this position from the top. (A) is explanatory drawing for demonstrating the case where the image for right eyes and the image for left eyes are displayed on standard conditions, (b) is right-eye on a display screen smaller than the display screen set by standard conditions. An explanatory diagram for explaining a case where an image for viewing and an image for the left eye are displayed and observed at a viewing distance shorter than the set viewing distance, (c) is a display screen smaller than the display screen set by the standard condition Explanatory drawing for demonstrating the case where the stereoscopic vision image for right eyes and the stereoscopic vision image for left eyes which were produced | generated by the stereoscopic vision image generation apparatus of this invention are displayed, and it observed with the viewing distance shorter than the set viewing distance It is. It is the flowchart which showed the operation | movement which the stereoscopic vision image generation apparatus in this invention produces | generates the stereoscopic vision image for right eyes, and the stereoscopic vision image for left eyes.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Stereoscopic image production | generation apparatus 10 Information input means 11 Virtual space setting means 11a Display screen area | region setting part 11b Gaze direction setting part 11c Binocular position setting part 11d Standard display area setting part 12 Right eye image area setting means 13 For left eyes Image region setting means 14 Right-eye image generating means 15 Left-eye image generating means

Claims (3)

Stereoscopic image generation that converts a right-eye image and a left-eye image based on the size and viewing distance of the display screen to generate a right-eye stereoscopic image and a left-eye stereoscopic image A device,
Based on display screen information indicating the size of the display screen for displaying the right-eye stereoscopic image and the left-eye stereoscopic image, the position of the observer, and the position of the display screen, the observer A right eye and a left eye position, an area of the display screen, and a display area of the right eye image and the left eye image that are set in advance corresponding to the position of the observer. A virtual right eye position on the space, a virtual left eye position, a virtual display screen area, a virtual space setting means for setting as a virtual standard display area,
On the virtual space, a right-eye image in which the virtual standard display area is perspective-projected from the virtual right-eye position to the virtual display screen area and a virtual right-eye image area is set in the virtual display screen area. Region setting means;
On the virtual space, a left-eye image in which the virtual standard display area is perspectively projected from the virtual left-eye position to the virtual display screen area and a virtual left-eye image area is set in the virtual display screen area Region setting means;
A transformation for performing perspective projection of the virtual standard display area from the virtual right eye position with respect to the virtual display screen area is performed on the right eye image, and is inserted into the virtual right eye image area in the virtual display screen area. A right-eye image generating means for generating the right-eye stereoscopic image;
Conversion for performing perspective projection of the virtual standard display region from the virtual left eye position to the virtual display screen region is performed on the left eye image, and is fitted into the virtual left eye image region in the virtual display screen region. A left-eye image generating means for generating the left-eye stereoscopic image;
A stereoscopic image generating apparatus comprising:   The virtual space setting means sets a line-of-sight direction that is a direction from the position of the observer to the center of the display screen based on the display screen information as a virtual line-of-sight direction on the virtual space, and In the virtual space, the virtual right eye position and the virtual left eye position are set so that a straight line connecting the virtual right eye position and the virtual left eye position is orthogonal to the virtual line-of-sight direction, and the virtual The stereoscopic image generation apparatus according to claim 1, wherein the standard display area is set in a direction orthogonal to the virtual visual line direction. A computer is used to convert the right-eye image and the left-eye image based on the size of the display screen and the viewing distance to generate a right-eye stereoscopic image and a left-eye stereoscopic image. ,
Based on the display screen information indicating the size of the display screen for displaying the right-eye stereoscopic image and the left-eye stereoscopic image, the position of the observer, and the position of the display screen, the observer's A virtual space includes positions of the right eye and the left eye, an area of the display screen, and a display area of the image for the right eye and the image for the left eye that are set in advance corresponding to the position of the observer. A virtual space setting means for setting as a virtual right eye position, a virtual left eye position, a virtual display screen area, and a virtual standard display area;
On the virtual space, a right-eye image in which the virtual standard display area is perspective-projected from the virtual right-eye position to the virtual display screen area and a virtual right-eye image area is set in the virtual display screen area. Area setting means,
On the virtual space, a left-eye image in which the virtual standard display area is perspectively projected from the virtual left-eye position to the virtual display screen area and a virtual left-eye image area is set in the virtual display screen area Area setting means,
A transformation for performing perspective projection of the virtual standard display area from the virtual right eye position with respect to the virtual display screen area is performed on the right eye image, and is inserted into the virtual right eye image area in the virtual display screen area. A right-eye image generating means for generating the right-eye stereoscopic image;
Conversion for performing perspective projection of the virtual standard display region from the virtual left eye position to the virtual display screen region is performed on the left eye image, and is fitted into the virtual left eye image region in the virtual display screen region. A left-eye image generating means for generating the left-eye stereoscopic image;
A stereoscopic image generation program characterized by functioning as:

Images