JP2007133415A - Display device and display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide such a virtual image that a distance from a user is changed by a video. <P>SOLUTION: The virtual image is provided with a shape suitable to the video. When a video is broadcasted as a movie and a drama having an aspect ratio of 16:9 by a high-definition television broadcast, a large virtual image is formed in a position far away from a user, for example, by about 15m in the display device 4. When a video is broadcasted as a television signal having an aspect ratio of 4:3 by an NTSC system, a middle-sized virtual image is formed in a position comparatively close to the user, for example, by about 3m in the display device 4. Whether the video is broadcasted by the high-definition television broadcast or the NTSC system is determined, for example, based on the synchronization signal of the television signal. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a display device and a display method, and in particular, in providing a virtual image of a video, by changing a distance, a size, or a direction to the virtual image corresponding to the video, in a form suitable for the video. The present invention relates to a display device and a display method capable of providing a virtual image.

  As a display device that provides a virtual image to a user, for example, an HMD (Head Mounted Display) is realized.

  Here, the virtual image can be formed on the object side when the object is closer to the lens than the focal length. For example, “Introduction to lens science (top)”, Toshio Ogura The details are described in Asahi Sonorama, "Optics", Kazumi Murata, Science, etc.

  For example, as shown in FIG. 9, the HMD includes a lens that enlarges an image to form a virtual image, and a display panel (for example, a liquid crystal display) disposed at a position closer to the focal length of the lens. The The user can view the virtual image by wearing the HMD on the head and viewing the video displayed on the display panel through the lens.

  In addition to the HMD, examples of the display device that can appreciate the virtual image include a HUD (Head Up Display) and a video camera.

  However, in HUD, for example, necessary information is provided as a virtual image while performing some work such as driving a car or maneuvering an aircraft. Therefore, HUD is not suitable for the purpose of purely viewing images such as movies.

  Further, in the video camera, for example, as shown in FIG. 10, a virtual image formed by enlarging the display of the built-in display panel with an eyepiece can be seen by looking through the viewfinder. However, in the viewfinder, since a virtual image can be seen only with one eye, a video camera is not suitable for the purpose of purely viewing a video such as a movie, like HUD.

  By the way, when making a user appreciate a virtual image, it is preferable to change the distance from the user in which a virtual image is formed, etc. with an image | video.

  That is, for example, for an image with an aspect ratio of 4: 3, such as an NTSC television signal, the virtual image is placed closer to the user, and for example, an aspect ratio such as a so-called high-definition television signal. For a horizontally long image with a ratio of 16: 9, forming the virtual image at a position far from the user can make the user feel a sense of realism, and also less fatigue due to viewing the virtual image Become.

  The present invention has been made in view of such a situation, and makes it possible to provide a virtual image in a form suitable for an image.

  A display device according to an aspect of the present invention is a cover that covers a user's head, which is provided in user holding means for holding a user in a sitting state, and in which the light transmittance changes. A display device incorporated therein, wherein a display means for displaying an image and a two-dimensional virtual image are formed by enlarging the image displayed on the display means and observed with the left eye and the right eye of the user The same virtual image to be arranged on the same plane, the type of the video signal of the video or the content of the video, and the user of the virtual image formed according to the recognized result Control means for controlling the distance from the image, the size of the virtual image, or the direction in which the virtual image is formed.

  The control means can control the distance from the user of the virtual image and the size of the virtual image according to the aspect ratio of the video.

  The control means can control the direction in which the virtual image is formed in accordance with audio for the video or characters included in the video.

  The display device may further include operation means operated when changing a distance of the virtual image from the user, a size of the virtual image, and a display direction of the virtual image.

  The operating means can be operated to change the transmittance of the cover.

  A display method according to an aspect of the present invention is a cover that covers a user's head, which is provided in user holding means for holding a user in a sitting state, and in which the light transmittance changes. A display method of a built-in display device, which displays an image, forms a two-dimensional virtual image by enlarging the image displayed on the display means, and observes with the left eye and right eye of the user The same virtual image to be arranged on the same plane, recognizing the type of video signal of the video or the content of the video, and depending on the recognized result, the distance from the user of the virtual image formed, Controlling the size of the virtual image or the direction in which the virtual image is formed.

  In one aspect of the present invention, an image is displayed, a two-dimensional virtual image is formed by enlarging the image displayed on the display means, and the same virtual image observed by the user's left eye and right eye is It is arranged on the same plane, the type of video signal or the content of the video is recognized, and the distance from the user, the size of the virtual image, or the virtual image is formed according to the recognized result Direction is controlled.

  According to the present invention, a virtual image can be provided in a form suitable for an image. In addition, according to the present invention, the user can watch the video while holding the user's posture so that the user can relax while showing the external scenery or preventing the external scenery from being seen by the eyes. Can be made.

  FIG. 1 shows a configuration of an embodiment of a virtual image providing system to which the present invention is applied. In this virtual image providing system, a realistic virtual image is provided in a form suitable for the video, and the user can watch it in a relaxed state.

  That is, the user holding mechanism 1 holds the user in a sitting state, for example, a chair or a sofa, and the user is held in a relaxed state by sitting on the user.

  Furthermore, for example, a hemispherical device fixing portion 2 configured to cover the user's head when the user sits on the backrest of the user holding mechanism 1 is provided. The device fixing portion 2 is supported by the user holding mechanism 1 by a rotation pin 3 and further rotates in the vertical direction around the rotation pin 3. The device fixing portion 2 does not come into contact with the user's head held by the user holding mechanism 1 when the device fixing portion 2 is rotated upward, and when the device fixing portion 2 is rotated downward. Each position is locked (locked).

  Therefore, the user can easily sit on the user holding mechanism 1 by rotating the device fixing portion 2 upward. Further, it is possible to easily stand up from the user holding mechanism 1.

  A display device 4 is incorporated inside (inside) the device fixing portion 2. That is, the display device 4 is positioned substantially in front (front) of the user when the device fixing unit 2 is rotated downward and locked in a state where the user is held by the user holding mechanism 1. It is incorporated inside the device fixing part 2.

  The display device 4 displays a video, for example, a small display panel 14 (14L and 14R) (display means) composed of a liquid crystal display and the like, and enlarges the video displayed on the display panel 14 to display a virtual image. And has a lens 13 (13L and 13R) as a magnifying optical system that forms and arranges virtual images observed by the user's left eye and right eye at the same position in space. Thus, a virtual image obtained by enlarging a predetermined image is provided.

  The operation unit 5 includes various buttons and levers, and is operated when the system performs a predetermined process.

  That is, for example, the device fixing unit 2 is configured by an element such as ECD (Electrochromic Display) whose light transmittance is variable (hereinafter, referred to as a transmittance variable element as appropriate), or a transparent member. In addition, a liquid crystal shutter or the like is incorporated, and the operation unit 5 is operated to control the transmittance variable element, the liquid crystal shutter, and the like. Therefore, the user changes the transmittance of the apparatus fixing unit 2 by operating the operation unit 5, thereby preventing the outside scenery (situation) from being seen or the outside scenery from being seen by the eyes. You can do it.

  The operation unit 5 is also operated when setting the distance, the size, and the direction of the virtual image formed by the display device 4 from the user.

  In the virtual image providing system configured as described above, for example, when the user operates the operation unit 5 while being held by the user holding mechanism 1, for example, received by a TV (Television) tuner (not shown), An NTSC television signal, a high-definition broadcast television signal, a video signal output from a computer, or the like is supplied to the display device 4 and a corresponding video is displayed on the display panels 14L and 14R.

  The image displayed on the display panel 14L or 14R is enlarged by the lens 13L or 13R, respectively, and each of the light as the enlarged image enters the left eye or the right eye of the user. Thereby, the virtual image of the image displayed on the display panel 14L or 14R is observed with the left eye or the right eye of the user, respectively.

  At this time, the display device 4 changes the distance or size of the virtual image from the user in accordance with the video supplied thereto. That is, when the video is, for example, a movie or drama having an aspect ratio of 16: 9 by high-definition broadcasting, a large virtual image is formed on the display device 4 at a position about 15 m away from the user.

  In addition, when the video is, for example, an NTSC television signal with an aspect ratio of 4: 3, the display device 4 has an intermediate size at a relatively close position, for example, about 3 m from the user. A virtual image is formed. At this time, like the so-called wide television (wide television receiver), the display device 4 changes the aspect ratio of the video from 4: 3 to 16: 9 to provide the virtual image. It is also possible to do.

  Furthermore, when the video is an output screen of an information processing device such as a computer, for example, a relatively small virtual image is formed on the display device 4 at a very close position of, for example, about 0.5 m from the user.

  As described above, the virtual image is provided to the user in a form suitable for the video.

  That is, for a video such as a movie or a drama by high-definition broadcasting, a virtual image can be provided at a position far from the user and large to provide a realistic image, a sense of distance, and a powerful image.

  In addition, for an NTSC video image such as a 4: 3 aspect ratio television signal, the virtual image is formed at a position relatively close to the user and at an intermediate size so that the user can visually It is possible to provide images that do not feel uncomfortable. As a result, for example, it is possible to reduce the degree of eye strain.

  Furthermore, for images such as the output screen of an information processing device such as a computer, the virtual image is formed at a position very close to the user and relatively small so that the user can easily operate the computer or the like. Can be provided. As a result, for example, work efficiency can be improved.

  In the present embodiment, since the user is held by the user holding mechanism 1, the user can view the virtual image in a very relaxed state.

  Furthermore, as described above, the user can change the transmittance of the device fixing unit 2 covering the head by operating the operation unit 5. Therefore, for example, when the transmittance is lowered, most of the light from the outside is blocked, so that the user can be immersed in the virtual image space. Further, when the transmittance is increased, the user can observe the virtual image while confirming the surrounding situation, that is, observe (confirm) the surrounding situation (scenery) superimposed on the virtual image. Furthermore, by setting the transmittance to an appropriate value, it is possible to observe a virtual image with a well-balanced brightness and an external scenery. In this case, the user can appreciate the virtual image without feeling uneasy (a feeling of obstruction) due to the fact that the outside cannot be seen (can give the user a sense of openness). On the other hand, for example, when the transmittance is gradually lowered, the user can enjoy a sense of being immersed in the virtual image space from the real world.

  In addition, a speaker (not shown) is provided inside the apparatus fixing unit 2, and when there is an audio accompanying the video supplied thereto, the audio is output from the speaker. .

  Here, the description of the audio will be omitted below.

  Next, FIG. 2 shows a configuration example of an optical system of the display device 4 of FIG. FIG. 2 shows a configuration example when the display device 4 is viewed from above the user's head held by the user holding mechanism 1.

  In the embodiment of FIG. 2, the display device 4 includes a lens 13 </ b> L that is an optical system for the left eye having a different optical axis as a magnifying optical system for forming a virtual image by enlarging an image. And a lens 13R which is an optical system for the right eye.

  That is, the lens 13R or 13L is a convex lens having the same characteristics for providing the virtual image R or L obtained by enlarging the image displayed on the display panel 14R or 14L to the right eye or the left eye, respectively. These are arranged on the same plane. That is, the lenses 13R and 13L are arranged so that their main planes coincide with each other.

  In FIG. 2, O1 or O2 represents the principal point of the lens 13R or 13L, and F1 or F2 represents the focal point of the lens 13R or 13L, respectively. O represents the midpoint between the principal points O1 and O2.

  The center point of the display panel 14R or 14L (for example, when the display panels 14R and 14L are rectangular), the midpoint O and the focal point F1 or F2, respectively, are connected to each other. They are positioned on the straight lines OF1 and OF2, respectively, and are disposed so as to be positioned on the same plane.

  According to the display device 4 configured as described above, an image displayed on the display panel 14R or 14L is enlarged by the lens 13R or 13L, and light corresponding to the enlarged image is applied to the right eye or the left eye. By making each incident, a virtual image corresponding to the image is observed with the right eye or the left eye. That is, the virtual image R or L formed by the lens 13R or 13L is observed with the right eye or the left eye, respectively.

  According to the configuration of FIG. 2, the virtual images observed by the right eye or the left eye are formed by the lenses 13R or 13L that are separate optical systems, respectively, but these virtual images are at the same position in the three-dimensional space. Placed in. That is, the virtual images observed by the user's left eye and right eye are arranged at the same position in space.

  This is due to the following reason. That is, for example, the direction from the principal point O2 to O1 is the d-axis, and the optical axis direction of the lens 13L (the direction from the principal point O2 to the focal point F2) is the s-axis. The center point of the display panel 14L is M1, the coordinates on the sd plane are (s1, d1), the center point of the virtual image L formed by the lens 13L is M1 ', and the coordinates on the sd plane are (s1 ', D1'). Further, the midpoint between the focal points F1 and F2 is O ′.

  In this case, as described above, since the display panel 14R or 14L is in the same plane and the center point thereof is on the straight line OF1 or OF2, the display panels 14R and 14L are the main planes of the lenses 13R and 13L ( This is also equidistant from the same plane as described above. Therefore, since the virtual images R and L are also in the same plane, the virtual images R and L are the same if the center points of the virtual images R and L are both on the straight line OO ′ connecting the middle points O and O ′. Will be in position.

  Therefore, since the center point M1 (s1, d1) of the display panel 14L is on the straight line OF2, the following equation is established.

d1 = L / 2−L × s1 / (2 × f) (1)
However, L represents the distance between the principal points O1 and O2, and f represents the focal length of the lens 13L.

  On the other hand, the following formula is established by the imaging formula.

      1 / f = 1 / s1-1 / s1 '(2)

  Further, since the principal point O2 and the center points M1 and M1 'are on a straight line, the following equation is established.

      s1 / s1 '= d1 / d1' (3)

From the equations (1) to (3), the equation d1 ′ = L / 2 (4)
Is obtained.

  From equation (4), the center point M1 'of the virtual image L is on the straight line OO'.

  The optical system formed by the lens 13L and the optical system formed by the lens 13R are symmetric with respect to the straight line OO '. Therefore, the center point of the virtual image R is also on the straight line OO'.

  As described above, the virtual images R and L are in the same plane and their center points are both on the straight line OO ′, so that the virtual images R and L are at the same position.

  Therefore, the user can observe the virtual image in a state in which the convergence and adjustment of both eyes are matched, that is, in a relaxed state (reasonably).

  In the display device 4, each of the display panels 14R or 14L is configured to move synchronously so that the center point thereof is included in the same plane on the straight line OF1 or OF2, whereby the virtual images R and The position where L is formed is moved from near the user to infinity (the distance from the user to the virtual images R and L is changed). The display panels 14R and 14L are moved by, for example, a virtual image distance control motor 25 (FIGS. 3 and 5) configured by a stepping motor or the like. Further, each of the display panels 14R or 14L moves in a range on the lens 13R side or 13L side from the focal point F1 or F2. This is because, as described above, in order to observe a virtual image of an object, the object needs to be located closer to the lens than the focal length.

  In addition, by moving the display panels 14L and 14R to positions near or far from the lenses 13L and 13R, the virtual images L and R move to positions near or far from the user, respectively.

  Further, since the distance from the user to the virtual images R and L can theoretically be changed by the distance between the lenses 13L and 13R and the display panels 14L and 14R, the display panels 14L and 14R are not. It can also be changed by moving the lenses 13L and 13R.

  In FIG. 2, the lenses 13L and 13R, which are convex lenses, are used as the magnifying optical system. However, the display device 4 can be configured using, for example, a concave mirror in addition to the convex lens.

  Next, FIG. 3 is a perspective view illustrating a configuration example of the display device 4.

  The lenses 13L and 13R are attached to the bottom panel 16 at such an interval that the distance between their optical axes (principal points) is, for example, an average distance between the human left eye and right eye. The bottom panel 16 is fixed to a lower left frame spacer 11C and a lower right frame spacer 11D.

  In addition to the frame spacers 11C and 11D, a front panel 12 and a back panel 15 are provided so as to sandwich the upper left frame spacer 11A and the upper right frame spacer 11B. A motor mounting portion 24 for fixing the virtual image distance control motor 25 is provided at the upper center between the front panel 12 and the rear panel 15. The virtual image distance control motor 25 is configured to move the screwed motor shaft 26 in the vertical direction by rotating.

  In FIG. 3, the front panel 12, the back panel 15, and the bottom panel 16 are transparent, but this is for illustrating the configuration of the display device 4, and these are not necessarily transparent members. There is no need to configure.

  In a space sandwiched between the front panel 12 and the back panel 15, a panel holder 18 to which display panels 14L and 14R are attached is provided.

  That is, the panel holder 18 has panel attachment portions 19L and 19R, and the display panel 14L or 14R is attached to the panel attachment portion 19L or 19R so that the display screen faces the lens 13L or 13R, respectively. It has been. Then, the panel attachment portion 19L or 19R extends in a horizontal direction (in FIG. 3, in the direction parallel to the main plane of the lenses 13L and 13R) along the shaft 20L or 20R of the panel holder 18 along the left or right side. ) Can be moved respectively.

  Further, a pin 23L or 23R is provided on the front side of the panel mounting portion 19L or 19R, and the pin 23L or 23R is passed through a frame groove 21L or 21R provided on the front panel 12, respectively. .

  Here, the frame groove 21L or 21R is provided in the direction of rising left (lowering right) or moving upward (lowering left) along the straight line OF2 or OF1 described in FIG.

  Similarly to the frame groove 21L or 21R of the front panel 12, the rear panel 15 is also provided with a frame groove 22L or 22R, respectively. Further, pins (not shown) are provided on the back side of the panel mounting portion 19L or 19R in the same manner as the pins 23L or 23R, respectively, and the pins provided in the panel mounting portion 19L or 19R are respectively provided on the rear panel. It is passed through 15 frame grooves 22L or 22R.

  Therefore, when the panel holder 18 moves upward as a whole, the panel mounting portion 19L or 19R moves the shaft 20L or 19R by moving the pin 23L or 23R along the frame groove 21L (22L) or 21R (22R), respectively. Move to the left or right along 20R, respectively. Further, when the panel holder 18 moves downward as a whole, the panel mounting portion 19L or 19R moves the shaft 20L or 23R or 23R by moving the pin 23L or 23R along the frame groove 21L (22L) or 21R (22R), respectively. Move to the right or left along 20R.

  As a result, the display panel 14L or 14R moves along the frame grooves 21L (22L) or 21R (22R), respectively, in conjunction with the vertical movement of the panel holder 18, that is, as shown in FIG. Each of them moves on the OF2 or OF1 so as to be included in the same plane.

  A center plate 27 is provided at the center of the panel holder 18, and one end of a motor shaft 26 is attached to the center plate 27. Therefore, the panel holder 18 moves up and down together with the motor shaft 26. That is, when the virtual image distance control motor 25 rotates, the display panel 14L or 14R moves on the straight line OF2 or OF1 so as to be included in the same plane.

  In the embodiment of FIG. 3, the half mirror 17 is fixed to a boundary portion between the back panel 15 and the bottom panel 16 so as to be inclined with respect to the back panel. The front surface of the half mirror 17 is a reflecting surface.

  In the display device 4 configured as described above, an image is displayed on the display panel 14L or 14R and enlarged by the lens 13L or 13R, respectively. The magnified image obtained by the lens 13L or 13R is reflected by the half mirror 17 and enters the user's left eye or right eye, respectively. Thereby, a virtual image is observed in a user's eyeball. The light from the outside passes through the surface opposite to the reflecting surface of the half mirror 17 and enters the left eye and the right eye of the user, whereby an external scene is observed in the user's eyeball. The

  Then, the virtual image distance control motor 25 rotates, whereby the display panel 14L or 14R moves on the straight line OF2 or OF1, respectively, so that the virtual image observed by the user is as shown in FIG. It is formed at various distances from the user.

  In FIG. 3, the magnified images obtained by the lenses 13L and 13R are reflected by the half mirror 17 and are incident on the user's eyeball. However, the lenses 13L and 13R are not provided without providing the half mirror 17. It is also possible to make the magnified image obtained in (1) directly enter the user's eyeball. However, in this case, the display panels 14R and 14L are located in front of the user. Therefore, even if the device fixing unit 2 (FIG. 1) transmits light, the visual field is blocked by the display panels 14R and 14L. Therefore, the external situation (scenery) corresponding to the blocked visual field range should be confirmed. Will be difficult.

  Next, FIG. 4 shows the principle of making the size of the virtual image variable.

  As shown in FIG. 6A, the display panel 14 (14L and 14R) has a sufficiently large display area, and the size of the image displayed there is shown in FIGS. As shown, the size of the virtual image is changed by increasing or decreasing the size.

  As described above, by moving the position of the display panel 14 (FIG. 3) and changing the size of the image displayed there (FIG. 4), as described in FIG. A virtual image can be provided at a position at an appropriate distance from the user and at an appropriate size (view angle).

  That is, when the video is based on, for example, high-definition broadcasting, the display panel 14 is moved to a position away from the lens 13 and the video is displayed on the entire display panel 14 as shown in FIG. 5, a large virtual image having a wide angle of view and a horizontal to vertical ratio of 16: 9 can be formed as shown in FIG. When the video is, for example, an NTSC television signal, the display panel 14 is moved to a position close to the lens 13 and the video is displayed as shown in FIG. If displayed on a part of the central portion of the panel 14, as shown in FIG. 5, a relatively small virtual image having a narrow angle of view and a ratio of horizontal to vertical of 4: 3 can be formed.

  Next, FIG. 6 shows an example of the electrical configuration of the virtual image providing system of FIG.

  The video signal processing computer 41 (control means) receives the video signal and processes the video signal so that the video signal is, for example, one of a high-definition broadcast, an NTSC television signal, or a computer signal. It is designed to recognize which one. Then, the video signal processing computer 41 corresponds to the recognition result, and the virtual image distance signal for controlling the distance from the user of the virtual image to be formed or the size control signal for controlling the size of the virtual image. Are generated and supplied to the virtual image distance control computer 42 or the display control unit 44, respectively. The video signal processing computer 41 is also configured to supply the received video signal to the display control unit 44.

  The virtual image distance control computer 42 receives the virtual image distance signal from the video signal processing computer 41 and generates a virtual image distance control signal as a control signal to be given to the motor drive circuit 43 in accordance with the virtual image distance signal. It is made like that. This virtual image distance control signal is supplied from the virtual image distance control computer 42 to the motor drive circuit 43.

  The motor drive circuit 43 is configured to rotationally drive the virtual image distance control motor 25 (distance changing means) in accordance with a virtual image distance control signal from the virtual image distance control computer 42. Further, the motor drive circuit 43 is configured to rotationally drive the virtual image distance control motor 25 in accordance with an operation signal supplied when the operation unit 5 is operated. When both the virtual image distance control signal and the operation signal are supplied, the motor drive circuit 43 gives priority to, for example, the operation signal.

  The display control unit 44 (size changing means) (direction changing means) is used for the left eye and the right supplied from the video signal processing computer 41 according to the size control signal supplied from the video signal processing computer 41. The horizontal and vertical lengths of the video signal for the eye are limited (enlarged or reduced) and supplied to the display panels 14L and 14R for display. Further, the display control unit 44 enlarges or reduces the video signal in accordance with an operation signal supplied when the operation unit 5 is operated. Note that, similarly to the motor drive circuit 43, the display control unit 44 is configured to give priority to, for example, the operation signal when both the magnitude control signal and the operation signal are supplied. .

  Next, the operation will be described with reference to the flowchart of FIG. 7 shows the processing of the video signal processing computer 41 in FIG.

  When the video signal processing computer 41 receives the video signal, it determines in step S1, S3, or S5 whether the video signal is an NTSC system, a high-definition broadcast, or a computer signal. In steps S2, S4, S6 and S7, control corresponding to the determination result is performed.

  Here, the determinations in steps S1, S3, and S5 are performed based on, for example, a horizontal synchronization signal or a vertical synchronization signal included in the video signal and the horizontal synchronization frequency or the vertical synchronization frequency. Is called.

  That is, first, in step S1, it is determined whether or not the received video signal is of the NTSC system. If it is determined in step S1 that the video signal is of the NTSC system, the process proceeds to step S2, and the virtual image distance signal or the size control signal corresponding to the NTSC system is transmitted to the virtual image distance control computer 42 or the display control unit 44. Are output to the display control unit 44, and the processing is terminated.

  The virtual image distance control computer 42 recognizes a distance at which a virtual image is formed at the present time (hereinafter referred to as a current distance), and when receiving a virtual image distance signal, the difference between the distance corresponding to the virtual image distance signal and the current distance. Is calculated. If the difference value is not 0, a virtual image distance control signal corresponding to the rotation amount of the virtual image distance control motor 25 necessary to move the virtual image by the difference value is generated and supplied to the motor drive circuit 43. To do. In the motor drive circuit 43, the virtual image distance control motor 25 is rotationally driven in accordance with the virtual image distance control signal, whereby the display panels 14L and 14R are separated from a predetermined position (a distance corresponding to the virtual image distance signal from the user). Moved).

  On the other hand, in the display control unit 44, the video signal for the left eye or the right eye is enlarged or reduced in accordance with the magnitude control signal and supplied to the display panel 14L or 14R, respectively.

  Thereby, the virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and in a size corresponding to the size control signal. That is, in this case, since the virtual image distance signal and the magnitude control signal correspond to the NTSC system, as described in FIG. 1, the virtual image is relatively close to the user and has a medium magnitude. Formed.

  On the other hand, if it is determined in step S1 that the video signal is not of the NTSC format, the process proceeds to step S3, where it is determined whether or not the video signal is a high-definition broadcast. If it is determined in step S3 that the video signal is based on the high-definition broadcast, the process proceeds to step S4, where the virtual image distance signal or the size control signal corresponding to the high-definition broadcast is the virtual image distance control computer 42 or the display control unit 44. Are output to the display control unit 44, and the processing is terminated.

  Also in this case, as in the case described above, the virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and in a size corresponding to the size control signal. That is, in this case, the virtual image distance signal and the size control signal correspond to the high-definition broadcast. Therefore, as described with reference to FIG. 1, the virtual image is formed at a position far from the user and large.

  If it is determined in step S3 that the video signal is not a high-definition broadcast, the process proceeds to step S5 to determine whether the video signal is for a computer. If it is determined in step S5 that the video signal is for a computer, the process proceeds to step S6, and the virtual image distance signal or the size control signal corresponding to the computer is sent to the virtual image distance control computer 42 or the display control unit 44. The video signals for the left eye and the right eye are output to the display control unit 44, and the processing ends.

  Also in this case, as in the case described above, the virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and in a size corresponding to the size control signal. That is, in this case, since the virtual image distance signal and the magnitude control signal correspond to the computer, the virtual image is formed at a position very close to the user and small as described with reference to FIG.

  If it is determined in step S5 that the video signal is not for a computer, the process proceeds to step S7, and a default virtual image distance signal or magnitude control signal is sent to the virtual image distance control computer 42 or the display control unit 44, respectively. In addition to the output, the left-eye and right-eye video signals are output to the display control unit 44, and the process ends.

  Here, the default virtual image distance signal or the magnitude control signal is the same as that corresponding to, for example, the NTSC system, and therefore, in this case, the virtual image is located at a position relatively close to the user and in the middle. It is formed to a size of about.

  As described above, since the virtual image is provided in a form suitable for the video, it is possible to make the user feel a sense of reality, and to reduce the feeling of fatigue caused by viewing the virtual image.

  As mentioned above, although the case where the display device 4 that forms a virtual image is applied to a virtual image providing system integrated with the user holding mechanism 1 that holds a user has been described above, the present invention is not limited to, for example, an HMD or the like. The present invention can be applied to an apparatus that provides an image by a virtual image.

  In this embodiment, the distance and size at which the virtual image is formed are changed in response to the video synchronization signal. However, these distance and size (in addition, the virtual image to be described later) The (direction) can be changed in accordance with the content of the video, for example. That is, for example, by performing pattern recognition (image recognition) on an image, it continuously recognizes whether the image displays a landscape or a person. In the case of a landscape, the image is distant. A large virtual image is formed, and in the case of a person, a virtual image of a certain size can be formed at a relatively close position. In this case, for example, in a landscape scene, a virtual image of the landscape is formed large at a distant position, and it is possible to give the user a feeling of being surrounded in the landscape. Furthermore, for example, in a scene in which a person is displayed up, a virtual image of the person is formed in a relatively large size at a relatively close position, and the facial expression of the person can be clearly confirmed. Become.

  Further, the distance at which the virtual image is formed can be changed according to the detection result by detecting the aspect ratio of the video. That is, for example, when the aspect ratio is 16: 9, a large virtual image is formed at a far position, and when 4: 3, a medium-sized virtual image is formed at a relatively close position. It is possible.

  Further, the video displayed on the display panel 14 can be enlarged or reduced as a whole, and only a part of the video can be enlarged or reduced. Furthermore, it is possible to enlarge or reduce only one of the horizontal and vertical directions of the video, thereby converting the aspect ratio of the video to a desired value. For example, when the image is to display a landscape, only the horizontal direction is enlarged to form a horizontally long virtual image, so that the surrounding feeling as described above can be given to the user.

  In the present embodiment, the distance to the virtual image and the size thereof are changed corresponding to the video, but for example, the direction in which the virtual image is formed is also changed corresponding to the video. It is possible. For example, as shown in FIG. 8, the display control unit 44 changes the position of an area for displaying an image on the display panel 14 (the hatched portion in the figure). Can be realized.

  In this way, changing the direction in which the virtual image is formed corresponding to the video is useful, for example, when viewing the virtual image while performing some work.

  Specifically, for example, when the present invention is applied to an HMD, when actually cooking while watching a virtual image of a cooking program, the direction in which the virtual image is formed is changed from the center to the upper left, upper right, lower left. By changing to the lower right or the like, the user can surely work in the front direction while looking at a recipe that is a virtual image. That is, by moving the virtual image from the front direction (center), the field of view in the front direction is improved, and the work can be performed safely and reliably.

  Whether the program is a cooking program can be determined, for example, by causing the video signal processing computer 41 to recognize whether the video includes characters such as a cooking name. Alternatively, the voice associated with the video is recognized as voice, and the result of the voice recognition is determined based on whether or not the name of the dish or its ingredients are included. Further, the content of the program is added to the television signal of the program. It is possible to superimpose information to be broadcast and make a determination based on the information. In the case of a cooking program, for example, the display control unit 44 is controlled so that the video signal processing computer 41 displays the video in a direction that is not the front direction of the user, such as the upper left direction. Just do it.

  In the present embodiment, the distance to the virtual image or the like is changed corresponding to the video, but this may be changed by the user operating the operation unit 5 as described above. Is possible.

  Furthermore, the relationship between the image and the distance at which the virtual image is formed is not limited to that described with reference to FIG.

It is a figure which shows the external appearance of one Embodiment of the virtual image provision system to which this invention is applied. It is a figure which shows the structural example of the optical system of the display apparatus 4 of FIG. It is a perspective view which shows the structural example of the display apparatus 4 of FIG. It is a figure for demonstrating the principle which makes the magnitude | size of a virtual image variable. It is a figure for demonstrating the principle which makes the magnitude | size of a virtual image variable. It is a block diagram which shows the electrical structural example of the virtual image provision system of FIG. 7 is a flowchart for explaining the operation of the video signal processing computer 41 of FIG. 6. It is a figure for demonstrating the method to change the direction in which a virtual image is formed. It is a figure which shows the structure of an example of an HMD system. It is a figure which shows the structure of an example of a video camera.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 User holding mechanism, 2 Apparatus fixing | fixed part, 3 Rotation pin, 4 Display apparatus, 5 Operation part, 11A thru | or 11D Frame spacer, 12 Front panel, 13L, 13R Lens, 14L, 14R Display panel, 15 Back panel, 16 Bottom panel , 17 Half mirror, 18 Panel holder, 19L, 19R Panel mounting part, 20L, 20R Shaft, 21L, 21R, 22L, 22R Frame groove, 23L, 23R pin, 24 Motor mounting part, 25 Virtual image distance control motor, 26 Motor Shaft, 27 center plate, 41 video signal processing computer, 42 virtual image distance control computer, 43 motor drive circuit, 44 display control unit

Claims (6)

In a display device that is incorporated in a user holding means for holding the user in a sitting state and a cover that covers the user's head, the light transmittance changing,
Display means for displaying video;
A magnifying optical system that forms a two-dimensional virtual image by enlarging the image displayed on the display means, and arranges the same virtual image observed by the left eye and the right eye of the user on the same plane; ,
The type of the video signal of the video or the content of the video is recognized, and the distance from the user of the virtual image to be formed, the size of the virtual image, or the direction in which the virtual image is formed is determined according to the recognized result. And a control means for controlling. The display device according to claim 1, wherein the control unit controls a distance from the user of the virtual image and a size of the virtual image according to an aspect ratio of the video. The display device according to claim 1, wherein the control unit controls a direction in which the virtual image is formed in accordance with audio for the video or characters included in the video. The display device according to claim 1, further comprising an operation unit that is operated when changing a distance of the virtual image from the user, a size of the virtual image, or a display direction of the virtual image. The display device according to claim 4, wherein the operation unit is operated so as to change a transmittance of the cover. In a display method for a display device provided in user holding means for holding a user in a sitting state, covering the user's head and incorporated in a cover in which the light transmittance changes ,
Display the video,
A two-dimensional virtual image is formed by enlarging the image displayed on the display means, and the same virtual image observed by the left eye and the right eye of the user is arranged on the same plane,
The type of the video signal of the video or the content of the video is recognized, and the distance from the user of the virtual image to be formed, the size of the virtual image, or the direction in which the virtual image is formed is determined according to the recognized result. A display method that includes a controlling step.

Images