JPH11249064A - Head mounted display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a head mounted display device having functions which output an alarm and turn off the power source according to the gazing state of a viewer. SOLUTION: A light projection part 1 emits an infrared-ray beam to the part of an eye E. When the pupil is open like the eye E1, the infrared-ray beam is partially reflected by the surface of the cornea and made incident on a photodetection part 2. When the pupil is closed, on the other hand, the infrared- ray beam is scattered by time surface of the eyelid and not made incident on the photodetection part 2. A sleep decision part 3 judges whether the gazing power has decreased or is normal according to whether the reflected light detected by the photodetection part 2 is large or small and the time elapse of the photodetection quantity. When the gazing power becomes low and the closure time of the pupil becomes long, the sleep judgement part 3 judges a sleeping state.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head-mounted display device having a function of outputting an alarm or shutting off a power supply according to a state of watching of a viewer.

[0002]

2. Description of the Related Art As one type of a head mounted display, an HMD which forms a virtual image at a clear viewing distance of a viewer through a lens system on an image output to a small liquid crystal panel, and views the virtual image
(HeadMount Display). As another method,
VR that directly images light-modulated video light on the viewer's retina
D (Virtual Retinal Display). Some of these head-mounted display devices are wireless to reduce restrictions on the movement and posture of the viewer's body and the movement of the head.

In such a wireless head-mounted display device, similarly to an audio wireless headphone device, a signal is transmitted to a desired space by diffusing infrared rays from a fixed transmitting section to a specific range. The video and audio signals are reproduced by receiving the infrared rays. A battery as a power supply is built in such a head-mounted display device, and the display device is driven using the energy of the battery.

In order to extend the operation time of the head mounted display device, the capacity of the battery may be increased, but the weight of the head mounted display device is correspondingly increased. On the other hand, it is preferable to reduce the weight of the head-mounted display device as much as possible in order to reduce the feeling of oppression or discomfort to the head-mounted, and also to reduce the displacement.

[0005]

It is needless to say that it is necessary to reduce the power consumption of the circuit section and the display element in order to extend the operating time, but there is a limit to the reduction in the current of the circuit section. The head-mounted display device outputs images in the dark field,
A part of the face centered on the viewer's eyes is shielded from the outside world. For this reason, when the gaze decreases with respect to the output video,
The viewer temporarily falls asleep. This state is not noticeable to a third party, and is useless for both the video provider and the viewer.

[0006] As in the case of an electronic desk calculator, when the use of an electronic device is interrupted for a certain period of time or longer, a timer operates to shut off the power of the electronic device. Such an electronic device counts the time elapsed since the last key input, and shuts off the power supply when the time exceeds a specified value. However, this method cannot be said to be sufficient because an electrical response such as key input cannot be expected just by the viewer watching the screen as in a head-mounted display device.

The present invention has been made in view of such a conventional problem, and detects a gaze state of a viewer.
It is an object of the present invention to realize a head-mounted display device having a function of outputting an alarm or shutting off a power supply according to the result.

[0008]

According to a first aspect of the present invention, there is provided a light projecting unit for irradiating an invisible light beam to a viewer's eye;
When the light beam emitted from the light emitting unit is reflected through the viewer's cornea, a light receiving unit that detects the reflected light,
A sleep determining unit that determines whether the viewer's eye is in a sleep state or a gazing state based on the light receiving level of the light receiving unit.

According to a second aspect of the present invention, there is provided an image projection unit for outputting a visible light beam whose luminance is modulated by an image signal, and a two-dimensional scanning of the light beam emitted from the image projection unit. A scanning unit that provides scanning light to the retina of the viewer's eye, and a light receiving unit that detects the reflected light when the light beam emitted from the image projection unit is reflected through the viewer's cornea,
A sleep determining unit that determines whether the viewer is in a sleep state or a gaze state based on the light receiving level of the light receiving unit.

The invention of claim 3 of the present application is directed to claim 1 or 2
The head-mounted display device according to the above, further comprising an alarm unit that outputs a sleep alarm to a viewer when the sleep determination unit determines that the user is in a sleep state.

According to a fourth aspect of the present invention, there is provided an image projecting section for outputting a visible light beam whose luminance is modulated by an image signal, and a light beam emitted from the image projecting section is two-dimensionally scanned. A scanning unit that provides scanning light to the retina of the viewer's eye, and a light receiving unit that detects the reflected light when the light beam emitted from the image projection unit is reflected through the viewer's cornea,
Based on the light receiving level of the light receiving unit, the sleep state of the viewer, or a sleep determination unit that determines whether the gaze state, when the sleep determination unit is determined to be a sleep state, the image projection unit, the scanning unit, And a power control unit that shuts off power to the sleep determination unit.

According to a fifth aspect of the present invention, there is provided an image projection unit for outputting a visible light beam whose luminance is modulated by a video signal, and a light beam emitted from the image projection unit is two-dimensionally scanned. A scanning unit that provides scanning light to the retina of the viewer's eye, and a light receiving unit that detects the reflected light when the light beam emitted from the image projection unit is reflected through the viewer's cornea,
Based on the light receiving level of the light receiving unit, a sleep determining unit that determines whether the viewer is in a sleep state or a gaze state, and when the sleep determining unit determines that the sleeping state, the video light emitting unit is turned on and off. And a VRD control unit for concentrating the scanning position of the light beam of the scanning unit in a specific range.

[0013]

(Embodiment 1) A head mounted display according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram showing a configuration of a main part of the head mounted display device according to the present embodiment. This head-mounted display device is provided with an image display device (not shown) that outputs a virtual image at a clear viewing distance, and it is assumed that the viewer is gazing at the virtual image in front through the eye E.

As shown in FIGS. 1A and 1B, the head mounted display device is provided with a light projecting unit 1, a light receiving unit 2, and a sleep judging unit 3. The light projecting unit 1 emits an infrared beam to the eye E, and the light receiving unit 2 receives light reflected from the eye E. The sleep determining unit 3
Based on the magnitude of the reflected light detected by the light receiving unit 2 and the lapse of the received light amount, it is determined whether the gaze of the viewer has decreased or is normal. If the eyesight decreases and the closing time of the pupil increases, the sleep determining unit 3 determines that the subject is in a sleep state.

FIG. 2 is a block diagram showing a configuration example of the sleep judging section 3. Here, the sleep judging unit 3 includes a low-pass filter (LPF) 31, an inverting circuit (NOT) 32, and a comparator 33.
It is constituted by. The LPF 31 is a filter that allows only a low component of the output signal of the light receiving unit 2 to pass. Inverting circuit 32
Is a circuit for inverting the output of the LPF 31. Comparator 3
Numeral 3 compares the output level of the inverting circuit 32 with a reference value, and outputs an H-level sleep signal if the input signal is equal to or greater than the reference value. As described above, the sleep determining unit 3 determines that the viewer wearing the head-mounted display device is in a sleep state when the closing time of the pupil increases.

When the pupil is open, like the eye E1 in FIG. 1A, a part of the infrared beam is reflected on the surface of the cornea and is incident on the light receiving section 2. This infrared light is not detected by human eyes. Since the crystalline lens is substantially spherical, if the light receiving unit 2 is installed at a position where the incident angle and the reflection angle are equal, the reflected light from the cornea can be efficiently captured.

Now, as shown in a period T1 in FIG.
When the opening time of the pupil becomes short, that is, when the number of blinks increases, the light receiving level output from the light receiving unit 2 becomes L
Level. When the eye E2 closes as shown in FIG. 1B, the infrared beam hits the eyelid. Since the surface is skin tissue, most of the infrared beam is scattered on the surface. Therefore, the amount of light incident on the light receiving unit 2 is as shown in FIG.
Less than In this case, the period T2 in FIG.
As shown in (1), the light receiving level output from the light receiving unit 3 is continuously at the L level.

The output waveform of the LPF 31 is shown in FIG. 3B, and the output of the inverting circuit 32 is shown in FIG. Comparator 3
Reference numeral 3 compares the output of the inverting circuit 32 with the reference value, and outputs an H-level signal, that is, a sleep signal when the output of the inverting circuit 32 is larger than the reference value.

Embodiment 2 A head mounted display according to Embodiment 2 of the present invention will be described with reference to the drawings. FIG. 4 is an explanatory diagram showing a configuration of a main part of the head-mounted display device of the present embodiment. As in Embodiment 1, FIG.
In addition to the light emitting unit 1, the light receiving unit 2, and the sleep determining unit 3, an alarm unit 4
Is provided.

The alarm unit 4 outputs an alarm to a viewer when a sleep signal is output from the sleep determination unit 3.
For example, buzzer 4a, warning light 4b, or vibrator 4c
Composed of These buzzers 4a, warning lights 4
b, The vibrator 4c is small and lightweight, and can be attached to a head-mounted display device.

According to the above head-mounted display device, by detecting the closing time of the pupil, the slumber state of the viewer, and hence the sleep state, is detected, and the buzzer 4a sounds and the warning light 4b is turned on. Light up or vibrate the vibrator 4c. And even if an alarm is output, when the viewer does not gaze at the output screen, it is determined that the head-mounted display device is not actually used, and the power of the head-mounted display device is cut off. Is also good. In this case, the consumption of the battery in a substantially non-use state can be reduced.

(Embodiment 3) Next, a head mounted display according to Embodiment 3 of the present invention will be described with reference to FIG. In this embodiment, it is assumed that the head-mounted display device is a VRD. As described above, the VRD directly forms an image of light-modulated video light on a viewer's retina. For this reason, a scanner is required as an optical system for two-dimensionally forming an image on the retina located on the rear surface of the crystalline lens.

For this reason, the head-mounted display device according to the present embodiment comprises an image projection unit 11 and a first scanner 1 serving as a scanning unit.
2nd and 2nd scanner 13, light receiving part 14, sleep judgment part 1
5. It is configured to include the alarm unit 16. The image light projecting unit 11 emits a visible light beam whose luminance is modulated by an image signal. For example, when the output image is a color image, the image light projecting unit 11 has R, B, and G light emitting diodes, and R, B, and G light emitting diodes.
It is assumed that the G light beam is output on the same optical axis.

The scanner 12 scans the light beam in the horizontal direction of the retina, and the scanner 13 scans the light beam in the vertical direction of the retina. Such scanning is similar to the electron beam scanning method in the CRT. The irradiation time of the light beam applied to the photoreceptor cells is instantaneous when viewed from one frame time of the image. However, it appears as if one frame image was simultaneously formed on the retina due to the afterimage effect of the photoreceptor cells. The stimulus is transmitted to the cerebrum via the optic nerve.

Now, when the pupil is open like the eye E1 in FIG. 5A, a part of the light beam is reflected by the surface of the cornea,
The light enters the light receiving unit 14. Since the lens is almost spherical,
If the light receiving unit 14 is installed at a position where the incident angle and the reflection angle are equal, the reflected light from the cornea can be efficiently captured.

When the pupil is closed as in the case of the eye E2 in FIG. 5B, when the light beam hits the eyelid, most of the light beam is scattered on the surface because the surface is skin tissue.
Therefore, the amount of light incident on the light receiving unit 14 is smaller than that in the case of FIG. Further, in this case, since the light beam does not enter the retina via the crystalline lens, no image is displayed.

The sleep judging unit 15 judges whether the gaze has decreased or is normal based on the magnitude of the reflected light detected by the light receiving unit 14 and the lapse of time of the received light amount. If the eyesight decreases and the closing time of the pupil increases, the sleep determining unit 15 determines that the sleeping state. Then, a sleep signal is output to the alarm unit 16. If the eyesight continues and the pupil opening time is long, the sleep determining unit 15 determines that the sleep is normal. The operation of the alarm unit 16 is the same as that of the second embodiment, and the description is omitted here.

According to the head-mounted display device as described above, by detecting the closing time of the pupil using a light beam for forming an image on the retina, the viewer is in a slumber state, and thus a sleep state. Start can be detected. And even if an alarm is output, when the viewer does not gaze at the output screen, it is determined that the head-mounted display device is not actually used, and the power of the head-mounted display device is cut off. Is also good. In this way, the consumption of the battery in a substantially unused state can be reduced.

(Embodiment 4) Next, a head-mounted display device according to Embodiment 4 of the present invention will be described with reference to the drawings. Here, it is assumed that the head-mounted display device is VRD. FIG. 6 is a configuration diagram of a main part of the VRD according to the present embodiment. As in the third embodiment, a video light projecting unit 11, a first scanner 12 and a second scanner 13, which are scanning units, and a light receiving unit 14 , A sleep determination unit 15 is provided. Since these functions are the same as those shown in FIG. 5, their description will be omitted.

Here, the power control unit 21 is used instead of the alarm unit.
Is provided. When a sleep signal is given from the sleep judging unit 15, the power control unit 21 supplies the sleep light to the image projecting unit 11, the scanner 12, the scanner 13, the light receiving unit 14, and the sleep judging unit 15 so as to temporarily stop the operations. Turn off the power.

When the viewer slumbers, sleeps temporarily, and wakes up again, the head mounted display can be brought back into a display state by pressing a reset button (not shown).

According to the head-mounted display device as described above, by detecting the closing time of the pupil using a light beam for imaging an image on the retina, the viewer is in a slumber state, and thus sleep. Start can be detected. Then, when the viewer is in a sleep state, the power supply of the head mounted display is cut off. In this way, the consumption of the battery in a substantially non-use state can be reduced.

Embodiment 5 Next, a head-mounted display device according to Embodiment 5 of the present invention will be described with reference to the drawings. Here, it is assumed that the head-mounted display device is VRD. FIG. 7 is a configuration diagram of a main part of the VRD according to the present embodiment, and similarly to the second embodiment, a video light projecting unit 11, a first scanner 12, a second scanner 13, a light receiving unit 14, a sleep determining unit. 15 are provided. Since these functions are also the same as those shown in FIG. 5, their description will be omitted.

Here, the VRD control unit 2 is used instead of the alarm unit.
2 are provided. The VRD control unit 22 is a sleep determination unit 1
When a sleep signal is given from 5, the light beam of the image light projecting section 11 is made to blink independently of the image signal, and pulse light is given to the pupil via the scanner 12 and the scanner 13. At this time,
The blinking cycle of the image projection unit 11 is synchronized with the scanning cycle of the scanner 12 and the scanner 13, and pulse light is given to a specific portion of the pupil.

As a result, as shown in FIG. 7A, when the viewer tries to enter a slumber state even if the pupil is almost open, a high-luminance pulse light is input to a specific portion of the retina. It can give a stimulating warning.
Also, as shown in FIG. 7B, even if the pupil is closed,
Since high-intensity pulsed light is input from above the eyelid, a part of the light passes through skin tissue including the capillaries of the eyelid. Accordingly, red pulse light is also input to the retina.

With this control, when the viewer becomes dormant and temporarily enters a sleep state, the stimulating light is automatically given to the viewer's eyes, and the viewer can be alerted. .

[0037]

According to the first aspect of the present invention, when the viewer is wearing the head-mounted display device, it is possible to detect whether the eyelid is in the sleeping state or the gaze state from the open / closed state of the eyelids.

According to the second aspect of the present invention, VRD
In the state where the viewer of the system is wearing the head-mounted display device, it is possible to detect whether the eyelid is in the sleeping state or the gaze state from the open / closed state of the eyelids by using the output light of the image light source.

According to the third aspect of the present invention, when the viewer is wearing the head-mounted display device, it detects whether the user is in a sleep state or a gazing state. An alert can be given to the viewer. For this reason, prevention of dozing can be realized.

According to the fourth aspect of the present invention, VRD
In the state where the viewer of the system is wearing the head mounted display device, it is possible to detect whether the eye is in the sleeping state or the gaze state from the open / closed state of the eyelids by using the output light of the image light source.
Then, if it is in the sleep state, the power supply control unit cuts off the power to the image projection unit, the scanning unit, and the sleep determination unit. In this way, the consumption of the battery when not in use can be prevented, and the usable time can be extended.

According to the fifth aspect of the present invention, VRD
In the state where the viewer of the system is wearing the head mounted display device, it is possible to detect whether the eye is in the sleeping state or the gaze state from the open / closed state of the eyelids by using the output light of the image light source.
In the sleep state, the VRD control unit can give a warning to the viewer by blinking the image projection unit and concentrating the scanning position of the light beam of the scanning unit in a specific range. . For this reason, prevention of dozing can be realized.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a head-mounted display device according to a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a sleep determination unit in the head-mounted display device according to the first embodiment.

FIG. 3 is a waveform diagram illustrating an operation of a sleep determining unit according to the first embodiment.

FIG. 4 is a configuration diagram of a head-mounted display device according to a second embodiment of the present invention.

FIG. 5 is a configuration diagram of a head-mounted display device according to a third embodiment of the present invention.

FIG. 6 is a configuration diagram of a head-mounted display device according to a fourth embodiment of the present invention.

FIG. 7 is a configuration diagram of a head-mounted display device according to a fifth embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 light emitting unit 2, 14 light receiving unit 3, 15 sleep determining unit 4, 16 alarm unit 4 a buzzer 4 b warning light 4 c vibrator 11 video light emitting unit 12, 13 scanner (scanning unit) 21 power supply control unit 22 VRD control unit 31 LPF 32 inverting circuit 33 comparator

────────────────────────────────────────────────── ─── front page continued (51) Int.Cl. ⁶ identifications FI G09G 3/20 611 G09G 3/20 612G 612 680A 680 H04N 5/64 511A H04N 5/64 511 A61B 3/10 Z

Claims (5)

[Claims] 1. A light projecting unit for irradiating an invisible light beam to a viewer's eye, and detecting a reflected light when a light beam emitted from the light projecting unit is reflected through a viewer's cornea. A head-mounted display device comprising: a light receiving unit that performs a sleep operation; and a sleep determination unit that determines whether a viewer's eye is in a sleeping state or a gaze state based on a light receiving level of the light receiving unit. 2. An image projection unit for outputting a visible light beam whose luminance has been modulated by an image signal, and a light beam emitted from the image projection unit is two-dimensionally scanned and applied to a retina of a viewer's eye. A scanning unit that provides scanning light, a light receiving unit that detects the reflected light when a light beam emitted from the video light projecting unit is reflected through a viewer's cornea, and based on a light receiving level of the light receiving unit. A head-mounted display device comprising: a sleep determination unit that determines whether the viewer is in a sleep state or in a gaze state. 3. The head mounted device according to claim 1, further comprising an alarm unit that outputs a sleep alarm to a viewer when the sleep determination unit determines that the user is in a sleep state. Type display device. 4. An image projection unit for outputting a visible light beam luminance-modulated by an image signal, and two-dimensionally scanning a light beam emitted from the image projection unit to a viewer's eye retina. A scanning unit that provides scanning light, a light receiving unit that detects the reflected light when a light beam emitted from the video light projecting unit is reflected through a viewer's cornea, and based on a light receiving level of the light receiving unit. A sleep determination unit that determines whether the viewer is in a sleep state or a gaze state; and when the sleep determination unit determines that the user is in a sleep state, power is supplied to the video light projection unit, the scanning unit, and the sleep determination unit. And a power supply control unit for shutting off the power. 5. An image projection unit for outputting a visible light beam luminance-modulated by an image signal, and a two-dimensional scanning of a light beam emitted from the image projection unit to a viewer's eye retina. A scanning unit that provides scanning light, a light receiving unit that detects the reflected light when a light beam emitted from the video light projecting unit is reflected through a viewer's cornea, and based on a light receiving level of the light receiving unit. A sleep determining unit that determines whether the viewer is in a sleep state or a gazing state; and when the sleep determining unit determines that the sleeping state, the image projection unit is turned on and off, and the light beam of the scanning unit. A head-mounted display device, comprising: a VRD control unit for concentrating the scanning position on a specific range.