JP2003076353A - Head-mounted display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a head-mounted display which does not damage the health of a user when being continuously used by the user for a long time. SOLUTION: A head-mounted display 100 includes a display part 150 for picture display, an optical part which allows the user to visually detect the picture displayed on the display part 150, a detection part 160 which detects whether the user puts on the head-mounted display 100 or not, a timer which measures the time when the detection part 160 detects that the user puts on the head-mounted display 100 and the picture is displayed on the display part 150, and a control part 130 which changes the visually detected picture so as to suppress the fatigue of the user's eyes.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head mount type display device which is attached to a part of a body such as a head of a user and allows an image to be visually sensed by the user. The present invention relates to a display device that prevents the deterioration of vision.

[0002]

2. Description of the Related Art Conventionally, a head-mounted display has been used as a display device that is mounted on a part of the body such as the head of a user and displays an image supplied from outside while the user is wearing it so that the user can observe it. There is a device.

This head mounted display device converts an image signal supplied from an external device, such as a TV tuner, an image reproducing device, a computer, into an RGB signal,
The RGB signals are supplied to the display system for the left eye and the display system for the right eye. Each display system captures a virtual image with an image display element and a backlight, and allows the user's vision to detect an image based on RGB signals.

Such a head mounted display device is
Since the image is supplied to the user while being worn on the user's head or the like, the user cannot visually detect anything other than the supplied image. Therefore, when such a head mounted display device is continuously used for a long time, the user may have eye fatigue. It is necessary to sufficiently caution the user when using such a device for a long time. JP-A-2000-23516
Japanese Patent Publication No. 3 discloses a head-mounted display device that prevents a user's health from being adversely affected by long-term use.

The head-mounted display device disclosed in this publication has an image display circuit for displaying an image, an optical section for guiding the displayed image to the left and right eyes of a user, and an image display time for the image display circuit. A measurement circuit for measuring
A determination circuit that determines whether or not the display time has reached a predetermined set time, and controls to display an image on the image display circuit, and the determination circuit determines that the continuous display time has reached the set time. And a control circuit that controls the image display circuit to display the warning information.

According to this apparatus, a preset time is set in advance so that the user's health is not adversely affected by continuous use for a long time, and the user is using the apparatus after the preset time is exceeded. And warning information is displayed. When the warning information is displayed, the user finishes using the device. As a result, it is possible to prevent adverse effects on the user's health due to eye strain.

[0007]

However, in the head-mounted display device disclosed in this publication, if the user ignores the alarm and continues to use the device, the user's health is impaired. The present invention has been made in order to solve the above-mentioned problems, and an object of the present invention is to provide a head-mounted display device that does not damage the health of the user even if it is continuously used for a long time.

[0008]

A head-mounted display device according to a first aspect of the present invention includes a display section for displaying an image, an optical section for visually detecting the image displayed by the display section, and an image display section for displaying the image. The display unit is connected to the measuring unit for measuring the display time, the display unit, and the measuring unit, and the display unit is configured to change the visually sensed image according to the passage of the display time measured by the measuring unit. And control means for controlling the.

According to the first invention, for example, a computer or a DVD connected to the head mounted display device.
(Digital Versatile Disc) An image is displayed on a display unit including a liquid crystal element and a backlight based on an image signal from a reproducing apparatus. The image displayed on the display unit is visually detected by the user through an optical unit including a half mirror, a concave mirror, and a plurality of lenses. When the display is started, the measuring means measures the display time, and the control means changes the image according to the lapse of the display time. In such a head-mounted display device, an image is displayed in the entire field of view, so that the user always sees the image displayed on the display unit, and the user's eyes become very tired as the image display time elapses. . The control means, for example, lower the contrast of the image or increase the brightness so as to prevent the tiredness or make it easy to see even when tired. This can reduce eye strain of the user. As a result, it is possible to provide a head-mounted display device in which the user's health is less likely to be damaged even if it is continuously used for a long time.

A head mounted display device according to a second invention includes, in addition to the configuration of the first invention. It further includes a detection unit that is connected to the measurement unit and that detects a state in which the head mounted display device is worn by a person. The measuring means includes means for measuring the display time of the image only when the detecting means detects the state in which the head mounted display device is worn by a person.

According to the second invention, the detecting means measures the display time only when the head mounted display device is mounted on the user's body. Thereby, the time when the user is actually looking at the image displayed on the display unit can be measured.

In the head-mounted display device according to the third aspect of the invention, in addition to the configuration of the first or second aspect of the invention, the control means is an image visually sensed so as to suppress human visual fatigue. And means for changing the.

According to the third aspect of the invention, the image is changed by, for example, decreasing the contrast of the image or increasing the brightness so as to suppress the visual fatigue of the user in response to the passage of the display time. .

In the head-mounted display device according to a fourth aspect of the present invention, in addition to the configuration of the first or second aspect of the invention, the control means is means for changing the difference in brightness between images and the brightness of the entire image. including.

According to the fourth aspect of the invention, the difference (contrast) between light and dark in the image is changed (lowered), and the brightness (brightness) of the entire image is changed (raised) to change the image.

In the head mounted display device according to the fifth aspect of the invention, in addition to the configuration of the first or second aspect of the invention, the control means includes means for changing the hue of the image.

According to the fifth aspect of the invention, the image is changed by changing the color tone (for example, strengthening the green color component which causes less visual stimulus).

In the head-mounted display device according to the sixth invention, in addition to the configuration of the first or second invention, the display section includes a liquid crystal element for displaying an image and a backlight for illuminating the liquid crystal element. . The control unit includes means for changing the brightness of the backlight.

According to the sixth aspect, the brightness of the image is changed by changing the brightness of the backlight that illuminates the liquid crystal element (for example, lowering the brightness of the light source).

In addition to the configuration of the first or second aspect of the invention, the head mounted display device according to the seventh aspect of the present invention includes an image pickup means for picking up an image of a human eye and an image pickup means connected to the image pickup means. Based on the imaged image, a detection unit for detecting an eye fatigue state, a measuring unit connected to the measurement unit and the detection unit, and a display time by the measurement unit based on the eye fatigue state detected by the detection unit. Measurement control means for controlling the measurement means so as to change the speed of measurement of.

According to the seventh invention, the detecting means detects the eye fatigue state based on the image of the user's eye imaged by the image pickup means (for example, change in the number of blinks per unit time with time). To do. When it is detected that the eyes are tired, the measurement control means controls the measurement means so that the measurement speed of the display time by the measurement means is measured faster than the speed at which the actual time elapses. To do.
As a result, when the eyes get tired, the display time is measured several times as long as the actual display time (for example, the display time is measured as 2 minutes even if the actual time is 1 minute). As a result, when the eyes get tired, the display time is measured faster and the display time elapses faster. The control means can change the image corresponding to the elapsed display time faster than the actual elapsed time, and can suppress eye strain.

In the head-mounted display device according to the eighth invention, in addition to the configuration of the seventh invention, the detection means includes the number of blinks per unit time and the number of blinks per unit time at the start of display. And means for detecting an eye fatigue condition by comparing and.

According to the eighth invention, when the eyes get tired,
Since the number of blinks is generally large, the eye fatigue state can be detected by the change in the number of blinks per unit time (for example, 1 minute) with time.

In the head mounted display device according to the ninth invention, in addition to the configuration of the seventh invention, the detection means compares the area of the eyelid of the eye with the area of the eyelid of the eye at the time of starting display. Accordingly, it includes means for detecting an eye fatigue state.

According to the ninth invention, when the eyes get tired,
Since it is common to narrow the eye, the fatigue state of the eye can be detected by the change in the area of the eyelid with time.

In the head mounted display device according to the tenth invention, in addition to the configuration of the seventh invention, the measurement control means is
When the detection means detects that the eyes are tired, a means for controlling the measurement means is provided so that the speed of measurement of the display time by the measurement means is measured faster than the speed at which time actually elapses. Including.

According to the tenth aspect, when the eyes are tired, the display time is measured more quickly, and the display time elapses faster. The control means can change the image corresponding to the elapsed display time faster than the actual elapsed time, and can suppress eye strain.

[0028]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment> Referring to FIG. 1, a head-mounted display device 100 according to the present embodiment is
The frame 170 includes left and right ear contact portions 174 and 176 extending from the left and right sides of the frame 170 to the rear, and a head band 178.
The image output from is visually detected.

The frame 170 is provided with a nose contact portion 172 at the lower center thereof. The frame 170 of the head-mounted display device 100 is provided with left and right display units 150 corresponding to the positions of the left and right eyes. Each of the display units 150 includes a two-dimensional image display element (liquid crystal element) that displays an image and a backlight that illuminates the liquid crystal element. The display unit 150 includes an optical unit including a half mirror, a concave mirror, and a plurality of lenses for visually detecting an image output to the liquid crystal element. The liquid crystal element, the backlight, and the optical unit included in the display unit 150 allow the user to visually detect the image.

A mounting detection sensor 162 is provided on each of the nose contact portion 172 and the left and right ear contact portions 174, 176 of the frame 170. When the head mounted display device 100 is mounted on the user's head, all of the three mounting detection sensors 162 detect the ON state.

A control block of the head mounted display device 100 shown in FIG. 1 will be described with reference to FIG.
As shown in FIG. 2, a head mounted display device 100
Is an operation unit 110 for a user to turn on the power of the head-mounted display device 100 and input settings of a display image, and a storage unit 1 for storing various setting data.
20, a control unit 130 that controls each unit of the head mounted display device 100, and a connection device 200,
An image pickup control unit 140 that receives an image signal from a connected device 200 such as a DVD reproducing device or a computer, and a display unit
0 and the detection unit 160 are included. These operation units 110,
The storage unit 120, the control unit 130, the imaging control unit 140, the display unit 150, and the detection unit 160 are internally connected by a bus and can transmit and receive data to and from each other.

The control unit 130 includes a timer for measuring time. This timer is based on information detected by the control unit 130 (information that the three mounting detection sensors 162 of the detection unit 160 are on and the image signal is output from the imaging control unit 140 to the display unit 150). The usage time of the head mounted display device 100 is measured.

The image pickup control section 140 converts the image signal from the connection device 200 into a signal that can be displayed by the two-dimensional image display element 152, or creates a drive signal. The imaging control unit 140 can adjust the contrast, brightness, and hue of the image displayed on the two-dimensional image display element 152 based on the control signal from the control unit 130.

The display section 150 has a two-dimensional image display element (liquid crystal element) 152 for displaying an image and a back light for illuminating the liquid crystal element 152, based on the image signal, the drive signal and the control signal from the image pickup control section 140. Light source part 15
6 and a light source controller 154 that controls the light amount of the light source. The light source control unit 154 can adjust the light amount of the light source unit 156 based on the control signal from the control unit 130. If the two-dimensional image display element is a self-luminous element,
The backlight is not necessary, and the degree of self-luminous control of the two-dimensional image display element 152 itself is controlled based on the control signal from the control unit 130.

The detection section 160 includes a nose contact section 172 and mounting detection sensors 162 provided at the left and right ear contact sections 174 and 176, respectively. The mounting detection sensor 162 is, for example, a contact-type piezoelectric sensor, and when the head-mounted display device 100 contacts the nose or the ear, detects the pressure and sends a signal indicating the ON state to the control unit 130. .

With reference to FIG. 3, the temporal change of the contrast multiplication coefficient stored in the storage unit 120 will be described. The meaning of the multiplication coefficient will be described later. As shown in FIG. 3, the multiplication coefficient is set to decrease with the lapse of usage time. As a result, eye strain increases with the passage of time, and the contrast becomes tighter, so you can lower the contrast and prevent an increase in eye strain, or make it easier to see even with eye strain. can do. As shown in FIG. 3, for example, the multiplication coefficient of the contrast is determined by the head mounted display device 10.
It is represented by a linear function of "1.2" at the start of use of 0 and "0.8" at the end of a preset use time. This numerical value is set by the user. Note that the function need not be a linear function, and may be a non-linear function as described later.

With reference to FIG. 4, the temporal change of the brightness addition coefficient stored in the storage unit 120 will be described. The meaning of the addition coefficient will be described later. As shown in FIG. 4, the addition coefficient is set to increase with the lapse of usage time. As a result, eye strain increases with the passage of time, and dark areas become difficult to see, so brightness is increased to prevent an increase in eye strain, or to make it easier to see even with eye strain. be able to. As shown in FIG. 4, for example, the contrast addition coefficient is represented by a linear function which is “0” at the start of use of the head mounted display device 100 and “10” at the end of a preset use time. This numerical value is set by the user. Note that the function need not be a linear function, and may be a non-linear function as described later.

The changes over time in the coefficients shown in FIGS. 3 and 4 are shown in FIG. 3 and FIG.
Calculated based on UT (Look Up Table). Each of the calculated coefficients is substituted into the following equation and transmitted from the control unit 130 to the imaging control unit 140 to correct the image signal from the connection device 200 and display it on the display unit 150. In the following description, the case where the image data is represented in the YCrCb data format will be described, but the RGB data format or another data format may be used.

When correcting the Y value in the YCrCb data format, the input signal from the connection device 200 is set to Yin (0 to 0).
255) and the output signal to the display unit 150 is Yout.
(0 to 255), Yout = Yin × C (ti)
It is calculated by + B (ti). However, C (ti) is the contrast multiplication coefficient (0 to 2) at the time of use ti,
B (ti) is a brightness addition coefficient (-256 to 255) at the use time ti. Note that this equation is for a case where the resolution is 8 bits. After that, RGB conversion is performed and the image is transmitted from the imaging control unit 140 to the display unit 150.
An image is displayed on the display unit 150 with a predetermined contrast and brightness.

With reference to FIG. 5, the temporal change of the luminance stored in the storage unit 120 will be described. As shown in FIG. 5, the brightness is set to decrease with the lapse of usage time. As a result, asthe eyestrain increases with the passage of time, and the eye becomes more sensitive to glare, the brightness of the light source unit 156 is reduced to prevent an increase in eyestrain, or to reduce eyestrain. Even if there is, you can make it easier to see. As shown in FIG. 5, for example, the brightness is
When the head-mounted display device 100 is used, “10
0% "and" 80% "at the end of the preset use time.
% "Is represented by a linear function. This numerical value is set by the user. Note that the function need not be a linear function, and may be a non-linear function as described later.

With reference to FIG. 6, the temporal change in the saturation of the image stored in the storage unit 120 will be described. A correction value for this saturation is calculated by a non-linear function. Note that the above-mentioned contrast, brightness, and brightness can also be corrected by a non-linear function as described below. FIG. 6 shows a function representing the corrected output value with respect to the input value. A curve ts is a correction function at the start of use of the head mounted display device 100, and a curve te is a correction function at the end of a preset use time. A plurality of these functions are prepared in advance and selected by the user. The corrected output value can be calculated by linearly complementing the values obtained from these two curves with respect to the input value. This linear interpolation is performed by correcting the saturation output value = correction output value on the curve ts for the input saturation value + {(correction output value on the curve ts for the input saturation value−correction on the curve te for the input saturation value Output value) × (elapsed usage time / total usage time)}. The number of curves to be linearly complemented is not limited to two, and may be three.

Since the curve ts is above the curve te, the corrected and output saturation is set so as to decrease with the lapse of usage time. This allows
As eye strain increases with the passage of time, it becomes sensitive to vividness, so reduce saturation to prevent increase in eye strain or make it easier to see even with eye strain. You can

With reference to FIG. 7, the overall process executed by the head mounted display device 100 according to the present embodiment is as follows.
It has the following control structure.

Step (hereinafter, step is abbreviated as S)
At 100, control unit 130 determines whether or not power of head mounted display device 100 is turned on. When the power is turned on (YES in S100), the process proceeds to S102.
Is moved to. If not (NO in S100),
The process returns to S100 and waits until the power is turned on.

At S102, control unit 130 determines whether or not the state in which head mounted display device 100 is mounted on the user is detected. This determination is made based on whether or not all the three mounting detection sensors 162 of the detection unit 160 are in the ON state. Head mounted display device 1
When 00 detects the state of being worn by the user (S1
(YES in 02), the process proceeds to S104. If not (NO in S102), the process returns to S102 and waits until the head mounted display device 100 detects a state in which the user mounts it.

At S104, control unit 130 determines whether or not there is an image display signal. This determination is made based on whether or not an image signal for displaying an image, a drive signal, a control signal, and the like are transmitted from the imaging control unit 140 to the display unit 150. When there is an image display signal (S104
YES), the process proceeds to S106. If not (NO in S104), the process is returned to S102, and it is determined again whether or not the head-mounted display device 100 is worn by the user and whether or not there is an image display signal. It In S 106, control unit 130 measures the usage time using the timer built in control unit 130. In S108, control unit 130 performs a display quality changing process. Details of this display quality changing process will be described later.

At S110, control unit 130 determines whether or not the measurement time has expired. This determination is made based on whether or not the measurement end time preset by the user has elapsed. When the measurement time ends (YES in S110)
S), the entire process ends. If not (S
(NO in 110), the process is returned to S102, the head mounted display device 100 is mounted on the user, the usage time is measured when there is an image display signal, and the display quality is changed according to the measured usage time. Repeat.

Referring to FIG. 8, the display quality changing process of FIG. 7 has the following control structure.

At S200, control unit 130 reads the contrast multiplication coefficient from storage unit 120 based on the usage time. At this time, the contrast multiplication coefficient read from the storage unit 120 is a coefficient determined by the linear function shown in FIG.

At S202, control unit 130 reads the brightness addition coefficient from storage unit 120 based on the usage time. The brightness addition coefficient read at this time is
It is a value determined by the linear function shown in FIG.

At S204, control unit 130 calculates Yout based on the read contrast multiplication coefficient and brightness addition coefficient.

At S206, control unit 130 reads the brightness ratio from storage unit 120 based on the usage time. The brightness ratio read at this time is a ratio determined by the linear function shown in FIG.

At S208, control unit 130 calculates the saturation ratio based on the usage time. The saturation ratio calculated at this time is a non-linear function (curves ts, te) shown in FIG.
It is determined by the linear interpolation of.

At S210, control unit 130 returns to You.
The imaging control unit 140 is instructed to display an image on the two-dimensional image display element 152 using t, the luminance ratio, and the saturation ratio.

The operation of the head mounted display device 100 based on the above structure and flowchart will be described.

The user of the head-mounted display device 100 is required to use the head-mounted display device 100 before using the head-mounted display device 100.
Various settings are made according to the display examples of the display unit 150 shown in FIGS.

The user of the head-mounted display device 100 sets the measurement end time to, for example, 3 hours and 20 minutes by using the measurement end time setting screen as shown in FIG. 9, and presses the setting end key. In this head-mounted display device 100, in order to enable the function of changing the display quality according to the usage time, the user sets the function to be effective.

The user sets the contrast start value and end value, the brightness start value and end value, and the brightness start value and end value, respectively, using the contrast, brightness, and brightness setting screen as shown in FIG. . For example, the user sets the start contrast to "1.
2 ", end contrast" 0.8 ", start brightness" 0 ", end brightness" 10 ", start brightness" 100% ", end brightness" 80% ".

The user sets the LUT using the LUT setting screen as shown in FIG. This LUT setting is
As described above, at least two non-linear functions for correcting the saturation of the image are selected. For example, the non-linear function “2” is set as the LUT at the start and the non-linear function “3” is set as the LUT at the end.

When the initial setting by the user is completed in this way, the user can move the head mounted display device 100.
Is attached to its own head, and the connected device 200 is instructed to display an image on the head mounted display device 100. The head mounted display device 100 includes the display unit 1 based on the image display signal transmitted from the connection device 200.
The image is displayed on 50.

The head-mounted display device 100 detects the mounting state (YES in S102), determines that there is an image display signal (YES in S104), and measures the usage time (S106). At this time, the user temporarily removes the head-mounted display device 100 or the connected device 200.
If the image signal from is interrupted, the measurement of the usage time is temporarily stopped. As a result, the usage time is measured only when the user is viewing the image using the head mounted display device 100. The display quality is changed while the usage time is measured.

The storage unit 1 is based on the measured usage time.
The contrast multiplication coefficient is read from 20 (S20
0), the brightness addition coefficient is read from the storage unit 120 based on the usage time (S202), and Yout is calculated based on the read contrast multiplication coefficient and the brightness addition coefficient (S204). The brightness ratio is read from the storage unit 120 based on the usage time (S20).
6), the saturation ratio is calculated based on the usage time (S
208).

At S210, the image using the calculated Yout, the luminance ratio and the saturation ratio is displayed on the display unit 150 of the head mounted display device 100 on the two-dimensional image display element 152 (S210). .

As described above, the head-mounted display device according to this embodiment measures the time when the user wears the head-mounted display device and looks at the image as the usage time. As the usage time increases, the display unit is controlled so that the contrast, the brightness, the brightness of the backlight, and the saturation in the color are adjusted and output. As a result, for example, when the user's eye strain increases with the increase in usage time, the contrast is lowered,
To prevent eye strain by increasing the brightness, reducing the brightness of the backlight, and decreasing the saturation.
Alternatively, it is possible to make the image easy to see even if there is eye strain. As a result, it is possible to realize a head-mounted display device that does not impair the user's health even if it is continuously used for a long time.

<Second Embodiment> The second embodiment of the present invention will be described below.
Head mounted display device 1000 according to the embodiment
Will be described. The detection unit 1600 of the head-mounted display device 1000 according to the present embodiment has the appearance of an eyeball in addition to the mounting detection unit 162 of the detection unit 160 of the head-mounted display device 100 according to the first embodiment described above. It further includes an eyeball image pickup unit 164 that picks up an image. The head-mounted display device 1000 according to the present embodiment detects the fatigue state of the user's eye based on the appearance of the eyeball imaged by the eyeball imaging unit 164, and reflects the fatigue state in the measurement time. , Measure the usage time. The head mounted display device 1000 corresponds to the measured usage time,
Change the image contrast, brightness, and hue.

Therefore, in the head mounted display device 1000 according to the present embodiment and the head mounted display device 100 according to the above-described first embodiment, the structure and flow chart of the detection unit represented by the control block. The structure of processing in the control unit 130 represented by is different. For other structures and flow charts,
This is the same as the first embodiment described above. Therefore, detailed description thereof will not be repeated.

Control unit 130 includes a timer for measuring time. This timer operates according to the information detected by the control unit 130 (the three mounting detection sensors 162 of the detection unit 1600 are on, and the image signal from the imaging control unit 140 is displayed on the display unit 1).
The usage time is measured based on the information output to 50). Furthermore, this timer can speed up or slow down the time measured based on the internal control signal of the control unit 130. For example, the actual elapsed time is 2
If it is a minute, you can measure the usage time as late as 1 minute, 4
You can measure as quickly as a minute.

The detection unit 1600 includes a mounting detection sensor 162.
In addition to the above, an eyeball imaging unit 164 is further included. The eyeball image pickup unit 164 includes an infrared output unit 166 and an image pickup CCD element 16.
And 8 are connected. The infrared output unit 166 outputs infrared light to the eyeball of the user, and the imaging CCD element 168 detects the infrared light reflected from the eyeball and converts the external appearance state of the eyeball (FIG. 13) into digital data based on the detected infrared light. Convert. The appearance state of the eyeball imaged by the eyeball imaging unit 164 is transmitted to the control unit 130, and the control unit 130 detects the eye fatigue state.

The control unit 130 detects the eye fatigue state based on the digital data representing the appearance state of the eyeball received from the eyeball image pickup unit 164. Based on the appearance state of the eyeball imaged by the eyeball imaging unit 164 (based on the comparison of the captured images shown in FIGS. 14 and 15), the control unit 13
0 detects whether the eye is open or closed. Figure 1
As shown in FIG. 4 and FIG. 15, the feature amount is calculated from the values of the digital signals at three lateral positions to detect whether the eye is open or closed. The control unit 130 detects blinking based on the open / closed state of the eye and the opening / closing time. The control unit 130 controls the unit time (for example, 10
Calculate the number of blinks (per second). Control unit 130
Compares the number of blinks at the start of display and during display to detect the eye fatigue state. When the number of blinks is increased, it is determined that the eyes are tired, and when the number of blinks is decreased, it is determined that the eyes are not tired.

The control unit 130 detects eye fatigue based on the thinness of the user's eyes. As shown in FIG. 16, from the appearance state of the eyeballs shown in FIGS. 13 and 16 captured by the eyeball image capturing unit 164, the control unit 130 causes the eyelid 30
The area of 0 is detected. The control unit 130 calculates an average value of the areas of the eyelids 300 for a predetermined time. The control unit 130 displays the area of this eyelid at the start of display (FIG. 13).
And the state during display (FIG. 14) are compared to detect the eye fatigue state. It is judged that the eye is getting tired when the eye is narrowed (the area of the eyelid is increased), and the eye is not tired when the eye is not thinned (the area of the eyelid is decreased or unchanged).

The control unit 130 detects eye fatigue based on the size of the user's black eye. As shown in FIG. 17, from the appearance state of the eyeballs shown in FIGS. 13 and 17, which is imaged by the eyeball imaging unit 164, the control unit 130
Detect the area of iris. The control unit 130 calculates an average value of the areas of the black eyes for a predetermined time. Control unit 1
30 indicates the area of this black eye at the start of display (FIG. 13),
The state of eye fatigue is detected by comparison with that during display (FIG. 17). In particular, it is determined that the eye is tired when the area of the black eye is small, and it is determined that the eye is not tired when the area of the black eye is large.

Referring to FIG. 18, the overall processing executed by head mounted display device 1000 according to the present embodiment has the following control structure. In the flowchart shown in FIG. 18, the same steps as those in the flowchart shown in FIG. 7 are designated by the same step numbers.
The processing is the same. Therefore, detailed description thereof will not be repeated.

If the user mounts the head mounted display device 1000 and there is an image display signal, S300
At, control unit 130 performs eye strain detection processing. After this eye strain detection processing, in S106, the control unit 130
Measures the usage time. At this time, the measured usage time reflects the result of the eye strain detection process in S300. Thereafter, in S108, control unit 130 performs the display quality changing process, and these processes are repeatedly performed until the measurement time ends.

Referring to FIG. 19, the eye strain detection process of FIG. 18 has the following control structure.

At S302, control unit 130 detects the number of blinks, the eyelid area average value, and the black eye area average value from the image of the eyeball taken by eyeball image pickup unit 164. This detection is performed as described with reference to FIGS. The predetermined time is set to, for example, 10 seconds. In S304, control unit 130 determines whether to save the initial data. This determination is made based on whether or not the user saves the data for 10 seconds immediately after the head mounted display device 1000 is used as the initial data. Once saved, this initial data will not be saved until the measurement end time elapses, except for data storage failure (data storage failure includes abnormal data storage). . If the initial data is stored (YES in S304), the process proceeds to S306. If not (NO in S304), the process proceeds to S308.

At S306, control unit 130 causes storage unit 1
In 20, the initial blink count, the initial eyelid average area average value, and the initial iris area average value are stored. After that, this eye strain detection process ends, and the process returns to S106 of FIG.

At S308, control unit 130 determines whether or not the number of blinks has increased or decreased at a predetermined rate from the initial data value. If the number of blinks has increased from the initial data value by a predetermined ratio or more (increase in S308), the process proceeds to S316.
If the number of blinks has decreased from the initial data value by a predetermined ratio or more (decrease in S308), the process proceeds to S3.
Moved to 14. If the number of blinks does not increase or decrease by a predetermined ratio or more than the initial data value (S30
No in step 8), the process proceeds to S310.

At S310, control unit 130 determines whether the eyelid area average value has increased or decreased from the initial data value by a predetermined ratio or more. If the eyelid area average value has increased from the initial data value by a predetermined ratio or more (increase in S310), the process proceeds to S316. If the eyelid area average value is decreasing from the initial data value at a predetermined rate (decreasing in S310),
The process proceeds to S314. If the average value of the area of the eyelid lid does not increase or decrease by a predetermined ratio or more from the initial data value (NO in S310), the process proceeds to S312.

At S312, control unit 130 determines whether or not the average value of iris area has increased or decreased from the initial data value by a predetermined ratio or more. If the black eye area average value has increased from the initial data value by a predetermined ratio or more (increase in S312), the process proceeds to S314. If the black eye area average value has decreased from the initial data value by a predetermined ratio or more (decrease in S312), the process proceeds to S3.
Moved to 16. If the black eye average value does not increase or decrease by more than a predetermined ratio from the initial data value (NO in S312), the process proceeds to S315.

At S314, control unit 130 lowers the usage time count speed. For example, the timer inside the control unit 130 is instructed to count the actual 2 seconds into 1 second. After that, the process is returned to S106 of FIG.

At S315, control unit 130 sets the usage time count speed to the initial value. For example, the timer inside the control unit 130 is instructed to count the actual 1 second into 1 second. After that, the process is returned to S106 of FIG.

At S316, control unit 130 increases the usage time count speed. For example, the timer inside the control unit 130 is instructed to count the actual 1 second into 2 seconds. After that, the process is returned to S106 of FIG.

The operation of head-mounted display device 1000 according to the present embodiment based on the structure and flow charts described above will be described.

The user of the head mounted display device 1000 sets the eyeball change detection setting based on the display screen displayed on the display unit 150 before starting the use of the head mounted display device 1000. Based on the eyeball change detection setting screen as shown in FIG. 20, the user changes the count rate of the timer when the number of blinks increases or decreases, or changes the count rate of the timer when the eyelid area increases or decreases by%. Set how much the area of the black eye increases or decreases to change the count speed of the timer. For example, the user sets the measurement time of the timer to be double speed when the number of blinks decreases by 200% or more.

As a result, when the number of blinks reaches 200% compared to immediately after the start of display, the timer measures the usage time at double speed. As a result, the usage time is measured as if two minutes have elapsed although only one minute actually has elapsed. As a result, since the display quality is changed based on the measured usage time, when the eye fatigue progresses, the display quality of the image is changed so as to suppress eye strain further than the actual time elapsed. .

As described above, the head-mounted display device according to the present embodiment is not limited to merely the elapsed time of use of the head-mounted display device, but also the use time of the head-mounted display device according to the eye strain of the user. The display quality of the displayed image can be changed based on the measured usage time. As a result, it is possible to provide a head-mounted display device in which the user's health is less likely to be damaged even if it is continuously used for a long time.

<Second Embodiment: Modification> A modification of the second embodiment of the present invention will be described below. The head mounted display device 1000 according to this modification differs in the method of measuring the usage time by the timer after detecting the eye strain. The head-mounted display device 1000 according to the present modification has the above-described second embodiment and hardware configuration except for the function of the timer. Therefore, detailed description thereof will not be repeated.

Control unit 130 includes a timer for measuring time. This timer operates according to the information detected by the control unit 130 (when the three wearing detection sensors of the detection unit 160 are ON,
In addition, the usage time is measured based on the information that the image signal is output from the imaging control unit 140 to the display unit 150). At this time, based on the internal control signal of the control unit 130, the measurement can be started or stopped, or a time-up signal can be transmitted to the control unit 130 at a predetermined designated time (for example, 5 minutes). .

With reference to FIG. 21, the overall processing executed by the head mounted display device 1000 according to this modification is as follows.
It has the following control structure. In the flowchart shown in FIG. 21, the same steps as those in the above-described flowchart of FIG. 18 are designated by the same step numbers.
The processing for them is also the same. Therefore, detailed description thereof will not be repeated here.

At S400, control unit 130 causes the above-mentioned S
An eye strain detection process different from the eye strain detection process of 300 is performed. In S402, control unit 130 calculates the usage time by adding the designated time based on the result of the eye strain detection process. Then, the display quality changing process is performed based on the calculated usage time. Such processing is repeated until the measurement time ends.

Referring to FIG. 22, the eye fatigue detection process executed in S400 of FIG. 21 has the following control structure. In the flowchart shown in FIG. 22, the same steps as those in the flowchart shown in FIG. 19 are given the same step numbers. The processing for them is also the same. Therefore, detailed description thereof will not be repeated here.

At S402, control unit 130 determines whether or not the number of blinks has increased from the initial data value by a predetermined ratio or more. When the number of blinks increases from the initial data value by a predetermined ratio or more (YES in S402), the process proceeds to S408. If not (NO in S402), the process proceeds to S404.

At S404, control unit 130 determines whether the eyelid area average value has increased from the initial data value at a predetermined rate or more. If the average value of the eyelid area increases from the initial data value by a predetermined ratio or more (S
(YES in 404), and the process proceeds to S408. If not (NO in S404), the process proceeds to S406.

At S406, control unit 130 determines whether or not the average black-eyed area value has decreased from the initial data value by a predetermined ratio or more. If the average value of the iris area decreases from the initial data value by a predetermined rate or more (S
(YES in 406), and the process proceeds to S408. If not (NO in S406), this eye strain detection processing ends, and the processing is returned to S402 in FIG. 21 described above.

At S408, control unit 130 measures time. In S410, control unit 130 determines whether or not the designated time has elapsed. This designated time is set in advance by the user. For example, the designated time is set to 5 minutes. When the designated time has elapsed (YES in S410),
The processing is returned to S402 in FIG. If not (NO in S410), the process is returned to S302, and the number of blinks, the eyelid area average value, and the black eye area average value are compared again with the initial data value, and whether or not the time is measured by the timer is determined. Is judged.

The user of the head-mounted display device 1000 according to this modification is the head-mounted display device 100.
Before the use of 0 is started, the eyeball change detection setting is performed based on the display screen displayed on the display unit 150. FIG. 23
Based on the eyeball change detection setting screen as shown in, the user measures the time with a timer until the specified time is reached when the number of blinks increases, or the user waits until the specified time when the eyelid area increases by more than%. Set whether to measure the time by, or when the area of the black eye decreases by less than or equal to%, the timer measures the time between the designated times.

According to the head mounted display device of this modification, the eye strain of the user is detected based on the changes in the number of blinks, the average value of the eyelid area and the average value of the iris area, and the eye strain is detected. Only if timed. When that time has passed the designated time, a process of changing the display quality is performed. Therefore, not only when eye fatigue is detected continuously, even when eye fatigue is detected intermittently without continuity, the eye fatigue is detected and the display quality is changed. Can be reflected.

The process shown in FIG. 24 may be performed instead of the process shown in FIG. 19 shown in the second embodiment.

At S308, control unit 130 determines whether the number of blinks has increased or decreased at a predetermined rate from the initial data value. If the number of blinks has increased from the initial data value by a predetermined ratio or more (increase in S308), the process proceeds to S316.
If the number of blinks has decreased from the initial data value by a predetermined ratio or more (decrease in S308), the process proceeds to S3.
Moved to 17. If the number of blinks does not increase or decrease by a predetermined ratio or more than the initial data value (S30
No in step 8), the process proceeds to S310.

At S310, control unit 130 determines whether the eyelid area average value has increased or decreased from the initial data value by a predetermined ratio or more. If the eyelid area average value has increased from the initial data value by a predetermined ratio or more (increase in S310), the process proceeds to S316. If the eyelid area average value is decreasing from the initial data value at a predetermined rate (decreasing in S310),
The process proceeds to S317. If the average value of the area of the eyelid lid does not increase or decrease by a predetermined ratio or more from the initial data value (NO in S310), the process proceeds to S312.

At S312, control unit 130 determines whether or not the average value of iris area has increased or decreased from the initial data value by a predetermined ratio or more. If the black eye area average value has increased from the initial data value by a predetermined ratio or more (increase in S312), the process proceeds to S317. If the black eye area average value has decreased from the initial data value by a predetermined ratio or more (decrease in S312), the process proceeds to S3.
Moved to 16. If the black eye average value does not increase or decrease by more than a predetermined ratio from the initial data value (NO in S312), the process returns to S106 in FIG. At this time, it is possible not to count the usage time.

At S316, control unit 130 increases the usage time count speed. For example, the timer inside the control unit 130 is instructed to count the actual 1 second into 2 seconds. After that, the process is returned to S106 of FIG.

At S317, control unit 130 restores the use time count speed. For example, the timer inside the control unit 130 is instructed to subtract 1 second from the count speed at which the actual 2 seconds is currently counted in 1 second. After that, the process is returned to S106 of FIG.

In this way, after the eyes are tired once and the counting speed is increased, when the eyestrain is recovered due to a break or the like, the counting speed can be restored and the usage time can be measured.

The embodiments disclosed this time are to be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

[Brief description of drawings]

FIG. 1 is an external view of a head mounted display device according to a first embodiment of the present invention.

FIG. 2 is a control block diagram of the head mounted display device shown in FIG.

FIG. 3 is a diagram showing a temporal change of a contrast multiplication coefficient stored in a storage unit.

FIG. 4 is a diagram showing a temporal change of a brightness addition coefficient stored in a storage unit.

FIG. 5 is a diagram showing a temporal change in luminance stored in a storage unit.

FIG. 6 is a diagram showing a relationship between an input value and a corrected output value stored in a storage unit.

FIG. 7 is a flowchart showing a control structure of overall processing executed in the head mounted display device according to the first embodiment of the invention.

FIG. 8 is a flowchart showing a control structure of a display quality changing process executed in the head mounted display device according to the first embodiment of the invention.

FIG. 9 is a diagram showing a display example (No. 1) displayed on the head mounted display device according to the first embodiment of the invention.

FIG. 10 is a display example (No. 2) displayed on the head mounted display device according to the first embodiment of the invention.
FIG.

FIG. 11 is a display example (part 3) displayed on the head-mounted display device according to the first embodiment of the invention.
FIG.

FIG. 12 is a control block diagram of a head mounted display device according to a second embodiment of the invention.

13 is a diagram (No. 1) illustrating an image captured by the eyeball imaging unit illustrated in FIG.

FIG. 14 is a diagram (part 1) showing image pickup data obtained by the eyeball image pickup section.

FIG. 15 is a diagram (No. 2) showing image pickup data by the eyeball image pickup unit.

16 is a diagram (No. 2) showing an image captured by the eyeball imaging unit shown in FIG.

FIG. 17 is a diagram (No. 3) showing an image captured by the eyeball imaging unit shown in FIG. 12.

FIG. 18 is a flowchart showing a control structure of overall processing executed in the head mounted display device according to the second embodiment of the invention.

FIG. 19 is a flowchart showing a control structure of eye strain detection processing executed in the head mounted display device according to the second embodiment of the invention.

FIG. 20 is a display example (part 1) displayed on the head-mounted display device according to the second embodiment of the invention.
FIG.

FIG. 21 is a flowchart showing a control structure of a modified example of the overall processing executed in the head mounted display device according to the second embodiment of the invention.

FIG. 22 is a flowchart showing a control structure of a modified example of eye strain detection processing executed in the head mounted display device according to the second embodiment of the invention.

FIG. 23 is a display example (part 2) displayed on the head-mounted display device according to the second embodiment of the invention.
FIG.

FIG. 24 is a flowchart showing a control structure of a modified example of eye strain detection processing executed in the head mounted display device according to the second embodiment of the invention.

[Explanation of symbols]

100,1000 Head-mounted display device, 110
Operation unit, 120 Storage unit, 130 Control unit, 140
Imaging control unit, 150 display unit, 152 two-dimensional image display device, 154 light source control unit, 156 light source unit, 160,
1600 detection unit, 162 wearing detection sensor, 164
Eyeball imaging unit, 166 infrared output unit, 168 imaging CC
D element, 170 frame, 172 nose contact portion, 174, 1
76 ear contact part, 200 connected device, 210 display control part, 220 control part, 230 storage part.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G02F 1/13357 G06F 3/00 651A 5C082 G06F 3/00 651 G09G 3/20 642E 5E501 G09G 3/20 642 642J 680A 680 3/34 J 3/34 3/36 3/36 H04N 5/64 511A H04N 5/64 511 5/66 102Z 5/66 102 A61B 3/10 Z (72) Inventor Rui Sakuda Osaka Abeno, Osaka 22-22, Nagaike-cho, Chuap Co., Ltd. (72) Inventor Nozomu Shiotani 22-22, Nagaike-cho, Abeno-ku, Osaka-shi, Osaka Prefecture F-term (reference) in Sharp Co., Ltd. AA21 AB05 BF29 BF38 EA01 EC02 EC13 5C058 AA06 AB03 BA08 BA29 BA35 BB25 5C080 AA10 BB05 CC03 DD17 EE28 EE32 JJ02 JJ06 JJ07 KK43 5C082 AA01 AA02 AA27 BA12 BA34 BD02 CA11 CA81 CB01 MM08 5E501 AA30 AC37 BA16 CA01 EA33 FA50 FB21

Claims (10)

[Claims] 1. A display unit for displaying an image, an optical unit for visually detecting the image displayed by the display unit, a measuring unit for measuring a display time of the image, and the display unit. Control means connected to the measuring means and controlling the display unit so as to change the visually sensed image in response to the passage of the display time measured by the measuring means. Head-mounted display device including. 2. The head mounted display device further includes detection means connected to the measurement means for detecting a state in which the head mounted display device is worn by a person, and the measurement means comprises: A means for measuring the display time of the image is included only when the detection means detects the state in which the head mounted display device is worn by a person,
The head-mounted display device according to claim 1. 3. The head-mounted display according to claim 1, wherein the control means includes means for changing an image detected by the eyes so as to suppress fatigue of the eyesight of the person. apparatus. 4. The head mounted display device according to claim 1, wherein the control unit includes a unit for changing a difference in brightness between the image and the brightness of the entire image. 5. The head-mounted display device according to claim 1, wherein the control unit includes a unit for changing a hue in the image. 6. The display unit includes a liquid crystal element that displays the image, and a backlight that illuminates the liquid crystal element, and the control unit includes means for changing the brightness of the backlight. The head-mounted display device according to claim 1. 7. The head-mounted display device includes an image pickup unit for picking up an image of the human eye, and an eye fatigue state based on an image picked up by the image pickup unit, which is connected to the image pickup unit. Detecting means for detecting, and connected to the measuring means and the detecting means, based on the fatigue state of the eye detected by the detecting means, to change the speed of measurement of the display time by the measuring means The head mounted display device according to claim 1 or 2, further comprising a measurement control unit for controlling the measurement unit. 8. The detecting means includes means for detecting the eye fatigue state by comparing the number of blinks per unit time with the number of blinks per unit time at the start of display. The head-mounted display device according to claim 7. 9. The detecting means includes means for detecting the fatigued state of the eye by comparing the area of the eyelid of the eye with the area of the eyelid of the eye at the start of display. Item 7. The head-mounted display device according to item 7. 10. The measurement control means, when the detection means detects that the eye is fatigued, sets the measurement time of the display time by the measurement means to be faster than the speed at which the actual time elapses. The head mounted display device according to claim 7, further comprising means for controlling the measuring means so as to measure.