JPH08320454A - Image display device - Google Patents

Abstract

PURPOSE: To increase merits such as the reduction of eyestrain which is characteristic of an environmental video and enhance presence feeling, and also to grasp the circumferential situation at loading the device by providing a situation detecting means for detecting the situation of the image display device used by a display observer. CONSTITUTION: The light quantity changing device 35 is constituted of a deciding part 32 for comparing the luminance data of a liquid crystal display from a sensor 31 as the situation detecting means with the present light quantity 34 of a back light and deciding that the light quantity should be increased, or decreased, and a light controlling part 33 for controlling the light quantity of the back light for the environmental video at the request of the deciding part 32. The light quantity of the back light for the environmental video is decided by the deciding part 32 of the light quantity changing device 35 based on the transmitted data on the light quantity in such a way, then, the decision is transmitted to the light controlling part 33 by the part 32 so as to be reflected in the light quantity of the back light for the environmental video. Thus, the luminance difference between the environmental video and the liquid crystal display can be eliminated, so that the observer can enjoy watching the video with no eyestrain.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device, and more particularly, to a head mounted display (Head Mount) in which a liquid crystal display is magnified and used with a lens.
ted Display: hereinafter abbreviated as HMD).

For example, it is used for watching television and video, watching stereoscopic images, displaying virtual reality, monitor for video game, monitor for computer input, and the like.

[0003]

2. Description of the Related Art In recent years, with the miniaturization of liquid crystal displays, research on HMDs has become active. For example, FIG. 20 is a schematic configuration diagram of a conventional HMD.
Is a magnifying lens, 132 is a field stop, 133 is a liquid crystal display, and 134 is a backlight. These are housed in a case, and the viewer can watch the liquid crystal display magnified by the lens.

Further, the HMD has its peripheral portion covered with a black field stop so that only the effective display portion of the liquid crystal display can be seen. Therefore, from the viewer,
As shown in FIG. 21, the device was such that the screen seemed to float in the dark.

However, the following problems occur in viewing with the HMD as described above.

First, since the difference in brightness between the periphery and the center of the visual field of the display is large, eye fatigue occurs. Second,
Since the viewer's surroundings are completely invisible while wearing the HMD, the atmosphere of the surroundings as when looking at the screen in the room is lost.

Therefore, in order to solve the above-mentioned problem, for example, as shown in FIG. 22, a device for providing an environmental image on the periphery of a liquid crystal display so that the user can recognize the movie as if it is watching a movie on the screen in the room. There is. The HMD having this environmental image eliminates the difference in brightness between the display and the periphery of the display, reduces eye fatigue, and provides a clue for evaluating the size of the display.
There are merits that you can enjoy the atmosphere of the place where you watch the video and increase the sense of presence.

[0008]

However, even in the HMD having the above-described environment image, the environment image does not change, and thus the advantage of the environment image may be lost.

For example, since the brightness of the display is not always constant and changes in various ways, if the brightness of the environmental image does not change accordingly, a large brightness difference may occur between the display and the environmental image. Therefore, the merit of reducing eye fatigue is lost.

Further, if there is a brightness difference between the brightness of the room when the viewer wears and removes the HMD and the visual field of the HMD, an excessive change in perception occurs and the eyes of the viewer are tired. I also have.

Further, even if the display changes, if the environmental image does not change, the overall impression becomes dull, which is not enough to enhance the presence of the viewer. Therefore, the merit of enhancing the sense of presence is also lost.

[0012] Furthermore, human presence and force are caused by the interaction of audiovisual senses, but when no image or sound is presented on the display, only the visual image is presented by the environmental image. In such a case, there is a problem that the sense of presence is lost.

Furthermore, as one of the problems of HMD, H
One of the reasons is that it is difficult to grasp the surrounding conditions when mounting the MD. In a typical HMD, you can immerse yourself in the video and audio on the display, keep the outside world invisible and only see the display image, and present the audio on the display from your headphones to avoid external noise. Since I was not able to hear it, the viewer of the display could not perceive the outside world and did not know what was happening in the surroundings.For example, even if someone called me or a ringing tone such as a telephone ringed However, it has a problem that it is not noticed.

The present invention has been made in order to solve the above-mentioned problems, and further improves the merit such as reduction of eye fatigue and increase of the sense of presence, which are features of the environmental image, and the surroundings at the time of wearing. An object of the present invention is to provide an image display device capable of grasping the situation.

[0015]

The image display device according to the first invention of the present application is made in order to solve the above-mentioned problems, and is arranged in a display for displaying an image and a peripheral portion of the display. In an image display device for enlarging and viewing an image (hereinafter, environmental image), a usage situation of the image display device of a display viewer, for example, brightness of a liquid crystal display of an HMD, brightness of a room around the HMD user, It is characterized in that it is provided with a situation detecting means for detecting the situation such as the volume and sound frequency from the speaker.

The image display device according to the second invention of the present application is the image display device for enlarging and viewing an image displayed on the display and an environmental image arranged in the peripheral portion of the display. It is characterized by further comprising image changing means for changing the environmental image according to the detected situation.

Further, the situation detecting means detects the light amount or the brightness around the display or the viewer of the display, and the image changing means changes the light amount of the environmental image according to the light amount or the brightness. And Further, the situation detecting means detects the volume or sound around the display or a viewer of the display, and the image changing means changes the light amount of the environmental image according to the volume or sound. .
Further, the situation detecting means detects the amount of light or brightness around the display or a viewer of the display, and the image changing means changes the color tone of the environmental image according to the amount of light or brightness. . Further, the situation detecting means detects a volume or a sound around the display or a viewer of the display, and the image changing means changes a color tone of the environmental image according to the volume or the sound. .

That is, in the image display device of the present invention, the brightness or light amount of the image displayed on the liquid crystal display, the color tone, the sound accompanying the image, the frequency of the sound, and the surroundings of the viewer of the liquid crystal display. The change can be detected and the detection result can be reflected on the brightness, the light amount, the color tone, and the like of the environmental image arranged around the liquid crystal display.

Therefore, the viewer of the image display device, especially H
Compared with the conventional method, the MD wearer can eliminate the extreme brightness difference and light amount difference between the liquid crystal display and the environmental image or the brightness of the surroundings of the viewer and the brightness of the visual field of the HMD, so that the viewer can watch the display. It becomes possible to reduce eye fatigue when wearing or removing the HMD.

Furthermore, since it is possible to change the brightness of the environment image by the image and sound of the liquid crystal display and synchronize the environment image and the image of the liquid crystal display,
The viewer can obtain a higher sense of presence than the conventional image presentation device, especially the conventional HMD.

The image display device according to the third invention of the present application is a display for displaying an image and an image display device for enlarging and viewing an environmental image arranged in the peripheral portion of the display according to the environmental image. It is characterized by comprising an environmental sound presenting means for presenting the environmental sound.

Further, the environmental sound presenting means synthesizes the sound of the display and the environmental sound and outputs the synthesized sound. Further, the environmental sound presenting means outputs the sound of the display and the environmental sound separately. Further, the environmental sound presenting means detects presence or absence of sound of the display, and switches and outputs the sound of the display and the environmental sound according to the presence or absence of the sound.

Therefore, in the case of the image display device of the present invention,
The viewer can obtain a higher sense of presence than the conventional image display device, especially the conventional HMD, from the audiovisual interaction between the environmental video and the environmental sound. Further, the viewer can enjoy the sound of the display when there is sound from the display, and the environmental sound when there is no sound from the display. Further, by switching this depending on the presence or absence of the sound on the display, the sound on the display can be enjoyed without being disturbed by the environmental sound.

The image display apparatus according to the fourth aspect of the present invention is the display for displaying an image and the image display apparatus for enlarging and viewing an environmental image arranged in the periphery of the display, wherein the display or the display is used. The present invention is characterized by including an environmental sound presenting means for detecting a sound around the viewer, selecting a specific sound from the sounds, and outputting the selected sound together with the environmental sound.

As a result, the viewer of the display can perceive a specific sound in the surroundings as an environmental sound, and thus can always grasp the surroundings.

[0026]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic configuration diagram of one embodiment in which the image display device according to the present invention is applied to an HMD used for virtual reality or the like. In FIG. 1, 11 is a magnifying lens, 12 is an environment image slide, 13 is an environment image backlight, 14 is a liquid crystal display, 15 is a liquid crystal display backlight, 16 is a light amount sensor of the liquid crystal display, and 17 is a light amount changing device. , 18 are headphone speakers.

FIG. 22 is a view showing a field of view seen by a viewer of the liquid crystal display of the HMD shown in FIG. In FIG. 22, an image on the liquid crystal display can be seen in the central portion, and an environmental image slide can be seen around the image. Here, since the light amount sensor 16 for liquid crystal display shown in FIG. 1 is outside the field of view of the magnifying lens 11, it does not block the field of view of the display. In this way, the environment image is perceived as if a movie is being watched in a room, as in the case of a conventional device.

FIG. 2 is a partially enlarged view showing a configuration example of the situation detecting means which is a characteristic part of the present invention, and FIG. 3 is a functional block diagram showing a light quantity changing device which is an image changing means. In the figure, 21 is a magnifying lens, 22 is a light amount sensor, and 23 is a display device including an environment image slide and a liquid crystal display. The light quantity changing device 35 in FIG. 3 compares the brightness data of the liquid crystal display from the sensor 31 which is the situation detecting means with the current light quantity 34 of the backlight, and decides whether to increase or decrease the light quantity. 32, and a dimming unit 33 that controls the light amount of the backlight for the environmental image according to a request from the determination unit.

FIG. 4 is a diagram showing a flow chart of the control operation of the judging section 32 shown in FIG. As shown in FIG. 4, in step (hereinafter abbreviated as S) 42, the brightness and light amount data of the liquid crystal display is input from the sensor unit, and in S43, the data is the same as the light amount data of the backlight of the current environmental image. It is determined whether or not. If they are the same, no adjustment is made and the process returns to S41. If they are different, it is determined in S44 whether the light amount of the liquid crystal display is higher than the backlight of the environmental image. When the liquid crystal display is brighter than the environmental image, the light amount is adjusted by requesting the light control section to increase the light amount of the environmental image in S45 and to decrease the light amount of the environmental image in S46 when the liquid crystal display is dark.

As described above, the determination unit of the light intensity changing device determines the light intensity of the environmental image backlight based on the transmitted light intensity data and informs the light control unit of the light intensity of the environmental image backlight. reflect. With this configuration, the difference in brightness between the environmental image and the liquid crystal display can be eliminated, and the viewer can enjoy the image without eye strain.

Further, by changing the position at which the situation detecting means is provided, it is possible to obtain an apparatus capable of detecting a situation different from that of the above embodiment. For example, as shown in FIG. 5, a light amount sensor 56 is installed so as to measure the light amount around the outside of the HMD, and the light amount data is processed in the same manner as in FIGS. It is possible to change the brightness of the environmental image to the same brightness as the brightness of.

In FIG. 5, the position of the light amount sensor and what is detected are different from those in FIG. 1, and other configurations are almost the same as those shown in FIG. That is, when a device for detecting the brightness around the viewer is used and the brightness of the environmental image is changed according to the brightness around the viewer, when the viewer of the liquid crystal display tries to use the HMD, The display image can be enjoyed in an environment image of the same brightness as that of the room, for example, in a dark room when viewed in a dark environment.

Further, even when the viewer removes the HMD, an environmental image having the same brightness as the room brightness can be obtained, so that eye fatigue can be reduced without causing an excessive perceptual change in the eyes. Furthermore, the viewer is HMD
Since it is possible to know the surrounding brightness condition during use from the brightness of the environmental image, it is possible to recognize the surrounding condition to some extent. For example, while wearing the HMD, the entire field of view is covered by the device, so someone came into the room and could not understand the surroundings at all, such as lighting up a dark room. According to the present invention, it is possible to know the surroundings of the user to some extent even when the HMD is attached.

Next, another embodiment of the situation detecting means will be described. The situation detection means is a device that detects the volume of sound output from the speaker (that is, the volume of sound that is emitted together with the image on a TV, game, etc.) according to the image on the liquid crystal display. It is also possible to change the brightness of the environmental image in accordance with.

For example, as shown in FIG. 6, a volume measuring device 66 (volume sensor) for measuring the volume from a speaker.
Is installed, and the data is processed through the light quantity changing device as in FIG. This volume measuring device is a device that measures the intensity of a sound signal and converts it into numerical data by DA conversion, for example. In FIG. 6, the position of the volume measuring device 66 and what is detected are different from those in FIG. 1, and other configurations are almost the same as those shown in FIG.

FIG. 7 is a diagram showing a flow chart of the control operation of the judging section when the volume measuring device is provided as the situation detecting means. As shown in FIG. 7, in S72, the volume measuring device 6
The volume data from No. 6 is input, and it is determined in S73 whether or not the volume data is louder than the set reference (certain threshold value) volume. If the volume is low, the process returns to S71, and if the volume is high, a command for increasing the light amount of the environmental image is requested to the light control unit in S74.

Further, in S75, the volume data from the volume measuring device 66 is inputted, and in S76, it is judged whether or not the volume data is lower than the set reference (certain threshold value) volume data. If the volume is loud, S75
If it is small, a light amount down command is requested to the light control section in S77, and the process returns to S71.

As described above, the volume measuring device detects how loud the sound emitted from the display is, and sends the result to the light quantity changing device. The determination unit of the light intensity changing device determines the light intensity of the environmental image backlight based on the sent volume data, informs the dimming unit, and reflects it in the light intensity of the environmental image backlight. Since the volume from the speaker is synchronized with the liquid crystal display image, naturally,
The environmental image is synchronized with the display image. Therefore,
When the speaker volume changes, the display image changes, and the environmental image also changes.
D becomes feasible.

Further, an embodiment will be described with respect to the situation detecting means by another type of volume measuring device. Although the volume measuring device measures the loudness of the sound, it may be set to detect the sound of a specific frequency component by frequency decomposition of the sound signal. For example, only the sound of a specific low frequency component is detected, and the sound data is sent to the determination unit. With this configuration, for example, in the case of a liquid crystal display image in which a low tone such as an explosion scene is emphasized, it is possible to enjoy a more realistic image by changing the environmental image. Alternatively, by measuring the sound data of the frequency component of the human voice and sending the data to the determination unit, it is possible to obtain an interesting image in which the environmental image changes only during the human dialogue. .

Further, the volume measuring device is set, for example, to detect the volume around the liquid crystal display viewer by a volume sensor, and the sound around the outside of the viewer is changed,
Of course, it is possible to change the environmental image.
In this way, by setting so that the environmental image changes according to the sound of the outside of the viewer, the surrounding situation can be grasped, for example, when someone talks to the HMD while using the HMD or receives a call. It is also possible to do so.

Furthermore, a plurality of status detecting means are provided,
It is also possible to change the environmental image more finely depending on the liquid crystal display image and surrounding conditions. For example, as the situation detecting means, a volume measuring device for a display and a light amount sensor for detecting the brightness of the outer periphery of a viewer are provided, and a function showing the configuration of an embodiment in which an environmental image is changed from two data A block diagram is shown in FIG.

In FIG. 8, an optical data determination unit 83 uses a light amount data from a light amount sensor 81 that detects the brightness of the surroundings of a display viewer, and a sound data determination unit 84 detects a speaker volume of the display. It is a means for determining the backlight light amount for the environment image based on the volume data from and requesting the dimming unit 85 to increase or decrease the light amount.

The light amount data and the sound volume data can be expressed as a light amount curve 91 and a sound volume curve 92, as shown in FIG. Then, based on the data of FIG. 9A, the light quantity conversion device 8
In the light control section 85 of No. 7, the backlight light amount for the environmental image is changed as shown in FIG. 9B, and the brightness of the environmental image is made to correspond to the light amount data and the volume data.
According to this configuration, the environmental image changes in accordance with the brightness of the surroundings of the viewer and the display volume, and it is possible to reduce eye fatigue and realize a highly realistic HMD.

Image changing means other than the light quantity changing device will be described below. As an image changing means, FIG.
An embodiment will be described in which an LED array in which red, blue, and green LEDs as shown in 0 are arranged in a delta shape is provided with a light color changing device that changes the light color of an environmental image. In FIG. 10, 1
Reference numeral 01 is a red LED arranged in a delta shape, 102 is a blue LED, 103 is a green LED, 104 is the entire LED array, and 105 is an environment image slide. By setting the light emission amounts of the LEDs of the three colors so that they can be controlled separately, it is possible to change the overall light color tone.

FIG. 11 is a functional block diagram of the light color changing device 119. By determining the data from the color tone sensor 111, the light color tone of the backlight is determined by the determination unit 112, and the light control units of the respective colors, here, the green LED light control unit 113, the blue LED light control unit 114, and the red color. In response to a command from the LED dimming unit 115, the green LED 116 and the blue LED 1
17, the light amount of each color LED of the red LED 118 is controlled. The above configuration can be similarly realized by using an EL panel of three colors instead of using LEDs.

FIG. 12 is a diagram showing an example of the control operation of the determination unit 112 shown in FIG. The sound reference (threshold) data 1 and the sound reference (threshold) data 2 are set in advance in the determination unit, and the reference data and the input data from the sensor are compared to change the light color state according to the situation. Let For example, when the sound data sent from the volume measuring device is larger than the sound reference data 1, a reddish environment image, and when it is smaller than the sound reference data 2, a greenish environment image.
It is possible to enjoy interesting environmental images that are set freely by the viewer. Of course, it is also possible to increase the reference data and change the color light variously with respect to the input data.

With the above structure, the environmental image is changed according to the situation of the viewer, eyestrain is reduced, and the presence of the image is high.
MD can be realized.

Further, another embodiment of the HMD according to the present invention will be described with reference to FIGS. 13 to 15. FIG.
In FIG. 3, 161 is a magnifying optical system, 162 is an environmental image, and 163.
Is a liquid crystal panel, 164 is a liquid crystal panel backlight, 1
Reference numeral 65 is an environmental sound presenting means, 167 is a video input terminal, 168
Is an audio input terminal, and these are housed in a glasses case 166. The video signal 169 and the audio signal 170 from the outside are input to the video input terminal 167 and the audio input terminal 168.
Is input to the HMD via.

FIG. 14 is a view showing a field of view seen from a viewer of the HMD. FIG. 14A shows a movie at a movie theater according to an environmental image around the liquid crystal display 171.
FIG. 17 (B) is playing a game on a spaceship, FIG.
Each of (C) shows a state of being able to obtain a realistic sensation of watching TV in the forest.

FIG. 15 is a block diagram showing a configuration example of the environmental sound presenting means 165 which is a characteristic part of the present invention. In the figure,
Reference numeral 181 denotes an environmental sound memory unit in which environmental sounds are stored, 182
Is a voice of the liquid crystal display 171 from the voice input terminal 168, 183 is a synthesizing unit for mixing ambient sound and voice of the liquid crystal display, and 184 is a headphone speaker.

The environmental sound corresponding to the environmental image 162 is stored in the environmental sound memory section 181 by a memory such as an IC memory card or a micro tape. For example, in the environmental image of the movie theater shown in FIG. The crowded crowd, the engine sound and the siren sound in the environment image inside the spacecraft shown in FIG. 14B, and the environment sound such as chirping birds in the forest environment image shown in FIG. 14C are stored. This environmental sound memory unit 181 turns on the power of the HMD.
At the same time, an audio signal is sent to the synthesis unit 183, and then the stored environmental sound is repeated to turn off the power.
Continues to send audio signals until time.

The synthesis unit 183 is the environmental sound memory unit 181.
The audio signal from the headphone speaker 1 is combined with the audio signal from the liquid crystal display 171.
The synthesis at this time is performed, for example, with the setting of the intensity of the environmental sound of 20 dB and the intensity of the sound of the liquid crystal display of 70 dB. Further, the environmental sound is assumed to have a high frequency band of 700 Hz or higher, for example.

It is known that human hearing has a masking effect that a certain sound becomes inaudible due to other sounds that are present at the same time.
A sound having a high frequency and a low intensity has a characteristic that it becomes hard to hear (masked) by a sound having a low frequency and a high intensity. Therefore, as described above, the sound synthesized by the synthesizer 183 is masked of the environmental sound when the sound of the liquid crystal display 171 is presented, and the liquid crystal display 1
When the sound 71 is not presented, the environmental sound is heard by the viewer. It is needless to say that each of the above sound intensity settings is an example, and other settings may be used as long as a masking effect can be obtained.

As described above, in the HMD of the present embodiment, in the state where the viewer wears the HMD and the video signal 169 and the audio signal 170 related to the liquid crystal display 171 are not input, the environmental image and the environmental sound are generated. And are presented to the viewer, and a high sense of realism can be obtained by the interaction of the audiovisual sense. When the video signal 169 and the audio signal 170 related to the liquid crystal display 171 are input, the environmental sound is not heard due to the masking effect, and the video and the audio displayed on the liquid crystal display 171 can be enjoyed. Further, even when the image on the liquid crystal display 171 is being viewed, when the sound disappears, for example, when the TV channel is switched, the environmental sound is heard, and the sense of presence is not lost.

In the above embodiment, the headphone speaker for presenting the environmental sound is described as only one pair for the left and right ears, but as shown in the block diagram of FIG. ,
Display audio headphone speaker 196
And adjusting units 193 and 194 that adjust the intensity settings of both voices.
15 may be provided, and the composition unit 183 in FIG. 15 may be omitted. In this case, it is possible to prevent the deterioration of sound by the composition unit.

Further, another embodiment of the environmental sound presenting means which is a characteristic part of the present invention will be described with reference to FIG. In FIG. 17, 201 is an environmental sound memory unit, 202 is a display sound, 203 is a switching unit for switching between the environmental sound and the display sound 202, 204 is a headphone speaker, and 205 is the display sound 20.
2 is a detection unit that detects the presence or absence of 2 and controls the switching of the switching unit 203. Specifically, when the detection unit 205 detects that the display sound 202 is present, the switching unit 203 is controlled to output the display sound 202, and when the display sound 202 is not detected. The control unit 203 controls the switching unit 203 to output the environmental sound from the environmental sound memory unit 201. This eliminates the need to limit the frequency band of the environmental sound stored in the environmental sound memory unit 201.

Next, another embodiment of the HMD according to the present invention will be described with reference to FIGS. In FIG. 18, 211 is an enlarging optical system, 212 is an environmental image, 213 is a liquid crystal panel, 214 is a liquid crystal panel backlight, 215 is an environmental sound presenting means, 216 is a sound sensor for detecting sounds around the viewer of the display, 217 is a video input terminal, 218 is an audio input terminal, and the viewer is at H
You can wear the MD on your head and enjoy the input video and the environmental video.

FIG. 19 is a block diagram showing the environmental sound presenting means 215 in this embodiment. In the figure, 221 is an environmental sound memory unit in which environmental sounds are stored, 222 is a display sound that is input from the outside, 223 is a synthesizing unit that mixes the environmental sound, the display sound, and the sound around the HMD, and 224 is a headphone. The speaker 225 is a peripheral sound determination unit that determines the sound around the HMD from the sound sensor 216.

The peripheral voice determination section 225 is provided with the sound sensor 21.
It is judged whether or not the sound around the HMD sent from No. 6 has a certain level, for example, an intensity of 80 dB or more, and 80 d
If it is B or less, nothing is output, and if it is 80 dB or more, a sound signal is output to the synthesis unit 223. Synthesis unit 223
Then, the sound around the HMD, the display sound, and the environmental sound are combined and presented from the headphone speaker 224. Here, the synthesis of voice in the synthesis unit 223 is set as follows, for example.

Ambient sound intensity 20 dB Display sound intensity 70 dB HMD surrounding sound intensity 80 dB By setting each sound intensity as described above, the surrounding sound of the viewer of the display includes both the display sound and the environmental sound. It is perceived by the viewer of the display both when the sound is presented and when only the environmental sound is presented. The voice intensities to be synthesized are not limited to the above setting examples, and may be other settings as long as the sound around the HMD can be perceived in any situation.

As described above, in the HMD according to the present embodiment, even a display viewer whose visual sense is covered by the HMD, when a call is made in the surroundings or a ringing tone such as a telephone sounds, The sound is presented from the headphone speaker 224 and can be perceived, so that the surrounding situation can be grasped. Also, for example, 80
Since a small noise of dB or less is not presented, it is possible to enjoy the display image and sound of the HMD, or the environmental image and the environmental sound with high realism and power.

[0062]

The present invention has the following effects. First, since the light quantity and brightness of the environmental image can be changed according to the brightness of the liquid crystal display, the light quantity and the brightness difference between the display brightness and the environmental image can be extremely reduced, and the eyestrain of the viewer can be reduced. Decrease.

Secondly, since it is possible to change the amount of light and the brightness of the environmental image depending on the brightness of the surroundings of the viewer, there is no excessive perceptual change when the image presenting device, especially when the HMD is attached or detached. , The eyestrain of the viewer is reduced.

Thirdly, since it is possible to synchronize the environmental image with the light quantity, luminance, color tone and sound of the display image, it is possible to obtain a higher sense of realism as compared with the conventional image presenting apparatus, especially the image of the HMD. it can.

Fourth, since it is possible to present the environmental sound corresponding to the environmental video, the audio-visual interaction between the video and the audio makes the presence higher than that of the conventional image presenting apparatus, especially the video of the HMD. Can be obtained.

Fifth, since it is possible to present sounds around the viewer, it is possible to always grasp the surrounding situation.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram showing an embodiment of an HMD according to the present invention.

FIG. 2 is a partially enlarged view showing a configuration example of a situation detecting means in one embodiment of the HMD according to the present invention.

FIG. 3 is a functional block diagram showing a light amount changing device which is an image changing means in one embodiment of the HMD according to the present invention.

FIG. 4 is a flowchart showing a control operation of a determination unit of the light quantity conversion device in the HMD according to the embodiment of the present invention.

FIG. 5 is a schematic configuration diagram of an HMD equipped with a light amount sensor for measuring the light amount of the outer periphery according to the present invention.

FIG. 6 is a schematic configuration diagram of an HMD including a volume measuring device for measuring a volume according to the present invention.

FIG. 7 is a flowchart showing the control operation of the determination unit of the volume measuring device in one embodiment of the HMD according to the present invention.

FIG. 8 is a functional block diagram showing an embodiment including a plurality of situation detecting means of the HMD according to the present invention.

9A is a diagram showing a curve showing a temporal change of light amount data and volume data, and FIG. 9B is a diagram showing a curve showing a temporal change of luminance of an environmental image.

FIG. 10 is a partially enlarged view showing a configuration example of an image changing unit in the HMD of the present invention.

FIG. 11 is a functional block diagram showing a light color changing device which is an image changing means in the HMD of the present invention.

FIG. 12 is an explanatory diagram showing an example of the control operation of the determination unit of the light color changing device in the HMD of the present invention.

FIG. 13 is a schematic configuration diagram showing another embodiment of the HMD according to the present invention.

FIG. 14 is an explanatory diagram showing a field of view of an HMD according to the present invention viewed from a viewer.

FIG. 15 is a block diagram showing a configuration example of environmental sound presenting means in another embodiment of the HMD according to the present invention.

FIG. 16 is a block diagram showing another configuration example of the environmental sound presenting means in the HMD according to the present invention.

FIG. 17 is a block diagram showing another configuration example of the environmental sound presenting means in the HMD according to the present invention.

FIG. 18 is a schematic diagram showing another embodiment of the HMD according to the present invention.

FIG. 19 is a block diagram showing a configuration example of environmental sound presenting means in another embodiment of the HMD according to the present invention.

FIG. 20 is a schematic configuration diagram showing a conventional HMD.

FIG. 21 is a diagram showing a field of view seen by a viewer of a liquid crystal display using a conventional HMD.

[Fig. 22] Fig. 22 is a diagram showing a field of view viewed from a display viewer of an HMD having an environmental image.

[Explanation of symbols]

11 magnifying lens 12 slide for environmental image 13 backlight for environmental image 14 liquid crystal display 15 backlight for liquid crystal display 16 light intensity sensor for liquid crystal display 17 light intensity changing device 18 headphone speaker 21 magnifying lens 22 light intensity sensor 23 slide for environmental image and liquid crystal Display device including display 31 Sensor as condition detecting means 32 Judgment unit 33 Light control unit 34 Light intensity of backlight for environmental image 35 Light intensity changing device 51 Magnifying lens 52 Slide for environmental image 53 Backlight for environmental image 54 Liquid crystal display 55 Backlight 56 Light intensity sensor (for the viewer's surroundings) 57 Light intensity changing device 58 Headphone speaker 61 Magnifying lens 62 Environmental image slide 63 Environmental image backlight 64 Liquid crystal display Play 65 Backlight for liquid crystal display 66 Volume measuring device 67 Light intensity changing device 68 Headphone speaker 81 Light intensity sensor 82 Volume measuring device 83 Optical data judging part 84 Sound data judging part 85 Light control part 86 Environmental image backlight 87 Light intensity changing device 91 Curve of light intensity 92 Curve of volume 93 Luminance curve of environmental image 101 Red LED arranged in delta shape 102 Blue LED arranged in delta shape 103 Green LED arranged in delta shape 104 LED array whole 105 Environmental image slide 111 Color tone sensor 112 Judgment unit 113 Green LED dimming unit 114 Blue LED dimming unit 115 Red LED dimming unit 116 Green LED 117 Blue LED 118 Red LED 119 Light color changing device 161 Enlargement optical system 162 Environmental image 163 Liquid crystal Channel 164 Backlight 165 Environmental sound presenting means 166 Glasses case 167 Video input terminal 168 Audio input terminal 169 Video signal 170 Audio signal 181 Environmental sound memory section 182 Display sound 183 Synthetic section 184 Headphone speaker 191 Environmental sound memory section 192 Display sound 193 Environmental sound adjusting unit 194 Display audio adjusting unit 195 Environmental sound headphone speaker 196 Display audio headphone speaker 201 Environmental sound memory unit 202 Display sound 203 Switching unit 204 Headphone speaker 205 Detection unit 211 Enlarging optical system 212 Environment Image 213 Liquid crystal panel 214 Backlight 215 Environmental sound presenting means 216 Sound sensor 217 Video input terminal 218 Audio input end Child 221 Environmental sound memory unit 222 Display sound 223 Synthesizing unit 224 Headphone speaker 225 Surrounding sound judging unit

Claims (11)

[Claims] 1. A display for displaying an image and an image display device for enlarging and viewing an environmental image arranged in a peripheral portion of the display, comprising situation detection means for detecting a use state of the image display device by a viewer of the display. An image display device characterized by the above. 2. A display for displaying an image and an image display device for enlarging and viewing an environmental image arranged in the peripheral portion of the display, according to the situation detected by the situation detecting means according to claim 1. An image display device comprising image changing means for changing the environmental image. 3. The image display device according to claim 1 or 2, wherein the situation detecting means detects a light amount or brightness around the display or a viewer of the display, and the image changing means responds to the light amount or brightness. And an image display device characterized by changing the light amount of an environmental image. 4. The image display device according to claim 1 or 2, wherein the situation detecting means detects a volume or sound around the display or a viewer of the display, and the image changing means detects the volume or sound. An image display device, characterized in that the light amount of an environmental image is changed in accordance therewith. 5. The image display device according to claim 1 or 2, wherein the situation detecting means detects a light amount or brightness around the display or a viewer of the display, and the image changing means detects the light amount or brightness. An image display device characterized by changing the color tone of an environmental image according to the above. 6. The image display device according to claim 1 or 2, wherein the situation detecting means detects a volume or sound around the display or a viewer of the display, and the image changing means detects the volume or sound. An image display device characterized by changing the color tone of an environmental image according to the above. 7. A display for displaying an image and an image display device for enlarging and viewing an environmental image arranged in the periphery of the display, comprising environmental sound presenting means for presenting an environmental sound according to the environmental image. An image display device characterized by the above. 8. The image display device according to claim 7, wherein the environmental sound presenting means synthesizes the sound of the display and the environmental sound and outputs the synthesized sound. 9. The image display device according to claim 7, wherein the environmental sound presenting means outputs the sound of the display and the environmental sound separately. 10. The image display device according to claim 7, wherein the environmental sound presenting means detects the presence or absence of the sound of the display, and switches and outputs the sound of the display and the environmental sound accordingly. An image display device characterized by the above. 11. The image display device according to claim 7, wherein the environmental sound presenting means detects a sound around the display or a viewer of the display, selects a specific sound from the sounds, and outputs the selected sound together with the environmental sound. An image display device characterized by: