WO2019069812A1

WO2019069812A1 - Sight-line detection system for head-mounted display, head-mounted display, and sight-line detection method for head-mounted display

Info

Publication number: WO2019069812A1
Application number: PCT/JP2018/036290
Authority: WO
Inventors: 敬志畑田; クマールラヴィ
Original assignee: 株式会社ソニー・インタラクティブエンタテインメント
Priority date: 2017-10-05
Filing date: 2018-09-28
Publication date: 2019-04-11

Abstract

Provided are a sight-line detection system for a head-mounted display, whereby the sight line of a user wearing a head-mounted display can be accurately detected, a head-mounted display, and a sight-line detection method for a head-mounted display. A plurality of optical fibers (48a)-(48e) are supported by a housing (24) of a head-mounted display (10) so that one-end surfaces (52a)-(52e) thereof are disposed in different positions facing an eye of a user (22). A sight-line detection device (20) detects, for the plurality of optical fibers (48a)-(48e), light reflected by the eye of the user (22), the reflected light being incident on the one-end surfaces (52a)-(52e) and emitted from other-end surfaces (56a)-(56e). The sight-line detection device (20) detects the sight line of the user (22) on the basis of the result of the above detection.

Description

Eye-gaze detection system for head-mounted display, head-mounted display, and eye-gaze detection method for head-mounted display

The present invention relates to a gaze detection system for a head mounted display, a head mounted display, and a gaze detection method for the head mounted display.

In a head mounted display (HMD) for a user to wear on the head and watch an image, there is a technology for detecting the line of sight of the user based on an image of the user's eye taken by a camera arranged inside the housing Are known.

In the line of sight detection in the conventional HMD, the camera can not be disposed at a position suitable for detecting the line of sight of the user due to the restriction of the shape and size of the casing, and the line of sight of the user can not be detected with sufficient accuracy.

The present invention has been made in view of the above situation, and one of the objects is a line of sight detection system for a head mounted display, a head mounted display, and a head mount capable of accurately detecting the line of sight of a user wearing the head mounted display. An object of the present invention is to provide a method of detecting the line of sight of a display.

In order to solve the above problems, the gaze detection system for a head mounted display according to the present invention is arranged such that one end face faces the user's eyes at different positions, and a plurality of lights supported by the housing of the head mounted display A fiber, a reflected light detection unit for detecting reflected light of the user's eye, which is incident on the one end face and emitted from the other end of the plurality of optical fibers, and a result of the detection And a gaze detection unit that detects the gaze of the user.

In one aspect of the present invention, the reflected light detection unit is a camera that captures the other end face of the plurality of optical fibers, and the sight line detection unit is based on an image of the other end face captured by the camera. To detect the line of sight of the user.

In the head mounted display according to the present invention, a housing worn by a user, a plurality of optical fibers supported by the housing and arranged to face the eyes of the user at different positions on one end face, and A reflected light detection unit for detecting reflected light from the user's eyes, which is incident on the one end face and emitted from the other end of a plurality of optical fibers, and based on the result of the detection, And a gaze detection unit that detects a gaze.

In the head-mounted display eye gaze detection method according to the present invention, one of the plurality of optical fibers supported by the housing of the head-mounted display is disposed such that one end face faces the user's eyes at different positions. Detecting reflected light from the end face of the user, which is incident on the end face of the light source and emitted from the other end face, and detecting a line of sight of the user based on a result of the detection.

It is a top view showing an example of a look detection system concerning one embodiment of the present invention. It is a left view of the gaze detection system shown in FIG. FIG. 3 is a cross-sectional view taken along line III-III of the gaze detection system shown in FIGS. 1 and 2; It is a figure which shows an example of an end surface image. It is a functional block diagram which shows an example of the function mounted by the gaze detection apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process performed with the gaze detection apparatus which concerns on one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a plan view showing an example of a gaze detection system 1 according to an embodiment of the present invention. FIG. 2 is a left side view of the sight line detection system 1 shown in FIG. FIG. 3 is a cross-sectional view taken along line III-III of the gaze detection system 1 shown in FIGS.

As shown in FIGS. 1 and 2, the gaze detection system 1 according to the present embodiment includes a head mounted display (HMD) 10, a display unit 12 for the left eye, a display unit 14 for the right eye, and a gaze detection apparatus 20. ,It is included. The sight line detection device 20 includes a main body 20a, an infrared light emitting diode (LED) 20b, a camera 20c for the left eye, and a camera 20d for the right eye. The display unit 12 and the display unit 14 are displays such as a liquid crystal display and an organic EL display, for example. The camera 20c and the camera 20d are, for example, infrared cameras.

The HMD 10 includes a case 24 that the user 22 wears on the head, an optical fiber 26 for the left eye that guides an image for the left eye, and an optical fiber 28 for the right eye that guides the image for the right eye. included. The optical fiber 26 and the optical fiber 28 according to the present embodiment have, for example, flexibility.

A support 30 for supporting the optical fiber 26 and a support 32 for instructing the optical fiber 28 are provided on the front surface of the housing 24. As shown in FIG. 3, the support 30 is a frame supporting the optical fiber 26 in front of the left eye of the user 22, and the support 32 supports the optical fiber 28 in front of the right eye of the user 22. It is a frame.

Further, the housing 24 according to the present embodiment includes the connection portion 34 disposed on the back of the user 22. The optical fiber 26 is connected to the support 30, the connection 34, and the display surface of the display 12. The optical fiber 28 is connected to the support 32, the connection 34, and the display surface of the display 14.

Each of the optical fibers 26 according to the present embodiment is associated with at least one pixel constituting the display surface of the display unit 12. Then, each of the optical fibers 26 is connected to at least one pixel constituting the display surface of the display unit 12 that is associated with the optical fiber 26. Each of the optical fibers 26 guides the light of at least one pixel that is associated with the optical fiber 26. Further, each of the optical fibers 28 according to the present embodiment is associated with at least one pixel constituting the display surface of the display unit 14. Each of the optical fibers 28 is connected to at least one pixel constituting the display surface of the display unit 14 that is associated with the optical fiber 28. Each of the optical fibers 28 then guides the light of at least one pixel that is associated with the optical fiber 28.

Further, the pixels forming the display surface of the display unit 12 or the display unit 14 may be formed of a plurality of sub-pixels such as, for example, R pixels, G pixels, and B pixels.

In the present embodiment, for example, the optical fiber 26 connected to the display surface of the display unit 12 is guided by the support unit 30 along the left head of the user 22 via the connection unit 34. The support unit 30 supports the bundle of optical fibers 26 from the outside in front of the left eye of the user 22 so that one end face of the optical fiber 26 that emits light of an image faces the left eye of the user 22. Then, the light of the image from the display unit 12 is incident on the other end face of the optical fiber 26. Here, for example, the other end face of the optical fiber 26 may be connected to the display unit 12.

Also, for example, the optical fiber 28 connected to the display surface of the display unit 14 is guided by the support unit 32 along the right head of the user 22 via the connection unit 34. The support portion 32 supports the bundle of optical fibers 28 from the outside in front of the right eye of the user 22 so that one end face of the optical fiber 28 emitting light of an image faces the right eye of the user 22. Then, the light of the image from the display unit 14 is incident on the other end surface of the optical fiber 28. Here, for example, the other end face of the optical fiber 28 may be connected to the display unit 14.

The light of the image for the left eye output from the display unit 12 and guided by the optical fiber 26 is incident on the user 22 for the left eye. Further, the light of the image for the right eye which is output by the display unit 14 and guided by the optical fiber 28 is incident on the user 22 to the right eye. The user 22 wearing the HMD 10 can appreciate, for example, the three-dimensional image output by the display unit 12 and the display unit 14.

The HMD 10 according to the present embodiment also includes an optical fiber 40 for emitting infrared light to the left eye of the user 22 and an optical fiber 42 for emitting infrared light to the right eye of the user 22. As shown in FIG. 3, the optical fiber 40 is supported by the support 30 in front of the left eye of the user 22 with the bundle of optical fibers 26. The optical fiber 42 is also supported by the support 32 in front of the right eye of the user 22 together with the bundle of optical fibers 28.

Then, in the present embodiment, for example, the infrared LED 20b of the sight line detection device 20 makes infrared rays incident on one end surface of the optical fiber 40 and one end surface of the optical fiber 42. Then, the infrared ray is emitted from the other end face 44 of the optical fiber 40 shown in FIG. 3 toward the left eye of the user 22. Further, infrared rays are emitted from the other end face 46 of the optical fiber 42 shown in FIG. 3 to the right eye of the user 22. Although the other end face 44 of the optical fiber 40 is located at the center of the bundle of optical fibers 26 in the example of FIG. 3, the end face 44 does not have to be located at the center of the bundle of optical fibers 26. In the example of FIG. 3, the other end face 46 of the optical fiber 42 is located at the center of the bundle of optical fibers 28, but the end face 46 does not have to be located at the center of the bundle of optical fibers 28.

In the HMD 10 according to this embodiment, the optical fibers 48 (48a to 48e) for guiding the light reflected by the left eye of the user 22 and the optical fibers 50 (50a to 50e) for guiding the light reflected by the right eye of the user 22 )It is included.

As shown in FIGS. 1 to 3, the support portion 30 of the housing 24 supports the plurality of optical fibers 48 such that one end face 52 is disposed at a different position. Further, the plurality of optical fibers 48 are arranged such that one end face 52 faces the left eye of the user 22. For example, one end face 52 a of the optical fiber 48 a is supported by the support 30 so as to be located below the support 30. Further, one end face 52 b of the optical fiber 48 b is supported by the support 30 so as to be located on the left of the support 30. Further, one end face 52 c of the optical fiber 48 c is supported by the support portion 30 so as to be located at the upper left of the support portion 30. Further, one end face 52 d of the optical fiber 48 d is supported by the support 30 so as to be located on the right of the support 30. Further, one end face 52 e of the optical fiber 48 e is supported by the support 30 so as to be located at the upper right of the support 30. In the present embodiment, the optical fiber 48 penetrates the hole formed in the frame of the support portion 30. However, the optical fiber 48 does not have to penetrate the hole formed in the frame of the support portion 30.

Further, as shown in FIGS. 1 to 3, the support portion 32 of the housing 24 supports the plurality of optical fibers 50 such that one end face 54 is disposed at a different position. The plurality of optical fibers 50 are arranged such that one end face 54 faces the right eye of the user 22. For example, one end face 54 a of the optical fiber 50 a is supported by the support 32 so as to be located below the support 32. Further, one end face 54 b of the optical fiber 50 b is supported by the support portion 32 so as to be located on the right of the support portion 32. Further, one end face 54 c of the optical fiber 50 c is supported by the support portion 32 so as to be located at the upper right of the support portion 32. Further, one end face 54 d of the optical fiber 50 d is supported by the support portion 32 so as to be located on the left of the support portion 32. Further, one end face 54 e of the optical fiber 50 e is supported by the support portion 32 so as to be located at the upper left of the support portion 32. In the present embodiment, the optical fiber 50 passes through the hole formed in the frame of the support portion 32. However, the optical fiber 50 does not have to pass through the hole formed in the frame of the support portion 32.

In the present embodiment, for example, an infrared ray emitted from the other end surface 44 of the optical fiber 40 and reflected by the left eye of the user 22 is incident on one end surface 52 of the optical fiber 48. Further, the infrared ray emitted from the other end face 46 of the optical fiber 42 and reflected by the right eye of the user 22 is incident on one end face 54 of the optical fiber 50.

Then, in the present embodiment, for example, the camera 20 c captures the other end face 56 of the plurality of optical fibers 48. For example, the camera 20c includes the other end 56a of the optical fiber 48a, the other end 56b of the optical fiber 48b, the other end 56c of the optical fiber 48c, the other end 56d of the optical fiber 48d, and the other end of the optical fiber 48e. Shoot 56e.

Further, in the present embodiment, for example, the camera 20 d captures the other end surface 58 of the plurality of optical fibers 50. For example, the camera 20d includes the other end face 58a of the optical fiber 50a, the other end face 58b of the optical fiber 50b, the other end face 58c of the optical fiber 50c, the other end face 58d of the optical fiber 50d, and the other end face of the optical fiber 50e. Shoot 58e.

Hereinafter, an image obtained by capturing the other end face 56 of the optical fiber 48 is referred to as a left end face image, and an image obtained by capturing the other end face 58 of the optical fiber 50 is referred to as a right end face image. FIG. 4 is a view showing an example of the left end surface image 60 which is an image obtained by photographing the other end surface 56 of the plurality of optical fibers 48 by the camera 20c. As shown in FIG. 4, in the left end surface image 60, images of the end faces 56a to 56e are shown.

Then, in the present embodiment, for example, the visual axis detection device 20 enters the end face 52 of the optical fiber 48 and emits from the end face 56 based on the detection result of the reflected light of the user 22's left eye. Detect the gaze of Here, for example, the gaze detection apparatus 20 may detect the gaze of the left eye of the user 22 based on the left end surface image 60.

Similarly, based on the detection result of the reflected light by the right eye of the user 22 that is incident on the end face 54 of the optical fiber 50 and emitted from the end face 58, the line of sight detection device 20 To detect.

Hereinafter, the function of the visual axis detection device 20 and the process executed by the visual axis detection device 20 will be further described.

For example, the main unit 20a of the sight line detection device 20 according to the present embodiment is a computer including a processor which is a control device such as a microprocessor, a storage element such as a ROM or RAM, a storage unit such as a hard disk drive, Good. The processor included in the main unit 20a may operate in accordance with a program installed in the main unit 20a.

FIG. 5 is a functional block diagram showing an example of functions implemented by the visual axis detection device 20 according to the present embodiment. In the visual axis detection device 20 according to the present embodiment, not all the functions illustrated in FIG. 5 need to be implemented, and functions other than the functions illustrated in FIG. 5 may be implemented.

As shown in FIG. 5, the visual axis detection device 20 functionally includes, for example, an infrared light emitting unit 70, a reflected light detection unit 72, and a visual axis detection unit 74. The infrared emitting unit 70 is mainly mounted with, for example, the infrared LED 20b. The reflected light detection unit 72 is mainly mounted with, for example, the processor of the main body unit 20a, the camera 20c, and the camera 20d. The gaze detection unit 74 is mainly implemented with, for example, the processor and the storage unit of the main body unit 20 a.

Further, the above functions are executed by executing a program installed in the main body 20a of the sight line detection device 20, which is a computer, including a command corresponding to the above functions by a processor included in the main body 20a of the sight line detection device 20. It may be implemented. This program is supplied to the main body 20a of the visual axis detection device 20 via a computer readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, a flash memory or the Internet, for example. It may be done.

In the present embodiment, the infrared emitting unit 70 causes infrared rays to be incident on one end surface of the optical fiber 40 and one end surface of the optical fiber 42, for example.

In the present embodiment, the reflected light detection unit 72 detects, for example, the reflected light of the left eye of the user 22 that is incident on one end surface 52 of the optical fiber 48 and emitted from the other end surface 56. Further, in the present embodiment, for example, the reflected light detection unit 72 detects the reflected light of the right eye of the user 22 that is incident on one end surface 54 of the optical fiber 50 and emitted from the other end surface 58.

Further, as described above, the reflected light detection unit 72 may be a camera. Then, the reflected light detection unit 72 may generate, for example, a left end surface image obtained by entering the one end surface 52 of the optical fiber 48 and capturing the other end surface 56. For example, the reflected light detection unit 72 may generate the left end surface image 60 shown in FIG. Further, for example, the reflected light detection unit 72 may generate a right end face image obtained by entering one end face 52 of the optical fiber 48 and capturing the other end face 56.

In the present embodiment, for example, the line-of-sight detection unit 74 detects the line of sight of the user 22, such as the movement of the pupil or the direction of the line of sight, based on the detection result by the reflected light detection unit 72. The line-of-sight detection unit 74 may detect the line of sight of the left eye of the user 22 based on, for example, a left end face image which is an image of the other end face 56 of the optical fiber 48 captured by the camera 20c. The line-of-sight detection unit 74 may detect the line of sight of the right eye of the user 22, for example, based on a right end face image which is an image of the other end face 58 of the optical fiber 50 captured by the camera 20d.

For example, the amount of infrared rays incident on each of the end faces 52a to 52e corresponds to the direction of the line of sight of the left eye of the user 22. The brightness of the end faces 56a to 56e shown in the left end face image 60 corresponds to the amount of infrared rays incident on the end faces 52a to 52e, respectively. Based on this, in the present embodiment, the line-of-sight detection unit 74 detects the line of sight of the left eye of the user 22 based on the left end face image in which the images of the end faces 56a to 56e are shown. Similarly, in the present embodiment, the gaze detection unit 74 detects the gaze of the right eye of the user 22 based on the right end face image.

Here, the method of detecting the sight line based on the left end face image and the right end face image is not particularly limited. For example, the line of sight of the user 22 may be detected by a machine learning method such as deep learning.

For example, learning data including an image in which the images of the end faces 56a to 56e are shown as learning input data and learning data including data indicating the direction of the line of sight of the left eye of the user 22 when the image is photographed The gaze detection unit 74 may store the learned model. In this case, the learned model is a machine learning model in which supervised learning is performed. The line-of-sight detection unit 74 detects (estimates) the line of sight of the left eye of the user 22 when the left end plane image is captured based on the output when the left end plane image is input to the learned model. Good.

Also, for example, learning data is included that includes an image in which the images of the end faces 58a to 58e are shown as learning input data and data indicating the direction of the line of sight of the right eye of the user 22 when the image is taken The gaze detection unit 74 may store the learned model that has been learned. In this case, the learned model is a machine learning model in which supervised learning is performed. Then, the sight line detection unit 74 detects (estimates) the sight line of the right eye of the user 22 when the right end face image is captured based on the output when the right end face image is input to the learned model. Good.

For example, even if the visual axis detection unit 74 generates data in which the positions at which the end faces 52a to 52e are arranged are associated with the values indicating the brightness of the end faces 56a to 56e shown in the left end face image. Good. Then, the line-of-sight detection unit 74 detects the line of sight of the left eye of the user 22 based on the distribution of values indicating the brightness associated with each of the positions where the end faces 52a to 52e indicated by the data. May be Similarly, even if the line-of-sight detection unit 74 generates data in which the positions at which the end faces 54a to 54e are arranged correspond to the values indicating the brightness of the end faces 58a to 58e shown in the right end face image. Good. Then, the line-of-sight detection unit 74 detects the line of sight of the right eye of the user 22 based on the distribution of values indicating the brightness associated with each of the positions where the end faces 54a to 54e indicated by the data. May be

Here, an example of the flow of the gaze detection process performed by the gaze detection apparatus 20 according to the present embodiment will be described with reference to the flowchart illustrated in FIG.

First, the infrared emitting unit 70 waits for the infrared emitting timing (S101). In the present embodiment, for example, infrared rays are emitted at an interval of one second. Here, when the emission timing of the infrared rays comes, the infrared emitting unit 70 emits the infrared rays toward one end face of the optical fiber 40 and one end face of the optical fiber 42 (S102).

Then, the reflected light detection unit 72 generates the left end surface image and the right end surface image (S103).

Then, the line-of-sight detection unit 74 detects the line of sight of the left eye of the user 22 based on the left end surface image generated in the process shown in S103, and the user 22 based on the right end face image generated in the process shown in S103. The line of sight of the right eye of the camera is detected (S104). Then, the process returns to the process shown in S101.

As described above, the infrared ray incident on one end face of the optical fiber 40 in the process shown in S102 is emitted from the other end face 44 of the optical fiber 40 toward the left eye of the user 22, and the left eye of the user 22 It is reflected. The infrared ray incident on one end face of the optical fiber 42 in the process shown in S102 is emitted from the other end face 46 of the optical fiber 42 toward the right eye of the user 22 and is reflected by the right eye of the user 22.

The infrared light reflected by the left eye of the user 22 is incident on one end face 52a to 52e of the optical fibers 48a to 48e. The infrared light reflected by the right eye of the user 22 is incident on one end face 54a to 54e of the optical fibers 50a to 50e.

The infrared rays incident on one end face 52a to 52e of the optical fibers 48a to 48e are emitted from the other end faces 56a to 56e of the optical fibers 48a to 48e. The infrared rays incident on one of the end faces 54a to 54e of the optical fibers 50a to 50e are emitted from the other end faces 58a to 58e of the optical fibers 50a to 50e.

In the process shown in S103, the left end face image obtained by photographing the end faces 56a to 56e from which infrared rays are emitted in this manner and the right end face image obtained from the end faces 58a to 58e from which infrared rays are emitted in this manner are generated. Ru.

In the present processing example, the display of the image by the display unit 12 and the display unit 14 may be suppressed at the timing when the infrared light is emitted. For example, when the frame rate of the display unit 12 and the display unit 14 is 60 fps, the display of the image may be suppressed every 60 frames. For example, in this way, it is possible to suppress the influence of the image output from the display unit 12 or the display unit 14 on the detection of the user's line of sight.

Alternatively, for example, the display unit 12 and the display unit 14 may output visible light of a predetermined color at predetermined time intervals (for example, at intervals of 1 second) instead of an image to be viewed by the user. Then, the reflected light detection unit 72 emits the left end surface image obtained by photographing the end faces 56a to 56e emitting the visible light reflected by the left eye of the user 22, and the visible light reflected by the right eye of the user 22. A right end face image obtained by photographing the end faces 58a to 58e may be generated. This makes it possible to detect the line of sight of the user 22 without providing the infrared LED 20b.

In the line of sight detection in the conventional HMD 10, the line of sight of the user 22 is detected based on the image of the eye of the user 22 captured by a camera arranged inside the housing 24. In such an HMD 10, the camera can not be disposed at a position suitable for detecting the line of sight of the user 22 due to the restriction of the shape and size of the housing 24, and the line of sight of the user 22 may not be detected with sufficient accuracy.

In the gaze detection system 1 according to the present embodiment, it is not necessary to dispose a camera for detecting the gaze of the user 22 inside the housing 24 of the HMD 10. Then, in the gaze detection system 1 according to the present embodiment, the gaze of the user 22 is detected based on the detection result of the light guided by the optical fiber 48 or the optical fiber 50 having a high degree of freedom of arrangement. Thus, according to the gaze detection system 1 according to the present embodiment, the gaze of the user 22 wearing the HMD 10 can be accurately detected. Then, a process according to the line of sight of the user 22 detected in this manner may be executed, for example, in a game program executed on the game console or a program executed on the personal computer.

The present invention is not limited to the above-described embodiment.

For example, the reflected light detection unit 72 does not have to be a camera. For example, the reflected light detection unit 72 may be a light receiving element such as a light sensor capable of detecting the amount of infrared light. In this case, the sight line detector 74 may detect the sight line of the user 22 based on the detection result of the amount of infrared rays detected by the light receiving element.

Further, it is not necessary for the sight line detection unit 74 to detect the sight line of the user 22 based on the detection result of the light guided by the five optical fibers. The line-of-sight detection unit 74 may detect the line of sight of the user 22 based on the detection result of the light guided by a larger number of optical fibers or a smaller number of optical fibers.

In addition, the HMD 10 may have the function of the visual axis detection device 20. For example, the line-of-sight detection device 20 may be incorporated in the connection unit 34 of the HMD 10. The display unit 12 or the display unit 14 may be incorporated in the connection unit 34 of the HMD 10. This allows the user 22 to move his head freely.

Further, the present invention is not limited to the gaze detection system 1 including the HMD 10 described above. Among the HMDs, there is one in which a display unit is disposed in front of a housing worn by the user on the head so that the user can directly view an image displayed on the display unit. Further, the display unit is disposed on the side of the housing, and a mirror that reflects the video light emitted forward from the display unit is disposed on the front of the housing, so that the video output from the display unit and reflected by the mirror There are also HMDs that allow the user to view The present invention is equally applicable to gaze detection systems including such HMDs.

Claims

A plurality of optical fibers, one end face of which is arranged to face the user's eyes at different positions and supported by the housing of the head mounted display;
A reflected light detection unit for detecting reflected light of the user's eye, which is incident on the one end face and emitted from the other end of the plurality of optical fibers;
A gaze detection unit that detects the gaze of the user based on the result of the detection;
An eye gaze detection system for a head mounted display, comprising:
The reflected light detection unit is a camera for photographing the other end surface of the plurality of optical fibers,
The gaze detection unit detects the gaze of the user based on an image obtained by photographing the other end face of the camera.
The eye gaze detection system of a head mounted display according to claim 1.
A housing that the user wears,
A plurality of optical fibers, one end face of which is arranged to face the user's eyes at different positions, and supported by the housing;
A reflected light detection unit for detecting reflected light of the user's eye, which is incident on the one end face and emitted from the other end of the plurality of optical fibers;
A gaze detection unit that detects the gaze of the user based on the result of the detection;
A head mounted display characterized by including.
One of the end faces is arranged to face the user's eyes at a different position, and the plurality of optical fibers supported by the housing of the head mounted display are incident on the one end face and emitted from the other end face Detecting reflected light from the human eye;
Detecting a line of sight of the user based on a result of the detection;
And a visual line detection method for a head mounted display.