TW202409657A - Augmented reality device capable of fine-tuning clear artificially generated images for left and right eyes separately no need to install separate frames and lenses and no need to change different lenses to accommodate users with different diopters - Google Patents

Abstract

The invention includes a shell unit, two artificial image adjustment units and a control unit. The shell unit has two perspective windows with two mutually parallel virtual optical axes between them. The user's eyes can respectively view an actual image along the two virtual optical axes and through the two perspective windows. The two artificial image adjustment units respectively correspond to two virtual optical axes. Each artificial image adjustment unit has an artificial image display part, an optical processing part, a plane reflection part, a light combining part and a focus adjustment part, wherein the artificial image display part generates an artificial image, and the artificial image is transmitted to the plane reflection part through the optical processing part and reflected to the light combining part, and then is overlapped with the actual image along the virtual optical axes and reaches both eyes, respectively. The focus adjustment part adjusts the distance between the artificial image display part and the optical processing part, so as to adjust the clarity of artificial images for both eyes separately. The invention can adjust the clarity of artificial images for both eyes separately. There is no need to install separate frames and lenses, which can reduce weight, and there is no need to change different lenses to accommodate users with different diopters. Thus, the invention has advantage of wider application range.

Description

Augmented reality device that can fine-tune the left and right eyes to produce clear artificial images

The present invention relates to an augmented reality device that can fine-tune the left and right eyes separately to produce clear artificially generated images. In particular, it relates to an augmented reality device that can separately adjust the clarity of artificial images for both eyes. It does not require separate frames and lenses and can reduce weight. And it is an augmented reality device that does not need to adapt to users with different degrees to change different lenses. It has a wider application range and can fine-tune clear artificially generated images for the left and right eyes respectively.

The existing augmented reality (AR, or "augmented reality") device is a technology that integrates digital information and actual information in real time. See-through near-eye display technology is a key component of AR, through which computer-generated images or videos (i.e., digital information) can be displayed on existing environmental images (i.e., actual information). Furthermore, the difference between AR and displays such as LCD and flat panel displays is that AR is a wearable device and is very close to the eyes. Therefore, not only the optical performance of the display but also the user's vision needs to be considered. According to a recent study on global myopia prevalence, it is estimated that after 2050, half of the world's population will be myopic. Current AR designs may require users with visual impairments (for example) to wear additional optical correction glasses. As a result, the user's experience of AR, or the performance of the AR device, is reduced because wearing additional optical correction glasses makes the AR device bulky and the eyes are further away from the exit pupil. For example, the "Hololens" (Microsoft) design is not convenient for visually impaired users. The glasses are installed in a Head Mounted Display (HMD), so that the frames may be squeezed and deformed or the lenses may be scratched. And the images seen are sometimes smaller than those seen by users without glasses. This is because part of the field of view (FOV) is blocked by the frames of the Hololens and glasses. Of course, users can also choose to wear contact lenses or even AR devices similar to contact lenses. However, for the elderly, in addition to being prone to discomfort due to dry eyes, they also have low acceptance because they use less contact lenses. With the current AR design, when a myopic user does not wear optical correction glasses, while displaying artificially generated digital images (or videos) on the actual environment image, there is no way to target the user's left eye and The degree of myopia of the right eye is determined, and the digital images are fine-tuned to match the design of the degree of myopia of the left eye and right eye respectively. In view of this, it is necessary to develop technology that can solve the above conventional shortcomings.

The purpose of the present invention is to provide an augmented reality device that can fine-tune clear artificial images for the left and right eyes respectively. It can adjust the clarity of the artificial images for both eyes separately, does not require separate frames and lenses, and can reduce weight. , and there is no need to change different lenses to suit users with different degrees of power, and it has the advantages of a wider application range. In particular, the problem to be solved by the present invention is that with the current AR design, when a myopic user does not wear optical correction glasses, artificially generated digital images (or videos) are displayed on the actual environment image. At the same time, there is no problem of fine-tuning the digital image to match the myopia degrees of the left eye and right eye of the user respectively. The technical means to solve the above problems is to provide an augmented reality device that can finely adjust the left and right eyes to produce clear artificially generated images, which includes: A shell unit has a first virtual optical axis, a second virtual optical axis, a first perspective window part, a second perspective window part and an inner space; the first virtual optical axis and the second virtual optical axis The optical axes are parallel to each other, respectively corresponding to the eyes of a user, and linearly connected to the first perspective window part, the second perspective window part and the inner space of the shell. The inner space of the shell is between the first Between the see-through window part and the second see-through window part; so that the two eyes can view an actual image through the first see-through window part and the second see-through window part along the first and second virtual optical axes respectively ; A first artificial image adjustment unit is located in the space inside the shell. The first artificial image adjustment unit has a first artificial image display part, a first optical processing part, a first plane reflection part, a first The light combining part and a first focus adjustment part; the first artificial image display part is used to generate a first artificial image, and the first artificial image is transmitted to the first plane reflection part through the first optical processing part, and It is reflected from the first plane reflection part to the first light combining part, overlaps with the actual image at the first light combining part, and then reaches one of the eyes along the first virtual optical axis; the first focal length The adjustment part is connected to the first artificial image display part and is used to adjust the distance between the first artificial image display part and the first optical processing part, thereby adjusting the clarity of one of the two eyes viewing the first artificial image. ; A second artificial image adjustment unit is provided in the space inside the shell. The second artificial image adjustment unit has a second artificial image display part, a second optical processing part, a second plane reflection part, a second The light combining part and a second focus adjustment part; the second artificial image display part is used to generate a second artificial image, and the second artificial image is transmitted to the second plane reflection part through the second optical processing part, and The second plane reflection part reflects to the second light combining part, overlaps with the actual image in the second light combining part, and then reaches the other eye of the two eyes along the second virtual optical axis; the second light combining part The focus adjustment part is connected to the second artificial image display part and is used to adjust the distance between the second artificial image display part and the second optical processing part, thereby adjusting the distance between the other eye of the two eyes when viewing the second artificial image. clarity; and A control unit is connected and used to control the first artificial image display part, the first focus adjustment part, the second artificial image display part and the second focus adjustment part. The above objects and advantages of the present invention can be easily understood from the following detailed description of selected embodiments and the accompanying drawings. The present invention is described in detail below with the following examples and drawings:

Referring to Figures 1, 2A, 2B, 2C, 3A, 3B, 3C, 4 and 5, the present invention is an augmented reality device that can fine-tune the left and right eyes to produce clear artificially generated images respectively, which includes: a shell unit 10, having a first virtual optical axis M1, a second virtual optical axis M2, a first transparent window portion 11, a second transparent window portion 12 and an inner shell space 13. The first virtual optical axis M1 and the second virtual optical axis M2 are parallel to each other, respectively corresponding to the binocular eyes 92 of a user 91, and respectively linearly connect the first transparent window portion 11, the second transparent window portion 12 and the inner space 13 of the shell, and the inner space 13 of the shell is between the first transparent window portion 11 and the second transparent window portion 12. The binocular eyes 92 can view a real image N through the first transparent window portion 11 and the second transparent window portion 12 along the first and second virtual optical axes M1 and M2, respectively. A first artificial image adjustment unit 20 is disposed in the housing inner space 13, and the first artificial image adjustment unit 20 has a first artificial image display unit 21, a first optical processing unit 22, a first plane reflection unit 23, a first light combining unit 24, and a first focal length adjustment unit 25. The first artificial image display unit 21 is used to generate a first artificial image N1, which is transmitted to the first plane reflection unit 23 via the first optical processing unit 22, and is reflected to the first light combining unit 24 via the first plane reflection unit 23, and overlaps with the real image N in the first light combining unit 24, and then reaches one of the binocular eyes 92 along the first virtual optical axis M1. The first focal length adjustment unit 25 is connected to the first artificial image display unit 21 to adjust the distance between the first artificial image display unit 21 and the first optical processing unit 22, thereby adjusting the clarity of the first artificial image N1 viewed by one of the two eyes 92. A second artificial image adjustment unit 30 is disposed in the housing inner space 13, and the second artificial image adjustment unit 30 has a second artificial image display unit 31, a second optical processing unit 32, a second plane reflection unit 33, a second light combining unit 34 and a second focal length adjustment unit 35. The second artificial image display unit 31 is used to generate a second artificial image N2, which is transmitted to the second plane reflection unit 33 through the second optical processing unit 32, and reflected to the second light combining unit 34 through the second plane reflection unit 33, and overlaps with the real image N in the second light combining unit 34, and then reaches the other eye of the two eyes 92 along the second virtual optical axis M2. The second focal length adjustment unit 35 is connected to the second artificial image display unit 31, and is used to adjust the distance between the second artificial image display unit 31 and the second optical processing unit 32, and further adjust the clarity of the second artificial image N2 viewed by the other eye of the two eyes 92. A control unit 40 is connected and used to control the first artificial image display section 21, the first focal length adjustment section 25, the second artificial image display section 31 and the second focal length adjustment section 35. In practice, referring to FIGS. 2A and 2C, regarding the first corresponding relationship between the first artificial image display section 21 and the first optical processing section 22: The first artificial image display section 21 is disposed between the first optical processing section 22 and the first plane reflection section 23. The first optical processing section 22 may be a parabolic mirror structure. Referring to FIGS. 2B and 2C, regarding the first corresponding relationship between the second artificial image display section 31 and the second optical processing section 32: The second artificial image display section 31 is disposed between the second optical processing section 32 and the second plane reflection section 33. The second optical processing section 32 may be a parabolic mirror structure. Referring to FIGS. 3A and 3C, regarding the second corresponding relationship between the first artificial image display section 21 and the first optical processing section 22: The first optical processing section 22 is disposed between the first artificial image display section 21 and the first plane reflection section 23. The first optical processing section 22 may be a combination device of a parabolic mirror structure and a hyperbolic mirror structure. Referring to FIGS. 3B and 3C, regarding the second corresponding relationship between the second artificial image display section 31 and the second optical processing section 32: The second optical processing section 32 is disposed between the second artificial image display section 31 and the second plane reflection section 33. The second optical processing unit 32 can be a combination of a parabolic mirror structure and a hyperbolic mirror structure. Furthermore, the first plane reflecting unit 23 can be a plane reflecting mirror structure. The first light combining unit 24 can be a light combining mirror structure. The second plane reflecting unit 33 can be a plane reflecting mirror structure. The second light combining unit 34 can be a light combining mirror structure. Furthermore, the present case can further include (as shown in Figures 1, 2A and 3A): at least one pupil movement detecting unit 50, which is disposed in the space 13 inside the shell and is electrically connected to the control unit 40, and the at least one pupil movement detecting unit 50 includes a spectroscope 51 and a detection structure 52. The spectroscope 51 is disposed on at least one of the first virtual optical axis M1 and the second virtual optical axis M2, and is used to reflect the pupil image of the eye corresponding to the binocular eyes 92 to the detection structure 52, and the detection structure 52 receives the pupil image to determine the moving direction of the eye, and further controls one of the first artificial image N1 and the second artificial image N2 to move along with the moving direction of the eye (to improve the visual field). A first polarizer 61 is disposed in the housing inner space 13 and is coaxial with the first virtual optical axis M1; a second polarizer 62 is disposed in the housing inner space 13 and is coaxial with the second virtual optical axis M2, and the polarization direction of the second polarizer 62 is 90 degrees different from that of the first polarizer 61. Thus, the first artificial image N1 reaches one of the two eyes 92 through the first polarizer 61; the second artificial image N2 reaches the other of the two eyes 92 through the second polarizer 62, thereby producing a three-dimensional image effect for the two eyes 92. It is particularly important to explain that, since the binocular eyes 92 directly see the external scene (i.e., the actual image N) through the first and second perspective windows 11 and 12 (the first and second light combining parts 24 and 34 do not affect the actual image N), the view of the external scene is not affected by the reflective lens assembly (i.e., the first artificial image adjustment unit 20 and the second artificial image adjustment unit 30). However, the path of the artificial image (i.e., the first artificial image N1 and the second artificial image N2) is limited by the field of view of the reflective lens set. Therefore, when the eye position tracking device (i.e., the at least one pupil movement detection unit 50) is used, the horizontal movement direction of the eyeball (e.g., the pupil image of the two eyes 92) can be tracked, and then the control unit 40 can adjust the picture movement of the artificial image in real time in accordance with the eyeball movement, thereby increasing the visible picture range. The key point of this case is that when applied to the user 91 with visual impairment, the user 91 does not need to wear additional optical correction glasses. Because this case is aimed at this part, it has the following designs: [a] The first focal length adjustment unit 25. Referring to FIG. 2A , the first artificial image adjustment unit 20 is provided with the first focal length adjustment unit 25, which is connected to the first artificial image display unit 21 and the control unit 40. Assuming that there is an original distance L0 between the first artificial image display unit 21 and the first optical processing unit 22, the degree of one of the eyes 92 can be adjusted to a first optical distance L1 (equivalent to adjusting the focal length) through the first focal length adjustment unit 25, so that one of the eyes 92 can clearly see (improve the clarity) the first artificial image N1. [b] Second focal length adjustment unit 35. Referring to FIG. 2B , the second artificial image adjustment unit 30 is provided with the second focal length adjustment unit 35, which is connected to the second artificial image display unit 31 and the control unit 40. Assuming that the second artificial image display unit 31 and the second optical processing unit 32 have the original distance L0, which also corresponds to the degree of the other eye of the pair of eyes 92, the second focal length adjustment unit 35 can be adjusted to a second optical distance L2 (equivalent to adjusting the focal length), so that the other eye of the pair of eyes 92 can clearly see (improve clarity) the second artificial image N2. In particular, there is no need to add other frames or optical lenses, and there is no need to replace optical lenses of different degrees to cooperate with different users 91 (some people have high myopia), which greatly improves convenience and acceptance. Regarding the optical focusing of the present invention, for example, the control unit 40 may have the following built-in (Formula 1) and (Formula 2): X*X'=f ² (Formula 1) D=1/(X') (Formula 2) Where: f represents the focal length of the lens group (e.g., 20 mm). X is the moving distance of the display (e.g., the first optical distance L1, or the second optical distance L2). When the units of X and X' are meters, D*100 is degrees. Further, (Table 1) can be obtained: (Table 1) D 2.5 5 7.5 10 3.75 6.25 8.75 X' 0.4 0.2 0.133 0.1 0.2666 0.16 0.114 X 1 2 3 4 1.5 2.5 3.5 The advantages and effects of the present invention can be summarized as follows: [1] The clarity of the artificial images of the two eyes can be adjusted separately. Taking the first artificial image adjustment unit corresponding to one of the two eyes as an example, the first focus adjustment unit is provided, and the first focus adjustment unit is connected to the first artificial image display unit and the control unit. Assuming that there is an original distance between the first artificial image display unit and the first optical processing unit, the degree of the one of the two eyes can be adjusted to a first optical distance (i.e., focusing) through the first focus adjustment unit, so that the one of the two eyes can clearly see (improve the clarity) the first artificial image. As for the other eye of the two eyes, it corresponds to the second artificial image adjustment unit, and the adjustment method is the same and will not be repeated. Therefore, the clarity of the artificial images of the two eyes can be adjusted separately. [2] No need to set up separate frames and lenses, which can reduce weight. In this case, the clarity of the artificial image can be adjusted and improved by adjusting the distance between the corresponding artificial image display unit and the optical processing unit. No need to set up separate frames and lenses, which effectively reduces weight. Therefore, no need to set up separate frames and lenses can reduce weight. [3] No need to change different lenses to suit users with different degrees of myopia, which has a wider range of applications. In this case, the clarity of the artificial image is not adjusted through optical lenses, so there is no need to change different lenses to suit different users (especially if some users have high myopia, the lenses must be customized and are difficult to obtain). Therefore, no need to change different lenses to suit users with different degrees of myopia, which has a wider range of applications. The above is only a detailed description of the present invention through a preferred embodiment. Any simple modification and change made to the embodiment does not deviate from the spirit and scope of the present invention.

10: Shell unit 11: First transparent window 12: Second transparent window 13: Shell space 20: First artificial image adjustment unit 21: First artificial image display unit 22: First optical processing unit 23: First plane reflection unit 24: First light combining unit 25: First focal length adjustment unit 30: Second artificial image adjustment unit 31: Second artificial image display unit 32: Second optical processing unit 33: Second plane reflection unit 34: Second light combining unit 35: Second focus adjustment unit 40: Control unit 50: Pupil movement detection unit 51: Spectrum 52: Detection structure 61: First polarizing lens 62: Second polarizing lens 91: User 92: Binoculars M1: First virtual optical axis M2: Second virtual optical axis N: Real image N1: First artificial image N2: Second artificial image L0: Original distance L1: First optical distance L2: Second optical distance

FIG. 1 is a schematic diagram of an embodiment of the present invention. FIG. 2A is a schematic diagram of a first correspondence between the first artificial image display unit and the first optical processing unit of the present invention. FIG. 2B is a schematic diagram of a first correspondence between the second artificial image display unit and the second optical processing unit of the present invention. FIG. 2C is a schematic diagram of an application example of the first (second) optical processing unit of FIG. 2A (FIG. 2B). FIG. 3A is a schematic diagram of a second correspondence between the first artificial image display unit and the first optical processing unit of the present invention. FIG. 3B is a schematic diagram of a second correspondence between the second artificial image display unit and the second optical processing unit of the present invention. FIG. 3C is a schematic diagram of an application example of the first (second) optical processing unit of FIG. 3A (FIG. 3B). FIG. 4 is a schematic diagram of a first application example of the present invention. Figure 5 is a schematic diagram of the second application example of the present invention.

10: Shell unit

11: First perspective window

12: Second perspective window

20: First artificial image adjustment unit

21: First artificial image display unit

22: First optical processing unit

23: First plane reflection part

24: The first light synthesis department

25: First focal length adjustment unit

30: Second artificial image adjustment unit

31: Second artificial image display unit

32:Second Optical Processing Department

33: Second plane reflection part

34: Second light combining unit

35: Second focal length adjustment unit

40:Control unit

50:Pupil movement detection unit

51: Spectroscope

52: Detection structure

92: Eyes

M1: First virtual light axis

M2: Second virtual optical axis

N: Actual image

N1: The first artificial image

N2: Second artificial image

Claims (6)

An augmented reality device that can fine-tune the left and right eyes to produce clear artificially generated images, comprising: A housing unit, having a first virtual optical axis, a second virtual optical axis, a first transparent window, a second transparent window, and a housing inner space; the first virtual optical axis and the second virtual optical axis are parallel to each other, respectively corresponding to the eyes of a user, and linearly connect the first transparent window, the second transparent window, and the housing inner space, respectively, and the housing inner space is between the first transparent window and the second transparent window; so that the eyes can respectively view a real image along the first and second virtual optical axes through the first transparent window and the second transparent window; A first artificial image adjustment unit is disposed in the space inside the housing. The first artificial image adjustment unit has a first artificial image display unit, a first optical processing unit, a first plane reflection unit, a first light combining unit and a first focal length adjustment unit. The first artificial image display unit is used to generate a first artificial image. The first artificial image is transmitted to the first plane reflection unit through the first optical processing unit, and is reflected to the first light combining unit through the first plane reflection unit, and overlaps with the real image in the first light combining unit, and then reaches one of the two eyes along the first virtual optical axis. The first focal length adjustment unit is connected to the first artificial image display unit, and is used to adjust the distance between the first artificial image display unit and the first optical processing unit, thereby adjusting the clarity of the first artificial image viewed by one of the two eyes; A second artificial image adjustment unit is disposed in the space inside the housing. The second artificial image adjustment unit has a second artificial image display unit, a second optical processing unit, a second plane reflection unit, a second light combining unit and a second focal length adjustment unit. The second artificial image display unit is used to generate a second artificial image. The second artificial image is transmitted to the second plane reflection unit through the second optical processing unit, and is reflected to the second light combining unit through the second plane reflection unit, and overlaps with the real image in the second light combining unit, and then reaches the other eye of the two eyes along the second virtual optical axis. The second focal length adjustment unit is connected to the second artificial image display unit to adjust the distance between the second artificial image display unit and the second optical processing unit, and further adjust the clarity of the second artificial image viewed by the other eye of the two eyes; and A control unit is connected and used to control the first artificial image display unit, the first focal length adjustment unit, the second artificial image display unit and the second focal length adjustment unit. As described in claim 1, the left and right eyes can respectively fine-tune the augmented reality device to produce clear artificially generated images, wherein: The first artificial image display unit is arranged between the first optical processing unit and the first plane reflection unit; The first optical processing unit is a parabolic mirror structure; The second artificial image display unit is arranged between the second optical processing unit and the second plane reflection unit; and The second optical processing unit is a parabolic mirror structure. As described in claim 1, the left and right eyes can respectively fine-tune the augmented reality device to produce clear artificially generated images, wherein: The first optical processing unit is disposed between the first artificial image display unit and the first plane reflection unit; The first optical processing unit is a combination of a parabolic mirror structure and a hyperbolic mirror structure; The second optical processing unit is disposed between the second artificial image display unit and the second plane reflection unit; and The second optical processing unit is a combination of a parabolic mirror structure and a hyperbolic mirror structure. As described in claim 1, the left and right eyes can be fine-tuned to produce clear artificially generated images respectively, wherein: The first plane reflection part is a plane reflection mirror structure; The first light combining part is a light combining mirror structure; The second plane reflection part is a plane reflection mirror structure; and The second light combining part is a light combining mirror structure. The augmented reality device described in claim 1 that can fine-tune clear artificially generated images for the left and right eyes respectively, further includes: At least one pupil movement detection part is provided in the space inside the shell and is electrically connected to the control unit. The pupil movement detection part includes a beam splitter and a detection structure; and The spectroscope is disposed on at least one of the first virtual optical axis and the second virtual optical axis, and is used to reflect the image of the eye corresponding to the two eyes to the detection structure to determine the The moving direction of the eye further controls one of the first artificial image and the second artificial image to move along with the moving direction of the eye. The augmented reality device as described in claim 1 can fine-tune the left and right eyes to produce clear artificial images respectively, and further comprises: A first polarizer is arranged on the first virtual optical axis; and A second polarizer is arranged on the second virtual optical axis, and the polarization direction of the second polarizer is 90 degrees different from that of the first polarizer; Thus, the first artificial image reaches one of the two eyes through the first polarizer; and The second artificial image reaches the other eye through the second polarizer, thereby producing a three-dimensional image effect.

Images