WO2023103711A1 - Near-to-eye display apparatus and head-mounted device - Google Patents

Abstract

Provided in the embodiments of the present application are a near-to-eye display apparatus and a head-mounted device. The near-to-eye display apparatus comprises an image generation unit and an optical display element, wherein the optical display element is used for constructing a first optical path and constructing a second optical path; the first optical path and the second optical path are respectively used for forming a left-eye image and a right-eye image on an imaging plane; and the left-eye image and the right-eye image are seamlessly combined or partially overlapped, so as to synthesize original image information which is received by the image generation unit. By means of using a near-to-eye display device as provided in the present application, an on-site operator can perform an on-site operation while watching a remote guidance plan.

Description

Near-eye display device and head-mounted device

This application claims the priority of the Chinese patent application with the application number 202111510079.9 and the title of the invention "near-eye display device and head-mounted device" submitted to the China Patent Office on December 10, 2021, the entire contents of which are incorporated by reference in this application .

technical field

The present application relates to the technical field of image display, in particular to a near-eye display device and a head-mounted device.

Background technique

In scenarios such as tower operations, high-altitude operations, or remote maintenance, when on-site operators are working on the front line, if they encounter some difficult problems that cannot be solved during the operation, they need the assistance of remote technical experts. The traditional method is that on-site operators use portable terminals, such as mobile phones, tablets, and remote experts to video, share on-site information with remote experts, remote experts provide guidance, and on-site operators watch the guidance of remote experts displayed on portable terminals. According to the guidance plan, the operation is carried out, resulting in low efficiency of on-site operations.

Contents of the invention

Embodiments of the present application provide a near-eye display device, an inductor having the near-eye display device, and a head-mounted device, which can improve work efficiency.

In the first aspect, an embodiment of the present application provides a near-eye display device. The near-eye display device includes an image generation unit and an optical display element, and the image generation unit is used to receive the original image information transmitted by the control unit and generate image light. The image The light is a light beam carrying the original image information, and the optical display element is used to construct a first optical path, and the first optical path is used to project the image light onto an imaging surface and form a light beam on the imaging surface. Left-eye image, the optical display element is used to construct a second optical path, the second optical path is used to project the image light onto an imaging surface and form a right-eye image on the imaging surface, the left The eye image and the right eye image are seamlessly spliced or partially overlapped to synthesize the original image information. Specifically, the first optical path is constructed by the optical display element and the left eye together, and the second optical path is constructed by the optical display element and the right eye together.

The near-eye display device provided by this application is shared by the left eye and the right eye, that is, in the wearing state, the near-eye display device is directly in front of the area between the two eyes, and the image information on the imaging surface can be watched by both eyes at the same time, and the near-eye display device will not Block the view. The non-blocking of the line of sight defined in this application means that when wearing a near-eye display device, both eyes can still watch the things in front of the eyes, so that the on-site operators can watch the image information and perform real-world operations simultaneously. Moreover, using binoculars to watch the image, the combined image of the left-eye image and the right-eye image can provide better image quality. If there is only one eye to watch images, it is easy to cause visual fatigue, so the near-eye display device provided by the present application can also improve the comfort of viewing image information and reduce visual fatigue.

In a possible implementation manner, the width of the optical display element is less than or equal to 70mm, and the width of the optical display element is the size of the optical display element in the first direction, and the first direction is the size of the left eye and the right eye. The connection direction of the eye. The advantage of this solution by limiting the upper limit of the width of the optical display element is that the near-eye display device 100 can not block the line of sight, and the user can watch the images in the near-eye display device 100 and the real scene in front of him at the same time.

In a possible implementation manner, the width of the optical display element is greater than or equal to 40mm. In this embodiment, the middle position of the connecting line between the left eye and the right eye is the reference point, and in the extending direction of the optical axis of the optical display element 30, the distance between the optical display element 30 and the reference point is Exit pupil distance, the distance between the imaging surface and the reference point is the image distance, in the first direction, the size of the image information on the imaging surface is the image width, when the exit pupil distance is 80mm, the image distance is 250mm, and the image width is 150mm. This solution limits the lower limit of the width of the optical display element, in order to meet the preset imaging quality and normal image combination.

In a possible implementation manner, in the first direction, the size of the overlapping portion between the left-eye image and the right-eye image is 5%-60% of the size of the original image information. Since there are design tolerances, manufacturing errors, and assembly tolerances in the process of designing, manufacturing, and assembling optical display elements, it is appropriate to limit the size of the combined image area to 5% larger than the size of the original image information in this embodiment. Therefore, even if there is an assembly error during the use of the near-eye display device, the integrity of the joint image will be guaranteed. In actual design and manufacture, in order to prevent the problem of non-normal joint image caused by manufacturing errors (normal joint image refers to: the imaging surface composed of the left eye image and the right eye image does not contain the light beam generated by the image generation unit. All the information of the image formed by the image), usually making the combined image area greater than or equal to 5% of the lateral dimension of the image. The design that the upper limit of the size of the combined image area is 60% of the size of the original image information can make the near-eye display device provided by the present application have a wider application position, that is to say, the user can adjust a variety of different positions to suit his viewing Both of them can meet the conditions of complete imaging, which makes the application flexibility of the near-eye display device better.

In a possible implementation manner, the image generation unit and the optical display element are stacked in the direction in which the optical axis of the optical display element extends, and the optical display element is located between the image generation unit and the imaging surface In between, the optical display element includes a central area around the optical axis, and the image generation unit is correspondingly arranged on the periphery of the central area (referring to the area outside the central area), and the light output direction of the image generation unit is the same as that of the light An angle is formed between the axes. In this solution, the image light generated by the image generation unit directly hits the optical display element, and the image light enters the human eye after being reflected by the optical display element. In one embodiment, in order to ensure that the optical path between the optical display element and the human eye is not blocked, the image generation unit may be arranged corresponding to the edge area of the optical display element. Specifically, the optical display element includes an optical effective area, the optical axis of the optical display element can be located in the center of the optical effective area, and the image light can be reflected by the optical display element to the human eye in the optical effective area, and the optical display element includes surrounding light The central area of the axis, which may be part of the optically active area, or the central area may be identical to the optically active area. The image generation unit is correspondingly arranged on the periphery of the central area, and the angle between the light output direction of the image generation unit and the optical axis is formed, that is, the optical display element reflects the image light to the human eye through its central area, and the image generation unit is set to avoid The optical path from the central area to the human eye ensures that the human eye can see a complete image.

In a possible implementation manner, the image generation unit and the optical display element are stacked in the direction in which the optical axis of the optical display element extends, and the image generation unit is located between the optical display element and the imaging surface between. Laminated arrangement means that: in the extending direction of the optical axis of the optical display element, the light-emitting surface of the image generating unit faces the light-incident surface of the optical display element. In this design scheme, the image generation unit can be arranged in a space away from the human eye of the optical display element, and the image generation unit and the optical display element are stacked, and the light output surface of the image generation unit can be perpendicular to the optical axis of the optical display element. That is to say, the image generation unit is arranged parallel to the optical display element. In this solution, the image light generated by the image generation unit directly hits the optical display element, and the image light enters the human eye after being refracted by the optical display element. Since the image generation unit is on the side of the optical display element away from the human eye, it will not block or occupy the optical path that the image generation unit transmits light to the human eye, so that the near-eye display device can be smaller in size, which is conducive to the thinning of the near-eye display device the design of.

In a possible implementation manner, the optical display element includes a first lens and a second lens arranged in layers, the second lens is located between the first lens and the image generating unit, and the first lens Both the surface away from the second lens and the surface of the second lens facing the image generating unit are Fresnel surfaces. With this solution, the width of the optical display element in the first direction is 45.6mm, and the limitation of the width of the optical display element will not block the line of sight. The image width on the imaging surface is 150mm, the image width seen by the left eye is 82.5mm, the image width seen by the right eye is 82.5mm, and the width of the overlapping part of the image seen by the left and right eyes is 15mm. At this time, the images seen by the left and right eyes are normally combined in the brain , the final effect is equivalent to binocular viewing of a 6.8-inch screen at a distance of 250mm.

In a possible implementation manner, the near-eye display device includes a fixing part, a connecting part, and a display part, the display part includes a casing, the image generation unit and the optical display element are arranged inside the casing, and the connecting part Connected between the fixing part and the shell, the fixing part is used to be fixedly connected to the fixing body of the head-mounted device.

In a possible implementation manner, the connection part is used to correct the use position of the display part. In one embodiment, the connecting part can have the ability of elastic bending and deformation. For example, the connecting part can adjust its bending shape under the action of external force, so that the specific position of the display part can be changed, and the display can be adjusted according to the specific use environment. The position of the part is determined to determine the specific position of the optical display element to obtain clear image information. In other embodiments, the connecting part may also be a link structure with multiple degrees of freedom, and the specific position of the display part may be adjusted through the relative movement of the link. In one embodiment, no control unit is provided in the near-eye display device, the control unit is provided in the fixed body of the head-mounted device, and a data line for transmitting original image information between the control unit and the image generation unit is provided inside the connection part , the fixing part is provided with a male connector, and the fixed body of the head-mounted device is provided with a female connector, through the docking of the male connector and the female connector, the image information of the control unit is transmitted to the near-eye display device.

In a possible implementation manner, the formula for calculating the width of the optical display element is:

Wherein, the size of the expected virtual image is L, the distance from the virtual image to the binoculars is H, the overlapping rate of the left-eye image and the right-eye image is k%, the desired exit pupil distance is set as E, and the pupillary distance is P, the optical The width of the display element is D.

In a second aspect, the present application provides a head-mounted device, including a fixed body and the near-eye display device described in any possible implementation manner of the first aspect, where the near-eye display device is connected to the fixed body.

In a possible implementation manner, the minimum distance between the near-eye display device and the fixed main body is 40-80 mm. In a possible implementation manner, in the horizontal plane, the adjustment range of the near-eye display device ensures that the exit pupil distance can be adjusted within 40-80 mm (adjusting the distance between the optical display element and the human eye). The near-eye display device can adjust the left and right positions of the optical display element through the connecting part, and adjust the center of the optical display element (or the center of the near-eye display device) at the center of the line connecting the two pupils to ensure the imaging of the left eye image and the right eye image. The surface contains all the information of the image formed by the image carried by the light beam generated by the image generating unit. The height of the near-eye display device can also be adjusted in the vertical plane. The vertical plane refers to the direction perpendicular to the horizontal plane. The horizontal plane refers to the plane where the horizontal line of sight of the human eye is located. The center of the optical display element can be adjusted by 80 degrees in the vertical plane. , specifically 50° above the standard field of view, 30° below the standard field of view, and the standard field of view is horizontal, set as 0°.

The head-mounted device provided in this application may be a safety helmet, a headband, a headband, a hat, glasses, earphones and other devices.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiment of the present application or the background art, the following will describe the drawings that need to be used in the embodiment of the present application or the background art.

FIG. 1 is a schematic diagram of a near-eye display device provided in an embodiment of the present application;

Fig. 2 is a schematic diagram of the internal structure layout of a near-eye display device provided in an embodiment of the present application;

Fig. 3 is a schematic diagram of the connection relationship between the image generation unit and the control unit and the specific architecture of the control unit in Fig. 2;

Fig. 4 is a schematic diagram of the internal structure layout of a near-eye display device provided in an embodiment of the present application;

FIG. 5A is a schematic diagram of the internal structure layout of a near-eye display device provided in an embodiment of the present application;

Fig. 5B is a schematic view in another direction of the embodiment shown in Fig. 5A, combining Fig. 5A and Fig. 5B to show the positional relationship between the image generating unit and the optical display element;

FIG. 6 is a schematic diagram of an internal structure layout of a near-eye display device provided in an embodiment of the present application;

Fig. 7 is a schematic diagram of an internal structural layout of a near-eye display device provided in an embodiment of the present application;

Fig. 8 is a schematic diagram of an internal structural layout of a near-eye display device provided in an embodiment of the present application;

Fig. 9A is a schematic diagram of the positional relationship between the optical display element and the image generation unit of the near-eye display device provided in an embodiment of the present application and the application scene;

Fig. 9B is a schematic diagram of the positional relationship and application scenarios between the optical display element and the image generation unit of the near-eye display device provided in an embodiment of the present application;

Fig. 10A is a schematic diagram of the positional relationship between the optical display element and the image generating unit of the near-eye display device provided in an embodiment of the present application and the application scene;

Fig. 10B is a schematic diagram of the positional relationship and application scenario between the optical display element and the image generating unit of the near-eye display device provided in an embodiment of the present application;

Fig. 11, Fig. 12, Fig. 13 and Fig. 14 are optical schematic diagrams of a near-eye display device provided in an embodiment of the present application;

Fig. 15 is an optical path diagram of a near-eye display device provided in an embodiment of the present application, expressing the parameters in the calculation formula of the width of the optical display element;

Fig. 16 is a schematic diagram of a specific embodiment of an optical display element of a near-eye display device provided in an embodiment of the present application;

Fig. 17 is a schematic diagram of a near-eye display device provided in an embodiment of the present application;

Fig. 18 is a schematic diagram of a head-mounted device provided in an embodiment of the present application;

Fig. 19 is a schematic diagram of adjusting the position of the near-eye display device on the head-mounted device in the vertical plane according to an embodiment of the present application;

Fig. 20 is a schematic diagram of a head-mounted device provided in an embodiment of the present application.

Detailed ways

Embodiments of the present application are described below with reference to the drawings in the embodiments of the present application.

Referring to FIG. 1 and FIG. 2 , in an implementation manner, a near-eye display device 100 provided by the present application includes a casing 10 , and the casing 10 includes a casing 11 and a light-transmitting panel 12 . The light-transmitting panel 12 is assembled to the casing 11 and together with the casing 11 encloses a receiving space G inside the housing 10 , the receiving space G is used for installing the image generating unit 20 and the optical display element 30 . The casing 11 is provided with an external interface 111, and the position of the external interface 111 can be used to charge the near-eye display device 100, and can also be used to realize data interaction between the near-eye display device 100 and other devices (such as a remote mobile phone or controller) (such as image information). Specifically, the position of the external interface 111 is used for setting a connector, and the connector can be used for charging, and can also be used for signal transmission between internal components of the near-eye display device 100 and external devices or control modules. In one embodiment, the housing 10 is in the shape of a cuboid (or cube) as a whole. In other implementations, the housing 10 may also be disc-shaped or cylindrical, or have an elliptical cross-section. Specifically, the light-transmitting panel 12 can be made of glass, such as tempered glass, and an optical film layer 121 can be provided on the light-transmitting panel 12, such as a light uniform film. The setting of the optical film layer 121 can improve the display effect of the near-eye display device 100. . The optical film layer 121 is disposed on the inner surface of the transparent panel 12 . A transparent protective layer can be provided on the outer surface of the light-transmitting panel 12, and the protective layer can protect the light-transmitting panel 12, and prevent the light-transmitting panel 12 from being scratched by sandstorms in harsh environments, thereby affecting the display effect. The shape of the light-transmitting panel 12 can be circular, square, elliptical, polygonal, etc. Specifically, a light-transmitting panel 12 of a suitable shape can be selected according to the shape of the optical display element 30 .

Referring to FIG. 2 , in an implementation manner, an optical display element 30 , an image generating unit 20 and a control unit 40 are disposed in the housing space G of the housing 10 of the near-eye display device 100 . The control unit 40 is electrically connected to the image generating unit 20 . The image generating unit 20 is a micro-display, the control unit 40 is a micro-display driver (or driving unit), and the control unit 40 is electrically connected to the image generating unit 20 through an FPC or a cable. The control unit 40 is used to transmit the original image information to the image generation unit 20. The image generation unit 20 is used to receive the original image information transmitted by the control unit 40 and generate image light. The image light can be understood as a light beam carrying the original image information.

Referring to FIG. 3 , in one embodiment, the control unit 40 and the image generating unit 20 are electrically connected through a flexible circuit board (FPC) 50 . Signal wires, data wires, and power wires can be arranged on the flexible circuit board 50 to realize the transmission of signals, data, and current between the control unit 40 and the image generating unit 20 . In one embodiment, the control unit 40 is provided with multiple functional modules, including: a driver module 41 , a frame buffer module 42 , a power supply module 44 , and a flash memory module 45 , and the control unit 40 is electrically connected to the external interface 111 . The driving module 41 is also called a driver, and the driving module 41 is used to turn on the image generating unit 20 . The power supply module 44 is also called power. The power supply module 44 is used to supply power to the image generating unit 20 . The power supply module 44 can be charged through the external interface 111 . The frame buffer module 42 is also called frame buffer, and the frame buffer module 42 is used for buffering images. The flash memory module 45 is also called flash, and the flash memory module 45 is used to realize the storage of image data. The frame buffer module 42 and the flash memory module 45 can be electrically connected to the external interface 111 , so that external original image information is transmitted to the frame buffer module 42 and the flash memory module 45 through the external interface 111 . In this application, the control unit 40 drives the image generation unit 20 to work through the electrical connection between each functional module in the control unit 40 and the image generation unit 20 . In one embodiment, the control unit 40 further includes a screen projection module 43 for projecting images on the mobile phone to the near-eye display device 100 for display, so as to improve the functions of the near-eye display device 100 . The control unit 40 in the near-eye display device 100 provided in the present application may also be provided with other functional modules, such as a WIFI module, a camera module, and the like.

Referring to FIG. 4 , in one embodiment, a control unit may not be provided inside the near-eye display device 100, only an image generation unit 20 and an optical display element 30 are provided, and the image generation unit 20 is electrically connected to an external control unit (with a drive module) . In one embodiment, the image generation unit 20 is electrically connected to the external interface 111, and the image generation unit 20 is electrically connected to an external control unit through the external interface 111. In this case, a device for The flexible cable that transmits the original image information, and the image is transmitted to the image generation unit through the external control unit. The implementation shown in FIG. 4 is equivalent to the need to combine the near-eye display device 100 with other terminal equipment through an external control unit to realize the transmission of original image information. The external control unit is conducive to the small size and light weight of the near-eye display device 100. the design of. In one embodiment, the near-eye display device 100 is connected to the head-mounted device, the control unit can be arranged on the head-mounted device, and an image signal transmission structure can be set between the head-mounted device and the near-eye display device 100, so that the head-mounted device The original image information of is transmitted to the image generation unit 20 in the near-eye display device 100 . The external interface 111 may also be electrically connected to the image signal transmission structure of the head-mounted device through an external control unit.

The image generation unit 20 is equivalent to the image source of the near-eye display device 100 , and the generated image light is transmitted to the optical display element 30 . The optical display element 30 is used to project image light onto the imaging surface, that is, present original image information on the imaging surface. The imaging surface is also referred to as the image surface. The function of the optical display element 30 is to refract, reflect or diffract the image light generated by the image generating unit 20 to form an image on the imaging surface. For example, the image light generated by the image generating unit 20 passes through The optical phenomena formed on the imaging surface behind the optical display element 30 may include real images and virtual images, and the image formed by the near-eye display device 100 provided in the embodiment of the present application may be a virtual image.

The specific description of the positional relationship between the image generating unit 20 and the optical display element 30 is as follows:

In the first embodiment, as shown in FIG. 2 and FIG. 4 , the image generation unit 20 and the optical display element 30 are stacked in the direction in which the optical axis of the optical display element 30 extends, and the image generation unit 20 is located in the optical Between the display element 30 and the imaging surface 200 . The imaging surface 200 in FIG. 2 and FIG. 4 is a schematic representation of the surface where the virtual image is located. The imaging surface 200 is located on the side of the casing 11 away from the light-transmitting panel 12, and the light-transmitting panel 12 is located on the side of the casing 11 facing the human eye. side. The stacked arrangement means that in the extending direction of the optical axis of the optical display element 30 , the light exit surface of the image generating unit 20 faces the light incident surface of the optical display element. There may be a gap between the light exit surface of the image generating unit 20 and the light entrance surface of the optical display element 30 , and other optical elements may also be provided, such as a lens with a light-condensing function, a lens with a light-filtering function, and the like. In one embodiment, the image generating unit 20 and the optical display element 30 are independent of each other, and are respectively assembled inside the casing 11 of the near-eye display device 100 . In one embodiment, the image generation unit 20 and the optical display element 30 are integrated into a module structure, for example: the image generation unit 20 and the optical display element 30 are assembled into an integrated module structure (the two can be connected by a frame ), and then install some module structures in the housing 11.

In the accommodation space G inside the casing 10 of the near-eye display device 100 , the optical display element 30 is located between the image generating unit 20 and the light-transmitting panel 12 . It can also be understood that the optical display element 30 is located on the side of the image generating unit 20 facing the human eye. In this design scheme, the image generation unit 20 can be arranged in the space on the side of the optical display element 30 away from the human eye, and the image generation unit 20 and the optical display element 30 are stacked. The light output surface of the image generation unit 20 can be perpendicular to the optical surface. The optical axis of the display element 30, that is, the image generation unit 20 is arranged in parallel with the optical display element 30. In this solution, the image light generated by the image generation unit 20 directly hits the optical display element 30, and the image light passes through the optical display element 30 of refraction into the human eye. Since the image generation unit 20 is on the side of the optical display element 30 away from the human eye, it will not block or occupy the optical path for the image generation unit 20 to transmit light to the human eye, so that the near-eye display device 100 can be smaller in size, which is beneficial to the near-eye The thinner design of the display device 100 .

In the second embodiment, as shown in FIG. 5A and FIG. 5B , the image generating unit 20 and the optical display element 30 are stacked in the direction in which the optical axis of the optical display element 30 extends, and the optical display element 30 is located in the image Between the generating unit 20 and the imaging surface 200 . Explanations about the imaging surface 200 and the stacking arrangement are the same as those in the first implementation manner, and will not be repeated here. Fig. 5A and Fig. 5B express the same scheme, the image generating unit 20 in Fig. 5A and the image generating unit 20 in Fig. 5B can be regarded as a position, Fig. 5A shows a direction (direction one) of the near-eye display device 100 Cross-sectional view, FIG. 5B shows a cross-sectional view in another direction (direction two) of the near-eye display device 100. The direction perpendicular to the cross-sectional direction shown in FIG. The specific positional relationship with respect to the optical display element 30 . In this solution, the image light generated by the image generation unit 20 directly hits the optical display element 30 , and the image light enters the human eye after being reflected by the optical display element 30 . In one embodiment, in order to ensure that the optical path between the optical display element 30 and the human eye is not blocked, the image generation unit 20 may be arranged corresponding to the edge area of the optical display element 30 . Referring to FIG. 5B , specifically, the optical display element 30 includes an optical effective region R1, the optical axis A of the optical display element 30 can be located at the center of the optical effective region R1, and the image light can be transmitted by the optical display element 30 in the optical effective region R1. Reflected to the human eye, the optical display element 30 includes a central region R2 surrounding the optical axis A, and this central region R2 may be a part of the optically active region R1 , or the central region R2 may be identical to the optically active region R1 . The image generation unit 20 is correspondingly arranged on the periphery of the central region R2, and an angle is formed between the light output direction of the image generation unit 20 and the optical axis A, that is, the optical display element 30 reflects the image light to the human eye through its central region R2, and the image The setting of the generation unit 20 avoids the optical path from the central region R2 to the human eyes, so as to ensure that the human eyes can see a complete image.

In the first embodiment, the image light emitted by the image generating unit 20 can directly strike the optical display element 30, and the emission direction of the image light can be parallel to the extending direction of the optical axis of the optical display element 30 (see FIG. 4 ). In the second embodiment, an included angle is formed between the direction of the image light emitted by the image generation unit 20 and the extension direction of the optical axis of the optical display element 30 (see FIG. 5B ). The component 30 is arranged obliquely, so that the image light emitted by the image generating unit 20 can be reflected to human eyes after striking the optical display component 30 .

In the third implementation manner, the image generating unit 20 may be arranged on the side of the optical display element 30 . Referring to FIG. 6, FIG. 6 shows a section of the near-eye display device 100, and the direction perpendicular to this section is the direction of the optical axis of the optical display element 30. It can be seen from FIG. 6 that the position of the image generation unit 20 is not in the optical Between the display element 30 and the human eye, nor on the side of the optical display element 30 facing away from the human eye, that is, in the extending direction of the optical axis, the image generating unit 20 and the optical display element 30 are not stacked. On a plane perpendicular to the optical axis where the optical display element 30 is located, the image generating unit 20 is located on one side of the optical display element 30 . In one embodiment, the image light generated by the image generating unit 20 can be transmitted to the optical display element 30 through other light transmission medium (light guide medium), the direction of the image light can be changed through the light transmission medium, and projected to the optical display appropriate location on the element 30. In one embodiment, the image light generated by the image generation unit 20 can also be directly transmitted to the optical display element 30, that is, without relying on other light transmission media to change the direction of the image light, but through the oblique placement of the image generation unit 20 , so that the image light can be directly transmitted to the optical display element 30 .

In one embodiment, referring to FIG. 7 , the image generation unit 20 is obliquely arranged on the side of the optical display element 30 , and in the direction in which the optical axis of the optical display element 30 extends, part of the image generation unit 20 and the edge portion of the optical display element 30 Overlap settings. In one embodiment, referring to FIG. 8 , the image generation unit 20 is arranged obliquely on the side of the optical display element 30 with respect to the optical axis of the optical display element 30 , and in the direction in which the optical axis of the optical display element 30 extends, the image generation unit 20 and The optical display elements 30 are completely staggered with no overlapping parts.

As shown in FIGS. 9A and 9B , on the basis of the embodiments shown in FIGS. 7 and 8 , the image generation unit 20 may be located on the side of the optical display element 30 away from the human eye, that is, the image generation unit 20 is located on the side of the optical display element 30 30 and the imaging surface 200, FIG. 9A shows an embodiment in which the image generating unit 20 is located above the horizontal line of sight in the wearing state, and the horizontal line of sight is the line of sight on the horizontal plane directly in front of the human eye. 9B shows that in the wearing state, the image generation unit 20 is located directly in front of both eyes, which may be on the horizontal line of sight, but is located between the optical display element 30 and the left eye (or right eye), so that the near-eye display device 100 It does not exceed the range of the interpupillary distance between the eyes, providing a more comfortable viewing experience. As shown in Figure 10A and Figure 10B, the image generation unit 20 can also be located on the side of the optical display element 30 facing the human eye, and Figure 10A shows an embodiment in which the image generation unit 20 is located above the horizontal line of sight in the wearing state, and the horizontal The line of sight is the line of sight on the horizontal plane directly in front of the human eye. 10B shows that in the wearing state, the image generation unit 20 is located directly in front of both eyes, which may be on the horizontal line of sight, but is located between the optical display element 30 and the left eye (or right eye), so that the near-eye display device 100 It does not exceed the range of the interpupillary distance between the eyes, providing a more comfortable viewing experience. It can be understood that, for a display device, the larger the size, the better the display effect can be designed. In the embodiment shown in FIG. 9A and FIG. 10A , since the image generation unit 20 is located above the horizontal line of sight, it will not block the line of sight of both eyes. Even if the size of the near-eye display device 100 provided by this embodiment is large, it will not affect the common imaging of both eyes. And at the same time, the real scene environment in front of the user can be viewed, which can provide a better display effect without blocking the line of sight. The implementations shown in Figure 9B and Figure 10B require strict control of the size of the image generation unit 20 and the size of the optical display element 30 to ensure that the near-eye display device 100 is applied directly in front of the eyes without blocking the line of sight and ensuring The user can watch the displayed image and the real scene environment in front at the same time. This design scheme can obtain a small-sized near-eye display device 100 , and the light and thin design can provide the user with a better experience.

The near-eye display device 100 provided in this application is applied between the two eyes and is shared by the left eye and the right eye, that is, in the wearing state, the near-eye display device 100 is directly in front of the area between the two eyes, and the images on the imaging surface can be watched by both eyes at the same time information, and the near-eye display device 100 will not block the line of sight. The non-blocking of the line of sight defined in this application means that when the near-eye display device 100 is worn, both eyes can still watch the things in front of the eyes, which can enable field operators to view image information and real operations Synchronization. Moreover, using binoculars to watch the image, the combined image of the left-eye image and the right-eye image can provide better image quality. If there is only one eye to watch images, it is easy to cause visual fatigue, so the near-eye display device provided by the present application can also improve the comfort of viewing image information and reduce visual fatigue.

Fig. 11, Fig. 12, Fig. 13 and Fig. 14 are the optical principle diagrams of the near-eye display device 100 provided by an embodiment of the present application. The optical principle consists of the real light represented by the solid line and the reverse extension line by the dotted line. The image on the imaging surface is a virtual image. The optical display element 30 includes a light incident surface, a light exit surface and an optical axis A. In the embodiments shown in FIGS. Facing the surface of the human eye, the optical axis A of the optical display element 30 is the center line of the light beam (light column), or the symmetry axis of the optical system. surface, and is located at the center of the optical display element 30 .

As shown in FIG. 11, the optical display element 30 is used to construct the first optical path L1, and the first optical path L1 includes a part of the optical path (solid line portion) between the image generating unit 20 and the optical display element 30 shown in FIG. 11 , a part of the optical path (solid line part) between the optical display element 30 and the human eye and a part of the optical path (dashed line part) between the optical display element 30 and the imaging surface 200, the first optical path L1 is used for the image generating unit The image light emitted by 20 is projected onto the imaging surface 200 , and forms the left-eye image 201 on the imaging surface 200 . As shown in FIG. 12, the optical display element 30 is used to construct a second optical path L2, and the second optical path L2 includes a part of the optical path between the image generating unit 20 and the optical display element 30 shown in FIG. 12 (solid line part), a part of the optical path (solid line part) between the optical display element 30 and the human eye, and a part of the optical path (dashed line part) between the optical display element 30 and the imaging surface 200, the second optical path L2 is used to The image light is projected onto the imaging surface 200 , and a right-eye image 202 is formed on the imaging surface 200 . Specifically, the first optical path L1 is constructed by the optical display element 30 and the left eye, and the second optical path L2 is constructed by the optical display element 30 and the right eye.

As shown in FIG. 13 , in one embodiment, the first optical path L1 and the second optical path L2 are formed at the same time, and a partial overlapping area is formed between the left-eye image 201 and the right-eye image 202, and this partial overlapping area can be a combined image. Area 203, that is, the image in the combined image area 203 can be seen by both the left eye and the right eye. The left eye image 201 and the right eye image 202 are combined in the brain, and the composite image generating unit 20 receives the original image from the control unit. image information. In the embodiment shown in FIG. 13 , the optical axis A of the optical display element 30 is in both the left-eye image 201 and the right-eye image 202 , and the center of the combined image area 203 is on the optical axis A. As shown in FIG. 14 , in an implementation manner, the left-eye image 201 and the right-eye image 202 are spliced to synthesize the original image information. In the embodiment shown in FIG. 14 , there is no overlapping area between the left-eye image 201 and the right-eye image 202 , and the stitching position between the left-eye image 201 and the right-eye image 202 is on the optical axis A. The original image information mentioned in this application refers to the physical information of the image, including color, geometric shape and so on. In this application, an optical display element 30 is used to form a left-eye image 201 and a right-eye image 202 on the imaging surface 200. The left-eye image 201 is part of the image information seen by the left eye, and the right-eye image 202 is the image information of the right eye. The part of the image information seen by the eyes, the left-eye image 201 and the right-eye image 202 synthesize the original image information. The left eye image 201 seen by the left eye is incomplete image information, that is, a part of the image information, and the right eye image 202 seen by the right eye is also incomplete image information, that is, a part of the image information. The left-eye image 201 seen by the left eye and the right-eye image 202 seen by the right eye are combined in the brain to form complete image information.

In a specific implementation manner, in the first direction X (the direction of the connecting line between the left eye and the right eye), the size of the overlapping portion between the left eye image 201 and the right eye image 202 is the original 5%-60% of the size of the image information. Since the optical display element 30 has design tolerances, manufacturing errors, and assembly tolerances in the process of designing, manufacturing, and assembling, it is appropriate to limit the size of the combined image area 203 to be greater than 5% of the size of the original image information in this embodiment. range, so that during the use of the near-eye display device 100, even if there is an assembly error, the integrity of the joint image will be guaranteed. In actual design and manufacture, in order to prevent the problem of non-normal joint image caused by manufacturing errors (normal joint image refers to: the imaging surface 200 composed of the left eye image 201 and the right eye image 202 does not include the image generated by the image generation unit 20. All the information of the image formed by the image carried by the light beam), usually make the combined image area 203 greater than or equal to 5% of the lateral dimension of the image. The upper limit of the size of the combined image area 203 is designed to be 60% of the size of the original image information, so that the near-eye display device 100 provided by the present application has a wider application position. That is to say, users can adjust a variety of different positions to suit their viewing habits, all of which can meet the conditions of complete imaging, making the near-eye display device 100 more flexible in application.

The width of the near-eye display device 100 is smaller than the interpupillary distance of human eyes, that is, the distance between the pupils of the two eyes. Specifically, the direction of the line connecting the left eye and the right eye is defined as the first direction X, and the size of the near-eye display device 100 in the first direction X is called the width of the near-eye display device 100, and the width of the near-eye display device 100 is less than or equal to two eye pupil distance. The width of the optical display element 30 (ie the size of the optical display element 30 in the first direction X) is smaller than the binocular interpupillary distance. The binocular interpupillary distance of an adult male is 60-73 mm, and 3 mm is reserved for the shell thickness of the near-eye display device 100 . In one embodiment, the width of the optical display element 30 is less than or equal to 70 mm. The advantage of the limitation of this range is that the near-eye display device 100 does not block the line of sight, and the user can watch the images in the near-eye display device 100 and the images in front of the eyes at the same time. real scene. In one embodiment, the width of the optical display element 30 is greater than or equal to 40mm. In this embodiment, the middle position of the connecting line between the left eye and the right eye is the reference point, and in the extending direction of the optical axis of the optical display element 30, the distance between the optical display element 30 and the reference point is Exit pupil distance, the distance between the imaging surface and the reference point is the image distance, in the first direction, the size of the image information on the imaging surface is the image width, when the exit pupil distance is 80mm, the image distance is 250mm, and the image width is 150mm.

Referring to FIG. 15 , the formula for calculating the width of the optical display element 30 provided in an embodiment of the present application is:

Wherein, the size of the expected virtual image is L, the distance from the virtual image to the binoculars is H, the overlapping rate of the left-eye image and the right-eye image is k%, the desired exit pupil distance is set as E, and the pupillary distance is P, the optical The display element 30 has a width D.

In a specific implementation, referring to FIG. 13 , the near-eye display device 100 is placed between the eyes, the interpupillary distance between the eyes is 60 mm, and the optical display element 30 is located at a distance of 80 mm from the human eye. The display effect of the near-eye display device 100 (including The position of the imaging surface 200, the size of the image) is: the imaging surface 200 is located at a distance of 250mm from the human eye, and the imaged size is a 6.8-inch image (150×84.4mm), and the combined image area 203 on the imaging surface 200 is set as the imaging surface 10% of the size of the image information on 200 in the first direction X (ie, the horizontal size of the image), that is, 15 mm. The area formed by connecting the left and right endpoints of the left eye image 201 of the imaging surface 200 with the left eye is the left visual area, and the area formed by connecting the left and right endpoints of the right eye image 202 of the imaging surface 200 is the right visual area. , the width of the boundary of the area formed by the left visual area and the right visual area at a distance of 80 mm from the human eye is the size of the width of the optical display element 30 in the first direction X required by this embodiment. In this embodiment, when the width of the optical display element 30 is 45.6 mm, the width of the combined image area 203 on the imaging surface (the size in the first direction X) is 15 mm, and the width of the left-eye image 201 is 82.5 mm. The width of the right-eye image 202 is 82.5 mm. The left-eye image 201 and the right-eye image 202 contain all the information of the image formed by the original image information carried by the light beam generated by the image generating unit 20 .

In a specific implementation manner, referring to FIG. 16 , the optical display element 30 includes a first lens 31 and a second lens 32 arranged in layers, and the second lens 32 is located between the first lens 31 and the image generating unit 20 Between, the surface of the first lens 31 away from the second lens 32 and the surface of the second lens 32 facing the image generating unit 20 are Fresnel surfaces. Specifically, both the first lens 31 and the second lens 32 are planar Fresnel lenses. The radius of curvature of the first lens 31 is: -40.909, and the conic coefficient is: 45.6; the radius of curvature of the second lens 32 is: 210, and the conic coefficient is: -0.9, the radius of curvature of the first lens 31 and the second lens 32 and the conic coefficient The setting can make the effective focal length of the optical display element 30 be 70.07mm, so that when the distance between the optical display element 30 and the human eye is 80mm, the formed image is at 250mm, the size of the image is 150X84.4, and the size of the combined image area is 15mm. The eyes of a person can form a normal image. Specifically, the distance between the first lens 31 and the pupil of the human eye is 80 mm, the first side 311 (the surface near the eye side) of the first lens 31 is a Fresnel surface, and the radius of curvature of the first side 311 is: -40.909 mm, conic coefficient: -7.54; the second side 312 of the first lens 31 is a smooth surface, and the radius of curvature of the second side 312 is 0; the thickness of the first lens 31 is 2mm. The first side 321 of the second lens 32 is a light surface (near the eye side), and the radius of curvature of the first side 321 of the second lens 32 is 0 mm; the second side 322 of the second lens 32 is a Fresnel surface, and the second lens 32 The radius of curvature of the second side 322 is 210, the conic coefficient is -0.9; the thickness of the second lens 32 is 2 mm; the gap between the first lens 31 and the second lens 32 is 0.5 mm. The effective apertures of the two lenses (referring to the width of the first lens 31 in the first direction and the width of the second lens 32 in the first direction) are the same, both being 45.8×25.8mm. In this embodiment, the image display unit 20 adopts a 1.5-inch OLED micro-display.

In the embodiment shown in FIG. 16 , the imaging surface 200 of the near-eye display device 100 can reach a distance of 250 mm from the human eye, and the size of the image is 150×84.4, which is equivalent to an image of 6.8 inches. The width of the optical display element 30 in the first direction X is 45.6mm (this numerical value is only the optimal aperture value calculated to achieve the desired imaging effect, and the aperture value can have slight changes, for example, within ±4.8mm, This change affects the size of the image combining area, but as long as the image combining area is guaranteed to be greater than or equal to 0, the requirement of normal image combining can be met), and the limitation of the width of the optical display element 30 will not block the line of sight. The image width on the imaging surface is 150mm, the image width seen by the left eye is 82.5mm, the image width seen by the right eye is 82.5mm, and the width of the overlapping part of the image seen by the left and right eyes is 15mm. At this time, the images seen by the left and right eyes are normally combined in the brain , the final effect is equivalent to binocular viewing of a 6.8-inch screen at a distance of 250mm. In this embodiment, parameters such as the radius of curvature of each optically effective surface of the first lens 31 and the second lens 32 , the central thickness, and the gap between the first lens 31 and the second lens 32 are not limited to the above values.

In the above-mentioned embodiment, when the near-eye display device 100 is used, the distance between the optical display element 30 and both eyes is 80mm, which is the optimal use distance under given parameters such as the interpupillary distance, and the user can adjust the distance according to his own interpupillary distance, etc. For example: it can be 40-80mm away from the human eye.

In one embodiment, referring to FIG. 17 , the near-eye display device 100 includes a fixing part 110, a connecting part 120 and a display part 130, the display part 130 includes a housing 10, and the image generation unit 20 and the optical display element 30 are set Inside the housing 10 , the connection part 120 is connected between the fixing part 110 and the housing 10 , and the fixing part 110 is used to be fixedly connected to a fixed body of the headset. Specifically, the fixing part 110 may be a buckle structure, and the fixing part 110 cooperates with a corresponding buckle structure on the fixing body of the head-mounted device to realize the connection between the near-eye display device 100 and the head-mounted device. The fixing part 110 and the corresponding fastening structure on the fixed main body of the headgear can be connected by a buckle structure, or can be connected by a plug-in structure, or can be fixedly connected by a fastener, for example, a fastener for the screw. The connection part 120 is used for correcting the use position of the display part 130 . In one embodiment, the connecting part 120 may have the ability of elastic bending and deformation. For example, the connecting part 120 may be able to adjust its bending shape under the action of an external force, so that the specific position of the display part 130 can be changed. The environment adjusts the position of the display part 130, determines the specific position of the optical display element 30, and obtains clear image information. In other embodiments, the connection part 120 may also be a link structure with multiple degrees of freedom, and the specific position of the display part 130 can be adjusted through the relative movement of the link. In one embodiment, the near-eye display device 100 is not provided with a control unit, the control unit is provided in the fixed body of the head-mounted device, and the connection part 120 is provided with a device for transmitting original image information between the control unit and the image generation unit 20. The fixed part 110 is provided with a male connector, and the fixed body of the head-mounted device is provided with a female connector. Through the docking of the male connector and the female connector, the image information of the control unit is transmitted to the near-eye display device 100 .

The near-eye display device 100 provided in the embodiment of the present application is applied to a head-mounted device, and the head-mounted device may be a safety helmet, a headband, a headband, a hat, glasses, an earphone, and the like. Taking a safety helmet as an example, referring to FIG. 18 , the fixing part 110 of the near-eye display device 100 is fixed on the front 1 of the head-mounted device 500. The corresponding position directly above the middle position of the binocular. When in use, the connecting portion 120 of the near-eye display device 100 can be adjusted. In the horizontal plane, the adjustment range of the near-eye display device 100 ensures that the exit pupil distance can be adjusted within 40-80 mm (adjusting the distance between the optical display element 30 and the human eye). distance). The near-eye display device 100 can adjust the left and right positions of the optical display element 30 through the connecting part 120, and adjust the center of the optical display element 30 (or the center of the near-eye display device 100) at the center of the line connecting the pupils to ensure that the left eye image and the right eye The imaging surface composed of the eye image contains all information of the image formed by the image carried by the light beam generated by the image generating unit 20 .

Referring to Fig. 19, the height of the near-eye display device 100 can also be adjusted in the vertical plane. The vertical plane refers to the direction perpendicular to the horizontal plane. The horizontal plane refers to the plane where the horizontal line of sight of the human eye is located. The inner field of view is 80 degrees adjustable, specifically 50° above the standard field of view, 30° below the standard field of view, and the standard field of view is horizontal, which is set at 0°. In Fig. 18, two connection parts 120 and two display parts 130 are shown with solid lines and dashed lines respectively, indicating the positions of two different states of the same connection part 120, and two different use positions of the same display part 130 .

Referring to FIG. 20 , the near-eye display device 100 provided by the embodiment of the present application is applied on the headband 600. The fixing structure on the headband 600 is located in the middle of the front end of the headband. The fixing structure can be a socket. The fixing part of the near-eye display device 100 110 is inserted into the fixed structure. The adjustable solution of the connection part 120 and the position setting of the display part 130 are similar to the implementations shown in Fig. 18 and Fig. 19, and will not be repeated here.

The embodiment of the present application provides a description of an application scenario of a head-mounted device having a near-eye display apparatus 100 as follows.

A specific application scenario is: the scene of working on the tower and working at heights. When workers are working on the tower, for example: 5G base station installation, maintenance, acceptance, etc., the national grid and other scenarios that need to work on the tower, if the operation process When encountering some difficult problems, the on-site operators cannot solve them and need the assistance of remote technical experts. The traditional method is to take out the mobile phone to contact the remote experts, share the on-site information with the remote experts, the remote experts will guide, and the on-site operators will carry out the operations. At this time, it is very inconvenient to operate while holding the mobile phone, and there is also a potential safety hazard. However, if the near-eye display device provided by this application is used, field operators can use the near-eye display device on the head-mounted device to interact with remote experts while performing on-site operations, completely freeing their hands. A camera can be installed on the head-mounted device, and the head-mounted device collects data from the camera on the scene and transmits it to a remote expert. The remote expert marks and guides on the real-time video screen, and transmits the marked and guided video screen to the on-site operator in real time. Since the near-eye display device provided by this application is applied at the position between the eyes, and the width of the near-eye display device does not exceed the interpupillary distance, it will not interfere with the field operator's line of sight, making it impossible to operate on-site. Therefore, the field operator The remote expert's guidance and marking can be viewed in real time through the near-eye display device, and the operation can be performed in real time according to the remote expert's guidance, which improves work efficiency.

If the near-eye display device provided by this application is worn directly in front of one eye, on the one hand, the near-eye display device will completely block the front line of sight of one eye, and the operator can only watch the real scene of the scene through the other eye, and the line of sight is half blocked , easily fatigued and uncomfortable, and cannot operate more comfortably on site; on the other hand, for example, the near-eye display device is worn in front of the left eye, and the optical display element forms the first optical path with the left eye, but cannot form the second optical path with the right eye. Optical path, so that two parts of the image cannot be formed on the imaging surface, and only the left eye image can be formed. Even if the left eye image has a large range, it cannot completely include all the information of the original image information, that is, the complete image cannot be viewed.

Another specific application scenario is: aircraft, ships, trains, automobiles and other maintenance, operation and maintenance scenarios. For example: in order to ensure the safe flight of the aircraft, mechanics need to carry out daily manual inspections to ensure that the engine is in good condition. When faults and defects are found during maintenance, a large number of maintenance technical experts will be temporarily dispatched to the operation site, which may cause flight delays and increase operation and maintenance costs virtually; as an important means of transportation for bulk goods, ships usually stop At the seaport, the distance from the maintenance center is relatively far, and the maintenance is time-consuming and labor-intensive; however, the use of the near-eye display device and the head-mounted device provided by the embodiment of the present application can solve this problem. The on-site maintenance personnel can get in touch with the technical support center in real time by wearing the headset. The maintenance personnel can communicate with the remote technical experts more clearly and intuitively in real time during the maintenance, and they can maintain while communicating, which not only ensures the completion of complicated tasks. The accuracy of the work also improves the work efficiency.

The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still apply to the foregoing embodiments Modifications are made to the recorded technical solutions, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of each embodiment of the application.

Claims (12)

A near-eye display device, characterized in that it includes an image generating unit and an optical display element, The image generation unit is used to receive the original image information transmitted by the control unit and generate image light, the image light is a light beam carrying the original image information, The optical display element is used to construct a first optical path, the first optical path is used to project the image light onto the imaging surface to form a left-eye image, and the optical display element is also used to construct a second optical path, The second optical path is used to project the image light onto the imaging surface to form a right-eye image; the left-eye image and the right-eye image are seamlessly spliced or partially overlapped to synthesize the original image information. The near-eye display device according to claim 1, wherein the width of the optical display element is less than or equal to 70mm, the width of the optical display element is the size of the optical display element in the first direction, and the second One direction is the direction of the line connecting the left eye and the right eye. The near-eye display device according to claim 2, wherein the width of the optical display element is greater than or equal to 40 mm. The near-eye display device according to claim 3, wherein in the first direction, the size of the overlapping portion between the left-eye image and the right-eye image is 5 times the size of the original image information %-60%. The near-eye display device according to any one of claims 1-4, wherein the image generation unit and the optical display element are stacked in the direction in which the optical axis of the optical display element extends, and the optical display The element is located between the image generation unit and the imaging surface, the optical display element includes a central area around the optical axis, the image generation unit is correspondingly arranged outside the central area, and the light output direction of the image generation unit form an angle with the optical axis. The near-eye display device according to any one of claims 1-4, wherein the image generation unit and the optical display element are stacked in the direction in which the optical axis of the optical display element extends, and the image generation unit A cell is located between the optical display element and the imaging plane. The near-eye display device according to claim 6, wherein the optical display element comprises a first lens and a second lens arranged in layers, and the second lens is located between the first lens and the image generating unit Meanwhile, the surface of the first lens away from the second lens and the surface of the second lens facing the image generating unit are both Fresnel surfaces. The near-eye display device according to any one of claims 1-7, characterized in that it includes a fixing part, a connecting part and a display part, the display part includes a housing, and the image generation unit and the optical display element are arranged on Inside the casing, the connecting portion is connected between the fixing portion and the casing, and the fixing portion is used to be fixedly connected to the fixing body of the head-mounted device. The near-eye display device according to claim 8, wherein the connection part is used to correct the use position of the display part. The near-eye display device according to any one of claims 2-9, wherein the calculation formula of the width of the optical display element is:

Wherein, the size of the expected virtual image is L, the distance from the virtual image to the binoculars is H, the overlapping rate of the left-eye image and the right-eye image is k%, the desired exit pupil distance is set as E, and the interpupillary distance is P, so The width of the optical display element is D. A head-mounted device, characterized by comprising a fixed body and the near-eye display device according to any one of claims 1 to 10, the near-eye display device being connected to the fixed body. The head-mounted device according to claim 11, wherein the minimum distance between the near-eye display device and the fixed main body is 40-80 mm.

Images