Nothing Special   »   [go: up one dir, main page]

WO2020009819A1 - See-through near eye optical display - Google Patents

See-through near eye optical display Download PDF

Info

Publication number
WO2020009819A1
WO2020009819A1 PCT/US2019/038624 US2019038624W WO2020009819A1 WO 2020009819 A1 WO2020009819 A1 WO 2020009819A1 US 2019038624 W US2019038624 W US 2019038624W WO 2020009819 A1 WO2020009819 A1 WO 2020009819A1
Authority
WO
WIPO (PCT)
Prior art keywords
augmented reality
reality system
micro
see
near eye
Prior art date
Application number
PCT/US2019/038624
Other languages
French (fr)
Inventor
Ronald Blum
Ami GUPTA
Igor Landau
Rick MORRISON
Original Assignee
NewSight Reality, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/289,623 external-priority patent/US10634912B2/en
Application filed by NewSight Reality, Inc. filed Critical NewSight Reality, Inc.
Priority to TW108123133A priority Critical patent/TW202007145A/en
Publication of WO2020009819A1 publication Critical patent/WO2020009819A1/en

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G02B3/0037—Arrays characterized by the distribution or form of lenses
    • G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0181—Adaptation to the pilot/driver

Definitions

  • the invention relates to an augmented reality system that utilizes a transparent or semi transparent see-through near eye display that is in optical alignment with a micro-lens array.
  • the transparent or semi-transparent see-through near eye display must permit light rays from the distant world to pass through as well as the micro-lens array.
  • Light rays from said display pass through the micro-lens array, then through an eye glass lens providing refractive correction for that specific gaze direction before entering the pupil of the eye.
  • the micro-lenses are static, light rays from the real-world pass through the transparent or semi transparent portions of the display as well as the micro-lens array before being incident on the eyeglass lens in order to form a real image.
  • the quality of the virtual image can be affected by multiple factors, such as by way of example only, by aberrations of the micro-lenses in the micro-lens array, number of lit pixels producing the virtual image, the brightness of the pixels that produce the virtual image, and/or the magnification produced by the AR system of the image on the retina.
  • multiple factors such as by way of example only, by aberrations of the micro-lenses in the micro-lens array, number of lit pixels producing the virtual image, the brightness of the pixels that produce the virtual image, and/or the magnification produced by the AR system of the image on the retina.
  • the micro-lenses and / or the micro-lens array can be switched between two optical powers (by way of example only, no optical power or optical) in order to provide an optimal combination of a virtual image and a real image (thus creating augmented reality).
  • the quality of the real image and the quality of the virtual image will affect the quality of the augmented reality being perceived by the eye of a user.
  • the switchable micro-lens array is electrically connected to the see-through near eye display.
  • the invention is an augmented reality system that utilizes a near eye see-through optical module that comprises a transparent or semi- transparent see-through near eye display that is in optical alignment with a micro-lens array.
  • the augmented reality system comprises generating a virtual image as perceived by an eye of a wearer of the augmented reality system when looking at an object in space having a location in the real world that forms a real image.
  • the virtual image changes, by way of example only, one or more of its shape, form, depth, 3D effect, location due to the eye or eyes shifting its (their) fixation position due to changing the location of different lighted pixels of the see-through near eye display (s).
  • first an eye tracker locates the eye of a wearer and then the appropriate pixels are illuminated (lit) for such a location of the eye of a wearer
  • this embodiment the opposite occurs, in aspects.“First” a pixel or plurality of pixels is /are illuminated (lit) and the fixation point of the eye(s) moves to see the lit pixel or pixels.
  • the eye or eyes is / are a slave of the near eye display.
  • the invention further discloses various ways to improve the quality of the virtual image and that of the augmented reality image while utilizing a near eye see-through optical module that comprises a see-through near eye display and distance separated and aligned micro-lens array.
  • An embodiment for generating such an improvement can be used for the inventive near eye see-through optical module with or without an eye tracker.
  • FIG. l is a schematic diagram showing a dithering concept according to an embodiment.
  • FIG. 2 is a schematic diagram showing a dithering concept according to an embodiment.
  • FIG. 3 is a schematic diagram showing a dithering concept according to an embodiment.
  • FIG. 4 is a schematic diagram showing a dithering concept according to an embodiment.
  • FIG. 5 is a schematic diagram showing a recessed metallized cone according to an embodiment.
  • FIG. 6 is a chart showing pixel Size, pitch, fill factor and transparency according to an embodiment.
  • FIG. 7 is a chart showing pixel size, image magnification, retinal size and resolution at retina according to an embodiment.
  • FIG. 8 is a schematic diagram showing improving AR image by way of activating selective pixels according to an embodiment.
  • the invention teaches various ways to improve the quality of the AR image provided by the inventive see-through near eye optical module described herein.
  • the invention relates to a see-through near eye display that is in optical alignment with a micro-lens array.
  • the see-through near eye display permits light rays from the distant world to pass through as well as the micro-lens array.
  • Light rays from said display pass through the micro- lens array, then through an eye glass optic providing refractive correction for that specific gaze direction before entering the pupil of the eye without forming an image.
  • the resolution of the virtual image formed on the retina can be improved by dithering the lenslets (micro-lenses) of the micro-lens array in the x, y plane.
  • the layout of pixels or pixel patches can be dithered.
  • the MLA (micro-lens array) may also be dithered; in other words, varied in their x, y location by an amount smaller than their pitch.
  • the dithering of pixels or pixel patches can improve virtual image quality.
  • the dithering of the pixels or pixel patches can be dithered within the range of 5% to 20% of pitch.
  • the dithering of lenslets / micro-lenses can further improve virtual image quality. Dithering of lenslets / micro-lenses can be within the range of 5% and 50% of their pitch, such as from 5% to 10%, 10% to 15%, 15% to 20%, and so on.
  • dithering overlays shifted or said another way partially offsetting (misaligned) pix elated image sets are specifically designed this way for the objective to improve overall performance.
  • Increased resolution is accomplished by creating a slight offset of overlapping images on the retina that are generated by a plurally of pixel patches. This can be accomplished by shifting the position of either the pixel patch or the MLA (micro-lens array) lenslet (micro-lens).
  • Dithering can be applied when the light is collected from multiple lenslets (micro-lenses) or optical channels simultaneously and accepted through the eye’s pupil.
  • Configuration can be such that multiple pixel patches have their light imaged into or onto a common retinal area.
  • Dithering can be used with the pixel array of a sparsely populated near eye display to increase the resolution of the virtual image.
  • Dithering can be provided by slightly modifying the pitch of the lenslets (micro-lenses of an MLA).
  • Dithering can be provided by slightly modifying the pitch of the pixels or pixel patches of a near eye display.
  • the invention taught herein describes an augmented reality system, wherein the augmented reality system comprises a micro-lens array and a see- through near eye display, wherein the real image is formed from light rays from the real world that pass through the near eye display and that of the micro-lens array largely unaltered (meaning not refracted by the micro-lenses) and are seen by an eye of a user, wherein the virtual image is formed from light rays generated by the see through near eye display that pass through micro- lenses of a micro-lens array that are seen by the eye of a user and wherein the pixels or pixel patches of the see-though near eye display or micro-lenses of the micro-lens array are dithered.
  • the pixels can be dithered within the range of 5% to 50% of their pitch.
  • the pixels patches can be dithered within the range of 5% to 20% of their pitch.
  • the micro-lenses can be dithered within the range of 5% to 50% of their pitch.
  • the augmented reality system can comprise pixels or pixel patches and micro-lenses of the micro-lens array that are dithered. By dithering the pixels, pixel patches, micro-lenses or a combination thereof it is possible to enhance the virtual image as seen by the eye of a user of the AR System.
  • the invention utilizes the eye being a slave to the see-through near eye display.
  • the eye does not first move to see additional detail of a virtual image, but rather changing illumination from the display drives the eye to see a changing virtual image.
  • the macula and / or fovea is completely or partially filled by the virtual image.
  • the display may display different content or image forms that completely or partially fill the macula and / or fovea of the eye seeing augmented reality.
  • the eye is not“moving” to see a different tiled area of the virtual image that is displayed by the near eye display.
  • the macula and / or the fovea is completely or partially filled with the virtual image to see more detail or a different part of a virtual image.
  • the displayed content may change but the eye may stay mostly or partially or completely steady except for involuntary eye movements.
  • a plurality of pixel patches generates a retinal image that partially or completely overlaps, thus increasing brightness and increasing contrast of the virtual image.
  • the display specifically the activated pixels in the display at any point of time may control the gaze direction and alter the real image corresponding to the direction of gaze.
  • the positioning of the virtual image may be rendered disconjugate to control vergence and image magnification of the real image provided by the eyeglass optics. Such a binocular embodiment provides an alignment between vergence and image magnification as well as better depth perception within the virtual image.
  • the manner (method) in which adjacent retinal images generated by adjacent pixel patches have their borders aligned adjacent to one another may be accomplished by way of taking into consideration the image magnification on the retina of the AR system and the distance separation of the two adjacent pixel patches. By adjusting either or both the
  • magnification and / or distance separation of the two adjacent pixel patches it is possible to align the two adjacent representative retinal images.
  • the eye of a wearer moves to where the virtual image is generated by the pixel or pixel patches of the near eye display.
  • the virtual image can be moved or relocated along the X, Y, Z axes due to the pixels or pixel patches being lighted on the near eye display and the eye reacting / fixating to the lighted pixels or pixels as opposed to the way AR systems work that use eye tracking.
  • location of the virtual image when combined with the real image is achieved by locating the target location of the real image by combining information from a GPS sensor with an accelerometer that tracks heads movement.
  • a sealed optical module(s) comprise a sparsely populated, see-through near eye display having a transparency of 70% or higher that is distance separated from that of a sparsely populated micro-lens array.
  • the sealed optical module can be curved to the shape of the front base curve of an eyeglass lens. Both the see-through near eye display and the micro-lens array can be curved.
  • the see-though near eye display and the micro- lens array may be distance separated by a gap.
  • the gap can be that of air or filled in by a material.
  • the curve is in one direction. In certain other embodiments the curve is in two or more directions.
  • the pixels of the see-through near eye display can be, by way of example only, micro-LEDs (iLEDs).
  • the size of the pixels may be 5 microns or less, preferably 2 microns or less. In certain embodiments the pixel fill factor can be 20% or less. In certain other embodiments the pixel fill factor can be 10% or less.
  • the micro-lens fill factor of the micro-lens array can be 40% or less. In certain other embodiments the micro-lens fill factor is 30% or less.
  • the size of a micro-lens of the micro-lens array can be 400 microns - 600 microns, by way of example.
  • One or more micro-LEDs can be optically aligned with 1 micro-lens or more than one micro-lens.
  • a plurality of micro-LEDs can be optically aligned with a plurality of micro-lenses.
  • a patch of micro-LEDs can be optically aligned with a micro-lens or a micro-lens array.
  • multiple patches of micro-LEDs can provide overlapping retinal images whereby the overlap is 100%, or less.
  • the size of the micro-lenses of the micro-lens array can range between 10 microns and 100 microns.
  • diffraction caused by the micro-lenses may be eliminated by creating a Bessel beam that travels diffraction free, at least for short distances.
  • the micro-lenses are aspheric.
  • the micro-lenses are dithered.
  • the see-through near eye display can be of an active matrix display.
  • the see-through near eye display can be of a passive matrix display.
  • the pixel pitch can be about 5 microns for a pixel size of 3.5 microns. In embodiments, the pixel pitch can be 3 microns for a pixel size of 1-2 microns.
  • the micro-lens array can be that of a static micro-lens array or that of a dynamic micro-lens array. When the micro-lens array is dynamic the switching on and off of the micro-lens array can be synchronized with the switching on and off of certain pixels or pixel patches of the see-through near eye display.
  • the micro-LEDs (iLEDs) are pulsed or modulated. In aspects, the minimum modulation frequency can be 30 Hz - 60 Hz (or higher).
  • the duty cycle can be 1% or higher. In certain embodiments the duty cycle may be between 1% and 25%. In other embodiments the duty cycle may be between 25% and 50%. In certain
  • the modulation for the micro-LEDs may be such that the user’s perception of the virtual image brightness is commensurate to that of the user’s perception of the brightness of the real-world ambient light. In certain other embodiments the modulation for the micro-LEDs (iLEDs) may be such that the user’s perception of the virtual image brightness is higher than that of the user’s perception of the brightness of the real-world ambient light. In certain
  • the see-through near eye display can be monochromatic. In other embodiments the see-through near eye display can be that of RGB or full color.
  • the back side of the micro-LEDs (iLEDs) furthest away from the eye of the user can be opaque or near-opaque. This back side can be that of the substrate or that of an opaque or near-opaque element that is attached to either the substrate of the micro-LED (iLED).
  • the area between the micro-LEDs (iLEDs) can be transparent or semi-transparent.
  • the diameter of the lenslet (micro-lens) to maintain diffraction at a low level may be about 400 - 650 microns (about 0.4 - 0.6 mm).
  • the pixel pitch can be about 5 microns in a monochrome display, with a pixel size of 3.5 microns. In aspects, it can be 3 microns for a pixel size of 1-2 microns. This means that there will be about 64X64 pixels or more per patch and will be refracted through a single lens-let (micro-lens).
  • the pupil Given that the size of the pupil is around 4 mm, the pupil will be partially or fully covered by about 8X8 lenslets, covering a field of view of around 12.5 deg X 12.5 deg, full macular vision. This assumes little to no sparsity and can be used if the substrate is transparent and the pixels are see-through, for example. For a fill factor of around 2%, the number of pixels can be reduced per lenslet (micro-lens) from 64X64 to 9X9, or 32X32 for a fill factor of 25%, by way of example.
  • the light distribution of an iLED (micro-LED) can be formed in a cone projecting to the eye of the wearer.
  • a certain embodiment is that of an AR system, wherein the real image is generated by the eye looking at a stationary location in space, while the virtual image changes due to changing the location of the activated pixels of the see-through near eye display while the eye remains stationary.
  • Another embodiment is that of an AR system, wherein the location of the virtual image is altered by changing the location of different activated pixels causing the eye to move to fixate on these different activated pixels, as opposed tracking the direction of gaze using a gaze tracker, then projecting the virtual image at a location to match the direction of gaze.
  • movement of the virtual image is achieved by altering the location of activated pixels causing the eye to move to fixate on these different activated pixels, as opposed to activated pixels being generated in relation to the location of where the eye is looking.
  • the invention describes an AR system, wherein the brightness is increased by overlapping images on the retina generated by a plurality of pixel patches that generate such overlap.
  • the overlapping retinal images may have an overlap between 90% to 100% overlappping images, in examples.
  • the overlapping retinal images have an overlap of 100%, in other examples.
  • An additional embodiment is that of an AR system wherein the virtual image is enhanced by way of dithering the overlap of the retinal images by way of pixel patches.
  • an AR system is taught wherein the virtual image is enhanced by way of dithering the overlap of the retinal images by way of micro-lenses.
  • an array of recessed micro-cone structures is formed in the transparent substrate of the display, which are then populated with pixels (by way of example only) iLEDs (micro-LEDs).
  • a metallic coating can be applied to the sides and bottom of the micro-cone structures.
  • aluminum, silver, and / or tin can be used.
  • the coating may be optimized to have maximum reflectivity at the wavelength of light emitted by the pixels, for example, green, blue or red.
  • the diameter of the cones may be narrowest where the pixel is deposited, which may be the deepest part of the recessed cone(s). The diameter of the cones may be the widest on the surface of the transparent substrate. This embodiment reduces light scatter and causes the light to be projected forward toward the eye of the wearer.
  • an array of transparent pixels may be deposited on a transparent substrate.
  • These transparent pixels can be, by way of example only, transparent iLEDs (micro-LEDs).
  • the AR image can be enhanced by selectively activating a larger number of pixels or pixel patches that provide an image partially or completely covering the fovea of the retina of an eye of a wearer and activating a lower number of pixels or pixels patches that provide an image that partially or completely covers the macula and not that of the fovea of the eye of a wearer.
  • any one or more of the following separately or in combination will enhance the function and AR or MR experience of a person looking through the see-through transparent optical module’s near eye display.
  • the invention disclosed herein teaches multiple ways of enhancing an AR or MR image. These can be by way of example only one or a combination of the following: 1) Utilizing a larger number of smaller pixels.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

An augmented reality system that utilizes a near eye see-through optical module that comprises a transparent or semi-transparent see- through near eye display that is in optical alignment with a micro-lens array. The augmented reality system comprises generating a virtual image as perceived by an eye of a wearer of the augmented reality system when looking at an object in space having a location in the real world that forms a real image. The virtual image may change one or more of its shape, form, depth, 3D effect, location due to the eye or eyes shifting their fixation position due to changing the location of different lighted pixels of the see-through near eye display(s). Further disclosed are mechanisms to improve the quality of the virtual image and that of the augmented reality image.

Description

SEE-THROUGH NEAR EYE OPTICAL DISPLAY
CROSS-REFRERENCE TO RELATED APPLICATIONS
[0001] The present application relies on the disclosures of and claims priority to and the benefit of the filing dates of ET.S. Patent Application No. 16/289,623 filed February 28, 2019, which claims priority to ET.S. Patent Application No. 16/008,707 filed June 14, 2018, which claims priority to U.S. Application No. 15/994,595 filed May 31, 2018, as well as the following ET.S. Provisional Patent Applications, with filing dates and titles, the disclosures of which are hereby incorporated by reference herein in their entireties.
62/694,222 filed on 07/05/2018: Optimizing Micro-Lens Array for use with TOLED for Augmented Reality or Mixed Reality
62/700,621 filed on 07/19/2018: LC Switchable See-Through TOLED Optical Combiner for Augmented Reality or Mixed Reality
62/700,632 filed on 07/19/2018: Improved See-Through TOLED Optical Combiner for Augmented Reality or Mixed Reality
62/703,909 filed on 07/27/2018: Near Eye See-Through Display Optical Combiner for
Augmented Reality or Mixed Reality
62/703,911 filed on 07/27/2018: LC Switchable Near Eye See-Through Display Combiner for Augmented Reality or Mixed Reality
62/711,669 filed on 07/30/2018: Near Eye See-Through Display Optical Combiner Comprising LC Switchable Lensing System for Augmented Reality or Mixed Reality
62/717,424 filed on 08/10/2018: Near Eye See-Through Display Optical Combiner for
Augmented Reality or Mixed Reality and HMD 62/720,113 filed on 08/20/2018: Sparsely Populated Near Eye Display Optical Combiner and Static Micro-Optic Array for AR and MR
62/720,116 filed on 08/21/2018: Sparsely Populated Near Eye Display Optical Combiner for AR and MR
62/728,251 filed on 09/07/2018: Figures For Eyewear Comprising a See-Through Eye Display Optical Combiner
62/732,039 filed on 09/17/2018: Eyewear Comprising a Dynamic See-Through Near Eye Display Optical Combiner
62/732,138 filed on 09/17/2018: Binocular See-Through Near Eye Display Optical Combiner 62/739,904 filed on 10/02/2018: See-Through Near Eye Display Optical Combiner Module and Attachment Mean
62/739,907 filed on 10/02/2018: Dynamic See-Through Near Eye Display Optical Combiner Module and Attachment Mean
62/752,739 filed on 10/30/2018: Photonic Optical Combiner Module
62/753,583 filed on 10/31/2018: Improved Photonic Optical Combiner Module
62/754,929 filed on 11/02/2018: Further Improved Photonic Optical Combiner Module
62/755,626 filed on 11/05/2018: Near Eye Display See Through Optical Combiner
62/755,630 filed on 11/05/2018: Static See Through Near Eye Display Optical Combiner 62/756,528 filed on 11/06/2018: Detachable Attachable Two Section Frame Front for XR 62/756,542 filed on 11/06/2018: Spectacle Lens in Optical Communication with See-Through Near Eye Display Optical Combiner
62/769,883 filed on 11/20/2018: Enhanced Near Eye Display Optical Combiner Module 62/770,210 filed on 11/21/2018: Further Enhanced Near Eye Display Optical Combiner Module 62/771,204 filed on 11/26/2018: Adjustable Virtual Image Near Eye Display Optical Combiner Module
62/774,362 filed on 12/03/2018: Integrated Lens with NSR Optical Combiner
62/775,945 filed on 12/06/2018: See-Through Near Eye Display Optical Combiner Module With
Front Light Blocker
62/778,960 filed on 12/13/2018: See-Through Near Eye Display Having Opaque Pixel Patches 62/778,972 filed on 12/13/2018: Improved See-Through Near Eye Display Optical Combiner Module With Front Light Blocker
62/780,391 filed on 12/17/2018: See-Through Modulated Near Eye Display With Light Emission Away From The Eye of a Wearer Reduced or Blocked
62/780,396 filed on 12/17/2018: Modulated MLA and/or Near Eye Display Having Light Emission Away From The Eye of a Wearer Reduced or Blocked
62/783,596 filed on 12/21/2018: Modulated MLA and/or Near Eye Display With Light Emission Away From Eye of ETser
62/783,603 filed on 12/21/2018: Improved Modulated MLA and/or Near Eye Display With Light Emission Away From Eye of ETser
62/785,284 filed on 12/27/2018: Advanced See-Through Modulated Near Eye Display With Outward Light Emission Reduced or Blocked
62/787,834 filed on 01/03/2018: Advanced Integrated Lens with NSR Optical Combiner 62/788,275 filed on 01/04/2019: Advanced See-Through Near Eye Display Optical Combiner 62/788,993 filed on 01/07/2019: Fabricating an Integrated Lens with See-Through Near Eye Display Optical Combiner 62/788,995 filed on 01/07/2019: Further Advanced See-Through Near Eye Display Optical Combiner
62/790,514 filed on 01/10/2019: Further, Further Advanced See-Through Near Eye Display Optical Combiner
62/790,516 filed on 01/10/2019: Advanced, Advanced See-Through Near Eye Display Optical Combiner
62/793,166 filed on 01/16/2019: Near Eye Display See-Through Module for XR
62/794,779 filed on 01/21/2019: Near Eye Module Invention Summary
62/796,388 filed on 01/24/2019: Transparent Near Eye Display Invention Summary
62/796,410 filed on 01/24/2019: Transparent Near Eye Module Summary
62/830,645 filed on April 8, 2019: Enhancement of Virtual Image
62/847,427 filed May 14, 2019: Enhancing the AR Image
62/848,636 filed May 16, 2019: Further Enhanced AR Image
BACKGROUND OF THE INVENTION
Field of the Invention
[0002] The invention relates to an augmented reality system that utilizes a transparent or semi transparent see-through near eye display that is in optical alignment with a micro-lens array. The transparent or semi-transparent see-through near eye display must permit light rays from the distant world to pass through as well as the micro-lens array. Light rays from said display pass through the micro-lens array, then through an eye glass lens providing refractive correction for that specific gaze direction before entering the pupil of the eye. In static embodiments where the micro-lenses are static, light rays from the real-world pass through the transparent or semi transparent portions of the display as well as the micro-lens array before being incident on the eyeglass lens in order to form a real image. The quality of the virtual image can be affected by multiple factors, such as by way of example only, by aberrations of the micro-lenses in the micro-lens array, number of lit pixels producing the virtual image, the brightness of the pixels that produce the virtual image, and/or the magnification produced by the AR system of the image on the retina. Thus, there is always a need for ways to improve the quality of the virtual image.
In dynamic embodiments the micro-lenses and / or the micro-lens array can be switched between two optical powers (by way of example only, no optical power or optical) in order to provide an optimal combination of a virtual image and a real image (thus creating augmented reality). In certain cases, the quality of the real image and the quality of the virtual image will affect the quality of the augmented reality being perceived by the eye of a user. In certain dynamic embodiments the switchable micro-lens array is electrically connected to the see-through near eye display. Thus, there is a need to enhance the virtual image using design techniques for enhancing, such as by way of incorporating such techniques within the design of the near eye display and the micro-lens array.
Description of Related Art
[0003] Today’s augmented and / or mixed reality systems in most cases have a large form factor and are clunky, heavy, power hungry, fashion limited and expensive. For these systems to have an increased level of adoption a major transformational technology change is needed. The innovation disclosed herein teaches such a transformational breakthrough for the AR (augmented reality) & MR (mixed reality) eyewear / headwear systems.
SUMMARY OF THE INVENTION
[0004] According to embodiments of the invention, the invention is an augmented reality system that utilizes a near eye see-through optical module that comprises a transparent or semi- transparent see-through near eye display that is in optical alignment with a micro-lens array. According to certain embodiments of the invention, the augmented reality system comprises generating a virtual image as perceived by an eye of a wearer of the augmented reality system when looking at an object in space having a location in the real world that forms a real image. When utilizing a certain embodiment of the invention the virtual image changes, by way of example only, one or more of its shape, form, depth, 3D effect, location due to the eye or eyes shifting its (their) fixation position due to changing the location of different lighted pixels of the see-through near eye display (s). It is important to note that unlike other AR systems whereby “first” an eye tracker locates the eye of a wearer and then the appropriate pixels are illuminated (lit) for such a location of the eye of a wearer, with this embodiment the opposite occurs, in aspects.“First” a pixel or plurality of pixels is /are illuminated (lit) and the fixation point of the eye(s) moves to see the lit pixel or pixels. Thus, the eye or eyes is / are a slave of the near eye display. The invention further discloses various ways to improve the quality of the virtual image and that of the augmented reality image while utilizing a near eye see-through optical module that comprises a see-through near eye display and distance separated and aligned micro-lens array. An embodiment for generating such an improvement can be used for the inventive near eye see-through optical module with or without an eye tracker.
BRIEF DESCRIPTION OF THE DRAWINGS
[0005] The accompanying drawings illustrate certain aspects of embodiments of the present invention and should not be used to limit the invention. Together with the written description the drawings explain certain principles of the invention.
[0006] FIG. l is a schematic diagram showing a dithering concept according to an embodiment.
[0007] FIG. 2 is a schematic diagram showing a dithering concept according to an embodiment. [0008] FIG. 3 is a schematic diagram showing a dithering concept according to an embodiment.
[0009] FIG. 4 is a schematic diagram showing a dithering concept according to an embodiment.
[00010] FIG. 5 is a schematic diagram showing a recessed metallized cone according to an embodiment.
[00011] FIG. 6 is a chart showing pixel Size, pitch, fill factor and transparency according to an embodiment.
[00012] FIG. 7 is a chart showing pixel size, image magnification, retinal size and resolution at retina according to an embodiment.
[00013] FIG. 8 is a schematic diagram showing improving AR image by way of activating selective pixels according to an embodiment.
DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS OF THE INVENTION
[00014] Reference will now be made in detail to various exemplary embodiments of the invention. It is to be understood that the following discussion of exemplary embodiments is not intended as a limitation on the invention. Rather, the following discussion is provided to give the reader a more detailed understanding of certain aspects and features of the invention.
[00015] According to embodiments, the invention teaches various ways to improve the quality of the AR image provided by the inventive see-through near eye optical module described herein. The invention relates to a see-through near eye display that is in optical alignment with a micro-lens array. The see-through near eye display permits light rays from the distant world to pass through as well as the micro-lens array. Light rays from said display pass through the micro- lens array, then through an eye glass optic providing refractive correction for that specific gaze direction before entering the pupil of the eye without forming an image. [00016] Turning to the figures, as shown in FIGs. 1-4, the resolution of the virtual image formed on the retina can be improved by dithering the lenslets (micro-lenses) of the micro-lens array in the x, y plane. The layout of pixels or pixel patches can be dithered. In addition, the MLA (micro-lens array) may also be dithered; in other words, varied in their x, y location by an amount smaller than their pitch. The dithering of pixels or pixel patches can improve virtual image quality. The dithering of the pixels or pixel patches can be dithered within the range of 5% to 20% of pitch. The dithering of lenslets / micro-lenses can further improve virtual image quality. Dithering of lenslets / micro-lenses can be within the range of 5% and 50% of their pitch, such as from 5% to 10%, 10% to 15%, 15% to 20%, and so on.
[00017] In embodiments, dithering overlays shifted or said another way partially offsetting (misaligned) pix elated image sets are specifically designed this way for the objective to improve overall performance. Increased resolution is accomplished by creating a slight offset of overlapping images on the retina that are generated by a plurally of pixel patches. This can be accomplished by shifting the position of either the pixel patch or the MLA (micro-lens array) lenslet (micro-lens). Dithering can be applied when the light is collected from multiple lenslets (micro-lenses) or optical channels simultaneously and accepted through the eye’s pupil.
Configuration can be such that multiple pixel patches have their light imaged into or onto a common retinal area.
[00018] Dithering can be used with the pixel array of a sparsely populated near eye display to increase the resolution of the virtual image. Dithering can be provided by slightly modifying the pitch of the lenslets (micro-lenses of an MLA). Dithering can be provided by slightly modifying the pitch of the pixels or pixel patches of a near eye display. [00019] According to embodiments, the invention taught herein describes an augmented reality system, wherein the augmented reality system comprises a micro-lens array and a see- through near eye display, wherein the real image is formed from light rays from the real world that pass through the near eye display and that of the micro-lens array largely unaltered (meaning not refracted by the micro-lenses) and are seen by an eye of a user, wherein the virtual image is formed from light rays generated by the see through near eye display that pass through micro- lenses of a micro-lens array that are seen by the eye of a user and wherein the pixels or pixel patches of the see-though near eye display or micro-lenses of the micro-lens array are dithered. The pixels can be dithered within the range of 5% to 50% of their pitch. The pixels patches can be dithered within the range of 5% to 20% of their pitch. The micro-lenses can be dithered within the range of 5% to 50% of their pitch. The augmented reality system can comprise pixels or pixel patches and micro-lenses of the micro-lens array that are dithered. By dithering the pixels, pixel patches, micro-lenses or a combination thereof it is possible to enhance the virtual image as seen by the eye of a user of the AR System.
[00020] The invention utilizes the eye being a slave to the see-through near eye display. In aspects, the eye does not first move to see additional detail of a virtual image, but rather changing illumination from the display drives the eye to see a changing virtual image. With the invention, the macula and / or fovea is completely or partially filled by the virtual image. With the invention, to see a change in the virtual image the display may display different content or image forms that completely or partially fill the macula and / or fovea of the eye seeing augmented reality. In aspects, the eye is not“moving” to see a different tiled area of the virtual image that is displayed by the near eye display. Rather, with the invention, the macula and / or the fovea is completely or partially filled with the virtual image to see more detail or a different part of a virtual image. In aspects, the displayed content may change but the eye may stay mostly or partially or completely steady except for involuntary eye movements. In embodiments, a plurality of pixel patches generates a retinal image that partially or completely overlaps, thus increasing brightness and increasing contrast of the virtual image. In aspects, the display, specifically the activated pixels in the display at any point of time may control the gaze direction and alter the real image corresponding to the direction of gaze. In a binocular device, for example, the positioning of the virtual image may be rendered disconjugate to control vergence and image magnification of the real image provided by the eyeglass optics. Such a binocular embodiment provides an alignment between vergence and image magnification as well as better depth perception within the virtual image.
[00021] The manner (method) in which adjacent retinal images generated by adjacent pixel patches have their borders aligned adjacent to one another may be accomplished by way of taking into consideration the image magnification on the retina of the AR system and the distance separation of the two adjacent pixel patches. By adjusting either or both the
magnification and / or distance separation of the two adjacent pixel patches it is possible to align the two adjacent representative retinal images. In addition, it is possible to remove pixels of one or more pixel patch(es) that cause overlap with an adjacent retinal image or images such to provide for a border between two adjacent retinal images.
[00022] In another embodiment, the eye of a wearer moves to where the virtual image is generated by the pixel or pixel patches of the near eye display. This is, in ways, unlike eye tracking where the eye looks first then the near eye display lights up pixels due to identifying the location of the eye first. According to the current invention, the virtual image can be moved or relocated along the X, Y, Z axes due to the pixels or pixel patches being lighted on the near eye display and the eye reacting / fixating to the lighted pixels or pixels as opposed to the way AR systems work that use eye tracking. In an embodiment, location of the virtual image when combined with the real image is achieved by locating the target location of the real image by combining information from a GPS sensor with an accelerometer that tracks heads movement.
[00023] In an embodiment of the invention, a sealed optical module(s) comprise a sparsely populated, see-through near eye display having a transparency of 70% or higher that is distance separated from that of a sparsely populated micro-lens array. The sealed optical module can be curved to the shape of the front base curve of an eyeglass lens. Both the see-through near eye display and the micro-lens array can be curved. The see-though near eye display and the micro- lens array may be distance separated by a gap. The gap can be that of air or filled in by a material. In certain embodiments the curve is in one direction. In certain other embodiments the curve is in two or more directions. The pixels of the see-through near eye display can be, by way of example only, micro-LEDs (iLEDs). The size of the pixels may be 5 microns or less, preferably 2 microns or less. In certain embodiments the pixel fill factor can be 20% or less. In certain other embodiments the pixel fill factor can be 10% or less. The micro-lens fill factor of the micro-lens array can be 40% or less. In certain other embodiments the micro-lens fill factor is 30% or less. The size of a micro-lens of the micro-lens array can be 400 microns - 600 microns, by way of example. One or more micro-LEDs can be optically aligned with 1 micro-lens or more than one micro-lens. Thus, a plurality of micro-LEDs can be optically aligned with a plurality of micro-lenses. In certain embodiments a patch of micro-LEDs can be optically aligned with a micro-lens or a micro-lens array. In certain embodiments multiple patches of micro-LEDs can provide overlapping retinal images whereby the overlap is 100%, or less. In certain other embodiments the size of the micro-lenses of the micro-lens array can range between 10 microns and 100 microns. In this embodiment, diffraction caused by the micro-lenses may be eliminated by creating a Bessel beam that travels diffraction free, at least for short distances. In certain embodiments the micro-lenses are aspheric. In certain embodiments the micro-lenses are dithered. The see-through near eye display can be of an active matrix display. The see-through near eye display can be of a passive matrix display.
[00024] In embodiments, the pixel pitch can be about 5 microns for a pixel size of 3.5 microns. In embodiments, the pixel pitch can be 3 microns for a pixel size of 1-2 microns. The micro-lens array can be that of a static micro-lens array or that of a dynamic micro-lens array. When the micro-lens array is dynamic the switching on and off of the micro-lens array can be synchronized with the switching on and off of certain pixels or pixel patches of the see-through near eye display. In certain embodiment the micro-LEDs (iLEDs) are pulsed or modulated. In aspects, the minimum modulation frequency can be 30 Hz - 60 Hz (or higher). In aspects, the duty cycle can be 1% or higher. In certain embodiments the duty cycle may be between 1% and 25%. In other embodiments the duty cycle may be between 25% and 50%. In certain
embodiments the modulation for the micro-LEDs (iLEDs) may be such that the user’s perception of the virtual image brightness is commensurate to that of the user’s perception of the brightness of the real-world ambient light. In certain other embodiments the modulation for the micro-LEDs (iLEDs) may be such that the user’s perception of the virtual image brightness is higher than that of the user’s perception of the brightness of the real-world ambient light. In certain
embodiments, the see-through near eye display can be monochromatic. In other embodiments the see-through near eye display can be that of RGB or full color. The back side of the micro-LEDs (iLEDs) furthest away from the eye of the user can be opaque or near-opaque. This back side can be that of the substrate or that of an opaque or near-opaque element that is attached to either the substrate of the micro-LED (iLED). The area between the micro-LEDs (iLEDs) can be transparent or semi-transparent.
[00025] In a certain embodiment using an iLED (micro-LED) see-through near eye display, the diameter of the lenslet (micro-lens) to maintain diffraction at a low level may be about 400 - 650 microns (about 0.4 - 0.6 mm). In aspects, the pixel pitch can be about 5 microns in a monochrome display, with a pixel size of 3.5 microns. In aspects, it can be 3 microns for a pixel size of 1-2 microns. This means that there will be about 64X64 pixels or more per patch and will be refracted through a single lens-let (micro-lens). Given that the size of the pupil is around 4 mm, the pupil will be partially or fully covered by about 8X8 lenslets, covering a field of view of around 12.5 deg X 12.5 deg, full macular vision. This assumes little to no sparsity and can be used if the substrate is transparent and the pixels are see-through, for example. For a fill factor of around 2%, the number of pixels can be reduced per lenslet (micro-lens) from 64X64 to 9X9, or 32X32 for a fill factor of 25%, by way of example. The light distribution of an iLED (micro-LED) can be formed in a cone projecting to the eye of the wearer. This can be accomplished, by way of example only, by creating a recessed well in the surface of the transparent substrate and positioning the iLED (micro-LED) in or within the recessed well. In other embodiments this can be accomplished by utilizing an aperture shield around an iLED (micro-LED) and located between the iLED (micro-LED) and the micro-lens of the micro-lens array, for example.
[00026] A certain embodiment is that of an AR system, wherein the real image is generated by the eye looking at a stationary location in space, while the virtual image changes due to changing the location of the activated pixels of the see-through near eye display while the eye remains stationary. Another embodiment is that of an AR system, wherein the location of the virtual image is altered by changing the location of different activated pixels causing the eye to move to fixate on these different activated pixels, as opposed tracking the direction of gaze using a gaze tracker, then projecting the virtual image at a location to match the direction of gaze.
[00027] In still another embodiment of an AR system, movement of the virtual image is achieved by altering the location of activated pixels causing the eye to move to fixate on these different activated pixels, as opposed to activated pixels being generated in relation to the location of where the eye is looking. In still another embodiment, the invention describes an AR system, wherein the brightness is increased by overlapping images on the retina generated by a plurality of pixel patches that generate such overlap.
[00028] The overlapping retinal images may have an overlap between 90% to 100% overlappping images, in examples. The overlapping retinal images have an overlap of 100%, in other examples. An additional embodiment is that of an AR system wherein the virtual image is enhanced by way of dithering the overlap of the retinal images by way of pixel patches. And in another embodiment, an AR system is taught wherein the virtual image is enhanced by way of dithering the overlap of the retinal images by way of micro-lenses.
[00029] In another embodiment, such as shown in FIG. 5, an array of recessed micro-cone structures is formed in the transparent substrate of the display, which are then populated with pixels (by way of example only) iLEDs (micro-LEDs). A metallic coating can be applied to the sides and bottom of the micro-cone structures. By way of example only, aluminum, silver, and / or tin can be used. In aspects, the coating may be optimized to have maximum reflectivity at the wavelength of light emitted by the pixels, for example, green, blue or red. In aspects, the diameter of the cones may be narrowest where the pixel is deposited, which may be the deepest part of the recessed cone(s). The diameter of the cones may be the widest on the surface of the transparent substrate. This embodiment reduces light scatter and causes the light to be projected forward toward the eye of the wearer.
[00030] In another embodiment, such as that shown in FIG. 9, an array of transparent pixels may be deposited on a transparent substrate. These transparent pixels can be, by way of example only, transparent iLEDs (micro-LEDs). The AR image can be enhanced by selectively activating a larger number of pixels or pixel patches that provide an image partially or completely covering the fovea of the retina of an eye of a wearer and activating a lower number of pixels or pixels patches that provide an image that partially or completely covers the macula and not that of the fovea of the eye of a wearer.
[00031] Any one or more of the following separately or in combination will enhance the function and AR or MR experience of a person looking through the see-through transparent optical module’s near eye display. The invention disclosed herein teaches multiple ways of enhancing an AR or MR image. These can be by way of example only one or a combination of the following: 1) Utilizing a larger number of smaller pixels. Thus, for the same level of retinal magnification it is possible to have a higher resolution image created; 2) Utilize aspheric micro- lenses for generating a sharper virtual image; 3) Use a light aperture around a pixel patch or pixel patches to reduce light scatter; 4) Use a light aperture around a micro-lens to reduce light scatter; 5) Have the diameter of the micro-lens slightly larger than the aligned and spaced pixel patches or a single pixel patch to which the micro-lens is in optical communication therewith; 6) Cause as little light loss as possible thereby increasing the amount of light that is projecting towards the eye of the wearer; 7) Utilize multiple pixel patches optically aligned with each individual micro- lens of the plurality of micro-lenses of a micro-lens array; 8) Utilize a curved or faceted architecture for TOM (the sealed transparent optical module that comprises a see-through near eye display and an aligned and spaced micro-lens array)— in aspects, the curved or faceted architecture should, by way of example only, mimic that of the front base curve of the spectacle lens or visor to which TOM is embedded, attached, or aligned, at or near the anterior surface of the eyewear— thus, if the TOM is of a 3-dimensional profile (curved or faceted) then the same may be true of the see-through near eye display and the micro-lens array; 9) Dithering of pixels or pixel patches of the see-though near eye display; 10) Dithering of micro-lenses of the micro- lens array; 11) Removing or turning off specific pixel patch or patches to ensure that overlapping retinal images provide for an image border; 12) keep the magnification of the retinal image at 8X or less; 13) Recessing each pixel or pixel patch within a recessed cone structure located within the surface of the transparent substrate to which the pixel is deposited; 14) Metallizing the recessed cone structure that is located within the surface of the transparent substrate; 15)
Increasing the number of active lighted pixels that provide an image that completely or partially fills the fovea of the eye of the wearer while utilizing a lower number of active lighted pixels that provide an image that completely or partially fills the macular area other than that of the fovea, and /or 16) Use smaller micro-lenses, preferably 5-100 microns in diameter, and generate a Bessel beam from the display that travels fully, partially, completely, or mostly diffraction free, at least for short distances— such a Bessel beam can be generated by deploying, for example, switchable polarizing reflectors at the seat of the pixels in the display.
[00032] While this invention disclosure teaches embodiments comprising iLEDs (micro- LEDs), it should be pointed out that other light emitting pixels can be used such as, by way of example only, that of OLEDs or TOLEDs. The present invention has been described with reference to particular embodiments having various features. In light of the disclosure provided above, it will be apparent to those skilled in the art that various modifications and variations can be made in the practice of the present invention without departing from the scope or spirit of the invention. One skilled in the art will recognize that the disclosed features may be used singularly, in any combination, or omitted based on the requirements and specifications of a given application or design. When an embodiment refers to“comprising” certain features, it is to be understood that the embodiments can alternatively“consist of’ or“consist essentially of’ any one or more of the features. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention.
[00033] [000356] It is noted that where a range of values is provided in this specification, each value between the upper and lower limits of that range is also specifically disclosed. The upper and lower limits of these smaller ranges may independently be included or excluded in the range as well. The singular forms“a,”“an,” and“the” include plural referents unless the context clearly dictates otherwise. It is intended that the specification and examples be considered as exemplary in nature and that variations that do not depart from the essence of the invention fall within the scope of the invention. Further, all of the references cited in this disclosure are each individually incorporated by reference herein in their entireties and as such are intended to provide an efficient way of supplementing the enabling disclosure of this invention as well as provide background detailing the level of ordinary skill in the art.

Claims

1) An augmented reality system comprising a see-through near eye display and a micro-lens array, wherein the see-through near eye display comprises one or more light emitting pixels that are aligned with one or more micro-lenses of the micro-lens array, wherein the augmented reality system causes an eye of a wearer of the augmented reality system to change or adjust a location of its fixation by illuminating a different one or more light emitting pixels of the see-through near eye display, and wherein the change or adjustment to the location of the fixation of the eye of the wearer of the augmented reality system results in a perceived partial or full change of a location or 3D effect of a virtual image as perceived by the wearer of the augmented reality system.
2) The augmented reality system of claim 1, wherein the location of the virtual image is generated by a location of the one or more light emitting pixels being activated and causing the eye of the wearer to move to fixate on the activated one or more light emitting pixels.
3) The augmented reality system of claim 1, wherein movement of the virtual image is generated by a location of the one or more light emitting pixels being activated, wherein the activated light emitting pixels cause the eye of the wearer to move to fixate on the activated one or more light emitting pixels.
4) The augmented reality system of claim 1, wherein brightness of the one or more light emitting pixels is increased by overlapping an image on a retina of the eye of the wearer, and wherein the image is generated by a one or more pixel patches.
5) The augmented reality system of claim 4, wherein the overlap of the overlapping image is
90% to 100%. 6) The augmented reality system of claim 1, wherein the virtual image is enhanced by dithering an overlap of the virtual image using pixel patches.
7) The augmented reality system of claim 1, wherein the virtual image is enhanced by dithering an overlap of the virtual image using the micro-lenses of the micro-lens array.
8) The augmented reality system of claim 1, further comprising a sealed optical module comprising a see-through near eye display and a distance separated and optically aligned micro- lens array, wherein the see-through near eye display comprises iLEDs (micro-LEDs) or OLEDs.
9) The augmented reality system of claim 1, wherein the micro-lens of the micro-lens array are 400 - 600 microns.
10) The augmented reality system of claim 1, wherein the micro-lens array comprises one or more lenslet, wherein the size of each lenslet is in the range of 5 microns to 100 microns.
11) The augmented reality system of claim 10, wherein the augmented reality system is configured to generate a Bessel beam from the see-through near eye display to one or more lenslets, and wherein the Bessel beam is generated using switchable, polarizing reflectors in or on the see-through near eye display.
12) The augmented reality system of claim 1, wherein the see-through near eye display comprises one or more pixels, and wherein the size of the one or more pixels is 3 microns or less.
13) The augmented reality system of claim 1, wherein the see-through near eye display comprises one or more pixels, and wherein the size of the one or more pixels is 1.5 mm or less.
14) The augmented reality system of claim 1, wherein a pixel fill factor of the see-through near eye display is less than 5%. 15) The augmented reality system of claim 1, wherein the see-through near eye display comprises iLEDs (micro-lenses), and wherein the iLEDs (micro-lenses) are modulated at 30 Hz or higher.
16) The augmented reality system of claim 15, wherein the iLEDs (micro-lenses) of the see- through near eye display have a duty cycle of 1% or higher.
17) The augmented reality system of claim 15, wherein the iLEDs (micro-lenses) of the see- through near eye display have a duty cycle of between 1% and 25%.
18) The augmented reality system of claim 1, wherein the virtual image is generated using aspheric micro-lenses.
19) The augmented reality system of claim 1, wherein the virtual image is generated using a light aperture around a pixel patch or pixel patches and/or around the micro-lenses.
20) The augmented reality system of claim 1, wherein a diameter of the micro-lenses is larger than an aligned and spaced pixel patch or pixel patches to which the micro-lens is in optical communication with.
21) The augmented reality system of claim 1, wherein the augmented reality system reduces light loss by increasing an amount of light projecting towards the eye of the wearer.
22) The augmented reality system of claim 1, further comprising a plurality of pixel patches optically aligned with the micro-lenses of the micro-lens array.
23) The augmented reality system of claim 1, further comprising curved or faceted architecture of the see-through near eye display, and wherein a see-through near eye display optical module partially or completely matches the front base curve of a spectacle lens with which it is aligned and in optical communication with. 24) The augmented reality system of claim 1, wherein the light emitting pixels and/or the micro- lenses of the micro-lens array are dithered.
25) The augmented reality system of claim 1, wherein the augmented reality system is configured to remove or turn off a pixel patch or pixel patches.
26) The augmented reality system of claim 1, wherein the magnification of the virtual image is 8X or less.
27) The augmented reality system of claim 1, further comprising a recessed pixel or pixel patch within a recessed cone structure located within a surface of a partially or completely transparent substrate to which the pixel or pixel patch is deposited.
28) The augmented reality system of claim 27, further comprising a metallized coating on the recessed cone structure.
29) The augmented reality system of claim 1, wherein the augmented reality system is configured to increase a number of the light emitting pixels to provide the virtual image that partially or completely fills a fovea of the eye of the wearer while utilizing a lower number of light emitting pixels that provide the virtual image that partially or completely fills a macular area other than that of the fovea.
30) An augmented reality system comprising a see-through near eye display, wherein the see- through near eye display comprises light emitting pixels, wherein the see-through near eye display alters a location of a virtual image as perceived by a wearer of the augmented reality system, by first illuminating a different pixel or pixels of the see-through near eye display.
PCT/US2019/038624 2018-07-05 2019-06-22 See-through near eye optical display WO2020009819A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW108123133A TW202007145A (en) 2018-07-05 2019-07-01 See-through near eye optical display

Applications Claiming Priority (92)

Application Number Priority Date Filing Date Title
US201862694222P 2018-07-05 2018-07-05
US62/694,222 2018-07-05
US201862700632P 2018-07-19 2018-07-19
US62/700,632 2018-07-19
US201862703909P 2018-07-27 2018-07-27
US201862703911P 2018-07-27 2018-07-27
US62/703,909 2018-07-27
US62/703,911 2018-07-27
US201862711669P 2018-07-30 2018-07-30
US62/711,669 2018-07-30
US201862717424P 2018-08-10 2018-08-10
US62/717,424 2018-08-10
US201862720113P 2018-08-20 2018-08-20
US62/720,113 2018-08-20
US201862720116P 2018-08-21 2018-08-21
US62/720,116 2018-08-21
US201862728251P 2018-09-07 2018-09-07
US62/728,251 2018-09-07
US201862732039P 2018-09-17 2018-09-17
US201862732138P 2018-09-17 2018-09-17
US62/732,138 2018-09-17
US62/732,039 2018-09-17
US201862739904P 2018-10-02 2018-10-02
US201862739907P 2018-10-02 2018-10-02
US62/739,904 2018-10-02
US62/739,907 2018-10-02
US201862752739P 2018-10-30 2018-10-30
US62/752,739 2018-10-30
US201862753583P 2018-10-31 2018-10-31
US62/753,583 2018-10-31
US201862754929P 2018-11-02 2018-11-02
US62/754,929 2018-11-02
US201862755630P 2018-11-05 2018-11-05
US201862755626P 2018-11-05 2018-11-05
US62/755,630 2018-11-05
US62/755,626 2018-11-05
US201862756542P 2018-11-06 2018-11-06
US201862756528P 2018-11-06 2018-11-06
US62/756,542 2018-11-06
US62/756,528 2018-11-06
US201862769883P 2018-11-20 2018-11-20
US62/769,883 2018-11-20
US201862770210P 2018-11-21 2018-11-21
US62/770,210 2018-11-21
US201862771204P 2018-11-26 2018-11-26
US62/771,204 2018-11-26
US201862774362P 2018-12-03 2018-12-03
US62/774,362 2018-12-03
US201862775945P 2018-12-06 2018-12-06
US62/775,945 2018-12-06
US201862778960P 2018-12-13 2018-12-13
US201862778972P 2018-12-13 2018-12-13
US62/778,972 2018-12-13
US62/778,960 2018-12-13
US201862780396P 2018-12-17 2018-12-17
US201862780391P 2018-12-17 2018-12-17
US62/780,391 2018-12-17
US62/780,396 2018-12-17
US201862783603P 2018-12-21 2018-12-21
US201862783596P 2018-12-21 2018-12-21
US62/783,603 2018-12-21
US62/783,596 2018-12-21
US201862785284P 2018-12-27 2018-12-27
US62/785,284 2018-12-27
US201962787834P 2019-01-03 2019-01-03
US62/787,834 2019-01-03
US201962788275P 2019-01-04 2019-01-04
US62/788,275 2019-01-04
US201962788995P 2019-01-07 2019-01-07
US201962788993P 2019-01-07 2019-01-07
US62/788,995 2019-01-07
US62/788,993 2019-01-07
US201962790516P 2019-01-10 2019-01-10
US201962790514P 2019-01-10 2019-01-10
US62/790,514 2019-01-10
US62/790,516 2019-01-10
US201962793166P 2019-01-16 2019-01-16
US62/793,166 2019-01-16
US201962794779P 2019-01-21 2019-01-21
US62/794,779 2019-01-21
US201962796388P 2019-01-24 2019-01-24
US201962796410P 2019-01-24 2019-01-24
US62/796,388 2019-01-24
US62/796,410 2019-01-24
US16/289,623 US10634912B2 (en) 2017-06-01 2019-02-28 See-through near eye optical module
US16/289,623 2019-02-28
US201962830645P 2019-04-08 2019-04-08
US62/830,645 2019-04-08
US201962847427P 2019-05-14 2019-05-14
US62/847,427 2019-05-14
US201962848636P 2019-05-16 2019-05-16
US62/848,636 2019-05-16

Publications (1)

Publication Number Publication Date
WO2020009819A1 true WO2020009819A1 (en) 2020-01-09

Family

ID=69059915

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/038624 WO2020009819A1 (en) 2018-07-05 2019-06-22 See-through near eye optical display

Country Status (1)

Country Link
WO (1) WO2020009819A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112649960A (en) * 2020-12-08 2021-04-13 复旦大学 Accurate adjusting method for diopter of virtual reality glasses

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6990228B1 (en) * 1999-12-17 2006-01-24 Canon Kabushiki Kaisha Image processing apparatus
US20120320100A1 (en) * 2011-06-16 2012-12-20 Sony Corporation Display apparatus
US8582209B1 (en) * 2010-11-03 2013-11-12 Google Inc. Curved near-to-eye display
US20140146394A1 (en) * 2012-11-28 2014-05-29 Nigel David Tout Peripheral display for a near-eye display device
US20160379606A1 (en) * 2015-06-29 2016-12-29 Microsoft Technology Licensing, Llc Holographic near-eye display
US20170131764A1 (en) * 2015-10-26 2017-05-11 Pillantas Inc. Systems and methods for eye vergence control
US20170131545A1 (en) * 2015-11-10 2017-05-11 R. Andrew Wall Waveguide coatings or substrates to improve intensity distributions
US20170293148A1 (en) * 2014-10-20 2017-10-12 Intel Corporation Near-eye display system
WO2018001917A1 (en) * 2016-06-28 2018-01-04 Hologram Industries Research Gmbh Display apparatus for superimposing a virtual image into the field of vision of a user
US9898082B1 (en) * 2016-11-01 2018-02-20 Massachusetts Institute Of Technology Methods and apparatus for eye tracking

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6990228B1 (en) * 1999-12-17 2006-01-24 Canon Kabushiki Kaisha Image processing apparatus
US8582209B1 (en) * 2010-11-03 2013-11-12 Google Inc. Curved near-to-eye display
US20120320100A1 (en) * 2011-06-16 2012-12-20 Sony Corporation Display apparatus
US20140146394A1 (en) * 2012-11-28 2014-05-29 Nigel David Tout Peripheral display for a near-eye display device
US20170293148A1 (en) * 2014-10-20 2017-10-12 Intel Corporation Near-eye display system
US20160379606A1 (en) * 2015-06-29 2016-12-29 Microsoft Technology Licensing, Llc Holographic near-eye display
US20170131764A1 (en) * 2015-10-26 2017-05-11 Pillantas Inc. Systems and methods for eye vergence control
US20170131545A1 (en) * 2015-11-10 2017-05-11 R. Andrew Wall Waveguide coatings or substrates to improve intensity distributions
WO2018001917A1 (en) * 2016-06-28 2018-01-04 Hologram Industries Research Gmbh Display apparatus for superimposing a virtual image into the field of vision of a user
US9898082B1 (en) * 2016-11-01 2018-02-20 Massachusetts Institute Of Technology Methods and apparatus for eye tracking

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112649960A (en) * 2020-12-08 2021-04-13 复旦大学 Accurate adjusting method for diopter of virtual reality glasses
CN112649960B (en) * 2020-12-08 2021-10-26 复旦大学 Accurate adjusting method for diopter of virtual reality glasses

Similar Documents

Publication Publication Date Title
US10634921B2 (en) See-through near eye optical display
US10634912B2 (en) See-through near eye optical module
US11204641B2 (en) Light management for image and data control
US10275024B1 (en) Light management for image and data control
US11644669B2 (en) Depth based foveated rendering for display systems
US10345599B2 (en) Tile array for near-ocular display
CN108375840B (en) Light field display unit based on small array image source and three-dimensional near-to-eye display device using light field display unit
US8994614B2 (en) Head mountable display
JP5801401B2 (en) Opaque filter for transmissive head mounted display
US20130021226A1 (en) Wearable display devices
KR20180135646A (en) Method for providing composite image based on optical see-through and apparatus using the same
US11454815B2 (en) Transparent optical module using pixel patches and associated lenslets
IL228839A (en) Image display utilizing a variable mask to selectively block image data
EP3762764B1 (en) See-through near eye optical module
CN113640988A (en) Optical imaging array system, near-to-eye display device and optical system image projection method
TW201945791A (en) See-through near eye optical module
WO2020009819A1 (en) See-through near eye optical display
US20230185114A1 (en) Eyewear
WO2021222218A1 (en) See-through near eye display optical dithering
TW202007145A (en) See-through near eye optical display
KR20240095444A (en) Head-wearable display device
CN112764223A (en) Augmented reality lens, augmented reality glasses and augmented reality imaging method
JP2019153958A (en) Head-up display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19830357

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 15/04/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19830357

Country of ref document: EP

Kind code of ref document: A1