CN117590599A

CN117590599A - Optical component for shared experience

Info

Publication number: CN117590599A
Application number: CN202311033370.0A
Authority: CN
Inventors: P·X·王; J·C·弗兰克林
Original assignee: Apple Inc
Current assignee: Apple Inc
Priority date: 2022-08-18
Filing date: 2023-08-16
Publication date: 2024-02-23

Abstract

The present disclosure relates to optical components for sharing experiences. A head-mountable device is capable of cooperating with one or more optical components of the head-mountable device to provide a shared experience and content enjoyment to multiple users. Such operations can be facilitated by a connection between the head-mountable device and one or both of the optical components of the head-mountable device to allow different users to receive content. Such connection can be made possible by a communication link that directly and/or physically connects the head-mountable device with one or both of the optical components of the head-mountable device when one or both of the optical components are removed from the head-mountable device for operation by a separate user. The ability to provide multiple outputs on separate components allows separate users to participate in a shared experience.

Description

Optical component for shared experience

Cross Reference to Related Applications

The present application claims the benefit of U.S. provisional application 63/399,175, entitled "OPTICAL ASSEMBLIES FOR SHARED EXPERIENCE," filed 8.18, 2022, the entire contents of which are incorporated herein by reference.

Technical Field

The present description relates generally to head-mountable devices, and more particularly, to head-mountable devices having optical components that facilitate a shared experience.

Background

A user may wear a wearable device to display visual information within the user's field of view. The head-mounted device may be used as a Virtual Reality (VR) system, an Augmented Reality (AR) system, and/or a Mixed Reality (MR) system. The user may observe output provided by the head-mountable device, such as visual information provided on a display. The display may optionally allow a user to view the environment external to the head-mountable device. Other outputs provided by the head-mountable device may include speaker output and/or haptic feedback. The user may further interact with the head-mountable device by providing input for processing by one or more components of the head-mountable device. For example, a user may provide tactile input, voice commands, and other inputs while the device is mounted to the user's head.

Drawings

Some features of the subject technology are set forth in the following claims. However, for purposes of explanation, several embodiments of the subject technology are set forth in the following figures.

Fig. 1 illustrates a top view of a head-mountable device according to some embodiments of the present disclosure.

Fig. 2 illustrates a rear view of a head mounted device according to some embodiments of the present disclosure.

Fig. 3 illustrates a top view of a head-mountable device with one of the two optical components partially removed, according to some embodiments of the present disclosure.

Fig. 4 illustrates a top view of the head-mountable device and optical assembly of fig. 3, with the optical assembly separated from the head-mountable device for use when connected to the head-mountable device by a cable, according to some embodiments of the present disclosure.

Fig. 5 illustrates a top view of a head-mountable device with one of the two optical components partially removed, according to some embodiments of the present disclosure.

Fig. 6 illustrates a top view of the head-mountable device and optical component of fig. 5, with the optical component separated from the head-mountable device for use in wireless communication with the head-mountable device, according to some embodiments of the present disclosure.

Fig. 7 illustrates a top view of a head-mountable device and an optical assembly according to some embodiments of the present disclosure, wherein the optical assembly is separate from the head-mountable device for use when connected to the head-mountable device by a cable.

Fig. 8 illustrates a view of a cable having a retraction feature according to some embodiments of the present disclosure.

Fig. 9 illustrates a block diagram of a head-mountable device according to some embodiments of the present disclosure.

Detailed Description

The detailed description set forth below is intended as a description of various configurations of the subject technology and is not intended to represent the only configurations in which the subject technology may be practiced. The accompanying drawings are incorporated in and constitute a part of this specification. The specific embodiments include specific details for the purpose of providing a thorough understanding of the subject technology. However, it will be clear and apparent to one skilled in the art that the subject technology is not limited to the specific details shown herein and may be practiced without these specific details. In some instances, well-known structures and components are shown in block diagram form in order to avoid obscuring the concepts of the subject technology.

A wearable device, such as a wearable display, headset, goggles, smart glasses, head-up display, etc., may perform a series of functions managed by components (e.g., sensors, circuitry, and other hardware) included in the wearable device.

The head-mountable device can cooperate with one or more optical components of the head-mountable device to provide a shared experience and content enjoyment to multiple users. Such operations may be facilitated by a connection between the head-mountable device and one or both of its optical components to allow different users to receive content. Such connection may be made possible by a communication link that directly and/or physically connects the head-mountable device with one or both of the optical components of the head-mountable device when the one or both of the optical components are removed from the head-mountable device for operation by a separate user.

The burden of processing may be shared among multiple devices and/or delegated to a designated device. At least some content provided for output on the head-mountable device may be sent to a separate optical component device for output at the optical component device. The connection may facilitate such transmission in a manner that reduces the burden of generating content and/or adapting content for output on any given display. The ability to provide multiple outputs on separate components allows separate users to participate in a shared experience.

These and other embodiments are discussed below with reference to fig. 1-9. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes only and should not be construed as limiting.

Referring to fig. 1 and 2, the head-mountable device 100 may include a frame 110 and a head adapter 120. The frame 110 may be worn on the head of the user. The frame 110 may be positioned in front of the user's eyes to provide information within the field of view of the user. The frame 110 may optionally provide a nose piece that rests on the nose of the user and/or other face engaging portions that rest against the face of the user.

According to some embodiments, for example, as shown in fig. 1, the head-mountable device 100 includes a frame 110 and a face seal 122 that are worn on the head of a user. The frame 110 may be positioned in front of the user's eyes to provide information within the field of view of the user. The frame 110 and/or the face seal 122 may provide a nose piece that rests on the nose of the user.

The frame 110 may be supported on the head of a user with a head adapter 120. The head adapter 120 may wrap or extend along opposite sides of the user's head and/or toward the rear of the user's head. The head adapter 120 may optionally include headphones for wrapping around or otherwise engaging or resting on the user's ear. It should be appreciated that other configurations may be applied to secure the head-mountable device 100 to the head of a user. For example, one or more straps, bands, covers, caps, or other components may be used in addition to or in lieu of the illustrated components of the wearable device 100. As another example, the head adapter 120 may include a plurality of features for engaging the head of a user. The head adapter 120 may extend from the frame 110 and/or the face seal 122.

The frame 110 may provide structure about its peripheral region to support any internal components of the frame 110 in their assembled position. For example, the frame 110 may encapsulate and support various internal components (including, for example, integrated circuit chips, processors, memory devices, and other circuitry) to provide computing and functional operations for the head-mountable device 100, as discussed further herein. While several components are shown within the frame 110, it will be understood that some or all of these components may be located anywhere within or on the head-mountable device 100. For example, one or more of these components may be positioned within the face seal 122 and/or the head adapter 120 of the head-mountable device 100.

While the face seal 122 is schematically illustrated as having a particular size and shape, it will be appreciated that the size and shape of the face seal 122 (particularly at the inside of the face seal) may have a size and shape that accommodates the face of a user wearing the wearable device 100. For example, the face seal 122 may provide a shape that substantially matches the contour of the user's face around the user's eyes. The face seal 122 may be provided with one or more features that allow the face seal 122 to conform to the face of the user to enhance comfort and to block light from entering the face seal 122 when in contact with the face. For example, the face seal 122 may provide a flexible, soft, resilient, and/or compliant structure. The face seal 122 may be provided with customization and adjustability so that the head-mountable device 100 is in a desired position and orientation relative to the user's face and head during use. The engagement of the face seal 122 with the face may prevent or limit the ingress of light from the external environment.

The head-mountable device 100 can include and/or support one or more cameras 130. The camera 130 may be positioned on or near the outside of the frame 110 to capture images of views external to the head-mountable device 100. As used herein, the outside of a portion of a head-mountable device is the side facing away from the user and/or toward the external environment. The captured image may be available for display to a user or stored for any other purpose. Each of the cameras 130 may be movable along the frame 110.

The head-mountable device 100 can include an optical component 200 that provides visual output for viewing by a user wearing the head-mountable device 100 and/or another user. One or more optical assemblies 200 may be positioned on or near the inside of the frame 110. As used herein, the inside of a portion of the head-mountable device 100 is the side facing the user and/or facing away from the external environment.

The optical assembly 200 may transmit light from a physical environment (e.g., as captured by a camera) for viewing by a user. Such an optical assembly 200 may include optical characteristics such as lenses for vision correction based on incident light from a physical environment. Additionally or alternatively, the optical assembly 200 may provide information as a display within the field of view of the user. Such information may be provided instead of or in addition to (e.g., overlaying) the view of the physical environment.

The physical environment relates to the physical world that people can sense and/or interact with without necessarily requiring assistance from an electronic device. Computer-generated reality environments involve fully or partially simulated environments in which people sense and/or interact with the assistance of electronic devices. Examples of computer-generated reality include mixed reality and virtual reality. Examples of mixed reality may include augmented reality and augmented virtualization. Some examples of electronic devices that enable a person to sense and/or interact with various computer-generated reality environments include head-mountable systems, projection-based systems, heads-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses (e.g., similar to contact lenses) designed to be placed on a person's eyes, headphones/earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablet computers, and desktop/laptop computers. The head-mountable device may have an integrated opaque display, have a transparent or translucent display, or be configured to accept an external opaque display (e.g., a smart phone).

As shown in fig. 2, when coupled to the frame 110, each optical assembly 200 may be adjusted to align with a corresponding eye of a user. For example, each optical assembly 200 may be moved along one or more axes until the center of each optical assembly 200 is aligned with the center of the corresponding eye. Thus, the distance between displays 250 may be set and/or changed based on the user's pupil distance ("IPD"). IPD is defined as the distance between the pupil centers of the user's eyes.

The head-mountable device 100 can include one or more lens assemblies 290 that are each coupled to a corresponding one of the optical assemblies in a relative position and orientation that is preferred for a given user. The lens assembly 290 may be or include one or more lenses for providing vision correcting capabilities.

Referring now to fig. 3 and 4, the head-mountable device can operate in one of a plurality of configurations that allow one user or multiple individual users to wear components of the head-mountable device for an optional sharing experience of the output of the head-mountable device. It will be appreciated that the apparatus and system of fig. 3 and 4 may include any one or more of the features of the apparatus of fig. 1 and 2 as described herein, even though not shown in fig. 3 and 4.

In a first configuration, as described herein, the optical component 200 of the head-mountable device 100 can be coupled to the frame 110 for use by a single user. For example, each of the optical assemblies 200 may be provided in alignment with each of the two eyes of the user, thereby providing a stereoscopic output to the user.

As shown in fig. 3, the components of the assembled head-mountable device 100 may be separated from other components to provide a separate operation by another user. In a second configuration of the head-mountable device 100, one optical component 200 may provide visual output to a first user (e.g., wearing the head-mountable device 100) and another optical component 200 may provide another visual output to a second user (e.g., not wearing the head-mountable device 100). For example, the optical assembly 200 and/or the lens assembly 290 may be separated from other components for separate operation by another user.

The frame 110, optical assembly 200, and lens assembly 290 of the head-mountable device 100 may be securely and releasably coupled together. For example, the frame engager 188 of the frame 110 may releasably engage the optical assembly engager 288 of the optical assembly 200. As another example, the lens assembly engagement 296 of the lens assembly 290 may releasably engage the other optical assembly engagement 286 of the optical assembly 200. One or more of a variety of mechanisms may be provided to secure the components to one another. For example, mechanisms such as locks, latches, snaps, slides, channels, screws, clasps, threads, magnets, pins, interference (e.g., friction) fits, roller presses, bayonet locks, fused materials, fabrics, knits, braids, hook and loop fasteners, and/or combinations thereof may be included to couple and/or secure the head-mountable device 100 together. The components may remain fixed to each other until the optional release mechanism is actuated. Where applicable, a release mechanism may be provided for access by the user.

As described herein, at least some of the adapters may include a magnet. As used herein, "magnet" may include a magnet of hard magnetic material and/or a magnet of soft magnetic material. For example, some of the magnets (e.g., the magnets of the frame adapter 188, the optical assembly adapter 288, and/or the lens assembly adapter 296) may form permanent magnets, and some of the magnets may be responsive to magnetic fields. Hard magnetic materials include materials that retain their magnetic properties even after removal of an applied magnetic field. The magnet comprising hard magnetic material may form a permanent magnet. Hard magnetic materials include neodymium (NdFeB), ferrite, alNiCo, iron neodymium, iron boron, samarium cobalt, iron chromium cobalt, and combinations or alloys thereof. Soft magnetic materials include materials that respond to magnetic fields but do not retain their magnetic properties after removal of an applied magnetic field. A magnet comprising soft magnetic material may form the temporary magnet. Soft magnetic materials include iron, iron cobalt, iron silicon (FeSi), steel, stainless steel, iron aluminum silicon, nickel iron, ferrite, and combinations or alloys thereof. It should be understood that "hard" and "soft" are not necessarily related to the stiffness of the material. It will be appreciated that other attachment mechanisms may be employed in addition to or in lieu of magnets.

The optical assembly 200 may include features that facilitate separate operations when removed from the frame 110 of the head-mountable device 100. Such features may allow a separate (e.g., secondary) user to wear and/or operate the optical assembly 200 while the frame 110 is worn by the primary user.

Each optical assembly 200 may include a display 250 that provides visual output to a user operating the optical assembly 200. Such a display 250 may be an integrated opaque display and/or a transparent or translucent display. Such a transparent or translucent display may have a medium through which light representing an image is directed to the eyes of a person. The display 250 may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light sources, or any combination of these techniques. The medium may be an optical waveguide, a holographic medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to selectively become opaque. Projection-based systems may employ retinal projection techniques that project a graphical image onto a person's retina. The projection system may also be configured to project the virtual object into the physical environment, for example as a hologram or on a physical surface.

Each optical assembly 200 may include a processor 210 (e.g., control circuitry) having one or more processing units including or configured to access a memory having instructions stored thereon. Processor 210 may be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, the processor 210 may include one or more of the following: a microprocessor, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to encompass a single processor or processing unit, multiple processors, multiple processing units, or one or more other suitably configured computing elements.

Each optical assembly 200 may include a sensor 270. The sensor 270 may be positioned and arranged to detect characteristics of the user, such as facial features. For example, such user sensors may perform facial feature detection, facial motion detection, facial recognition, eye tracking, user emotion detection, voice detection, and the like. As another example, the sensor 270 may be or include an eye tracking sensor that may track characteristics of a user wearing the wearable device 100, including a condition of the user's eyes (e.g., focal length, pupil size, etc.). For example, an eye sensor may optically capture a view of an eye (e.g., pupil) and determine a direction of a user's gaze. Such eye tracking may be used to determine a location and/or orientation of interest for the optical component 200 and/or elements presented thereon. Such information may be used as a basis for output from the optical assembly 200 and/or the head-mountable device 100. The user interface element may then be provided on the optical assembly 200 and/or the head-mountable device 100 based on this information, for example in an area along the direction of the user's gaze, or in an area other than the current gaze direction, as further described herein. Detection by the eye tracking sensor may determine user actions that are interpreted as user inputs. Such user inputs may be used alone or in combination with other user inputs to perform certain actions. As another example, the sensors 270 may include IMUs, depth sensors, user input components (e.g., touch sensors, crowns, touch pads, buttons, microphones, etc.).

Each optical assembly 200 may include a camera 230. The camera 230 may be positioned on or near the outside of the optical assembly 200 to capture images of views external to the optical assembly 200. The captured image may be available for display to a user (e.g., on display 250) or stored for any other purpose.

As further shown in fig. 3, the lens assembly 290 may be or include one or more lenses 292 for providing vision correcting capabilities. It will be appreciated that where multiple lenses are used, the lenses 292 of the lens assembly 290 may be provided together or separately (e.g., for combination). The one or more lenses 292 may provide one or more types of optical effects and/or vision correction. Lens 292 may include other optical components as needed to produce the desired optical effect. For example, lens 292 may provide vision correction for light for a given user as appropriate. Such corrections may be spherical, aspherical, toroidal, cylindrical, monoscopic, multifocal, progressive, and/or adjustable. As another example, lens 292 may include one or more diffusers, filters, polarizers, prisms, beam splitters, diffraction gratings, mirrors, and/or windows. Differences in correction or other effects between lenses 292 of different lens assemblies 290 may include variations in correction type, diopters, axes of correction, and the like. Various corrective combinations may be provided with different lens assemblies 290. For example, each of the lenses 292 of any given lens assembly 290 may have a known correction type based on the identity of that lens. A corresponding identifier, such as a stock keeping unit ("SKU"), may be assigned for reference and to facilitate selection of the lens assembly 290 for a given user. Thus, different users may use different lens assemblies 290 and/or not use lens assemblies 290 as desired.

For example, a user may use one lens assembly 290 while the corresponding optical assembly 200 is coupled to the frame 110. A second user may use a different lens assembly 290 while the corresponding optical assembly 200 is separated from the frame 110. Accordingly, the corresponding user may provide the appropriate lens assembly 290 as needed.

To facilitate replacement of the lens assemblies, each lens assembly 290 may also include one or more lens assembly adapters 296 (e.g., magnets). The lens assembly adapter 296 may facilitate coupling of the lens assembly 290 to the corresponding optical assembly 200 in a relative position and orientation that aligns the lens 292 of the lens assembly 290 in a preferred position and orientation relative to the display 250 of the corresponding optical assembly 200. It will be appreciated that such placement may allow lens assembly 290 to be securely held in any position that places lens 292 within the user's field of view and/or between the user and display 250.

The optical assembly 200 may include or be coupled to an eye seal 294. While the eye seal 294 is schematically shown as having a particular size and shape, it will be appreciated that the size and shape of the eye seal 294 (particularly at the inside of the eye seal) may have a size and shape that accommodates the face of the user in the region of the eyes. For example, the eye seal 294 may provide a shape that substantially matches the contour of the user's face around the eye to which the optical assembly 200 is held. The eye seal 294 may be provided with one or more features that allow the eye seal 294 to conform to the user's face to enhance comfort and to block light from entering the eye seal 294 when in contact with the face. For example, the eye seal 294 may provide a flexible, soft, resilient, and/or compliant structure. The eye seal 294 may be provided with customization and adjustability so that the optical assembly 200 is in a desired position and orientation relative to the user's face during use. The engagement of the eye seal 294 with the face may prevent or limit the ingress of light from the external environment.

As further shown in fig. 3, a cable 222 may be provided to facilitate communication between the components. The cables 222 may operatively connect the corresponding optical assemblies 200 to the frame 110 and components of the frame, such as the processor 150. For example, the cable 222 may include two or more end portions that each include a mechanism for facilitating attachment to and communication with each of the plurality of components. In some embodiments, the cable 222 may provide operable communication when the optical assembly 200 is coupled to the frame 110 and when the optical assembly 200 is decoupled from the frame 110. In some embodiments, the cable 222 may provide operable communication when the optical assembly 200 is separated from the frame 110, and a separate communication interface may provide operable communication when the optical assembly 200 is coupled to the frame 110. For example, the cable 222 may be provided and connected after the optical assembly 200 is separated from the frame 110. As another example, the cable 222 can include an end portion that provides engagement and facilitates mechanical coupling and a communication interface that facilitates a communication link. The communication interface may include one or more of a variety of features, such as an electrical connector, a pogo pin, a conductive surface, a wireless receiver/transmitter, and/or an inductive coupling feature (e.g., a coil) for communicatively coupling to the communication interface. The communication interface may include a pair of conductive contacts configured to make electrical contact when the end portion is engaged with a corresponding component.

As shown in fig. 4, the head-mountable device 100 and the optical assembly 200 may form a system 10 in which the head-mountable device and the optical assembly may each operate separately, for example, when worn by a separate user. When connected by cable 222, the head-mountable device 100 and the optical assembly 200 can communicate with each other and operate in concert. Thus, signals may be transmitted and received by each of the head-mountable device 100 and the optical component 200 via the cable 222.

The cable 222 may facilitate a direct connection between the head-mountable device 100 and the optical component 200. For example, cable 222 may include a conductive wire that transmits unmodified signals between devices such that signals substantially identical to the signals transmitted from the source device are received at the destination device. When connected by cable 222, the signal shared between the head-mountable device 100 and the optical component 200 may be related to the output provided by both the head-mountable device 100 and the optical component 200. For example, the head-mountable device 100 may be operated to provide an output at the remaining optical components 200 of the head-mountable device, and the head-mountable device 100 may output a signal to the individual optical components 200 via the cable 222, so the head-mountable device may provide a related output at the display of the head-mountable device. The signals transmitted via cable 222 may be the same or similar to the signals used to operate optical assembly 200.

While the signal may be related to the visual output provided by the display of the optical assembly 200, it will be appreciated that the same or different signal transmitted through the cable 222 may be related to other content shared between the head-mountable device 100 and the optical assembly 200. For example, cable 222 may transmit signals related to other outputs provided by the head-mountable device 100 and optical assembly 200, such as sound, haptic feedback, and the like. The cable 222 may transmit signals between devices without necessarily providing a correlation output.

It will be appreciated that the outputs provided by the head-mountable device 100 and the optical component 200 may be the same or different. For example, in some embodiments, an output (e.g., visual output) may be replicated for each of two users to view. In some embodiments, the output (e.g., visual output) may be different for users related to each other, such as by providing different views of the same object (e.g., real or virtual) based on different perspectives of the user. For example, the head-mountable device 100 can provide an output based on the field of view 20 captured by the camera of the head-mountable device, and the optical component 200 can provide an output based on the field of view 30 captured by the camera of the optical component. In some embodiments, the output (e.g., visual output) of the head-mountable device 100 and the optical component 200 may be completely independent, e.g., based on individual user selections, while both types of output are optionally managed by the head-mountable device 100.

Referring now to fig. 5 and 6, the head-mountable device can operate in one of a plurality of configurations that allow one user or multiple individual users to wear components of the head-mountable device for an optional sharing experience of the output of the head-mountable device. It will be appreciated that the apparatus and system of fig. 5 and 6 may include any one or more of the features of the apparatus and system of fig. 1-4 as described herein, even though not shown in fig. 5 and 6.

As shown in fig. 5, the components of the assembled head-mountable device 100 may be separated from other components to provide a separate operation by another user. In a second configuration of the head-mountable device 100, one optical component 200 may provide visual output to a first user (e.g., wearing the head-mountable device 100) and another optical component 200 may provide another visual output to a second user (e.g., not wearing the head-mountable device 100). For example, the optical assembly 200 and/or the lens assembly 290 may be separated from other components for separate operation by another user.

When the optical assembly 200 is coupled to the frame 110, operation of the optical assembly 200 may be controlled by the processor 150 of the head-mountable device 100. When coupled to the frame 110, the processor 150 and/or other components may be operably connected to the optical assembly 200 through one or more of a variety of connections. For example, one or more of the optical component connectors 254 may include elements for making electrical connections, such as at least partially collapsible pogo pins and/or contact pads provided by the frame connector 164 of the frame 110. As another example, the pogo pins of the optical assembly connector 254 may be spring loaded and/or the contact pads of the frame connector 164 may be formed of conductive foam or elastomer. It will be appreciated that the arrangement of the parts may be varied, for example using pogo pins extending from the frame 110 and/or contact pads positioned at the optical assembly 200. Such a connection may be easily released when the optical assembly 200 is removed from the frame 110.

It will be appreciated that the head-mountable device 100 may have one or more of the features shown and described herein with respect to fig. 3 and 4. Such features will not be described in detail. However, it will be appreciated that such features may optionally be provided. For example, each optical assembly 200 may include a display 250, a processor 210, a sensor 270, and/or a camera 230. For example, each optical assembly 200 may include or be coupled to a lens assembly 290.

Each optical assembly 200 may include features that facilitate wireless operation of the optical assembly 200, among other features. In some embodiments, each optical assembly 200 may include a battery 240 to provide power to other components of the optical assembly 200. The battery 240 may be charged while connected to the frame 110 and store power for use during separation from the frame 110.

Each optical assembly 200 may include a wireless communication interface 220 for communicating with the wireless communication interface 166 of the head-mountable device 100 (e.g., located at and/or supported by the frame 110) using any suitable communication protocol. For example, the wireless communication interface 220 may support Wi-Fi (e.g., 802.11 protocol), bluetooth, high frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems), infrared, TCP/IP (e.g., any of the protocols used in each of the TCP/IP layers), HTTP, bitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The wireless communication interface 220 may also include an antenna for transmitting and receiving electromagnetic signals. It will be appreciated that the wireless communication interface 220 may provide a communication link without requiring a physical connection (e.g., a cable).

When the optical assembly 200 is separated from the frame 110, the communication link disposed between the optical assembly connector 254 and the frame connector 164 may be removed. At this point, the wireless communication interface 220 of the optical assembly 200 may wirelessly communicate with the wireless communication interface 166 of the head-mountable device 100 located within and/or supported by the frame 110, which may be operatively and/or communicatively connected to other components of the head-mountable device 100, such as the processor 150.

In some embodiments, the optical assembly connector 254 and the frame connector 164 may provide operable communication when the optical assembly 200 is coupled to the frame 110, and the wireless communication interface 220 may provide operable communication when the optical assembly 200 is decoupled from the frame 110. In some embodiments, wireless communication interface 220 may provide operable communication when optical assembly 200 is coupled to frame 110.

As shown in fig. 6, the head-mountable device 100 and the optical assembly 200 may form a system 10 in which the head-mountable device and the optical assembly may each operate separately, for example, when worn by a separate user. When connected by a wireless communication link, the head-mountable device 100 and the optical component 200 can communicate with each other and operate in concert. Thus, signals may be transmitted and received by each of the head-mountable device 100 and the optical component 200 via a wireless communication link.

The wireless communication link may facilitate a direct connection between the head-mountable device 100 and the optical component 200. While the signals may relate to visual output provided by the display of the optical component 200, it will be appreciated that the same or different signals transmitted over the wireless communication link may relate to other content shared between the head-mountable device 100 and the optical component 200. For example, the wireless communication link may transmit signals related to other outputs provided by the head-mountable device 100 and the optical component 200, such as sound, haptic feedback, and the like. The wireless communication link may transmit signals between devices without necessarily providing a correlation output.

Referring now to fig. 7, the head-mountable device can facilitate operation by a plurality of users, each operating one of the optical components. As shown in fig. 7, the optical assemblies 200 may each be individually operated, for example, when held or worn by an individual user. Each of the optical assemblies 200 may be separate from the frame of the head-mountable device 100. The head-mountable device 100 need not be worn by any of the users. Instead, the head-mountable device 100 may operate as a base station for the optical assembly 200. The head-mountable device 100 can provide for processing and coordinated operation of the individual optical components 200. In some embodiments, the head-mountable device 100 can provide additional input, such as through operation of the camera 130 and/or other sensors that remain on the head-mountable device when the optical component 200 is deployed.

When connected by cable 222, the head-mountable device 100 and the optical assembly 200 can communicate with each other and operate in concert. Thus, signals may be transmitted and received by each of the head-mountable device 100 and the optical component 200 via the cable 222.

In some embodiments, the optical assembly 200 may communicate with the head-mountable device 100 and/or each other via one or more cables, as described herein with respect to fig. 3 and 4. It will be appreciated that the system 10 of fig. 7 may include any one or more features of the systems, devices, and components shown and described herein with respect to fig. 3 and 4.

Additionally or alternatively, the optical component 200 may communicate with the head-mountable device 100 and/or each other via a wireless communication link, as described herein with respect to fig. 5 and 6. It will be appreciated that the system 10 of fig. 7 may include any one or more features of the systems, devices, and components shown and described herein with respect to fig. 5 and 6.

It will be appreciated that the output provided by the optical assembly 200 may be the same or different. For example, in some embodiments, an output (e.g., visual output) may be replicated for each of two users to view. In some embodiments, the output (e.g., visual output) may be different for users related to each other, such as by providing different views of the same object (e.g., real or virtual) based on different perspectives of the user. For example, a first optical assembly 200 may provide an output based on a field of view 20 captured by a camera of the first optical assembly, and a second optical assembly 200 may provide an output based on a field of view 30 captured by a camera of the second optical assembly. The operation of either optical component may be based at least in part on a first one of the views 40 captured by the camera 130 of the head-mountable device 100. In some embodiments, at least one of the head-mountable devices 100 may be within a field of view of the other's camera or one or both of the optical components, thereby facilitating determination of the relative position and/or orientation of the components. In some embodiments, the output (e.g., visual output) of the optical component 200 may be completely independent, e.g., based on individual user selections, with both types of output optionally managed by the head-mountable device 100.

Referring now to fig. 8, one or more cables can have length control features that allow for increasing or decreasing length as needed to facilitate both the stowed and deployed positions of the optical assembly. For example, as shown in fig. 8, the cable 222 may include a retractor 226 along a length of the cable 222. In the retracted or partially retracted configuration, a length of cable 222 may be at least partially retained within housing 224. For example, the cable 222 may form a coil within the cavity of the housing 224 such that at least a portion of the cable 222 is concealed therein. The cable 222 may be biased to the retracted configuration. For example, the cable 222 may form a coil within the housing 224, and the retractor 226 (e.g., a torsion spring) may apply a force tending to retract the cable 222 to form the coil. At least a portion of the cable 222 may remain exposed for manipulation by a user. The housing 224 may include an engager 228, such as a button, that selectively controls the pawl to release or prevent the retractor 226. Thus, a user may selectively control the length of the cable 222 as desired for various applications. For example, when the optical assembly is coupled to the frame, the cable 222 may be retracted such that only a short length is provided and the remainder remains within the housing, so no excess length of cable is visible or protruding. As another example, cable 222 may be elongated to facilitate deployment of a corresponding optical component to another user (e.g., other than the user wearing the head-mounted device). It will be appreciated that the cable 222 may be of any length to facilitate operation by different users at any relative distance from each other. For example, in a fully deployed (e.g., elongated) configuration, the cable 222 may be 1 meter, 2 meters, 3 meters, 4 meters, 5 meters, 6 meters, 7 meters, 8 meters, 9 meters, 10 meters, or greater than 10 meters long.

Referring now to fig. 9, components of the head-mountable device can be operably connected to provide the capabilities described herein. Fig. 9 shows a simplified block diagram of an exemplary head-mountable device 100 according to one embodiment of the present invention. It will be appreciated that the components described herein may be disposed on one, some, or all of the frame, light seal, optical assembly, lens assembly, and/or head adapter. It should be understood that additional components, different components, or fewer components than those shown may be utilized within the scope of the subject disclosure.

As shown in fig. 9, the head-mountable device 100 may include a processor 150 (e.g., control circuitry) having one or more processing units including or configured to access a memory 152 having instructions stored thereon. The instructions or computer program may be configured to perform one or more of the operations or functions described with respect to the head-mountable device 100. Processor 150 may be implemented as any electronic device capable of processing, receiving, or transmitting data or instructions. For example, the processor 150 may include one or more of the following: a microprocessor, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to encompass a single processor or processing unit, multiple processors, multiple processing units, or one or more other suitably configured computing elements. The processor may be and/or be operatively connected to a component of the control board and/or another component of the head-mountable device.

The memory 152 may store electronic data that may be used by the head-mountable device 100. For example, the memory 152 may store electrical data or content such as audio and video files, documents and applications, device settings and user preferences, timing and control signals or data for various modules, data structures or databases, and the like. The memory 152 may be configured as any type of memory. By way of example only, the memory 152 may be implemented as random access memory, read only memory, flash memory, removable memory, or other types of storage elements or combinations of such devices.

The head-mountable device 100 may include input/output components 186, which may include any suitable components for connecting the head-mountable device 100 to other devices. Suitable components may include, for example, audio/video jacks, data connectors, or any additional or alternative input/output components. Input/output components 186 may include buttons, keys, a touch pad, a crown, a microphone, a mouse, a gesture tracking sensor, and/or another feature that may be used to detect input for user operation. Input/output component 186 can include a speaker, a haptic feedback device, and/or another feature that can be utilized to provide output to a user.

The head-mountable device 100 may include communication circuitry, such as a frame connector 164 and/or a wireless communication interface 166, for communicating with one or more servers or other devices using any suitable communication protocol. For example, the communication circuitry may support Wi-Fi (e.g., 802.11 protocol), ethernet, bluetooth, high frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems), infrared, TCP/IP (e.g., any of the protocols used in each of the TCP/IP layers), HTTP, bitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The communication circuit may also include an antenna for transmitting and receiving electromagnetic signals.

The head-mountable device 100 can include a battery 172 that can charge and/or power the components of the head-mountable device 100. The battery 172 may also charge and/or power components (e.g., the optical assembly 200) connected to the head-mountable device 100.

As further shown in fig. 9, the optical assemblies 200 may each include the electronic components described herein. Such components may include a processor 210, a camera 230, a battery 240, a display 250, and/or a sensor 270. It will be appreciated that a greater or lesser number of components may be included.

The optical assembly 200 may include an optical assembly connector 254 and/or a wireless communication interface 220 for communicating with the head-mountable device 100 and/or with each other. Such communication may optionally be facilitated by one or more cables, as described herein. Thus, each of the optical assemblies 200 may be operably connected to the head-mountable device 100 and to each other. Thus, each component of the head-mountable device 100 can be operably connected to each component of each of the optical assemblies 200.

Accordingly, embodiments of the present disclosure provide a head-mountable device that can cooperate with one or more optical components of the head-mountable device to provide a sharing experience and content enjoyment to multiple users. Such operations may be facilitated by a connection between the head-mountable device and one or both of its optical components to allow different users to receive content. Such connection may be made possible by a communication link that directly and/or physically connects the head-mountable device with one or both of the optical components of the head-mountable device when the one or both of the optical components are removed from the head-mountable device for operation by a separate user. The ability to provide multiple outputs on separate components allows separate users to participate in a shared experience.

For convenience, various examples of aspects of the disclosure are described below as clauses. These examples are provided by way of example and not limitation of the subject technology.

Clause a: a head-mountable device, comprising: a frame; a frame adaptor; a first optical assembly supported by the frame, the first optical assembly including a first display; a processor; a cable; and a second optical assembly releasably coupled to the frame, the second optical assembly comprising: a second optical assembly adapter configured to releasably couple the second optical assembly to the frame by engaging the frame adapter; and a second display operably coupled to the processor through the cable when the second optical assembly is released from the frame.

Clause B: a head-mountable device, comprising: a frame; a frame adaptor; a first optical assembly supported by the frame, the first optical assembly including a first display; a first wireless communication interface; and a second optical assembly releasably coupled to the frame, the second optical assembly comprising: a second optical assembly adapter configured to releasably couple the second optical assembly to the frame by engaging the frame adapter; a second display; a battery; and a second wireless communication interface for communicating with the first wireless communication interface.

Clause C: a head-mountable device, comprising: a frame; a head adapter for securing the frame to a head; a processor; a first cable; a second cable; a first frame coupler; a second frame coupler; a first optical assembly releasably coupled to the frame by the first frame adapter, the first optical assembly including a first display operably coupled to the processor by the first cable when the first optical assembly is released from the first frame adapter; and a second optical assembly releasably coupled to the frame by the second frame adapter, the second optical assembly including a second display operably coupled to the processor by the second cable when the second optical assembly is released from the second frame adapter.

One or more of the above clauses may include one or more of the following features. It should be noted that any of the following clauses may be combined with each other in any combination and placed in the corresponding independent clauses, e.g., clauses A, B or C.

Clause 1: the second optical assembly further includes an eye sensor for detecting a characteristic of the eye.

Clause 2: the second optical assembly also includes a camera located on a side of the second optical assembly opposite the second display.

Clause 3: a head adapter for securing the frame to a head; and a light seal supported by the frame and configured to conform to a face.

Clause 4: a lens assembly including a lens adjacent the second display.

Clause 5: the lens assembly further includes a lens assembly adapter configured to releasably couple the lens assembly to the second optical assembly by engaging an additional second optical assembly adapter.

Clause 6: the lens assembly further includes an eye seal configured to conform to an area of the face surrounding the eye.

Clause 7: the cable includes a retractor configured to controllably retract a length of the cable within a housing.

Clause 8: a frame connector supported by the frame, wherein the second optical assembly includes an optical assembly connector operably connected to the frame connector when the second optical assembly is coupled to the frame.

Clause 9: a lens assembly, the lens assembly comprising: a lens adjacent to the second display; and a lens assembly adapter configured to releasably couple the lens assembly to the second optical assembly by engaging an additional second optical assembly adapter.

Clause 10: a head adapter for securing the frame to a head; and a light seal supported by the frame and configured to conform to a face, wherein the lens assembly further comprises an eye seal configured to conform to an area of the face surrounding an eye.

Clause 11: the first optical assembly further includes a first camera located on a side of the first optical assembly opposite the first display; the second optical assembly further includes a second camera located on a side of the second optical assembly opposite the second display; and the headset further comprises a third camera supported by the frame.

Clause 12: the first optical assembly further includes a first eye sensor for detecting a characteristic of the first eye; and the second optical assembly further comprises a second eye sensor for detecting a characteristic of the second eye.

Clause 13: a light seal supported by the frame and configured to conform to a face.

Clause 14: a first lens assembly releasably coupled to the first optical assembly and including a first lens adjacent the first display; and a second lens assembly releasably coupled to the second optical assembly and including a second lens adjacent the second display.

As described above, one aspect of the present technology may include collecting and using data. The present disclosure contemplates that in some instances, such collected data may include personal information or other data that uniquely identifies a particular person or that may be used to locate or contact a particular person. The present disclosure contemplates that the entity responsible for collecting, disclosing, analyzing, storing, transmitting, or otherwise using such personal information or other data will comply with established privacy policies and/or privacy practices. The present disclosure also contemplates embodiments in which a user may selectively block use or access to personal information or other data (e.g., managed to minimize the risk of inadvertent or unauthorized access or use).

Elements referred to in the singular are not intended to be unique unless specifically stated, but rather are intended to mean one or more. For example, "a" module may refer to one or more modules. Elements prefixed with "a", "an", "the" or "the" do not exclude the presence of additional identical elements without further limitation.

Headings and subheadings, if any, are for convenience only and do not limit the invention. The term "exemplary" is used to mean serving as an example or illustration. To the extent that the terms "includes," "having," and the like are used, such terms are intended to be inclusive in a manner similar to the term "comprising" as the term "comprising" is interpreted when employed as a transitional word in a claim. Relational terms such as "first" and "second", and the like may be used to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.

Phrases such as an aspect, this aspect, another aspect, some aspects, one or more aspects, an implementation, the implementation, another implementation, some implementations, one or more implementations, an embodiment, the embodiment, another embodiment, some embodiments, one or more embodiments, a configuration, the configuration, another configuration, some configurations, one or more configurations, subject technology, disclosure, the present disclosure, other variations, and the like are all for convenience and do not imply that disclosure involving such one or more phrases is essential to the subject technology, or that such disclosure applies to all configurations of the subject technology. The disclosure relating to such one or more phrases may apply to all configurations or one or more configurations. The disclosure relating to such one or more phrases may provide one or more examples. A phrase such as an aspect or some aspects may refer to one or more aspects and vice versa, and this applies similarly to other previously described phrases.

The phrase "at least one" preceding a series of items, with the term "and" or "separating any of the items, modifies the list as a whole rather than each member in the list. The phrase "at least one" does not require the selection of at least one item; rather, the phrase allows for the inclusion of at least one of any one item and/or the meaning of at least one of any combination of items and/or at least one of each item. By way of example, each of the phrases "at least one of A, B and C" or "at least one of A, B or C" refers to a alone, B alone, or C alone; A. any combination of B and C; and/or at least one of each of A, B and C.

It is to be understood that the specific order or hierarchy of steps, operations or processes disclosed is an illustration of exemplary approaches. Unless explicitly stated otherwise, it is understood that the particular order or hierarchy of steps, operations or processes may be performed in a different order. Some of the steps, operations, or processes may be performed simultaneously. The accompanying method claims, if any, present elements of the various steps, operations, or processes in a sample order, and are not meant to be limited to the specific order or hierarchy presented. These may be performed in serial, linear, parallel, or a different order. It should be understood that the described instructions, operations, and systems may be generally integrated together in a single software/hardware product or packaged into multiple software/hardware products.

In one aspect, the term "coupled" or the like may refer to a direct coupling. On the other hand, the term "coupled" or the like may refer to an indirect coupling.

Terms such as top, bottom, front, rear, side, horizontal, vertical, etc. refer to any frame of reference and not to the usual gravitational frame of reference. Thus, such terms may extend upwardly, downwardly, diagonally or horizontally in a gravitational frame of reference.

The present disclosure is provided to enable one of ordinary skill in the art to practice the various aspects described herein. In some instances, well-known structures and components are shown in block diagram form in order to avoid obscuring the concepts of the subject technology. The present disclosure provides various examples of the subject technology, and the subject technology is not limited to these examples. Various modifications to these aspects will be readily apparent to those skilled in the art, and the principles described herein may be applied to other aspects.

All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims. Furthermore, nothing disclosed herein is intended to be dedicated to the public regardless of whether such disclosure is explicitly recited in the claims. According to the provisions of 35u.s.c. ≡112, there is no need to interpret any claim element unless the phrase "method is used to" explicitly state the element or, in the case of method claims, the phrase "step is used to" state the element.

The headings, background, brief description of the drawings, abstract and drawings are incorporated herein by reference into this disclosure and are provided as illustrative examples of the disclosure and not as limiting descriptions. They are not to be taken as limiting the scope or meaning of the claims. Furthermore, it can be seen in the detailed description that the description provides illustrative examples for the purpose of simplifying the disclosure, and that various features are grouped together in various implementations. This method of disclosure is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed configuration or operation. The claims are hereby incorporated into the detailed description, with each claim standing on its own as a separately claimed subject matter.

The claims are not intended to be limited to the aspects described herein but are to be accorded the full scope consistent with the language of the claims and encompassing all legal equivalents. None of the claims, however, contain subject matter that is not in compliance with the applicable patent statute, nor should it be construed in such manner.

Claims

1. A head-mountable device, comprising:

a frame;

a frame adaptor;

a first optical assembly supported by the frame, the first optical assembly including a first display;

a processor;

a cable; and

a second optical assembly releasably coupled to the frame, the second optical assembly comprising:

a second optical assembly adapter configured to releasably couple the second optical assembly to the frame by engaging the frame adapter; and

a second display operably coupled to the processor through the cable when the second optical assembly is released from the frame.

2. The head-mountable device of claim 1, wherein the second optical component further comprises an eye sensor for detecting a characteristic of an eye.

3. The head-mountable device of claim 1, wherein the second optical component further comprises a camera located on a side of the second optical component opposite the second display.

4. The head-mountable device of claim 1, further comprising:

A head adapter for securing the frame to a head; and

a light seal supported by the frame and configured to conform to a face.

5. The head-mountable device of claim 1, further comprising a lens assembly comprising a lens adjacent to the second display.

6. The head-mountable device of claim 5, wherein the lens assembly further comprises a lens assembly adapter configured to releasably couple the lens assembly to the second optical assembly by engaging an additional second optical assembly adapter.

7. The head-mountable device of claim 5, wherein the lens assembly further comprises an eye seal configured to conform to an area of the face surrounding the eye.

8. The head-mountable device of claim 1, wherein the cable comprises a retractor configured to controllably retract a length of the cable within a housing.

9. A head-mountable device, comprising:

a frame;

a frame adaptor;

A first wireless communication interface; and

a second optical assembly adapter configured to releasably couple the second optical assembly to the frame by engaging the frame adapter;

a second display;

a battery; and

a second wireless communication interface for communicating with the first wireless communication interface.

10. The head-mountable device of claim 9, wherein the second optical component further comprises an eye sensor for detecting a characteristic of an eye.

11. The head-mountable device of claim 9, wherein the second optical component further comprises a camera located on a side of the second optical component opposite the second display.

12. The head-mountable device of claim 9, further comprising:

a head adapter for securing the frame to a head; and

a light seal supported by the frame and configured to conform to a face.

13. The head-mountable device of claim 9, further comprising a frame connector supported by the frame, wherein the second optical component comprises an optical component connector operably connected to the frame connector when the second optical component is coupled to the frame.

14. The head-mountable device of claim 9, further comprising a lens assembly comprising:

a lens adjacent to the second display; and

a lens assembly adapter configured to releasably couple the lens assembly to the second optical assembly by engaging an additional second optical assembly adapter.

15. The head-mountable device of claim 14, further comprising:

a head adapter for securing the frame to a head; and

a light seal supported by the frame and configured to conform to a face,

wherein the lens assembly further comprises an eye seal configured to conform to an area of the face surrounding the eye.

16. A head-mountable device, comprising:

a frame;

a head adapter for securing the frame to a head;

a processor;

a first cable;

a second cable;

a first frame coupler;

a second frame coupler;

a first optical assembly releasably coupled to the frame by the first frame adapter, the first optical assembly including a first display operably coupled to the processor by the first cable when the first optical assembly is released from the first frame adapter; and

a second optical assembly releasably coupled to the frame by the second frame adapter, the second optical assembly including a second display operably coupled to the processor by the second cable when the second optical assembly is released from the second frame adapter.

17. The head-mountable device of claim 16, wherein:

the first optical assembly further includes a first camera located on a side of the first optical assembly opposite the first display;

The second optical assembly further includes a second camera located on a side of the second optical assembly opposite the second display; and is also provided with

The head mountable device also includes a third camera supported by the frame.

18. The head-mountable device of claim 16, wherein:

the first optical assembly further includes a first eye sensor for detecting a characteristic of the first eye; and is also provided with

The second optical assembly further includes a second eye sensor for detecting a characteristic of a second eye.

19. The head-mountable device of claim 16, further comprising a light seal supported by the frame and configured to conform to a face.

20. The head-mountable device of claim 16, further comprising:

a first lens assembly releasably coupled to the first optical assembly and including a first lens adjacent the first display; and

a second lens assembly releasably coupled to the second optical assembly and including a second lens adjacent the second display.