DE102019131640A1 - Method and device for operating a display system with data glasses - Google Patents

Abstract

The invention relates to a reference unit, in particular a portable reference unit, for operation with data glasses, comprising: a platform movement sensor system which is designed to detect a platform movement indication; a control unit which is designed to determine platform movement information from the platform movement indication; a communication device which is designed to transmit the platform movement information to the outside.

Description

Technical area

The invention relates to data glasses, in particular for use in a mobile platform, such as a train, an airplane or another vehicle. The invention also relates to measures for providing precise positional information in data glasses.

Technical background

Data glasses, also called head-mounted displays, are known which, with the aid of a display device, can display an image on one or two display surfaces in the field of view of the wearer of the data glasses. The display surfaces can correspond to reflection surfaces which direct images into the eye of the wearer of the data glasses. The viewing openings of the data glasses are transparent, so that the real environment can be perceived in the normal way through the data glasses. The display surfaces are located in the viewing openings so that information to be displayed, such as text, symbols, graphics, video displays and the like, can be displayed superimposed on the perception of the surroundings.

The information is usually presented to the wearer of the smart glasses in a contact-analog manner, ie represented in such a way that it is superimposed as object information on a specific assigned object in the real environment or is oriented towards it, or that the object information to be displayed is in a specific orientation of the smart glasses or their Is displayed. Furthermore, the contact-analog object information can be displayed in such a way that it appears perspective correct in relation to the object in the real environment, i.e. the illusion arises that the object in the real environment has actually been supplemented by the additional feature of the visual object information.

In order to display the object information in a contact-analog manner on the display surfaces of the data glasses, it is necessary to know the position of the object in the environment and the direction in which the user is looking. When wearing the data glasses, the viewing direction of the user is permanently assigned to their pose, i.e. the 3D position as well as the 3D alignment of the data glasses.

To determine the pose of the data glasses in a motor vehicle, a pose recognition unit can be provided in the data glasses, for example. The pose recognition unit generally has a camera and computing device, for example in the form of a microprocessor. Images of the surroundings of the wearer of the data glasses recorded by the camera can be used to determine the pose of the data glasses in the vehicle interior based on stored images or structures of the vehicle interior. This process is also called tracking.

So is from the pamphlet DE 10 2014 206 623 A1 a device for determining the pose of smart glasses is known which comprises a display and a camera. The device is designed to create recordings of the surroundings of the data glasses with the aid of the camera, to recognize the image of a stored and predefined area of the surroundings in the recordings of the camera, to recognize a feature in the recognized image of the area and the pose of the data glasses To determine consideration of the particular feature in the recordings.

Such pose recognition units integrated in the data glasses, which are designed to detect the absolute pose, require a high processor power and are therefore complex to implement. This leads to a high structural weight and / or structural volume of the data glasses and the provision of the required electrical energy is complex to implement.

Furthermore, the pose of the data glasses can also be determined by an external pose detection unit, in which an interior camera detects the head of the wearer of the data glasses and by evaluating the camera image either the pose of the head is determined and the pose of the data glasses is derived from it or the pose of the data glasses is derived directly is determined. With these so-called outside-in tracking systems, there is a difficulty in transmitting the absolute pose information determined outside of the data glasses to the data glasses with a sufficiently low latency, especially in the case of a wireless communication connection, so that the data glasses can have corresponding contact-analog representations without delay or a can not output annoying delay.

There are known non-camera-based pose recognition units in data glasses which use an acceleration sensor in the data glasses. The pose of the smart glasses is then determined incrementally by integrating and accumulating movements of the smart glasses. One difficulty with such an approach is that when the smart glasses are worn within a moving mobile platform, such as a moving train, a moving airplane, on a bicycle or the like, the acceleration sensors only detect an overall acceleration relative to the environment / environment and from this can only determine movement speeds relative to the environment / environment.

With inertial sensors, the pose can only be determined in data glasses in relation to the world coordinate system. This is especially done in reference to the gravitational vector and in the direction of magnetic north. If the pose of the data glasses is to be determined within a moving mobile platform, the movement of the platform leads to sometimes strong deviations, which are caused by the superposition of platforms and data glasses movements. Thus, on the basis of the measurement of the acceleration within the data glasses, the movement of the data glasses relative to a platform coordinate system that is also moving in the vicinity cannot easily be determined.

Since only relative movements since the last availability of an absolute pose information are evaluated with the exclusive use of an acceleration sensor to determine the poses, the determination of the poses based on acceleration sensors is subject to a drift over time due to the necessary integration operations, so that the determined pose becomes more and more inaccurate the longer none absolute pose specification is provided for reference.

For the contact-analog representation, however, as precise a knowledge as possible of the pose of the data glasses in relation to the vehicle coordinate system is necessary. Deviations between the actual pose and the determined pose information lead to a misrepresentation of contact-analog information objects in the data glasses, which is annoying and can possibly lead to nausea on the part of the user.

While the application in a vehicle system enables a corresponding tracking option for providing pose information with the data glasses, it is not possible with other mobile platforms, such as a train or airplane or the like, to provide data glasses with information that improves tracking the pose of the smart glasses. In particular, such display systems require a coordinated communication link between data glasses and assistance system, which is not available in other mobile platforms, in particular in mass transport.

It is the object of the present invention to provide a display system with data glasses, in which a position indication of the data glasses can be provided. In particular, it is an object to carry out a spectacle pose indication in data glasses also in moving platforms, so that these are available in relation to a platform coordinate system.

Disclosure of the invention

This object is achieved by a reference unit for operation with data glasses according to claim 1 and by the method for operating data glasses with a reference unit, by data glasses and by the display system according to the independent claims.

Further refinements are given in the dependent claims.

• - eine Plattformbewegungssensorik, die ausgebildet ist, eine Plattformbewegungsanagabe zu erfassen;
• - eine Steuereinheit, die ausgebildet ist, um eine Plattformbewegungsinformation aus der Plattformbewegungsangabe zu bestimmen;
• - eine Kommunikationseinrichtung, die ausgebildet ist, die Plattformbewegungsinformation nach extern, insbesondere an eine oder mehrere Datenbrillen, zu übertragen.

According to a first aspect, a reference unit, in particular a portable reference unit, is provided for operation with data glasses, comprising:

• a platform movement sensor which is designed to detect a platform movement indication;
• a control unit which is designed to determine platform movement information from the platform movement information;
• a communication device which is designed to transmit the platform movement information externally, in particular to one or more data glasses.

The above reference unit is intended for use in a mobile platform and can be preinstalled there or brought along by the wearer of the data glasses and stored in a fixed position. With its motion sensors, it enables the platform to detect its own movement and transmits the relevant information to the one or more data glasses in the immediate vicinity. This makes it possible for data glasses on the platform to receive corresponding movement information about the movement of the platform in the world coordinate system in order to be able to determine from this the proper movement of the data glasses on the platform or the relative movement of the data glasses to the platform.

This makes it possible to display contact-analog representations on the data glasses, which are based on the platform coordinate system of the platform. The data glasses can thus determine the glasses pose information in relation to the platform coordinate system from the platform movement information. In particular, the reference unit can only include platform motion sensors that are sent as corresponding information to the data glasses in the area via a suitable transmission device.

In particular, the communication device can be designed to transmit the platform movement information unidirectionally to the external data glasses located within transmission range. This can be done, for example, in the form of a radio signal or radio signal with a limited range. The range should be limited to the area of the platform, since only the platform movement information is transmitted to external units.

Furthermore, the communication device can be designed to transmit the platform movement information to the outside in an unauthorized manner.

An energy supply, in particular a battery, can be provided so that the reference unit can be operated autonomously.

The reference unit can have a housing that is no larger than 10cm × 8cm * 2cm. In this way, the reference unit can be designed to be portable or portable.

According to a further embodiment, the communication device can be designed, in addition to the platform movement information, to externally transmit information on one or more information objects to be displayed in a contact-analog manner for display in the data glasses based on the platform coordinate system.

• - Erfassen einer Brillenbewegungsinformation mit einer Brillenbewegungsangabe durch die Datenbrille, wobei die Brillenbewegungsangabe eine Bewegung der Datenbrille in einem Weltkoordinatensystem der Plattformumgebung angibt;
• - Empfangen einer Plattformbewegungsinformation mit einer Plattformbewegungsangabe, die eine Bewegung der Plattform in dem Weltkoordinatensystem der Plattformumgebung angibt;
• - Transformieren der Brillenbewegungsangabe in ein Plattformkoordinatensystem, das plattformfest der Referenzeinheit zugeordnet ist, abhängig von der Plattformbewegungsinformation;
• - Ermitteln einer aktuellen Brillenposenangabe in der Datenbrille bezogen auf das Plattformkoordinatensystem abhängig von der transformierten Brillenbewegungsangabe;
• - Anzeigen eines Informationsobjekts mit Bezug zu der Brillenposenangabe im Plattformkoord i natensystem.

According to a further aspect, a method for operating a display system with data glasses and the above reference unit is provided, with the following steps:

• - Acquisition of glasses movement information with a glasses movement indication by the data glasses, the glasses movement indication indicating a movement of the data glasses in a world coordinate system of the platform environment;
• - Receiving platform movement information with a platform movement specification which indicates a movement of the platform in the world coordinate system of the platform environment;
• - Transforming the information about the movement of the glasses into a platform coordinate system that is assigned to the reference unit in a fixed manner on the platform, depending on the information about the movement of the platform;
• - Determination of a current glasses pose information in the data glasses based on the platform coordinate system as a function of the transformed glasses movement information;
• - Display of an information object with reference to the glasses pose information in the platform coordinate system.

The method can use a glasses movement sensor system provided in the data glasses in order to determine movement speed increments of the data glasses relative to the surroundings by integration and thus enables the glasses pose to be determined by accumulating the movement speed increments. This enables the provision of a spectacle pose information without complex devices arranged in the data glasses, so that an energy-efficient operation for the pose determination is possible. The spectacle pose information obtained in this way is, however, based on the world coordinate system. In order to display information objects related to a platform coordinate system in the data glasses, it is necessary to transform the glasses pose information into a platform coordinate system. This is done based on the platform movement information transmitted by the reference unit.

The above method for operating the display system is used to provide current glasses pose information, which corresponds to an absolute pose of the data glasses in relation to a platform coordinate system, in the data glasses. The method transforms a pair of glasses pose information determined by means of glasses movement information, which is initially related to a world coordinate system, with the aid of the platform movement information about a movement of the mobile platform in which the user of the data glasses is located.

In particular, the transformation can be carried out on the basis of glasses movement information and platform movement information recorded at the same time.

It can be provided that the glasses movement information includes a time stamp which corresponds to a point in time of the detection of the movement of the data glasses specified by the glasses movement information in relation to the world environment, the platform movement information including a time stamp which corresponds to a point in time when the relative movement of the specified by the platform movement information was recorded Platform corresponds to the world environment, the same times of the detected glasses movement information and the detected platform movement information is determined based on the time stamps.

According to one embodiment, the glasses movement information can be determined with a detected acceleration of the data glasses in one or more spatial directions and / or an angular acceleration of the data glasses in one or more directions of rotation, the platform movement information from a detected acceleration of the reference unit in one or more spatial directions and / or one Angular acceleration is determined in one or more directions of rotation.

In particular, the transformation can be carried out by a rotation between the orientation of the platform coordinate system and the world coordinate system is determined and the transformed glasses pose information is determined depending on the rotation and the platform movement information, in particular by rotating a platform movement vector corresponding to the rotation and a portion of a glasses movement vector that corresponds to the rotated platform movement vector is eliminated from the glasses movement vector, the glasses movement vector being the Corresponds to the indication of the movement of the glasses.

The rotation can be determined by various other methods. For example, the orientation in the surrounding coordinate system can be determined from the direction of movement (change in position over time), which is determined using a geopositioning system (GPS, etc.), if the orientation of the platform during a movement is known (forward direction). A compass in the reference unit can also be used to identify the orientation of the platform.

• - eine Kommunikationseinrichtung, die ausgebildet ist, um eine Plattformbewegungsinformation mit einer Plattformbewegungsangabe zu empfangen;
• - eine Brillenbewegungssensorik, die ausgebildet ist, um eine Brillenbewegungsinformation mit einer Brillenbewegungsangabe zu erfassen;
• - eine Steuereinheit, die ausgebildet ist, um eine aktuelle Brillenposenangabe in der Datenbrille abhängig von der Brillenbewegungsangabe zu ermitteln, um die Brillenposenangabe abhängig von der Plattformbewegungsinformation in ein Plattformkoordinatensystem, das plattformfest der Referenzeinheit zugeordnet ist, zu transformieren; und um ein Informationsobjekt mit Bezug zu der Brillenposenangabe im Plattformkoordinatensystem anzuzeigen.

According to a further aspect, data glasses for a display system are provided, comprising:

• a communication device which is designed to receive platform movement information with an indication of platform movement;
• a glasses movement sensor which is designed to detect glasses movement information with a glasses movement indication;
• a control unit which is designed to determine current glasses pose information in the data glasses as a function of the glasses movement information, in order to transform the glasses pose information as a function of the platform movement information into a platform coordinate system that is permanently assigned to the reference unit on the platform; and to display an information object related to the glasses pose indication in the platform coordinate system.

According to a further aspect, a display system with the above reference unit and the above data glasses is provided.

Figure list

• 1 eine schematische Darstellung eines Anzeigesystems mit einer Datenbrille und einer Referenzeinheit zum Einsatz in einer mobilen Plattform;
• 2 eine schematische Darstellung eines möglichen Einsatzortes in einem Zug; und
• 3 ein Flussdiagramm zur Veranschaulichung eines Verfahrens zum Betreiben des Anzeigesystems in einer mobilen Plattform.

Embodiments are explained in more detail below with reference to the accompanying drawings. Show it:

• 1 a schematic representation of a display system with data glasses and a reference unit for use in a mobile platform;
• 2 a schematic representation of a possible location in a train; and
• 3rd a flow chart to illustrate a method for operating the display system in a mobile platform.

Description of embodiments

1 shows a schematic representation of a display system 1 especially for use in a motor vehicle. The display system 1 includes a reference unit 2 who are in communication link 4th with data glasses 3rd stands. The communication link 4th is designed as a data transmission channel, for example in the form of a wireless communication link or a wired communication link. The communication link 4th is able to share any kind of data and information between the reference unit 2 and the data glasses 3rd to be transmitted, for example based on a packet-bound data transmission. The communication link 4th can for example be based on WiFi, Bluetooth, Bluetooth Low Energy or a comparable standardized radio protocol.

The data glasses 3rd includes two transparent lenses 32 that are in a frame 31 are bordered in a manner known per se. The frame 31 is with glasses temples 33 provided so that the smart glasses 3rd can be worn on the head of a user in a manner known per se.

One or both lenses 32 (Glasses) are still with a transparent display surface 35 provided by any suitable device such as one on the frame 31 arranged display device 36 , a display image for displaying virtual information objects in the eye of the wearer of the data glasses 3rd can be projected. The display device 36 can have a microprocessor or a comparable computing unit and a display unit, such as a projection device or the like. The display unit can be designed to transfer the electronically generated display image onto the display surface 35 to judge and to map / display there.

Due to the transparent design of the display area 35 the electronically generated image can be transmitted through the display area 35 superimpose perceptible real environment. Using the display device 36 information such as text, a symbol, video information, a graphic or the like can be displayed on one or both display surfaces 35 being represented.

The data glasses 3rd can be worn on the head of the user like a typical visual aid, the smart glasses 3rd with the frame 31 on the The user's nose rests and the temples 33 rest on the side of the head of the user. The viewing direction of the user in a straight line then occurs through the viewing panes 32 mainly through the transparent display surfaces 35 so that the viewing direction of the user corresponds to the orientation of the smart glasses 3rd corresponds or can, for example, be derived therefrom based on a calibration process. It is assumed here that the position of the smart glasses 3rd is set relative to the eyes of the user and is known in advance. When using the data glasses for the first time, a calibration process can be carried out for this purpose 3rd in which the relative pose of the smart glasses 3rd is determined relative to the head of the user.

Furthermore, the data glasses 3rd with a control unit 37 be provided. The control unit 37 can be designed separately or together with the microprocessor of the display device 36 be trained. The control unit 37 can be designed in a suitable manner to include data glasses functions and functions of the display system 1 perform or support. The reference unit 2 with the data glasses 3rd are connected to display information relating to contact-analog or non-contact-analog information objects to be displayed on the smart glasses 3rd to submit. The display information defines the position and representation of the information objects in relation to the motor vehicle, ie in a vehicle coordinate system (reference system of the motor vehicle).

So can the control unit 37 the data glasses perform a pose detection function in the form of a tracking process to identify a pose of the head or the data glasses 3rd to be determined in a vehicle interior. The pose of data glasses 3rd refers to the spatial position of the smart glasses 3rd in the vehicle coordinate system and their three-dimensional alignment in space. The pose of the data glasses 3rd represents the direction of view of the user and his area of vision, as the smart glasses 3rd has a fixed relative position on the user's head.

This includes the data glasses 3rd a glasses movement sensor 38 (eg an inertial sensor system) that provides information about the movement of the glasses. The glasses movement information includes glasses movement information and an associated time stamp. The indication of the movement of the glasses can accelerate the data glasses 3rd Specify in three spatial directions and angular accelerations or angular velocities around three different swivel axes. The glasses movement information is continuously sent to the control unit 37 provided.

Furthermore, a communication unit 39 be provided that a communication with the reference unit 2 enables.

The reference unit 2 can be provided as an autonomous unit and in particular designed as a portable device with an independent energy supply. The reference unit 2 can be a platform movement sensor 22nd , a controller 23 and a communication unit 21 exhibit. The reference unit 2 also with an energy supply 24 , in particular a battery, be provided.

The communication unit 21 the reference unit 2 can the communication link 4th between data glasses 3rd and reference unit 2 enable. The reference unit also includes 2 the platform movement sensors 22nd to get a platform movement indication. The platform movement information can indicate a platform acceleration with acceleration in three spatial directions as well as angular acceleration or angular speeds about three pivot axes.

The platform movement information can be in the reference unit 2 processed and as platform movement information to the data glasses 3rd be transmitted. The platform movement information can also include a plurality of platform movement information recorded one after the other, so that a course of the platform movement information is provided as platform movement information.

The communication unit 21 is designed to receive the platform movement information via the communication link 4th at suitable times or continuously to the data glasses 3rd transferred to. The platform movement information can be sent to one or more within range of the communication unit 21 existing data glasses 3rd transfer. Furthermore, the communication unit 21 as well as the communication unit 39 be designed so that the platform movement information from the smart glasses 3rd is received at any time if the data glasses 3rd within radio range of the communication unit 21 the reference unit 2 arrives or is located.

In addition to the platform movement information, the reference unit 2 also transmit display information with information objects to be displayed, which are to be displayed in a contact-analog manner in relation to the platform coordinate system. This enables information to be displayed on a platform-specific basis. For example, in a train, timetable information can be displayed in a free area of an inner wall via the display area of the smart glasses 3rd are displayed, with the Timetable information is displayed in a contact-analog manner to the position of the inner wall.

The reference unit 2 can also be designed as a portable device that is used by the wearer of the data glasses 3rd is carried. The wearer of the data glasses arrives 3rd into a mobile platform, the latter can remove the device from the body and place it in the vicinity of its current position so that it can record platform movement information that is not caused by the movement of the wearer of the data glasses 3rd are disturbed.

The reference unit also includes 2 the platform movement sensors 22nd to get a platform movement indication. The platform movement information can indicate a platform acceleration with accelerations in three spatial directions as well as angular accelerations or angular speeds about three pivot axes. Alternatively, the platform movement information can be specified as a time course (of platform movement information) of a platform movement speed and a change in the direction of movement.

The platform movement information can be found in the control 23 (Microprocessor) of the reference unit 2 processed and as platform movement information to the data glasses 3rd be transmitted. The platform movement information can also include a plurality of platform movement information recorded one after the other, so that a course of the platform movement information is provided as platform movement information.

The communication unit 21 is designed to receive the vehicle movement information via the communication link 4th at appropriate times or as soon as available to the data glasses 3rd transferred to. In particular, the communication connection can be designed to receive the platform movement information without authorization. Alternatively, the platform movement information can be provided by the reference unit 2 be transmitted as a radio signal, so that the communication link 4th only unidirectional from the reference unit 2 to data glasses 3rd consists.

In the control unit 37 the data glasses 3rd the glasses movement information is evaluated and a current glasses pose information is always determined by incrementally updating a glasses pose information. This can be done by integrating the accelerations twice in the spatial directions and the directions of rotation around the pivot axes in order to provide incremental changes in position and alignment as relative positional information for the smart glasses 3rd to obtain. If, instead of the angular acceleration, only angular velocities around the swivel axes are recorded, the corresponding positional information is obtained by simply integrating the angular velocity. The relative poses are added up accordingly in order to determine the current glasses pose on the basis of a known starting position. This includes position information and alignment information of the data glasses 3rd . The glasses pose information indicates an alignment of a glasses coordinate system in relation to the world coordinate system.

The accelerations of the platform in the spatial directions and around the pivot axes are contained in the glasses movement information, since the user of the data glasses 3rd is in the mobile platform and participates in the movements of the platform. Therefore, the platform movement information is used to transform the glasses pose information to the platform coordinate system.

In 2 is a schematic of the use of the reference unit 2 Shown in a railway wagon 51 as a mobile platform. A wearer of data glasses 3rd as a passenger in the railway wagon 51, the portable reference unit is placed after taking his seat 2 on a table next to his sitting position. By receiving the platform movement information from the reference unit 2 can in the data glasses 3rd a spectacle pose information can be determined that in the data glasses 3rd determined pose information can be provided with reference to the platform coordinate system. This enables information objects to be in contact with the platform coordinate system in the data glasses 3rd are displayed.

The transformation of the glasses pose information into the platform coordinate system can be done by rotating the world coordinate system of the data glasses 3rd to the platform coordinate system. For this purpose, the courses of the low-frequency components of the glasses movement information can be analyzed and compared with the platform movement information. The transformation takes place by adapting the determined spectacle pose information to the platform coordinate system fixed on the platform with the aid of a determined rotation between the world coordinate system and the platform coordinate system.

The transformation of the glasses pose information can be based on the observation that changes in movement of the platform occur at a much lower frequency than movements of the head or the data glasses 3rd . Therefore, through a detection, which of the movement components of the smart glasses 3rd can be assigned to the platform movement, a rotation between the world coordinate system and the platform coordinate system can be generated.

The platform movement information gives accelerations of the mobile platform in the Spatial directions and around the swivel axes. These are offset against each other so that a relative indication of the movement of the smart glasses 3rd is determined with respect to the platform coordinate system. By integrating the relative movements in the spatial directions and relative rotational movements (angular velocity or angular acceleration) around the pivot axes, indicated by the relative movement information, a relative movement information of the smart glasses 3rd and furthermore a relative indication of the pose (change of pose) of the data glasses 3rd starting from a previous point in time, for example a point in time of a last known absolute pose of the data glasses 3rd , be calculated. The relative movement information and the relative pose information of the data glasses 3rd are related to a platform coordinate system.

Since the platform movement information only with one through the communication link 4th caused latency in the data glasses 3rd are available, the vehicle movement information is provided with a time stamp and sent to the data glasses as vehicle movement information 3rd transmitted.

The transfer of the platform movement information to the data glasses 3rd can include the platform acceleration in the spatial directions and the platform angular acceleration about the axes of rotation.

In the data glasses 3rd the platform movement information, the glasses pose information, which are sent to the smart glasses 3rd with the in the data glasses 3rd detected glasses movement information combined.

Overall, the display system 1 with the platform-fixed reference unit 2 and the data glasses 3rd perform a procedure outlined in the flowchart of FIG 3rd is sketched.

In step S1 are in the smart glasses 3rd Glasses movement information with the help of the glasses movement sensors 22nd detected.

From the glasses movement information, which is usually given as acceleration information in three spatial directions and around three pivot axes, movement increments or relative pose information are determined in step S2 by integration twice, which are added to obtain a current glasses pose information. This is related to the world coordinate system.

In step S3, platform movement information is obtained from the reference unit 2 received, the platform movement information (platform acceleration information) in the spatial directions with respect to the mobile platform and corresponding time stamps for these platform acceleration information also refer to the world coordinate system.

In step S4, a platform acceleration vector for the direction of a current acceleration movement of the mobile platform is determined from the platform movement information. For this purpose, the translational acceleration information in all available spatial directions as well as the angular accelerations around the axes of rotation are evaluated.

In step S5, the glasses movement information becomes a glasses acceleration vector for the direction of acceleration of a current acceleration of the smart glasses 3rd determined. For this purpose, the translational acceleration information in all available spatial directions as well as the angular accelerations around the axes of rotation are evaluated.

In step S6, a rotation between the world coordinate system and the platform coordinate system can be determined from the platform acceleration vector and the glasses acceleration vector.

Alternatively, the rotation can also be determined with the aid of the direction of movement (change in position over time), which is determined using a geopositioning system (GPS, etc.). The orientation in the surrounding coordinate system can be determined if the orientation of the platform is known during a movement (forward direction of travel). A compass in the reference unit can also be used to identify the orientation of the platform.

In step S7, the rotation of the glasses pose information is applied in order to transform a transformed glasses pose information in relation to the platform coordinate system.

In step S8, the corrected glasses pose information is used for further processing in the data glasses 3rd used. In particular, this can be used to display information objects in the data glasses depending on the direction of view 3rd be used.

This method is repeated cyclically by jumping back to step S1 and thereby always provides a spectacle pose specification of the data glasses that has been transformed to the platform coordinate system 3rd in the data glasses 3rd ready.

The platform movement information used in the above method and the glasses movement information used are essentially to recorded at the same time. In the data glasses 3rd that spectacle movement information is selected which corresponds to the time stamp or the recording time of the platform movement information. For this purpose, a temporal course of the glasses movement information in the data glasses 3rd get saved.

Alternatively, a time offset between the course of the platform movement information and the glasses movement information can be determined with the aid of an autocorrelation function, so that by selecting a suitable point in time within the course of the platform movement information, a corresponding glasses movement information, which is based on a detection at the same point in time, for the comparison (calculation of the rotation ) the resulting acceleration data can be used. A point in time of a maximum value of the resulting platform movement information within the period of the course taken into account is preferably assumed to be a suitable point in time.

List of reference symbols

1

Display system

2

Reference unit

21

Communication unit

22nd

Platform movement sensors

23

control

24

power supply

3

Data glasses

31

frame

32

Viewing panes

33

Glasses temples

35

transparent display area

36

Display device

37

Control unit

38

Glasses movement sensors

39

Communication unit

4th

Communication link

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102014206623 A1 [0006]

Claims (13)

Reference unit (2), in particular a portable reference unit, for operation with data glasses (3), comprising: a platform movement sensor which is designed to detect a platform movement indication; - A control unit (23) which is designed to determine platform movement information from the platform movement information; - A communication unit (21) which is designed to transmit the platform movement information to the outside. Reference unit (2) Claim 1 , wherein the communication unit (21) is designed to transmit the platform movement information unidirectionally to data glasses located in transmission range to the outside. Reference unit (2) Claim 2 , wherein the communication unit (21) is designed to transmit the platform movement information to the outside in an unauthorized manner. Reference unit (2) according to one of the Claims 1 to 3rd , an energy supply, in particular a battery, being provided so that the reference unit (2) can be operated autonomously. Reference unit (2) according to one of the Claims 1 to 4th , wherein the reference unit (2) has a housing that is no larger than 10cm × 8cm * 2cm. Reference unit (2) according to one of the Claims 1 to 5 , wherein the communication unit (21) is designed to transmit, in addition to the platform movement information, information on one or more information objects to be displayed in a contact-analog manner for display in the data glasses (3) based on the platform coordinate system to the outside. Method for operating a display system (1) with data glasses (3) and a reference unit (2) according to one of the Claims 1 to 6th , with the following steps: - Acquisition (S1) of glasses movement information with a glasses movement indication by the data glasses (3) in a world coordinate system; - Receiving platform movement information with a platform movement specification which indicates a movement of the platform in the world coordinate system of the platform environment; - Transforming the information about the movement of the glasses into a platform coordinate system that is assigned to the reference unit in a fixed manner on the platform, depending on the information about the movement of the platform; - Determination (S2) of current glasses pose information in the data glasses (3) based on the platform coordinate system as a function of the transformed glasses movement information; - Display of an information object with reference to the glasses pose information in the platform coordinate system. Procedure according to Claim 6 , wherein the transformation is carried out based on glasses movement information and platform movement information acquired at the same time. Procedure according to Claim 7 , wherein the glasses movement information comprises a time stamp which corresponds to a point in time of the detection of the movement of the data glasses (3) with respect to the world environment indicated by the glasses movement information, the platform movement information including a time stamp which corresponds to a point in time when the relative movement of the platform indicated by the platform movement information was recorded with respect to the world environment, the same points in time of the recorded glasses movement information and the recorded platform movement information being determined based on the time stamps. Method according to one of the Claims 6 to 8th , wherein the indication of the movement of the glasses is determined with a detected acceleration of the data glasses (3) in one or more spatial directions and / or an angular acceleration of the data glasses in one or more directions of rotation, and the indication of the movement of the platform is determined from a detected acceleration of the reference unit (2) in one or more spatial directions and / or an angular acceleration is determined in one or more directions of rotation. Procedure according to Claim 9 , wherein the transformation is carried out by determining a rotation between the orientation of the platform coordinate system and the world coordinate system and the transformed glasses pose information is determined depending on the rotation and the platform movement information, in particular by rotating a platform movement vector according to the rotation and a portion of a glasses movement vector that corresponds to the rotated platform movement vector, from which the glasses movement vector is eliminated, the glasses movement vector corresponding to the glasses movement indication. Data glasses (3) for a display system (1), comprising: - a communication device (39) which is designed to receive platform movement information with an indication of platform movement; a glasses movement sensor which is designed to detect glasses movement information with a glasses movement indication; - a control unit (37) which is designed to determine current glasses pose information in the data glasses (3) as a function of the glasses movement information in order to transform the glasses pose information as a function of the platform movement information into a platform coordinate system that is permanently assigned to the reference unit on the platform; and to display an information object related to the glasses pose indication in the platform coordinate system. Display system with a reference unit (2) according to one of the Claims 1 to 5 and data glasses Claim 12 .

Images