WO2013098376A1

WO2013098376A1 - Augmented reality mask ensuring good reproducibility and good repeatability of the display of information from the sensors relative to the real environment

Info

Publication number: WO2013098376A1
Application number: PCT/EP2012/077028
Authority: WO
Inventors: Lien Luong; Zile Liu; Henri CHAMBAUD; Tanguy BERLAUD; Brieuc TOULLAT
Original assignee: Thales
Priority date: 2011-12-30
Filing date: 2012-12-28
Publication date: 2013-07-04
Also published as: FR2985321B1; FR2985321A1

Abstract

The invention relates to an apparatus for viewing augmented reality, comprising: a mask (16) having one plane of symmetry and comprising a frame (22) defining a bearing surface (24) on the face of a user, and a strap (20) for holding the frame (22) on the face of the user with the bearing surface (24) bearing on the face around the eyes; and at least one optical device (18A, 18B) including a rigid support unit (70), a semitransparent screen (76) supported by the support unit (70) and attached to the frame (22) so as to opposite the eye of a user, a projection system (82) supported by the support unit (70), and at least one environment sensor (90), characterized in that the or each sensor (90) is built into the optical device (18A, 18B), and is supported by the support unit (70) and immobilized relative to the support unit (70).

Description

Augmented reality mask ensuring good reproducibility and good repeatability of the visualization of sensor information in relation to the real environment.

The present invention relates to augmented reality vision equipment of the type comprising:

a mask having a plane of symmetry and comprising:

a frame delimiting a bearing surface on the face of a user;

- A headband of the frame on the face of the user with the bearing surface resting with the face around the eyes .;

at least one optical device comprising:

a rigid block of support;

- A semi-transparent screen carried by the support block and fixed to the frame to be facing the eye of a user;

a projection chain carried by the support block;

at least one environmental sensor.

It is known for applications of driving aids, or military applications to provide a human being with augmented reality vision equipment allowing him to simultaneously see the environment in which it is located and images added in its field of vision, thus increasing the reality perceived visually by the user.

Such equipment includes a semi-transparent screen, placed in the field of view of the user and on which the images of augmented reality are projected. This screen is formed for example by the glass of a pair of glasses worn by the user.

The equipment can be equipped with orientation sensors to determine the direction of the user's gaze, including the position of the head of the latter relative to the environment. Thus, the superimposed images in the natural field of view of the user are positioned in accordance with the environment perceived visually by the user.

Many augmented reality vision equipment has been proposed.

It is known to provide these orientation sensors in the frame of the equipment worn by the user. Thus, in the case of spectacles, the orientation sensors are carried by the frame of the glasses, that is to say the frame carrying the lenses of the glasses. In the case of a mask, the frame is formed of the generally tubular structure bearing on the face of the user and defining, away from the user, a retaining rim of the visor. Optical devices for projection of augmented reality images are also worn by the frame, either glasses or the mask.

With the known equipment, it can be seen that the information coming from the orientation sensors does not always make it possible to display the augmented reality information in a correct superposition with the real image seen by the user with good reproducibility, that is, that is to say an identity of the results whatever the individual and a good repeatability, that is to say the identity of the results obtained for the same individual regardless of the number of tests.

The object of the invention is therefore to provide augmented reality equipment making it possible to obtain good reproducibility, good repeatability in the positioning and choice of augmented reality images, as a function of the information received from the orientation sensors provided on equipment.

For this purpose, the subject of the invention is an augmented reality vision equipment of the aforementioned type, characterized in that the or each sensor is integrated in the optical device and is carried by the support block and immobilized relative to the support block. .

According to particular embodiments, the vision equipment comprises one or more of the following characteristics:

two optical devices, which devices are identical and symmetrical to one another with respect to the plane of symmetry of the mask;

the or each optical device comprises orientation means capable of determining the position of the optical device relative to the frame;

the mask and the or each optical device constitute self-supporting, interchangeable modules that can be assembled and disassembled while maintaining their integrity;

an interchangeable visor held on the frame;

the visor is a ballistic visor;

- the screen is attached to the projection chain;

- The support block of the or each optical device forms a sealed chamber defining an enclosed space in which are confined the elements constituting each optical device.

The invention will be better understood on reading the description which follows, given solely by way of example and with reference to the drawings in which:

FIG. 1 is a perspective view of augmented reality vision equipment connected to an augmented reality image supply calculator; Figure 2 is a perspective view of augmented reality vision equipment;

- Figure 3 is a side view of the vision equipment of Figure 1 carried by the head of a user;

FIG. 4 is a perspective view of three quarters of augmented reality vision equipment carried by the head of a user;

FIG. 5 is a view from above of the optical device of the equipment of the preceding figures; and

- Figure 6 is a top view of the vision equipment.

In Figure 1 is shown an augmented reality vision equipment 10 connected by a wire 12 to a computer 14 for processing signals received by the equipment 10 and providing the latter with augmented reality images.

The computer 14 is known per se and will not be described further.

The vision equipment shown in more detail in FIGS. 2 to 4 comprises a vision mask 16, two optical devices 18A, 18B rigidly attached to the mask 16 and a mask retaining strip 20 on the face of the user.

The mask 16 has a general plane of symmetry corresponding to the plane of symmetry of the face when the mask is in place.

More specifically, the mask 16 comprises a frame 22 having a generally tubular body 22A delimiting, on the side of the user's face, a flexible and extensible frame 23 on which is attached a non-stretchable surface 24 of support on the face . At its other end, the body 22A defines a strapping 26 in which is fixed a visor 28 for protecting the user against dust and possibly solar radiation. Alternatively, the visor 28 is a ballistic visor, that is to say a visor for protection against projectile shards, including bullets or explosives.

The body 22A of the frame 22 is delimited laterally by rigid flanks 30A, 30B connected to each other by the frame 23 on one side and the retaining rim 26 of the visor on the other side. The optical devices 18A, 18B are rigidly connected to the sidewalls 30A, 30B. The visor 28 and the frame 23 are connected to each other by a trellis 32 of flexible and elastic beams delimiting between them openings 34 normally concealed by a permeable foam film not shown.

The material constituting the body 22A is overmolded on the rigid flanks 30A, 30B thus forming a hinge with elastic return between the strapping 26 stiffened by the visor 28 and each rigid flank. The axis of articulation of each hinge extends generally vertically, that is to say perpendicularly to the axis connecting the two eyes of the user and parallel to the plane of symmetry of the mask. In a variant, the hinge is formed by a zone of lesser thickness.

Under these conditions, the mask forms, schematically, a trapezium whose face formed by the visor 28 and those formed by the flanks are rigid while the rest of the body 22A is extensible. Thus, the flanks 30A, 30B hinged relative to the strapping 26 are free to deviate from each other following an angular deflection of a few degrees, in particular at most +/- 5 degrees with respect to a rest position . The body 22A, outside the flanks and the visor being elastic, the flanks 30A, 30B are resiliently returned to their rest position.

In its lower part, between the two eyes, the body 22A of the mask has a shape of arch proper to receive the nose of the user. This arch has a size much larger than the corresponding size of the nose to allow a movement of the mask following the surface of the user's face without the body of the mask being in abutment against the nose of the user. This possible displacement is for example between 0.5 cm and 2 cm in two directions perpendicular to each other contained in the surface of the face of the user.

The headband 20 comprises a clean elastic strap 42 to bear on the rear part of the head of the user. This strap is connected to the mount 22 of the helmet by two U-shaped articulated connecting brackets 44A, 44B, each fixed on a corresponding rigid flank 30A, 30B.

These stirrups each comprise two branches 46, 47 extending generally parallel to each other and a bridge 48 connecting the two branches.

This bridge, of generally arcuate shape with its radius of curvature disposed between the two branches 46, 47 is traversed by a curved light 50 in which the strap 42 is engaged. The light 50 separates the bridge 48 into two parallel members 51, 52.

The length of the light 50 is greater than the height of the strap 42. Its length is for example between 1, 5 and 2.5 times the height of the strap 42. The strap 42 is engaged through the light 50 and it is fixed for example by an end loop surrounding the outer frame 52 delimited by the light 50 in the bridge 48.

At its opposite end to the connecting end of the strap 42, each yoke 44A, 44B comprises articulation profiles on the frame 22. These profiles consist for example of pins 58 received in coaxial bores 60 arranged through the flanks 30A, 30B. The axis of articulation of the stirrups 44A, 44B extends along the height of the head of the user, that is to say in a direction parallel to the plane of symmetry of the mask and perpendicular to the straight line passing through the two eyes of the user. The two branches 46, 47 delimit between them a receiving space for optical devices 18A, 18B.

The optical devices 18A, 18B are identical and symmetrical to one another with respect to the plane of symmetry of the mask 16.

In the case of a binocular system, the two optical devices 18A, 18B are rigidly fixed, for example by snapping, to the frame 22. They are each connected to the computer 14. It is also possible in the case of a monocular system to fix only one of the two optical devices preferably on the directing eye. In this case, the other side may either be left empty or be replaced by another branch with other features.

Each optical device comprises an orientation sensor adapted to address to the computer 14 information on the position of the optical device considered relative to the frame 22.

For example, this sensor comprises two clean switches each to cooperate in the orientation with the same actuating pin provided on the mount 22. Thus, once fixed on the mount, only one of the switches is closed under the action pawn.

The switch thus closed depends on the side and therefore the mounting direction of the optical device. From the analysis of the state of the switches, the computer 14 deduces the orientation of each optical device.

The optical device 18A is shown in greater detail in FIG. 5. It comprises a sealed support block 70 having a main section 72 formed in an opaque material extended by a transparent structure 74.

The main section 72 extends between the branches 46, 47 of the connecting brackets of the strip 20, while the structure 74 extends in the space defined by the frame 22 in the visual field of the user.

The structure 74 has a geometry in the form of a polyhedron whose one face may be curved, and has on its end face a semi-transparent screen 76 disposed opposite the pupil of the eye of the user who is placed at the exit pupil denoted 78 of the optical system in FIG. 5 when the equipment is worn by a user.

The screen 76 is connected to the main section 72 by a transparent skirt 80 delimiting with the screen 76 an enclosed space connected only to the main section 72. Thus, the support block 70 forms a sealed box delimiting an enclosed space in which are confined the elements constituting each optical device.

The main section 72 encloses a projection chain 82 successively comprising a matrix of pixels 84 capable of forming an image, lenses 86 arranged along the length of the main branch 72 and a reflection mirror 88 of the beam towards the screen 76.

The matrix 84 is capable of transmitting augmented reality images received from the computer 14 and the lenses 86 ensure their projection on the screen 76.

The screen 76 is convex and has a reduced area of projection of augmented reality images. The normal in the center of the exit pupil 78 of the optical system constitutes the main axis of augmented vision noted X1 -X1. The projection chain is able to project on the screen an undeformed image on the projection zone.

A set of environment sensors of the mask designated by the reference 90 is attached to the block 70 of the optical device 18A. These sensors, for example formed of an inertial unit or an electronic compass are suitable for determining the orientation and / or the position of the vision equipment relative to the external environment. The information of these sensors are sent to the computer 14 so that the computer addresses the relevant images according to the orientation of the equipment.

The environment sensors 90 are arranged along a preferred measurement axis X2-X2 fixed with respect to the X1 -X1 direction. The axis extends parallel to the preferred viewing direction X1-X1.

According to a particular embodiment, the sensors 90 integrate an observation camera, whose observation axis extends along the axis X2-X2. Alternatively, the camera is replaced by an electronic compass to determine the Earth's magnetic field.

In the embodiment illustrated in FIG. 6, the frame 22 comprises a band 102 that is deformable, but inextensible in its length, which is added along the length of the frame 23. This strip, again designated by strip, delimits the bearing surface 24 on the face of the user. It consists, for example, of a supple and non-extensible support strip 104 covered with a layer 106 of compressible foam capable of bearing on the user's forehead. The band 102 is secured to the frame 23 by two pins 108 disposed at each end of the support strip 104. These pins 108 are engaged in orifices 1 10 formed through the frame 23. The pins are adapted to engage elastically at through orifices 1 10 and to be so retained.

The number of orifices disposed at each end of the frame 23 is greater than the number of pins 108, thus allowing the user to choose the orifices in which the pins are engaged. The length of the strip 102 being inextensible, the distance marked Z separating the strip 102 from the frame 23 is thus adjustable as a function of the orifices in which the pins 108 are engaged. In Figure 6, the strip 102 is shown in two different positions, one of the positions being shown in phantom.

The augmented reality vision equipment described here is formed of independent modules that can be easily assembled together and disassembled for replacement. These modules comprise the frame 22 of the mask, the protective visor 28, the strip 20 and the two optical devices 18A, 18B.

Each module or combination of modules 20, 22, 28, 18A, 18B is self-supporting and can be assembled and disassembled in one piece of the equipment while maintaining its integrity.

To use the vision equipment, the user first positions the band 102 on the frame 22 by selecting the orifices 1 10 in which the pins 108 are introduced so that the distance Z between the band 102 and the frame 23 allow to obtain a complete vision on the whole field of projection of augmented reality images projected on the screens 76.

After fixing the headband 102, the user puts the mask on his face and engages the headband 20 behind his skull. Under the action of the elasticity of the headband 20, the mask is placed on the face.

While the optical devices 18A, 18B project augmented reality images on the screens 76, the frame 22 of the mask is displaced in translation relative to the face of the user, by manual action thereof, until the projected images are perceived by the user, that is to say that the privileged axes of vision X1-X1 pass through the pupils of the user.

Thus, a correct alignment between the projection zones of the augmented reality images and the pupils of the user is easily obtained, by a simple manual movement of the mask, without it being necessary to resort to complex adjustments of the position of the images. screens 76 relative to the support surface 24, as is the case in equipment of the state of the art. This is why the equipment according to the invention may be devoid of such adjustment means.

The bearing surface 24 of the mask on the face of the user allows correct positioning of the pupils of the user with respect to the projection areas, without complex relative positional adjustments between the mask frame and the projection screens. are necessary.

The presence of curved lights in the binding brackets of the frame to the strap 42 allows movement of the strap relative to the stirrups along the length of the lights in the direction of the arrow F1 shown in Figure 3. This movement allows the user to position the strap for a comfortable hold of the equipment on his face.

Finally, the frame 23 and the mesh 32 form a flexible and elastic structure adapted to the deformation of the inextensible strip in its length 102. This deformation of the strip ensures a homogeneous distribution of the pressure of the strip 102 on the front of the user. This deformation according to the morphology of the head of the user is controlled by the rigidity of the sidewalls 30A and 30B and by the force feedback effect of the hinges allowing the mask to conform to the shape of the user's face, without the visor and especially the two optical devices 18A, 18B are substantially displaced relative to the pupils of the user.

Indeed, when the flanks 30A, 30B deviate from each other to allow satisfactory positioning on the face of the user, the optical devices 18A, 18B which are integral are slightly displaced. Each screen 76 is thus close to the strip 102. At the same time the strip 102, retained at these ends in the vicinity of the free ends of the flanks 30A, 30B, is stretched, leading to an increased spacing between the strip 102 and the screen 76. The two effects substantially offsetting each other, the distance between the pupil of the user and the screens remains substantially constant.

The presence of the environmental sensors directly on the housing of the optical devices 18A, 18B makes it possible to guarantee a fixity of the privileged axes of vision X1-X1 and of measurement X2-X2, thus guaranteeing a correct determination of the position of the axis of privileged vision relative to its environment, even if the mount 22 is caused to deform.

As a variant, the screen 76 is integrated with the visor 28. In a variant also, the screen 76 is mechanically independent of the projection chain 82.

Claims

1. - augmented reality vision equipment comprising:

a mask (16) having a plane of symmetry and comprising:

- a mount (22) defining a bearing surface (24) on the face of a user;

- a headband (20) for retaining the frame (22) on the face of the user with the bearing surface (24) bearing with the face around the eyes .;

at least one optical device (18A, 18B) comprising:

a rigid block of support (70);

a semitransparent screen (76) carried by the support block (70) and fixed to the frame (22) to face the eye of a user;

a projection chain (82) carried by the support block (70);

at least one environmental sensor (90);

characterized in that the or each sensor (90) is integrated with the optical device (18A, 18B) and is carried by the support block (70) and immobilized with respect to the support block (70).

2. - Equipment according to claim 1, characterized in that it comprises two optical devices (18A, 18B), which devices are identical and symmetrical to each other with respect to the plane of symmetry of the mask (16).

3. - Equipment according to claim 2, characterized in that the or each optical device (18A, 18B) comprises orientation means adapted to determine the position of the optical device relative to the frame (22).

4. - Equipment according to any one of the preceding claims, characterized in that the mask (16) and the or each optical device (18A, 18B) constitute self-supporting modules, interchangeable can be assembled and disassembled while maintaining their integrity .

5. - Equipment according to any one of the preceding claims, characterized in that it comprises an interchangeable visor (28) held on the frame (22A).

6. - Equipment according to claim 5, characterized in that the visor (28) is a ballistic visor.

7. - Equipment according to any one of the preceding claims, characterized in that the screen (76) is fixed to the projection chain (82).

8. Equipment according to any one of the preceding claims, characterized in that the support block (70) of the or each optical device (18A, 18B) forms a sealed box delimiting an enclosed space in which are confined the elements constituting each optical device.