FR3074332B1 - METHOD FOR POSITIONING AT LEAST ONE VIRTUAL OBJECT IN AT LEAST ONE VIRTUAL AREA FOR RECEIVING VIRTUAL OBJECTS, TERMINAL AND ASSOCIATED SYSTEM - Google Patents

Abstract

The invention relates to a method for positioning at least one virtual object in at least one virtual virtual object reception zone, said method comprising the following steps, implemented by a first terminal: • definition (E410) of the at least one virtual zone in a virtual environment corresponding to a real environment, reception (E430), via a telecommunications network, of at least one virtual object previously selected by a second terminal positioned outside the environment real, • positioning (E440) of the at least one virtual object received in the at least one virtual zone.

Description

Background of the invention

The present invention relates to the general field of mixed reality, sometimes also called hybrid reality, and more particularly relates to a method of positioning a virtual object in at least one virtual virtual object receiving zone.

Mixed Reality is a technology for merging a virtual world with the real world, to produce a new environment and visualizations in which real-world physical objects and digital objects of the virtual world coexist and may interact, for example in time. real. This technology is increasingly used, especially in the entertainment sector (video games) or the corporate world (immersive educational content).

Mixed reality can be used to display virtual objects by means of a display module, so that they can be superimposed on the real world.

The display module is for example a transparent screen, on which is displayed a virtual object, this virtual object typically taking the form of a hologram. The transparent screen can be mounted on mixed reality glasses, such as for example the "Microsoft Hololens" (registered trademark) glasses, so that the user sees the virtual object displayed on the screen and the real environment through the screen.

In another example, the display module is a screen displaying an image from the real world, typically acquired by a camera, image on which is superimposed the virtual object.

A terminal using mixed reality, and positioned in a given real environment, thus allows a user to choose and position a virtual object so that the user can see this virtual object in this real environment. However, the use of mixed reality is limited to the user of the terminal in this real environment. Interactions using mixed reality are therefore to be developed.

Object and summary of the invention

The present invention relates to a method of positioning at least one virtual object in at least one virtual virtual object receiving zone, the method comprising the following steps, implemented by a first terminal:

Defining the at least one virtual zone in a virtual environment corresponding to a real environment; receiving, via a telecommunications network, at least one virtual object previously selected by a second terminal positioned outside the virtual environment; real environment, positioning of the at least one virtual object received in the at least one virtual zone.

The invention thus makes it possible to define a virtual zone for receiving virtual objects, these objects being able to be selected by users located outside the real environment from which the virtual zone is defined. This provision of a virtual zone to remote terminals improves the interaction capabilities between several users or the interaction capabilities of the same user who needs to move.

In a particular embodiment, the method further comprises a step of displaying in the at least one virtual zone of the at least one virtual object.

In a particular embodiment, the method further comprises a step of sending, by the first terminal, to a remote server, an identifier of the at least one virtual zone, so that the at least one object virtual is associated with said identifier, prior to its receipt by the first terminal.

The identifier enables the second terminal to accurately find the virtual zone defined by the first terminal.

In a particular embodiment, the first terminal is a pair of glasses or a headset, mixed reality, a smartphone-type mobile phone, or a digital tablet.

The invention further relates to a terminal adapted to implement a method as described above.

In a particular embodiment, the method further comprises a step of selection by the second terminal of the at least one virtual object.

In a particular embodiment, the first terminal is positioned in the real environment during the step of defining the at least one virtual zone, the first terminal and the second terminal being two distinct terminals.

The method improves the interactions between the user of the first terminal using the mixed reality technology and other users. Indeed, the user of the second terminal can choose, by means of this second terminal, the virtual object to be positioned in the virtual zone corresponding to the real environment of the first terminal. Thus, the user of the second terminal can send or offer the virtual object to the user of the first terminal.

In a particular embodiment, the first terminal and the second terminal form the same terminal, said terminal being named first terminal when said terminal is positioned in the real environment, and being named second terminal when said terminal is positioned outside. of the real environment.

In a particular embodiment, the at least one virtual object:

• is a three-dimensional digital object, and / or • a two-dimensional digital image, and / or • a two-dimensional digital video, and / or • is in the form of a computer application, and / or • includes sound data.

In a particular embodiment, the step of selecting the at least one virtual object comprises a substep of selection:

• a lifetime, and / or • a number of repetition of reading or viewing, and / or • a right of use, associated with the at least one virtual object.

In a particular embodiment, the method comprises a step of verification, by a remote server, of a right of access of the second terminal to the at least one virtual zone.

In a particular embodiment, the method further comprises a verification step that the volume of the at least one virtual object is less than the volume of the at least one virtual zone.

The invention further relates to a system adapted to implement a method as described above, comprising at least one terminal as described above.

In a particular embodiment, the various steps of the method according to the invention are determined by instructions of computer programs.

Consequently, the invention also relates to a computer program, on an information medium, this program comprising instructions adapted to the implementation of the steps of a method according to the invention.

This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other form desirable shape.

The invention also relates to a computer-readable information medium, comprising instructions of a computer program as mentioned above.

The information carrier may be any entity or device capable of storing the program. For example, the medium may comprise storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or a magnetic recording means, for example a hard disk.

On the other hand, the information medium may be a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means. The program according to the invention can be downloaded in particular on an Internet type network.

Alternatively, the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

Brief description of the drawings

Other features and advantages of the present invention will emerge from the description given below, with reference to the accompanying drawings which illustrate an embodiment having no limiting character. In the figures:

- Figure 1 shows schematically a virtual object positioning system according to an exemplary embodiment of (Invention;

FIGS. 2A and 2B show, schematically, a user of a first terminal in his real environment, having defined a virtual zone in a step of defining a method of positioning at least one virtual object according to an example embodiment of the invention;

- Figure 3 shows schematically a terminal according to an exemplary embodiment of the invention;

FIGS. 4 and 5 represent, in the form of flowcharts, the main steps of methods for positioning at least one virtual object according to examples of embodiments of the invention.

Detailed description of several embodiments

FIG. 1 schematically represents a virtual object positioning system 100 capable of implementing a method of positioning at least one virtual object OV in at least one virtual zone ZV for receiving virtual objects, according to an exemplary embodiment of the invention.

The system 100 includes a first terminal 110 and may further comprise a second terminal 120 and / or a remote server 130. The first terminal 110, the second terminal 120 and / or the remote server 130 may communicate with each other by means of a remote control. telecommunications network 150, for example an Internet network (for example Wifi), a Bluetooth network, an NFC network, or a fixed or mobile telephone network (3G, 4G etc.).

As shown in FIG. 2A, a user U1 of the first terminal 110 can define, by means of the first terminal 110, a virtual zone ZV in the real environment ER of the first terminal 110, this virtual zone ZV being able to accommodate one or more OV virtual objects.

A user U2 of the second terminal 120, located outside the real environment ER of the first terminal U1, can furthermore choose a virtual object OV by means of the second terminal 120, so that this virtual object OV can be positioned in the virtual zone ZV defined by the first terminal 110 (see FIG. 2B). The user Ul of the first terminal can then view, by means of the first terminal 110, the virtual object OV positioned in the virtual zone ZV. Thus, the user U2 of the second terminal 120 can offer a present to the user Ul of the first terminal 110, for example a dog as illustrated in FIG. 2B, or a virtual flower bouquet for the occasion of the Mother's Day. . In this example, the first terminal 110 and the second terminal 120 are two separate terminals, and the user Ul of the first terminal 110 and the user U2 of the second terminal 120 may be two different users or the same user.

As a variant, the user U1 or U2 of the first terminal 110 chooses the virtual object OV by means of the first terminal 110, whereas this first terminal 110 is positioned outside the real environment ER from which the virtual zone ZV has been defined. The user Ul or U2 of the first terminal 110 can then, when he returns the first terminal 110 in the real environment ER from which the virtual zone ZV has been defined, display, by means of the first terminal 110, the object virtual OV positioned in the ZV virtual zone. This variant finds for example an application when the user

U1 of the first terminal 110 moves into a furniture store and wishes to view a piece of furniture at home, before buying it.

The real environment ER here designates a space, typically a room of a building, in which the first terminal 110 is located during the definition of the virtual zone ZV.

The virtual zone ZV is a numerical zone defined with respect to the real environment ER. This virtual zone ZV can be displayed by the first terminal 110, so that the user of the first terminal 110 can see, by means of the first terminal 110, this virtual zone ZV superimpose itself on the real environment ER.

The OV virtual object is a three-dimensional digital object, typically a hologram. Alternatively, the virtual object OV may be a two-dimensional digital image or a two-dimensional digital video. The OV virtual object can also be in the form of a computer application. In addition, the virtual object OV may include sound data. The virtual object OV can be displayed by the first terminal 110, so that the user of the first terminal 110 can see, by means of the first terminal 110, this virtual object OV superimpose itself on the real environment ER.

The first terminal 110 is for example a pair of mixed reality glasses or a mixed reality helmet. Alternatively, the first terminal 110 may be a mobile terminal such as a mobile phone, for example of the "smartphone" type, a digital tablet, or a personal computer.

The second terminal 120 is for example a mobile terminal such as a mobile phone, for example of the "smartphone" type, a digital tablet, or a personal computer. Alternatively, the second terminal 120 may be a pair of mixed reality glasses or a mixed reality headset.

The first terminal 110 comprises a definition module, a reception module and a positioning module. In addition, the first terminal 110 may include a obtaining module, an acquisition module, a sending module, a verification module and a display module.

The acquisition module is in one example a camera or depth sensor. In addition, the display module may be a screen, typically a transparent or semi-transparent screen.

The sending and / or receiving modules may comprise one or more sub-long distance communication modules, for example a Wifi sub-module,

3G, or 4G, and / or one or more short-distance communication sub-modules, for example an NFC (Near Field Communication) or Bluetooth sub-module.

In addition, the second terminal 120 may include a selection module and a sending module. In addition, the remote server 130 may include a storage module and a verification module.

As shown in FIG. 3, the first terminal 110 presents the conventional architecture of a computer. The first terminal 110 comprises in particular a processor 300, a read-only memory 302 (of the "ROM" type), a non-volatile rewritable memory 304 (of the "EEPROM" or "NAND flash" type for example), a rewritable volatile memory 306 (of type "RAM"), and a communication interface 308.

The read-only memory 302 of the first terminal 110 constitutes a recording medium in accordance with an exemplary embodiment of the invention, readable by the processor 300 and on which is recorded a computer program PI conforming to an exemplary mode of operation. embodiment of the invention. In a variant, the computer program PI is stored in the rewritable non-volatile memory 304.

This PI computer program defines functional and software modules here configured to implement the steps of a method for positioning at least one virtual object in at least one virtual virtual object reception zone, in accordance with a exemplary embodiment of the invention. These functional modules rely on or control the hardware elements 300, 302, 304, 306 and 308 of the terminal 110 mentioned above. They include in particular here the definition module, the receiving module, the positioning module, as well as possibly the obtaining module, the acquisition module, the sending module, the verification module and the module of display.

In addition, the second terminal 120 and the remote server 130 also have the conventional architecture of a computer, each comprising a processor, a read-only memory ("ROM" type), a non-volatile memory rewritable (type " EEPROM "or" Flash NAND "for example), a volatile memory rewritable (type" RAM "), and a communication interface.

As for the first terminal 110, the read-only memory (or the rewritable volatile memory) of the second terminal 120 and that of the remote server 130 each constitute a recording medium according to an exemplary embodiment of the invention, readable by the associated processor and on which is recorded a computer program according to an exemplary embodiment of the invention.

Each computer program defines functional and software modules here configured to implement steps of a method for positioning at least one virtual object in at least one virtual virtual object reception zone, in accordance with an example embodiment of the invention. They include in particular here the selection module and the sending module for the second terminal 120, as well as the storage module and the verification module for the remote server 130.

The functions of these different modules are described in more detail below, with reference to the steps of the methods described with reference to FIGS. 3 and 4.

FIG. 4 represents a method of positioning at least one virtual object OV in at least one virtual zone ZV for receiving virtual objects, according to an exemplary embodiment of the invention.

The steps of the method are implemented by a terminal, for example the first terminal 110 described with reference to FIGS. 1 and 3.

In a step E410, the at least one virtual zone ZV is defined in a virtual environment EV corresponding to a real environment ER.

In a step E430, at least one virtual object OV, previously selected by a second terminal 120 positioned outside the real environment ER, is received via a telecommunications network 150.

In a step E440, the at least one virtual object OV received is positioned in the at least one virtual zone ZV.

FIG. 5 represents a method of positioning at least one virtual object OV in a virtual zone ZV for receiving virtual objects, according to an exemplary embodiment of the invention.

The method is implemented by a virtual object positioning system, for example the system 100 written with reference to FIG.

In a step E510, the virtual zone ZV is defined in a virtual environment EV corresponding to a real environment ER, by the definition module and possibly the acquisition module of the first terminal 110.

This step E510 follows an E500 obtaining step of the virtual environment EV, from one or more data acquired in the real environment ER. This step E500 is implemented by the module for obtaining the first terminal 110, as well as possibly the acquisition module.

More precisely, the acquisition module scans in three dimensions the real environment ER in which the first terminal 110 is positioned.

The virtual environment EV is then modeled in three dimensions by the obtaining module, from the data from the acquisition module, by means of spatial coordinates.

The virtual environment EV here designates a numerical space associated with a marker, typically an orthonormal marker, representing by spatial coordinates the real environment ER in which the first terminal 110 is located.

The definition step E510 is typically performed by means of one or more data obtained from one or more measurements made in the real environment ER.

Thus, in one example, the definition step E510 comprises an acquisition sub-step E512, by the acquisition module and in the real environment ER, of one or more images or videos, comprising a positioning indication. of the ZV virtual zone.

The positioning indication may comprise two different positions of a body part of the user U1 of the first terminal 110, typically a finger of the user U1.

Step E510 then comprises a substep E514 for analyzing one or more images acquired in order to detect the indication and to deduce a positioning of the virtual zone ZV in the virtual environment EV, that is to say say spatial coordinates of the virtual zone ZV in the virtual environment. At least two or three coordinates are typically required to define the virtual zone ZV.

For example, the first terminal 110 displays a predefined virtual zone and having known spatial coordinates, typically taking the form of a rectangular parallelepiped.

The user Ul of the first terminal 110 then sees the virtual zone pre-defined in its real environment ER. The user Ul can then modify the size and position of the predefined virtual zone, for example by performing movements that are captured by the acquisition module and analyzed by the definition module, in order to define the virtual zone ZV.

In the case where the virtual zone ZV takes the form of a rectangular parallelepiped, two coordinates ZI and Z2 are necessary in order to define the length and the width of the zone, and therefore the volume of the zone.

Once the virtual zone ZV has been defined, the sending module of the first terminal 110 can send, in a step E516 and via the telecommunications network 150, a message comprising an identifier of the virtual zone ZV and / or an identifier of the U1 user of the first terminal 110 to the remote server 130. The message may further comprise the spatial coordinates of the virtual zone ZV and / or a right of access to the virtual zone ZV, for example an authorization list comprising one or more identifiers of users or terminals authorized to position an OV virtual object in the ZV virtual zone.

After receiving the message F516 by the remote server 130, the storage module of the remote server 130 stores, for example in a database, the identifier of said virtual zone ZV and / or an identifier of the user U1 of the first terminal 110, possibly in association with the spatial coordinates of the virtual zone ZV and / or the access right (step F518).

The steps E510, as well as optionally the steps E516, F516 and F518 can be reiterated in order to create, for the same real environment, several virtual zones.

As a variant, the identifier or identifiers are not sent to the remote server 130 and are stored in the rewritable non-volatile memory 304 of the first terminal 110, in association with the spatial coordinates of the virtual zone ZV and / or the access right, or sent to the second terminal 120 and then stored in the rewritable non-volatile memory of the second terminal 120. Steps E516, F516 and F518 are thus not implemented.

In a step G520, the selection module of the second terminal 120, or the user U2 of the second terminal 120, by means of the selection module, selects the virtual object OV. The virtual object OV is for example selected from a library of virtual objects.

The step G520 for selecting the virtual object OV may comprise a sub-step G522 for selecting a lifetime and / or a number of repetition of reading or viewing, and / or a right of use, associated with said OV virtual object.

The virtual object OV can thus be ephemeral (for example when linked to a promotional offer or a contest), and thus be associated with a finite life and / or, in the case where the virtual object OV is an image or a video, a number of repeat play or finished view. In addition, a usage right may be associated with the virtual object, such as a right to move the object or a right to copy the object.

In one embodiment, the first terminal 110 and the second terminal 120 are two separate terminals.

In another embodiment, the first terminal 110 and the second terminal 120 form a same terminal, the terminal being named first terminal 110 when it is positioned in the real environment ER, and being called second terminal 120 when the terminal is positioned outside the real ER environment.

The recipient of the object, that is to say the user U1 of the first terminal 110 or at least one of the ZV virtual zones defined above, is found by the second terminal 120 by consulting the remote server 130 (step G524) for example via the telecommunications network 150. In one example, the sending module of the second terminal 120 sends a request to the remote server 130, the request comprising the identifier of the user LU of the first terminal 110 or directly the identifier of the virtual zone ZV. The request may further include the selected OV virtual object. In an example where the user U wishes to position at least one virtual object OV in several virtual zones ZV, the request may comprise the identifier of each virtual zone ZV. The following steps F526, F528, E530, E540 and / or E544 can then be performed for each identifier / virtual zone ZV.

Upon receiving the request F524, the verification module of the remote server 130 may optionally check, in a step F526, the access right AC of the second terminal 120 to the virtual zone ZV, by consulting the access right associated with the identifier of the virtual zone ZV. In one example, the request sent by the second terminal 120 includes an identifier of the second terminal 120 or an identifier of the user U2 of the second terminal 120, and the remote server 130 then compares this identifier with the identifier (s) of the authorization list stored by the remote server 130.

The storage module of the remote server 130 can then store, in association with the identifier of the virtual zone ZV, the virtual object OV (step F528). The virtual object OV is thus associated with said identifier by the remote server 130, prior to its reception by the first terminal 110.

The step G520 and possibly the steps G524, F524 and / or F526 can be repeated to select several virtual objects to be positioned in the virtual zone ZV.

In a step E530, the OV virtual object or objects, previously selected by the second terminal 120 positioned outside the real environment ER, are received by the reception module of the first terminal 110, via the telecommunications network 150.

In one example, the sending module of the first terminal 110 sends to the remote server 130 a request to interrogate the remote server 130 on the presence of one or more virtual objects OV associated with the virtual zone ZV. This request can thus comprise the identifier of the virtual zone, the identifier of the first terminal 110 or the identifier of the user 111 of the first terminal 110. In addition, this request is sent for example when the first power is turned on. terminal 110, after recognition of the real environment ER and therefore the virtual zone ZV, and / or periodically.

In the remainder of the description, for reasons of brevity, an example will be considered in which a single virtual object OV is associated with the virtual zone ZV.

The remote server 130 extracts the identifier of the request and finds the associated OV virtual object, for example by consulting the database using this identifier.

The remote server 130 then sends (step F530) the virtual object OV to the first terminal 110, so that the virtual object OV is downloaded by the first terminal 110.

The remote server 130 can further send the spatial coordinates of the virtual zone ZV in this step F530. In a variant, the spatial coordinates of the virtual zone ZV stored in the rewritable non-volatile memory 304 of the first terminal 110.

In a variant, the steps G524, F524, F526, F528, F530 and E530 are not implemented and the virtual object OV is sent directly by the second terminal 120 to the first terminal 110, by means of the identifier of the zone ZV virtual or U1 user identifier of the first terminal 110.

The positioning module of the first terminal 110 can then position the virtual object OV received in said virtual zone ZV (step E540).

In this positioning step E540, the spatial coordinates of the virtual zone ZV and the volume of the virtual object OV can be used to define the spatial coordinates of the virtual object OV, so that this virtual object OV can appear in the virtual zone ZV. The spatial coordinates of the virtual object OV are then stored in the rewritable non-volatile memory 304 of the first terminal 110.

The positioning step E540 may comprise a step E542 in which the verification module of the first terminal 110 verifies that the volume of the virtual object OV is smaller than the volume of the virtual zone ZV.

If the volume of the virtual object OV is greater than the volume of the virtual zone ZV, the volume of the virtual object OV is reduced so that the virtual object OV can be displayed entirely in the virtual zone ZV.

As a variant, the step E540 is not implemented by the first terminal 110 but by the second terminal 120 or the remote server 130, by obtaining the spatial coordinates stored by the remote server 130 by means of the identifier of the virtual zone ZV or the user identifier U1 of the first terminal 110.

In a step E544, the display module of the first terminal 110 displays the virtual object V in the virtual zone.

Claims (14)

A method for positioning at least one virtual object in at least one virtual object receiving virtual zone (ZV), said method comprising the following steps, implemented by a first terminal (110): Defining (E410, E510) said at least one virtual zone (ZV) in a virtual environment (EV) corresponding to a real environment (ER), receiving (E430, E530), via a telecommunications network, from least one virtual object (OV) previously selected by a second terminal (110, 120) positioned outside the real environment, • positioning (E440, E540) of said at least one virtual object (OV) received in said at least one a virtual zone (ZV). The method of claim 1, further comprising a step of displaying (E544) in said at least one virtual area (ZV) of said at least one virtual object (OV). 3. Method according to one of claims 1 or 2, further comprising a step of sending (E516), by the first terminal (110), to a remote server (130), an identifier of said at least one virtual zone (ZV), so that said at least one virtual object (OV) is associated with said identifier, prior to its reception (E530) by the first terminal (110). 4. Method according to any one of claims 1 to 3, wherein the first terminal (110) is a pair of glasses or a headset, mixed reality, a smartphone-type mobile phone, or a digital tablet. 5. Method according to one of claims 1 to 4, further comprising a step of selection (G520) by the second terminal (110, 120) of said at least one virtual object (OV). The method according to claim 5, wherein the first terminal (110) is positioned in the real environment (ER) during the step of defining (E510) said at least one virtual zone (ZV), the first terminal (110) and the second terminal (120) being two separate terminals. 7. The method of claim 5, wherein the first terminal (110) and the second terminal (120) form a same terminal, said terminal being named first terminal when said terminal is positioned in the real environment (ER), and being named second terminal when said terminal is positioned outside the real environment (ER). 8. Method according to any one of claims 5 to 7, wherein the step of selecting (G520) said at least one virtual object (OV) comprises a substep selection (G522): • a lifetime, and / or • a number of repetition of reading or viewing, and / or • a right of use, associated with said at least one virtual object (OV). 9. Method according to any one of claims 5 to 8, comprising a verification step (F526), by a remote server (130), a right of access of the second terminal (120) to said at least one zone virtual (ZV). The method according to any one of claims 5 to 9, further comprising a verification step (E542) that the volume of said at least one virtual object (OV) is smaller than the volume of said at least one virtual zone (ZV). . 11. Terminal (110) adapted to implement a method according to any one of claims 1 to 4. A computer program (PI) comprising instructions for performing the steps of the method according to any one of claims 1 to 4 when said program is executed by a computer. A computer-readable recording medium on which a computer program (PI) is recorded including instructions for performing the steps of the method according to any one of claims 1 to 4. 5 14. System (100) adapted to implement a method according to any one of claims 5 to 10, comprising at least one terminal (110) according to claim 11.