WO2018120657A1

WO2018120657A1 - Method and device for sharing virtual reality data

Info

Publication number: WO2018120657A1
Application number: PCT/CN2017/087725
Authority: WO
Inventors: 商泽利; 周胜丰; 陈浩
Original assignee: 华为技术有限公司
Priority date: 2016-12-27
Filing date: 2017-06-09
Publication date: 2018-07-05
Also published as: CN108431872A

Abstract

The present application relates to the technical field of communications, especially relates to the technology of virtual reality. A terminal obtains environment data including an environment image of a current environment, and converts the environment image in the environment data from a two-dimensional image into a three-dimensional image in the case that the environment image is a two-dimensional image, to obtain virtual reality data that reflects a three-dimensional scene of the environment of the terminal, so that after the virtual reality data is transmitted to at least one receiving terminal, a user of the receiving terminal may feel as if he/she is in the environment where the first terminal is located by viewing the virtual reality data output by the receiving terminal, thereby achieving the experience effect that multiple users share a same scene.

Description

Method and device for sharing virtual reality data

The present application claims priority to Chinese Patent Application No. 201611224693.8, entitled "A Method and Apparatus for Sharing Virtual Reality Data", filed on December 27, 2016, the entire contents of which are incorporated by reference. In this application.

Technical field

The present application relates to the field of communication technologies, and in particular, to virtual reality technology.

Background technique

Virtual Reality (VR) technology refers to the use of computer simulation to generate a virtual world in a three-dimensional space, providing users with simulations of visual, tactile and other senses, allowing users to be as immersive as they can, in a timely and unrestricted manner. Observe things in three dimensions.

At present, virtual reality technology has been applied to many fields such as games and movies. However, in many fields of applying virtual reality, the virtual reality experience function is relatively simple, and can only meet the viewing needs of single-sided users. However, with the continuous development of the network and the social application, the interaction between the network users is increasing. Therefore, how to realize the effect that multiple users can experience the same scene is a technical problem that the technical personnel urgently need to solve. .

Summary of the invention

In view of this, the present application provides a method and device for sharing virtual reality data, so as to realize sharing of virtual reality data of the same scene among multiple users, so that multiple users in different places can experience being in the same scene. The effect of the experience.

In one aspect, the present application provides a method for sharing virtual reality data, in which the first terminal collects environmental data of an environment in which the current terminal is located, and the environment data includes at least an environment image of an environment in which the first terminal is located; In the case where the environment image is a two-dimensional image, the environment image in the environment data is converted from a two-dimensional image into a three-dimensional image, thereby converting the environment data into a virtual one for reflecting a three-dimensional scene in which the first terminal is located Real data, such that after transmitting the virtual reality data to the at least one second terminal, the user of the second terminal can feel that the first terminal is located by watching the virtual reality data output by the second terminal The visual experience in the environment, thus experiencing the experience of the same environment scene as the first terminal.

In a possible design, converting the environment image in the environment data from a two-dimensional image to a three-dimensional image may be to create depth information for an environment image in the environment data, and then using the depth information and the The environment image is constructed by constructing a three-dimensional image corresponding to the environment image, so that the environment data is converted into virtual display data by replacing the two-dimensional environment image in the environment data with the three-dimensional environment image.

In a possible design, in a case where the environment image in the environment data is a three-dimensional image, the environment data may be directly determined as virtual reality data for reflecting a three-dimensional scene of an environment in which the first terminal is located, and Transmitting the virtual reality data to the at least one second terminal, so that data sharing the three-dimensional scene of the environment in which the first terminal is located is shared to the at least one second terminal, so that the user of the second terminal can experience based on the virtual reality data. The experience in the same environment as the user of the first terminal.

In a possible design, after the first terminal obtains the virtual reality data, the first terminal may further perform virtual reality scene rendering on the three-dimensional environment image in the virtual reality data, where the virtual reality scene rendering may include: reverse distortion, One or several of anti-dispersion and interpupillary adjustment. By performing virtual reality scene rendering on the virtual reality data, an abnormal situation such as image distortion occurs in the process of displaying the virtual reality data by the subsequent second terminal.

In a possible design, while the first terminal collects the environment data of the environment in which the first terminal is currently located, the viewing angle of the user on the first terminal side may also be collected; correspondingly, at the first And transmitting, by the terminal, the virtual reality data to the at least one second terminal, the first terminal may further send the viewing angle to the at least one second terminal, so that the second terminal renders the virtual reality data according to the viewing angle, and outputs the The virtual reality data presented by the viewing angle is viewed, so that the user of the second terminal can view the environment scene where the first terminal is located at the same perspective as the user of the first terminal.

In a possible design, in order to adapt to the data transmission protocol, the first terminal may further encode the virtual reality data before the first terminal transmits the virtual reality data to the at least one second terminal.

Further, in order to improve the speed and reliability of the data transmission, determine the network state of the first terminal; and determine an encoding mode based on the network state, and encode the virtual reality data according to the encoding mode. In still another aspect, the present application also provides a terminal having a function of implementing actual terminal behavior in the above method. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In one possible design, the terminal includes an image acquisition device, a data interface, a processor, and a communication module. The image collection device is configured to collect an environment image of an environment in which the terminal is currently located; and the data interface is configured to obtain environment data of the current environment of the terminal, where the environment data includes at least: an environment image collected by the image collection device; The device is configured to support the terminal to perform a corresponding function in the above method, as the processor may be configured to use the environment image in the environment data by two if the environment image is a two-dimensional image Converting the dimensional image into a three-dimensional image, and obtaining virtual reality data converted by the environmental data, the virtual reality data is used to reflect a three-dimensional scene of an environment in which the terminal is located; the communication module is configured to use the virtual reality data Transfer to at least one receiving terminal.

In a possible design, the processor is further configured to determine the environment data as the virtual space for reflecting a three-dimensional scene of an environment in which the terminal is located, if the environment image is a three-dimensional image. Realistic data.

In a possible design, the processor is further configured to: after obtaining the virtual reality data, perform virtual reality scene rendering on the three-dimensional environment image in the virtual reality data, where the virtual reality scene rendering includes: One or more of distortion, inverse dispersion, and interpupillary adjustment.

In a possible design, the terminal may further include: a sensor, configured to sense a viewing angle of the environment of the user on the terminal side;

The data interface is further used for viewing the viewing angle of the environment by the user on the terminal side collected by the sensor;

The communication module is further configured to send the viewing angle to the at least one second terminal while the virtual reality data is transmitted to the at least one second terminal, so that the second terminal follows the viewing The perspective view renders the virtual reality data and outputs virtual reality data presented at the viewing angle.

In a possible design, the processor is further configured to: before the communication module transmits the virtual reality data to the at least one receiving terminal, determine a network state of the terminal; determine an encoding mode based on the network state; The virtual reality data is encoded.

The second aspect of the embodiment of the present application is consistent with the design of the first aspect, and the technical means are similar. For the specific beneficial effects brought by the technical solution, please refer to the first aspect, and details are not described herein.

In another aspect, the present application further provides another method for sharing virtual reality data, in which the terminal acquires target data to be shared by the first terminal, the target data includes at least one frame image, and in the target data. When the image is a two-dimensional image, the image in the target data is converted from the two-dimensional image into a three-dimensional image, and the virtual reality data converted by the target data is obtained, and the virtual reality data can be reflected according to the target data. a three-dimensional scene, such that after transmitting the virtual reality data to the at least one second terminal, the user of the second terminal can view the virtual reality data on the second terminal, thereby realizing sharing of the virtual reality data; and, second The user of the terminal can experience the real environment scene corresponding to the image played by the first terminal side through the virtual reality data.

In a possible design, the terminal acquiring the target data to be shared by the first terminal may be the environment data of the environment in which the first terminal is located, and the environment data includes: an environment image of the environment in which the first terminal is located.

In a possible design, the acquiring, by the terminal, the target data to be shared by the first terminal may be acquiring video data currently being played by the first terminal, where the video data includes at least one frame of video image.

In a possible design, the terminal acquiring the video data currently played by the first terminal may be acquiring a target play window displayed in the first terminal (such as a game window of a game application, a video display window of a browser, After the video data currently being played in the play window of the player or the like is sent to the second terminal by the video data converted by the video data played by the target window, the user of the second terminal outputs the output of the second terminal. The virtual reality data may be such that the user is in a three-dimensional environment scene corresponding to the target data in the first terminal (eg, in a three-dimensional environment scene of the game outputted by the first terminal).

In still another aspect, the present application also provides a terminal having a function of realizing the actual terminal behavior in the above method of the third aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a possible design, the terminal includes a data interface, a processor, and a communication module, wherein the data interface is used to acquire target data to be shared by the first terminal, the target data includes at least one frame image; In the case that the image in the target data is a two-dimensional image, the image in the target data is converted from a two-dimensional image into a three-dimensional image, and virtual reality data converted from the target data is obtained, the virtual The real-time data is used to reflect the three-dimensional scene constructed according to the target data; and the communication module is configured to transmit the virtual reality data to the at least one second terminal.

In a possible design, the data interface is specifically configured to obtain environment data of an environment in which the first terminal is currently located, where the environment data includes: an environment image of an environment in which the first terminal is located.

In a possible design, when the data interface is to acquire the target data to be shared by the first terminal, the data interface is specifically configured to acquire video data currently played by the first terminal, where the video data includes at least one frame of video image.

In a possible design, the data interface is specifically configured to acquire video data currently playing in a target play window displayed in the first terminal, where the target play window is in the first terminal. Specifies the image output window of the app.

The design ideas of the fourth aspect and the third aspect of the embodiments of the present application are the same, the technical means are similar, and the technical solution brings Please refer to the third aspect for the specific benefits. I will not repeat them.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application, Those skilled in the art can also obtain other drawings based on these drawings without paying for creative labor.

1 is a schematic structural diagram of a terminal of a terminal of the present application;

2 is a schematic flow chart of an embodiment of a method for sharing virtual reality data according to the present application;

3 is a schematic flow chart of still another embodiment of a method for sharing virtual reality data according to the present application;

4 is a schematic structural diagram of an embodiment of an apparatus for sharing virtual reality data according to the present application;

FIG. 5 is a schematic structural diagram of an embodiment of an apparatus for sharing virtual reality data according to another application of the present application.

detailed description

The method for sharing virtual reality data in the embodiment of the present application is applicable to sharing virtual reality data between different terminal devices.

In the embodiment of the present application, the terminal may include, but is not limited to, a mobile phone, a mobile computer, a tablet computer, a personal digital assistant (PDA), a media player, a smart wearable device (eg, smart glasses and head-mounted smart phones). Equipment, etc.). The terminal specifically has functions such as running an application (Application, APP) and accessing the network.

FIG. 1 is a schematic structural diagram of a part of a terminal 100 related to an embodiment of the present application.

Referring to FIG. 1, the terminal 100 includes components such as a communication module 110, a memory 120, an input device 130, a display 140, a sensor 150, an audio circuit 160, an image capture device 170, and a processor 180. The communication module 110, the memory 120, the input device 130, the display 140, the sensor 150, the audio circuit 160, the image acquisition device 170, and the processor 180 are connected by a communication bus 190.

It will be understood by those skilled in the art that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal. In practice, the terminal may include more or less components than those illustrated, or combine some components, or different. Parts layout.

The components of the terminal 100 will be specifically described below with reference to FIG. 1 :

The communication module 110 can be used for transmitting and receiving information, such as receiving and transmitting signals. For example, when the terminal is a mobile phone, the communication module can be a radio frequency (RF) circuit, and the RF circuit can include but is not limited to an antenna, at least one amplifier. , transceivers, couplers, Low Noise Amplifiers (LNAs), and duplexers. In addition, the RF circuit can communicate with the network and other devices through wireless communication. The communication module may further include a data transmission module and a data receiving module to implement reception and transmission of image, audio or video data, such as a communication module, which may include a Bluetooth module, a WiFi module, and the like.

The memory 120 can be used to store software programs as well as modules. The memory can also store data such as images, audio, and the like involved in the present application.

In a possible implementation, the memory 120 may mainly include a storage program area and a storage data area, where The stored program area can store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.) and the like. In the embodiment of the present application, the storage program area may store an image acquisition module for acquiring an environment in which the first terminal is located; an image processing module for processing an environment image of the environment in which the first terminal is located; A data encoding module for encoding data; and a data transmission module for data transmission.

The storage data area may store data created according to the use of the terminal 100, such as audio data, image data, and the like.

Moreover, memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input device 130 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the terminal 100. For example, taking the terminal as a mobile phone as an example, the input device 130 may include a touch panel and other input devices. The touch panel, also known as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like, any suitable object or accessory on or near the touch panel), and The corresponding connecting device is driven according to a preset program. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

Display 140 (which may also be referred to as a display module) may be used to display information entered by the user or information provided to the user as well as various menus of terminal 100. The display 140 may include a display panel. In one possible case, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Although in FIG. 1, the input device and the display are implemented as two separate components to implement the input and output functions of the terminal 100, in some embodiments, such as a mobile terminal such as a mobile phone, the input device (eg, touch The control panel is integrated with the display panel to implement the input and output functions of the mobile phone.

Terminal 100 may also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors. In particular, in order to be able to determine the current viewing angle of the middle terminal, the terminal at least includes a sensor capable of acquiring the user's body posture of the user.

The audio circuit 160 can be coupled to a speaker and a microphone to provide an audio interface between the user and the terminal 100. The audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker and convert it into a sound signal output by the speaker; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and then converted. For audio data, the audio data is then output to the communication module 110 for transmission to another terminal, or the audio data is output to the memory 120 for further processing.

The image collection device 170 is configured to collect image data of an environment in which the terminal is located, and transmit the image collection data to a processor for processing. For example, image capture device 170 can be a camera. It can be understood that FIG. 1 is an example in which the image collection device is provided in the terminal, but in practical applications, the image acquisition unit is disposed outside the terminal and is equal to the terminal through a line or a wireless network. Connected.

The image acquisition device, the audio circuit connected with the speaker and the microphone, and the sensor can be used as a data acquisition module for collecting image, audio and the like data in the present application.

The processor 180 is the control center of the terminal 100, connecting various portions of the entire handset with various data interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120. The various functions and processing data of the terminal 100 are executed to perform overall monitoring of the terminal. Such as The processor obtains the image data collected by the image acquisition unit through the data interface. At the same time, the data interface can also acquire the audio signal collected by the audio circuit and the sensing signal collected by the sensor, and transmit the audio signal and the sensing signal to the processor.

In this embodiment, the processor may include a central processing unit (CPU), and may further include: a graphics processing unit (GPU).

In a possible case, the processor 180 is configured to: obtain, from the data interface, environment data of a current environment of the terminal, where the environment data includes at least an environment image collected by the image collection device; In the case of a dimensional image, the environmental image in the environmental data is converted from a two-dimensional image into a three-dimensional image, and virtual reality data converted from the environmental data is obtained, and the virtual reality data is used to reflect a three-dimensional scene of the environment in which the terminal is located; The virtual reality data is transmitted to the at least one receiving terminal by the communication module, and the receiving terminal is a terminal for receiving the virtual reality data.

Specifically, the processor can be used to implement related operations performed by the processor in the first terminal in the method for sharing virtual reality data provided by the embodiment shown in FIG. 2 and FIG. 3 described below.

The terminal 100 also includes a power source (such as a battery) for powering various components. In one possible case, the power source can be logically connected to the processor 180 through the power management system to manage charging, discharging, and power consumption through the power management system. And other functions.

Although not shown, the terminal 100 may further include a radio frequency module, a Bluetooth module, and the like, and details are not described herein again.

A scheme for sharing a virtual reality data according to an embodiment of the present application is described below with reference to FIG.

First, the virtual terminal data corresponding to the environment in which the first terminal is located is shared by the first terminal to the second terminal as an example. The first terminal may be understood as a transmitting terminal that needs to send or share virtual reality data; and the second terminal is a receiving terminal that receives virtual reality data.

FIG. 2 is a schematic flowchart diagram of an embodiment of a method for sharing virtual reality data according to the present application. The method in this embodiment may include:

S201. The first terminal collects video data of an environment in which the first terminal is located.

It can be understood that the video data may be composed of consecutive multi-frame images. For the purpose of distinguishing, each frame image of the environment in which the first terminal is located is referred to as an environment image.

For example, an image of the environment in which the first terminal is currently located may be collected by an image capturing device of the first terminal, such as a camera or an external camera connected to the first terminal.

It can be understood that the image capturing device in the embodiment of the present application may be an image capturing device such as a camera that collects two-dimensional (2D) images. Correspondingly, the collected video data may be a 2D image including multiple frames. . The 2D image may also be referred to as a planar image, and refers to an image having two dimensions, such as an image that can be represented by two dimensions (X, Y).

The image capturing device may also be an image capturing device such as a camera that collects three-dimensional (3D) images. The 3D image may also be referred to as a stereoscopic image, and refers to an image having three dimensions, for example, by (X, Y). , Z) An image represented by three dimensions. For example, the image capturing device may be a VR camera or the like. Correspondingly, the collected video data may be a 3D image including multiple frames.

In particular, in order to more accurately reflect the characteristics of the environment in which the first terminal is located (eg, the current time, location, weather, etc. of the first terminal), the image acquisition device of the first terminal collects the environment in which the first terminal is located. At the same time of the video data, the audio signal of the environment in which the first terminal is located may be collected through an audio circuit, for example, an audio signal such as a microphone connected to the audio circuit collects an audio signal of an environment in which the first terminal is located, so that the audio circuit can The audio signal is collected.

In order to enable the user on the second terminal side to learn information such as the viewing angle of the user on the first terminal side in the environment, the first terminal may also acquire the video data through the first terminal. User gesture data of a user gesture of a terminal side user, the user gesture may include a viewing angle of the user viewing the current environment. For example, the user gesture can be the user's head elevation angle and the like.

The video image and the audio data may constitute environment data of an environment where the first terminal side is located.

S202, the first terminal detects whether the currently collected environment image belongs to the 3D image, and if yes, the environment image is used as the virtual reality data of the environment where the first terminal is currently located, and performs step S206; if not, step S203 is performed. ;

For example, the processor of the first terminal may detect whether the environment image includes depth information, if the depth information is not included, the environment image is a 2D image; if the environment image includes depth information, the environment image belongs to a 3D image. .

The difference between the 2D image and the 3D image is that the 2D image lacks depth information. For example, in the camera coordinate system, the vertical imaging plane and the straight line passing through the center of the mirror are the Z axis, if the imaged object is in the camera coordinate system. The coordinate is (X, Y, Z), then, wherein the value of the object in the Z axis is the depth information of the object in the imaging plane of the camera, the depth information of the object is not included in the 2D image of the object, and the 3D of the object This depth information is included in the image.

It can be understood that the first terminal collects one frame of the environment image at a time, and each time the first terminal collects one frame of the environment image, it is required to detect whether the environment image belongs to the 3D image, and the environment image does not belong to the 3D image. Next, an operation of converting a 2D environment image into a 3D image is performed. Of course, in the process of collecting the video image of the environment in which the first terminal is located, the image capturing device such as the camera is generally not switched, and therefore, only the first frame in the video data may be used. The environment image is detected, and the dimensions of each frame environment image included in the video data are determined according to the dimension of the environment image.

It should be noted that the present application only introduces the environmental data including the environment image as an example, and the collected environmental data may include audio signals and the like in addition to the environment image, and therefore, if the environmental data is included in the environment data, When the environment image is a 3D image, the environment data may be used as virtual reality data of the environment in which the first terminal is located.

S203. In a case where the environment image is a 2D image, the first terminal determines depth information required to convert the environment image from the 2D image to the 3D image;

For example, the processor of the first terminal constructs depth information of the environment image to subsequently convert the environment image from the 2D image to the 3D image according to the depth information constructed for the environment image. The first terminal can construct depth information for the 2D environment image. For example, based on the geometric analysis method, the feature learning method is used to construct the depth information by using the method of relative depth or depth sorting. The depth information required to construct the 2D environment image into a 3D image is not limited.

In particular, in order to optimize the depth information, if there is a moving object in the environment image, the motion information of the motion object, the environment image, and the latest frame environment image before the environment image may be combined. The depth information corresponding to the environment image is optimized.

The analyzing whether the moving object exists in the environment image may be determined by analyzing the environment image and the one or more frame environment images adjacent to the environment image, for example, performing image recognition on the adjacent frame environment image, and determining Whether the subject has a positional offset.

S204: The first terminal constructs a 3D environment image corresponding to the 2D environment image according to the depth information constructed for the 2D environment image and the 2D environment image.

Among them, for convenience of distinction, a 3D image constructed from an environment image is referred to as a 3D environment image.

For example, the processor of the first terminal synthesizes the depth information with the environment image, and converts the 2D environment image into a 3D environment image.

The 3D environment image constructed by the environment image actually reflects the three-dimensional scene of the environment in which the first terminal is located when the environment image is collected. Therefore, the 3D environment image is actually the first terminal side currently located. Virtual reality data corresponding to the environment. The virtual reality data may reflect a three-dimensional scene of the environment in which the first terminal is located.

It can be understood that the above is directly taking the processing of the environment image as an example, but it can be understood that if the first terminal collects the environmental data including the environment image, the environment of the environment can be 2D. The image is converted into a 3D environment image, and the virtual reality data converted from the environment data can be obtained.

It should be noted that steps S203 and S204 are an implementation manner of converting an environment image from a 2D image to a 3D image. If the environment image is converted from 2D to 3D image by other means, the same applies to the embodiment of the present application. This will not be repeated here.

S205. The first terminal performs hole filling on the constructed 3D environment image.

Among them, the cavity filling is also called void filling. The basic idea used for cavity filling is spatial correlation, that is, using the neighborhood pixels around the image hollow hole to estimate the depth value of the pixel in the hole, so that the estimated depth value is based on The holes are filled.

In order to improve the 3D effect exhibited by the rendered 3D environment image, the processor of the first terminal may perform optimization processing such as hole filling on the converted 3D environment image. Of course, this step is only for optimizing the 3D effect of the image. In the scenario where the 3D effect is not high, the step S205 may not be performed.

S206. The first terminal performs VR scene rendering on the 3D environment image to obtain a rendered 3D environment image.

The purpose of the VR scene rendering by the processor on the constructed 3D environment image or the acquired 3D environment image is to avoid an abnormal situation such as distortion when the second terminal displays the 3D environment image.

In order to facilitate understanding of the distortion that may occur in an image, an example of several distortion cases and VR scene rendering to cancel the distortion is introduced:

For example, since the image on the display screen of the terminal is magnified through the lens, the image needs to be distorted to offset the distortion, so that the image displayed by the terminal is projected onto the user's retina. No distortion of the image. Among them, the processing for canceling the distortion of the image outputted by the terminal display screen is anti-distortion, also called reverse distortion, and the anti-distortion is a processing method of VR scene rendering.

Another example is that when a white light passes through the prism, a rainbow is emitted from the prism, which is caused by the difference in refractive index of different colors of light. Correspondingly, the terminal will also exhibit this kind of dispersion phenomenon during the process of outputting images. In order to avoid image distortion due to dispersion phenomenon, the color path reversible principle can be used to reverse the color. For example, since the light projected from the image passes through the lens, dispersion occurs. Then, before the light of the image enters the lens, the image is dispersed once, so that the image presented through the lens is a normal image.

For example, when the eyes of normal people look at the same object, the objects are imaged at the retinas of the two eyes, and are superimposed on the center of the brain to become a complete, three-dimensional single object. This function is called binocular single vision. The principle of VR glasses used to view VR images is similar to our eyes. Currently, VR glasses generally split the image content into two halves, and superimpose the image through the lens, which often leads to the pupil center of the human eye. The center of the lens and the center of the screen (after the split screen) are not in a straight line, which makes the visual effect very poor, and there are a lot of problems such as unclearness and deformation. The ideal state is that the center of the pupil of the eye, the center of the lens, and the center of the screen (after the split screen) should be in a straight line. In this case, it is necessary to adjust the "pitch" of the lens to coincide with the eyelid of the human eye, and adjust At the center of the screen, make sure that 3 points are in a straight line for the best visual effect. In order to realize that the center of the pupil of the human eye, the center of the lens, and the center of the screen (after the split screen) are in a straight line, the processing on the 3D environment image is called the pitch adjustment.

In the embodiment of the present application, the VR scene rendering may include: performing one or more kinds of processing such as reverse distortion, inverse dispersion, and distance adjustment on the 3D environment image. It can be seen that if the collected environmental data (which may be referred to as the first environment data for convenience of distinction) is not 3D data, the first terminal adjusts parameter information of the environment data (eg, adding depth information, performing hole filling, etc.) The environment data is converted into 3D environment data (ie, the second environment data), and the VR scene rendering is performed on the 3D environment data to generate 3D environment data after being rendered by the VR scene (may be referred to as a third environment) Data or third data). If the environment data collected by the data collection module (ie, the first environment data) is 3D data, the first terminal only needs to perform VR scene rendering on the environment data to generate fourth data.

It can be understood that if the virtual reality data including the 3D environment image is acquired before step S206, the VR scene rendering may be directly performed on the three-dimensional environment image in the virtual reality data.

S207. The first terminal determines, according to a current network state between the first terminal and the second terminal, a coding mode applicable to the network state.

The network status may reflect the data transmission effect between the first terminal and the second terminal. For example, the network status may include network speed, network signal quality, and the like.

The coding mode can be divided into two categories, one is lossy coding mode and the other is lossless coding mode. Of course, each type of coding method can be further divided into multiple coding modes. For example, the lossy coding method can include: audio and video interlaced format (AVI) encoding, dynamic image expert group 4 (Moving Picture) The encoding method of Experts Group 4, MPEG4). The lossless coding method may include: Shannon coding, Huffman coding, Run Length Code (RLC), and the like.

In the embodiment of the present application, according to the network speed, it can be determined which type of coding mode is required, and then an encoding mode included in the coding mode is used for encoding.

For example, when the network status is good, for example, the network status indicates that the network speed of the first terminal and the second terminal is high, the processor of the first terminal may use the lossless coding mode as the required coding mode, The image quality encoded by the encoding method is high, so that image data with higher image quality is transmitted to the second terminal without affecting the image data transmission speed. Of course, in the case of a good network state, which lossless coding mode is specifically adopted, it can be set as needed. The network status is poor. For example, the network status indicates that the network transmission speed of the first terminal and the second terminal is low, and the first terminal can select the lossy coding mode as the coding mode for encoding the 3D image. It may reduce the time required to transfer compressed data. Correspondingly, in the case of a poor network state, which lossy coding mode is specifically adopted, it can also be set as needed.

It can be understood that, in order to enable the first terminal to transmit the environment data, the first terminal and the second terminal may be pre-established communication connections, for example, an instant communication may be established between the first terminal and the second terminal. The channel transmits the encoded 3D environment image through an instant messaging channel between the first terminal and the second terminal. In this case, the network status of the communication connection channel established between the first terminal and the second terminal can be determined.

Certainly, the first terminal may also transmit the 3D environment image to the second terminal by using a mail or the like, and the specific communication manner adopted by the first terminal to transmit the 3D environment image to the second terminal is not limited. Before the first terminal and the second terminal establish a network connection, the first terminal and the second terminal may determine the network state of the first terminal, and determine the coding mode according to the network state of the first terminal. .

It should be noted that determining the coding mode according to the network state is only an implementation manner. In an actual application, the required coding mode may be preset, or the user may select a desired coding mode, which is not limited herein.

S208. The first terminal encodes the 3D environment image rendered by the VR scene according to the determined encoding manner, to obtain encoded 3D environment data.

It can be understood that, while collecting the environment image, if the first terminal collects audio data and the user views the viewing angle and the like, the first terminal may use the 3D environment data and the audio data rendered by the VR scene. The data, and the data such as the viewing angle of the user are encoded together to transmit the encoded environment data and the viewing angle of the first terminal side user to the second terminal.

S209. The first terminal sends the encoded 3D environment image to the second terminal.

For example, the processor of the first terminal sends the encoded 3D environment image to the communication module of the first terminal, and transmits the encoded 3D environment image to the second terminal through the communication module.

The network used by the first terminal to transmit the encoded 3D environment image to the first terminal may have multiple possibilities, such as being transmitted to the 3D environment to the second terminal through a wired network or a wireless network such as Bluetooth or wifi. image. Specifically, the transmission protocol used to transmit the encoded 3D environment image is related to the transmission mode used to transmit the 3D environment image.

It can be understood that, since the environment image is continuously collected in step S201, in the actual application, the first terminal may repeat the above steps S202 to S209 until all the environmental images in the captured video image are processed and then sent. Give the second terminal.

In the embodiment of the present application, when the environment image of the current environment of the first terminal is obtained, if the currently acquired environment image is a two-dimensional image, the environment image is converted into virtual reality data in real time, and the current The converted virtual reality data is transmitted to the second terminal in real time as an example for description.

However, it can be understood that, in the case that the scenario of the environment in which the first terminal is located is not required to be shared in real time, after the first terminal ends the collection of the environment image of the environment in which the first terminal is located, the collection is sequentially performed. The obtained environment image is converted into virtual reality data, and the VR scene is rendered by the virtual reality data; then, each 3D image after VR rendering is encoded and transmitted in turn; or all 3D after rendering through the VR scene is performed. After the image is uniformly encoded, it is sent to the second terminal together.

It should be noted that the above is an example in which the first terminal continuously ingests a multi-frame environment image, but may It is understood that if the first terminal only collects one frame of the environment image, the method can be processed in the manner of the embodiment of the present application, and the process is similar, and details are not described herein again.

In particular, in the case of converting the environmental image in the environmental data into a 3D image and performing VR scene rendering on the converted 3D image, the environment data includes the 3D environment data after being rendered by the VR scene, and then directly The environmental data is encoded to subsequently transmit the encoded environmental data to the second terminal.

In this embodiment, the first terminal sends the virtual reality data (the 3D environment image or the video data including the 3D environment image) corresponding to the environment image to a second terminal as an example, but it can be understood that the first terminal can The virtual reality data is sent to the multiple second terminals as needed, and the specific process is similar, and details are not described herein again.

S210. The second terminal, after receiving the encoded 3D environment image, decodes the encoded 3D environment data to obtain the 3D environment image.

For example, the second terminal receives the encoded 3D environment image transmitted by the first terminal through its communication module, and the processor (the processor may call the data decoding module) of the second terminal receives the encoded 3D environment received by the communication module. The image is decoded to decode the 3D environment image.

In the case that the first terminal transmits the encoded environment data to the second terminal, the environment data may be decoded to decode the environment data including the image of the 3D environment.

S211. The second terminal acquires a specified viewing angle of view of the current 3D environment image.

S212. The second terminal renders the 3D environment image according to the specified viewing, and obtains a 3D environment image presented by the specified viewing angle.

It can be understood that the image decoded by the second terminal is a 3D image, and the image output by the second terminal to the display screen can be an image viewed from any angle of view. Therefore, the processor of the second terminal can first determine one. The viewing angle is specified, and the 3D environment image is rendered according to the specified viewing angle to obtain a 3D environment image presented at the specified viewing angle.

The specified viewing angle may be a preset default viewing angle, or may be a viewing angle selected by a user on the second terminal side or selected in real time.

It can be understood that, while the encoded 3D environment data is received by the second terminal, if the communication module of the second terminal receives the encoded user gesture data, the processor of the second terminal can decode the user gesture. data. Correspondingly, the processor can determine the viewing angle of the user on the first terminal side according to the user posture data, so that the viewing angle of the user on the first terminal side can be used as the default viewing angle. In this way, in a case where the user on the second terminal side does not adjust the viewing angle, the second terminal may render the 3D environment image according to the viewing angle of the first terminal side user, so that the second terminal can feel the first The environment scene viewed by the user on the terminal side.

S213. The second terminal outputs the 3D environment image presented by the specified viewing angle to the display screen.

For example, the processor of the second terminal transmits the 3D environment image rendered according to the specified viewing angle to the display unit of the second terminal to output the 3D environment image through the display unit.

After the second terminal outputs the 3D environment image, the user of the second terminal can view the 3D environment image output by the second terminal side through the virtual reality device, so that the 3D environment can be viewed by the user-related viewing angle of the first terminal. The image; the 3D image can also be viewed from any angle according to its own needs, so that the visual experience of the environment where the user is located on the first terminal side can be experienced.

In the embodiment of the present application, the first terminal may acquire an environment image of an environment in which the first terminal is located, and based on the environment The image constructs a 3D environment image for reflecting a three-dimensional scene of the environment in which the first terminal is located, and transmits the 3D environment image to the at least one second terminal, such that the user of the second terminal outputs the The 3D environment image can feel the visual experience in the environment in which the first terminal is located, thereby experiencing the experience effect of being in the same environment scene as the first terminal.

It can be understood that the above is an example in which the first terminal shares the virtual reality data corresponding to the environment in which the first terminal is located in the second terminal. In an actual application, the first terminal may also be the first terminal side user. The video image to be viewed is processed as a video image to be shared, and is processed by the method for sharing virtual reality data of the present application, and then shared with the second terminal, so that the user of the second terminal can experience the user watching with the first terminal. The same experience with video images. Certainly, the first terminal may also use the video image stored by the first terminal as data to be shared, and process the stored video image into virtual reality data by using the method for sharing virtual reality data of the present application, and transmit the data to the second terminal. .

The following describes an example in which the first terminal shares the video image being played by the first terminal to the second terminal.

FIG. 3 is a schematic flowchart diagram of still another embodiment of a method for sharing virtual reality data according to the present application. The method in this embodiment may include:

S301. The first terminal acquires video data currently played by the first terminal.

The video data includes at least a video image, and may further include an audio signal;

The video data may be a frame image and an audio signal associated with the frame image, such as video data composed of a frame of video image currently being played in the video file played by the terminal and the output audio signal.

Of course, the video data may also be a video file, where the video text includes a multi-frame video image and an audio signal associated with the multi-frame video file. In this case, the first terminal may sequentially process each frame in the video file. The processing of the video image is similar to the process of this embodiment, and details are not described herein again.

In an implementation manner, the first terminal may acquire video data currently playing in the target play window displayed by the first terminal, where the target play window may be an image output window of the specified application in the first terminal.

For example, the specified application may be a game application, and the target play window is a game window for outputting a game screen for the game application. In the application scenario, the video data acquired by the first terminal may be game data, and the game data includes a game screen. And the sound signal in the game, etc., by the virtual reality sharing method of the embodiment, the game screen in the game data can be converted into virtual reality data for sharing to the user of the second terminal, so that the user of the second terminal The three-dimensional scene corresponding to the game screen played on the first terminal side can be viewed.

For another example, the specified application may be a player, and the target play window may be a video play window of the player. In the application scenario, the first terminal may acquire a video image played by a video play window of the player, and The virtual reality sharing method of the embodiment is implemented to convert the video image played by the player into virtual reality data, and share the data to the user of the second terminal, so that the user of the second terminal can feel the first terminal. The experience of the three-dimensional scene corresponding to the video image played by the player on the side.

Of course, the specified application can also be an application having an image output function such as a browser, and is not limited herein.

In a possible implementation manner, the first terminal acquires a currently viewed video image, and may also sense, by using a device such as a sensor, a viewing angle of the video image viewed by the first terminal side user, so that the second terminal side can View the video image at the same viewing angle.

S302, the first terminal detects whether the video image in the video data belongs to the 3D image, and if so, the video data is used as the virtual reality data currently played by the first terminal, and step S306 is performed; if not, step S303 is performed;

It can be understood that, in the case that the video data includes multiple frames of video images, it is required to detect whether the currently played video image belongs to a 3D image, and if the video image does not belong to the 3D image, perform conversion of the 2D video image. For the operation of 3D images. Of course, considering that the dimensions of the video images in a video file are generally the same, it is also possible to determine the video only by detecting the first frame of the video image in the video data and according to the dimensions of the first frame image. The dimensions of the image of each frame contained in the data.

S303. In a case where the video image is a 2D image, the first terminal determines depth information required to convert the video image in the video data from the 2D image to the 3D image;

In particular, in order to optimize the depth information, if there is a moving object in the moving state in the video image, the motion information of the moving object and the latest frame image in front of the video image in the video image may be combined to correspond to the environment image. The depth information is optimized.

S304. The first terminal converts the video image in the video data into a 3D video image according to the depth information corresponding to the video image and the video image, to obtain virtual reality data converted by the video data.

In order to facilitate the distinction, the 3D image converted from the video image is referred to as a 3D video image, and since the video data including the 3D environment image is actually a three-dimensional video data, the converted video data may be referred to as virtual The real data is used to reflect a three-dimensional scene of the video image currently played by the first terminal.

S305. The first terminal performs hole filling and optimization on the 3D video image in the virtual reality data.

Of course, this step is only for optimizing the 3D effect of the image. In the scenario where the 3D effect is not high, the step S305 may not be performed.

S306. The first terminal performs VR scene rendering on the 3D video image in the virtual reality data to obtain the rendered virtual reality data.

For example, the VR scene rendering includes: performing one or more kinds of processing such as anti-distortion, anti-dispersion, and interpupillary adjustment on the 3D environment image.

The process of converting the video image into the 3D video image is similar to the process of converting the environment image into the 3D environment image in the previous embodiment. For details, refer to the related description of the previous embodiment, and details are not described herein again.

S307. The first terminal determines, according to a current network state between the first terminal and the second terminal, a coding mode applicable to the network state.

S308. The first terminal encodes the virtual reality data that is rendered by the VR scene according to the determined encoding manner, to obtain the encoded virtual reality data.

It can be understood that if the first terminal acquires the viewing angle of the first terminal side user while acquiring the video data, the virtual reality data may be encoded together with the viewing angle of the user, so as to be encoded later. The virtual reality data and the viewing angle are sent together to the second terminal.

The process of encoding and transmitting virtual reality data can be referred to the related process in the previous embodiment, and is no longer Narration.

S309. The first terminal sends the encoded virtual reality data to the second terminal.

S310. The second terminal, after receiving the encoded virtual reality data, decodes the encoded virtual reality data to obtain virtual reality data including a 3D video image.

S311. The second terminal acquires a specified viewing angle of the current viewing of the 3D video image.

S312. The second terminal renders the 3D video image according to the specified viewing, and obtains a 3D video image presented by the specified viewing angle.

It can be understood that, while the encoded 3D environment data is received by the second terminal, if the communication module of the second terminal receives the viewing angle of the video image viewed by the first terminal side user, the viewing angle can be used as a default. Watch the perspective.

S313. The second terminal outputs the 3D video image presented by the specified viewing angle to the display screen.

In the solution of the embodiment, the first terminal sends the 3D image corresponding to the video image currently played by the first terminal to the at least one second terminal, so that if the video image viewed by the user of the first terminal is a 3D video image, Then, sharing the 3D video image to the second terminal, the user of the second terminal can experience the same viewing experience as the user of the first terminal; and if the video image viewed by the user of the first terminal is a 2D video image, The video image played by the first terminal side can be converted into a 3D image and shared to the second terminal by using the solution of the present application, so that the sharing of the 3D image is realized, so that the user of the second terminal can simultaneously view the first terminal side. The virtual reality data corresponding to the video image viewed by the user.

In another aspect, the present application further provides a computer readable storage medium having stored therein instructions for causing the terminal to perform any of the sharing of virtual reality data as described above when the instruction is run on the terminal. Methods.

In another aspect, the present application also provides a computer program product comprising instructions for causing a terminal to perform a method of sharing virtual reality data as described above when the computer program product is run on a terminal.

On the other hand, the present application also provides an apparatus for sharing virtual reality data, which can be applied to the aforementioned terminal for transmitting virtual reality data.

For example, referring to FIG. 4, it is a schematic structural diagram of an embodiment of an apparatus for sharing virtual reality data according to the present application. The apparatus of this implementation may include:

The data collection module 401 is configured to obtain environment data of an environment in which the terminal is located, where the environment data includes at least an environment image. The environmental data can be understood as video data composed of at least one frame of environment image. For example, the data acquisition module acquires an environment image of an environment in which the terminal is collected by an image acquisition device such as a camera (a camera that captures a two-dimensional image or a camera that collects VR data).

The image processing module 402 is configured to convert the environment image in the environment data from a two-dimensional image into a three-dimensional image, and obtain virtual reality data converted by the environment data, where the environment image is a two-dimensional image. Virtual reality number According to a three-dimensional scene for reflecting the environment in which the terminal is located.

The data transmission module 403 is configured to transmit the virtual reality data to the at least one receiving terminal.

The environment data acquired by the data collection device may further include: audio data collected through a microphone or the like on the terminal, and user posture and the like sensed by the sensor. The acquired environmental data and user posture data may be collectively referred to as user environment data. The user gesture may be a viewing angle of the environment in which the first terminal is located, and correspondingly, the data transmission module 403 may transmit the virtual reality data while transmitting the user posture data, so that the receiving device can The virtual reality data is rendered according to the viewing angle, and the virtual reality data presented at the viewing angle is output.

In an implementation manner, after the image processing module acquires the environment data from the data collection module, the image processing module may further detect whether the collected data is 3D data.

If the environment data is 2D data, the process of the image processing module converting the environment image in the environment data into the 3D image may be: determining the depth information corresponding to the 2D environment data, and constructing the acquired depth information and the 2D environment data. Out of 3D environment data. Among them, the motion information and the inter-frame information are used to optimize the depth information when processing the video with motion information.

Further, the image processing module can also perform hole filling and optimization on the 3D environment data.

Further, after the image processing module constructs the 3D environment data, the 3D environment data may also be rendered, that is, the VR scene rendering mentioned above is performed.

If the image processing module determines that the environment data is 3D data, the image processing module may further determine the environment data as virtual reality data to directly render the 3D environment data VR scene.

In an implementation manner, the apparatus may further include: a data encoding module 404, configured to determine an encoding mode based on a network state of the terminal; and encode the virtual reality data according to the encoding mode. The data encoding module can adaptively select the most suitable coding mode according to the network state, and encode the 3D environment data according to the selected coding mode, so as to improve the speed and reliability of the subsequent transmission of the virtual reality data.

In another aspect, the present application further provides another apparatus for sharing virtual reality data, the apparatus being applicable to a receiving terminal that receives the virtual reality data.

For example, referring to FIG. 5, a schematic structural diagram of another embodiment of an apparatus for sharing virtual reality data is shown. The apparatus of this embodiment may include:

The data receiving module 501 is configured to receive virtual reality data from the sending terminal. The data receiving module 501 can establish a transmission connection with the data transmission module of the transmitting terminal by using a transmission protocol.

The display module 502 is configured to display the virtual reality data.

The display module to which the display module outputs the virtual reality data includes but is not limited to a mobile phone screen, and the VR helmet has a display screen.

In one implementation, the apparatus further includes a data decoding module 503.

If the virtual reality data received by the data receiving module is encoded virtual reality data, the data receiving module transmits the virtual reality data to the data decoding module. The data decoding module is configured to decode the virtual reality data, and transmit the decoded virtual reality data to the display module for display.

The various embodiments in the present application are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.

The steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented directly in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The above description of the disclosed embodiments enables those skilled in the art to make or use the application. Various modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the application is not limited to the embodiments shown herein, but is to be accorded the broadest scope of the principles and novel features disclosed herein.

Claims

A method for sharing virtual reality data, comprising:

Obtaining environment data of an environment in which the first terminal is currently located, where the environment data includes at least: an environment image of an environment in which the first terminal is located;

In the case that the environment image is a two-dimensional image, converting the environment image in the environment data from a two-dimensional image to a three-dimensional image, and obtaining virtual reality data converted by the environment data, the virtual reality The data is used to reflect a three-dimensional scene of the environment in which the first terminal is located;

Transmitting the virtual reality data to at least one second terminal.
The method of sharing virtual reality data according to claim 1, further comprising:

In a case where the environment image is a three-dimensional image, the environment data is determined as the virtual reality data for reflecting a three-dimensional scene in which the first terminal is located.
The method for sharing virtual reality data according to claim 1 or 2, further comprising: after obtaining the virtual reality data,

And performing virtual reality scene rendering on the three-dimensional environment image in the virtual reality data, where the virtual reality scene rendering includes one or more of reverse distortion, inverse dispersion, and distance adjustment.
The method of sharing virtual reality data according to claim 1 or 2, wherein the converting the environment image in the environment data from a two-dimensional image to a three-dimensional image comprises:

Creating depth information for the environment image in the environmental data;

Using the depth information and the environment image, a three-dimensional image corresponding to the environment image is constructed.
The method for sharing virtual reality data according to claim 1, wherein, while collecting the environmental data of the environment in which the first terminal is currently located, the method further includes:

Collecting a viewing angle of the environment on the first terminal side of the user;

And the transmitting the virtual reality data to the at least one second terminal, the method further includes:

And transmitting the viewing angle to the at least one second terminal, so that the second terminal renders the virtual reality data according to the viewing angle, and outputs virtual reality data presented in the viewing angle.
The method for sharing virtual reality data according to claim 1, 2 or 5, further comprising: before the transmitting the virtual reality data to the at least one second terminal,

Determining a network status of the first terminal;

Determining an encoding mode based on the network state;

The virtual reality data is encoded in accordance with the encoding mode.
The method for sharing virtual reality data according to claim 1, 2 or 5, wherein the obtaining the environmental data of the environment in which the first terminal is currently located includes:

Obtaining an environment image of the current environment where the first terminal is currently collected;

In the case that the environment image is a two-dimensional image, the environment image in the environment data is converted from a two-dimensional image into a three-dimensional image, and the virtual reality data converted by the environment data is obtained, including:

When the environment image that is currently acquired is acquired, and the environment image is determined to be a two-dimensional image, the environment image in the environment data is converted from a two-dimensional image into a three-dimensional image, and the environmental data is obtained. Converted virtual Realistic data;

Transmitting the virtual reality data to the at least one second terminal includes:

Transmitting the virtual reality data converted at the current time to the at least one second terminal.
A method for sharing virtual reality data, comprising:

Obtaining target data to be shared by the first terminal, where the target data includes at least one frame image;

In a case where the image in the target data is a two-dimensional image, the image in the target data is converted from a two-dimensional image into a three-dimensional image, and virtual reality data converted from the target data is obtained, the virtual reality The data is used to reflect a three-dimensional scene constructed according to the target data;

Transmitting the virtual reality data to at least one second terminal.
The method for sharing the virtual reality data according to claim 8, wherein the acquiring the target data to be shared by the first terminal side comprises:

Obtaining environment data of an environment in which the first terminal is currently located, where the environment data includes: an environment image of an environment in which the first terminal is located.
The method for sharing the virtual reality data according to claim 8, wherein the acquiring the target data to be shared by the first terminal comprises:

Obtaining video data currently played by the first terminal, where the video data includes at least one frame of video image.
The method for sharing virtual reality data according to claim 10, wherein the acquiring the video data currently played by the first terminal comprises:

Obtaining video data currently playing in the target play window displayed in the first terminal, where the target play window is an image output window of a specified application in the first terminal.
A terminal, comprising:

An image capturing device, configured to collect an environment image of an environment in which the terminal is currently located;

a data interface, configured to acquire environment data of an environment in which the terminal is currently located, where the environment data includes at least: the environment image collected by the image collection device;

a processor, configured to convert the environment image in the environment data from a two-dimensional image into a three-dimensional image, and obtain virtual reality data converted by the environment data, in a case where the environment image is a two-dimensional image The virtual reality data is used to reflect a three-dimensional scene of an environment in which the terminal is located;

And a communication module, configured to transmit the virtual reality data to the at least one receiving terminal.
The terminal according to claim 12, wherein the processor is further configured to: when the environment image is a three-dimensional image, determine the environment data to reflect that the terminal is located Virtual reality data for 3D scenes of the environment.
The terminal according to claim 12 or 13, wherein the processor is further configured to: after obtaining the virtual reality data, perform virtual reality scene rendering on the three-dimensional environment image in the virtual reality data, where the virtual Realistic scene rendering includes one or more of reverse distortion, inverse dispersion, and pitch adjustment.
The terminal according to any one of claims 12 to 14, wherein the processor is specifically configured to use the environment image in the environment data when converting the two-dimensional image into a three-dimensional image. Creating the depth information in the environment image in the environment image; constructing the environment image corresponding to the depth information and the environment image 3D image.
The terminal according to claim 15, wherein the terminal further comprises:

a sensor, configured to sense a viewing angle of the environment of the user on the terminal side;

The data interface is further used for a viewing angle of the user on the terminal side collected by the sensor to the environment;

The communication module is further configured to send the viewing angle to the at least one second terminal while the virtual reality data is transmitted to the at least one second terminal, so that the second terminal according to the The viewing angle renders the virtual reality data and outputs virtual reality data presented at the viewing angle.
The terminal according to claim 12, 13 or 16, wherein the processor is further configured to determine a network of the terminal before the communication module transmits the virtual reality data to at least one receiving terminal. a state; determining an encoding mode based on the network state; encoding the virtual reality data according to the encoding mode.
A terminal, comprising:

a data interface, configured to acquire target data to be shared by the first terminal, where the target data includes at least one frame image;

a processor, configured to convert an image in the target data from a two-dimensional image into a three-dimensional image, and obtain virtual reality data converted by the target data, in a case where the image in the target data is a two-dimensional image The virtual reality data is used to reflect a three-dimensional scene constructed according to the target data;

And a communication module, configured to transmit the virtual reality data to the at least one second terminal.
The terminal according to claim 18, wherein the data interface is configured to acquire environment data of an environment in which the first terminal is currently located when acquiring the target data to be shared by the first terminal, the environment data. Includes: an environmental image of the environment in which the first terminal is located.
The terminal according to claim 18, wherein the data interface is configured to acquire video data currently played by the first terminal, where the video data includes at least the target data to be shared by the first terminal, where the video data includes at least One frame of video image.
The terminal according to claim 20, wherein the data interface is configured to acquire, in the target play window displayed in the first terminal, the video data currently being played by the first terminal The played video data, wherein the target play window is an image output window of a specified application in the first terminal.
A computer readable storage medium having stored therein instructions, wherein when the instructions are run on a terminal, causing the terminal to perform as claimed in any one of claims 1-7 A method of sharing virtual reality data.
A computer readable storage medium having stored therein instructions, wherein when the instructions are run on a terminal, causing the terminal to perform as claimed in any one of claims 8-11 A method of sharing virtual reality data.
A computer program product comprising instructions, wherein when the computer program product is run on a terminal, the terminal is caused to perform the method of sharing virtual reality data according to any one of claims 1-7.
A computer program product comprising instructions, wherein the computer program product, when run on a terminal, causes the terminal to perform the method of sharing virtual reality data according to any one of claims 8-11.