WO2021204296A1

WO2021204296A1 - Remote display method for three-dimensional model, first terminal, electronic device and storage medium

Info

Publication number: WO2021204296A1
Application number: PCT/CN2021/086655
Authority: WO
Inventors: 高佩文; 周瑜; 刘双双
Original assignee: 北京城市网邻信息技术有限公司
Priority date: 2020-04-10
Filing date: 2021-04-12
Publication date: 2021-10-14
Also published as: CN111414225B; CN111414225A

Abstract

A remote display method for a three-dimensional model, a first terminal, an electronic device and a storage medium. The method comprises: on the basis of a network graphics library drawing protocol, loading a three-dimensional model in a page; calling an augmented reality interface to display a first attitude of the three-dimensional model; on the basis of real-time audio and video technology, establishing a transmission channel group with a second terminal (202), so that the second terminal (202) and the first terminal (201) synchronously display in the page a first attitude of the three-dimensional model; in response to the detected adjustment operation executed on the three-dimensional model displayed in the first terminal (201), obtaining operation data corresponding to the adjustment operation; on the basis of a network graphics library drawing protocol, calling an augmented reality interface, and displaying a second attitude of the three-dimensional model corresponding to the adjustment operation; and transmitting the operation data from the first terminal (201) to the second terminal (202) by means of the transmission channel group, so that the second terminal (202) displays a second attitude of the three-dimensional model corresponding to the adjustment operation. According to the method, the three-dimensional vehicle model may be displayed in the webpage, and screen sharing between terminals can be achieved.

Description

Three-dimensional model remote display method, first terminal, electronic equipment and storage medium

This application claims the priority of the Chinese patent application No. 202010279917.5 filed on April 10, 2020, and the content of the above-mentioned Chinese patent application is quoted here in full as a part of this application.

Technical field

The embodiments of the present disclosure relate to a method for remotely displaying a three-dimensional model, a first terminal, an electronic device, and a storage medium.

Background technique

With the improvement of people's material living standards, the volume of automobile transactions has increased year by year. In the process of car transaction, the buyer needs to obtain car information, such as the shape, color, configuration, price, etc. of the car, and then choose the car of choice according to actual needs. For example, the buyer can go to the 4S shop to see the car on site, but the on-site car watching will be affected by factors such as time and distance, and the efficiency of car watching is low. With the development of network technology in recent years, buyers can obtain car information through the network, eliminating the need to watch the car on site, improving the efficiency of car viewing.

Summary of the invention

At least one embodiment of the present disclosure provides a method for remotely displaying a three-dimensional model, which is applied to a first terminal, and the method includes: loading a three-dimensional model in a page based on a network graphics library drawing protocol; calling an augmented reality interface to display the three-dimensional model The first posture; establish a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal on the page; in response to the detected pair The adjustment operation performed by the three-dimensional model displayed on the first terminal obtains the operation data corresponding to the adjustment operation; based on the network graphics library drawing protocol and calls the augmented reality interface to display and the adjustment Operate the corresponding second posture of the three-dimensional model; transmit the operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal performs an operation based on the operation data The first posture of the three-dimensional model displayed by the second terminal performs the adjustment operation synchronously, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation.

For example, in the method provided by an embodiment of the present disclosure, the network graphics library drawing protocol includes WebGL.

For example, in the method provided by an embodiment of the present disclosure, the augmented reality interface includes an ARcore development interface in JavaScript form or an ARKit development interface in JavaScript form.

For example, in the method provided by an embodiment of the present disclosure, the page includes a browser page or an application page.

For example, in the method provided by an embodiment of the present disclosure, calling the augmented reality interface to display the first posture of the three-dimensional model includes: acquiring an image; calling the augmented reality interface to perform plane recognition on the image to identify all The display plane in the image; calling the augmented reality interface to display the first posture of the three-dimensional model on the display plane.

For example, in the method provided by an embodiment of the present disclosure, calling the augmented reality interface to display the first posture of the three-dimensional model further includes: after the display plane is recognized, before the first posture of the three-dimensional model is displayed , Prompting the user to click on the display plane; receiving a click instruction from the user to determine the click position.

For example, in the method provided by an embodiment of the present disclosure, calling the augmented reality interface to display the first posture of the three-dimensional model on the display plane includes: calling the augmented reality interface to click on the display plane The first posture of the three-dimensional model is displayed at the position.

For example, in the method provided by an embodiment of the present disclosure, invoking the augmented reality interface to display the first posture of the three-dimensional model further includes: invoking the augmented reality interface to process ambient light data, and evaluating the first posture of the three-dimensional model Adjust the display effect parameters of a posture.

For example, in the method provided by an embodiment of the present disclosure, the display effect parameters include shadow, color saturation, and white balance.

For example, in the method provided by an embodiment of the present disclosure, in response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal, the operation corresponding to the adjustment operation is acquired The data includes: in response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal, monitoring the adjustment operation by using a first page monitoring tool configured in the first terminal to Obtain the operation data based on the first page monitoring tool.

For example, in the method provided by an embodiment of the present disclosure, the operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal is based on the operation data pair Performing the adjustment operation synchronously with the first posture of the three-dimensional model displayed by the second terminal so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation includes: The transmission channel group transmits the operation data based on the first page monitoring tool from the first terminal to the second terminal, so that the second terminal sets the operation data in the second terminal according to the operation data The state of the second page monitoring tool configured so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation; wherein, the first page monitoring tool and the second page monitoring The tool is the same type of page monitoring tool.

For example, in the method provided by an embodiment of the present disclosure, based on the network graphics library drawing protocol and calling the augmented reality interface, displaying the second posture of the three-dimensional model corresponding to the adjustment operation includes: The network graphics library drawing protocol adjusts the size, display angle, and display position of the three-dimensional model corresponding to the adjustment operation, and based on the network graphics library drawing protocol and calling the augmented reality interface to display the three-dimensional model The second posture, so that the three-dimensional model is switched from the first posture to the second posture.

For example, in the method provided by an embodiment of the present disclosure, based on the network graphics library drawing protocol and calling the augmented reality interface, displaying the second posture of the three-dimensional model corresponding to the adjustment operation includes: calling the The augmented reality interface processes the posture data of the three-dimensional model to adjust the size, display angle, and display position of the three-dimensional model corresponding to the adjustment operation, and calls the augmented reality based on the network graphics library drawing protocol The interface displays the second posture of the three-dimensional model, so that the three-dimensional model is switched from the first posture to the second posture.

For example, in the method provided by an embodiment of the present disclosure, the display posture parameters of the three-dimensional model in the first posture are different from the display posture parameters of the three-dimensional model in the second posture, and the display posture parameters include size, At least one of display angle and placement.

For example, in the method provided by an embodiment of the present disclosure, the three-dimensional model is a three-dimensional vehicle model, and the display angle includes the external viewing angle of the three-dimensional vehicle model and/or the internal space viewing angle of the three-dimensional vehicle model, The first posture is the posture of the three-dimensional vehicle model when the display angle is the external viewing angle or the posture when the display angle is the internal space viewing angle, and the second posture is the posture of the three-dimensional vehicle model The display angle is the posture under the external viewing angle or the posture under the internal space viewing angle.

For example, in the method provided by an embodiment of the present disclosure, the three-dimensional vehicle model includes the shape of the interior space of the vehicle, the outline of the vehicle, and material information.

For example, in the method provided by an embodiment of the present disclosure, the adjustment operation is any one of the following operations performed on the three-dimensional model displayed on the first terminal: click, drag, zoom in, and zoom out .

At least one embodiment of the present disclosure further provides a first terminal for remotely displaying a three-dimensional model, including: a page loading unit configured to load the three-dimensional model in the page based on a network graphics library drawing protocol; and an augmented reality processing unit configured to Call the augmented reality interface to display the first posture of the three-dimensional model; the communication unit is configured to establish a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays synchronously with the first terminal on the page The first posture of the three-dimensional model; an obtaining unit configured to obtain operation data corresponding to the adjustment operation in response to a detected adjustment operation performed on the three-dimensional model displayed on the first terminal; switching Unit, configured to display the second posture of the three-dimensional model corresponding to the adjustment operation based on the network graphics library drawing protocol and call the augmented reality interface; The operation data is transmitted from the first terminal to the second terminal, so that the second terminal performs the adjustment synchronously on the first posture of the three-dimensional model displayed by the second terminal based on the operation data Operation, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation.

At least one embodiment of the present disclosure further provides an electronic device, including: a processor; a memory, including one or more computer program modules; wherein the one or more computer program modules are stored in the memory and configured To be executed by the processor, the one or more computer program modules include instructions for implementing the method for remotely displaying a three-dimensional model according to any embodiment of the present disclosure.

At least one embodiment of the present disclosure further provides a storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the three-dimensional Model remote display method.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the drawings of the embodiments. Obviously, the drawings in the following description only refer to some embodiments of the present disclosure, rather than limiting the present disclosure. .

FIG. 1 is a schematic flowchart of a method for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure;

2 is a schematic diagram of screen sharing between a first terminal and a second terminal according to at least one embodiment of the present disclosure;

FIG. 3 is a schematic flowchart of step S120 of the remote display method for a three-dimensional model shown in FIG. 1;

FIG. 4 is another schematic flowchart of step S120 of the method for remotely displaying a three-dimensional model shown in FIG. 1;

5 is a schematic diagram of still another flow chart of step S120 of the remote display method for a three-dimensional model shown in FIG. 1;

6A is one of the display effect diagrams of a method for remote display of a three-dimensional model provided by at least one embodiment of the present disclosure;

6B is the second display effect diagram of a method for remote display of a three-dimensional model provided by at least one embodiment of the present disclosure;

6C is the third display effect diagram of a method for remote display of a three-dimensional model provided by at least one embodiment of the present disclosure;

6D is the fourth display effect diagram of a method for remote display of a three-dimensional model provided by at least one embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a system that can be used to implement the remote display method of a three-dimensional model provided by an embodiment of the present disclosure;

FIG. 8 is a schematic block diagram of a first terminal for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure;

FIG. 9 is a schematic diagram of the remote display application provided by at least one embodiment of the present disclosure;

FIG. 10 is a schematic block diagram of an electronic device provided by at least one embodiment of the present disclosure;

FIG. 11 is a schematic block diagram of another electronic device provided by at least one embodiment of the present disclosure; and

FIG. 12 is a schematic diagram of a storage medium provided by at least one embodiment of the present disclosure.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be described clearly and completely in conjunction with the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative labor are within the protection scope of the present disclosure.

Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity, or importance, but are only used to distinguish different components. Likewise, similar words such as "a", "one" or "the" do not mean a quantity limit, but mean that there is at least one. "Include" or "include" and other similar words mean that the element or item appearing before the word covers the elements or items listed after the word and their equivalents, but does not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", etc. are only used to indicate the relative position relationship. When the absolute position of the described object changes, the relative position relationship may also change accordingly.

Under normal circumstances, when a buyer sees a car through the Internet, he can obtain vehicle photos from multiple angles through web pages or software. These vehicle photos are 2D pictures, which are difficult to reflect the real situation of the vehicle. With the advancement of technology, 3D car viewing came into being. In the application scenario of car viewing in 3D, the buyer can view the three-dimensional model of the vehicle on the software, so that it can intuitively understand the condition of the vehicle. However, this requires users to install corresponding software on the terminal device, which occupies the hardware resources of the terminal device and is not convenient enough to use. Moreover, the presentation of the three-dimensional model of the vehicle is relatively abrupt, lacks realism, and has a poor user experience.

Based on flat display or based on virtual reality (Virtual Reality, VR) or augmented reality (Augmented Reality, AR) display technology, remote display of vehicle photos or vehicle models can be realized. In the process of remote display, it is necessary to synchronize the display between the two terminals, or it can be called screen sharing. Screen sharing can be understood as keeping the content displayed on the screens of different terminals consistent between different terminals in real time. For example, in the state of screen sharing, after the first user corresponding to the first terminal performs a drag operation such as a drag operation on the displayed vehicle photo or vehicle model on the first screen of the first terminal, the second terminal will also perform the drag operation. The mobile operation enables the content displayed on the second screen of the second terminal to be synchronized with the first screen.

In the method of realizing screen sharing, based on Web Real-Time Communication (WebRTC) technology, the image currently displayed on the first screen can be obtained by screen interception, and then the intercepted image is transmitted to the second terminal , So that the content displayed on the first screen is synchronously displayed on the second screen of the second terminal. For example, the screen can be captured at a rate of 30 frames and 45 frames per second, and the captured images can be transmitted to the second terminal one by one. However, this screen capture method will take up a lot of equipment resources to store and transmit the captured images, which will cause a lot of equipment resources to be occupied, reduce the performance of the equipment, and even cause display freezes and heat generation. A large amount of image data transmission will also cause a display delay problem, that is, there is a time difference between the content displayed by the two terminals, which is especially obvious on mobile terminals with lower performance. In addition, in order to reduce the amount of data occupied by the transmitted image, the intercepted image may be compressed to reduce the resolution, which causes the image displayed by the second terminal to be unclear and reduces the user experience.

At least one embodiment of the present disclosure provides a method for remotely displaying a three-dimensional model, a first terminal for remotely displaying a three-dimensional model, an electronic device, and a storage medium. The 3D model remote display method can display 3D models (such as 3D vehicle models) on pages (such as webpages) without installing native applications. It is convenient to use, can realize the integration of 3D vehicle models and real scenes, and can provide more realistic online The way to watch the car, and improve the interactivity and playability of watching the car online. Moreover, the 3D model remote display method can realize screen sharing between terminals, reduce the amount of data transmitted, can avoid occupying a large amount of equipment resources, avoid display jams, equipment heating, etc., can solve the display delay problem, and ensure The resolution of the image displayed by each terminal improves the user experience.

Hereinafter, embodiments of the present disclosure will be explained in detail with reference to the drawings. It should be noted that the same reference numerals in different drawings will be used to refer to the same elements that have been described.

At least one embodiment of the present disclosure provides a method for remotely displaying a three-dimensional model, which is applied to a first terminal. The method includes: loading a three-dimensional model on the page based on the network graphics library drawing protocol; calling the augmented reality interface to display the first posture of the three-dimensional model; establishing a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal is on the page In synchronizing with the first terminal, the first posture of the three-dimensional model is displayed; in response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal, the operation data corresponding to the adjustment operation is obtained; and based on the network graphics library drawing protocol and Call the augmented reality interface to display the second posture of the three-dimensional model corresponding to the adjustment operation; transmit the operating data from the first terminal to the second terminal through the transmission channel group, so that the second terminal displays the three-dimensional model to the second terminal based on the operating data The first posture of the model performs the adjustment operation synchronously, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation.

FIG. 1 is a schematic flowchart of a method for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure.

For example, the remote display method of the three-dimensional model is applied to a first terminal, and the first terminal includes any electronic device with computing function, such as a mobile phone, a laptop, a tablet, a desktop computer, a server, etc. The embodiments of the present disclosure are suitable for This is not limited. For example, the first terminal has a central processing unit (Central Processing Unit, CPU) or a graphics processing unit (Graphics Processing Unit, GPU), and also includes a memory. The memory is, for example, a non-volatile memory (for example, Read Only Memory (ROM)), and the code of the operating system is stored thereon. For example, the memory also stores codes or instructions, and by running these codes or instructions, the remote display method of the three-dimensional model provided by the embodiments of the present disclosure can be realized. For example, the first terminal may also include a display component, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a quantum dot light emitting diode (Quantum Dot Light). Emitting Diode (QLED) display screens, projection components, VR head-mounted display devices (for example, VR helmets, VR glasses), AR display devices, etc., which are not limited in the embodiments of the present disclosure. The remote display method of the three-dimensional model provided by the embodiment of the present disclosure may use the display part of the first terminal to display corresponding content to display the three-dimensional model.

For example, the first terminal may implement screen sharing with the second terminal by executing the method for remote display of the three-dimensional model. Here, the first terminal and the second terminal are only used to distinguish two terminals, and do not indicate any order, quantity, or importance. Similarly, the second terminal can also implement screen sharing with the first terminal by executing the three-dimensional model remote display method, which is not limited in the embodiment of the present disclosure.

As shown in FIG. 1, in at least one embodiment, the method includes the following operations.

Step S110: Load the 3D model on the page based on the drawing protocol of the network graphics library;

Step S120: Call the augmented reality interface to display the first posture of the three-dimensional model;

Step S130: Establish a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal on the page;

Step S140: In response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal, obtain operation data corresponding to the adjustment operation;

Step S150: Based on the network graphics library drawing protocol and calling the augmented reality interface, the second posture of the three-dimensional model corresponding to the adjustment operation is displayed;

Step S160: The operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal synchronously performs an adjustment operation on the first posture of the three-dimensional model displayed by the second terminal based on the operation data, so that the second terminal The second posture of the three-dimensional model corresponding to the adjustment operation is displayed.

For example, in step S110, the network graphics library drawing protocol may be WebGL (Web Graphics Library). WebGL is a 3D drawing protocol that combines JavaScript and open graphics libraries (such as OpenGL). OpenGL can provide a graphics program interface for rendering 2D and 3D vector graphics. For example, a common page (such as a web page) is constructed using HTML standards, and a canvas of HTML (Canvas) uses JavaScript to draw images on the page. In WebGL technology, by adding a JavaScript binding of OpenGL (for example, OpenGL ES 2.0), hardware 3D accelerated rendering can be provided for HTML Canvas. Therefore, the developer of the page can smoothly display the three-dimensional model on the page with the help of the graphics card of the terminal device that displays the page. Based on WebGL, graphics can be rendered using the hardware acceleration at the bottom of the terminal device, so that a three-dimensional model can be displayed on the page without the support of a browser plug-in, and it has an efficient graphics rendering speed.

It should be noted that in the embodiments of the present disclosure, the network graphics library drawing protocol is not limited to WebGL, and may also be other applicable protocols for drawing 3D models on the page, which may be determined according to actual needs. The embodiment does not limit this.

For example, the page includes a browser page or an application page.

For example, a browser page is a page accessed through a browser, that is, a normal web page. The user can use any browser to access this page. The browser may be, for example, an Internet Explorer browser, a Firefox browser, a Safari browser, a 360 browser, a Sogou browser, etc., which are not limited in the embodiments of the present disclosure.

For example, an application page is a page accessed through a page view. The page view is, for example, a WebView, which is a control used to display a page in Android (Andriod). The user can use the page view controls in the application to access the page when using the application without using a browser. Common applications (such as "WeChat", "58.com", etc.) have page view controls, so that pages can be accessed within the application. It should be noted that the page view is not limited to WebView, and can also be a control used to access pages in an application in the IOS system, Windows Phone system, or any other system. This can be determined according to actual needs. This is not limited.

It should be noted that the browser page and the application page are essentially the same, and both contain HTML tags and adopt the Hypertext Markup Language format, but the access tools used by the two are different. Of course, the embodiments of the present disclosure are not limited to this, and the page may also include pages accessed in other ways, which may be determined according to actual needs.

For example, the three-dimensional model may be a three-dimensional vehicle model, which includes the shape of the interior space of the vehicle, vehicle outline, material information, and the like. For example, a three-dimensional vehicle model can be obtained by modeling based on Azure Kinect DK or based on a deep binocular camera according to the actual vehicle. The three-dimensional vehicle model can better reflect the actual vehicle situation and has a strong sense of reality. For example, the size ratio of the three-dimensional vehicle model to the actual vehicle is 1:N, and N is an integer greater than 1. The shape and contour of the internal space of the three-dimensional vehicle model are the same as the shape and contour of the internal space of the actual vehicle, and the material (for example, color, texture, etc.) of the three-dimensional vehicle model is the same as the visual effect of the actual vehicle. As a result, the user can obtain the same intuitive experience as viewing the actual vehicle by viewing the three-dimensional vehicle model.

It should be noted that in the embodiments of the present disclosure, the three-dimensional model is not limited to the three-dimensional vehicle model, but can also be any other object model, such as a three-dimensional room model, a three-dimensional furniture model, a three-dimensional household appliance model, etc., which can be based on actual needs. Certainly, the embodiments of the present disclosure do not limit this.

For example, in step S120, the augmented reality (AR) interface includes an ARcore development interface in JavaScript form or an ARKit development interface in JavaScript form. ARcore is a software development platform launched by Google to build augmented reality applications. It can be used to develop augmented reality applications on the Android platform or add augmented reality functions to Android applications. ARKit is a software development platform launched by Apple to build augmented reality applications. It can be used to develop augmented reality applications on the IOS platform or add augmented reality functions to IOS applications. Augmented reality technology can ingeniously integrate virtual information with the real world, so that the virtual information and the real world can complement each other, thereby realizing the "enhancement" of the real world. For the detailed description of ARcore and ARKit, please refer to the conventional design, which will not be detailed here. It should be noted that since the 3D model is loaded into the page based on WebGL, the augmented reality interface needs to be in the form of JavaScript in order to be called on the page.

It should be noted that in the embodiments of the present disclosure, the augmented reality interface is not limited to the type described above, and may also be other applicable augmented reality development interfaces, which may be determined according to the type of operating system. This is not limited.

For example, in step S130, a transmission channel group is established with the second terminal based on Real-Time Communication (RTC) technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal on the page. For example, the three-dimensional model is a three-dimensional vehicle model, the first posture can be a display posture of the three-dimensional vehicle model at any viewing angle, and the first posture can display the shape or internal space of the three-dimensional vehicle model.

For example, the first terminal may obtain the parameters of the first terminal and the parameters of the second terminal, and establish a transmission channel group based on the parameters of the first terminal and the parameters of the second terminal, thereby establishing a transmission channel with the second terminal based on real-time audio and video technology Group. The parameters of the first terminal may include the IP (Internet Protocol) address of the first terminal (for example, network IP address), the device identification corresponding to the first terminal (for example, the ID of a mobile phone, etc.), time and other information, and the parameters of the second terminal It may include information such as the IP address of the second terminal, the device identifier corresponding to the second terminal, and time. For example, the first terminal and the second terminal may be various mobile terminals, fixed terminals, etc., the mobile terminal may be a mobile phone, a tablet computer, etc., and the fixed terminal may be a desktop computer, etc. The first terminal and the second terminal may be devices of the same type or different types. For example, the first terminal and the second terminal may also include an application (App) of the mobile terminal. The application program can be, for example, "58 Same City" and so on.

As an example, the transmission channel group may implement data transmission through a wired network and/or a wireless network. Wired networks, for example, can use twisted pair, coaxial cable, or optical fiber transmission for data transmission, and wireless networks can, for example, use 3G/4G/5G mobile communication networks, Bluetooth, Zigbee, or WiFi for data transmission. For example, the transmission channel group is established based on real-time audio and video technology, so that the transmission channel group has a small delay when transmitting data, thereby meeting the needs of real-time data interaction.

For example, when a transmission channel group is established between the first terminal and the second terminal based on real-time audio and video technology, the first terminal and the second terminal can implement real-time data transmission through the transmission channel group. For example, the data may be operation data described below.

As an example, FIG. 2 is a schematic diagram of screen sharing between a first terminal and a second terminal according to at least one embodiment of the present disclosure. As shown in FIG. 2, the first posture of the three-dimensional model is displayed on the first screen 2011 of the first terminal 201. The first terminal 201 and the second terminal 202 have a transmission channel group established based on real-time audio and video technology for real-time data transmission. The second screen 2021 of the second terminal 202 synchronously displays the first posture of the three-dimensional model. That is, the size, display angle, display position and other parameters of the three-dimensional model displayed on the first screen 2011 and the second screen 2021 are the same. The visual perception of the three-dimensional model displayed on the screen 2021 is the same or substantially the same. For example, the first terminal 201 and the second terminal 202 are located in different locations, thereby realizing remote screen sharing.

For example, as shown in FIG. 1, in step S140, in response to a detected adjustment operation performed on the three-dimensional model displayed on the first terminal, operation data corresponding to the adjustment operation is acquired. For example, the first user corresponding to the first terminal may perform a screen operation on the first screen of the first terminal, that is, the aforementioned adjustment operation, to change the screen displayed on the first screen. The adjustment operation may be any one of the following operations performed on the three-dimensional model displayed on the first terminal: click, drag, zoom in, and zoom out. For example, the first user corresponding to the first terminal can use the mouse or directly operate on the touch screen to click and drag the three-dimensional model, or perform operations such as zooming in or zooming out the three-dimensional model, thereby changing the display posture of the three-dimensional model to make the first What is displayed on the screen is no longer the first posture of the three-dimensional model. It should be noted that in the embodiment of the present disclosure, the adjustment operation may be any applicable operation performed on the three-dimensional model displayed on the first terminal, and the embodiment of the present disclosure does not limit this.

For example, as shown in FIG. 1, in step S150, based on the network graphics library drawing protocol and calling the augmented reality interface, the second posture of the three-dimensional model corresponding to the adjustment operation is displayed. Thus, the three-dimensional model displayed by the first terminal is switched from the first posture to the second posture.

For example, the display posture parameters of the three-dimensional model in the first posture are different from the display posture parameters of the three-dimensional model in the second posture, and the display posture parameters include at least one of size (for example, size), display angle, and display position. For example, any one, two or three parameters of the size, display angle, and display position of the three-dimensional model in the first posture are different from the corresponding parameters in the second posture, so that the user can obtain different viewing experience. The detailed description of the placement will be described below, so I won’t repeat it here.

For example, the three-dimensional model is a three-dimensional vehicle model, and the above-mentioned display angle includes the external view angle of the three-dimensional vehicle model and/or the internal space view angle of the three-dimensional vehicle model. The first posture can be the posture of the three-dimensional vehicle model when the display angle is the external viewing angle or the posture when the display angle is the internal space viewing angle, and the second posture can be the posture of the three-dimensional vehicle model when the display angle is the external viewing angle or The display angle is the posture under the viewing angle of the internal space.

When the three-dimensional vehicle model displayed by the first terminal is switched from the first posture to the second posture, the three-dimensional vehicle model may only have a change in the appearance viewing angle (that is, switching from one appearance viewing angle to another appearance viewing angle), and It can only change the viewing angle of the internal space (that is, switch from one internal space viewing angle to another internal space viewing angle), and can also switch from the external viewing angle to the internal space viewing angle or from the internal space viewing angle to the external viewing angle angle. As a result, the first user corresponding to the first terminal can view the shape and internal space of the three-dimensional vehicle model, and can switch the display angle at will.

For example, in one example, the size, display angle, and display position of the 3D model can be adjusted corresponding to the adjustment operation based on the network graphics library drawing protocol, and the second part of the 3D model can be displayed based on the network graphics library drawing protocol and calling the augmented reality interface. Posture, so that the three-dimensional model is switched from the first posture to the second posture. In this example, the adjustment of the three-dimensional model is done through the network graphics library drawing protocol. For example, based on WebGL, the size, display angle, and display position of the 3D model can be adjusted to provide a better user experience. For example, the user can use the mouse or directly use the finger to operate on the touch screen, so that the three-dimensional model can be dragged, zoomed, rotated, and the shape and internal space are switched.

For example, in another example, the augmented reality interface can be called to process the posture data of the 3D model to adjust the size, display angle and display position of the 3D model corresponding to the adjustment operation, based on the network graphics library drawing protocol and call the augmented reality interface The second posture of the three-dimensional model is displayed, so that the three-dimensional model is switched from the first posture to the second posture. In this example, the adjustment of the three-dimensional model is completed by calling the augmented reality interface. For example, the pose estimation function provided by the augmented reality interface can be used to process the pose data by calling the augmented reality interface, and then adjust the size, display angle, and display position of the 3D model according to the processing result, thereby providing a better user experience.

For example, the remote display method for a three-dimensional model provided by an embodiment of the present disclosure runs in a first terminal by running code. The first terminal may be a mobile terminal, such as a mobile phone, a tablet computer, etc., and the posture data is the posture data of the mobile terminal. . For example, the user can hold the mobile terminal and change the posture of the mobile terminal, and process the posture data by calling the augmented reality interface, so that the size, display angle, and display position of the three-dimensional model can be adjusted according to the processing result. This approach can simplify user operations, improve interactivity, and improve user experience. For the description of the posture estimation function in the augmented reality technology, please refer to the conventional design, which will not be detailed here.

For example, the specific method for displaying the second posture of the three-dimensional model based on the network graphics library drawing protocol and calling the augmented reality interface can refer to the method for displaying the first posture of the three-dimensional model by using step S110 and step S120, which will not be described in detail here.

After detecting the adjustment operation, the first terminal may obtain operation data corresponding to the adjustment operation. After performing the adjustment operation, the first terminal will display the second posture of the three-dimensional model corresponding to the adjustment operation. That is, the adjustment operation is used to change the three-dimensional model displayed on the first screen from the first posture to the second posture. The specific process of obtaining operation data will be described in detail below.

For example, as shown in FIG. 1, in step S160, the operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal displays the first posture of the three-dimensional model of the second terminal based on the operation data. The adjustment operation is performed synchronously, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation. For example, after the second terminal receives the operation data transmitted through the transmission channel group, the second terminal may perform an adjustment operation synchronously on the first posture of the three-dimensional model displayed by the second terminal based on the operation data, so that the second terminal is synchronized Show the second pose of the 3D model.

For example, in some examples, when the first user corresponding to the first terminal performs a zoom-in operation on the three-dimensional model displayed on the first screen, the operation data corresponding to the zoom-in operation is transmitted to the second terminal, and the second terminal is based on the zoom-in operation. The operating data also simultaneously performs an enlargement operation on the three-dimensional model displayed on the second screen, so that the first terminal and the second terminal realize screen sharing, so that both the first terminal and the second terminal display the enlarged three-dimensional model. When the first user performs other operations on the three-dimensional model displayed on the first screen, the working modes of the first terminal and the second terminal are similar to the above-mentioned modes, and so on.

In the remote display method for a three-dimensional model provided by an embodiment of the present disclosure, the first user corresponds to the first terminal, and the second user corresponds to the second terminal. The first user and the second user can be located in different locations, and the first user and the second user can remotely watch the three-dimensional model and switch the posture of the three-dimensional model. In the process of remote display, the first user and the second user can watch the images of the same posture of the three-dimensional model at the same time, that is, realize screen sharing. For example, when the three-dimensional model is a three-dimensional vehicle model, if the first posture displayed by the first terminal corresponds to the main view of the three-dimensional vehicle model outline, the first posture displayed by the second terminal also corresponds to the main view of the three-dimensional vehicle model outline. View screen, and the size, display angle, and display position of the three-dimensional vehicle model viewed by the first user and the second user are the same, so that the first user corresponding to the first terminal and the second user corresponding to the second terminal can view The same image of the three-dimensional vehicle model.

After the transmission channel group is established, the first terminal and the second terminal may obtain images corresponding to the same three-dimensional model in the same posture, for example, images corresponding to the same three-dimensional vehicle model. For example, the first terminal may first determine the identification of the three-dimensional model to be displayed, such as vehicle identification, serial number and other information, and then send the identification of the three-dimensional model to the second terminal through the transmission channel group, so that the second terminal can also access and display the Three-dimensional model.

It should be noted that when the first terminal and the second terminal initially display the initial posture of the three-dimensional model, there may be cases where the initial screen displayed by the first terminal and the initial screen displayed by the second terminal are different. In this case, it is necessary to synchronize the initial screen displayed by the first terminal and the initial screen displayed by the second terminal, so that the screen displayed by the first terminal and the screen displayed by the second terminal are the same.

FIG. 3 is a schematic flowchart of step S120 of the method for remotely displaying a three-dimensional model shown in FIG. 1. For example, as shown in FIG. 3, in at least one embodiment, step S120 in FIG. 1 may further include the following operations.

Step S121: Obtain an image;

Step S122: Call the augmented reality interface to perform plane recognition on the image to identify the display plane in the image;

Step S123: Call the augmented reality interface to display the first posture of the three-dimensional model on the display plane.

For example, in step S121, the acquired image is an image of a real scene. For example, in some examples, the first terminal that implements the method for remotely displaying the three-dimensional model has a camera, and the camera can be used to capture images of the real scene. For example, the image may be a video displayed in real time, or a picture (ie, a photo), which is not limited in the embodiments of the present disclosure. For example, in some other examples, an image may be obtained through the network, and the image is an image that is captured in advance, reflects a real scene, and is stored on the network. For example, a certain image can be selected from a plurality of images and acquired, and the scenes reflected by the plurality of images are different from each other. It should be noted that, in the embodiments of the present disclosure, the method of acquiring images is not limited to the above-described method, and any applicable method may also be used, which may be determined according to actual needs, and the embodiment of the present disclosure does not limit this.

For example, in step S122, an augmented reality interface (such as the aforementioned ARcore development interface in JavaScript form or ARKit development interface in JavaScript form) is called to perform plane recognition on the image. For example, there may be one or more planes in the image, such as the ground, the desktop, and so on. When there is only one plane in the image, this plane is determined as the display plane. When there are multiple planes in the image, one of the multiple planes can be determined as the display plane according to a preset rule. For example, in some examples, a larger plane may be determined as the display plane according to the relative sizes of multiple planes. For example, in other examples, after multiple planes are identified, the user can select one of the multiple planes as the display plane.

It should be noted that the foregoing preset rule is not limited to the two methods described above, and can be any method, which may be determined according to actual needs, and the embodiment of the present disclosure does not limit this. For example, according to the characteristics of the real scene, there may be no plane in the above image, that is, the display plane cannot be obtained. In this case, the user may be prompted that the display plane cannot be recognized and the image needs to be reacquired.

For example, the plane recognition can be realized by a triangulation algorithm, or by other applicable algorithms, which is not limited in the embodiments of the present disclosure. For the detailed description of the plane recognition and triangulation algorithm in the augmented reality technology, please refer to the conventional design, which will not be detailed here.

For example, in step S123, the augmented reality interface is called to display the first posture of the three-dimensional model on the display plane, that is, the first posture of the three-dimensional model is displayed on the display plane. For example, the first terminal not only displays the acquired image, but also displays the first posture of the three-dimensional model on the display plane in the image, thereby realizing the fusion of the three-dimensional model and the real scene, and achieving the purpose of displaying the three-dimensional model.

It should be noted that when the first posture of the three-dimensional model is switched to the second posture, the second posture of the three-dimensional model can be displayed on the previously determined display plane for displaying the first posture, without the need to display the plane again. Recognition. Of course, the embodiments of the present disclosure are not limited to this. In other examples, when the first posture of the three-dimensional model is switched to the second posture, the image can be re-acquired and the display plane can be recognized, which can be determined according to actual needs. The embodiment of the present disclosure does not limit this.

FIG. 4 is another schematic flowchart of step S120 of the method for remotely displaying a three-dimensional model shown in FIG. 1. For example, as shown in FIG. 4, in at least one embodiment, step S120 in FIG. 1 may further include the following operations.

Step S121: Obtain an image;

Step S124: prompt the user to click on the display plane;

Step S125: Receive a click instruction from the user to determine the click position;

Step S123a: Call the augmented reality interface to display the first posture of the three-dimensional model at the click position on the display plane.

Step S121 and step S122 in this embodiment are basically the same as step S121 and step S122 shown in FIG.

For example, in step S124, after the display plane is identified, the user is prompted to click on the display plane. For example, the user may be prompted through a pop-up text box, the user may also be prompted through a voice broadcast, or the user may be prompted through other applicable methods, which are not limited in the embodiments of the present disclosure. For example, the display plane can be marked in the displayed image to facilitate the user to click. For example, a wire frame may be used to mark the display plane, or the display plane may be displayed in a highlight coloring manner, or the display plane may be marked in other applicable manners, which is not limited in the embodiments of the present disclosure.

For example, in step S125, a click instruction from the user is received to determine the click position, and the user can click any position on the display plane. For example, the method for remotely displaying a three-dimensional model provided in this embodiment runs in a first terminal by running code, and the first terminal includes an input device, such as a mouse or a touch screen. The user can directly click the position on the touch screen with a finger, or click the position on the screen with a mouse, and the first terminal receives the click instruction, so that the click position can be determined. For example, when the user clicks on any position on the display plane, the received click instruction is valid, so that subsequent operations can be performed. When the user clicks on a position outside the display plane, the received click instruction is invalid, and the user is prompted to click again.

For example, in this embodiment, step S123 shown in FIG. 3 may be implemented as step S123a shown in FIG. 4. For example, in step S123a, after the click position is determined, the augmented reality interface is called to display the first posture of the three-dimensional model at the click position on the display plane. For example, the three-dimensional model can be displayed according to a preset display scale and the three-dimensional model can be in the first posture, and the center of the three-dimensional model can be located at the click position on the display plane, so that the three-dimensional model can be displayed at the click position on the display plane. For example, the preset display ratio can be determined according to actual needs. For example, the size ratio of the three-dimensional model and the display plane can be 1:1 or 1:2 to achieve a better display effect. Of course, the embodiment of the present disclosure is not limited to this, the preset display ratio can be any numerical value, and the preset display ratio can also be changed and reconfigured by the user, which is not limited by the embodiment of the present disclosure.

It should be noted that in the embodiment of the present disclosure, step S124 and step S125 can also be omitted, that is, when the display plane is recognized, the user is no longer prompted to click the display plane. At this time, step S123a is changed to the default, for example. The first pose of the three-dimensional model is displayed at the center of the display plane.

FIG. 5 is a schematic diagram of still another flow chart of step S120 of the method for remotely displaying a three-dimensional model shown in FIG. 1. For example, as shown in FIG. 5, in at least one embodiment, step S120 in FIG. 1 may further include the following operations.

Step S121: Obtain an image;

Step S123: Call the augmented reality interface to display the first posture of the three-dimensional model on the display plane;

Step S126: Call the augmented reality interface to process the ambient light data, and adjust the display effect parameters of the first posture of the three-dimensional model.

Steps S121-S123 in this embodiment are basically the same as steps S121-S123 shown in FIG.

For example, in step S126, the ambient light data is ambient light data in a real scene, such as parameters such as light intensity and light direction. For example, in some examples, the first terminal that implements the method for remotely displaying the three-dimensional model includes a light sensor, and the ambient light data can be acquired by using the light sensor. For example, in other examples, the ambient light data is acquired by processing and analyzing the acquired image of the real scene. Of course, the embodiments of the present disclosure are not limited to this, and the ambient light data can be acquired in any applicable manner.

For example, use the ambient light estimation function provided by the augmented reality interface, process the ambient light data by calling the augmented reality interface, and then adjust the display effect parameters of the first posture of the 3D model according to the processing result, so that the 3D model is consistent with the real scene Illumination effect, so that the 3D model can be seamlessly integrated into the real scene, which can improve the realism of the display effect. For example, the display effect parameters include shadow, color saturation, white balance, etc., and may also include other applicable parameters, which are not limited in the embodiments of the present disclosure. Regarding the description of the ambient light estimation function in the augmented reality technology, please refer to the conventional design, which will not be detailed here.

It should be noted that when displaying the second posture of the three-dimensional model, the display can be performed in a manner similar to that of displaying the first posture of the three-dimensional model, which will not be repeated here.

In at least one embodiment of the present disclosure, in response to a detected adjustment operation performed on the three-dimensional model displayed on the first terminal, obtaining operation data corresponding to the adjustment operation includes: responding to the detected adjustment operation performed on the first terminal The adjustment operation performed by the three-dimensional model shown above uses the first page monitoring tool configured in the first terminal to monitor the adjustment operation to obtain operation data based on the first page monitoring tool. After obtaining the operating data, the first terminal transmits the operating data based on the first page monitoring tool from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the second terminal configured in the second terminal according to the operating data. The status of the page monitoring tool, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation. For example, the first page monitoring tool and the second page monitoring tool are the same type of page monitoring tools.

As an example, a script (such as JavaScript) is used to draw an image on the Canvas canvas, so that the image can be drawn on the page. For example, the first page monitoring tool may be a Canvas canvas including a script, so that adjustment operations can be monitored. After listening to the adjustment operation, the Canvas canvas will obtain the operation data corresponding to the adjustment operation, and draw the image based on the obtained operation data. For example, after the first user performs a zoom-in operation on the three-dimensional model displayed on the first screen, the Canvas canvas can monitor the zoom-in operation, and obtain the operation data corresponding to the zoom-in operation, such as the magnification ratio, and perform the operation data based on the operation data. Graphical drawing is performed to display the second posture obtained by enlarging the first posture of the three-dimensional model according to the magnification ratio.

Then, the first terminal may send the operation data obtained by the Canvas canvas to the second terminal in real time through the transmission channel group. After the second terminal receives the operation data sent by the first terminal, it provides the received operation data to the Canvas canvas configured in the second terminal, so that the Canvas canvas of the second terminal draws graphics based on the operation data, for example , Perform the corresponding zooming operation, so as to realize the synchronous display of the second posture of the three-dimensional model on the second screen.

In other examples, the first user and the second user can also communicate information while sharing the screen, for example, transmitting voice data through the transmission channel group, so as to transmit information more timely and feedback information more accurately, which can improve the product Experience, enhance product performance, and increase the fun of remote display of 3D models.

Using the remote display method of a three-dimensional model provided by the embodiments of the present disclosure, a three-dimensional model (such as a three-dimensional vehicle model) can be displayed on a page (such as a web page) without installing a native application program, which is convenient to use. In addition, the integration of the three-dimensional vehicle model and the real scene can be realized, a more realistic way of watching a car online can be provided, and the interaction and playability of watching a car online can be improved, and the user experience can be effectively improved. By establishing a transmission channel group to transmit operating data in real time, the first terminal and the second terminal can perform synchronous display based on the operating data transmitted in real time, that is, the screen sharing between the first terminal and the second terminal is realized, and both Synchronous display of the screens of two terminals. In this way, the amount of transmitted data can be effectively reduced, avoid occupying a large amount of equipment resources, and avoid phenomena such as display freezes and equipment heating. In addition, on the basis of reducing the amount of data transmission, the display delay problem caused by the transmission of a large amount of image data can also be avoided, which is more conducive to real-time screen sharing and narrowing the time difference between the two terminals to display content. Further, since the screen sharing is realized based on the same operation performed by the page monitoring tools configured in the first terminal and the second terminal, the resolution of the images displayed by the two terminals can be guaranteed, which improves the user experience and makes the remote The display is more convenient.

It should be noted that, in the embodiments of the present disclosure, the execution order of the steps of the three-dimensional model remote display method is not limited. Although the execution process of the steps is described in a specific order above, this does not constitute a reference to the embodiments of the present disclosure. limits. The steps in the remote display method of the three-dimensional model can be executed serially or in parallel, which can be determined according to actual needs. The remote display method of the three-dimensional model may further include more or fewer steps, which are not limited in the embodiment of the present disclosure.

FIG. 6A is one of the display effect diagrams of a method for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure, and FIG. 6B is the second display effect diagram of a method for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure.

As shown in FIG. 6A, the remote display method for a three-dimensional model provided by an embodiment of the present disclosure runs in the first terminal by running code, and there is a round table 310 in the real scene. The first user accesses a page (for example, a web page) through a browser installed on the first terminal, or accesses a page through a WebView control in an application program installed on the first terminal. Then, an image of the real scene is captured by the camera of the first terminal and displayed on the page, so that the image displayed on the page includes the round table 310. By calling the augmented reality interface to recognize the plane of the image, the desktop 311 is identified, and the desktop 311 is the aforementioned display plane.

Next, the first user is prompted to click on the desktop 311 displayed on the page. For example, the first user clicks on the center of the desktop 311 under the prompt. After receiving the click instruction of the first user, based on WebGL and calling the augmented reality interface, the three-dimensional vehicle model 320 is displayed at the center of the desktop 311 displayed on the page. At this time, the first posture of the three-dimensional vehicle model 320 is displayed. Based on real-time audio and video technology, the first terminal and the second terminal establish a transmission channel group, so that the second terminal displays the first posture of the three-dimensional vehicle model 320 synchronously with the first terminal on the page. At this time, the screens displayed on the page of the first terminal and the page of the second terminal are both the screens shown in FIG. 6A.

Then, the first user performs a rotation operation and a reduction operation on the three-dimensional vehicle model 320 displayed on the first terminal, and the first page monitoring tool configured in the first terminal monitors these operations to obtain operation data. For example, the rotation operation is used to change the display angle of the three-dimensional vehicle model 320, and the reduction operation is used to reduce the size of the three-dimensional vehicle model 320. In response to the operation data, the first terminal displays the second posture of the three-dimensional vehicle model 320 corresponding to these operations. For example, the second posture is as shown in FIG. 6B. Compared with the screen shown in FIG. 6A, the size and display angle of the three-dimensional vehicle model 320 in the screen shown in FIG. 6B have changed.

Then, the first terminal transmits the operation data to the second terminal through the transmission channel group. After receiving the operation data, the second terminal synchronously performs a rotation operation and a reduction operation on the three-dimensional vehicle model 320 displayed by the second terminal based on the operation data, so that the second terminal displays the second posture of the three-dimensional vehicle model 320. At this time, the screens displayed on the page of the first terminal and the page of the second terminal are both the screens shown in FIG. 6B.

Thus, through operations such as dragging, zooming, rotating, shape and internal space switching of the three-dimensional vehicle model 320 by the first user, the three-dimensional vehicle model 320 can be displayed simultaneously on the page of the first terminal and the page of the second terminal. Different postures, thus providing a better viewing experience.

FIG. 6C is the third display effect diagram of a method for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure. As shown in FIG. 6C, the remote display method for a three-dimensional model provided by an embodiment of the present disclosure runs in the first terminal by running code, and the real scene is a room 330. The first user accesses a page (for example, a web page) through a browser installed on the first terminal, or accesses a page through a WebView control in an application program installed on the first terminal. Then, an image of the real scene is captured by the camera of the first terminal and displayed on the page, so that the image displayed on the page includes the room 330. By calling the augmented reality interface to recognize the plane of the image, the ground 331 is identified, and the ground 331 is the aforementioned display plane.

Next, the first user is prompted to click on the ground 331 displayed on the page. For example, the first user clicks any position on the ground 331 under the prompt. After receiving the click instruction of the first user, based on WebGL and calling the augmented reality interface, the first posture of the three-dimensional vehicle model 320 is displayed at the position on the ground 331 displayed on the page. Based on real-time audio and video technology, the first terminal and the second terminal establish a transmission channel group, so that the second terminal displays the first posture of the three-dimensional vehicle model 320 synchronously with the first terminal on the page. At this time, the screens displayed on the page of the first terminal and the page of the second terminal are both the screens shown in FIG. 6C. The method for subsequently switching the posture of the three-dimensional vehicle model 320 and enabling the first terminal and the second terminal to realize synchronous display by transmitting operation data is basically the same as the example shown in FIGS. 6A-6B, and will not be repeated here.

FIG. 6D is the fourth display effect diagram of a method for remote display of a three-dimensional model provided by at least one embodiment of the present disclosure. As shown in FIG. 6D, the remote display method for a three-dimensional model provided by an embodiment of the present disclosure runs in the first terminal by running code, and there is a round table 310 in the real scene. The first user accesses a page (for example, a web page) through a browser installed on the first terminal, or accesses a page through a WebView control in an application program installed on the first terminal. Then, an image of the real scene is captured by the camera of the first terminal and displayed on the page, so that the image displayed on the page includes the round table 310. By calling the augmented reality interface to recognize the plane of the image, the desktop 311 is identified, and the desktop 311 is the aforementioned display plane.

Next, the first user is prompted to click on the desktop 311 displayed on the page. For example, the first user clicks on the center of the desktop 311 under the prompt. After receiving the click instruction of the first user, based on WebGL and calling the augmented reality interface, the three-dimensional house model 340 is displayed at the center position of the desktop 311 displayed on the page. At this time, the first posture of the three-dimensional house model 340 is displayed. Based on real-time audio and video technology, the first terminal and the second terminal establish a transmission channel group, so that the second terminal synchronously displays the first posture of the three-dimensional house model 340 on the page with the first terminal. At this time, the screens displayed on the page of the first terminal and the page of the second terminal are both the screens shown in FIG. 6D. The method for subsequently switching the posture of the three-dimensional house model 340 and enabling the first terminal and the second terminal to realize synchronous display by transmitting operation data is basically the same as the example shown in FIGS. 6A-6B, and will not be repeated here.

It should be noted that, in the embodiment of the present disclosure, the three-dimensional house model 340 may be a real estate community sand table model, a house model, or a single-room house model. For example, these three-dimensional house models can be created and saved in advance through modeling software for use when they need to be displayed. For example, the three-dimensional house model 340 may be a model showing the appearance of a house, may also be a model with an internal structure, and may also be a model that can be switched between an appearance mode and an interior mode.

For example, when the three-dimensional house model 340 is a model that can be switched between the appearance mode and the interior mode, the switching can be implemented based on a user's operation instruction. For example, when the user's operation instruction indicates the shape mode, the appearance of the three-dimensional house model 340 can be displayed, and the posture of the three-dimensional house model 340 can be adjusted, so that the user can observe the appearance of the three-dimensional house model 340 from different angles. When the user's operation instruction indicates the internal mode, the internal structure of the three-dimensional house model 340 can be displayed, that is, a certain wall or a few walls of the three-dimensional house model 340 are removed to present the internal structure, and the user can compare the three-dimensional house model 340 The posture of the three-dimensional house model 340 can be adjusted so that the user can observe the internal structure and spatial layout of the three-dimensional house model 340 from different angles.

It should be noted that in the embodiments of the present disclosure, the three-dimensional model is not limited to the three-dimensional vehicle model and the three-dimensional house model, but can also be any other applicable three-dimensional model. As long as the three-dimensional model needs to be displayed remotely, the embodiments of the present disclosure can be used. The provided method performs remote display, which is not limited in the embodiments of the present disclosure.

FIG. 7 is a schematic diagram of a system that can be used to implement the remote display method of a three-dimensional model provided by an embodiment of the present disclosure. As shown in FIG. 7, the system 400 may include a first terminal 410, a network 420, a server 430, a database 440, and a second terminal 450. For example, the system 400 can be used to implement the remote display method of a three-dimensional model provided by any embodiment of the present disclosure.

The first terminal 410 is, for example, a computer 410-1 or a mobile phone 410-2. The second terminal 450 is, for example, a computer 450-1 or a mobile phone 450-2. It is understandable that the first terminal 410 and the second terminal 450 can be any other types of electronic devices capable of performing data processing, which can include, but are not limited to, desktop computers, laptops, tablets, smart phones, smart home devices, Wearable devices, in-vehicle electronic equipment, monitoring equipment, etc. The first terminal 410 and the second terminal 450 may also be any equipment provided with electronic devices, such as vehicles, robots, and so on.

The first user may operate an application program installed on the first terminal 410. The application program transmits user behavior data to the server 430 through the network 420, and the first terminal 410 may also receive data transmitted by the server 430 through the network 420. The first user may also use a browser installed on the first terminal 410 to access a page or use a page view control of an application program to access a page, and the page uses the remote display method of a three-dimensional model provided by an embodiment of the present disclosure to display a three-dimensional model.

The network 420 may be a single network, or a combination of at least two different networks. For example, the network 420 may include, but is not limited to, one or a combination of several of a local area network, a wide area network, a public network, and a private network.

The second user may use a browser installed on the second terminal 450 to access the page or use the page view control of the application to access the page. When the first terminal 410 uses the three-dimensional model remote display method provided by the embodiments of the present disclosure to display the three-dimensional model, the operating data can be transmitted from the first terminal 410 to the second terminal 450 via the network 420, and the second terminal 450 is displayed in the page with the first terminal 450. A terminal 410 simultaneously displays the three-dimensional model.

The server 430 may be a single server or a server group, and each server in the group is connected through a wired or wireless network. A server group can be centralized, such as a data center, or distributed. The server 430 may be local or remote.

The database 440 may generally refer to a device having a storage function. The database 440 is mainly used to store various data used, generated, and output by the first terminal 410, the second terminal 450, and the server 430 in the work. For example, a large amount of three-dimensional model data is stored in the database 440, and the server 430 reads the three-dimensional model data selected by the first user from the database 440, and sends the three-dimensional model data to the first terminal 410 via the network 420. The first terminal 410 The three-dimensional model corresponding to the three-dimensional model data is displayed, and the second terminal 450 is synchronized to display the three-dimensional model remotely, so that it is convenient for the first user and the second user to browse or watch. The database 440 may be local or remote. The database 440 may include various memories, such as random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), and so on. The storage devices mentioned above are just a few examples, and the storage devices that can be used by the system 400 are not limited to these.

The database 440 may be connected or communicated with the server 430 or a part thereof via the network 420, or directly connected or communicated with the server 430, or a combination of the above two methods.

In some examples, the database 440 may be a stand-alone device. In other examples, the database 440 may also be integrated in at least one of the first terminal 410, the second terminal 450, and the server 430. For example, the database 440 may be set on the first terminal 410, on the second terminal 450, or on the server 430. For another example, the database 440 may also be distributed, a part of which is set on the first terminal 410 and the other part is set on the server 430.

At least one embodiment of the present disclosure also provides a first terminal for remotely displaying a three-dimensional model. The first terminal can display a three-dimensional model (such as a three-dimensional vehicle model) on a page (such as a web page) without installing a native application. It is convenient and can realize the integration of three-dimensional vehicle model and real scene, can provide a more realistic way of watching cars online, and improve the interactivity and playability of watching cars online. Moreover, the first terminal can realize screen sharing between terminals, reduce the amount of data transmitted, can avoid occupying a large amount of equipment resources, avoid display jams, equipment heating, etc., can solve the display delay problem, and ensure that each terminal The resolution of the displayed image improves the user experience.

FIG. 8 is a schematic block diagram of a first terminal for remotely displaying a three-dimensional model provided by at least one embodiment of the present disclosure. As shown in FIG. 8, the first terminal 500 includes a page loading unit 510, an augmented reality processing unit 520, a communication unit 530, an acquisition unit 540, a switching unit 550, and a transmission unit 560. For example, the first terminal 500 can be applied to any device or system that needs to remotely display a three-dimensional model, which is not limited in the embodiment of the present disclosure.

The page loading unit 510 is configured to load the three-dimensional model in the page based on the network graphics library drawing protocol. For example, the page loading unit 510 may execute step S110 of the method for remotely displaying a three-dimensional model as shown in FIG. 1. The augmented reality processing unit 520 is configured to call the augmented reality interface to display the first posture of the three-dimensional model. For example, the augmented reality processing unit 520 may execute step S120 of the method for remotely displaying a three-dimensional model as shown in FIG. 1. The communication unit 530 is configured to establish a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal 500 on the page. For example, the communication unit 530 may execute step S130 of the method for remotely displaying a three-dimensional model as shown in FIG. 1.

The obtaining unit 540 is configured to obtain operation data corresponding to the adjustment operation in response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal 500. For example, the acquiring unit 540 may execute step S140 of the method for remotely displaying a three-dimensional model as shown in FIG. 1. The switching unit 550 is configured to display the second posture of the three-dimensional model corresponding to the adjustment operation based on the network graphics library drawing protocol and call the augmented reality interface. For example, the switching unit 550 may execute step S150 of the method for remotely displaying a three-dimensional model as shown in FIG. 1. The transmission unit 560 is configured to transmit the operation data from the first terminal 500 to the second terminal through the transmission channel group, so that the second terminal synchronously performs an adjustment operation on the first posture of the three-dimensional model displayed by the second terminal based on the operation data, so that The second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation. For example, the transmission unit 560 may execute step S160 of the method for remotely displaying a three-dimensional model as shown in FIG. 1.

For example, the page loading unit 510 and the augmented reality processing unit 520 can be reused as the switching unit 550 as a whole, so as to not only display the first posture of the three-dimensional model, but also display the second posture of the three-dimensional model when needed, so as to improve Resource utilization.

For example, the page loading unit 510, the augmented reality processing unit 520, the communication unit 530, the acquisition unit 540, the switching unit 550, and the transmission unit 560 may be hardware, software, firmware, and any feasible combination thereof. For example, the page loading unit 510, the augmented reality processing unit 520, the communication unit 530, the acquisition unit 540, the switching unit 550, and the transmission unit 560 may be dedicated or general-purpose circuits, chips or devices, etc., or may be a combination of a processor and a memory . Regarding the specific implementation form of each of the above-mentioned units, the embodiments of the present disclosure do not limit this.

It should be noted that, in the embodiment of the present disclosure, each unit of the first terminal 500 corresponds to each step of the aforementioned three-dimensional model remote display method. For the specific functions and technical effects of the first terminal 500, please refer to About three-dimensional model remote display The description of the method will not be repeated here. The components and structure of the first terminal 500 shown in FIG. 8 are only exemplary, and not restrictive. The first terminal 500 may further include other components and structures as required.

FIG. 9 is a schematic diagram of the remote display application provided by at least one embodiment of the present disclosure. As shown in FIG. 9, the first terminal 501 may include a first screen for displaying a three-dimensional model to the first user, and the second terminal 502 may include a second screen for displaying a three-dimensional model to the second user. The first terminal 501 may be the aforementioned first terminal 500. A transmission channel group is established between the first terminal 501 and the second terminal 502, which may be, for example, a long connection channel used for real-time communication. In addition, after the transmission channel group is established, the first terminal 501 and the second terminal 502 may obtain data corresponding to the same three-dimensional model, which may be a three-dimensional vehicle model. Next, the tool unit in the first terminal 501, such as the Canvas canvas, can monitor the adjustment operation of the first user on the first screen, obtain operation data corresponding to the adjustment operation, and perform graphics on the first screen based on the operation data Draw to switch the posture of the displayed 3D vehicle model.

In addition, the voice unit in the first terminal 501, such as a microphone, can monitor the voice input of the first user and obtain voice data. Then, the first terminal 501 can use the communication unit to transmit the voice data and the operation data to the communication unit of the second terminal 502 via the established transmission channel group. The tool unit in the second terminal 502 may perform an adjustment operation based on the received operation data to switch the posture of the three-dimensional vehicle model displayed on the second screen. In addition, the voice unit in the second terminal 502 may play voice based on the received voice data. Through the process shown in FIG. 9, screen sharing between terminals can be realized, and the three-dimensional vehicle model can be simultaneously displayed in the page displayed by the first terminal 501 and the page displayed by the second terminal 502.

FIG. 10 is a schematic block diagram of an electronic device provided by at least one embodiment of the present disclosure. As shown in FIG. 10, the electronic device 600 includes a processor 610 and a memory 620. The memory 620 is used to store non-transitory computer readable instructions (for example, one or more computer program modules). The processor 610 is configured to run non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are executed by the processor 610, one or more steps in the method for remotely displaying a three-dimensional model described above can be executed. The memory 620 and the processor 610 may be interconnected by a bus system and/or other forms of connection mechanisms (not shown).

For example, the processor 610 may be a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), or other forms of processing units with data processing capabilities and/or program execution capabilities, such as field programmable Gate array (FPGA), etc.; for example, the central processing unit (CPU) can be an X86 or ARM architecture. The processor 610 may be a general-purpose processor or a special-purpose processor, and may control other components in the electronic device 600 to perform desired functions.

For example, the memory 620 may include any combination of one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. Non-volatile memory may include, for example, read only memory (ROM), hard disk, erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and the processor 610 may run one or more computer program modules to implement various functions of the electronic device 600. The computer-readable storage medium may also store various application programs and various data, various data used and/or generated by the application programs, and the like.

It should be noted that, in the embodiments of the present disclosure, for the specific functions and technical effects of the electronic device 600, reference may be made to the above description of the method for remote display of a three-dimensional model, which will not be repeated here.

FIG. 11 is a schematic block diagram of another electronic device provided by at least one embodiment of the present disclosure. The electronic device 700 is, for example, suitable for implementing the method for remotely displaying a three-dimensional model provided by an embodiment of the present disclosure. The electronic device 700 may be a terminal device or the like. It should be noted that the electronic device 700 shown in FIG. 11 is only an example, which does not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 11, the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 710, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 720 or from a storage device 780. The program in the memory (RAM) 730 executes various appropriate actions and processes. In the RAM 730, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 710, the ROM 720, and the RAM 730 are connected to each other through a bus 740. An input/output (I/O) interface 750 is also connected to the bus 740.

Generally, the following devices can be connected to the I/O interface 750: including input devices 760 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD), speakers, vibration An output device 770 such as a device; a storage device 780 such as a magnetic tape, a hard disk, etc.; and a communication device 790. The communication device 790 may allow the electronic device 700 to perform wireless or wired communication with other electronic devices to exchange data. Although FIG. 11 shows an electronic device 700 with various devices, it should be understood that it is not required to implement or have all the devices shown, and the electronic device 700 may alternatively implement or have more or fewer devices.

At least one embodiment of the present disclosure further provides a storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the remote three-dimensional model provided by any embodiment of the present disclosure can be realized. Show method. Using this storage medium, three-dimensional models (such as three-dimensional vehicle models) can be displayed on pages (such as web pages) without installing native applications, which is convenient to use, and can realize the integration of three-dimensional vehicle models and real scenes, which can provide more realistic online The way to watch the car, and improve the interactivity and playability of watching the car online. Moreover, it can realize screen sharing between terminals, reduce the amount of data transmitted, avoid occupying a large amount of equipment resources, avoid display jams, equipment heating, etc., can solve the display delay problem, and ensure the quality of the images displayed by each terminal. Resolution improves the user experience.

FIG. 12 is a schematic diagram of a storage medium provided by at least one embodiment of the present disclosure. As shown in FIG. 12, the storage medium 800 is used to store non-transitory computer readable instructions 810. For example, when the non-transitory computer-readable instructions 810 are executed by a computer, one or more steps in the remote display method according to the above-mentioned three-dimensional model can be executed.

For example, the storage medium 800 may be applied to the above-mentioned electronic device 600. For example, the storage medium 800 may be the memory 620 in the electronic device 600 shown in FIG. 10. For example, for the relevant description of the storage medium 800, reference may be made to the corresponding description of the memory 620 in the electronic device 600 shown in FIG. 10, which will not be repeated here.

The following points need to be explained:

(1) The drawings of the embodiments of the present disclosure only refer to the structures involved in the embodiments of the present disclosure, and other structures can refer to the usual design.

(2) In the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

The above are only specific implementations of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

A method for remotely displaying a three-dimensional model, applied to a first terminal, the method including:

Based on the network graphics library drawing protocol, load the 3D model on the page;

Calling the augmented reality interface to display the first posture of the three-dimensional model;

Establishing a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal on the page;

In response to a detected adjustment operation performed on the three-dimensional model displayed on the first terminal, obtaining operation data corresponding to the adjustment operation;

Based on the network graphics library drawing protocol and calling the augmented reality interface to display the second posture of the three-dimensional model corresponding to the adjustment operation;

The operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal performs an analysis of the three-dimensional model displayed by the second terminal based on the operation data. The first posture performs the adjustment operation synchronously, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation.
The method according to claim 1, wherein the network graphics library drawing protocol includes WebGL.
The method according to claim 1 or 2, wherein the augmented reality interface comprises an ARcore development interface in JavaScript form or an ARKit development interface in JavaScript form.
The method according to any one of claims 1-3, wherein the page comprises a browser page or an application page.
The method according to any one of claims 1 to 4, wherein invoking the augmented reality interface to display the first posture of the three-dimensional model comprises:

Get an image;

Calling the augmented reality interface to perform plane recognition on the image to identify the display plane in the image;

Invoking the augmented reality interface to display the first posture of the three-dimensional model on the display plane.
The method according to claim 5, wherein invoking the augmented reality interface to display the first posture of the three-dimensional model further comprises:

Prompt the user to click on the display plane after the display plane is recognized and before the first posture of the three-dimensional model is displayed;

A click instruction from the user is received to determine the click position.
The method according to claim 6, wherein invoking the augmented reality interface to display the first posture of the three-dimensional model on the display plane comprises:

Call the augmented reality interface to display the first posture of the three-dimensional model at the click position on the display plane.
The method according to any one of claims 1 to 4, wherein invoking the augmented reality interface to display the first posture of the three-dimensional model further comprises:

The augmented reality interface is called to process the ambient light data, and the display effect parameters of the first posture of the three-dimensional model are adjusted.
8. The method according to claim 8, wherein the display effect parameters include shadow, color saturation, and white balance.
The method according to any one of claims 1 to 4, wherein, in response to the detected adjustment operation performed on the three-dimensional model displayed on the first terminal, obtaining all data corresponding to the adjustment operation The operating data, including:

In response to the detection of the adjustment operation performed on the three-dimensional model displayed on the first terminal, the first page monitoring tool configured in the first terminal is used to monitor the adjustment operation to obtain information based on the The operation data of the first page monitoring tool.
10. The method according to claim 10, wherein the operation data is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal performs data on the operation data based on the operation data. Performing the adjustment operation synchronously with the first posture of the three-dimensional model displayed by the second terminal so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation includes:

The operation data based on the first page monitoring tool is transmitted from the first terminal to the second terminal through the transmission channel group, so that the second terminal sets the second terminal according to the operation data The state of the second page monitoring tool configured in, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation;

Wherein, the first page monitoring tool and the second page monitoring tool are the same type of page monitoring tools.
The method according to any one of claims 1 to 4, wherein, based on the network graphics library drawing protocol and invoking the augmented reality interface, displaying the second posture of the three-dimensional model corresponding to the adjustment operation comprises:

The size, display angle, and display position of the three-dimensional model are adjusted corresponding to the adjustment operation based on the network graphics library drawing protocol, and the augmented reality interface is called based on the network graphics library drawing protocol to display the three-dimensional model. The second posture of the model, so that the three-dimensional model is switched from the first posture to the second posture.
The method according to any one of claims 1 to 4, wherein, based on the network graphics library drawing protocol and invoking the augmented reality interface, displaying the second posture of the three-dimensional model corresponding to the adjustment operation comprises:

Call the augmented reality interface to process the posture data of the three-dimensional model to adjust the size, display angle, and display position of the three-dimensional model corresponding to the adjustment operation, and call the network graphics library drawing protocol based on the The augmented reality interface displays the second posture of the three-dimensional model, so that the three-dimensional model is switched from the first posture to the second posture.
The method according to any one of claims 1 to 4, wherein the display posture parameters of the three-dimensional model in the first posture are different from the display posture parameters of the three-dimensional model in the second posture,

The display posture parameter includes at least one of size, display angle, and display position.
The method according to claim 14, wherein the three-dimensional model is a three-dimensional vehicle model, and the display angle includes the external view angle of the three-dimensional vehicle model and/or the internal space view angle of the three-dimensional vehicle model,

The first posture is the posture of the three-dimensional vehicle model when the display angle is the external viewing angle or the posture when the display angle is the internal space viewing angle, and the second posture is the posture of the three-dimensional vehicle model The display angle is the posture under the external viewing angle or the posture under the internal space viewing angle.
The method according to claim 15, wherein the three-dimensional vehicle model contains information about the shape of the interior space of the vehicle, the outline of the vehicle, and the material.
The method according to any one of claims 1 to 4, wherein the adjustment operation is any one of the following operations performed on the three-dimensional model displayed on the first terminal: click, drag, and zoom And zoom out.
A first terminal for remotely displaying a three-dimensional model, including:

The page loading unit is configured to load the 3D model on the page based on the network graphics library drawing protocol;

An augmented reality processing unit configured to call an augmented reality interface to display the first posture of the three-dimensional model;

The communication unit is configured to establish a transmission channel group with the second terminal based on real-time audio and video technology, so that the second terminal displays the first posture of the three-dimensional model synchronously with the first terminal on the page;

An obtaining unit configured to obtain operation data corresponding to the adjustment operation in response to a detected adjustment operation performed on the three-dimensional model displayed on the first terminal;

A switching unit configured to call the augmented reality interface based on the network graphics library drawing protocol to display the second posture of the three-dimensional model corresponding to the adjustment operation;

The transmission unit is configured to transmit the operation data from the first terminal to the second terminal through the transmission channel group, so that the second terminal displays the operation data to the second terminal based on the operation data The first posture of the three-dimensional model performs the adjustment operation synchronously, so that the second terminal displays the second posture of the three-dimensional model corresponding to the adjustment operation.
An electronic device including:

processor;

The memory includes one or more computer program modules;

Wherein, the one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include those used to implement any one of claims 1-17. Instructions for the remote display method of the three-dimensional model described above.
A storage medium for storing non-transitory computer-readable instructions, which can realize the remote display method of a three-dimensional model according to any one of claims 1-17 when the non-transitory computer-readable instructions are executed by a computer.