WO2024221739A1 - Interaction method for performance site, computer apparatus, and computer-readable storage medium - Google Patents

Abstract

The present invention provides an interaction method for a performance site, a computer apparatus, and a computer-readable storage medium. The interaction method for a performance site comprises: controlling a first image acquisition module to scan a target scene and controlling a first UWB module to communicate with a third UWB module; acquiring a first relative location of the third UWB module relative to the first UWB module; controlling a first AR display module to display a first target image of the target scene, determining a first target location of the third UWB module, and determining a first target object; acquiring third target device information of the third UWB module; according to the third target device information, sending a first identity request instruction to a target server, and acquiring third target identity information from the target server; controlling the first AR display module to display first target identity information; sending a first interaction instruction to the target server; and according to a second interaction instruction, controlling the first AR display module to display a first target interaction effect. The present invention can facilitate interaction between a performer and a viewer.

Description

Interactive method at performance site, computer device, and computer-readable storage medium Technical Field

The present invention relates to the field of Internet technology, and more particularly to an interactive method for a performance site, a computer device, and a computer-readable storage medium. This application is based on a Chinese invention application filed on April 28, 2023, with application number CN202310482989.3, the contents of which are incorporated herein by reference.

Background Art

At a performance, the interaction between the audience and the performers is often limited to language, and the interaction method is relatively simple. For example, at a concert, due to the limitations of the number of people, viewing angles, and distance, it is difficult for the audience to interact with the performers. When a viewer interacts with a performer, other viewers often find it difficult to see the interaction between the viewer and the performer, which affects the audience's on-site interactive experience.

Technical issues

The first object of the present invention is to provide an interactive method for a performance scene that facilitates interaction between viewers and performers.

The second object of the present invention is to provide another interactive method at a performance site that facilitates interaction between viewers and performers.

The third object of the present invention is to provide another interactive method at a performance site that facilitates interaction between viewers and performers.

A fourth object of the present invention is to provide a computer device for implementing the above-mentioned on-site performance interaction method.

A fifth object of the present invention is to provide a computer-readable storage medium including the above-mentioned performance scene interactive method.

Technical Solutions

In order to achieve the above-mentioned first purpose, the present invention provides an interactive method for a performance site, which includes the following steps: controlling the first image acquisition module to scan the target scene, controlling the first UWB module to communicate with at least one third UWB module in the target scene; obtaining the first relative position of the third UWB module relative to the first UWB module; controlling the first AR display module to display the first target image of the target scene, determining the first target position of the third UWB module in the first target image according to the first relative position, and determining the first target object at the first target position; obtaining the third target device information of the third UWB module; sending a first identity request instruction to the target server according to the third target device information, and obtaining the third target identity information corresponding to the third target device information from the target server; controlling the first AR display module to display the third target identity information at the first target position of the first target image; sending a first interaction instruction to the target server, and receiving a second interaction instruction from the target server; according to the second interaction instruction, controlling the first AR display module to display the first target interaction effect at the first target object of the first target image.

A further solution is to control the AR display module to display the target image of the target image, and when determining the target position of the third UWB module in the target image according to the relative position, determine the target object of the target position according to a preset image recognition algorithm.

A further solution is to receive performance location information from a target server before controlling the image acquisition module to scan the target scene.

In order to achieve the above-mentioned second purpose, the present invention provides an interactive method for a performance site, which includes the following steps: receiving a first identity request instruction from a first user terminal, determining first target identity information according to the first identity request instruction, and sending the first target identity information to the first user terminal; receiving an identity request instruction from a second user terminal, determining second target identity information according to the second identity request instruction, and sending the second target identity information to the second user terminal; receiving a first interaction instruction from the first user terminal, determining that the first target identity information is the same as the second identity information, and sending a second interaction instruction to the first user terminal and the second user terminal.

A further solution is to update the target account pointed to by the first interaction instruction after receiving the first interaction instruction.

In order to achieve the above-mentioned third purpose, the present invention provides an interactive method for a performance site, which includes the following steps: controlling the second image acquisition module to scan the target scene, controlling the second UWB module to communicate with at least one third UWB module in the target scene; obtaining the second relative position of the third UWB module relative to the second UWB module; controlling the second AR display module to display the second target image of the target scene, determining the second target position of the third UWB module in the second target image according to the second relative position, and determining the second target object at the second target position; obtaining the third target device information of the third UWB module, and sending the third target device information to the target server; sending a second identity request instruction to the target server according to the third target identity information, and obtaining the third target identity information corresponding to the third target device information from the target server; controlling the second AR display module to display the third target identity information at the second target position of the second target image; receiving the second interaction instruction from the target server, and controlling the second AR display module to display the second target interaction effect at the second target object of the second target image.

In order to achieve the fourth purpose mentioned above, the present invention provides a computer device, including a memory and a processor, wherein the processor stores a computer program, wherein: when the processor executes the computer program in the memory, the above-mentioned interactive method of the performance site is implemented.

In order to achieve the fifth purpose mentioned above, the present invention provides a computer-readable storage medium storing a computer program, wherein: when the computer program is executed by a processor, the above-mentioned interactive method of the performance site is implemented.

Beneficial Effects

The present invention can obtain the third target device information of the third UWB module through communication between the first UWB module and the third UWB module, and then determine the third target identity information corresponding to the third target device information. After initiating the first interaction instruction by combining the image acquisition module and the first AR display module, the first target interaction effect can be intuitively presented on the first target object, which facilitates the interaction between the viewer and the performer and improves the interactive experience.

In addition, combined with the image recognition algorithm, the object holding the third UWB module can be determined more accurately.

Moreover, it is convenient for the audience to go to the performance site.

The present invention determines whether the first target identity information and the second identity information are the same, thereby confirming that the viewers holding the first user terminal and the second user terminal are in the same target scene, and both obtain the target image including the performer through the image acquisition module and the AR display module, so that after receiving the first interaction instruction sent by the first user terminal, the second interaction instruction is sent to the first user terminal and the second user terminal in the target scene, so that the viewer holding the second user terminal can see the interaction effect initiated by the viewer holding the first user terminal, thereby improving the interaction experience of the viewer in the target scene.

The present invention can obtain the third target device information of the third UWB module through communication between the second UWB module and the third UWB module, and then determine the third target identity information corresponding to the third target device information. Combined with the image acquisition module and the first AR display module, according to the received second interaction instruction, the second target interaction effect can be intuitively presented on the second target object, thereby improving the interaction experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of an interactive system architecture of a performance scene according to a performance scene embodiment of the present invention.

FIG. 2 is a flow chart executed by the first processor in the live performance embodiment of the present invention.

FIG. 3 is a flow chart executed by the second processor in the live performance embodiment of the present invention.

FIG. 4 is a flow chart executed by the target server in the performance scene embodiment of the present invention.

The present invention is further described below in conjunction with the accompanying drawings and embodiments.

Best Mode for Carrying Out the Invention

The present invention implements an interactive method for a performance scene based on AR (Augmented Reality) technology and UWB (Ultra Wide Band) technology to improve the viewing experience of viewers at the performance scene. The present invention also provides a computer device and a computer-readable storage medium for implementing the interactive method for the performance scene.

An embodiment of the interactive method at a performance site:

Referring to Figure 1, the interactive method at the performance site of this embodiment is implemented based on the interactive system at the performance site. The interactive system 1 at the performance site includes a first user terminal 11, a second user terminal 21, a third user terminal 31, and a target server 41. The first user terminal 11, the second user terminal 21, and the third user terminal 31 can all communicate wirelessly with the target server 41.

The first user terminal 11 includes a first image acquisition module 111, a first AR display module 112, a first UWB module 113, and a first processor 114. The first processor 114 is connected to the first image acquisition module 111, the first AR display module 112, and the first UWB module 113 respectively.

The second user terminal 21 includes a second image acquisition module 211 , a second AR display module 212 , a second UWB module 213 , and a second processor 214 , which are respectively connected to the second image acquisition module 211 , the second AR display module 212 , and the second UWB module 213 .

The third user terminal 31 includes a third UWB module 313 .

Both the first UWB module 113 and the second UWB module 213 can perform UWB communication with the third UWB module 313 .

In this embodiment, the first user terminal 11, the second user terminal 21, and the third user terminal can all be smart phones, then the first image acquisition module 111 and the second image acquisition module 211 can both be camera modules on the smart phone, and the first AR display module 112 and the second AR display module 212 can both be display modules on the smart phone.

The first UWB module 113 includes a unique device number, namely, first target device information. The second UWB module 213 includes a unique device number, namely, second target device information. The third UWB module 213 includes a unique device number, namely, third target device information.

The target server 41 stores the correspondence between the account, the target device information of the UWB module, and the target identity information. That is, the target server 41 stores the correspondence between the account and the UWB module, and the user can register an account on the target server and bind the device information of one or more UWB modules. In this embodiment, viewer A holds the first user terminal 11, viewer B holds the second user terminal 21, and performer C holds the third user terminal 31. The target server 41 stores the correspondence between viewer A's account A and the first target device information, the correspondence between viewer B's account B and the second target device information, and the correspondence between performer C's account C and the third target device information. In addition, performer C's account C also stores the third target identity information corresponding to the third target device information, so that both viewer A and viewer B can request performer C's third target identity information from the target server 41 by obtaining viewer C's third target device information to determine performer C's identity.

Referring to FIG. 2 , the interactive method for implementing the performance scene of this embodiment specifically includes the following steps executed by the first processor:

First, step S11 is executed to receive performance location information from the target server. The performance location information is information such as the time, location, and introduction of the performance. The target server may receive the performance location information from the performer C, i.e., the third user terminal, and push it to the first user terminal of the viewer A.

Then, step S12 is executed to control the first image acquisition module to scan the target scene, and control the first UWB module to communicate with at least one third UWB module in the target scene.

Then, step S13 is performed to obtain a first relative position of the third UWB module relative to the first UWB module. Based on the principle of UWB communication, the distance and angle between the first UWB module and the third UWB module can be known.

Then, step S14 is executed to control the first AR display module to display the first target image of the target scene, determine the first target position of the third UWB module in the first target image according to the first relative position, and determine the first target object at the first target position. The first target image is an image directly obtained by scanning the target scene by the first image acquisition module. The third UWB module is in the target image. According to the existing image recognition algorithm, such as YOLOv5, the person and object in the target image can be identified. According to the existing camera ranging principle, such as the binocular ranging principle, the distance of the person and object in the target image relative to the first user terminal can be obtained. Since the relative position of the third UWB module relative to the first UWB module is known, that is, the first relative position of the third UWB module relative to the first user terminal is known, the person holding the third UWB module in the target image can be determined. The person holding the third UWB module is at the first target position of the first target image, and the person holding the third UWB module is the third target object.

Then, step S15 is executed to obtain the third target device information of the third UWB module.

Then, step S16 is executed to send a first identity request instruction to the target server according to the third target device information, and obtain the third target identity information corresponding to the third target device information from the target server, that is, request the target server to obtain the third target identity information corresponding to the third target device information, so as to confirm the specific identity of the third target object.

Then, step S17 is executed to control the first AR display module to display the third target identity information at the first target position of the first target image. Thus, the viewer A can directly see the third target identity information of the first target object from the first AR display module, and the third target identity information may include identity information such as name.

Then, step S18 is executed to send a first interaction instruction to the target server and receive a second interaction instruction from the target server. That is, viewer A can choose to send a first interaction instruction to the target server, and interact with the first target object after receiving the second interaction instruction from the target server, that is, performer C interacts. The first interaction instruction is an instruction to request the target server to display the first target interaction effect at the first target object, for example, requesting the first target object in the first target image to wear a hat, and the second interaction instruction can be a data packet returning a corresponding wearing of a hat or a reply allowing display.

Finally, step S19 is performed to control the first AR display module to display the first target interaction effect on the first target object of the first target image according to the second interaction instruction. The first target interaction effect can be rendered by the first processor and then displayed on the first target object.

The above steps can realize the interaction between viewer A and performer C at the performance scene, that is, the target scene. At the same time, there is also viewer B in the target scene. Viewer B and viewer A watch the performance of performer C at different positions, realizing the interactive method of the performance scene of this embodiment. Referring to FIG. 3, the second processor further performs the following steps:

First, step S21 is executed to control the second image acquisition module to scan the target scene, and control the second UWB module to communicate with at least one third UWB module in the target scene.

Then, step S22 is performed to obtain a second relative position of the third UWB module relative to the second UWB module.

Then, step S23 is executed to control the second AR display module to display the second target image of the target scene, determine the second target position of the third UWB module in the second target image according to the second relative position, and determine the second target object at the second target position.

Then, step S24 is executed to obtain the third target device information of the third UWB module, and send the third target device information to the target server.

Then, step S25 is executed to send a second identity request instruction to the target server according to the third target identity information, and obtain the third target identity information corresponding to the third target device information from the target server.

Then, step S26 is executed to control the second AR display module to display the third target identity information at the second target position of the second target image.

Finally, step S27 is executed to receive a second interaction instruction from the target server, and control the second AR display module to display a second target interaction effect on the second target object in the second target image.

The specific execution process of the above steps S21 to S27 is performed with reference to the above steps S11 to S19, which will not be repeated here. It should be noted that the second target object and the first target object are the same performer C, and the second target interaction effect and the first target interaction effect are the same target interaction effects under different perspectives. Since viewers A and B are at different positions in the target scene and face performer C in different directions, there is a difference in perspective between the first target interaction effect rendered by the first processor and the second target interaction effect rendered by the second processor. For example, if viewer A is in front of performer C, viewer A can see performer C wearing a hat from the first AR display module, but only see the front of the hat. If viewer B is on the side of performer C, viewer B can see performer C wearing a hat from the second AR display module, but only see the side of the hat.

In the above-mentioned interactive method at the performance site, the target server can synchronously send the second interactive instruction sent to the first user terminal to the second user terminal, so that the viewer B holding the second user terminal can see the interactive effect initiated by the viewer A to the performer C. Specifically, referring to FIG. 4 , the target server performs the following steps:

First, step S31 is performed to receive a first identity request instruction from a first user terminal, determine first target identity information according to the first identity request instruction, and send the first target identity information to the first user terminal. In this embodiment, the first target identity information is the same as the third target identity information.

Then, step S32 is performed to receive a second identity request instruction from the second user terminal, determine the second target identity information according to the second identity request instruction, and send the second target identity information to the second user terminal. In this embodiment, the second target identity information is the same as the third target identity information.

Finally, step S33 is executed, the first user terminal can accept the first interaction instruction, determine that the first target identity information is the same as the second target identity information, and send the second interaction instruction to the first user terminal and the second user terminal. That is, after receiving the first interaction instruction, the target server determines that the account corresponding to the third target identity information is received within the preset time period. In this embodiment, the first user terminal and the second user terminal both request the target server to determine the third target identity information within the preset time, which indicates that the viewer A and the viewer B are in the same target scene, and the target server sends the second interaction instruction to the first user terminal and the second user terminal respectively, so that the viewer B can see the interaction effect initiated by the viewer A with the performer C.

Optionally, the target server also stores the correspondence between accounts, target device relationships, and the number of tokens. The first interaction instruction may be equal to a preset number of tokens. After receiving the first interaction instruction, the target server also updates the target account pointed to by the first interaction instruction, that is, updates the number of tokens of the account corresponding to the first UWB module.

In summary, the present invention is used for interaction at a performance site. The first user terminal and the second user terminal can obtain the third target device information of the third UWB module through their respective UWB modules, thereby determining the performer through the third target device information, and then interacting through interactive instructions. The image acquisition module and the AR display module realize the intuitive display of the target interactive effect of the interactive instruction, which facilitates the interaction between the audience and the performer at the performance site. At the same time, when the target server receives a first interactive instruction from a viewer, it determines other viewers at the performance site where the viewer is located, and sends a second interactive instruction to the other viewers, so that the viewers at the same performance site can see the interactive effects initiated by other viewers to the performer, further facilitating the interaction between the audience and the performer at the performance site.

Computer device embodiment:

The computer device of this embodiment includes a processor and a memory. The memory stores a computer program. When the processor executes the computer program, the above-mentioned interactive method of the performance site is implemented.

The computer device may include but is not limited to a processor and a memory. Those skilled in the art will appreciate that the computer device may include more or fewer components, or a combination of certain components, or different components, for example, the computer device may also include input and output devices, network access devices, buses, etc.

For example, the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microcontroller or any conventional processor, etc. The processor is the control center of a computer device, and uses various interfaces and lines to connect various parts of the entire computer device.

The memory can be used to store computer programs and/or modules. The controller realizes various functions of the computer device by running or executing the computer programs and/or modules stored in the memory, and calling the data stored in the memory. For example, the memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound receiving function, a sound conversion to text function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, text data, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

Computer readable storage medium embodiment:

If the module integrated in the computer device of the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the process of the interactive method embodiment of the performance site can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the controller, the steps of the interactive method of the performance site can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The storage medium may include: any entity or device that can carry computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.

Industrial Applicability

The interactive method, computer device, and computer-readable storage medium at a performance site of the present invention are applicable to the field of Internet technology. The third target device information of the performer is obtained through the UWB module of the viewer's user terminal, and the performer is determined from the target server through the third target device information, so that the viewer interacts with the performer through interactive instructions. When a viewer interacts with the performer, the interactive effect is synchronized to other viewers at the same performance site, thereby improving the interactive experience between the viewers and performers at the performance site.

Claims (8)

An interactive method for a performance scene, characterized by comprising the following steps; Controlling the first image acquisition module to scan a target scene, and controlling the first UWB module to communicate with at least one third UWB module in the target scene; Acquire a first relative position of the third UWB module relative to the first UWB module; Controlling the first AR display module to display a first target image of the target scene, determining a first target position of the third UWB module in the first target image according to the first relative position, and determining a first target object at the first target position; Acquire third target device information of the third UWB module; Sending a first identity request instruction to a target server according to the third target device information, and obtaining third target identity information corresponding to the third target device information from the target server; Controlling the first AR display module to display the third target identity information at the first target position of the first target image; Sending a first interaction instruction to the target server, and receiving a second interaction instruction from the target server; According to the second interaction instruction, the first AR display module is controlled to display a first target interaction effect on the first target object in the first target image. The interactive method for a performance site as described in claim 1 is characterized by: The AR display module is controlled to display the first target image of the target scene, and when the target position of the third UWB module in the first target image is determined according to the first relative position, the target object of the first target position is determined according to a preset image recognition algorithm. The interactive method for a performance site as described in claim 1 is characterized by: Before controlling the image acquisition module to scan the target scene, performance location information is received from the target server. A method for interactive performance on site, characterized in that it comprises the following steps: receiving a first identity request instruction from a first user terminal, determining first target identity information according to the first identity request instruction, and sending the first target identity information to the first user terminal; receiving an identity request instruction from a second user terminal, determining the second target identity information according to the second identity request instruction, and sending the second target identity information to the second user terminal; A first interaction instruction is received from the first user terminal, it is determined that the first target identity information is the same as the second identity information, and a second interaction instruction is sent to the first user terminal and the second user terminal. An interactive method for a performance site as described in claim 4, characterized in that; After receiving the first interaction instruction, the target account pointed to by the first interaction instruction is updated. An interactive method for a performance scene, characterized by comprising the following steps; Controlling the second image acquisition module to scan a target scene, and controlling the second UWB module to communicate with at least one third UWB module in the target scene; Acquire a second relative position of the third UWB module relative to the second UWB module; Controlling the second AR display module to display a second target image of the target scene, determining a second target position of the third UWB module in the second target image according to the second relative position, and determining a second target object at the second target position; Acquire the third target device information of the third UWB module, and send the third target device information to the target server; Sending a second identity request instruction to a target server according to the third target identity information, and obtaining the third target identity information corresponding to the third target device information from the target server; Controlling the second AR display module to display the third target identity information at the second target position of the second target image; A second interaction instruction is received from the target server, and the second AR display module is controlled to display a second target interaction effect on the second target object in the second target image. A computer device, comprising a memory and a processor, wherein the processor stores a computer program, characterized in that: When the processor executes the computer program in the memory, the interactive method for a performance site as described in any one of claims 1 to 6 is implemented. A computer-readable storage medium stores a computer program, characterized in that: When the computer program is executed by a processor, the interactive method for a performance site as described in any one of claims 1 to 6 is implemented.