WO2021143182A1

WO2021143182A1 - Game processing method and apparatus, electronic device, and computer-readable storage medium

Info

Publication number: WO2021143182A1
Application number: PCT/CN2020/115987
Authority: WO
Inventors: 夏长锦; 王哲; 林顺
Original assignee: 厦门雅基软件有限公司
Priority date: 2020-01-14
Filing date: 2020-09-17
Publication date: 2021-07-22
Also published as: CN111803940B; CN111803940A

Abstract

A game processing method and apparatus, an electronic device, and a computer-readable storage medium, which relate to the field of data processing. The method comprises: when a terminal receives an action instruction for a current picture of a preset game, acquiring an action event in the action instruction, and determining the type of the action event (S201); on the basis of the type of the action instruction, executing the action event by means of at least one among a preset cloud server or the terminal, and obtaining a corresponding target picture (S202); and displaying the target picture in the terminal (S203). Thus, the interaction experience of a cloud game will remain unaffected when a network fluctuates, thereby improving the gaming experience of a user.

Description

Game processing method, device, electronic equipment and computer readable storage medium

Cross-references to related applications

This application claims the priority of Chinese Patent Application No. 2020100388722 filed at the State Intellectual Property Office of China on January 14, 2020, the disclosure of which is incorporated herein by reference in its entirety.

Technical field

This application relates to data processing technology. Specifically, this application relates to a game processing method, device, electronic equipment, and computer-readable storage medium.

Background technique

Conceptually, a cloud game is a game service based on cloud computing technology that runs the game on a cloud server, then encodes and compresses the rendering instructions or the rendered game screen video, and transmits it to the user terminal through the network for decoding and display.

The operation of cloud games relies heavily on a good network. If the network environment bandwidth, delay, packet loss rate and other aspects are unstable, the game will not run smoothly. Currently, the rendering schemes include a video stream scheme and an instruction stream scheme. Since all renderings are based on the cloud, network fluctuations often occur in reality. At this time, the stream transmitted through the network will inevitably be affected, resulting in the delay or loss of data packets to the client, which inevitably leads to game screen delays and the entire UI Interaction will also be delayed, which brings a bad experience to the user. How to make users feel smooth control under various network conditions is a technical problem to be solved by this application.

Summary of the invention

This application provides a game processing method, device, electronic equipment, and computer-readable storage medium, which can solve the problem of how to make users feel smooth control under various network conditions. The technical solution is as follows:

In the first aspect, a game processing method is provided, and the game processing method includes:

When the terminal receives an action instruction for the current screen of the preset game, acquire the action event in the action instruction, and determine the type of the action event;

Execute the action event through at least one of the preset cloud server or the terminal based on the type of the action instruction to obtain the corresponding target screen; and

The target screen is displayed in the terminal.

Preferably, before the terminal receives the action instruction for the current screen of the preset game, the method further includes:

When receiving a start instruction for the preset game, detect whether there is an application client of the preset game in the terminal;

If not, obtain the installation file of the application client from the cloud server, and run the installation file to obtain the application client.

Preferably, the type of the action event includes a UI type, and the action event of the UI type is an action event executed for the UI of the preset game.

Preferably, the step of executing the action event through at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain the corresponding target screen includes:

The application client in the terminal executes the UI type action event to obtain the corresponding target screen.

Preferably, the type of the action event includes a non-UI type, and the non-UI type of action event is an action event executed outside the UI for the preset game.

The terminal sends the action event to the cloud server, so that the cloud server executes the non-UI type action event, obtains the first video stream data of the corresponding first video frame image, and sends the first video stream data of the corresponding first video frame image to the cloud server. Sending a video stream data to the terminal;

The first video stream data is received, and the first video stream data is decoded to obtain the first video frame image, and the first video frame image is used as a corresponding target image.

When the action event includes UI type and non-UI type, the UI type action event is executed through the application client in the terminal to obtain the corresponding UI screen, and the non-UI type action event is sent to the cloud Server, enabling the cloud server to execute the non-UI type action event to obtain the second video stream data of the corresponding second video frame image, and send the second video stream data to the terminal;

Receive the second video stream data, decode the second video stream data to obtain the second video frame image, and integrate the second video frame image with the UI screen to obtain a target image .

Preferably, the cloud server and the terminal exchange related data through a preset network data interaction channel, and the related data includes at least one of an interaction protocol, application program interface information, and game data.

In a second aspect, a game processing method is provided, and the game processing method includes:

When receiving an action event for the current screen of the preset game sent by the terminal, execute the action event to obtain the corresponding game screen; wherein, the action event is of a non-UI type;

Rendering the game screen to obtain a third video frame image;

Encoding the third video frame image to obtain corresponding third video stream data;

Send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain the third video frame image, and obtain the preset game based on the video frame image The target screen.

In a third aspect, a game processing device is provided, and the game processing device includes:

The receiving module is configured to receive an action instruction for the current screen of the preset game;

An obtaining module, configured to obtain the action event in the action instruction, and determine the type of the action event;

The first processing module is configured to execute the action event through at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain a corresponding target screen;

The display module is configured to display the target screen in the terminal.

Preferably, it also includes:

The receiving module is further configured to receive a start instruction for the preset game before the action instruction for the current screen of the preset game is received;

The detection module is configured to detect whether there is an application client of the preset game in the terminal;

The second processing module is configured to obtain the installation file of the application client from the cloud server, and run the installation file to obtain the application client.

Preferably, the first processing module is specifically configured to:

Preferably, the first processing module includes:

The sending submodule is configured to send the action event to the cloud server, so that the cloud server executes the non-UI type action event to obtain the first video stream data of the corresponding first video frame image, and Sending the first video stream data to the terminal;

The first receiving submodule is configured to receive the first video stream data;

The decoding sub-module is configured to decode the first video stream data to obtain the first video frame image, and use the first video frame image as a corresponding target image.

Preferably, the first processing module is specifically configured to:

When the action event includes UI type and non-UI type, the UI type action event is executed through the application client in the terminal to obtain the corresponding UI screen, and the non-UI type action event is sent to the cloud Server, enabling the cloud server to execute the non-UI type action event to obtain the second video stream data of the corresponding second video frame image, and send the second video stream data to the terminal; and,

In a fourth aspect, a game processing device is provided, and the game processing device includes:

The execution module is configured to execute the action event to obtain the corresponding game screen when receiving the action event for the current screen of the preset game sent by the terminal; wherein, the action event is of a non-UI type;

A rendering module configured to render the game screen to obtain a third video frame image;

An encoding module configured to encode the third video frame image to obtain corresponding third video stream data;

The sending module is configured to send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain the third video frame image, and based on the video frame image Obtain the target screen of the preset game.

In a fifth aspect, an electronic device is provided, and the electronic device includes:

Processor, memory and bus;

The bus is configured to connect the processor and the memory;

The memory is configured to store operation instructions;

Wherein, the processor is configured to execute operations corresponding to the game processing methods shown in the first aspect and the second aspect of the present application when the operation instruction is invoked.

In a sixth aspect, a computer-readable storage medium is provided, and a computer program is stored on the computer-readable storage medium. When the program is executed by a processor, the game processing method shown in the first and second aspects of the present application is implemented.

The beneficial effects brought about by the technical solution provided by this application are:

In the embodiment of the present application, when the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then determines the type of the action event based on the action instruction. The type executes the action event through at least one of the preset cloud server or the terminal, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from a single cloud server into a cloud server and a terminal. Since the terminal's execution of action events is not affected by the network and can respond to user control in a timely manner, it has high real-time performance. In this way, when the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in a cloud game, it does not It needs to be executed through the cloud server again, so as to ensure that the interactive experience of the cloud game will not be affected even when the network fluctuates, thereby improving the user's game experience.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application.

Figure 1 is a schematic diagram of the interaction logic between the cloud server and the terminal of the application;

FIG. 2 is a schematic flowchart of a game processing method provided by an embodiment of the application;

FIG. 3 is a schematic flowchart of a game processing method provided by another embodiment of this application;

FIG. 4 is a schematic flowchart of a game processing method provided by still another embodiment of this application;

FIG. 5 is a schematic structural diagram of a game processing device provided by another embodiment of this application;

FIG. 6 is a schematic structural diagram of a game processing device provided by another embodiment of this application;

FIG. 7 is a schematic structural diagram of an electronic device for processing a game according to another embodiment of this application;

FIG. 8 is a schematic structural diagram of an electronic device for processing a game according to another embodiment of the application.

Detailed ways

The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary, and are only used to explain the present application, and cannot be construed as a limitation to the present application.

Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of this application refers to the presence of the described features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features , Integers, steps, operations, elements, components, and/or groups of them. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, or intervening elements may also be present. In addition, "connected" or "coupled" as used herein may include wireless connection or wireless coupling. The term "and/or" as used herein includes all or any unit and all combinations of one or more associated listed items.

In order to make the purpose, technical solutions, and advantages of the present application clearer, the implementation manners of the present application will be described in further detail below in conjunction with the accompanying drawings.

First, the application scenarios for running cloud games in this application will be described in detail.

Specifically, this application adopts a solution of separate design, separate rendering, and off-site rendering before mixing for cloud games.

Separate design means that cloud games can include two scenarios: heavy game scenarios and light interaction scenarios. The heavy game scene can be the main scene part of the cloud game, and its rendering consumes a large amount of processing power of GPU (Graphics Processing Unit, graphics processor). For example, fighting in the game and map-related scenes are all heavy game scenes. Lightly interactive scenes are parts related to user manipulation, such as virtual arrow keys, avatars, settings menus, backpack systems, chat boxes, etc., displayed on the game interface that users can often manipulate, including the GPU processing power consumed by rendering Less UI (User Interface).

Separate rendering means that the GPU of the cloud server can be used for rendering for heavy game scenes, which can make full use of the high performance of the cloud server; and for light interactive scenes, the GPU of the terminal can be used for rendering, which can make full use of the GPU processing of the terminal. Efficiency and real-time.

Further, the type of the action event can be determined by the target object of the action event. If the target object of the action event belongs to a light game scene, then the action event is of UI type, and the action event can be executed through the terminal; if the target object of the action event belongs to a heavy game scene, then the action event is of non-UI type. The action event needs to be executed through the cloud server; if the target object of the action event belongs to both a heavy game scene and a light game scene, then the light game scene part of the action event is processed through the terminal, and the cloud server is used to process the The heavy game scene part of the action event.

Among them, the terminal may have the following characteristics:

(1) In terms of hardware, the device includes a central processing unit, a memory, an input component and an output component, that is to say, the device is often a microcomputer device that includes communication functions. In addition, it can also have a variety of input methods, such as keyboard, mouse, touch screen, microphone and camera, etc., and can adjust the input as needed. At the same time, the equipment often has a variety of output methods, such as receivers, display screens, etc., which can also be adjusted as needed;

(2) In terms of software, the device must have an operating system, such as Windows Mobile, Symbian, Palm, Android, iOS, etc. At the same time, as these operating systems become more and more open, personalized applications based on these open operating system platforms emerge in endlessly, such as communication books, calendars, notepads, calculators, and various games, which greatly satisfy To meet the needs of personalized users;

(3) In terms of communication, the device has flexible access methods and high-bandwidth communication performance, and can automatically adjust the selected communication method according to the selected service and the environment, so as to facilitate the user's use. The equipment can support GSM (Global System for Mobile Communication), WCDMA (Wideband Code Division Multiple Access), CDMA2000 (Code Division Multiple Access), TDSCDMA (Time Division- Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), Wi-Fi (Wireless-Fidelity, Wireless Fidelity), and WiMAX (Worldwide Interoperability for Microwave Access), etc., so as to adapt to multiple standard networks, Not only supports voice services, but also supports multiple wireless data services;

(4) In terms of functional use, the equipment pays more attention to humanization, individualization and multi-function. With the development of computer technology, equipment has moved from a "equipment-centric" model to a "human-centric" model, integrating embedded computing, control technology, artificial intelligence technology, and biometric authentication technology, which fully embodies the people-oriented tenet . Due to the development of software technology, the equipment can be adjusted according to individual needs and become more personalized. At the same time, the device itself integrates a lot of software and hardware, and its functions are becoming more and more powerful.

Remixing after remote rendering refers to superimposing the screen rendered by the cloud server and the screen rendered by the terminal on the terminal, and displaying the superimposed screen to the user.

Through the above solution, after the terminal receives the user's manipulation, it can render the interactive UI first without delay. This part is not affected by the network and can respond to the user's manipulation in a timely manner. In this way, when the network fluctuates, The interactive experience of the game will still not be affected.

Further, in order to achieve separate rendering of cloud games, for the same cloud game, the cloud server application client SAPP can be set in the cloud server, and at the same time, the application client CAPP can be set in the terminal. As shown in Figure 1, SIPP and CAPP respectively include their corresponding data. For example, the SAPP may include map-related scene data, etc., and the CAPP may include UI resource data, etc. When a user starts a certain cloud game, SAPP and CAPP run at the same time, and the two work together to realize the functions of the cloud game.

Moreover, SIPP and CAPP are equipped with network data exchange channels. Specifically, there is related data that needs to be exchanged between the SAPP and the CAPP, including at least one of an interaction protocol, API information, and game data. The two run in different places (on the cloud and on the local side, respectively). Because the two need to collaborate, some data needs to be synchronized, that is, interact. For example, if the user sets the frame rate of the game screen on the CAPP to be 60 frames, then CAPP needs to notify the SIPP that the frame rate of the game screen is 60 frames, so this setting information needs to be synchronized to the SIPP, and the SIPP processes accordingly. The process is data interaction.

For example, if the user touches the virtual arrow keys on the CAPP, the arrow keys need to be sent to the server SIPP for corresponding processing; another example, the parameters of the characters in the game have changed and need to be transferred to the CAPP so that the CAPP displays normally .

In practical applications, when a certain cloud game is developed, the corresponding installation files of SAPP and CAPP will be deployed on the cloud server at the same time. When the user runs the cloud game for the first time, the SAPP will start in the cloud server. At the same time, the user needs to download the CAPP installation file to the terminal, and then run the installation file to get the CAPP.

Further, a host App (Application, application) can also be installed in the terminal. The host App is similar to a game lobby. There are many cloud game icons in it, which can be used as an entrance. Click the cloud game icon to start playing the corresponding cloud game. Specifically, the user clicks on a certain cloud game icon, generates a startup command, and transmits the startup command to the cloud server. The cloud server starts to start the SAPP, the terminal downloads the CAPP installation file to the local, and the terminal runs the installation file to get the CAPP and synchronizes it in the terminal Start running CAPP.

The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

In one embodiment, a game processing method is provided. As shown in Figure 2, the game processing method includes:

Step S201: When the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, and determines the type of the action event.

Specifically, when the application client in the terminal is running, it can capture the user's manipulation, that is, the action instruction triggered by the user, and the action instruction includes the corresponding action event. For example, when the user clicks the virtual arrow key, an action instruction that the action event is a movement is initiated; the user clicks the backpack icon, that is an action instruction that initiates the action event to show the backpack.

Furthermore, because the cloud game in this application includes heavy game scenes and light interaction scenes, after receiving an action instruction and obtaining the corresponding action event from the action instruction, it is necessary to determine the type of the action event. In order to determine whether to use the server to execute the action event or the terminal to execute the action event.

Step S202, based on the type of the action instruction, execute the action event through at least one of the preset cloud server or the terminal to obtain the corresponding target screen.

Specifically, the type of action event can be determined by the target object of the action event. If the target object of the action event belongs to a light game scene, the corresponding target screen can be obtained by executing the action event through the terminal; if the target object of the action event belongs to a heavy game scene, then the action event can be executed through the cloud server Obtain the corresponding target screen; if the target object of the action event belongs to both a heavy game scene and a light game scene with attributes, the terminal will process the light game scene part of the action event to obtain the light game scene screen through the cloud server To process the severe game scene part of the action event to obtain the heavy game scene picture, and then integrate the light game scene picture with the heavy game scene picture in the terminal to obtain the target picture.

In step S203, the target screen is displayed in the terminal.

In the embodiment of the present application, when the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from a single cloud server into a cloud server and a terminal. Since the terminal's execution of action events is not affected by the network and can respond to user control in a timely manner, it has high real-time performance. In this way, when the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in a cloud game, it does not It needs to be executed through the cloud server again, so as to ensure that the interactive experience of the cloud game will not be affected even when the network fluctuates, thereby improving the user's game experience.

In another embodiment, a game processing method is provided. As shown in FIG. 3, the game processing method includes:

Step S301: When receiving a start instruction for a preset game, detect whether there is an application client of the preset game in the terminal.

Among them, the preset game can be any cloud game in the host App. When the user clicks on any cloud game icon in the host App, a startup instruction for the cloud game is initiated. After the terminal receives the startup instruction, it can detect whether there is an application client for the cloud game in the terminal. It is the CAPP of this cloud game.

Further, the terminal sends the start instruction to the cloud server, and the cloud server can start the SAPP after receiving the start instruction.

Step S302, if not, obtain the installation file of the application client from the cloud server, and run the installation file to obtain the application client.

If the terminal detects that there is no application client (CAPP) of the preset game in the terminal, it can send an acquisition request to the cloud server to obtain the installation file of the application client. After the cloud server receives the acquisition request, it sends the application to the terminal The installation file of the program client, the terminal runs the installation file after receiving the installation file to obtain the application client, and then runs the application client.

Step S303: When the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, and determines the type of the action event.

Furthermore, because the cloud game in this application includes heavy game scenes and light interaction scenes, after receiving an action instruction and obtaining the corresponding action event from the action instruction, it is necessary to determine the type of the action event. In order to determine whether to use SAPP to execute the action event or CAPP to execute the action event. If CAPP is used to execute the action event, the terminal can handle the action event; if SAPP is used to execute the action event, then the action instruction can be sent to the SAPP in the cloud server, and then the cloud server can handle the action event. Process the action event.

Step S304, based on the type of the action instruction, execute the action event through at least one of the preset cloud server or the terminal to obtain the corresponding target screen.

Specifically, the type of action event can be determined by the target object of the action event. If the target object of the action event belongs to a light game scene, then the action event is of UI type, and the action event can be executed through the terminal; if the target object of the action event belongs to a heavy game scene, then the action event is of non-UI type. The action event needs to be executed through the cloud server; if the target object of the action event belongs to both a heavy game scene and a light game scene, then the light game scene part of the action event is processed through the terminal, and the cloud server is used to process the The heavy game scene part of the action event.

In a preferred embodiment of the present application, the step of executing an action event through at least one of the preset cloud server or terminal based on the type of the action instruction to obtain the corresponding target screen includes:

When the type of the action event is the UI type, the application client in the terminal executes the UI type action event to obtain the corresponding target screen; wherein, the UI type action event is an action event executed for the UI of the preset game.

Specifically, when the action event initiated by the user in the CAPP is of the UI type, the CAPP can be used to execute the action event, and at the same time, the GPU of the terminal is used for rendering to obtain the corresponding target screen after the action event is executed.

For example, if the user clicks the virtual icon of the backpack in the cloud game on the current game screen of CAPP, an action event is initiated to show the action instruction of the backpack. CAPP detects that the target object of the action event belongs to a light game scene, then The CAPP obtains the UI resource data of the backpack, and calls the GPU of the terminal to render the UI resource data of the backpack, thereby displaying the backpack in the current game screen and obtaining the target screen.

When the type of the action event is a non-UI type, the terminal sends the action event to the cloud server, so that the cloud server executes the non-UI type action event, and obtains the first video stream data of the corresponding first video frame image, and the first The video stream data is sent to the terminal; wherein, non-UI type action events are action events executed outside the UI of the preset game;

The first video stream data is received, and the first video stream data is decoded to obtain the first video frame image, and the first video frame image is used as the target image.

Specifically, when the action event initiated by the user in CAPP is of a non-UI type, the action event can be sent to SAPP, and SAPP calls the GPU in the cloud server for rendering, and obtains the corresponding target screen after executing the action event , And then the cloud server captures the target image to obtain the corresponding video frame image, then encodes the video frame image to generate the video stream data of the video frame image, and sends the video stream data to the terminal, and the terminal receives the video stream After the data, the video stream data is decoded to obtain the corresponding video frame image, and the video frame image is used as the target image.

For example, if the user clicks the virtual icon of map switching in the cloud game on the current game screen of CAPP, an action instruction that the action event is map switching is initiated. CAPP detects that the target object of the action event belongs to a severe game scene, then CAPP passes The terminal sends the action instruction to the SAPP, and the SAPP obtains the map-related scene data, and calls the GPU of the cloud server to render the map-related scene data to obtain the target screen after the map switching, and then the cloud server switches the target screen after the map switching Perform image capture to obtain the corresponding first video frame image, and then encode the first video frame image to generate the first video stream data of the first video frame image, and send the first video stream data to the terminal, and the terminal receives After the first video stream data is received, the first video stream data is decoded to obtain the corresponding first video frame image, and the first video frame image is displayed in the CAPP as the target image.

It should be noted that when CAPP displays the target screen of the heavy game scene, it will continue to display the light game scene such as the UI screen, otherwise the user will only see the heavy game scene without the UI screen, but in this case the user has not targeted The light game scene initiates an action event, so I won't go into details. For example, if the user clicks on the map switch, the CAPP will continue to display the UI screen while displaying the switched map. Otherwise, the user will see the switched map scene without the UI screen.

Further, the video frame image captured by the cloud server may be one frame or multiple frames, depending on the number of target images obtained after rendering. In practical applications, if there is only one target picture, then the video stream data corresponds to one frame of video frame image; if there are multiple target pictures, then the video stream data corresponds to multiple frames of video frame images, and multiple frames of video frame images. Encode in order.

In actual applications, in addition to sending action events to SAPP, CAPP can also send other interactive data, such as the frame rate of cloud games; and, in addition to rendering, the cloud server can also perform game logic calculations, etc. , These can be set according to actual needs, and this application does not limit it.

When the action event includes UI type and non-UI type, the UI type action event is executed through the application client in the terminal to obtain the corresponding UI screen, and the non-UI type action event is sent to the cloud server so that the cloud server executes For non-UI type action events, obtain the second video stream data of the corresponding second video frame image, and send the second video stream data to the terminal;

The second video stream data is received, and the second video stream data is decoded to obtain a second video frame image, and the second video frame image is integrated with the UI image to obtain the target image.

For example, if the user clicks on a certain skill icon in a cloud game, the character has a skill effect when the skill is cast (belonging to a severe game scene), and at the same time, the skill icon is also changed (belonging to a light game scene), so the skill effect Rendering through the cloud server to obtain the second video frame image, the skill icon is rendered through the terminal to obtain the UI image, and then the CAPP superimposes the second video frame image and the UI image to obtain the final target image. The manner in which the terminal executes the UI-type action event and the cloud server executes the non-UI-type action event can be referred to the foregoing, which will not be repeated here.

It should be noted that the frame rate of the second video frame image and the UI image are the same, so that each frame of the second video frame image has a corresponding UI image.

In step S305, the target screen is displayed in the terminal.

After the CAPP second video frame image is integrated with the UI picture to obtain the target picture, it can be displayed on the display device of the terminal.

In the embodiment of the present application, when the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in a timely manner, so it has high real-time performance. In this way, When the terminal receives an action event that can be executed in the terminal in the cloud game, such as UI interaction, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game will still not be performed even when the network fluctuates. Affected, thereby improving the user's gaming experience.

In another embodiment, a game processing method is provided. As shown in FIG. 4, the game processing method includes:

Step S401: When receiving an action event for the current screen of the preset game sent by the terminal, execute the action event to obtain the corresponding game screen; where the action event is of a non-UI type;

Step S402, rendering the game screen to obtain a third video frame image;

Step S403, encoding the third video frame image to obtain corresponding third video stream data;

Step S404: Send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain a third video frame image, and obtain a preset game target image based on the video frame image.

The embodiment of the present application is a process for the cloud server to execute an action event. For details, please refer to step S201 to step S203, and step S301 to step S305, which will not be repeated here.

FIG. 5 is a schematic structural diagram of a game processing device provided by another embodiment of this application. As shown in FIG. 5, the device in this embodiment may include:

The receiving module 501 is configured to receive an action instruction for the current screen of the preset game;

The obtaining module 502 is configured to obtain the action event in the action instruction and determine the type of the action event;

The first processing module 503 is configured to execute the action event through at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain a corresponding target screen;

The display module 504 is configured to display the target screen in the terminal.

In a preferred embodiment of this application, it further includes:

In a preferred embodiment of the present application, the type of the action event includes a UI type, and the action event of the UI type is an action event executed for the UI of the preset game.

In a preferred embodiment of the present application, the first processing module is specifically configured to execute the UI type action event through the application client in the terminal to obtain the corresponding target screen.

In a preferred embodiment of the present application, the type of the action event includes a non-UI type, and the non-UI type of action event is an action event executed outside the UI for the preset game.

In a preferred embodiment of the present application, the first processing module includes:

In a preferred embodiment of the present application, the first processing module is specifically configured as:

In a preferred embodiment of the present application, the cloud server and the terminal exchange related data through a preset network data interaction channel, and the related data includes at least one of an interaction protocol, application program interface information, and game data. A sort of.

The game processing device of this embodiment can execute the game processing method shown in the first embodiment of the present application, and the implementation principles are similar, and will not be repeated here.

In the embodiment of the present application, when the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in time, so it has high real-time performance. In this way, When the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in the cloud game, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game remains the same in the case of network fluctuations Will not be affected, thereby improving the user's gaming experience.

FIG. 6 is a schematic structural diagram of a game processing device provided by another embodiment of this application. As shown in FIG. 6, the apparatus of this embodiment may include:

The execution module 601 is configured to, when an action event for the current screen of a preset game is received from the terminal, execute the action event to obtain a corresponding game screen, wherein the action event is of a non-UI type;

The rendering module 602 is configured to render the game screen to obtain a third video frame image;

The encoding module 603 is configured to encode the third video frame image to obtain corresponding third video stream data;

The sending module 604 is configured to send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain the third video frame image, and based on the video frame The image obtains the target screen of the preset game.

In the embodiment of the present application, when the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in a timely manner, so it has high real-time performance. In this way, When the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in the cloud game, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game remains the same in the case of network fluctuations Will not be affected, thereby improving the user's gaming experience.

Another embodiment of the present application provides an electronic device, the electronic device includes: a memory and a processor; at least one program, stored in the memory, for being executed by the processor, compared with the prior art : When the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes at least one of the preset cloud servers or terminals based on the type of the action instruction An execution action event obtains the corresponding target screen and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in time, so it has high real-time performance. In this way, When the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in the cloud game, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game remains the same in the case of network fluctuations Will not be affected, thereby improving the user's gaming experience.

In an optional embodiment, an electronic device is provided, as shown in FIG. 7. The electronic device 7000 shown in FIG. 7 includes a processor 7001 and a memory 7003. Among them, the processor 7001 and the memory 7003 are connected, for example, connected through a bus 7002. Optionally, the electronic device 7000 may further include a transceiver 7004. It should be noted that in actual applications, the transceiver 7004 is not limited to one, and the structure of the electronic device 7000 does not constitute a limitation to the embodiment of the present application.

The processor 7001 may be a CPU, a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor 7001 may also be a combination that implements computing functions, for example, includes a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

The bus 7002 may include a path to transfer information between the above-mentioned components. The bus 7002 may be a PCI bus, an EISA bus, or the like. The bus 7002 can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in FIG. 7, but it does not mean that there is only one bus or one type of bus.

The memory 7003 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or it can be EEPROM, CD-ROM or other optical disk storage, or optical disk storage. (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.

The memory 7003 is used to store application program codes for executing the solutions of the present application, and is controlled by the processor 7001 to execute. The processor 7001 is configured to execute the application program code stored in the memory 7003 to implement the content shown in any of the foregoing method embodiments.

Among them, electronic equipment includes but is not limited to: mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PAD (tablet computers), PMP (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc. Mobile terminals such as digital TVs, desktop computers, etc.

Another embodiment of the present application provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when it runs on a computer, the computer can execute the corresponding content in the foregoing method embodiment. Compared with the prior art, when the terminal receives an action instruction for the current screen of a preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in a timely manner, so it has high real-time performance. In this way, When the terminal receives an action event that can be executed in the terminal in the cloud game, such as UI interaction, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game will still not be performed even when the network fluctuates. Affected, thereby improving the user's gaming experience.

Another embodiment of the present application provides an electronic device, the electronic device includes: a memory and a processor; at least one program, stored in the memory, for being executed by the processor, compared with the prior art : When the terminal receives an action instruction for the current screen of the preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes at least one of the preset cloud servers or terminals based on the type of the action instruction An execution action event obtains the corresponding target screen and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in a timely manner, so it has high real-time performance. In this way, When the terminal receives an action event that can be executed in the terminal in the cloud game, such as UI interaction, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game will still not be performed even when the network fluctuates. Affected, thereby improving the user's gaming experience.

In an optional embodiment, an electronic device is provided, as shown in FIG. 8. The electronic device 8000 shown in FIG. 8 includes a processor 8001 and a memory 8003. Among them, the processor 8001 and the memory 8003 are connected, for example, through a bus 8002. Optionally, the electronic device 8000 may further include a transceiver 8004. It should be noted that in actual applications, the transceiver 8004 is not limited to one, and the structure of the electronic device 8000 does not constitute a limitation to the embodiment of the present application.

The processor 8001 may be a CPU, a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor 8001 may also be a combination that implements computing functions, for example, it includes one or more microprocessor combinations, a DSP and a microprocessor combination, and so on.

The bus 8002 may include a path for transferring information between the above-mentioned components. The bus 8002 may be a PCI bus or an EISA bus. The bus 8002 can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in FIG. 8, but it does not mean that there is only one bus or one type of bus.

The memory 8003 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or it can be EEPROM, CD-ROM or other optical disk storage, or optical disk storage. (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.

The memory 8003 is used to store application program codes for executing the solutions of the present application, and is controlled by the processor 8001 to execute. The processor 8001 is configured to execute the application program code stored in the memory 8003 to implement the content shown in any of the foregoing method embodiments.

Another embodiment of the present application provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when it runs on a computer, the computer can execute the corresponding content in the foregoing method embodiment. Compared with the prior art, when the terminal receives an action instruction for the current screen of a preset game, it acquires the action event in the action instruction, determines the type of the action event, and then passes the preset cloud based on the type of the action instruction At least one of the server or the terminal executes the action event, obtains the corresponding target screen, and displays the target screen in the terminal. Through the above method, the execution subject of the action event in the action instruction is separated from the single cloud server into the cloud server and the terminal. Since the terminal executes the action event without being affected by the network, it can respond to the user's manipulation in time, so it has high real-time performance. When the terminal receives an action event (for example, UI interaction) that can be executed in the terminal in the cloud game, it does not need to be executed through the cloud server, thereby ensuring that the interactive experience of the cloud game remains the same in the case of network fluctuations Will not be affected, thereby improving the user's gaming experience.

It should be understood that although the various steps in the flowchart of the drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least part of the steps in the flowchart of the drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

The above are only part of the implementation of this application. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of this application, several improvements and modifications can be made, and these improvements and modifications are also Should be regarded as the scope of protection of this application.

Claims

A game processing method, including:

When the terminal receives an action instruction for the current screen of the preset game, acquire the action event in the action instruction, and determine the type of the action event;

Execute the action event through at least one of the preset cloud server or the terminal based on the type of the action instruction to obtain the corresponding target screen; and

The target screen is displayed in the terminal.
The game processing method according to claim 1, wherein before the terminal receives an action instruction for the current screen of the preset game, the method further comprises:

When receiving a start instruction for the preset game, detect whether there is an application client of the preset game in the terminal;

If not, obtain the installation file of the application client from the cloud server, and run the installation file to obtain the application client.
The game processing method according to claim 1, wherein the type of the action event includes a UI type, and the action event of the UI type is an action event executed for the UI of the preset game.
The game processing method according to any one of claims 1 to 3, wherein the action event is executed by at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain a corresponding The steps of the target screen include:

The application client in the terminal executes the UI type action event to obtain the corresponding target screen.
The game processing method according to claim 1, wherein the type of the action event includes a non-UI type, and the non-UI type of action event is an action event executed outside the UI for the preset game.
The method for processing a game according to any one of claims 1 or 2 or 5, wherein the action event is executed through at least one of a preset cloud server or the terminal based on the type of the action instruction, The steps for obtaining the corresponding target screen include:

The terminal sends the action event to the cloud server, so that the cloud server executes the non-UI type action event, obtains the first video stream data of the corresponding first video frame image, and compares the first video stream data to the first video frame image. Sending a video stream data to the terminal;

The first video stream data is received, and the first video stream data is decoded to obtain the first video frame image, and the first video frame image is used as a corresponding target image.
The game processing method according to claim 1 or 2, wherein the action event is executed through at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain the corresponding target The steps of the screen include:

When the action event includes UI type and non-UI type, the UI type action event is executed through the application client in the terminal to obtain the corresponding UI screen, and the non-UI type action event is sent to the cloud Server, enabling the cloud server to execute the non-UI type action event to obtain the second video stream data of the corresponding second video frame image, and send the second video stream data to the terminal;

Receive the second video stream data, decode the second video stream data to obtain the second video frame image, and integrate the second video frame image with the UI screen to obtain a target image .
The game processing method according to claim 1 or 2, wherein the cloud server and the terminal exchange related data through a preset network data interaction channel, and the related data includes interaction protocol and application program interface information , At least one of game data.
A game processing method, including:

When receiving an action event for the current screen of the preset game sent by the terminal, execute the action event to obtain a corresponding game screen, wherein the action event is of a non-UI type;

Rendering the game screen to obtain a third video frame image;

Encoding the third video frame image to obtain corresponding third video stream data; and

Send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain the third video frame image, and obtain the preset game based on the video frame image The target screen.
A game processing device applied to a terminal, including:

The receiving module is configured to receive an action instruction for the current screen of the preset game;

The obtaining module is configured to obtain the action event in the action instruction and determine the type of the action event;

The first processing module is configured to execute the action event through at least one of a preset cloud server or the terminal based on the type of the action instruction to obtain a corresponding target screen;

The display module is configured to display the target screen in the terminal.
A game processing device applied to a cloud server, including:

The execution module is configured to execute the action event to obtain the corresponding game screen when receiving the action event for the current screen of the preset game sent by the terminal, wherein the action event is of a non-UI type;

A rendering module configured to render the game screen to obtain a third video frame image;

An encoding module configured to encode the third video frame image to obtain corresponding third video stream data;

The sending module is configured to send the third video stream data to the terminal, so that the terminal decodes the third video stream data to obtain the third video frame image, and based on the video frame image Obtain the target screen of the preset game.
An electronic device including:

Processor, memory and bus;

The bus is configured to connect the processor and the memory;

The memory is configured to store operation instructions;

Wherein, the processor is configured to execute the game processing method according to any one of claims 1-9 when the operation instruction is invoked.
A computer-readable storage medium storing computer instructions, wherein when the computer instructions are run on a computer, the computer can execute the game according to any one of claims 1-9. Approach.