CN113204302B

CN113204302B - Virtual robot-based operation method, device, equipment and storage medium

Info

Publication number: CN113204302B
Application number: CN202110399769.5A
Authority: CN
Inventors: 陈加新
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-04-14
Filing date: 2021-04-14
Publication date: 2023-05-12
Anticipated expiration: 2041-04-14
Also published as: CN113204302A

Abstract

The disclosure relates to an operation method, device, equipment and storage medium based on a virtual robot, and belongs to the technical field of computers. The method comprises the following steps: acquiring input information based on any input control of a target application; under the condition that the input information meets the robot call condition, determining the input information as a robot call instruction; and calling a virtual robot corresponding to the robot calling instruction, and executing the operation indicated by the robot calling instruction. According to the method, the robot calling instruction input by the user in any input control is determined, and the operation indicated by the robot calling instruction is executed, so that when the user needs to execute certain operation in the target application, the robot calling instruction corresponding to the operation is input in any input control, the virtual robot can be called to execute the operation, the user does not need to inquire the control corresponding to the operation in the target application, the time for inquiring the control is saved, and the execution efficiency of the operation is improved.

Description

Virtual robot-based operation method, device, equipment and storage medium

Technical Field

The disclosure relates to the field of computer technology, and in particular relates to an operation method, device, equipment and storage medium based on a virtual robot.

Background

With the development of computer technology, applications are more and more, and executable operations in the applications are more and more abundant, for example, the operation of establishing a session can be performed in many applications, and the instant messaging operation and the like are performed by using the session, so that communication between users is greatly facilitated.

In general, an operation executed in an application is triggered by a control, and a user needs to find the control to be triggered from a plurality of pages and a plurality of controls of the application, so that the control can be triggered to execute the corresponding operation, and a long time is required in a searching process, which results in low execution efficiency of the operation.

Disclosure of Invention

The present disclosure provides an operation method, apparatus, device, and storage medium based on a virtual robot, capable of improving the execution efficiency of operations. The technical scheme of the present disclosure is as follows:

according to a first aspect of embodiments of the present disclosure, there is provided a virtual robot-based operation method, the method comprising:

acquiring input information based on any input control of a target application;

under the condition that the input information meets the robot call condition, determining the input information as a robot call instruction, wherein the robot call condition is a condition which is required to be met by the robot call instruction input when the virtual robot is called;

And calling the virtual robot corresponding to the robot calling instruction, and executing the operation indicated by the robot calling instruction.

In the embodiment of the disclosure, by determining the robot call instruction input by the user in any input control and executing the operation indicated by the robot call instruction, when the user needs to execute a certain operation in the target application, the robot call instruction corresponding to the operation is input in any input control, and the virtual robot can be called to execute the operation, so that the user does not need to query the control corresponding to the operation in the target application, the time for querying the control is saved, and the execution efficiency of the operation is improved.

In some embodiments, the determining the input information as the robot call instruction in the case that the input information satisfies the robot call condition includes:

and under the condition that the input information comprises a virtual account number and the address book of the current login account number comprises the virtual account number, determining the input information as the robot calling instruction, wherein the virtual account number is an account number corresponding to the virtual robot.

In the embodiment of the disclosure, the input information includes the virtual account number, and the virtual account number in the address book of the current login account number is used as a robot call condition, so that when the virtual account number corresponding to the virtual robot is added to the address book by a user, and the virtual robot needs to be called to execute operation, only the input information including the virtual account number needs to be input in the input control, and the terminal can know that the user inputs a robot call instruction, thereby realizing the call to the virtual robot. Therefore, the virtual robot is called simply and quickly, and the execution efficiency of the operation is improved.

In some embodiments, the determining the input information as the robot call instruction includes:

and under the condition that the input information comprises a first target character and the virtual account number positioned behind the first target character, and the address book of the current login account number comprises the virtual account number, determining the input information as the robot call instruction, wherein the first target character is a character for identifying the robot call instruction.

In the embodiment of the disclosure, because the virtual account number input by the user may be only a common character under some conditions, the user does not call the virtual robot to perform the operation, and therefore, by setting the first target character for identifying the call instruction of the robot, and including the first target character and the virtual account number located behind the first target character in the input information, the virtual account number is the virtual account number in the address book of the current login account number as the call condition of the robot, the false call to the virtual robot can be avoided, and the accuracy of the operation is improved.

In some embodiments, the invoking the virtual robot corresponding to the robot invocation instruction, performing the operation indicated by the robot invocation instruction, includes:

and calling the virtual robot, and sending the robot calling instruction to a third-party server corresponding to the virtual robot, wherein the third-party server is used for responding to the robot calling instruction.

In the embodiment of the disclosure, the robot call instruction is sent to the third-party server, and the third-party server responds to the robot call instruction, which is equivalent to using the third-party server to assist in executing the operation, so that the operation which can be realized by the virtual robot is not limited to the target application, and therefore, the types of the operation which can be realized are richer.

In some embodiments, the robot call instruction is a search instruction, the search instruction includes a search parameter, and after the call instruction is sent to a third party server corresponding to the virtual robot, the operation method based on the virtual robot further includes:

receiving at least one search result returned by the third party server, wherein the at least one search result is obtained by the third party server based on the search parameter;

And displaying the at least one search result in the current display interface.

According to the method for quickly searching information, through setting of the search instruction, a user can trigger the terminal to call the virtual robot to obtain the search result corresponding to the search word and display the search result only by inputting the search instruction containing the search word in any input control, and the operation is simple and the search efficiency is high.

In some embodiments, after the displaying the at least one search result in the current display interface, the virtual robot-based operation method further comprises:

responding to the selection operation of any search result, and publishing the selected search result to a first session, wherein the first session is a session corresponding to a session interface where any input control is positioned; or,

responding to the selection operation of any search result, displaying a session identification list, wherein the session identification list comprises the session identification of at least one session in the target application; and responding to the selection operation of any session identifier, and releasing the selected search result into the session corresponding to the selected session identifier.

In an embodiment of the disclosure, a method for quickly searching and publishing search results to a session is provided. If the user wants to issue the searched information in the session, the user can directly select the search result after the terminal displays the search result by inputting a search instruction in any input control, and issue the selected search result to the session corresponding to the current session interface or the session selected by the user, so that the operation is simple and efficient. The information does not need to be searched in the third-party server, and then the search result is copied to the target application in a copying mode, so that the search result is released to the session, and the efficiency of releasing the information search result in the session is greatly improved.

In some embodiments, the invoking the virtual robot, sending the robot invocation instruction to a third party server corresponding to the virtual robot, includes:

and calling the virtual robot, sending the robot calling instruction to a service interface corresponding to the robot calling instruction, and responding the robot calling instruction through the service interface by the third-party server.

In the embodiment of the disclosure, the corresponding service interfaces are set for the robot call instructions, and the robot call instructions are processed through the service interfaces corresponding to each robot call instruction, so that the processing of different operation tasks can be isolated, and the execution efficiency of the operation is improved.

In some embodiments, the robot call instruction is a card punching instruction, the calling the virtual robot corresponding to the robot call instruction, and executing the operation indicated by the robot call instruction includes:

and calling the virtual robot to execute a punching operation, wherein the punching operation is an operation of recording the environment information of the current login account in the target application.

In an embodiment of the present disclosure, a method for fast punching a card in a target application is provided. If the user wants to punch a card in the target application, the card punching operation can be completed by inputting a card punching instruction into any input control of the target application, and the control specially used for punching the card is not required to be searched in the target application, so that the execution efficiency of the operation is improved.

In some embodiments, the target application includes a robot adding control, and before the input information is acquired based on any input control of the target application, the virtual robot-based operation method further includes:

responding to the triggering operation of adding a control to the robot, and displaying a robot display interface, wherein the robot display interface comprises at least one virtual robot provided by a third-party server;

And responding to the selection operation of any virtual robot in the robot display interface, and adding the virtual account corresponding to the selected virtual robot into the address book.

In the embodiment of the disclosure, the terminal displays at least one virtual robot based on the robot display interface by responding to the robot adding control, so that a user can conveniently select a required virtual robot to add the required virtual robot to the address book, and the user viscosity is improved.

In some embodiments, the robot presentation interface includes a robot creation control therein, and the virtual robot-based operation method further includes:

responding to the triggering operation of the robot creating control, and displaying a robot creating interface;

acquiring input robot information based on the robot creation interface;

creating a virtual robot conforming to the robot information, and displaying the created virtual robot in the robot presentation interface.

In the embodiment of the disclosure, by displaying the robot creation control in the robot display interface, the user can create a new virtual robot based on the robot creation control without being limited to adding the existing virtual robot in the session, thereby meeting the personalized requirements of the user.

In some embodiments, the virtual robot has a corresponding target control and a target operation, where the target operation is an operation allowed to be executed in a session where a virtual account corresponding to the virtual robot is located, and the target control is used to trigger execution of the target operation, and the virtual robot-based operation method further includes:

and in response to adding the virtual account number corresponding to the virtual robot to any session of the target application, adding the target control to a session interface corresponding to the session.

In the embodiment of the disclosure, when the target control needs to be expanded in the application, the method is not limited to a mode of updating the application, and only the virtual account corresponding to the virtual robot with the target control needs to be added into the session, so that the target control can be added in the session interface of the application by using the virtual robot, and the flexibility of expanding the target control in the application is improved. Moreover, the developer only needs to develop the virtual robot, and does not need to re-develop the application with the target control, so that the expansion cost is reduced.

In some embodiments, the adding the target control in the session interface corresponding to the session in response to adding the virtual account number corresponding to the virtual robot to any session of the target application includes:

Adding the target control in a menu corresponding to the session message in the session interface;

the virtual robot-based operation method further comprises the following steps: and responding to the menu calling operation of any session message, displaying a menu corresponding to the session message in the session interface, wherein the menu comprises the target control.

In the embodiment of the disclosure, the target control is displayed in the menu corresponding to the session message, and the menu including the target control corresponding to the session message is displayed in the session interface in response to the menu-up operation of the session message, so that the user can quickly find the target control by the menu-up operation, thereby improving the efficiency of executing the target operation.

In some embodiments, the target operation includes an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and after the menu corresponding to the session message is displayed in the session interface, the virtual robot-based operation method further includes:

responding to the triggering operation of the target control, and calling the virtual robot to read the session message corresponding to the target control;

And sending the session message to the third party server.

In the embodiment of the disclosure, the virtual robot is utilized to flexibly expand the control for uploading the session message to the third party server in the target application, namely the message uploading control, and the user only needs to trigger the message uploading control corresponding to the session message, so that the session message can be uploaded to the third party server, and the method is simple and efficient.

In some embodiments, the target operation includes an operation of sending a task creation request to a third party server corresponding to the virtual robot, and after the menu corresponding to the session message is displayed in the session interface, the virtual robot-based operation method further includes:

responding to the triggering operation of the target control, and calling the virtual robot to read the session message corresponding to the target control and the current login account;

and sending a task creation request to the third-party server, wherein the task creation request carries the session message and the current login account, and the third-party server is used for creating a target task taking the session message as task content for the current login account.

In the embodiment of the disclosure, the virtual robot is utilized to flexibly expand the control for sending the task creation request to the third party server, namely the task creation control, in the target application, and the user only needs to trigger the task creation control corresponding to the session message, so that the session request carrying the session message and the current login account can be sent to the third party server, so that the third party server creates the target task taking the session message as the task content for the current login account.

In some embodiments, the virtual robot-based operation method further comprises:

responding to the input of a second target character in a message input field of a session interface corresponding to any session, and displaying a session instruction corresponding to a virtual account number in the session interface when the session comprises the virtual account number corresponding to the virtual robot, wherein the second target character is used for triggering the display of the session instruction;

and responding to the triggering operation of any displayed session instruction, issuing the session instruction into the session, calling the virtual robot, sending the session instruction to a service interface corresponding to the session instruction, and enabling a third-party server corresponding to the virtual robot to respond to the session instruction through the service interface.

In the embodiment of the disclosure, by setting the second target character, the user can quickly call out the session instruction corresponding to the virtual account number by inputting the second target character in the message input field, and then the user can call the virtual robot to execute the operation indicated by the session instruction only by triggering the required session instruction, so that the user is prevented from manually inputting the session instruction, and the operation efficiency of calling the virtual robot is improved.

acquiring a first session message issued in any session, wherein the first session message marks a virtual account corresponding to the virtual robot as a receiving account;

when the session comprises the virtual account number, calling the virtual robot, and sending a message processing request to a third party server corresponding to the virtual robot, wherein the message processing request carries the first session message, and the third party server is used for generating a control instruction corresponding to the first session message and returning the control instruction;

in response to receiving the control instruction, a processing operation is performed based on the control instruction.

In the embodiment of the disclosure, a scheme is provided in which a target application interacts with a third party server by using a virtual robot, and a session message which is received by using the virtual robot as an object only needs to be issued in a session, so that the session message can be reported to the third party server, the third party server can know that a user interacts with the virtual robot in the target application, and returns a control instruction to control the target application, and the method is not limited to controlling the target application only by an application server associated with the target application, thereby expanding the functions of the target application. In addition, under the condition that the virtual account corresponding to the virtual robot joins the session, the virtual robot can be used for controlling the target application, so that the application safety can be improved.

receiving a message release request sent by a third-party server corresponding to the virtual robot, wherein the message release request carries a second session message, the virtual account number and a network hook webhook address, and the webhook address is used for identifying a unique corresponding session;

and responding to the conversation corresponding to the webhook address to comprise a virtual account number corresponding to the virtual robot, and issuing the second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

In an embodiment of the present disclosure, a method for publishing a session message in a session of a target application using a virtual robot is provided. The third party server sends a message release request carrying a webhook address to the terminal, so that the terminal can determine which session to release the session message in based on the webhook address, and further release the second session message in the session based on the second session message in the message release request and the virtual account number, and the virtual account number is taken as a release account number.

In some embodiments, the virtual robot created by the virtual robot for the current login account, the target application includes an information configuration entry of the virtual robot, and the virtual robot-based operation method further includes:

responding to the triggering operation of the information configuration inlet, and displaying an information configuration interface of the virtual robot;

and configuring the robot information of the virtual robot based on the information input operation in the information configuration interface.

In the embodiment of the disclosure, the instruction configuration control is arranged in the information configuration interface of the virtual robot, so that a user can conveniently enter the instruction configuration interface corresponding to the virtual robot to configure the robot call instruction corresponding to the virtual robot, and the user viscosity can be improved.

In some embodiments, the information configuration interface includes an instruction configuration control, and the configuring the robot information of the virtual robot based on the information input operation in the information configuration interface includes:

responding to the triggering operation of the instruction configuration control, and displaying an instruction configuration interface of the virtual robot;

based on the instruction configuration interface, an input robot calling instruction and a service interface corresponding to the robot calling instruction are obtained, wherein the service interface is an interface for sending the robot calling instruction to a third-party server corresponding to the virtual robot.

In the embodiment of the disclosure, under the condition that the virtual robot is created by the current login account, the information configuration inlet of the virtual robot is displayed in the target application, so that a user can conveniently enter the information configuration interface corresponding to the virtual robot to configure the robot information, and the user viscosity is improved.

According to a second aspect of embodiments of the present disclosure, there is provided a virtual robot-based operation device, the device comprising:

the information acquisition module is configured to acquire input information based on any input control of the target application;

The instruction determining module is configured to determine the input information as a robot call instruction under the condition that the input information meets a robot call condition, wherein the robot call condition is a condition which is required to be met by the robot call instruction input when a virtual robot is called;

the first operation execution module is configured to call the virtual robot corresponding to the robot call instruction and execute the operation indicated by the robot call instruction.

In some embodiments, the instruction determining module is configured to determine the input information as the robot call instruction when the input information includes a virtual account number and the address book of the current login account number includes the virtual account number, where the virtual account number is an account number corresponding to the virtual robot.

In some embodiments, the instruction determining module is configured to determine the input information as the robot call instruction when the input information includes a first target character and the virtual account number located after the first target character, and the address book of the current login account number includes the virtual account number, where the first target character is a character for identifying the robot call instruction.

In some embodiments, the first operation execution module is configured to call the virtual robot, send the robot call instruction to a third party server corresponding to the virtual robot, and the third party server is used for responding to the robot call instruction.

In some embodiments, the robotic call instruction is a search instruction, the search instruction including a search parameter therein,

the first operation execution module is further configured to receive at least one search result returned by the third party server, wherein the at least one search result is obtained by the third party server based on the search parameter; and displaying the at least one search result in the current display interface.

In some embodiments, the virtual robot-based operation device further comprises:

the result issuing module is configured to issue the selected search result into a first session in response to the selection operation of any one search result, wherein the first session is a session corresponding to a session interface where any one input control is located; or, in response to a selection operation of any one search result, displaying a session identification list, wherein the session identification list comprises the session identification of at least one session in the target application; and responding to the selection operation of any session identifier, and releasing the selected search result into the session corresponding to the selected session identifier.

In some embodiments, the first operation execution module is configured to call the virtual robot, send the robot call instruction to a service interface corresponding to the robot call instruction, and the third party server is configured to respond to the robot call instruction through the service interface.

In some embodiments, the robot call instruction is a card punching instruction, and the first operation execution module is configured to call the virtual robot to execute a card punching operation, where the card punching operation is an operation of recording environmental information of the current login account in the target application.

In some embodiments, the target application includes a robot addition control therein, and the virtual robot-based operation device further includes:

a robot adding module configured to respond to a triggering operation of adding a control to the robot, and display a robot display interface, wherein the robot display interface comprises at least one virtual robot provided by a third-party server; and responding to the selection operation of any virtual robot in the robot display interface, and adding the virtual account corresponding to the selected virtual robot into the address book.

a robot creation module configured to display a robot creation interface in response to a trigger operation of the robot creation control; acquiring input robot information based on the robot creation interface; creating a virtual robot conforming to the robot information, and displaying the created virtual robot in the robot presentation interface.

In some embodiments, the virtual robot has a corresponding target control and a target operation, where the target operation is an operation allowed to be executed in a session where a virtual account corresponding to the virtual robot is located, and the target control is used to trigger execution of the target operation, and the virtual robot-based operation device further includes:

and the control adding module is configured to respond to adding the virtual account number corresponding to the virtual robot into any session of the target application, and add the target control into a session interface corresponding to the session.

In some embodiments, the control adding module is configured to add the target control in a menu corresponding to a session message in the session interface;

The virtual robot-based operation device further includes:

and the control display module is configured to respond to the menu calling operation of any session message, display a menu corresponding to the session message in the session interface, and the menu comprises the target control.

In some embodiments, the target operation includes an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and the virtual robot-based operation device further includes:

the second operation execution module is configured to respond to the triggering operation of the target control and call the virtual robot to read the session message corresponding to the target control; and sending the session message to the third party server.

In some embodiments, the target operation includes an operation of sending a task creation request to a third party server corresponding to the virtual robot, and the virtual robot-based operation device further includes:

the third operation execution module is configured to respond to the triggering operation of the target control and call the virtual robot to read the session message corresponding to the target control and the current login account; and sending a task creation request to the third-party server, wherein the task creation request carries the session message and the current login account, and the third-party server is used for creating a target task taking the session message as task content for the current login account.

a session instruction issuing module, configured to respond to the input of a second target character in a message input field of a session interface corresponding to any session, and if the session includes a virtual account number corresponding to the virtual robot, display a session instruction corresponding to the virtual account number in the session interface, where the second target character is used for triggering the display of the session instruction; and responding to the triggering operation of any displayed session instruction, issuing the session instruction into the session, calling the virtual robot, sending the session instruction to a service interface corresponding to the session instruction, and enabling a third-party server corresponding to the virtual robot to respond to the session instruction through the service interface.

a fourth operation execution module configured to acquire a first session message issued in any session, where the first session message marks a virtual account corresponding to the virtual robot as a receiving account; when the session comprises the virtual account number, calling the virtual robot, and sending a message processing request to a third party server corresponding to the virtual robot, wherein the message processing request carries the first session message, and the third party server is used for generating a control instruction corresponding to the first session message and returning the control instruction; in response to receiving the control instruction, a processing operation is performed based on the control instruction.

the session message issuing module is configured to receive a message issuing request sent by a third-party server corresponding to the virtual robot, wherein the message issuing request carries a second session message, the virtual account number and a network hook webhook address, and the webhook address is used for identifying a unique corresponding session; and responding to the conversation corresponding to the webhook address to comprise a virtual account number corresponding to the virtual robot, and issuing the second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

In some embodiments, the virtual robot created by the virtual robot for the current login account, the target application includes an information configuration entry of the virtual robot, and the virtual robot-based operation device further includes:

a configuration interface display module configured to display an information configuration interface of the virtual robot in response to a trigger operation to the information configuration entry;

and the information configuration module is configured to configure the robot information of the virtual robot based on the information input operation in the information configuration interface.

In some embodiments, the information configuration interface includes an instruction configuration control, and the information configuration module is configured to respond to a triggering operation of the instruction configuration control to display an instruction configuration interface of the virtual robot; based on the instruction configuration interface, an input robot calling instruction and a service interface corresponding to the robot calling instruction are obtained, wherein the service interface is an interface for sending the robot calling instruction to a third-party server corresponding to the virtual robot.

According to a third aspect of embodiments of the present disclosure, there is provided an electronic device comprising:

one or more processors;

volatile or non-volatile memory for storing the one or more processor-executable instructions;

wherein the one or more processors are configured to perform the virtual robot-based method of operation as described in the above aspects.

According to a fourth aspect provided by embodiments of the present disclosure, there is provided a computer-readable storage medium, which when executed by a processor of an electronic device, causes the electronic device to perform the virtual robot-based operation method as described in the above aspects.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the virtual robot-based operation method of the above aspect.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.

FIG. 1 is a schematic diagram illustrating an implementation environment according to an example embodiment.

Fig. 2 is a flow chart illustrating a virtual robot-based method of operation, according to an exemplary embodiment.

Fig. 3 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment.

Fig. 4 is a schematic diagram of a robotic presentation interface, shown according to an example embodiment.

Fig. 5 is a schematic diagram of a robotic presentation interface, shown according to an example embodiment.

FIG. 6 is a schematic diagram illustrating a robotic creation interface, according to an example embodiment.

FIG. 7 is a schematic diagram illustrating a robot creation interface, according to an example embodiment.

FIG. 8 is a schematic diagram illustrating the input of a robot call instruction in an input control, according to an example embodiment.

FIG. 9 is a schematic diagram of a search results presentation interface, according to an example embodiment.

Fig. 10 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment.

Fig. 11 is a schematic diagram illustrating a display of a target control in a menu corresponding to a session message, according to an example embodiment.

Fig. 12 is a schematic diagram showing a display of a session instruction in a session interface, according to an example embodiment.

Fig. 13 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment.

Fig. 14 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment.

FIG. 15 is a schematic diagram illustrating an instruction configuration interface, according to an example embodiment.

FIG. 16 is a schematic diagram illustrating an instruction configuration interface, according to an example embodiment.

Fig. 17 is a block diagram illustrating a virtual robot-based operation device according to an exemplary embodiment.

Fig. 18 is a schematic structural view of a terminal according to an exemplary embodiment.

Fig. 19 is a schematic diagram showing a structure of a server according to an exemplary embodiment.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description of the present disclosure and the claims and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

The terms "at least one," "a plurality," "each," "any one," as used herein, include one, two or more, a plurality includes two or more, and each refers to each of a corresponding plurality, any one referring to any one of the plurality. For example, the plurality of target characters includes 3 target characters, and each refers to each of the 3 target characters, and any one refers to any one of the 3 target characters, which may be the first, the second, or the third.

FIG. 1 is a schematic illustration of an implementation environment provided by embodiments of the present disclosure. Referring to fig. 1, the implementation environment includes at least one terminal 101 (2 are illustrated in fig. 1) and a server 102. The terminal 101 and the server 102 are connected by a wireless or wired network. In some embodiments, terminal 101 is a computer, cell phone, tablet computer, or other terminal. In some embodiments, server 102 is a background server for the target application or is a cloud server that provides services such as cloud computing and cloud storage.

In some embodiments, a target application served by the server 102 is installed on the terminal 101, and the terminal 101 can implement functions such as data transmission, message interaction, and the like through the target application. In some embodiments, the target application is a target application in the operating system of the terminal 101 or a target application provided for a third party. The target application has a communication function, through which the terminal 101 can receive and transmit session messages. For example, an account logged in to the target application can be added to multiple sessions, and session messages are issued in each added session, and then other accounts in the session can receive the session messages issued by the account through the target application. Of course, the target application can also have other functions, such as a shopping function, a live function, a game function, etc., to which the present disclosure is not limited. In some embodiments, the target application is an instant messaging application, a short video application, a music application, a gaming application, a shopping application, or other applications, which the present disclosure does not limit.

In the embodiment of the present disclosure, the target application includes a virtual robot, where the virtual robot is configured to implement a certain operation, and correspondingly, the implementation environment further includes a third party server 103 that provides the virtual robot, where the third party server 103 is a background server of the virtual robot or a cloud server that provides services such as cloud computing and cloud storage, and the third party server 103 is connected to the terminal 101 and the server 102 through a wireless or wired network.

In the embodiment of the present disclosure, the third party server 103 is configured to send the virtual robot to the terminal 101, where the terminal 101 is configured to add the virtual account number corresponding to the virtual robot to the address book of the current login account number, and then can call the virtual robot to execute the operation indicated by the robot call instruction in response to the robot call instruction corresponding to the virtual robot, which is input in any input control of the target application.

The virtual robot-based operation method provided by the present disclosure can be applied to a scenario in which any operation is performed by a target application. For example, if a user wants to search for a document related to an automobile, the user only needs to input a search instruction including a search word "automobile" in any input control of the target application, and then the terminal searches for the document related to the automobile by using the method provided by the disclosure, and displays the searched document to the user. For another example, if the user wants to punch a card in the target application, the terminal can perform the card punching operation in the target application by the method provided by the disclosure only by inputting the card punching instruction in any input control of the target application. For another example, if the user wants to switch the state of the current login account in the target application, the terminal only needs to input a state switching instruction in any input control of the target application, and then switches the login state of the current login account in the target application to an offline state through the method provided by the disclosure.

Fig. 2 is a flowchart illustrating a virtual robot-based operation method, as shown in fig. 2, for use in a terminal, according to an exemplary embodiment, including the following steps.

201. Based on any input control of the target application, input information is obtained.

202. When the input information satisfies the robot call condition, the input information is determined as a robot call instruction, and the robot call condition is a condition that the robot call instruction inputted when the virtual robot is called should satisfy.

203. And calling a virtual robot corresponding to the robot calling instruction, and executing the operation indicated by the robot calling instruction.

In some embodiments, in a case where the input information satisfies the robot call condition, determining the input information as the robot call instruction includes:

and under the condition that the input information comprises the virtual account number and the address book of the current login account number comprises the virtual account number, determining the input information as a robot calling instruction, wherein the virtual account number is an account number corresponding to the virtual robot.

In some embodiments, in a case where the input information includes a virtual account number and the address book of the current login account number includes the virtual account number, determining the input information as the robot call instruction includes:

And under the condition that the input information comprises a first target character and a virtual account number positioned behind the first target character, and the address book of the current login account number comprises the virtual account number, determining the input information as a robot call instruction, wherein the first target character is a character for identifying the robot call instruction.

In some embodiments, invoking the virtual robot corresponding to the robot invocation instruction, performing the operation indicated by the robot invocation instruction, includes:

and calling the virtual robot, and sending a robot calling instruction to a third-party server corresponding to the virtual robot, wherein the third-party server is used for responding to the robot calling instruction.

In some embodiments, the robot call instruction is a search instruction, where the search instruction includes a search parameter, calls the virtual robot, and after sending the robot call instruction to a third party server corresponding to the virtual robot, the operation method based on the virtual robot further includes:

receiving at least one search result returned by the third-party server, wherein the at least one search result is obtained by searching by the third-party server based on the search parameters;

at least one search result is displayed in the current display interface.

In some embodiments, after displaying the at least one search result in the current display interface, the virtual robot-based operation method further comprises:

in response to a selection operation of any one of the search results, displaying a session identification list including a session identification of at least one session in the target application; and responding to the selection operation of any session identifier, and releasing the selected search result into the session corresponding to the selected session identifier.

In some embodiments, invoking the virtual robot, sending a robot invocation instruction to a third party server corresponding to the virtual robot, includes:

and calling the virtual robot, sending a robot calling instruction to a service interface corresponding to the robot calling instruction, and responding the robot calling instruction through the service interface by a third-party server.

In some embodiments, the robot call instruction is a card punching instruction, calls a virtual robot corresponding to the robot call instruction, and executes an operation indicated by the robot call instruction, including:

and calling the virtual robot to execute a card punching operation, wherein the card punching operation is an operation of recording the environment information of the current login account in the target application.

responding to the triggering operation of adding a control to the robot, displaying a robot display interface, wherein the robot display interface comprises at least one virtual robot provided by a third-party server;

In some embodiments, the robot presentation interface includes a robot creation control therein, and the virtual robot-based method of operation further includes:

acquiring input robot information based on a robot creation interface;

creating a virtual robot conforming to the robot information, and displaying the created virtual robot in a robot presentation interface.

In some embodiments, the virtual robot has a corresponding target control and a target operation, where the target operation is an operation allowed to be executed in a session where a virtual account corresponding to the virtual robot is located, and the target control is used to trigger to execute the target operation, and the operation method based on the virtual robot further includes:

And adding the target control in a session interface corresponding to the session in response to adding the virtual account number corresponding to the virtual robot to any session of the target application.

In some embodiments, in response to adding the virtual account number corresponding to the virtual robot to any session of the target application, adding the target control in the session interface corresponding to the session includes:

adding a target control in a menu corresponding to the session message in the session interface;

the virtual robot-based operation method further comprises the following steps: and responding to the menu calling operation of any session message, displaying a menu corresponding to the session message in the session interface, wherein the menu comprises a target control.

In some embodiments, the target operation includes an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and after displaying a menu corresponding to the session message in the session interface, the operation method based on the virtual robot further includes:

responding to triggering operation of the target control, and calling the virtual robot to read session information corresponding to the target control;

and sending the session message to the third party server.

In some embodiments, the target operation includes an operation of sending a task creation request to a third party server corresponding to the virtual robot, and after displaying a menu corresponding to the session message in the session interface, the virtual robot-based operation method further includes:

Responding to triggering operation of the target control, and calling the virtual robot to read session information corresponding to the target control and the current login account;

and sending a task creation request to a third-party server, wherein the task creation request carries a session message and a current login account, and the third-party server is used for creating a target task taking the session message as task content for the current login account.

responding to the second target character input in the message input field of the conversation interface corresponding to any conversation, and displaying a conversation instruction corresponding to the virtual account number in the conversation interface when the conversation comprises the virtual account number corresponding to the virtual robot, wherein the second target character is used for triggering and displaying the conversation instruction;

and responding to the triggering operation of any displayed session instruction, issuing the session instruction into the session, calling the virtual robot, sending the session instruction to a service interface corresponding to the session instruction, and responding to the session instruction through the service interface by a third-party server corresponding to the virtual robot.

when the session comprises the virtual account number, calling the virtual robot, sending a message processing request to a third party server corresponding to the virtual robot, wherein the message processing request carries a first session message, and the third party server is used for generating a control instruction corresponding to the first session message and returning the control instruction;

receiving a message release request sent by a third-party server corresponding to the virtual robot, wherein the message release request carries a second session message, a virtual account number and a network hook webhook address, and the webhook address is used for identifying a unique corresponding session;

and responding to the conversation corresponding to the webhook address to comprise a virtual account number corresponding to the virtual robot, and issuing a second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

In some embodiments, the virtual robot created by the virtual robot for the current login account, the target application includes an information configuration entry of the virtual robot, and the operation method based on the virtual robot further includes:

and configuring robot information of the virtual robot based on the information input operation in the information configuration interface.

In some embodiments, the information configuration interface includes an instruction configuration control, and the configuration of the robot information of the virtual robot based on the information input operation in the information configuration interface includes:

responding to the triggering operation of the command configuration control, and displaying a command configuration interface of the virtual robot;

Fig. 3 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment, including the following steps, as shown in fig. 3.

301. And the terminal responds to the triggering operation of adding a control to the robot in the target application, and displays a robot display interface, wherein the robot display interface comprises at least one virtual robot provided by a third-party server.

The target application is any application, such as an instant messaging application, a short video application, a music application, a game application, a shopping application, or other applications. The target application comprises a robot adding control, wherein the robot adding control is used for indicating to add the virtual robot in the address book of the target application. The address book is used for recording an account number of a contact corresponding to the current login account or a session added by the current login account, and after the account number of a certain contact is added to the address book of the current login account, a user corresponding to the current login account can send a message between the target application and the contact. The session refers to a message group consisting of accounts, the session comprises at least two accounts, and session messages issued by any account in the session can be received by other accounts in the session. One account number of the at least two account numbers is a current login account number of the terminal. For example, the first session is composed of an account a, an account B, and an account C, and when the account a issues a session message in the session, the account B and the account C can both receive the session message. Each session has a session identification that characterizes the corresponding session, such that the session identification can be utilized to distinguish between different sessions. For example, the session identification is an identification of a session name, a session number, or the like.

The virtual robot is an artificial intelligent robot which can be on line at any time and communicate with people through natural language. In the embodiment of the present disclosure, the virtual robot is capable of performing various operations, such as a weather query operation, a map query operation, a translation operation, a data statistics operation, a game operation, a card punching operation, an operation of uploading a session message to a third party server or transmitting a task creation request, etc., which the embodiment of the present disclosure does not limit.

In some embodiments, the virtual robots provided by the third party servers are included in the robot presentation interface, wherein each third party server is configured to provide operational services for a corresponding virtual robot.

In some embodiments, the robot presentation interface includes at least one virtual robot and functional description information for each virtual robot. The function description information is used for describing operations that the robot can perform, and a method for triggering the virtual robot to perform the operations by a user. In some embodiments, the functional description information of each robot in the robot presentation interface includes at least one of text information, picture information, and video information. The picture information is a schematic process diagram of the virtual robot executing corresponding operation, and the video information is a video of the virtual robot executing corresponding operation. In the embodiment of the disclosure, the functions of the virtual robot are described in the form of videos or pictures, so that a user can more intuitively know the functions and the usage of the virtual robot.

In some embodiments, the robot display interface further comprises a robot search control, the user can search the virtual robot through the robot search control, and correspondingly, the terminal obtains search words input in the robot search control; acquiring a target robot matched with the search word and provided by a third-party server; the target robot is displayed in a robot presentation interface.

In some embodiments, the search term includes at least one of a robot name, a robot number, a maker name of the robot. Of course, the search terms can also be other, and the embodiments of the present disclosure are not limited in this regard.

In the embodiment of the disclosure, by displaying the robot search control in the robot display interface, a user can quickly search the target robot matched with the search word only by inputting the search word in the search control, so that the efficiency of searching the target robot is greatly improved.

Fig. 4 is a schematic view of a robot display interface, and referring to fig. 4, the robot display interface includes information such as two virtual robots, a robot name of each virtual robot, a producer, a robot head, and the number of sessions using the virtual robots. The robot display interface also comprises a search control, and when no search word is input in the search control, two words of search are displayed in the search control. Referring to fig. 5, after a search word "robot" is input in the search control, a searched robot L is displayed in the robot presentation interface.

In some embodiments, the robot presentation interface includes a robot creation control, on the basis of which a user can create a virtual robot, and the terminal displays the robot creation interface in response to a trigger operation of the robot creation control; acquiring input robot information based on a robot creation interface; creating a virtual robot conforming to the robot information, and displaying the created virtual robot in a robot presentation interface.

Wherein the robot creation interface is used to create a virtual robot. In some embodiments, the robot creation interface includes a robot information input field in which a user can input information of the virtual robot, and the terminal can create the virtual robot based on the information of the virtual robot input by the user. In some embodiments, the robot information includes information of a robot name, a robot head, a number of the robot, a profile of the robot, and the like. Of course, the robot information can also include other information, such as a robot call instruction for calling the virtual robot, to which the embodiments of the present disclosure are not limited.

With continued reference to fig. 5, a robot creation control is also included in the robotic presentation interface, with a "create robot" displayed in the robot creation control for prompting a user to trigger the robot creation control to create a virtual robot. Referring to fig. 6, after the robot creation control in fig. 5 is triggered, the robot creation interface shown in fig. 6 is displayed, where the robot creation interface includes a name input field, a robot number input field, a profile input field, and an avatar setting control. After the user inputs various robot information in the robot creation interface, the user triggers the "create" option, so that a virtual robot conforming to the input robot information can be created. FIG. 7 is a schematic diagram of a robot creation interface after a virtual robot is successfully created. Referring to fig. 7, the robot creation interface further includes a network hook address automatically generated for the created virtual robot, and an entry of an information configuration interface corresponding to the virtual robot. The server can trigger the virtual robot to issue the issued content in the session by issuing the content to the network hook address after the virtual robot is added to the session. The portal of the information configuration interface is displayed with prompt information for configuring more functions, and the prompt information is used for prompting a user to enter the information configuration interface of the virtual robot based on the portal.

302. The terminal responds to the selection operation of any virtual robot in the robot display interface, and adds the virtual account corresponding to the selected virtual robot to the address book.

The account numbers are used for distinguishing different users, and after the users register information in the server corresponding to the target application, the users can acquire one account number. The server can then distinguish between different users by account numbers. In the disclosed embodiment, the account numbers include virtual account numbers and real account numbers. The virtual account number refers to an account number corresponding to the virtual robot, and the real account number refers to an account number corresponding to the real user.

After the virtual account number corresponding to the virtual robot is added to the address book, the terminal can call the virtual robot to execute the operation corresponding to the virtual robot.

303. The terminal obtains input information based on any input control of the target application.

The input control is any control capable of inputting information in the target application, for example, a search control, a message input control and the like, and the input control is located at any interface in the target application, for example, an address book display interface of the target application, a session interface of the target application and the like, wherein the address book display interface is used for displaying an address book of a current login account, and the session interface is a session interface corresponding to a session in the target application and is used for sending and receiving session messages. The input controls and interfaces at which the input controls are located are merely exemplary, and embodiments of the present disclosure are not limited in this regard. Input information refers to information input in the input control, and the input information is arbitrary content, which is not limited by the embodiments of the present disclosure.

304. And the terminal determines the input information as a robot call instruction under the condition that the input information meets the robot call condition.

The robot call condition is a condition which is to be satisfied by a robot call instruction input when the virtual robot is called. In the embodiment of the disclosure, if a user wants to call a certain virtual robot to execute an operation, a robot call instruction corresponding to the virtual robot can be input in an input control of a target application, and in this way, the virtual robot is called to execute the operation indicated by the robot call instruction. Therefore, after the user inputs information in the input control, the terminal firstly judges whether the input information meets the robot call condition so as to determine whether the input information is a machine call instruction, and if the input information is the robot call instruction, the terminal responds to the robot call instruction and calls the virtual robot to execute the operation indicated by the robot call instruction.

In some embodiments, the robot call conditions are: the input information includes a virtual account number, and the virtual account number is a virtual account number in an address book of the current login account number. Correspondingly, when the input information meets the robot call condition, the terminal determines the input information as a robot call instruction, which comprises the following steps: and under the condition that the input information comprises the virtual account number and the address book of the current login account number comprises the virtual account number, the terminal determines the input information as a robot calling instruction. The virtual account number is an account number corresponding to the virtual robot.

In some embodiments, the robot call conditions are: the input information includes a first target character and a virtual account number located after the first target character, and the virtual account number is a virtual account number in an address book of the current login account number. Correspondingly, when the input information includes the virtual account number and the address book of the current login account number includes the virtual account number, the terminal determines the input information as a robot call instruction, including: and under the condition that the terminal comprises a first target character and a virtual account number positioned behind the first target character in the input information and the address book of the current login account number comprises the virtual account number, the input information is determined to be a robot calling instruction.

The first target character is a character for identifying a robot call instruction. The first target character is any character, e.g., "@", which is not limiting in accordance with the disclosed embodiments.

In some embodiments, the robot call conditions are: the input information includes a first target character and a virtual account number located after the first target character, wherein the first target character is not preceded by any information, and the virtual account number is a virtual account number in an address book of a current login account number. In the embodiment of the disclosure, by further limiting the first target character in the robot call condition without any information, the judgment of the robot call instruction can be further accurate, the false call of the virtual robot is avoided, and the operation accuracy is improved.

305. The terminal calls the virtual robot corresponding to the robot call instruction, sends the robot call instruction to a third party server corresponding to the virtual robot, and the third party server is used for responding to the robot call instruction.

After the terminal determines that the user inputs the robot calling instruction, the terminal calls the virtual robot corresponding to the robot calling instruction, executes the operation indicated by the robot calling instruction, and calls the virtual robot corresponding to the robot calling instruction, wherein one method for executing the operation indicated by the robot calling instruction is as follows: and calling the virtual robot corresponding to the robot calling instruction, and sending the robot calling instruction to a third-party server corresponding to the virtual robot so as to instruct the third-party server to respond to the robot calling instruction.

In some embodiments, the terminal invokes the virtual robot, and sends a robot invoking instruction to a third party server corresponding to the virtual robot, including: the terminal calls the virtual robot, sends a robot call instruction to a service interface corresponding to the robot call instruction, and the third-party server is used for responding to the robot call instruction through the service interface.

The service interface is used for the terminal to send the robot call instruction and is used for the third-party server to receive the robot call instruction so as to respond to the robot call instruction. For example, the service interface is a URL (Uniform Resource Locator ) of HTTP (Hyper Text Transfer Protocol, hypertext transfer protocol) or HTTPs (Hyper Text Transfer Protocol over Secure Socket Layer, hypertext transfer security protocol), which the disclosed embodiments do not limit.

It should be noted that, in the embodiment of the present disclosure, the manner in which the third party server responds to the robot call instruction is determined by the third party server. For example, the third party server responds to the robot call instruction by returning a session message, which is issued by the terminal in the selected session. For another example, the third-party server responds to the robot call instruction by returning a page address, and displaying a page corresponding to the page address by the terminal. For another example, the third party server performs an operation corresponding to the function of the robot call instruction, but does not return information. For example, a timed task is established in the associated application at a third party server. Of course, the manner in which the third party server responds to the robot call instruction can also be other manners, which are not limited by the embodiments of the present disclosure.

In some embodiments, the robot call instruction is a search instruction, where the search instruction includes a search parameter; correspondingly, the terminal calls the virtual robot, after sending a robot call instruction to a third-party server corresponding to the virtual robot, the third-party server responds to receiving the robot call instruction, searches based on the search parameters to obtain at least one search result, and returns the at least one search result to the terminal. And then, the terminal receives at least one search result returned by the third-party server, and at least one search result is displayed in the current display interface.

The search instruction is any information search instruction, for example, a picture search instruction and a document search instruction, which is not limited in the embodiment of the present disclosure. The search parameter is key information required when searching is performed, for example, when the search instruction is a picture search instruction, the search parameter is a key word indicating a picture type or picture content. As another example, when the search instruction is a document search instruction, the search parameter is a keyword indicating a document type or document content.

In some embodiments, the terminal receives at least one search result returned by the third party server, and displays the at least one search result in the current display interface, including: the terminal displays a search result display window in the current display interface, and displays at least one search result in the search result display window.

In some embodiments, the terminal displays a search result display window in the current display interface, and displays the at least one search result in the search result display window, including: the terminal determines the number of the search results, and displays the at least one search instruction in the search result display window in response to the number of the search results being not greater than a first reference number; or, in response to the number of the search results being greater than the first reference number, performing paging display on at least one search result, that is, displaying part of the search results in the search result display window, displaying a page turning control in the search result display window, and in response to the triggering operation of the page turning control, displaying another part of the search results in the search result display window. The number of search results displayed at one time in the search window can be set to any number, for example, 3, which is not displayed in the embodiment of the present disclosure. In the embodiment of the disclosure, under the condition of more search results, the search results are displayed in a paging mode, and only part of the search results are displayed in the search result display window at each time, so that the display effect of the search results can be improved.

In some embodiments, the constituent elements of each search result include at least one of a picture, a title, and descriptive information, where the title is the title of the search result and the descriptive information is descriptive information of the search result. For example, if the search result is a document, the title is the title of the document, and the description information includes the author of the document, the creation time, etc., which the embodiments of the present disclosure do not limit.

In some embodiments, the robot call instruction has corresponding call prompt information for prompting the business parameters that need to be input when the robot call instruction is invoked. When a user inputs a robot call instruction in an input control, the terminal displays the call prompt information under the condition that the service parameters are not input yet so as to prompt the user to input the service parameters corresponding to the robot call instruction. For example, in the case that the robot call instruction is a search instruction, the call prompt information is used to prompt a search parameter that needs to be input when the search instruction is called.

In the embodiment of the disclosure, through setting the call prompt information corresponding to the robot call instruction, when the user calls the virtual robot, the user can be prompted to input the service parameters through the call prompt information, so that the user is helped to input the complete robot call instruction, the virtual robot is successfully called, and the user viscosity is improved.

Fig. 8 is a schematic diagram of inputting a robot call instruction in a message input field. Referring to fig. 8, after a user inputs "@ document" in a message input field, a terminal acquires the input information, determines that the input information includes a first target character "@" and a virtual account number "document" after the first target character, determines that a document search instruction is input by the user after determining that the virtual account number is included in an address book of a current login account number, and then displays a call prompt message "please input keywords of a document to be searched" corresponding to the document search instruction at the back of a cursor so as to prompt the user to input search parameters. Fig. 9 is a schematic diagram of a search result display interface, and referring to fig. 9, after the user continues to input the search parameter "car" after the "@ document", three search results are displayed in the current session interface, namely, a car-related document 1, a car-related document 2 and a car-related document 3. And each search result includes the author and creation time of the searched document.

In some embodiments, the user is also able to select search results and publish the selected search results into the session. Correspondingly, after at least one search result is displayed in the current display interface, the terminal responds to the selection operation of any one search result, and the selected search result is released into the first session. The first session is a session corresponding to a session interface where any input control is located. Or, the terminal responds to the selection operation of any search result, and displays a session identification list, wherein the session identification list comprises the session identification of at least one session in the target application; and the terminal responds to the selection operation of any session identifier and issues the selected search result to the session corresponding to the selected session identifier.

In some embodiments, the terminal responds to the hovering operation in the display area of any search result, and displays release prompt information, wherein the release prompt information is used for prompting the search result to be released into the session, so that the user is helped to complete the release operation of the search result, and the user viscosity is improved. The hover operation refers to an operation of suspending an instruction input tool such as a mouse, a stylus, a finger, etc. above a certain area in a display screen but not clicking.

With continued reference to fig. 9, when the user hovers over the display area of the search result "car-related document 1", the right side of the "car-related document" is displayed with a release prompt message "send into session" to prompt the user to release the "car-related document" into session. After the user clicks the "car related document 1", the terminal issues the "car related document" to the session corresponding to the current session interface, or issues the "car related document" to the session selected by the user based on the displayed session identification list.

The above 305 describes the manner in which the robot call instruction is sent to the third party server and the third party server responds to the robot call instruction. For example, the robot call instruction is a card punching instruction, the terminal calls a virtual robot corresponding to the robot call instruction, and executes an operation indicated by the robot call instruction, including: and the terminal calls the virtual robot to execute the card punching operation. The card punching operation is an operation of recording the environment information of the current login account in the target application. For example, the environment information includes at least one of current time information or location information.

In some embodiments, the terminal will only publish the search results selected by the user into the session, and will not publish the input information in the input control into the session. And after the terminal successfully issues the search result in the session, the input information in the input control is automatically emptied.

It should be noted that, the embodiment corresponding to fig. 3 above describes a method of adding a virtual account number corresponding to a virtual robot to an address book and invoking the virtual robot within the global scope of the target application, and in some embodiments, the virtual robot can be authorized to a session, that is, the virtual account number corresponding to the virtual robot can be added to the session, so as to implement an operation of invoking the virtual robot to execute the session to allow execution. The following is a specific content.

Fig. 10 is a flowchart illustrating a virtual robot-based operation method, as shown in fig. 10, for use in a terminal, according to an exemplary embodiment, including the following steps.

1001. And the terminal responds to the virtual account number corresponding to the virtual robot to be added into any session of the target application, and adds a target control corresponding to the virtual robot into a session interface corresponding to the session.

The virtual robot is provided with a corresponding target control and target operation, and the target control is used for triggering and executing the target operation. And, the target operation is an operation allowed to be executed in the session where the virtual account number corresponding to the virtual robot is located. That is, when the user adds the account corresponding to the virtual robot to the session, the user can call the virtual robot to execute the target operation.

In some embodiments, the adding, by the terminal, the virtual account number corresponding to the virtual robot to any session of the target application includes: and the terminal responds to the triggering operation of the robot adding control in the session interface corresponding to any session, displays a robot display interface, and adds the virtual robot selected from the robot display interface into the session.

In some embodiments, after the terminal displays the robot presentation interface, in response to a selection operation of a virtual robot in the robot presentation interface, an address book option and a session option are displayed, in response to a selection operation of the address book option, the virtual robot is added to the address book, or in response to a selection operation of the session option, the virtual robot is added to the session, or in response to a full selection operation of the address book and the session, the virtual robot is added to the address book, and the virtual robot is added to the session.

In some embodiments, the adding, by the terminal, a target control in a session interface corresponding to a session in response to adding a virtual account number corresponding to a virtual robot to any session of a target application includes: and adding a target control in a menu corresponding to the session message in the session interface by the terminal.

At least one control corresponding to the session message is displayed in a menu corresponding to the session message, for example, a withdraw control is included in the menu corresponding to the session message, and is used for withdrawing the session message. For another example, the menu corresponding to the session message includes a forwarding control for forwarding the session message to other sessions. Of course, other controls can also be included in the menu corresponding to the session message, which is not limited by the embodiments of the present disclosure.

In some embodiments, the virtual robot to which the target control belongs, the name of the target control, and the like are displayed in the target control, and of course, other information can also be displayed in the target control, which is not limited by the embodiments of the present disclosure.

After adding a target control in a menu corresponding to each session message in the session interface, the terminal responds to the menu calling operation of any session message, and displays the menu corresponding to the session message in the session interface, wherein the menu comprises the target control.

1002. And the terminal responds to the triggering operation of the target control and calls the virtual robot to execute the target operation corresponding to the virtual robot.

In some embodiments, the target control is a translation control, the target operation is a translation operation, and correspondingly, the terminal responds to a triggering operation of the translation control to translate the session message corresponding to the translation control into the session message belonging to other languages, and displays the translated session message. For example, conversation messages belonging to chinese are translated into conversation messages belonging to english. Therefore, if the user needs to translate the session message into the session message of other languages, the user does not need to jump from the current target application to other translation software, and the translation function of the session message can be directly realized in the target application, so that the method is simple and efficient.

In the embodiment of the disclosure, when the translation operation needs to be extended in the target application, only the virtual robot for realizing the translation operation needs to be added into the session, and the translation control can be added in the session interface based on the virtual robot, so that the translation operation of the session message is realized by triggering the translation control, the target application does not need to be updated, the flexibility of the extension operation is improved, and the extension cost is reduced.

In some embodiments, the terminal responds to the triggering operation of the translation control, displays a translation interface, wherein the translation interface comprises a language selection control, the terminal determines a translated target language based on the language selection control, then translates the session message corresponding to the translation control into a session message belonging to the target language, and displays the translated session message in the translation interface. Thus, the user can freely select the target language to be translated through the language selection control, and the user viscosity is improved.

In some embodiments, the target control comprises a message uploading control, the target operation comprises an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and correspondingly, the terminal calls the virtual robot to read the session message corresponding to the target control in response to a triggering operation on the target control; and sending the session message to the third party server. In some embodiments, the terminal sending a session message to a third party server, comprising: and the terminal sends the session message to the service interface corresponding to the target control. Accordingly, the third party server receives the session message through the service interface. In some embodiments, after receiving the session message, the third party server performs an operation based on the session message, where the operation performed by the third party server based on the session message can be any operation, which is not limited by embodiments of the present disclosure.

In some embodiments, the target control comprises a task creation control, the target operation comprises an operation of sending a task creation request to a third-party server corresponding to the virtual robot, and correspondingly, the terminal calls the virtual robot to read a session message corresponding to the target control and a current login account in response to a triggering operation on the target control; and sending a task creation request to a third-party server, wherein the task creation request carries a session message and a current login account. The third party server is used for creating a target task taking the session message as task content for the current login account. In some embodiments, after receiving the task creation request, the third party server creates a target task with the session message as task content for the current login account in a third party application corresponding to the third party server.

In some embodiments, after the terminal invokes the virtual robot to read the session message corresponding to the task creation control and the current login account, the terminal displays a task creation interface, where the task creation interface includes the session message corresponding to the task creation control; the terminal acquires input task information based on a task creation interface; the task creation request sent to the third-party server also carries task information, and the third-party server is used for creating a target task which takes the session message as task content and contains the task information for the current login account.

In some embodiments, the task information includes a term of the task, an identification of the task, a type of the task, an account number for issuing the task, and the like, which is not limited by embodiments of the present disclosure. In some embodiments, the task creation interface includes at least one information input field corresponding to the task information, and the terminal obtains the task information input in each information input field.

In the embodiment of the disclosure, the task creation interface is displayed, so that a user can perfect task information based on the task creation interface, and a third party server can create a target task with richer task information for a current login account.

Fig. 11 is a schematic diagram of displaying a target control in a menu corresponding to a session message. Referring to fig. 11, when a session message pointed by an arrow is triggered, a menu corresponding to the session message is displayed, where the menu includes a copy control, a collection control, a remark control, and two target controls, and controls are created for a message upload control and a task respectively.

In some embodiments, the virtual robot has a corresponding session instruction, and in the case that the virtual account number corresponding to the virtual robot is added to a certain session, the virtual robot can be invoked to execute an operation indicated by the session instruction in the session. Correspondingly, in some embodiments, the terminal responds to the input of a second target character in a message input field of a session interface corresponding to any one session, and when the session comprises a virtual account corresponding to the virtual robot, a session instruction corresponding to the virtual account is displayed in the session interface; and the terminal responds to the triggering operation of any displayed session instruction, issues the session instruction into the session, calls the virtual robot and sends the session instruction to the service interface corresponding to the session instruction. And then, the third party server corresponding to the virtual robot responds to the session instruction through the service interface.

The virtual account number has a corresponding session instruction, and when the virtual account number joins the session, the user can call the virtual robot corresponding to the virtual account number through the session instruction corresponding to the virtual account number. The session instruction is used for calling the virtual robot to execute the operation indicated by the session instruction. For example, if the session instruction is a weather inquiry instruction, the virtual robot sends the weather inquiry instruction to the third party server, receives weather information returned by the third party server, and issues the weather information in the session. In some embodiments, one virtual account number can correspond to a plurality of different session instructions, each session instruction for invoking the virtual robot, and each session instruction invoking an operation performed by the virtual robot that is different.

The second target character is used for triggering a display session instruction. The second target character can be set to any character, for example, the second target character is "/", which is not limited by the embodiments of the present disclosure. In some embodiments, the second target character is entered to trigger a display session instruction when no other characters have been entered in the message input field. And if the second target character is input after other characters are input in the message input field, treating the second target character as a common character. In addition, if the second target character is input after the conversation instruction is triggered to be displayed, other characters are input before the second target character, the conversation instruction is not displayed any more, and the second target character is treated as a common character.

In some embodiments, the terminal issues a session instruction into the session in response to a trigger operation on any of the displayed session instructions, including: the terminal displays the session instruction in the message input field in response to a trigger operation on any of the displayed session instructions, and issues the session instruction into the session in response to receiving the acknowledgement transmission operation. In some embodiments, after the terminal displays the session instruction in the message input field, receives information input after the session instruction, and issues the session instruction together with the information into the session in response to receiving the determination to send operation. Correspondingly, the session instruction and the information are issued into the session together, and the session instruction and the information are sent to the service interface corresponding to the session instruction. The third party server receives the session instruction and the information through the service interface, identifies a service parameter from the information, and responds to the session instruction based on the service parameter.

In the disclosed embodiments, the manner in which the third party server responds to the session instruction is determined by the third party server. For example, the third party server responds to the session instruction by returning a session message that is published in the session by the virtual robot. For another example, the third party server responds to the session instruction by returning a page address, and displaying a page corresponding to the page address by the terminal. For another example, the third party server performs an operation corresponding to the function of the session instruction, but does not return information. For example, a timed task is established in the associated application at a third party server. Of course, the manner in which the third party server responds to the session instruction can also be other manners, which are not limited by the embodiments of the present disclosure.

Fig. 12 is a schematic diagram showing a session instruction in a session interface. Referring to fig. 12, after the second target character "/" is input in the message input field, three session commands, session command H, session command F, and session command G, respectively, are displayed in the session interface. The session instruction H belongs to a robot L, the session instruction F belongs to a robot O, the session instruction G belongs to a robot P, and when the session instruction H is triggered, the session instruction H is issued in a session and the session instruction H is sent to a service interface corresponding to the session instruction H.

The above-described embodiment corresponding to fig. 10 mainly describes a method of authorizing a virtual robot into a session to extend a control in a target application. In practice, after the virtual robot is authorized to the session, the third party server corresponding to the virtual robot can also control the target application by using the virtual robot, which is described in detail below.

Fig. 13 is a flowchart illustrating a virtual robot-based operation method, as shown in fig. 13, for use in a terminal, according to an exemplary embodiment, including the following steps.

1301. The terminal acquires a first session message issued in any session, and the first session message marks a virtual account corresponding to the virtual robot as a receiving account.

For example, a "@ virtual account number" is marked in the first session message, which indicates that the virtual account number is a receiving account number corresponding to the first session message, and the receiving object of the first session message is the virtual robot.

1302. And under the condition that the session comprises the virtual account number, the terminal calls the virtual robot, sends a message processing request to a third party server corresponding to the virtual robot, wherein the message processing request carries a first session message, and the third party server is used for generating a control instruction corresponding to the first session message and returning the control instruction.

After the user authorizes the virtual robot into the session, namely, after the virtual account number corresponding to the virtual robot is added into the session, the third party server corresponding to the virtual robot can control the target application by using the virtual robot. Therefore, after acquiring the first session message in the session, the terminal determines whether the session includes the virtual account number, and when determining that the session includes the virtual account number, the terminal invokes the virtual robot and sends a message processing request to a third party server corresponding to the virtual robot.

In some embodiments, the terminal may further carry other information besides the first session message in the message processing request, for example, the account number for issuing the first session message, the session identifier of the session for issuing the first session message, the virtual account number, and other information may be carried in the message processing request, which is not limited by the embodiments of the present disclosure.

And the third party server responds to the received message processing request and generates a control instruction corresponding to the first session message.

In some embodiments, the implementation manner of the third party server generating the control instruction corresponding to the first session message is as follows: the third party server identifies the instruction keywords in the first session message, determines the content matched with the instruction keywords in the first session message as instruction content, and generates control instructions corresponding to the instruction keywords and the instruction content.

Among these, there are various types of instruction keywords, for example, an instruction keyword for instructing to modify session information, an instruction keyword for instructing to create a session, an instruction keyword for instructing to add an account in a session, and the like. The content matched with the instruction keyword indicating to modify the session information comprises modified target session information, the content matched with the instruction keyword indicating to create the session comprises session information to be created, and the content matched with the instruction keyword indicating to add an account in the session comprises a target account to be added. The above-described session content matching various types of instruction keywords is merely an exemplary illustration, and embodiments of the present disclosure are not limited thereto.

In the embodiment of the disclosure, since the instruction keywords in the session message can accurately indicate the intention of the user, the instruction keywords in the first session message are identified, the content matched with the instruction keywords in the first session message is determined as the instruction content, and the control instruction corresponding to the instruction keywords and the instruction content is generated, so that the control instruction can be ensured to accord with the intention of the user.

In some embodiments, the first session message includes an instruction keyword indicating modification of the session information and modified target session information. The instruction keyword indicating modification of the session information is any keyword, for example, "modification", "replacement", or the like. In some embodiments, the session information includes a session name, a session header, profile information for the session, and the like. Correspondingly, the third party server identifies the instruction keyword in the first session message, determines the content matched with the instruction keyword in the first session message as the instruction content, and generates the control instruction corresponding to the instruction keyword and the instruction content, and comprises the following steps: the third party server identifies an instruction keyword in the first session message, which indicates to modify the session information, and determines the content matched with the instruction keyword in the first session message as modified target session information; a session information modification instruction carrying target session information is generated.

In the embodiment of the disclosure, by setting the instruction keyword for indicating to modify the session information, the user only needs to issue the instruction keyword and the modified target session information in the session, and can trigger the third-party server to generate the session information modification instruction carrying the target session information, so as to control the target application to modify the session information, that is, the user can modify the session information by issuing the session information, and the operation is simple and efficient.

In some embodiments, the first session message includes an instruction keyword indicating to add an account number in the session and a target account number to be added, and accordingly, the third party server identifies the instruction keyword in the first session message, determines a content matching the instruction keyword in the first session message as an instruction content, and generates a control instruction corresponding to the instruction keyword and the instruction content, including: the third party server identifies an instruction keyword in the first session message, which indicates that an account is added in the session, and determines the content matched with the instruction keyword in the first session message as a target account to be added; and generating an account adding instruction carrying the target account.

In the embodiment of the disclosure, by setting the instruction keyword for indicating the account to be added in the session, the user only needs to issue the instruction keyword and the target account to be added in the session, and can trigger the third party server to generate the account adding instruction carrying the target account, so that the target application is controlled to add the account in the session, that is, the user can add the designated account in the session in a manner of issuing the session message, and the operation is simple and efficient.

In some embodiments, the first session message includes an instruction keyword indicating that a session is created and session information of the session to be created, and correspondingly, the third party server identifies the instruction keyword in the first session message, determines content matching the instruction keyword in the first session message as instruction content, and generates control instructions corresponding to the instruction keyword and the instruction content, including: the third party server identifies an instruction keyword in the first session message, which indicates to create a session, and determines the content matched with the instruction keyword in the first session message as session information of the session to be created; a session creation instruction carrying the session information is generated.

In the embodiment of the disclosure, by setting the instruction keyword for indicating to create the session, the user only needs to issue the session information including the instruction keyword and the session to be created in the session, and can trigger the third-party server to generate the session creation instruction carrying the session information, so as to control the target application to create the session, that is, the user can create the session by issuing the session message, and the operation is simple and efficient.

After the third party server generates the control instruction corresponding to the first session message, the third party server sends the control instruction to the terminal related to the control instruction. For example, if the control instruction is a session information modification instruction carrying target session information or if the control instruction is an account adding instruction carrying target account, the third party server determines a terminal of each account logged in the session as a terminal to which the control instruction relates. For another example, the control instruction is a session creation instruction carrying session information of a session to be created, where the session information includes a plurality of accounts in the session to be created, and the third party server determines a terminal logging in the plurality of accounts as a terminal involved in the control instruction.

In some embodiments, the third party server sends the control instruction to an application server corresponding to the target application, and the application server sends the control instruction to a terminal related to the control instruction.

1303. And the terminal responds to the received control instruction and executes processing operation based on the control instruction.

In some embodiments, the control instruction is a session information modification instruction carrying target session information, and the terminal modifies the original session information of the session to the target session information in response to receiving the session information modification instruction. For example, the target session information is a target session name, and the terminal modifies the original session name to the target session name.

In some embodiments, the control instruction is an account adding instruction carrying a target account, and accordingly, the terminal adds the target account in the session in response to receiving the account adding instruction.

In some embodiments, the control instruction is a session creation instruction carrying session information of a session to be created, and the terminal creates a session conforming to the session information in the target application in response to receiving the session creation instruction.

The above embodiment corresponding to fig. 13 mainly describes a method of modifying session information, adding an account number in a session, and creating a new session using a virtual robot control target application after authorizing the virtual robot into the session. In practice, after the virtual robot is authorized to the session, the virtual robot can also be used to issue a session message in the target application, which is described in detail below.

In some embodiments, the terminal receives a message publishing request sent by a third party server corresponding to the virtual robot, where the message publishing request carries a second session message, a virtual account number, and a network hook address, where the web hook address is used to identify a session that uniquely corresponds to the session; and the terminal responds to the conversation corresponding to the webhook address and comprises a virtual account number corresponding to the virtual robot, and issues a second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

It should be noted that, the virtual account corresponding to the virtual robot can be added to multiple sessions, and after the virtual account corresponding to the virtual robot is added to any session, a webhook address corresponding to the session is generated, and then when a third party server needs to issue a session message in a certain session by using the virtual robot, the terminal only needs to specify the webhook address corresponding to the session, and can learn that the session message is to be issued in the session.

In some embodiments, the terminal obtains a corresponding relationship between each session added by the virtual account number and the webhook address from a local database or an application server, and after receiving the message processing request, determines a session corresponding to the webhook address in the message publishing request based on the corresponding relationship.

It should be noted that the message publishing request can carry a plurality of webhook addresses, and the corresponding plurality of sessions corresponding to the webhook addresses by the terminal include virtual accounts corresponding to the virtual robots, and the virtual accounts are taken as publishing accounts, so that the second session message is published in the plurality of sessions corresponding to the webhook addresses. Therefore, the method and the device realize that the session messages are issued to a plurality of sessions at the same time, and improve the issuing efficiency of the session messages.

When the virtual robot is a virtual robot created by the current login account, the target application includes an information configuration entry of the virtual robot, through which the user can configure information of the virtual robot. The following embodiment corresponding to fig. 14 describes a method of configuring robot information.

Fig. 14 is a flowchart illustrating a virtual robot-based operation method according to an exemplary embodiment, as shown in fig. 14, including the following steps.

1401. And the terminal responds to the triggering operation of the information configuration entrance of the virtual robot in the target application, and displays an information configuration interface of the virtual robot.

The information configuration entry of the virtual robot can be set at any position in the target application, for example, a robot entry is provided in an address book in the target application, the robot entry is triggered, and the terminal displays at least one virtual robot created by the current login account and the information configuration entry of each virtual robot. It should be noted that, only if the current login account is the account for creating the virtual robot, the information configuration entry of the virtual robot will be displayed in the target application.

The user can edit the robot information of the virtual robot in the information configuration interface, wherein the robot information has various types, such as authority information of the virtual robot, instruction information of the virtual robot, name, number, head portrait of the virtual robot, and the like, which is not limited by the embodiments of the present disclosure.

1402. The terminal configures robot information of the virtual robot based on information input operation in the information configuration interface.

In some embodiments, the information configuration interface includes information input controls of various robot information, and after the terminal displays the robot information, the robot information of the virtual robot is configured based on information input operation in the information configuration interface.

In some embodiments, the information configuration interface includes an instruction configuration control, and the terminal configures robot information of the virtual robot based on an information input operation in the information configuration interface, including: the terminal responds to the triggering operation of the command configuration control and displays a command configuration interface of the virtual robot; based on the instruction configuration interface, an input session instruction and a service interface corresponding to the session instruction are acquired, wherein the service interface is an interface for sending the session instruction to a third-party server corresponding to the virtual robot.

Fig. 15 is a schematic diagram of an information configuration interface. Referring to fig. 15, the information configuration interface includes a plurality of information configuration controls, where one of the information configuration controls is an instruction configuration control, and the instruction configuration control displays a "session instruction" therein. And when the instruction configuration control is triggered, displaying an instruction configuration interface in the right area of the information configuration interface. An established session instruction is displayed in the instruction configuration interface. And a conversation instruction input box is also displayed in the instruction configuration interface and is used for inputting a new conversation instruction.

In some embodiments, the information configuration interface includes an instruction configuration control, and the terminal configures robot information of the virtual robot based on an information input operation in the information configuration interface, including: the terminal responds to the triggering operation of the command configuration control and displays a command configuration interface of the virtual robot; based on the instruction configuration interface, an input robot calling instruction and a service interface corresponding to the robot calling instruction are obtained, wherein the service interface is an interface for sending the robot calling instruction to a third-party server corresponding to the virtual robot. Note that, since the above-described robot call instruction can initiate a call to the virtual robot in any input control on the global of the target application, the robot call instruction is also referred to as a global shortcut.

Fig. 16 is a schematic diagram of an information configuration interface. Referring to fig. 16, the information configuration interface includes a plurality of information configuration controls, where one of the information configuration controls is an instruction configuration control, and the instruction configuration control has a "shortcut" displayed therein. And when the instruction configuration control is triggered, displaying an instruction configuration interface in the right area of the information configuration interface. The command configuration interface displays a created global shortcut, i.e. a robot call command. And the command configuration interface also displays a global shortcut currently created by the user, and the information of the created global shortcut comprises a shortcut name, a shortcut description and an operation for realizing, and the operation corresponds to the service interface.

It should be noted that, the method for configuring the robot information is described above by taking the robot call instruction and the session instruction as examples, and in practice, other information of the virtual robot, such as authority information, can be configured through the information configuration interface, which is not limited in the embodiments of the present disclosure.

Fig. 17 is a block diagram illustrating a virtual robot-based operation device according to an exemplary embodiment. Referring to fig. 17, the apparatus includes:

an information acquisition module 1701 configured to acquire input information based on any input control of the target application;

the instruction determining module 1702 is configured to determine the input information as a robot call instruction in the case where the input information satisfies a robot call condition, the robot call condition being a condition that the robot call instruction input at the time of calling the virtual robot should satisfy;

the first operation execution module 1703 is configured to call a virtual robot corresponding to the robot call instruction, and execute an operation indicated by the robot call instruction.

In some embodiments, the instruction determining module 1702 is configured to determine, when the input information includes a virtual account number and the address book of the current login account number includes the virtual account number, the input information as the robot call instruction, where the virtual account number is an account number corresponding to the virtual robot.

In some embodiments, the instruction determining module 1702 is configured to determine, when the input information includes a first target character and a virtual account number located after the first target character, and the address book of the current login account includes the virtual account number, the input information as the robot call instruction, where the first target character is a character for identifying the robot call instruction.

In some embodiments, the first operation execution module 1703 is configured to invoke the virtual robot, and send a robot invocation instruction to a third party server corresponding to the virtual robot, where the third party server is configured to respond to the robot invocation instruction.

In some embodiments, the robot call instruction is a search instruction, the search instruction including a search parameter,

the first operation execution module 1703 is further configured to receive at least one search result returned by the third party server, where the at least one search result is obtained by the third party server based on the search parameter; at least one search result is displayed in the current display interface.

the result issuing module is configured to issue the selected search result into a first session in response to the selection operation of any one search result, wherein the first session is a session corresponding to a session interface where any one input control is located; or, in response to a selection operation of any one of the search results, displaying a session identification list including a session identification of at least one session in the target application; and responding to the selection operation of any session identifier, and releasing the selected search result into the session corresponding to the selected session identifier.

In some embodiments, the first operation execution module 1703 is configured to invoke the virtual robot, send a robot invocation instruction to a service interface corresponding to the robot invocation instruction, and the third party server is configured to respond to the robot invocation instruction through the service interface.

In some embodiments, the robot call instruction is a punch instruction, and the first operation execution module 1703 is configured to call the virtual robot to perform a punch operation, where the punch operation is an operation of recording environmental information of the current login account in the target application.

In some embodiments, the target application includes a robot addition control, and the virtual robot-based operation device further includes:

the robot adding module is configured to respond to the triggering operation of adding a control to the robot, and display a robot display interface, wherein the robot display interface comprises at least one virtual robot provided by a third-party server; and responding to the selection operation of any virtual robot in the robot display interface, and adding the virtual account corresponding to the selected virtual robot into the address book.

the robot creating module is configured to respond to the triggering operation of the robot creating control and display a robot creating interface; acquiring input robot information based on a robot creation interface; creating a virtual robot conforming to the robot information, and displaying the created virtual robot in a robot presentation interface.

In some embodiments, the virtual robot has a corresponding target control and a target operation, where the target operation is an operation allowed to be executed in a session where a virtual account corresponding to the virtual robot is located, and the target control is used to trigger to execute the target operation, and the operating device based on the virtual robot further includes:

and the control adding module is configured to respond to adding the virtual account number corresponding to the virtual robot into any session of the target application, and add the target control in the session interface corresponding to the session.

In some embodiments, the control adding module is configured to add a target control in a menu corresponding to a session message in the session interface;

the virtual robot-based operation device further includes:

and the control display module is configured to respond to the menu calling operation of any session message, display a menu corresponding to the session message in the session interface, and the menu comprises a target control.

In some embodiments, the target operation includes an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and the operating device based on the virtual robot further includes:

the third operation execution module is configured to respond to the triggering operation of the target control and call the virtual robot to read the session message corresponding to the target control and the current login account; and sending a task creation request to a third-party server, wherein the task creation request carries a session message and a current login account, and the third-party server is used for creating a target task taking the session message as task content for the current login account.

the conversation instruction issuing module is configured to respond to the second target character input in the message input column of the conversation interface corresponding to any conversation, and the conversation instruction corresponding to the virtual account number is displayed in the conversation interface under the condition that the conversation comprises the virtual account number corresponding to the virtual robot, and the second target character is used for triggering and displaying the conversation instruction; and responding to the triggering operation of any displayed session instruction, issuing the session instruction into the session, calling the virtual robot, sending the session instruction to a service interface corresponding to the session instruction, and responding to the session instruction through the service interface by a third-party server corresponding to the virtual robot.

a fourth operation execution module configured to acquire a first session message issued in any session, the first session message marking a virtual account number corresponding to the virtual robot as a receiving account number; when the session comprises the virtual account number, calling the virtual robot, sending a message processing request to a third party server corresponding to the virtual robot, wherein the message processing request carries a first session message, and the third party server is used for generating a control instruction corresponding to the first session message and returning the control instruction; in response to receiving the control instruction, a processing operation is performed based on the control instruction.

the session message issuing module is configured to receive a message issuing request sent by a third-party server corresponding to the virtual robot, wherein the message issuing request carries a second session message, a virtual account number and a network hook webhook address, and the webhook address is used for identifying a unique corresponding session; and responding to the conversation corresponding to the webhook address to comprise a virtual account number corresponding to the virtual robot, and issuing a second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

In some embodiments, the virtual robot created by the virtual robot for the current login account, the target application includes an information configuration entry of the virtual robot, and the operating device based on the virtual robot further includes:

the configuration interface display module is configured to respond to the triggering operation of the information configuration inlet and display an information configuration interface of the virtual robot;

the information configuration module is configured to configure robot information of the virtual robot based on information input operation in the information configuration interface.

It should be noted that: in the virtual robot-based operation device provided in the above embodiment, only the division of the above functional modules is used for illustration when performing an operation, and in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the electronic device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the virtual robot-based operation device and the virtual robot-based operation method provided in the above embodiments belong to the same concept, and detailed implementation processes of the virtual robot-based operation device and the virtual robot-based operation method are detailed in the method embodiments, which are not described herein.

In an exemplary embodiment, there is also provided an electronic device including one or more processors and volatile or non-volatile memory for storing one or more processor-executable instructions configured to execute the instructions to implement the virtual robot-based operation method of the above-described embodiments.

Optionally, the electronic device is provided as a terminal. Fig. 18 shows a block diagram of a terminal 1800 according to an exemplary embodiment of the present application. The terminal 1800 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. The terminal 1800 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or the like.

The terminal 1800 includes: a processor 1801 and a memory 1802.

Processor 1801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1801 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1801 may also include a main processor and a coprocessor, the main processor being a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1801 may be integrated with a GPU (Graphics Processing Unit, image processor) for taking care of rendering and rendering of content that the display screen is required to display. In some embodiments, the processor 1801 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.

The memory 1802 may include one or more computer-readable storage media, which may be non-transitory. The memory 1802 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1802 is used to store at least one program code for execution by processor 1801 to implement the virtual robot-based method of operation provided by the method embodiments herein.

In some embodiments, the terminal 1800 may also optionally include: a peripheral interface 1803 and at least one peripheral. The processor 1801, memory 1802, and peripheral interface 1803 may be connected by a bus or signal line. The individual peripheral devices may be connected to the peripheral device interface 1803 by buses, signal lines or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1804, a display screen 1805, a camera assembly 1806, an audio circuit 1807, a positioning assembly 1808, and a power supply 1809.

The peripheral interface 1803 may be used to connect I/O (Input/Output) related at least one peripheral device to the processor 1801 and memory 1802. In some embodiments, processor 1801, memory 1802, and peripheral interface 1803 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 1801, memory 1802, and peripheral interface 1803 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 1804 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1804 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 1804 converts electrical signals to electromagnetic signals for transmission, or converts received electromagnetic signals to electrical signals. Optionally, the radio frequency circuit 1804 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuitry 1804 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuitry 1804 may also include NFC (Near Field Communication ) related circuitry, which is not limited in this application.

The display 1805 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 1805 is a touch display, the display 1805 also has the ability to collect touch signals at or above the surface of the display 1805. The touch signal may be input as a control signal to the processor 1801 for processing. At this point, the display 1805 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1805 may be one, providing a front panel of the terminal 1800; in other embodiments, the display 1805 may be at least two, disposed on different surfaces of the terminal 1800 or in a folded configuration; in other embodiments, the display 1805 may be a flexible display disposed on a curved surface or a folded surface of the terminal 1800. Even more, the display screen 1805 may be arranged in an irregular pattern other than rectangular, i.e., a shaped screen. The display 1805 may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.

The camera assembly 1806 is used to capture images or video. Optionally, the camera assembly 1806 includes a front camera and a rear camera. The front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1806 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.

The audio circuitry 1807 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1801 for processing, or inputting the electric signals to the radio frequency circuit 1804 for realizing voice communication. For stereo acquisition or noise reduction purposes, the microphone may be multiple, and disposed at different locations of the terminal 1800. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is then used to convert electrical signals from the processor 1801 or the radio frequency circuit 1804 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, the audio circuitry 1807 may also include a headphone jack.

The location component 1808 is utilized to locate a current geographic location of the terminal 1800 to enable navigation or LBS (Location Based Service, location-based services). The positioning component 1808 may be a positioning component based on the united states GPS (Global Positioning System ), the beidou system of china, the grainer system of russia, or the galileo system of the european union.

A power supply 1809 is used to power the various components in the terminal 1800. The power supply 1809 may be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1809 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the terminal 1800 also includes one or more sensors 1810. The one or more sensors 1810 include, but are not limited to: acceleration sensor 1811, gyroscope sensor 1812, pressure sensor 1813, fingerprint sensor 1814, optical sensor 1815, and proximity sensor 1816.

The acceleration sensor 1811 may detect the magnitudes of accelerations on three coordinate axes of a coordinate system established with the terminal 1800. For example, the acceleration sensor 1811 may be used to detect components of gravitational acceleration on three coordinate axes. The processor 1801 may control the display screen 1805 to display a user interface in either a landscape view or a portrait view based on gravitational acceleration signals acquired by the acceleration sensor 1811. The acceleration sensor 1811 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 1812 may detect a body direction and a rotation angle of the terminal 1800, and the gyro sensor 1812 may collect a 3D motion of the user to the terminal 1800 in cooperation with the acceleration sensor 1811. The processor 1801 may implement the following functions based on the data collected by the gyro sensor 1812: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.

Pressure sensor 1813 may be disposed on a side frame of terminal 1800 and/or below display 1805. When the pressure sensor 1813 is disposed at a side frame of the terminal 1800, a grip signal of the terminal 1800 by a user may be detected, and the processor 1801 performs a left-right hand recognition or a shortcut operation according to the grip signal collected by the pressure sensor 1813. When the pressure sensor 1813 is disposed at the lower layer of the display 1805, the processor 1801 controls the operability control on the UI interface according to the pressure operation of the user on the display 1805. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 1814 is used to collect a fingerprint of the user, and the processor 1801 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 1814, or the fingerprint sensor 1814 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 1801 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 1814 may be provided on the front, back or side of the terminal 1800. When a physical key or vendor Logo is provided on the terminal 1800, the fingerprint sensor 1814 may be integrated with the physical key or vendor Logo.

The optical sensor 1815 is used to collect the ambient light intensity. In one embodiment, the processor 1801 may control the display brightness of the display screen 1805 based on the intensity of ambient light collected by the optical sensor 1815. Specifically, when the intensity of the ambient light is high, the display brightness of the display screen 1805 is turned up; when the ambient light intensity is low, the display brightness of the display screen 1805 is turned down. In another embodiment, the processor 1801 may also dynamically adjust the shooting parameters of the camera assembly 1806 based on the intensity of ambient light collected by the optical sensor 1815.

A proximity sensor 1816, also known as a distance sensor, is provided on the front panel of the terminal 1800. Proximity sensor 1816 is used to collect the distance between the user and the front face of terminal 1800. In one embodiment, when the proximity sensor 1816 detects that the distance between the user and the front face of the terminal 1800 gradually decreases, the processor 1801 controls the display 1805 to switch from the on-screen state to the off-screen state; when the proximity sensor 1816 detects that the distance between the user and the front of the terminal 1800 gradually increases, the processor 1801 controls the display 1805 to switch from the off-screen state to the on-screen state.

Those skilled in the art will appreciate that the structure shown in fig. 18 is not limiting and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.

Optionally, the electronic device is provided as a server. Fig. 19 is a schematic structural diagram of a server provided in an embodiment of the present application, where the server 1900 may have a relatively large difference due to different configurations or performances, and may include one or more processors (central processing units, CPU) 1901 and one or more memories 1902, where at least one program code is stored in the memories 1902, and the at least one program code is loaded and executed by the processors 1901 to implement the virtual robot-based operation method provided in the above method embodiments. Of course, the server may also have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.

In an exemplary embodiment, a computer readable storage medium, such as a memory including a degree code executable by a processor in an electronic device to perform the virtual robot-based operation method of the above embodiment, is also provided. For example, the computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

In an exemplary embodiment, a computer program product is also provided, comprising a computer program, which, when executed by a processor, implements the virtual robot based operation method in the above embodiments.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A virtual robot-based method of operation, comprising:

acquiring input information based on any input control of a target application, wherein the input control is positioned on any interface in the target application;

invoking the virtual robot, and sending the robot invoking instruction to a third party server corresponding to the virtual robot, wherein the third party server is used for responding to the robot invoking instruction;

if the robot calling instruction is a search instruction, receiving at least one search result returned by the third party server, wherein the at least one search result is obtained by searching by the third party server based on search parameters included in the search instruction;

displaying the at least one search result in a current display interface, and responding to hovering operation in a display area of any search result, displaying release prompt information, wherein the release prompt information is used for prompting the release of the search result into a session;

responding to the selection operation of any search result, displaying a session identification list, wherein the session identification list comprises the session identification of at least one session in the target application;

And responding to the selection operation of any session identifier, releasing the selected search result into the session corresponding to the selected session identifier, and clearing the input information in the input control.

2. The virtual robot-based operation method according to claim 1, wherein the determining the input information as a robot call instruction in the case where the input information satisfies a robot call condition comprises:

3. The method according to claim 2, wherein determining the input information as the robot call instruction in the case that the input information includes a virtual account number and the virtual account number is included in an address book of a current login account number includes:

4. The virtual robot-based operation method of claim 1, further comprising:

and responding to the selection operation of any one search result, and publishing the selected search result to a first session, wherein the first session is a session corresponding to a session interface where any one input control is positioned.

5. The virtual robot-based operation method of claim 1, wherein the invoking the virtual robot, sending the robot invocation instruction to a third party server corresponding to the virtual robot, comprises:

6. The virtual robot-based operation method according to claim 1, wherein the robot call instruction is a card punching instruction, the calling the virtual robot to which the robot call instruction corresponds, performing the operation indicated by the robot call instruction, includes:

7. The virtual robot-based operation method according to claim 2, wherein the target application includes a robot addition control, and before any input control of the target application is acquired, the virtual robot-based operation method further includes:

8. The virtual robot-based operation method of claim 7, wherein the robot presentation interface includes a robot creation control therein, the virtual robot-based operation method further comprising:

acquiring input robot information based on the robot creation interface;

9. The virtual robot-based operation method according to claim 1, wherein the virtual robot has a corresponding target control and a target operation, the target operation being an operation allowed to be performed in a session in which a virtual account corresponding to the virtual robot is located, the target control being used for triggering the performance of the target operation, the virtual robot-based operation method further comprising:

10. The virtual robot-based operation method according to claim 9, wherein the adding the target control in the session interface corresponding to the session in response to adding the virtual account number corresponding to the virtual robot to any session of the target application comprises:

11. The virtual robot-based operation method according to claim 10, wherein the target operation includes an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, and wherein after displaying a menu corresponding to the session message in the session interface, the virtual robot-based operation method further includes:

and sending the session message to the third party server.

12. The virtual robot-based operation method according to claim 10, wherein the target operation includes an operation of transmitting a task creation request to a third-party server corresponding to the virtual robot, and wherein after displaying a menu corresponding to the session message in the session interface, the virtual robot-based operation method further includes:

13. The virtual robot-based operation method according to any one of claims 1 to 12, further comprising:

14. The virtual robot-based operation method according to any one of claims 1 to 12, further comprising:

15. The virtual robot-based operation method according to any one of claims 1 to 12, further comprising:

16. The virtual robot-based operation method according to any one of claims 1 to 12, wherein the virtual robot created by the virtual robot for the current login account number, the target application includes an information configuration entry of the virtual robot, and the virtual robot-based operation method further includes:

17. The method of claim 16, wherein the information configuration interface includes an instruction configuration control, and wherein the configuring the robot information of the virtual robot based on the information input operation in the information configuration interface includes:

18. An operating device based on a virtual robot, comprising:

the information acquisition module is configured to acquire input information based on any input control of a target application, wherein the input control is positioned at any interface in the target application;

the first operation execution module is configured to call the virtual robot, send the robot call instruction to a third party server corresponding to the virtual robot, and the third party server is used for responding to the robot call instruction; if the robot calling instruction is a search instruction, receiving at least one search result returned by the third party server, wherein the at least one search result is obtained by searching by the third party server based on search parameters included in the search instruction; displaying the at least one search result in a current display interface;

the result issuing module is configured to respond to hovering operation in a display area of any search result, and display issuing prompt information, which is used for prompting the issuing of the search result into a session; responding to the selection operation of any search result, displaying a session identification list, wherein the session identification list comprises the session identification of at least one session in the target application;

19. The virtual robot-based manipulator of claim 18, wherein the manipulator is configured to move,

the instruction determining module is configured to determine the input information as the robot call instruction when the input information includes a virtual account number and the address book of the current login account number includes the virtual account number, where the virtual account number is an account number corresponding to the virtual robot.

20. The virtual robot-based manipulator of claim 19, wherein the virtual robot is configured to move,

the instruction determining module is configured to determine the input information as the robot call instruction when the input information includes a first target character and the virtual account number located after the first target character, and the address book of the current login account number includes the virtual account number, where the first target character is a character for identifying the robot call instruction.

21. The virtual robot-based manipulator of claim 18, wherein the manipulator is configured to move,

The result issuing module is further configured to issue the selected search result to a first session in response to a selection operation of any one search result, wherein the first session is a session corresponding to a session interface where any one input control is located.

22. The virtual robot-based manipulator of claim 18, wherein the manipulator is configured to move,

the first operation execution module is configured to call the virtual robot, send the robot call instruction to a service interface corresponding to the robot call instruction, and the third party server is used for responding to the robot call instruction through the service interface.

23. The virtual robot-based manipulator of claim 18, wherein the manipulator is configured to move,

the robot calling instruction is a card punching instruction, and the first operation executing module is configured to call the virtual robot to execute card punching operation, wherein the card punching operation is an operation of recording environment information of a current login account in the target application.

24. The virtual robot-based operation device of claim 19, wherein the target application includes a robot add control therein, the virtual robot-based operation device further comprising:

25. The virtual robot-based operation device of claim 24, further comprising:

26. The virtual robot-based operation device of claim 18, wherein the virtual robot has a corresponding target control and a target operation, the target operation being an operation permitted to be performed in a session in which a virtual account corresponding to the virtual robot is located, the target control being used to trigger the performance of the target operation, the virtual robot-based operation device further comprising:

27. The virtual robot-based manipulator of claim 26, wherein the virtual robot is configured to move,

the control adding module is configured to add the target control in a menu corresponding to the session message in the session interface;

the virtual robot-based operation device further includes:

28. The virtual robot-based operation device of claim 27, wherein the target operation comprises an operation of uploading a session message corresponding to the target control to a third party server corresponding to the virtual robot, the virtual robot-based operation device further comprising:

29. The virtual robot-based operation device of claim 27, wherein the target operation comprises an operation of sending a task creation request to a third party server to which the virtual robot corresponds, the virtual robot-based operation device further comprising:

30. The virtual robot-based manipulator of any one of claims 18-29, further comprising:

31. The virtual robot-based manipulator of any one of claims 18-29, further comprising:

32. The virtual robot-based manipulator of any one of claims 18-29, further comprising:

the session message issuing module is configured to receive a message issuing request sent by a third-party server corresponding to the virtual robot, wherein the message issuing request carries a second session message, a virtual account number and a network hook webhook address, and the webhook address is used for identifying a unique corresponding session; and responding to the conversation corresponding to the webhook address to comprise a virtual account number corresponding to the virtual robot, and issuing the second conversation message in the conversation corresponding to the webhook address by taking the virtual account number as an issuing account number.

33. The virtual robot-based operation device of any of claims 18-29, wherein the virtual robot created for the current login account number comprises an information configuration portal for the virtual robot in the target application, the virtual robot-based operation device further comprising:

34. The virtual robot-based manipulator of claim 33, wherein the virtual robot is configured to move,

the information configuration interface comprises an instruction configuration control, and the information configuration module is configured to respond to the triggering operation of the instruction configuration control and display an instruction configuration interface of the virtual robot; based on the instruction configuration interface, an input robot calling instruction and a service interface corresponding to the robot calling instruction are obtained, wherein the service interface is an interface for sending the robot calling instruction to a third-party server corresponding to the virtual robot.

35. An electronic device, the electronic device comprising:

one or more processors;

wherein the one or more processors are configured to perform the virtual robot-based method of operation of any of claims 1-17.

36. A computer readable storage medium, characterized in that instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the virtual robot based operation method of any one of claims 1-17.