Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Fig. 1 is an application environment diagram of a conference on-screen system according to an embodiment of the present invention, as shown in fig. 1, in the application environment, the application environment includes a server 110, and a master screen device 120 and at least one slave screen device 130 that communicate with the server 110.
The server 110 may be an independent physical server or terminal, or may be a server cluster formed by a plurality of physical servers, or may be a cloud server that provides basic cloud computing services such as a cloud server, a cloud database, cloud storage, and CDN.
The master device 120 and the slave device 130 may be, but are not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc. The server 110 and the master device 120 and the slave device 130 may be connected through a network, which is not limited in this disclosure.
As shown in fig. 2, an architecture diagram of a conference on-screen system is provided, and fig. 3 is a timing diagram of the conference on-screen system when an on-screen effect is achieved. In the conference on-screen system provided by the embodiment of the invention, the conference on-screen system comprises an on-screen service end 210, a master screen end 220 and at least one slave screen end 230, wherein the master screen end 220 and the slave screen end 230 are in communication with the on-screen service end 210.
The home screen end 220 is running on the home screen device and is configured to perform a corresponding action on the executable object according to an operation of inputting the executable object by a user; generating an operation instruction according to the operation of the user on the executable object input, and sending the operation instruction to the same-screen server, wherein the operation instruction carries the identification information of the executable object.
In the embodiment of the present invention, the home screen end 220 is associated with the home screen device 120 shown in fig. 1, and runs on the home screen device, which may be a program running on the home screen device or a functional module of the home screen device.
In the embodiment of the present invention, the executable object may be a file type, for example, a PPT document, a Word document, a PDF document, or a picture, or may be an application type, and the operation of inputting the executable object may be to open or close the file, for example, to open a PPT file, or to turn a page of the file, compile the file, or the like, which are not listed herein.
The on-screen server 210 is configured to send the operation instruction to the slave screen after receiving the operation instruction sent by the master screen.
In the embodiment of the present invention, the on-screen server 210 is associated with the server 110 shown in fig. 1, and the on-screen server 210 runs on the server 110 and may be a unit structure on the server 110.
In the embodiment of the present invention, the on-screen service end 210 is connected to at least one slave screen end 230, and receives the operation instruction sent by the master screen end, and sends the operation instruction to all slave screen ends simultaneously in a broadcast manner.
The slave screen end 230 is running on the slave screen device, and is configured to execute, after receiving the operation instruction sent by the on-screen server end, an operation corresponding to the operation instruction on the executable object according to the operation instruction.
In the embodiment of the present invention, the slave screen 230 is associated with the slave screen device 130 shown in fig. 1, and runs on the slave screen device, which may be a program running on the slave screen device or a functional module of the slave screen device.
In the embodiment of the present invention, it should be noted that, in executing, on the slave screen device, an operation corresponding to the operation instruction, where the executable object is a file or an application program that is stored in the slave screen device and is the same as the executable object stored in the master screen device, where the executable object on the slave screen device may be input to the slave screen device in advance, or may be acquired in real time during the on-screen operation.
In the embodiment of the invention, the slave screen end can analyze the operation instruction after receiving the operation instruction sent by the same screen service end, determine the operation corresponding to the operation instruction, and automatically execute the operation corresponding to the operation instruction on the executable object stored on the slave screen equipment, thereby realizing the same screen effect.
In the embodiment of the present invention, the master screen 220 and the slave screen 230 may be understood as functional units that are used to implement different functions in implementing the same-screen complete process but have the same or similar structures, that is, the master screen 220 and the slave screen 230 may be considered to be equivalent, that is, in a specific case, the master screen 220 and the slave screen 230 may be converted from each other, that is, the master screen 220 may be the slave screen 230, and the slave screen may be the master screen 220.
In the embodiment of the invention, the operation performed on the file is taken as an example to specifically explain the process of realizing the same screen, wherein when the operation of inputting the file by a user is the file opening operation, the master screen end opens the file and generates the operation instruction for opening the file, the operation instruction is sent to the same screen server, after the same screen server receives the operation instruction, the operation instruction for opening the file is sent to all the slave screen ends in a broadcast mode, after each slave screen receives the operation instruction for opening the file, the operation for opening the same file stored on the slave screen equipment is executed through analyzing the operation instruction, namely, the slave screen equipment can open the same file with the master screen equipment, so that the same screen is realized, and when the page turning and editing actions are executed on the file on the master screen equipment, the page turning and editing actions are executed on the same file on the slave screen equipment to realize the same screen.
In the embodiment of the present invention, it may be understood that, in order to implement that the slave device can perform the same operation as the master device to implement the on-screen effect, it is required that the slave device and the master device can have identical execution environments, in other words, the first point requires: the operation obtained by analyzing the operation instruction generated according to the operation executed by the master screen device by the slave screen device should be the same as the operation executed by the master screen device, and the implementation of the above conditions may depend on a preset communication protocol and a protocol corresponding to the instruction and the operation. The second point requires: when the slave screen device executes the operation, the executable object needs to be stored, that is, when the file A is opened on the master screen device, the slave screen device needs to store the file A to ensure that the same screen can be realized, when the master screen device edits the file A by using the editing software B, the slave screen device needs to have the editing software B and the file A, and the realization of the conditions can be realized by customizing the master screen device and the slave screen device in advance, or can be realized by adjusting the slave screen device in real time in the execution process of the same screen flow, for example, downloading corresponding files, software and the like from the slave screen device.
As a preferred embodiment of the present invention, the home screen end is further configured to send the executable object to the on-screen service end. In the embodiment of the present invention, a timing chart of a process of implementing on-screen in a conference on-screen system is shown in fig. 4 and an explanation thereof.
As another preferred embodiment of the present invention, the on-screen server is further configured to send the executable object to the slave screen. In the embodiment of the present invention, a timing chart of a process of implementing on-screen in a conference on-screen system is shown in fig. 5 and an explanation thereof.
As another preferred embodiment of the present invention, after the slave screen receives the operation instruction sent by the on-screen server, before executing an operation corresponding to the operation instruction on an executable object according to the operation instruction, it needs to determine whether the executable object exists on the slave screen, and execute a step of controlling the slave screen to open the file according to the identification information of the file carried by the operation instruction or a step of sending a first file download request to the on-screen server to download the file according to the result of whether the executable object exists on the slave screen, where a specific flowchart of the steps executed by the slave screen is shown in fig. 6 and an explanation thereof. Accordingly, a timing chart of a process of implementing on-screen in a conference on-screen system provided by the embodiment of the invention is shown in fig. 7 and an explanation thereof.
As a further preferred embodiment of the present invention, when the executable file does not exist on the slave device, a first download request of the executable file needs to be sent to the on-screen server to download the file, where the on-screen server is further configured to determine, after receiving the first download request of the executable file sent by the slave device, whether the file exists on the on-screen server according to the identification information of the file carried by the first download request of the file, and send, according to a determination result of whether the file exists on the on-screen server, the file to the slave device or send a second download request of the file to the master device, fig. 8 is referred to for a flowchart of a step executed by the on-screen server, and accordingly, a timing diagram of an on-screen implementation flow in the conference on-screen system provided by the embodiment of the present invention is referred to fig. 9 and an explanation thereof.
As a further preferred embodiment of the present invention, the home screen end is further configured to send, after receiving a second download request of the file sent by the on-screen server, the file to the on-screen server according to identification information of the file carried by the second download request of the file.
The conference on-screen system provided by the embodiment of the invention comprises an on-screen service end, a master screen end and at least one slave screen end, wherein the master screen end and the at least one slave screen end are communicated with the on-screen service end, the master screen end is operated on the master screen equipment, the slave screen end is operated on the slave screen equipment, the master screen equipment and the slave screen equipment store the same executable objects, the master screen end is used for executing corresponding actions on the executable objects according to the operation recorded by a user on the executable objects, an operation instruction is generated according to the operation recorded by the user on the executable objects on the master screen equipment and is sent to the on-screen service end, the on-screen service end can send the operation instruction to the slave screen end after receiving the operation instruction sent by the on-screen service end, and the slave screen end can execute the operation corresponding to the operation instruction on the executable objects stored on the slave screen equipment according to the operation instruction, so that the slave screen end and the master screen end can execute the same operation according to the operation instruction, and the slave screen equipment can keep the same interface. Compared with the existing conference on-screen system, the conference on-screen system provided by the embodiment of the invention has the advantages that the screen function is realized by replacing screenshot pictures with large data volume with operation instructions with small data volume, the requirements on a server and terminal equipment are low, and the popularization of the paperless conference system is facilitated.
As shown in fig. 3, a timing diagram for implementing on-screen in the conference on-screen system shown in fig. 2 is provided, where the timing diagram mainly describes an on-screen process, and is described in detail below.
In the embodiment of the invention, the main screen end firstly executes corresponding actions on the executable object according to the operation of the user for inputting the executable object, then generates operation instructions according to the operation of the user for inputting the executable object, and sends the operation instructions to the same-screen server.
In the embodiment of the invention, the corresponding relation between the operation of the user for inputting the executable object and the operation instruction can be determined through a preset protocol.
In the embodiment of the present invention, the operation instruction carries the identification information of the executable object, where the operation instruction is usually represented by a string of characters, and the specific size is generally 3-5 bytes.
In the embodiment of the invention, the on-screen service end can broadcast the operation instruction to all the slave screen ends at the same time so as to enable all the slave screen devices to realize the on-screen with the master screen device, and obviously, the slave screen device also stores the protocol of the relation between the operation instruction and the operation which is established in advance.
In the embodiment of the present invention, the slave device should have the same execution environment as the master device, for example, the slave device should store/install the same file and application program as the master device in advance, and of course, the slave device may be continuously adjusted in the same screen process so that the slave device and the master device have the same execution environment, and the implementation of the same screen flow will be specifically explained below in conjunction with the content of fig. 4 to 9.
Before describing the contents of fig. 4 to 9 individually, the main description of each figure will be summarized. It will be appreciated that when the operation performed by the user on the home screen device is to open a file, it is obvious that the operation instruction should carry identification information of the file.
For the home screen device, the operation instruction is sent to the same screen server, and meanwhile, the executable object can be optionally sent to the same screen server, so that although the data transmission amount of the home screen device is increased, the file can be ensured to be stored in the same screen server, so that the subsequent realization of the same screen is facilitated, and at the moment, the timing diagrams of two processes for realizing the same screen refer to fig. 4.
Further, for the on-screen server, similar to the master screen, the operation instruction may be sent to the slave screen, and simultaneously the executable object may be sent to the slave screen, so that the slave screen may be ensured to have the executable object on the slave screen device, and the slave screen may be able to execute the operation corresponding to the operation instruction according to the operation instruction, and at this time, the timing chart of the flow of implementing the on-screen is please refer to fig. 5 and the explanation thereof. In this process, the executable object on the on-screen server may be an executable object already stored in advance on the on-screen server, or may be an executable object acquired from the home screen.
Further, for the slave screen, when the operation corresponding to the operation instruction is performed on the executable object according to the operation instruction, there may be a possibility that the operation cannot be performed, for example, when the operation performed by the master screen device is to open the file a, if the slave screen device does not store the file a, it is obvious that the operation of opening the file a cannot be performed, and an additional step is required to obtain the file. At this time, the slave screen end needs to send a first download request of the executable object to the on-screen server end according to the identification information of the executable object carried by the operation instruction to download the executable object, and the specific process is shown in fig. 6 and the explanation thereof, and the timing chart of the flow for implementing on-screen is shown in fig. 7.
Further, when the first download request of the executable object is sent from the screen end to the on-screen server to request to download the executable form, the on-screen server also needs to determine whether the executable object is stored, and send the step of sending the executable object to the slave screen end or send the second download request of the executable object to the master screen server to request to download the executable object according to the result of whether the executable object is stored, where the specific process is shown in fig. 8 and the explanation thereof, and the timing diagram of the flow for implementing the on-screen process is shown in fig. 9 respectively.
As shown in fig. 4, a timing diagram for implementing on-screen of the conference on-screen system is provided, which is different from the timing diagram for implementing on-screen of the conference on-screen system shown in fig. 3 in that:
and the main screen end sends the executable object to the same-screen server while sending the operation instruction to the same-screen server.
In the embodiment of the present invention, compared with the timing chart shown in fig. 3, although the transmission data amount of the main screen end is changed from the single operation instruction into the operation instruction and the executable object, and the transmission data amount of the main screen end is improved, after the executable object is sent to the same-screen server, the executable object can be stored on the same-screen server, and the executable object can be conveniently acquired from the screen end later.
As shown in fig. 5, a timing diagram for implementing on-screen of the conference on-screen system is provided, which is different from the timing diagram for implementing on-screen of the conference on-screen system shown in fig. 3 in that:
the on-screen service end sends the operation instruction to the slave screen end and simultaneously sends the executable object to the slave screen end.
In the embodiment of the present invention, compared with the timing chart shown in fig. 3, although the transmission data amount of the on-screen server is changed from the single operation instruction to the operation instruction and the executable object, and the transmission data amount of the on-screen server is improved, after the executable object is sent to the slave screen, the executable object can be stored on the slave screen, and the slave screen can be ensured to open the executable object.
In the embodiment of the invention, the executable objects sent to the slave screen end by the same-screen service end can be stored in the same-screen service end in advance or can be obtained from the master screen end.
As can be seen from the flowcharts of fig. 3, 4 and 5, the steps of the flowcharts are different, the effect of realizing the same screen is different, and the method can be adapted to different implementation environments. For example, for preparing a sufficient meeting, all executable objects in the master screen device should be stored in the slave screen device in advance as much as possible, that is, the master screen device and the slave screen device are unified, at this time, only the operation command with byte size is only sent to the same screen server in the process of realizing the same screen, the same screen effect is better, for a meeting with relatively insufficient preparation time, the executable objects in the master screen device should be stored in the same screen server as much as possible, so that the slave screen device can download the executable objects from the same screen server to open, and for an emergency meeting, although the same screen server and the slave screen device are not stored in the master screen device, the master screen device can send the operation command and the executable objects to the same screen server simultaneously after opening the same screen function, and the same screen server can also select to send the operation command and the executable objects to the slave screen end simultaneously, so that the slave screen device can open the executable objects, thereby realizing the same screen. The specific on-screen process can be selected and determined by conference hosting personnel according to the type of the conference, so that the application range is wider.
As shown in fig. 6, a flowchart of steps executed from a screen end in a conference on-screen system is provided, which specifically includes the following steps:
step S602, determining whether the executable object is stored on the slave screen device according to the identification information of the executable object carried by the operation instruction. When it is determined that the executable object exists on the slave screen device, step S604 is executed; when it is determined that the executable object does not exist on the slave screen device, step S606 is performed.
In the embodiment of the invention, after the slave screen end receives the operation instruction, whether the executable object exists on the slave screen equipment or not needs to be judged according to the identification information of the executable object carried by the operation instruction, and when the executable object does not exist, the step of opening the executable object on the terminal equipment obviously cannot be executed, and the corresponding operation can be further carried out after the executable object needs to be acquired.
Step S604, executing an operation corresponding to the operation instruction on the executable object.
Step S606, a first acquisition request of the executable object is sent to the on-screen server.
In the embodiment of the invention, when the file does not exist on the slave screen device, the slave screen device sends an executable object first acquisition request to the same screen server to request to download the executed object, and obviously, the executable object first acquisition request carries the identification information of the executable object.
As shown in fig. 7, a timing diagram for implementing on-screen in the conference on-screen system is provided, which is described in detail below.
In the embodiment of the invention, the slave screen end firstly judges whether the slave screen equipment has the executable object, when the judging result is that the executable object is in some cases, the operation corresponding to the operation instruction is executed on the executable object, and when the judging result is that the executable object is not in some cases, an executable object first acquisition request is sent to the same screen server end, wherein the executable object first acquisition request carries the identification information of the executable object.
In the embodiment of the invention, the on-screen server side further sends the file to the slave screen side or sends a file second acquisition request to the master screen side according to the file first download request.
As shown in fig. 8, a flowchart of steps executed by a on-screen server in a conference on-screen system is provided, which specifically includes the following steps:
step S802, determining whether the executable object is stored on the on-screen server according to the identifier information of the executable object carried by the first executable object obtaining request. Executing step S804 when it is determined that the executable object exists on the on-screen server; when it is determined that the executable object does not exist on the on-screen server, step S806 is performed.
In the embodiment of the invention, after the on-screen server receives the first acquisition request of the executable object, whether the executable object exists on the on-screen server needs to be judged according to the identification information of the executable object carried by the first acquisition request of the executable object, when the executable object exists, the executable object is directly sent to the slave screen, and when the executable object does not exist on the on-screen server, the executable object needs to be further acquired from the master screen.
Step S804, sending the executable object to the slave screen end.
Step S806, sending a second obtaining request of the executable object to the home screen end.
In the embodiment of the invention, when the executable object does not exist on the same-screen server, the same-screen server further sends a second acquisition request of the executable object to the same-screen server to request to download the executable object, and obviously, the second acquisition request of the executable object carries the identification information of the executable object.
As shown in fig. 9, a timing diagram for implementing on-screen in the conference on-screen system is provided, which is described in detail below.
In the embodiment of the invention, the same screen server side firstly judges whether the executable object is stored on the same screen server side, and when the judging result is that the executable object is sometimes sent to the slave screen side, and when the judging result is that the executable object is not sometimes sent to the master screen side, a second downloading request of the executable object is sent to the master screen side, wherein the second downloading request of the executable object carries identification information of the executable object.
In the embodiment of the invention, the master screen end further sends the executable object to the same-screen server according to the second download request of the executable object, so that the same-screen server can send the executable object to the slave screen end, and the slave screen end opens the executable object to realize the same screen.
In the embodiment of the invention, it can be understood that after the master screen receives the second download request of the executable object, the executable object is returned to the on-screen server, and further, the on-screen server returns the executable object to the slave screen, so that the slave screen can execute the operation corresponding to the operation instruction on the executable object according to the operation instruction on the slave screen device, thereby realizing the on-screen effect.
In one embodiment, as shown in fig. 10, a step flowchart of a conference on-screen method is provided, where the conference on-screen method is applied to an on-screen server of a conference on-screen system, and specifically includes the following steps:
step S1002, an operation instruction corresponding to an operation of a user to enter an executable object stored on the home screen device is acquired.
Step S1004, transmitting the operation instruction to the slave screen device.
In the embodiment of the invention, the operation instruction is sent to all the slave screen devices so that all the slave screen devices execute the operation corresponding to the operation instruction, thereby realizing the same screen.
The conference on-screen method provided by the embodiment of the invention is applied to the on-screen server of the conference on-screen system, can acquire the operation instruction corresponding to the operation executed by the user on the master screen device and send the operation instruction to the slave screen device, so that the slave screen device executes the operation corresponding to the operation instruction.
In one embodiment, as shown in fig. 11, a schematic structural diagram of a conference on-screen device is provided, where the conference on-screen device is disposed on an on-screen service end of a conference on-screen system, and specifically includes an operation instruction obtaining unit 1110 and an operation instruction sending unit 1120.
The operation instruction obtaining unit 1110 is configured to obtain an operation instruction corresponding to an operation of inputting an executable object stored on the home screen device by a user.
The operation instruction sending unit 1120 is configured to send the operation instruction to a slave screen device.
In the embodiment of the invention, the operation instruction is sent to all the slave screen devices so that all the slave screen devices execute the operation corresponding to the operation instruction, thereby realizing the same screen.
The conference on-screen device provided by the embodiment of the invention is arranged on the on-screen server side of the conference on-screen system, can acquire the operation instruction corresponding to the operation executed by the user on the master screen device and send the operation instruction to the slave screen device, so that the slave screen device executes the operation corresponding to the operation instruction.
In one embodiment, a computer device is presented, the computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
Acquiring an operation instruction corresponding to the operation of inputting an executable object stored on the main screen device by a user;
and sending the operation instruction to the slave screen equipment so that the slave screen equipment can execute the operation corresponding to the operation instruction on the executable object stored on the slave screen equipment.
In one embodiment, a computer readable storage medium is provided, having a computer program stored thereon, which when executed by a processor causes the processor to perform the steps of:
acquiring an operation instruction corresponding to the operation of inputting an executable object stored on the main screen device by a user;
and sending the operation instruction to the slave screen equipment so that the slave screen equipment can execute the operation corresponding to the operation instruction on the executable object stored on the slave screen equipment.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in various embodiments may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.
Those skilled in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a non-volatile computer readable storage medium, and where the program, when executed, may include processes in the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.