TWI697236B - Video conference audio and video sharing method - Google Patents

Abstract

A video conference audio and video sharing method is implemented by a first user terminal connected to a server terminal, the server terminal is also connected to a second user terminal, and the server terminal stores an audio and video file, including: (A) generating and transmitting a The video conference generates a request to the server, so that the server creates a virtual video conference room for use by the first user and the second user; (B) generates and sends a page indicating that the video file is to be played A video and audio sharing request is sent to the server, so that the server sends the video and audio file to the first user terminal; (C) generates and sends a video and audio sharing command indicating that the video and audio file is to be played to the second user terminal, The second user end generates and sends a second video and audio sharing request to the server end, so that the server end sends the video and audio file to the second user end.

Description

Video conference audio and video sharing method

The present invention relates to a video and audio sharing method, in particular to a video and audio sharing method applied to a video conference.

The first method of the existing video and audio sharing method used in the virtual conference chat room is that the first user terminal in the virtual conference chat room first shares the video file to be shared with other users by sharing the screen; and The second method is that the first user terminal directly transmits the video file to be shared to other users through the communication network to achieve the purpose of video and audio sharing.

However, although the above two methods can achieve video and audio sharing, they are also easily affected by the upload bandwidth, resulting in poor playback quality.

In view of this, it is imperative to propose a completely new solution to the problems faced by the existing technology.

Therefore, the object of the present invention is to provide a video and audio sharing method that is not easily affected by upload bandwidth and causes poor playback quality.

Therefore, the video conference audio and video sharing method of the present invention is implemented by connecting a first user terminal of a server through a communication network, the server terminal is also connected to a second user terminal through the communication network, and the server terminal stores an audio and video file The video conference audio and video sharing method includes one step (A), one step (B), and one step (C).

Step (A) is to generate and send a video conference generation request to the server through the first user terminal in response to an input operation, so that the server terminal establishes a first user terminal and a second user terminal Virtual video conference room for data transmission.

Step (B) is to respond to another input operation by the first user terminal, generate and send a first video and audio sharing request indicating that the video file is to be played to the server, so that the server is streamed The stored audio-visual file is sent to the first user end.

Step (C) is to generate and send an audio and video sharing command indicating that the first user terminal wants to play the video file to the second user terminal in response to another input operation by the first user terminal, so that the first The two user terminals generate and send a second video and audio sharing request indicating that the video and audio file is to be played to the server, so that the server transmits the stored video and audio file to the second user terminal in a streaming manner.

The effect of the present invention is that the first audio and video sharing request and the audio and video sharing command generated by the first user end enable the server to send the audio and video files to the first user end and the second user end, respectively The user can complete the sharing of the audio and video files without being limited to the upload bandwidth of the first user terminal.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same number.

Referring to FIG. 1, a system for performing an embodiment of a video conference audio-video sharing method of the present invention includes a server 1 and a first user terminal 2 connected to the server 1 via a communication network 200, and a via a communication network The path 200 is connected to the second user terminal 3 of the servo terminal 1.

The server 1 includes a server communication module 11 connected to the communication network 200, a server storage module 12, and a server electrically connected to the server communication module 11 and the server storage module 12 Processing module 13. It is worth noting that in this embodiment, the server-side storage module 12 stores an audio-visual file.

The first user terminal 2 includes a first user terminal communication module 21 connected to the communication network 200, a first user terminal input module 22, a first user terminal display module 23, and an electrical connection to the first A user terminal communication module 21, the first user terminal input module 22 and the first user terminal processing module 24 of the first user terminal display module 23.

The second user terminal 3 includes a second user terminal communication module 31 connected to the communication network 200, a second user terminal input module 32, a second user terminal display module 33, and an electric connection to the first Two user-end communication modules 31, the second user-end input module 32, and the second user-end processing module 34 of the second user-end display module 33.

In this embodiment, the implementation of the server 1 is, for example, a personal computer, a server, or a cloud host, but not limited to this.

In this embodiment, the implementation of the first user terminal 2 is, for example, a personal computer, a smart phone, or a tablet computer, but it is not limited thereto.

In this embodiment, the implementation of the second user terminal 3 is, for example, a personal computer, a smart phone, or a tablet computer, but it is not limited thereto.

The operation details of the components of the server terminal 1, the first user terminal 2, and the second user terminal 3 will be described below through the embodiment of the video conference audio and video sharing method of the present invention. The embodiment includes an audio and video sharing program , A first video and audio synchronization program, and a second video and audio synchronization program.

It is worth noting that the server that executes the embodiment of the video conference audio-visual sharing method of the present invention can be used as a teaching platform, and the embodiment can be applied to a teaching mode. The first user terminal 2 is held by a teacher, and the second user terminal 3 is held by a student. The audio-visual file stored by the server-side storage module 12 is a teaching video.

2, the video sharing program is used to share the video file stored in the server-side storage module 12 and includes a step 51, a step 52, a step 53, a step 54, a step 55, a step 56, a step 57, a step 58, a step 59, a step 60, a step 61, and a step 62.

In step 51, the first user terminal processing module 24 is used to respond to an input operation input by the teacher through the first user terminal input module 22, generate a video conference generation request, and pass the first user terminal The communication module 21 sends the video conference generation request to the server 1.

In step 52, after receiving the video conference generation request through the server-side communication module 11, the server-side processing module 13 generates a virtual video conference room to join the first user terminal 2, and a The conference number of the virtual video conference room, and the conference number is transmitted to the first user terminal 2 through the server communication module 11.

In step 53, after receiving the conference number through the first terminal communication module 21, the first terminal processing module 24 displays the conference number on the first terminal display module 23.

It is worth noting that, in practice, after the teacher holding the first user terminal 2 obtains the meeting number, he can inform the meeting number (for example, through a smartphone) to hold the second use The student at terminal 3, so that the student also obtains the conference number.

In step 54, the second user terminal processing module 34 is used to respond to another input operation input by the student through the second user terminal input module 32 to generate a video conference join request including the conference number, and The video conference joining request is sent to the server 1 through the second user-end communication module 31.

In step 55, after receiving the video conference join request through the server-side communication module 11, the server-side processing module 13 adds the second user terminal 3 to the second conference terminal 3 according to the conference number in the video conference join request The virtual video conference room corresponding to the conference number enables the first user terminal 2 and the second user terminal 3 to transmit data, commands, and messages through the RTC Data Channel.

In step 56, the first user-end processing module 24 is used to respond to another input operation input by the teacher through the first user-end input module 22, and generates a first video indicating that the video file is to be played Sharing request, and sending the first video and audio sharing request to the server 1 through the first user-end communication module 21.

In step 57, after receiving the first video and audio sharing request through the server communication module 11, the server-side processing module 13 transmits the video and audio file stored in the server-side storage module 12 in a streaming manner To the first end of use 2.

In step 58, after receiving the audio-visual file through the first user-end communication module 21, the first user-end processing module 24 displays the audio-visual file on the first user-end display module 23.

In step 59, the first user terminal processing module 24 is used to respond to another input operation input by the teacher through the first user terminal input module 22, and generates an indication that the first user terminal 2 wants to play the A video and audio sharing command of the video and audio file, and the video and audio sharing command is transmitted to the second user terminal 3 through the first user terminal communication module 21.

It is worth noting that in this embodiment, the other input operation described in step 59 can be the same as another input operation in step 56, which means that the first user-end processing module 24 is used to respond to the teacher’s Another input operation input by the first user input module 22 can generate the first video sharing request and the video sharing command.

In step 60, after receiving the video and audio sharing command through the second user terminal communication module 31, the second user terminal processing module 34 generates a second video and audio sharing request indicating that the video and audio file is to be played, and The second video-to-audio sharing request is sent to the server 1 through the second user-end communication module 31.

In step 61, after receiving the second audio-visual sharing request through the server-side communication module 11, the server-side processing module 13 transmits the audio-video file stored in the server-side storage module 12 in a streaming manner To the second end of use 3.

In step 62, after receiving the video file through the second user-end communication module 31, the second user-end processing module 34 displays the video file on the second user-end display module 33.

Referring to FIG. 3, the first audio and video synchronization program is executed after the audio and video sharing program and is used to synchronize the playback progress of the shared audio and video file, and includes a step 71, a step 72, a step 73, and a step 74 , And a step 75.

In step 71, the first user terminal processing module 24 is used to respond to another input operation input by the teacher through the first user terminal input module 22, and generates a control for the first user terminal 2 to play the video file The first control command in the playback state, and send the first control command to the server 1 through the first user-end communication module 21. It is worth noting that in this embodiment, the first control command is one of pause, fast forward, rewind, and continue playing, but not limited to this.

In step 72, after receiving the first control command through the server-side communication module 11, the server-side processing module 13 controls the first user terminal 2 to play the playback state of the video file according to the first control command .

In step 73, the first user terminal processing module 24 is used to respond to another input operation input by the teacher through the first user terminal input module 22, and generates an indication that the first user terminal 2 according to the first A control command controls the operation command of the playback state of the video file, and transmits the operation command to the second user terminal 3 through the first user terminal communication module 21.

It is worth noting that in this embodiment, the other input operation described in step 71 can be the same as another input operation in step 73, which means that the first user end processing module 24 is used to respond to the teacher’s Another input operation input by the first user input module 22 can generate the first control command and the operation command.

In step 74, after receiving the operation command through the second user-end communication module 31, the second user-end processing module 34 generates a control for the second user end 3 to play the video file according to the operation command The second control command in the playback state, and transmits the second control command to the server 1 through the second user-end communication module 31. It is worth noting that in this embodiment, the second control command and the first control command can control the same playback state. For example, when the first control instruction is a pause, the second control instruction is also a pause.

In step 75, after receiving the second control command through the server-side communication module 11, the server-side processing module 13 controls the second user terminal 3 to play the playback state of the video file according to the second control command .

Referring to FIG. 4, the second audio and video synchronization program is executed after the audio and video sharing program, and when the transmission rate of the network communication 200 is different and the audio and video of the two parties are not synchronized, it is used to synchronize the playback progress of the shared audio and video file, and It includes a step 81, a step 82, a step 83, and a step 84.

In step 81, the first user terminal processing module 24 periodically generates a first playback time point indicating the playback progress of the first user terminal 2 playing the video file, and through the first user terminal communication mode Group 21 transmits the first playing time point to the second user terminal 3.

In step 82, after receiving the first playing time through the second user communication module 31, the second user processing module 34 determines the first playing time and indicates the second user 3. Whether a difference between a second playback time point of the playback progress of playing the video file is less than an error value. When it is determined that the difference is not less than the error value, proceed to step 83; when it is determined that the difference is less than the error value, no action is performed. In particular, in other preferred embodiments, the second user-side processing module 34 determines whether the absolute value of the difference between the first playback time point and the second playback time point is less than the error value, To decide whether to execute step 83.

In step 83, the second user terminal processing module 34 generates a third control command for adjusting the playback rate of the second user terminal 3 to play the audio and video file according to the difference, and passes the second user terminal The communication module 31 transmits the third control command to the server 1.

It is worth noting that in this embodiment, when the playback progress of the second user terminal 3 indicated by the difference leads the playback progress of the first user terminal 2, the second user terminal 3 is generated and transmitted The third control command for reducing the playback rate is sent to the server 1 to wait for the playback progress of the first user terminal 2 to catch up with the playback progress of the second user terminal 3; in addition, when the difference indicates the When the playback progress of the second user terminal 3 lags the playback progress of the first user terminal 2, the second user terminal 3 generates and transmits the third control command for increasing the playback rate to the server terminal 1 to control the The playback progress of the second user terminal 3 catches up with the playback progress of the first user terminal 2.

In step 84, after receiving the third control command through the server-side communication module 11, the server-side processing module 13 adjusts the playback of the second user terminal 3 to play the video file according to the third control command Rate to control the playback progress of the second user terminal 3 playing the video file.

Referring to FIG. 5, another implementation of the second audio-video synchronization procedure includes a step 91, a step 92, a step 93, a step 94, and a step 95.

In step 91, the second user terminal processing module 24 periodically generates the second playback time point indicating the playback progress of the second user terminal 3 playing the video file, and through the second user terminal communication mode The group 31 transmits the second playing time point to the first user terminal 2.

In step 92, after receiving the second playing time through the first user communication module 21, the first user processing module 24 determines the second playing time and indicates the first user 2 Whether another difference of the first playback time point of the playback progress of playing the video file is smaller than the error value. When it is determined that the other difference value is not less than the error value, the process proceeds to step 93; when it is determined that the other difference value is less than the error value, no action is performed. In particular, in other preferred embodiments, the second user-side processing module 34 determines whether the absolute value of the other difference between the first playback time point and the second playback time point is less than the error Value to decide whether to execute step 93.

In step 93, the first user terminal processing module 34 generates an adjustment command for adjusting the playback rate of the second user terminal 3 to play the video file according to the difference, and through the first user terminal communication mode The group 21 transmits the adjustment command to the second user terminal 3.

In step 94, after receiving the adjustment command through the second user-end communication module 31, the second user-end processing module 34 generates a command for adjusting the second user end 3 according to the adjustment command. The fourth control command of the playback rate of the audio and video file, and transmits the fourth control command to the server 1 through the second user-end communication module 31.

It is worth noting that in another embodiment of the second audio-video synchronization program, when the playback progress of the second user terminal 3 indicated by the difference leads the playback progress of the first user terminal 2, the The first user terminal 2 generates and sends the adjustment command indicating that the second user terminal 3 needs to reduce the playback rate to the second user terminal 3, and the second user terminal 3 will generate the adjustment command according to the adjustment command. The fourth control command of the playback rate is sent to the server 1 to wait for the playback progress of the first user terminal 2 to catch up with the playback progress of the second user terminal 3; in addition, when the difference indicates the second usage When the playback progress of the terminal 3 lags behind the playback progress of the first user terminal 2, the first user terminal 2 generates and transmits the adjustment command indicating that the second user terminal 3 needs to increase the playback rate to the second user terminal 3 , The second user terminal 3 will generate the fourth control command for increasing the playback rate to the servo terminal 1 according to the adjustment command to control the playback progress of the second user terminal 3 to catch up with the first user terminal 2. The playback progress.

In step 95, after receiving the fourth control command through the server-side communication module 11, the server-side processing module 13 adjusts the playback of the second user terminal 3 to play the video file according to the fourth control command Rate to control the playback progress of the second user terminal 3 playing the video file.

In summary, the video conference audio and video sharing method of the present invention first generates the first video and audio sharing request through the first user terminal 2 and the video and audio sharing command that triggers the second user terminal 3 to generate the second video and audio sharing request , So that the server 1 sends the video files to the first user end 2 and the second user end 3 in a streaming manner according to the first video sharing request and the second video sharing request, When playing the video file, the first user terminal 2 also generates the first control command, and the operation command that triggers the second user terminal 3 to generate the second control command, so that the servo terminal 3 according to the first control The instruction and the second control instruction synchronously control the playback progress of the first user terminal 2 and the second user terminal 3. In addition, the first user terminal 2 and the second user terminal 3 can also periodically determine whether the playback progress of the second user terminal 3 leads or lags too much, and then the second user terminal 3 adjusts its own playback rate to Maintain the synchronization of the video files played by both parties. Therefore, the purpose of cost invention can indeed be achieved.

However, the above are only examples of the present invention, and the scope of implementation of the present invention cannot be limited by this. Any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the patent specification are still classified as Within the scope of the invention patent.

200: communication network

1: server side

11: Servo communication module

12: Server storage module

13: Server-side processing module

2: the first user end

21: First user communication module

22: The first user input module

23: The first display module

24: First-end processing module

3: Second user end

31: Second user communication module

32: Second user input module

33: Second user terminal display module

34: Second-end processing module

Other features and functions of the present invention will be clearly presented in the embodiment with reference to the drawings, in which: FIG. 1 is a block diagram illustrating a server, an embodiment of an embodiment of a video conference audio-visual sharing method of the present invention, A first user terminal and a second user terminal; FIG. 2 is a flowchart illustrating a video and audio sharing procedure of the embodiment; FIG. 3 is a flowchart illustrating a first video and audio synchronization procedure of the embodiment; FIG. 4 Is a flowchart illustrating a second audio-visual synchronization procedure of the embodiment; and FIG. 5 is a flowchart illustrating another implementation aspect of the second audio-visual synchronization procedure of the embodiment.

51~62: steps

Claims (7)

A video conference audio and video sharing method is implemented by connecting a first user terminal of a server through a communication network, the server terminal is also connected to a second user terminal through the communication network, the server terminal stores an audio and video file, the video Conference video and audio sharing method: (A) respond to an input operation by the first user terminal, generate and send a video conference generation request to the server, so that the server creates a first user terminal and the first Two virtual video conference rooms for data transmission at the user end; (B) through the first user end, in response to another input operation, generate and send a first audio and video sharing request indicating to the audio and video file to the server , So that the server transmits the stored audio and video files to the first user terminal in a streaming manner; (C) by the first user terminal, in response to another input operation, an instruction is generated and sent A user terminal wants to play the video and audio sharing command of the video file to the second user terminal, so that the second user terminal generates and sends a second video and audio sharing request indicating that the video file is to be played to the server, causing the server The server transmits the stored audio and video file to the second user end in a streaming manner; and (D) through the first user end, it will periodically instruct the first user end to play the video and audio file A first playback time point of the progress is transmitted to the second user end, so that the second user end determines the first playback time point and a second playback indicating the playback progress of the second user end playing the video file Whether one of the time points is less than an error value, and when the second When the user terminal determines that the difference is not less than the error value, it generates and sends a third control command for controlling the playback progress of the second user terminal to play the video file to the server, so that the server Three control commands control the playback progress of the second user terminal playing the video file. The video conference audio and video sharing method as described in claim 1, wherein after step (C), the method further includes the following steps: (E) responding to another input operation by the first user terminal, generating and transmitting a control The first user terminal plays the first control command of the playback state of the video file to the server, so that the server controls the first user terminal to play the playback state of the video file according to the first control command; and (F) In response to another input operation, the first user terminal generates and transmits an operation command indicating that the first user terminal controls the playback state of the video file according to the first control command to the second user terminal, so that The second user terminal generates and transmits a second control command to control the playback state of the video file of the second user terminal to the server according to the operation command, so that the server controls the server according to the second control command The second user terminal plays the playback state of the video file, and the second control command is the same as the playback state that the first control command can control. The video conference audio and video sharing method according to claim 2, wherein in step (E), the first control instruction is one of pause, fast forward, rewind, and continue playing. The video conference audio and video sharing method according to claim 1, wherein, in step (D), the first playing time is periodically transmitted to the second using end by the first user end, so that The second user terminal determines the difference When it is not less than the error value, according to the difference, generate and transmit the third control command for adjusting the playback rate of the second user terminal to play the audio and video file, the servo terminal, so that the servo terminal according to the third control command Adjusting the playback rate of the second user terminal to play the video file to control the playback progress of the second user terminal to play the video file. The video conference audio and video sharing method according to claim 1, wherein in step (A), the first user terminal is used to generate and send the video conference generation request to the server, so that the server establishes a A virtual video conference room for the first user end and the second user end to transmit data through the RTC Data Channel. The video conference audio and video sharing method according to claim 1, wherein after step (C), the method further includes the following steps: (G) through the first user end, after receiving an instruction from the second user end After the second playback time point at which the second user terminal plays the playback progress of the video file is determined, the second playback time point and a first playback time indicating the playback progress of the first user terminal playing the video file are determined Whether the difference between one of the points is less than an error value; and (H) when it is determined that the difference between the second playback time point and the first playback time point is not less than the error value, through the first user end, Generate and transmit an adjustment command related to the second user terminal playing the video file to the second user terminal, so that the second user terminal generates and transmits a playback for controlling the second user terminal to play the video file The fourth control command of the progress is sent to the server, so that the server controls the second user to play the playback progress of the video file according to the fourth control command. The video conference audio and video sharing method according to claim 6, wherein in step (H), when it is determined that the difference is not less than the error value, the first user terminal generates and generates Sending the adjustment command for adjusting the playback rate of the second user terminal to play the video file to the second user terminal, so that the second user terminal generates and transmits the fourth control command according to the adjustment command to transmit the servo End, causing the server to adjust the playback rate of the video file played by the second user end according to the fourth control command, so as to control the playback progress of the video file played by the second user end.

Images