CN111131741A - Multi-party video call method, system, device and computer readable storage medium - Google Patents
Multi-party video call method, system, device and computer readable storage medium Download PDFInfo
- Publication number
- CN111131741A CN111131741A CN201911282591.5A CN201911282591A CN111131741A CN 111131741 A CN111131741 A CN 111131741A CN 201911282591 A CN201911282591 A CN 201911282591A CN 111131741 A CN111131741 A CN 111131741A
- Authority
- CN
- China
- Prior art keywords
- terminal device
- video call
- initiator
- session protocol
- terminal equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 239000003999 initiator Substances 0.000 claims abstract description 96
- 230000005540 biological transmission Effects 0.000 claims abstract description 30
- 230000011664 signaling Effects 0.000 claims description 30
- 238000004891 communication Methods 0.000 claims description 16
- 238000007781 pre-processing Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 4
- 238000007499 fusion processing Methods 0.000 claims description 3
- 238000009304 pastoral farming Methods 0.000 description 20
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephonic Communication Services (AREA)
Abstract
本发明实施例涉及核心网领域，公开了一种多方视频通话方法。本发明接收发起方终端设备发起的多方视频通话请求，并根据所述多方视频通话请求，获取与所述发起方终端设备视频通话的终端设备集和终端设备签约信息集，根据所述多方视频通话请求，调用协议生成服务器生成会话协议框架，将所述终端设备签约信息集作为所述会话协议框架的地址分配参数，生成会话协议集，根据所述会话协议集，将所述发起方终端设备的音视频信息发送给所述终端设备集内的各终端设备。本发明还提出一种多方视频通话电子设备、装置以及计算机可读存储介质。本发明可有效的解决繁琐的通话设置和占用过多传输资源的问题。
Embodiments of the present invention relate to the field of core networks, and disclose a multi-party video call method. The present invention receives a multi-party video call request initiated by an initiator terminal device, and according to the multi-party video call request, acquires a terminal device set and a terminal device subscription information set for a video call with the initiator terminal device, and according to the multi-party video call request, call the protocol generation server to generate a session protocol frame, use the terminal device subscription information set as an address allocation parameter of the session protocol frame, generate a session protocol set, and according to the session protocol set, convert the The audio and video information is sent to each terminal device in the terminal device set. The present invention also provides an electronic device, device and computer-readable storage medium for a multi-party video call. The invention can effectively solve the problems of complicated call setting and occupying too many transmission resources.
Description
Technical Field
The embodiment of the invention relates to the field of core networks, in particular to a method, electronic equipment, a device and a computer readable storage medium for multi-party video call.
Background
With the advent of the 5G era, video calls have become increasingly popular, particularly with multiparty video calls. At present, there are two main methods based on multi-party video call, one is to use the service of AS of IP multimedia subsystem, and create and realize multi-party video call through dialing prefix; and the other is to utilize the unconventional signaling in the SIP signaling transmission protocol, such as refer signaling, call holding, etc., to notify the device terminals to start the multiparty video call.
However, the inventor finds that the current multi-party video call technology still needs to perform complicated call settings of data configuration or dial-up modification on a core network (such as an IP multimedia subsystem), or changes transmission signaling, thereby causing a problem of occupying excessive transmission resources.
Disclosure of Invention
The embodiment of the invention aims to provide a multi-party video call method, electronic equipment, a device and a computer readable storage medium, which effectively solve the problems of fussy call setting and excessive transmission resource occupation.
In order to solve the above technical problem, an embodiment of the present invention provides a multiparty video call method, where the method includes:
receiving a multi-party video call request initiated by an initiator terminal device, and acquiring a terminal device set and a terminal device subscription information set which are in video call with the initiator terminal device according to the multi-party video call request;
calling a protocol generation server to generate a session protocol framework according to the multiparty video call request;
taking the terminal equipment subscription information set as an address distribution parameter of the session protocol framework to generate a session protocol set;
and sending the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
Preferably, according to the session protocol set, sending the audio/video information of the initiator terminal device to each terminal device in the terminal device set includes:
accessing the initiator terminal equipment and each terminal equipment in the terminal equipment set according to the session protocol set;
acquiring original audio and video information of the initiator terminal device, and preprocessing the original audio and video information to obtain standard audio and video information;
and establishing a conversation control rule, and sending the standard audio and video information to each terminal device in the terminal device set.
Preferably, the accessing the initiator terminal device and each terminal device in the terminal device set according to the session protocol set includes:
according to the session protocol set, connecting the initiator terminal equipment to an IP multimedia subsystem corresponding to the initiator terminal equipment, and connecting each terminal equipment in the terminal equipment set to an IP multimedia subsystem corresponding to each terminal equipment;
and accessing the initiator terminal equipment according to the IP multimedia subsystem corresponding to the initiator terminal equipment, and accessing each terminal equipment according to the IP multimedia subsystem corresponding to each terminal equipment.
Preferably, the constructing the call control rule includes:
setting a call operation authority in the initiator terminal device;
setting access multi-party video call authority and local equipment operation authority in each terminal equipment in the terminal equipment set;
and presetting a call rule that the multi-party video call is automatically ended when the initiator terminal equipment leaves the multi-party video call or only one terminal equipment exists in the multi-party video call.
Preferably, the preprocessing includes image deduplication processing, image fusion processing, and mixing processing.
Preferably, the acquiring, according to the multiparty video call request, a terminal device set and a terminal device subscription information set for video call with the initiator terminal device includes:
informing the initiator terminal device to send a signaling, and sending a receiving message to the initiator terminal device according to the signaling of the initiator terminal device;
when the sending and receiving messages are successful, a terminal equipment set and a terminal equipment subscription information set which are in video call with the initiator terminal equipment are analyzed from the multi-party video call request.
Preferably, the invoking a protocol generation server to generate a session protocol framework according to the multiparty video call request includes:
an original session protocol framework is pre-constructed in the protocol generation server, and the multi-party video call request is analyzed to obtain the type of a transmission protocol, bandwidth information and a media format;
and inputting the transmission protocol type, the bandwidth information and the media format to the specified position of the original session protocol framework to obtain a session protocol framework.
In order to solve the above problem, the present invention also provides an electronic device, including:
a memory storing at least one instruction; and
and the processor executes the instructions stored in the memory to realize the multi-party video call method.
In order to solve the above problem, the present invention further provides a computer-readable storage medium, which stores at least one instruction, where the at least one instruction is executed by a processor in an electronic device to implement the multiparty video call method described above.
The invention generates the terminal device signing information set by analyzing the multi-party video call request and generates the session protocol set according to the address distribution parameters in the terminal device signing information set, before the multi-party video call is connected, the complicated call setting is not needed by the dialing prefix and other modes, all the multi-party video call connection work is automatically completed, in addition, the audio and video information sending process is completed by the session protocol set, because the session protocol set adopts the conventional transmission protocol, the conventional transmission protocol can not cause the problem of occupying excessive transmission resources.
Furthermore, a call control rule is established, so that safety guarantee is provided for the call process of the multi-party video call, and before audio and video information is transmitted, operations including image duplicate removal processing, image fusion processing, audio mixing processing and the like are performed, so that the quality of the multi-party video call is guaranteed.
Drawings
One or more embodiments are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which elements having the same reference numeral designations represent like elements and in which the figures are not to scale unless specifically stated.
Fig. 1 is a schematic flow chart of a multi-party video call method according to an embodiment of the present invention;
fig. 2 is a detailed implementation flowchart of S2 in the multiparty video call method according to the embodiment of the present invention;
fig. 3 is a detailed implementation flowchart of S4 in the multiparty video call method according to the embodiment of the present invention;
fig. 4 is a detailed implementation flowchart of S41 in the multiparty video call method according to the embodiment of the present invention;
FIG. 5 is a block diagram of a multi-party video call device according to an embodiment of the present invention;
fig. 6 is a schematic internal structural diagram of an electronic device implementing a multi-party video call method according to an embodiment of the present invention;
the objects, features and advantages of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
The implementation mode of the invention relates to a multi-party video call method, and the core of the implementation mode lies in analyzing a multi-party video call request to obtain a generated session protocol set, and carrying out multi-party video call according to the generated session protocol set, thereby effectively solving the problems of fussy call setting and excessive transmission resource occupation. The following description specifically describes implementation details of the multi-party video call of the present embodiment, and the following description is only provided for facilitating understanding of the implementation details and is not necessary for implementing the present invention.
Referring to fig. 1, fig. 1 is a flow chart of a multiparty video call in an embodiment of the present invention, including:
s1, receiving a multi-party video call request initiated by the initiator terminal device, and acquiring a terminal device set and a terminal device subscription information set for video call with the initiator terminal device according to the multi-party video call request.
The embodiment of the invention is applied to a centralized communication Platform, and the centralized communication Platform (CCP for short) is a unified session resource scheduling center and a protocol generation center.
In detail, the acquiring a terminal device set and a terminal device subscription information set for video call with the initiator terminal device according to the multiparty video call request includes: receiving a multi-party video call request initiated by an initiator terminal device, and informing the initiator terminal device to send a signaling; when receiving the signaling of the initiator terminal device, sending receiving information to the initiator terminal device according to the signaling of the initiator terminal device, wherein the signaling can be SIP protocol signaling; and analyzing a terminal equipment set and a terminal equipment subscription information set which have video calls with the initiator terminal equipment from the multi-party video call request, and establishing video call channels with the same number as the terminal equipment sets.
If the plum husbandry is a Chinese person, and is currently reserved in the united states, the plum husbandry and family members can be agreed to use the mobile phone to carry out remote video call at weekend time, and the family members comprise a dad mother, a grand mother and a grandfather grandmother, wherein the dad mother is resident in Shenzhen in China, the grand grandmother is resident in Hefei in China, and the grandfather grandmother is resident in Shanghai in China, the initiator terminal device is the mobile phone held by the plum husbandry.
Further, when the Li pasture initiates a multi-party video call request with family, the centralized communication platform analyzes all terminal devices needing video calls in the multi-party video call request of the Li pasture, and all the terminal devices comprise a second terminal device of dad and mom, a third terminal device of grandpa and a fourth terminal device of grandpa, namely the terminal device set is formed.
The terminal device subscription information set represents subscription information of a terminal and a network. Preferably, each subscription information generally can uniquely represent one terminal, that is, different terminals can be identified through the subscription information of the terminal device, and whether the different terminals have the right to use the network or not is judged. As described above, the subscription information typically differs between the second terminal device of dad and mom, the third terminal device of grandpa, and the fourth terminal device of grandmother.
In detail, the video call channels with the same number as the terminal device sets are opened to establish separate and non-interfering calls, and as described above, the Li mu carries out video calls with the dad mother, the grandpa, and the grandfather and grandmother at the same time, but each of the Li mu and the father carries out a call through a separate call channel.
Further, in the video call process, a plurality of signals are transmitted, wherein one part of the signals is signals required by the user, such as voice, video and the like, and the other part of the signals is not directly required by the user and is only used for specially controlling the circuit, the signal of the type is called signaling, the signaling of the initiator terminal device is received, and data information is sent to the initiator terminal device according to the signaling of the initiator terminal device, so that whether data exchange between the initiator terminal device and the centralized communication platform is normal or not is ensured.
S2, according to the multi-party video call request, calling a protocol generation server to generate a session protocol framework.
In detail, referring to fig. 2, the detailed implementation flow diagram of S2 includes:
s21, pre-constructing an original session protocol frame in the protocol generation server, and analyzing to obtain the transmission protocol type, bandwidth information and media format corresponding to the multiparty video communication request.
S22, inputting the transmission protocol type, the bandwidth information and the media format to the appointed position of the original session protocol frame to obtain the session protocol frame.
Further, the original session protocol framework defines a uniform protocol format of the video call, but specific parameters are not added, and the presentation form of each original session protocol framework is different according to different programming languages, such as:
Sessiondescription
v＝(protocol version)
o＝(owner/creator and session identifier).
s＝(session name)
i＝*(session information)
…….
wherein, protocol version represents the version number of the original session protocol frame, and session name represents the name of the original session protocol frame.
The types of the transmission protocol, the bandwidth information and the media format are various, the types of the transmission protocol include RTP, UDP and the like, the bandwidth information can be expressed by megabytes, so that the bandwidth of the terminal device of the initiator at this moment is what, and the types of the media format include h.261video, MPEG video and the like.
And S3, generating a session protocol set by taking the terminal device subscription information set as the address allocation parameter of the session protocol frame.
The signing information of the initiator terminal device of the plum grazing is sign _1, the signing information of the second terminal device of a dad mom is sign _2, the signing information of the third terminal device of a grand mother is sign _3, and the signing information of the fourth terminal device of a grand is sign _4, and the sign _1, sign _2, sign _3 and sign _4 are sequentially used as address distribution parameters of the session protocol framework, so that a session protocol set is generated, for example, the session protocol set of the plum grazing and family video communication comprises three session protocols which respectively correspond to the plum grazing, the father mom, the plum grazing, the grand mom grand, the grand, the plum grazing and the grand.
And S4, sending the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
In detail, the step S4 shown in the detailed implementation flow chart of fig. 3 includes:
and S41, accessing the initiator terminal device and each terminal device in the terminal device set according to the session protocol set.
And S42, acquiring original audio and video information of the initiator terminal device, and preprocessing the original audio and video information to obtain standard audio and video information.
And S43, establishing a conversation control rule, and sending the standard audio and video information to each terminal device in the terminal device set.
Further, the step S41 shown in the detailed implementation flow chart of S41 in fig. 4 includes:
s411, respectively connecting the initiator terminal equipment to the IP multimedia subsystem corresponding to the initiator terminal equipment according to the session protocol set;
s412, accessing the initiator terminal device according to the IP multimedia subsystem corresponding to the initiator terminal device, and accessing each terminal device according to the IP multimedia subsystem corresponding to each terminal device.
The IP multimedia subsystem is abbreviated as IMS network, which is an IP-based standard system of independent access technology, and can be interworked with existing voice and data networks, and its transmission protocol can use a transmission protocol corresponding to the above SIP protocol signaling, which is called SIP transmission signaling protocol, for example, a first terminal device held by librarray (i.e., an initiator terminal device according to the present invention) is connected to the IP multimedia subsystem, a session protocol corresponding to the first terminal device held by librarray can be selected from the session protocol set, and the first terminal device held by librarray is connected to the IP multimedia subsystem according to the SIP transmission signaling protocol.
The preprocessing comprises image de-duplication, image fusion, sound mixing and the like.
Further, the sending the standard audio/video information to each terminal device in the terminal device set according to the established call control rule includes: setting operation authorities of a forbidden word, a locked word, a kicker, a member blacklist and a member white list for the initiator terminal equipment, setting operation authorities of accessing to a multi-party video call and a local equipment for each terminal equipment in the terminal equipment set, presetting a call rule for automatically ending the multi-party video call when the initiator terminal equipment leaves the multi-party video call or only one terminal equipment exists in the multi-party video call, and sending the standard audio and video information to each terminal equipment in the terminal equipment set.
According to the above, after the first terminal device held by the plum grazing, the second terminal device held by a father mother, the third terminal device held by a grandfather's grandmother, and the fourth terminal device held by a grandfather grandmother are accessed to the centralized communication platform, the audio and video information of the first terminal device held by the plum grazing, such as the personal selfie video and the call sound of the plum grazing, is obtained and processed, and after the first terminal device held by the plum grazing is set with the operation authority of forbidden words, locking, kicking, member blacklists, member whitelists and the like, the personal selfie video and the call sound of the plum grazing are sent to the second terminal device held by the father mother, the third terminal device held by the grandfather's grandmother, and the fourth terminal device held by the grandfather grandmother, so that the multiparty video call is completed.
FIG. 5 is a functional block diagram of the multi-party video call device of the present invention.
The multi-party video call device 100 of the present invention can be installed in an electronic device. According to the implemented functions, the multi-party video call device may include a subscription information generation module 101, a session protocol framework generation module 102, a session protocol set generation module 103, and an audio and video information transmission module 104. A module according to the present invention, which may also be referred to as a unit, refers to a series of computer program segments that can be executed by a processor of an electronic device and that can perform a fixed function, and that are stored in a memory of the electronic device.
In the present embodiment, the functions regarding the respective modules/units are as follows:
the subscription information generation module 101 is configured to receive a multi-party video call request initiated by an initiator terminal device, and obtain a terminal device set and a terminal device subscription information set for a video call with the initiator terminal device according to the multi-party video call request.
A session protocol framework generation module 102, configured to invoke a protocol generation server to generate a session protocol framework according to the multiparty video call request.
A session protocol set generating module 103, configured to use the terminal device subscription information set as an address allocation parameter of the session protocol framework, and generate a session protocol set.
And the audio and video information sending module 104 is configured to send the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
The module in the device provided by the application can be based on the multi-party video call method when in use, the multi-party video call request is analyzed to obtain a generated session protocol set, multi-party video call is carried out according to the generated session protocol set, and the technical effect same as that of the method embodiment can be obtained when the device is in specific operation, namely the problem that drawing is complex and occupies memory space under the multi-link type is effectively solved.
Fig. 6 is a schematic structural diagram of an electronic device for implementing the multi-party video call method according to the present invention.
The electronic device 1 may comprise a processor 12, a memory 11 and a bus, and may further comprise a computer program stored in the memory 11 and executable on the processor 12.
The memory 11 includes at least one type of readable storage medium, which includes flash memory, removable hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only to store application software installed in the electronic device 1 and various types of data, such as codes of a multi-party video call program, but also to temporarily store data that has been output or is to be output.
The processor 12 may be formed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be formed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 12 is a Control Unit (Control Unit) of the electronic device, connects various components of the whole electronic device by using various interfaces and lines, and executes various functions and processes data of the electronic device 1 by running or executing programs or modules (e.g., executing a multi-party video call program, etc.) stored in the memory 11 and calling data stored in the memory 11.
The bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is arranged to enable connection communication between the memory 11 and at least one processor 12 or the like.
Fig. 6 only shows an electronic device with components, and it will be understood by a person skilled in the art that the structure shown in fig. 6 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than shown, or a combination of certain components, or a different arrangement of components.
For example, although not shown, the electronic device 1 may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so that functions such as charging management, discharging management, and power consumption management are implemented through the power management device. The power supply may also include one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and any like components. The electronic device 1 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Further, the electronic device 1 may further include a network interface, and optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a bluetooth interface, etc.), which are generally used for establishing a communication connection between the electronic device 1 and other electronic devices.
Optionally, the electronic device 1 may further comprise a user interface, which may be a Display (Display), an input unit (such as a Keyboard), or alternatively, a standard wired interface, or a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the electronic device 1 and for displaying a visualized user interface.
It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.
The multi-party video call requesting program 12 stored in the memory 11 of the electronic device 1 is a combination of instructions, which when executed in the processor 10, can implement:
step one, receiving a multi-party video call request initiated by an initiator terminal device, and acquiring a terminal device set and a terminal device subscription information set which are in video call with the initiator terminal device according to the multi-party video call request.
The embodiment of the invention is applied to a centralized communication Platform, and the centralized communication Platform (CCP for short) is a unified session resource scheduling center and a protocol generation center.
In detail, the acquiring a terminal device set and a terminal device subscription information set for video call with the initiator terminal device according to the multiparty video call request includes: receiving a multi-party video call request initiated by an initiator terminal device, and informing the initiator terminal device to send a signaling; when receiving the signaling of the initiator terminal device, sending receiving information to the initiator terminal device according to the signaling of the initiator terminal device, wherein the signaling can be SIP protocol signaling; and analyzing a terminal equipment set and a terminal equipment subscription information set which have video calls with the initiator terminal equipment from the multi-party video call request, and establishing video call channels with the same number as the terminal equipment sets.
If the plum husbandry is a Chinese person, and is currently reserved in the united states, the plum husbandry and family members can be agreed to use the mobile phone to carry out remote video call at weekend time, and the family members comprise a dad mother, a grand mother and a grandfather grandmother, wherein the dad mother is resident in Shenzhen in China, the grand grandmother is resident in Hefei in China, and the grandfather grandmother is resident in Shanghai in China, the initiator terminal device is the mobile phone held by the plum husbandry.
Further, when the Li pasture initiates a multi-party video call request with family, the centralized communication platform analyzes all terminal devices needing video calls in the multi-party video call request of the Li pasture, and all the terminal devices comprise a second terminal device of dad and mom, a third terminal device of grandpa and a fourth terminal device of grandpa, namely the terminal device set is formed.
The terminal device subscription information set represents subscription information of a terminal and a network. Preferably, each subscription information generally can uniquely represent one terminal, that is, different terminals can be identified through the subscription information of the terminal device, and whether the different terminals have the right to use the network or not is judged. As described above, the subscription information typically differs between the second terminal device of dad and mom, the third terminal device of grandpa, and the fourth terminal device of grandmother.
In detail, the video call channels with the same number as the terminal device sets are opened to establish separate and non-interfering calls, and as described above, the Li mu carries out video calls with the dad mother, the grandpa, and the grandfather and grandmother at the same time, but each of the Li mu and the father carries out a call through a separate call channel.
Further, in the video call process, a plurality of signals are transmitted, wherein one part of the signals is signals required by the user, such as voice, video and the like, and the other part of the signals is not directly required by the user and is only used for specially controlling the circuit, the signal of the type is called signaling, the signaling of the initiator terminal device is received, and data information is sent to the initiator terminal device according to the signaling of the initiator terminal device, so that whether data exchange between the initiator terminal device and the centralized communication platform is normal or not is ensured.
And step two, calling a protocol generation server to generate a session protocol framework according to the multi-party video call request.
In detail, the second step includes: and pre-constructing an original session protocol frame in the protocol generation server, analyzing to obtain a transmission protocol type, bandwidth information and a media format corresponding to the multi-party video call request, and inputting the transmission protocol type, the bandwidth information and the media format to a specified position of the original session protocol frame to obtain the session protocol frame.
Further, the original session protocol framework defines a uniform protocol format of the video call, but specific parameters are not added, and the presentation form of each original session protocol framework is different according to different programming languages, such as:
Sessiondescription
v＝(protocol version)
o＝(owner/creator and session identifier).
s＝(session name)
i＝*(session information)
…….
wherein, protocol version represents the version number of the original session protocol frame, and session name represents the name of the original session protocol frame.
The types of the transmission protocol, the bandwidth information and the media format are various, the types of the transmission protocol include RTP, UDP and the like, the bandwidth information can be expressed by megabytes, so that the bandwidth of the terminal device of the initiator at this moment is what, and the types of the media format include h.261video, MPEG video and the like.
And step three, taking the terminal equipment subscription information set as an address allocation parameter of the session protocol framework to generate a session protocol set.
The signing information of the initiator terminal device of the plum grazing is sign _1, the signing information of the second terminal device of a dad mom is sign _2, the signing information of the third terminal device of a grand mother is sign _3, and the signing information of the fourth terminal device of a grand is sign _4, and the sign _1, sign _2, sign _3 and sign _4 are sequentially used as address distribution parameters of the session protocol framework, so that a session protocol set is generated, for example, the session protocol set of the plum grazing and family video communication comprises three session protocols which respectively correspond to the plum grazing, the father mom, the plum grazing, the grand mom grand, the grand, the plum grazing and the grand.
And fourthly, sending the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
In detail, the fourth step includes: and accessing the initiator terminal equipment and each terminal equipment in the terminal equipment set according to the session protocol set, acquiring original audio and video information of the initiator terminal equipment, preprocessing the original audio and video information to obtain standard audio and video information, constructing a call control rule, and sending the standard audio and video information to each terminal equipment in the terminal equipment set.
Further, the accessing the initiator terminal device and each terminal device in the terminal device set according to the session protocol set includes: and respectively connecting the initiator terminal equipment to the IP multimedia subsystem corresponding to the initiator terminal equipment according to the session protocol set, accessing the initiator terminal equipment according to the IP multimedia subsystem corresponding to the initiator terminal equipment, and accessing each terminal equipment according to the IP multimedia subsystem corresponding to each terminal equipment.
The IP multimedia subsystem is abbreviated as IMS network, which is an IP-based standard system of independent access technology, and can be interworked with existing voice and data networks, and its transmission protocol can use a transmission protocol corresponding to the above SIP protocol signaling, which is called SIP transmission signaling protocol, for example, a first terminal device held by librarray (i.e., an initiator terminal device according to the present invention) is connected to the IP multimedia subsystem, a session protocol corresponding to the first terminal device held by librarray can be selected from the session protocol set, and the first terminal device held by librarray is connected to the IP multimedia subsystem according to the SIP transmission signaling protocol.
The preprocessing comprises image de-duplication, image fusion, sound mixing and the like.
Further, the sending the standard audio/video information to each terminal device in the terminal device set according to the established call control rule includes: setting operation authorities of a forbidden word, a locked word, a kicker, a member blacklist and a member white list for the initiator terminal equipment, setting operation authorities of accessing to a multi-party video call and a local equipment for each terminal equipment in the terminal equipment set, presetting a call rule for automatically ending the multi-party video call when the initiator terminal equipment leaves the multi-party video call or only one terminal equipment exists in the multi-party video call, and sending the standard audio and video information to each terminal equipment in the terminal equipment set.
According to the above, after the first terminal device held by the plum grazing, the second terminal device held by a father mother, the third terminal device held by a grandfather's grandmother, and the fourth terminal device held by a grandfather grandmother are accessed to the centralized communication platform, the audio and video information of the first terminal device held by the plum grazing, such as the personal selfie video and the call sound of the plum grazing, is obtained and processed, and after the first terminal device held by the plum grazing is set with the operation authority of forbidden words, locking, kicking, member blacklists, member whitelists and the like, the personal selfie video and the call sound of the plum grazing are sent to the second terminal device held by the father mother, the third terminal device held by the grandfather's grandmother, and the fourth terminal device held by the grandfather grandmother, so that the multiparty video call is completed.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus, device and method can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
1. A multi-party video call method is applied to a centralized communication platform, and comprises the following steps:
receiving a multi-party video call request initiated by an initiator terminal device, and acquiring a terminal device set and a terminal device subscription information set which are in video call with the initiator terminal device according to the multi-party video call request;
calling a protocol generation server to generate a session protocol framework according to the multiparty video call request;
taking the terminal equipment subscription information set as an address distribution parameter of the session protocol framework to generate a session protocol set;
and sending the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
2. The multiparty video call method according to claim 1, wherein the sending audio/video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set includes:
accessing the initiator terminal equipment and each terminal equipment in the terminal equipment set according to the session protocol set;
acquiring original audio and video information of the initiator terminal device, and preprocessing the original audio and video information to obtain standard audio and video information;
and establishing a conversation control rule, and sending the standard audio and video information to each terminal device in the terminal device set.
3. The multiparty video call method according to claim 2, wherein said accessing the originating terminal device and each terminal device in the terminal device group according to the session protocol group comprises:
according to the session protocol set, connecting the initiator terminal equipment to an IP multimedia subsystem corresponding to the initiator terminal equipment, and connecting each terminal equipment in the terminal equipment set to the IP multimedia subsystem corresponding to each terminal equipment;
and accessing the initiator terminal equipment according to the IP multimedia subsystem corresponding to the initiator terminal equipment, and accessing each terminal equipment according to the IP multimedia subsystem corresponding to each terminal equipment.
4. The multiparty video call method according to claim 2, wherein said constructing a call control rule comprises:
setting a call operation authority in the initiator terminal device;
setting access multi-party video call authority and local equipment operation authority in each terminal equipment in the terminal equipment set;
and presetting a call rule that the multi-party video call is automatically ended when the initiator terminal equipment leaves the multi-party video call or only one terminal equipment exists in the multi-party video call.
5. The multi-party video call method according to claim 2, wherein the preprocessing comprises image de-duplication processing, image fusion processing, and audio mixing processing.
6. The multiparty video call method according to any one of claims 1 to 5, wherein the obtaining a terminal device set and a terminal device subscription information set for a video call with the initiator terminal device according to the multiparty video call request includes:
informing the initiator terminal device to send a signaling, and sending a receiving message to the initiator terminal device according to the signaling of the initiator terminal device;
when the sending and receiving messages are successful, a terminal equipment set and a terminal equipment subscription information set which are in video call with the initiator terminal equipment are analyzed from the multi-party video call request.
7. The multiparty video call method according to any one of claims 1 to 5, wherein said invoking a protocol generation server to generate a session protocol framework according to the multiparty video call request comprises:
an original session protocol framework is pre-constructed in the protocol generation server, and the multi-party video call request is analyzed to obtain the type of a transmission protocol, bandwidth information and a media format;
and inputting the transmission protocol type, the bandwidth information and the media format to the specified position of the original session protocol framework to obtain a session protocol framework.
8. A multi-party video call device, the device comprising:
the contract information generating module is used for receiving a multi-party video call request initiated by an initiator terminal device and acquiring a terminal device set and a terminal device contract information set which are in video call with the initiator terminal device according to the multi-party video call request;
a session protocol frame generating module, configured to invoke a protocol generating server to generate a session protocol frame according to the multiparty video call request;
a session protocol set generating module, configured to use the terminal device subscription information set as an address allocation parameter of the session protocol framework to generate a session protocol set;
and the audio and video information sending module is used for sending the audio and video information of the initiator terminal device to each terminal device in the terminal device set according to the session protocol set.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the multi-party video call method of any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the multiparty video call method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911282591.5A CN111131741B (en) | 2019-12-13 | 2019-12-13 | Multi-party video call method, electronic device, device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911282591.5A CN111131741B (en) | 2019-12-13 | 2019-12-13 | Multi-party video call method, electronic device, device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111131741A true CN111131741A (en) | 2020-05-08 |
| CN111131741B CN111131741B (en) | 2021-08-13 |
Family
ID=70498665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911282591.5A Active CN111131741B (en) | 2019-12-13 | 2019-12-13 | Multi-party video call method, electronic device, device, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111131741B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112637540A (en) * | 2020-12-14 | 2021-04-09 | 招商局金融科技有限公司 | Multi-client audio and video call connection method, device, equipment and storage medium |
| CN114338618A (en) * | 2020-10-10 | 2022-04-12 | 中国电信股份有限公司 | Multi-party call method, system, conference server and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095664A (en) * | 2011-10-31 | 2013-05-08 | 国际商业机器公司 | Method and system establishing internet protocol (IP) multi-media session |
| CN103200383A (en) * | 2012-01-04 | 2013-07-10 | 中国移动通信集团公司 | Method, device and system capable of achieving high-definition videophone services |
| US20140333713A1 (en) * | 2012-12-14 | 2014-11-13 | Biscotti Inc. | Video Calling and Conferencing Addressing |
| CN104580247A (en) * | 2015-01-27 | 2015-04-29 | 宇龙计算机通信科技(深圳)有限公司 | Information synchronization method and information synchronization device based on IMS multi-party calls |
| CN104735034A (en) * | 2013-12-24 | 2015-06-24 | 中国移动通信集团公司 | Media stream transmission method, device and system |
| CN105763537A (en) * | 2016-01-29 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Multi-party call method and device |
| CN107959665A (en) * | 2016-10-18 | 2018-04-24 | 北京视联动力国际信息技术有限公司 | A kind of communication means and communication system |
-
2019
- 2019-12-13 CN CN201911282591.5A patent/CN111131741B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095664A (en) * | 2011-10-31 | 2013-05-08 | 国际商业机器公司 | Method and system establishing internet protocol (IP) multi-media session |
| CN103200383A (en) * | 2012-01-04 | 2013-07-10 | 中国移动通信集团公司 | Method, device and system capable of achieving high-definition videophone services |
| US20140333713A1 (en) * | 2012-12-14 | 2014-11-13 | Biscotti Inc. | Video Calling and Conferencing Addressing |
| CN104735034A (en) * | 2013-12-24 | 2015-06-24 | 中国移动通信集团公司 | Media stream transmission method, device and system |
| CN104580247A (en) * | 2015-01-27 | 2015-04-29 | 宇龙计算机通信科技(深圳)有限公司 | Information synchronization method and information synchronization device based on IMS multi-party calls |
| CN105763537A (en) * | 2016-01-29 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Multi-party call method and device |
| CN107959665A (en) * | 2016-10-18 | 2018-04-24 | 北京视联动力国际信息技术有限公司 | A kind of communication means and communication system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114338618A (en) * | 2020-10-10 | 2022-04-12 | 中国电信股份有限公司 | Multi-party call method, system, conference server and electronic equipment |
| CN112637540A (en) * | 2020-12-14 | 2021-04-09 | 招商局金融科技有限公司 | Multi-client audio and video call connection method, device, equipment and storage medium |
| CN112637540B (en) * | 2020-12-14 | 2023-02-28 | 招商局金融科技有限公司 | Multi-client audio and video call connection method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111131741B (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170192819A1 (en) | Method and electronic device for resource allocation | |
| CN109905697A (en) | Video conference test method, device and storage medium | |
| CN108055304B (en) | Remote data synchronization method, device, server, equipment and storage medium | |
| CN110691331B (en) | Conference presentation method, device and terminal device based on bluetooth mesh technology | |
| CN105610777A (en) | remote live broadcast method and system | |
| CN111131741B (en) | Multi-party video call method, electronic device, device, and computer-readable storage medium | |
| CN103841466A (en) | Screen projection method, computer end and mobile terminal | |
| WO2019205555A1 (en) | Method and apparatus for pushing message | |
| AU2015272424A1 (en) | Communication apparatus, communication system, communication management system, communication control method, and computer program product | |
| US20250008170A1 (en) | Data stream-based playing method and apparatus, device, and medium | |
| US9489939B2 (en) | Speech server managing one or a plurality of pieces of speech terminal-specifying information and user-specifying information | |
| JP2018521583A (en) | Application implementation method and service controller | |
| CN114040189A (en) | Multimedia test method, device, storage medium and electronic equipment | |
| EP2429162A1 (en) | Seat service processing method and ip seat terminal | |
| CN114125024A (en) | Audio transmission method, electronic device and readable storage medium | |
| JP6724423B2 (en) | Communication terminal, communication system, output method, and program | |
| CN112637540B (en) | Multi-client audio and video call connection method, device, equipment and storage medium | |
| CN104391576A (en) | Remote input method and device based on wireless Ethernet | |
| CN108282670A (en) | Code converter for real-time imaging synthesis | |
| CN116032691B (en) | Shooting range interconnection method, electronic equipment and readable storage medium | |
| CN113452948B (en) | Conference terminal control method, device, equipment and storage medium | |
| CN113114755A (en) | Method and device for smooth switching between devices, electronic device and storage medium | |
| CN114640595A (en) | Cascading method, device, electronic equipment and storage medium | |
| CN111901561A (en) | Video data processing method, device and system in monitoring system and storage medium | |
| AU2022267510B2 (en) | Data transmission method and data transmission device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |