CN109963108B

CN109963108B - One-to-many talkback method and device

Info

Publication number: CN109963108B
Application number: CN201910127616.8A
Authority: CN
Inventors: 杨伟中; 朱道彦; 韩杰; 崔博
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-02-20
Filing date: 2019-02-20
Publication date: 2021-10-19
Anticipated expiration: 2039-02-20
Also published as: CN109963108A

Abstract

The embodiment of the application provides a one-to-many talkback method and a one-to-many talkback device, which are applied to a video network, wherein a talkback service protocol packet is generated when a video network terminal receives one-key operation of talkback service; the video networking terminal sends the talkback service protocol packet to the video networking server; the video networking server is used for sending the talkback service protocol packet to the conference chairman terminal; the video networking terminal receives a setting success instruction sent by the video networking server; the conference chairman terminal sets the video network terminal corresponding to the first identification mark as a speaker for the talkback service protocol packet, and then generates the setting success instruction and sends the setting success instruction to the video network server; the embodiment of the application creates a one-to-many talkback mode based on the video networking, and has the advantages of high safety, low delay and the like.

Description

One-to-many talkback method and device

Technical Field

The application relates to the technical field of video networking, in particular to a one-to-many talkback method and a one-to-many talkback device.

Background

The IP network-based intercom technology is widely applied in the prior art, but in an emergency, sudden and high-confidentiality scene, the IP network-based intercom technology has great hidden data transmission hazards, information is easy to tamper, and safety, reliability and delay performance cannot be well guaranteed.

Disclosure of Invention

In view of the above, embodiments of the present application are proposed to provide a method for one-to-many intercom and a corresponding apparatus for one-to-many intercom that overcome or at least partially solve the above problems.

In order to solve the above problem, an embodiment of the present application discloses a one-to-many intercom method, where the method is applied to a video network, where the video network includes a chairman terminal, a video network server connected to the chairman terminal, and multiple video network terminals connected to the video network server, and the method includes:

the video networking terminal generates an talkback service protocol packet when receiving one-key operation of talkback service; the talkback service protocol packet comprises a first identification mark of the video network terminal;

the video networking terminal sends the talkback service protocol packet to the video networking server; the video networking server is used for sending the talkback service protocol packet to the conference chairman terminal;

the video networking terminal receives a setting success instruction sent by the video networking server; the conference chairman terminal sets the video network terminal corresponding to the first identification mark as a speaker for the talkback service protocol packet, and then generates the setting success instruction and sends the setting success instruction to the video network server;

the video networking terminal collects local audio data and sends the local audio data to the video networking server according to the setting success instruction; the video network server is used for sending the local audio data to a target video network terminal corresponding to a plurality of second identification marks in a conference list in a broadcasting mode according to the plurality of second identification marks; and the target video network terminal is used for playing the local audio data.

Optionally, the video network further includes a video network conference control system pamir user terminal, and the conference chairman terminal is connected with the pamir user terminal; the method further comprises the following steps:

the video network terminal receives a conference service instruction sent by the video network server; the conference service instruction is generated by the pamir user side when receiving triggering operation of invitation of a participant, comprises an identification mark of a target video networking terminal and is sent to the conference chairman terminal; the conference chairman terminal is used for sending the conference service instruction to the video networking server; the video network server is used for sending the conference service instruction to a target video network terminal corresponding to the identification mark;

the video network terminal generates a service response instruction aiming at the conference service instruction and sends the service response instruction to the video network server; the video network server is used for sending the service response instruction to the conference chairman terminal; the conference chairman terminal is used for sending the service response instruction to the pamir user side; and the pamir user side is used for displaying the service response instruction.

Optionally, the step of generating, by the video networking terminal, a service response instruction for the conference service instruction and sending the service response instruction to the video networking server includes:

when the video networking terminal receives the conference service instruction, whether a conference disturbance-free configuration item is in an open state is inquired;

when the conference disturbance-free configuration item is in an open state, the video networking terminal generates a service response instruction; the service response instruction comprises interference-free state information aiming at the conference service instruction;

and the video network terminal sends the service response instruction to the video network server.

Optionally, the method further includes:

and when the service response instruction comprises the disturbance-free state information aiming at the conference service instruction, the pamir user side is used for removing the target video networking terminal from a conference list.

when the conference disturbance-free configuration item is not in an open state, the video networking terminal generates a service response instruction; the service response instruction comprises acknowledgement reply information aiming at the conference service instruction;

Optionally, the method further includes:

when the service response instruction comprises the acknowledgement reply information aiming at the conference service instruction, the pamir user side is used for sending the identification mark of the target video network terminal to the video network server;

and the video network server is used for writing the identification mark of the target video network terminal into the conference list.

In order to solve the above problem, based on the same concept, the embodiment of the present application discloses a device for one-to-many intercom, the device is applied to a video network, the video network includes a conference chairman terminal, a video network server connected with the conference chairman terminal, and a plurality of video network terminals connected with the video network server, the video network terminal includes:

the talkback service protocol packet generating module is used for generating a talkback service protocol packet when one-key operation of the talkback service is received; the talkback service protocol packet comprises a first identification mark of the video network terminal;

the talkback service protocol packet sending module is used for sending the talkback service protocol packet to the video networking server; the video networking server is used for sending the talkback service protocol packet to the conference chairman terminal;

the setting success instruction receiving module is used for receiving the setting success instruction sent by the video network server; the conference chairman terminal sets the video network terminal corresponding to the first identification mark as a speaker for the talkback service protocol packet, and then generates the setting success instruction and sends the setting success instruction to the video network server;

the local audio data acquisition module is used for acquiring local audio data according to the setting success instruction and sending the local audio data to the video networking server; the video network server is used for sending the local audio data to a target video network terminal corresponding to a plurality of second identification marks in a conference list in a broadcasting mode according to the plurality of second identification marks; and the target video network terminal is used for playing the local audio data.

Optionally, the video network further includes a video network conference control system pamir user terminal, and the conference chairman terminal is connected with the pamir user terminal; the video networking terminal further comprises:

the conference service instruction receiving module is used for receiving a conference service instruction sent by the video network server; the conference service instruction is generated by the pamir user side when receiving triggering operation of invitation of a participant, comprises an identification mark of a target video networking terminal and is sent to the conference chairman terminal; the conference chairman terminal is used for sending the conference service instruction to the video networking server; the video network server is used for sending the conference service instruction to a target video network terminal corresponding to the identification mark;

the service response instruction generating module is used for generating a service response instruction aiming at the conference service instruction and sending the service response instruction to the video networking server; the video network server is used for sending the service response instruction to the conference chairman terminal; the conference chairman terminal is used for sending the service response instruction to the pamir user side; and the pamir user side is used for displaying the service response instruction.

An embodiment of the present application further provides an apparatus, including:

one or more processors; and

one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform one or more of the methods of embodiments of the present application.

Embodiments of the present application also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more of the methods described in embodiments of the present application.

The embodiment of the application has the following advantages:

the method and the device have the advantages that the characteristics of the video network are applied, a one-to-many talkback mode based on the video network is created, the characteristics that the video network is in a two-layer link private network and a non-video network user cannot access are utilized, voice conversation safety in the talkback process is effectively guaranteed, conversation is more stable, local audio data are directly forwarded by a video network server with higher processing performance, low delay of talkback can be achieved, and user experience is improved;

according to the embodiment of the application, the characteristics of the video networking are applied, and for the video networking terminal which has audio and video processing capacity and can participate in the video networking video conference, a conference disturbance-free configuration item is added in the system configuration of the video networking terminal, so that the disturbance-free function of the video networking terminal for the conference can be realized, the normal operation of other video networking services which are currently operated can be ensured, and the user experience can be improved;

the embodiment of the application can realize the way of carrying out the talkback service based on the video networking protocol by using the existing equipment, is economical and practical, has lower research and development cost, and makes the security of the talkback technology have a leap;

in the embodiment of the application, the conference list is used as a unit, the talkback service group can be effectively managed, when a plurality of one-to-many talkback services exist in the video network, the video network server can not miss a certain user or string when the local audio data is forwarded, and the practicability is high.

Drawings

FIG. 1 is a networking schematic of a video network of the present application;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present application;

fig. 3 is a schematic diagram of a hardware architecture of an access switch of the present application;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present application;

FIG. 5 is a schematic diagram of a networking system of a one-to-many intercom system according to an embodiment of the present application;

FIG. 6 is a flow chart of the steps of a method of one-to-many intercom according to an embodiment of the present application;

fig. 7 is a block diagram of a one-to-many intercom device according to an embodiment of the present application.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present application, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present application can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present application: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Because the intercom technology based on the IP network generally adopts a common intercom to carry out the intercom service, but the intercom mostly uses the session initiation protocol SIP or low-frequency channel communication of the Internet, under the complex multi-network environment, the network communication delay is high, the conversation stability is low, the intercom is easy to suffer from network attack, the information is easy to be tampered, and the safety performance is poor.

Based on the characteristics of the video network and the technical problems of the application, one of the core concepts of the embodiment of the application is provided, a video network video conference control system is utilized to follow the protocol of the video network, firstly, a video network conference is established, video network terminals needing to participate in the talkback service are invited to the video network conference, and identification marks of all the video network terminals participating in the video network conference are recorded in a video network server; when a certain video network terminal initiates a one-key talkback service, a conference chairman terminal sets the video network terminal as a speaker, and returns a setting success instruction to the video network terminal; the video network terminal collects local audio data and sends the local audio data to the video network server according to the successful setting instruction, then the video network server sends the local audio data to a target video network terminal corresponding to a second identification mark in a broadcasting mode according to the second identification marks recorded in a conference list, and the target video network terminal plays the local audio data. The embodiment of the application realizes the one-to-many talkback mode based on the video network through the above mode, utilizes the video network to be in a two-layer link private network, and a non-video network user can not access, thereby effectively ensuring the voice call safety in the talkback process, and the call is more stable, the local audio data is directly forwarded by a video network server with higher processing performance, the talkback low delay performance can be realized, and the improvement of the user experience feeling is facilitated.

Next, the invention of the present application is explained in detail by the system, the method and the device for publishing live broadcast service described in embodiments 1 to 3.

Example 1:

as shown in fig. 5, a networking schematic diagram of a one-to-many intercom system according to an embodiment of the present application is shown, and the method may be applied to a video network, where the video network includes a chairman terminal 51, a video network server 52 connected to the chairman terminal 51, and a plurality of video network terminals 53 connected to the video network server 52.

The video network is located in the second layer of the network protocol layer, is a complete set of network communication protocol system designed for supporting a super-large-scale, high-bandwidth and real-time communication network, can establish addressing and communication between different terminals independently of an IP protocol, realizes a real-time communication network system with quality assurance, and is a large-scale and high-bandwidth real-time switching network communication technology which is in the same level with the IP protocol. The video network is composed of 255 video network servers 52, video network terminals 53 and other auxiliary systems, and the video network terminals 53 must be connected with the video network servers 52 to communicate and perform services with video network devices located in different network areas in other video networks.

The 255 video network servers 52 are divided into a master core server and 254 slave core servers, each slave core server is connected with tens of thousands of video network terminals 53, and the transmitted data is transmitted to other slave core servers only by forwarding through the master core server of the video network. The video networking service is a centralized control node of the video conference and can control the transmission of data of the whole video conference.

The video network terminal 53 mentioned in the embodiment of the present application includes two types, one is an entity terminal, and the other is a video network APP client mountable on a mobile terminal (such as a smart phone and a tablet). After a video network APP client joins in the video network and is established with the video network server 52, a connection is established with a virtual terminal in the video network server 52, and data sent by the video network APP client is forwarded in the video network through the virtual terminal.

The entity terminal is a service landing device on the video network, and an actual participant or a server of the video network service has strong audio and video processing capability, rich audio and video interfaces, capability of providing multi-path 1080P high-definition video coding and decoding capability and multi-picture full-screen display function. The functions included are: video conference, video monitoring, video telephone, video on demand, live broadcasting release, remote training and the like. The volume is small and exquisite, light.

The video networking APP client is an important component of video networking communication, such as a video networking mobile phone palm communication APP, and has the functions of video call, video monitoring, one-key alarm, one-key talkback, remote training and the like.

In a video networking conference, conference services are generally managed by a pamir client, the pamir client belongs to a video networking video conference control software and is installed in a computer, and the pamir client belongs to a mature product in the video networking and is sold in the market, which belongs to the prior art, and the functional principle of the pamir client is not described herein. The pamir ue can set any of the participant terminals (typically, the internet of view terminal 53) as the chairman terminal 51, and the chairman terminal 51 can be used to forward the data packet or signaling, command, etc. of the pamir ue to the internet of view server 52.

The chairman terminal 51 also belongs to a kind of video network terminal 53, and referring to the explanation of the video network terminal 53, it can control other participating terminals, control the whole conference, and can control a participating terminal or several participating terminals individually, for example: the switching of the split screen modules can be carried out, and the pictures of a plurality of participant terminals can be displayed on the conference chairman terminal 51 at the same time; or the chairman terminal 51 may perform operations to remove and add a participant.

To solve the technical problem of the embodiment of the present application, and according to the emergency intercom system described in embodiment 1, in order to establish a video networking conference, a video networking terminal 53 that will participate in the intercom task needs to be invited to enter the conference first, and the specific implementation method may include the following steps:

step 1: the video network terminal 53 receives the conference service instruction sent by the video network server 52; the conference service instruction is generated by the pamir user terminal when receiving a triggering operation of invitation of a participant, includes an identification mark of a target video network terminal 53, and is sent to the conference chairman terminal 51; the conference chairman terminal 51 is configured to send the conference service instruction to the video network server 52; the video network server 52 is configured to send the conference service instruction to a target video network terminal 53 corresponding to the identification identifier;

step 2: the video network terminal 53 generates a service response instruction for the conference service instruction and sends the service response instruction to the video network server 52; the video network server 52 is configured to send the service response instruction to the conference chairman terminal 51; the conference chairman terminal 51 is configured to send the service response instruction to the pamir user side; and the pamir user side is used for displaying the service response instruction.

At present, in the video networking, when the video networking terminal 53 operates normally, the video networking terminal 53 is often pulled into a conference in a famous place, and the video networking terminal 53 is pulled into the conference and can not actively quit the conference (a participant can not actively quit the conference and can only quit the conference by a conference chairman), so that the current service or operation of the video networking terminal 53 is interrupted, and the user experience is influenced. Therefore, in order to solve the above problem, in a preferred embodiment of the present application, the step of generating a service response instruction and sending the service response instruction to the video network server 52 by the video network terminal 53 for the conference service instruction is improved, and specifically, the method may include the following sub-steps:

substep 21: when receiving the conference service instruction, the video networking terminal 53 queries whether a conference disturbance-free configuration item is in an open state;

substep 22: when the conference disturbance-free configuration item is in an open state, the video networking terminal 53 generates a service response instruction; the service response instruction comprises interference-free state information aiming at the conference service instruction;

substep 23: the terminal 53 of the video network sends the service response instruction to the server 52 of the video network.

The conference disturbance-free configuration item in the embodiment of the present application may be set in the system configuration item of the video networking terminal 53, and there are various specific configuration modes, such as a flight mode on an existing mobile phone or a disturbance-free mode on a smart phone, as long as the purpose of the present application is achieved within the protection scope of the present application, reference may be made to the prior art, and details are not repeated here.

The method for opening the non-disturbing configuration item for the conference can refer to the following alternative embodiments:

and when receiving the triggering operation of the conference disturbance-free starting, the video networking terminal 53 starts the conference disturbance-free configuration item.

After receiving the service response instruction, the pamir user reads the disturbance-free state information in the service response instruction for the conference service instruction, and then removes the video networking terminal 53 from the conference list.

In practice, the conference list is shown as visible in the display interface of the pamir client, but the actual conference list is stored in the video network server 52. Next, it is explained how to remove the video networking terminal 53 from the conference list, and the method may specifically include the following steps:

the pamir user side is used for generating a party removing instruction when the disturbance-free state information is received; wherein, the participant removing instruction comprises the identification of the target video network terminal 53;

the pamir user side is configured to send the conference removal instruction to the conference chairman terminal 51;

the conference chairman terminal 51 is used for sending the participation removal instruction to the video network server 52;

the view network server 52 is configured to remove the target view network terminal 53 corresponding to the identifier from the meeting list according to the meeting removal instruction.

When the video network server 52 removes the target video network terminal 53 from the conference list, the video network server 52 receives the local audio data sent by any participant terminal in the conference list, and the local audio data is not sent to the target video network terminal 53, so that the whole conference non-disturbing function of the video network terminal 53 is completed, normal operation of other currently operating video network services can be ensured, and the user experience can be improved.

Of course, similarly, if the current video networking terminal 53 does not perform other services except for the video conference, the sub-step of the video networking terminal 53 generating a service response instruction for the conference service instruction and sending the service response instruction to the video networking server 52 may also include:

substep 24: when receiving the conference service instruction, the video networking terminal 53 queries whether a conference disturbance-free configuration item is in an open state;

substep 25: when the conference do not-disturb configuration item is not in an on state, the video networking terminal 53 generates a service response instruction; the service response instruction comprises acknowledgement reply information aiming at the conference service instruction;

substep 26: the terminal 53 of the video network sends the service response instruction to the server 52 of the video network.

At this time, when the service response instruction includes the acknowledgement reply information for the conference service instruction, the pamir ue is configured to send the identification identifier of the target internet-of-view terminal 53 to the internet-of-view server 52;

the video network server 52 is configured to write the identification of the target video network terminal 53 into the conference list.

The following explains a specific implementation method for solving the technical problem, and is described in detail in example 2.

Example 2:

as shown in fig. 6, a flowchart illustrating steps of a one-to-many intercom method according to an embodiment of the present application is shown, where the method is applicable to a video network, and the method is applied to a video network terminal 53 shown in fig. 5; the method may specifically comprise the steps of:

step S601: when the video networking terminal 53 receives the one-key operation of the talkback service, a talkback service protocol packet is generated; wherein, the talkback service protocol packet includes the first identification of the video network terminal 53;

when the video network terminal 53 is an entity terminal, the one-key operation of the talk-back service may be a shortcut key located on the entity terminal pressed by a user using the video network terminal 53; when the video network terminal 53 is an APP client, the one-key operation of the talk-back service may be a virtual shortcut key on the APP client display screen touched by the user, or a talk-back service is developed by using a voice application.

Then, the video network terminal 53 generates a corresponding talkback service protocol packet according to the received operation, so as to facilitate the video network server 52 to identify the sender of the talkback service protocol packet, i.e., identify the person who applies for talkback, where the talkback service protocol packet carries the first identification of the video network terminal 53.

Step S602: the video networking terminal 53 sends the talkback service protocol packet to the video networking server 52; the video network server 52 is configured to send the talkback service protocol packet to the chairman terminal 51;

since the video network terminal 53 is divided into an entity terminal and an APP client, the video network server 52 directly and transparently transmits the talkback service protocol packet to the conference chairman terminal 51 after receiving the talkback service protocol packet sent by the entity terminal.

When the video network terminal 53 is an APP client, since the APP client is installed on the mobile terminal based on the internet protocol, the video network server 52 is configured to send the talkback service protocol packet to the conference chairman terminal 51, and specifically includes the following sub-steps:

the video network server 52 is configured to select an idle virtual terminal to generate a binding relationship with the first identifier;

the video networking server 52 sends the talkback service protocol packet to the chairman terminal 51 by using the virtual terminal.

Step S603: the video network terminal 53 receives the setting success instruction sent by the video network server 52; the successful setting instruction is generated by the chairman terminal 51 setting the video network terminal 53 corresponding to the first identification identifier as a speaker for the talkback service protocol packet, and sending the video network terminal to the video network server 52;

after receiving the talkback service protocol packet, the chairman terminal 51 of the conference according to the embodiment of the application sets the terminal 53 of the video network corresponding to the first identification identifier as a speaker according to the request of the talkback service protocol packet, and then generates a successful setting instruction. In the setting success instruction, the first identification mark of the video network terminal 53 is also included, then the conference chairman terminal 51 sends the setting success instruction to the video network server 52, and then the video network server 52 forwards the setting success instruction to the video network terminal 53 (the video network terminal 53 at this time is an entity terminal), or forwards the setting success instruction to the video network terminal 53 by using a virtual terminal (the video network terminal 53 at this time is a video network APP).

Step S604: the video network terminal 53 collects local audio data and sends the local audio data to the video network server 52 according to the setting success instruction; the video network server 52 is configured to send the local audio data to a target video network terminal 53 corresponding to a plurality of second identifiers in the conference list in a broadcast manner according to the second identifiers; the target video network terminal 53 is configured to play the local audio data.

After receiving the setting success instruction, the video networking terminal 53 of the embodiment of the application further includes the following steps:

and the video network terminal 53 triggers a speech acquisition notification according to the setting success instruction.

The speech acquisition notification may be a voice notification or a display notification, and the physical terminal may further be a notification of a change in lighting (for example, when a button of the intercom service is pressed, a display lamp on the physical terminal is a red light, and when the notification of successful setting is received, the display lamp on the physical terminal may be changed from the red light to a green light, which indicates that the terminal has been used as a speech party and can normally acquire a voice signal.)

After receiving the announcement collection notification, the user can speak to the terminal 53 of the video network, and the terminal 53 of the video network sends the collected local audio data to the server 52 of the video network. After receiving the local audio data, the video network server 52 sends the local audio data to the target video network terminal 53 corresponding to the second identification identifier in a broadcast manner, and then the target video network terminal 53 decodes and plays the local audio data, so that the voice of the speaker can be heard.

Of course, when any participant (the terminal 53 of the video network) wants to speak, the way of initiating the talk back refers to the specific process of embodiment 2, and is not described herein again.

The video network terminal 53 corresponding to the first identification mark or the target video network terminal 53 corresponding to the second identification mark in the embodiment of the application is stored in a conference list, and the conference list can effectively manage the talkback service group, so that when a plurality of one-to-many talkback services exist in the video network at the same time, the video network server 52 can not miss a certain user or a serial line when the local audio data is forwarded, and the practicability is strong.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.

Example 3:

as shown in fig. 7, based on the same inventive concept, corresponding to the method in embodiment 2 of the present application, a structural block diagram of an apparatus for one-to-many intercom according to the embodiment of the present application is shown, where the apparatus may be applied to a video network, and specifically, applied to a video network terminal 53 shown in fig. 5, where the video network terminal 53 may specifically include the following modules:

the talkback service protocol packet generating module 701 is configured to generate a talkback service protocol packet when a one-key operation of a talkback service is received; wherein, the talkback service protocol packet includes the first identification of the video network terminal 53;

an intercom service protocol packet sending module 702, configured to send the intercom service protocol packet to the video networking server 52; the video network server 52 is configured to send the talkback service protocol packet to the chairman terminal 51;

a setting success instruction receiving module 703, configured to receive a setting success instruction sent by the video network server 52; the successful setting instruction is generated by the chairman terminal 51 setting the video network terminal 53 corresponding to the first identification identifier as a speaker for the talkback service protocol packet, and sending the video network terminal to the video network server 52;

a local audio data acquisition module 704, configured to acquire local audio data according to the setting success instruction and send the local audio data to the video network server 52; the video network server 52 is configured to send the local audio data to a target video network terminal 53 corresponding to a plurality of second identifiers in the conference list in a broadcast manner according to the second identifiers; the target video network terminal 53 is configured to play the local audio data.

Based on the same inventive concept, corresponding to the method in embodiment 2 of the present application, the video networking terminal 53 may further include the following modules:

a conference service instruction receiving module, configured to receive a conference service instruction sent by the video network server 52; the conference service instruction is generated by the pamir user terminal when receiving a triggering operation of invitation of a participant, includes an identification mark of a target video network terminal 53, and is sent to the conference chairman terminal 51; the conference chairman terminal 51 is configured to send the conference service instruction to the video network server 52; the video network server 52 is configured to send the conference service instruction to a target video network terminal 53 corresponding to the identification identifier;

a service response instruction generating module, configured to generate a service response instruction for the conference service instruction and send the service response instruction to the video network server 52; the video network server 52 is configured to send the service response instruction to the conference chairman terminal 51; the conference chairman terminal 51 is configured to send the service response instruction to the pamir user side; and the pamir user side is used for displaying the service response instruction.

one or more processors; and

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The one-to-many intercom method and the one-to-many intercom device provided by the application are introduced in detail, specific examples are applied in the text to explain the principle and the implementation mode of the application, and the description of the above embodiments is only used for helping to understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A one-to-many intercom method, wherein the method is applied to a video network, the video network comprises a chairman terminal, a video network server connected with the chairman terminal, and a plurality of video network terminals connected with the video network server, and the method comprises the following steps:

aiming at the talkback service, a video networking conference is established, video networking terminals participating in the talkback service are invited into the video networking conference, and identification marks of all the video networking terminals participating in the video networking conference are recorded in the video networking server to obtain a conference list;

when any video networking terminal in the conference list receives one-key operation of talkback service, generating a talkback service protocol packet; the talkback service protocol packet comprises a first identification mark of the video network terminal;

the video networking terminal triggers a speech acquisition notice according to the successful setting instruction, acquires local audio data and sends the local audio data to the video networking server; the video network server is used for sending the local audio data to a target video network terminal corresponding to a plurality of second identification marks in a conference list in a broadcasting mode according to the plurality of second identification marks; the target video network terminal is used for playing the local audio data;

when the video networking terminal is an entity terminal, one-key operation of the talkback service is a shortcut key on the entity terminal; when the video networking terminal is an APP client, one-key operation of the talkback service is a virtual shortcut key on a display screen of the APP client.

2. The method of claim 1, wherein the video network further comprises a video network conference control system pamir client, and the chairman terminal is connected with the pamir client; the method further comprises the following steps:

3. The method according to claim 2, wherein the step of generating and sending a service response instruction to the video network server by the video network terminal aiming at the conference service instruction comprises:

4. The method of claim 3, further comprising:

5. The method according to claim 2, wherein the step of generating and sending a service response instruction to the video network server by the video network terminal aiming at the conference service instruction comprises:

6. The method of claim 5, further comprising:

7. A one-to-many intercom device is characterized in that the device is applied to a video network, the video network comprises a conference chairman terminal, a video network server connected with the conference chairman terminal and a plurality of video network terminals connected with the video network server, a video network conference is established for intercom services, all the video network terminals participating in the intercom services are invited to the video network conference, and all identification marks of all the video network terminals participating in the video network conference are recorded in the video network server to obtain a conference list; the video network terminal is any one video network terminal in the conference list, and the method comprises the following steps:

the local audio data acquisition module is used for triggering a speech acquisition notice according to the setting success instruction, acquiring local audio data and sending the local audio data to the video networking server; the video network server is used for sending the local audio data to a target video network terminal corresponding to a plurality of second identification marks in a conference list in a broadcasting mode according to the plurality of second identification marks; the target video network terminal is used for playing the local audio data;

8. The apparatus of claim 7, wherein the video network further comprises a video network conference control system pamir client, and the chairman terminal is connected with the pamir client; the video networking terminal further comprises:

9. An apparatus for one-to-many intercom, comprising:

one or more processors; and

one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of any of claims 1-6.

10. A machine-readable medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-6.