CN114422864A - Audio and video weak network resisting transmission method and system - Google Patents
Audio and video weak network resisting transmission method and system Download PDFInfo
- Publication number
- CN114422864A CN114422864A CN202111610243.3A CN202111610243A CN114422864A CN 114422864 A CN114422864 A CN 114422864A CN 202111610243 A CN202111610243 A CN 202111610243A CN 114422864 A CN114422864 A CN 114422864A
- Authority
- CN
- China
- Prior art keywords
- data
- unit
- checking
- block data
- streaming media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000005540 biological transmission Effects 0.000 title claims abstract description 35
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000000903 blocking effect Effects 0.000 claims description 31
- 238000012549 training Methods 0.000 claims description 23
- 238000013473 artificial intelligence Methods 0.000 claims description 12
- 238000002372 labelling Methods 0.000 claims description 8
- 238000000638 solvent extraction Methods 0.000 claims description 7
- 230000007774 longterm Effects 0.000 abstract description 3
- 238000012937 correction Methods 0.000 description 6
- 230000006854 communication Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000011217 control strategy Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1829—Arrangements specially adapted for the receiver end
- H04L1/1864—ARQ related signaling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23113—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method and a system for transmitting audio and video weak network, comprising a sending end, a receiving end and a server; the sending end comprises a data coding unit, an intelligent sending unit and a backup data unit; the sending end establishes a network state model according to the real-time data statistical feedback of the receiving end, dynamically adjusts the data coding strategy and the data sending strategy according to the network state model, enables the data coding strategy and the data sending strategy to be more intelligent, and meanwhile, quickly corrects according to the real-time feedback of the receiving end, has self-learning capability, and can adapt to weak network data transmission under complex network conditions; the backup data which is successfully sent is deleted, so that the utilization rate of the storage space is increased, and the long-term occupation of the backup data is avoided; after data are lost in the weak network environment, by setting the serial number and the checking unit, missing data can be timely found, targeted sending is achieved, processing efficiency is improved, the occupied time of the retransmission process is short, data ductility is reduced, and weak network resistance is improved.
Description
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to an audio and video weak network transmission resisting method and system.
Background
Real-time transport protocol (RTP) is a network protocol for processing multimedia data streams on the Internet, and it can be used to implement end-to-end Real-time transmission of streaming media data in a one-to-one or one-to-many network environment, and is a widely adopted basic technology for streaming media transmission. RTP contains data and control parts that allow the receiving end to reassemble received data packets. The protocol focuses on the real-time property of data transmission, and can realize multicast and unicast of data transmission.
However, due to the factors such as the delay and the volatility of network transmission, the problems of packet loss, disorder and congestion are often encountered in the real-time data communication process, which becomes an important factor restricting the user experience. Therefore, there is a need to provide an audio and video weak network transmission method and system for solving the problem of packet loss in the real-time data communication process.
Disclosure of Invention
In order to solve the problems existing in the scheme, the invention provides an audio and video weak network transmission method and system.
The purpose of the invention can be realized by the following technical scheme:
an audio and video weak network transmission system comprises a sending end, a receiving end and a server;
the sending end comprises a data coding unit, an intelligent sending unit and a backup data unit; the data coding unit is used for blocking the streaming media data to be transmitted, marking the blocked streaming media data to be transmitted as blocked data, numbering the blocked data of the same batch in the same form, respectively transmitting the numbered blocked data to the backup data unit for storage and transmission to the intelligent transmitting unit, processing the received blocked data of the same batch by the backup data unit, and marking the processed blocked data of the same batch as backup data; the intelligent sending unit loads the received data of the same batch of blocks into an RTP protocol message header and sends the data of the same batch of blocks to a receiving end;
the receiving end comprises a receiving unit, a checking unit and a feedback unit; the receiving unit receives the block data sent by the intelligent sending unit and sends the received block data to the checking unit, the checking unit checks the block data and generates corresponding checking labels according to a checking result, and the checking labels comprise 01 and 02; the checking label is sent to a feedback unit, and the feedback unit identifies the checking label;
when the checking label is 02, acquiring an absent item number, generating an absent item signal, and sending the absent item number and the absent item signal to the server; and the server processes the received information, controls the sending end to resend the block data corresponding to the missing number, and integrates the block data with the corresponding missing block data according to the number.
Further, the number includes a total code and a sequence code, and the total code of the block data of different batches is different.
Further, the RTP protocol header includes the number of the blocks of the block data and the number of the block data.
Further, the method for partitioning the media data to be transmitted by the data coding unit comprises the following steps:
acquiring a plurality of streaming media data from the Internet, identifying the type of the streaming media data, establishing a blocking protocol, integrating and marking the streaming media data, the type of the streaming media data and the blocking protocol as training input data, setting the corresponding blocked streaming media data for the training input data, and establishing an artificial intelligence model; integrating and marking training input data and corresponding blocked streaming media data as a training set, training an artificial intelligence model through the training set, and marking the trained artificial intelligence model as a blocked model;
acquiring streaming media data to be transmitted, identifying the type of the streaming media data to be transmitted, acquiring a blocking protocol, integrating and marking the streaming media data to be transmitted, the type of the media data and the blocking protocol as input data, inputting the input data into a blocking model, and acquiring corresponding blocked streaming media data.
Further, the method for processing the received data blocks of the same batch by the backup data unit comprises the following steps:
identifying a total code number in the same batch of block data serial numbers, establishing a plurality of storage nodes, labeling the storage nodes, establishing a storage node label table, correspondingly labeling the stored storage nodes in the storage node label table, storing the identified total code number in the storage node label table, acquiring corresponding storage node label numbers, and storing the same batch of block data in the corresponding storage nodes.
Further, when the check label is 01, the check result is qualified; when the checking label is 02, the checking result is unqualified.
Further, the feedback unit identifies the check tag, generates a successful receiving signal when the check tag is 01, acquires the block data code, and sends the successful receiving signal and the block data code to the server;
the server generates a deleting signal, deletes the corresponding block data codes in the storage node number table in the sending end according to the block data codes, and deletes the data in the corresponding storage nodes.
Further, the method for checking the block data by the checking unit comprises the following steps:
inquiring a message header of an RTP protocol, acquiring the number of blocks of the block data and corresponding numbers, marking the number as the standard number and the standard number, identifying the received block data, acquiring the corresponding number and codes, marking the number as the identification number and the identification codes, comparing the identification number with the standard number, and comparing the standard number with the identification codes;
when the number of the identification blocks is different from the number of the standard blocks, acquiring codes lacking in the identification codes, and generating a check unqualified signal;
and when the number of the identification blocks is the same as that of the standard blocks, generating a checking qualified signal.
Further, the specific method for processing the received missing item number and the missing item signal by the server includes: the method comprises the steps of sending a reissue instruction and an absent number to a sending end, obtaining a corresponding storage node in a storage node number table by an intelligent sending unit according to the absent number, obtaining block data with a corresponding number from the storage node, loading the block data with an RTP protocol message header, sending the block data to a receiving end, checking the retransmitted block data by a checking unit, and integrating the successfully checked block data with the previously corresponding absent block data according to the number.
A method for transmitting an audio and video weak network comprises the following steps:
the method comprises the following steps: the method comprises the steps of partitioning streaming media data to be transmitted, marking the partitioned streaming media data to be transmitted as partitioned data, and carrying out isomorphic numbering on the partitioned data in the same batch;
step two: the data of the blocks are backed up, and the backed-up data of the blocks are loaded into a message header of an RTP protocol for network transmission;
step three: checking the transmitted block data to obtain a corresponding check label, and deleting the corresponding backup data when the check label is 01; when the checking label is 02, acquiring the serial number of the missing data, and retransmitting the block data with the corresponding serial number;
step four: and integrating the retransmitted block data with the previously received corresponding data.
Compared with the prior art, the invention has the beneficial effects that: the method has the advantages that the blocking of the to-be-transmitted streaming media data is realized by establishing the blocking model, so that the blocking of the to-be-transmitted streaming media data is more intelligent, and meanwhile, the blocking result can be quickly corrected, so that the method has self-learning capability and better meets the current actual requirement; the backup data which is successfully sent is deleted, so that the utilization rate of the storage space is increased, and the long-term occupation of the backup data is avoided; after data are lost in the weak network environment, by setting the serial number and the checking unit, missing data can be timely found, targeted sending can be realized, the processing efficiency is improved, the time occupied in the retransmission process is short, the time delay of the data is reduced, the problem of data block loss is effectively avoided, and the user experience is optimized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic block diagram of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Selection of transport layer protocol:
if the SDK is a video live broadcast SDK, an RTMP protocol is generally selected, and the SDK can be generally compatible with a CDN (content delivery network) delivery network, so that live broadcast is carried out on broad users who are around watching. In the case of an audio social SDK, video social SDK, or game voice SDK, the RTP/RTCP protocol (or RTP-like proprietary protocol) is typically chosen because the media stream need not be broadcast over the CDN network to the watching users. Whether to consider a CDN network compatible or not is a significant difference between the voice video call SDK and the live video SDK.
The RTMP protocol is based on the TCP protocol, and the RTP protocol or the proprietary protocol is based on the UDP protocol, so the struggle between the RTMP protocol and the RTP protocol is essentially the struggle between the TCP protocol and the UDP protocol.
The characteristics of the TCP protocol:
TCP is a general IP network protocol, not designed for real-time media transmission, and the delay increases in a weak network environment;
TCP has embedded ARQ, but does not have FEC, does not allow developers to control ARQ strategies, and can not realize FEC;
TCP is not designed from the perspective of real-time voice and video, the fairness of network transmission is considered more, and the embedded transmission control strategy is milder.
The UDP protocol has the characteristics that:
UDP is suitable for real-time voice and video communication, allows end-to-end full chain channel strategy control, and has stronger controllability in a weak network environment;
the size of UDP delay time depends on ARQ and FEC strategies when packet loss occurs, and developers are allowed to deeply control the ARQ and FEC strategies;
UDP is suitable for designing a communication mechanism of real-time voice and video, adaptively selecting ARQ and FEC strategies according to network conditions, and adjusting transmission code rate and the number of messages.
Under the condition of good network environment, as long as the voice and video codec is the same, the transmission efficiency of the TCP protocol and the transmission efficiency of the UDP protocol are equivalent, and the real-time communication effects of low delay, no jamming and high quality can be realized.
Under the condition of poor network environment, particularly under the condition of cross-network or even cross-country, the UDP-based protocol is controllable to the end-to-end full chain, including code stream control, ARQ, FEC, jitter buffering and the like, and can be more guaranteed against the severe network environment.
As shown in fig. 1, an audio and video weak network transmission system includes a sending end, a receiving end and a server;
the sending end comprises a data coding unit, an intelligent sending unit and a backup data unit;
the data coding unit is used for partitioning the streaming media data to be transmitted, marking the partitioned streaming media data to be transmitted as block data, numbering the block data of the same batch in the same form, wherein the numbering comprises a total code and sequential coding, and the total codes of the block data of different batches are different; the block data of the same batch refers to the block data separated by the same to-be-transmitted streaming media data, the same form number refers to numbering according to the same numbering rule, for example, five block data of the same batch are provided, the corresponding numbers can be PCTB1, PCTB2, PCTB3, PCTB4 and PCTB5, wherein the PCTB represents the total code number of the block data of the batch, and 1, 2, 3, 4 and 5 represent the sequential coding of the block data of the same batch; the method has the advantages that the sub-block data of the same batch are numbered in the same mode, so that the sub-block data of the same batch can be identified and searched conveniently, received data can be checked more conveniently and rapidly, and meanwhile, the total codes of the sub-block data of different batches are set to be different, so that the disorder and the intersection of the data are avoided; respectively transmitting the numbered block data to a backup data unit for storage and transmitting the numbered block data to an intelligent transmitting unit, processing the received same batch of block data by the backup data unit, and marking the processed same batch of block data as backup data; the intelligent sending unit loads the received data of the same batch of blocks into an RTP protocol message header and sends the data of the same batch of blocks to a receiving end; the RTP protocol message header comprises the block number of the block data and the serial number of the block data;
the method for partitioning the media data to be transmitted by the data coding unit comprises the following steps:
acquiring a plurality of streaming media data from the Internet, identifying the type of the streaming media data, namely the type of the corresponding streaming media data, which belongs to the audio data, the video data or the data in other formats, establishing a blocking protocol, wherein the blocking protocol is set by an expert group for discussion according to different use environments and actual conditions of application industries, integrating and marking the types of the streaming media data and the blocking protocol as training input data, setting the corresponding blocked streaming media data for the training input data, and constructing an artificial intelligent model; the artificial intelligence model is a neural network model, training input data and corresponding partitioned streaming media data are integrated and marked as a training set, the artificial intelligence model is trained through the training set, and the trained artificial intelligence model is marked as a partitioned model;
acquiring streaming media data to be transmitted, identifying the type of the streaming media data to be transmitted, acquiring a blocking protocol, integrating and marking the streaming media data to be transmitted, the type of the media data and the blocking protocol as input data, inputting the input data into a blocking model, and acquiring corresponding blocked streaming media data;
the method has the advantages that the blocking of the to-be-transmitted streaming media data is realized by establishing the blocking model, so that the blocking of the to-be-transmitted streaming media data is more intelligent, and meanwhile, the blocking result can be quickly corrected, so that the method has self-learning capability and better meets the current actual requirement;
the method for processing the received data blocks of the same batch by the backup data unit comprises the following steps:
identifying a total code number in the same batch of block data serial numbers, establishing a plurality of storage nodes, labeling the storage nodes, establishing a storage node label table, correspondingly labeling the stored storage nodes in the storage node label table, storing the identified total code number in the storage node label table, acquiring corresponding storage node label numbers, and storing the same batch of block data into the corresponding storage nodes;
the receiving end comprises a receiving unit, a checking unit and a feedback unit;
the receiving unit receives the block data sent by the intelligent sending unit and sends the received block data to the checking unit, the checking unit checks the block data and generates corresponding checking labels according to a checking result, the checking labels comprise 01 and 02, and when the checking label is 01, the checking result is qualified; when the checking label is 02, the checking result is unqualified;
the checking label is sent to a feedback unit, the feedback unit identifies the checking label, when the checking label is 01, a receiving success signal is generated, a block data code is obtained, and the receiving success signal and the block data code are sent to a server;
when the checking label is 02, acquiring an absent item number, generating an absent item signal, and sending the absent item number and the absent item signal to the server;
the method for checking the block data by the checking unit comprises the following steps:
inquiring a message header of an RTP protocol, acquiring the number of blocks of the block data and corresponding numbers, marking the number as the standard number and the standard number, identifying the received block data, acquiring the corresponding number and codes, marking the number as the identification number and the identification codes, comparing the identification number with the standard number, and comparing the standard number with the identification codes;
when the number of the identification blocks is different from the number of the standard blocks, acquiring codes lacking in the identification codes, and generating a check unqualified signal;
when the number of the identification blocks is the same as that of the standard blocks, generating a check qualified signal;
the server processes the received information, generates a deletion signal when a successful receiving signal and a block data code are received, deletes the corresponding block data code in a storage node number table in the sending end according to the block data code, and deletes the data in the corresponding storage node;
the backup data which is successfully sent is deleted, so that the utilization rate of the storage space is increased, and the long-term occupation of the backup data is avoided;
when the missing number and the missing signal are received, a reissue instruction and the missing number are sent to a sending end, an intelligent sending unit obtains a corresponding storage node in a storage node number table according to the missing number, obtains the block data with the corresponding number from the storage node, loads the block data with an RTP protocol message header, sends the block data to a receiving end, checks the retransmitted block data through a checking unit, and integrates the successfully checked block data with the corresponding missing block data through a server according to the number.
Fec (forward error correction) is a channel coding algorithm that recovers lost data packets by adding redundant data. The original data is FEC encoded by a sending end to generate a redundant parity data packet, the original data and the redundant data packet are combined to be called as an FEC data block, and the quantity ratio of the original data packet to the redundant data packet is fixed (the quantity ratio can be set according to the packet loss rate, the more redundant packets, the higher the anti-packet loss rate, and the larger the required code stream). The transmitting end transmits the FEC data block. And after receiving the FEC data block, the receiving end recovers the lost or error data packet through the redundant data packet and the original data packet.
The FEC codec algorithm recommends the use of a relatively sophisticated XOR algorithm, RS (reed-Solomon) algorithm, Raptor algorithm and Tornado algorithm. When the FEC coding algorithm is used, redundancy is set according to a Packet Loss Rate (PLR).
The following describes the usage of the FEC codec algorithm using an example of RS.
Since the ratio of the number of original packets to the number of redundant packets is fixed in one FEC block, it is easy to determine whether the lost packets can be completely recovered according to the number of lost packets and the number of redundant packets. RS (n, k) denotes the k original FEC data blocks that are processed by the RS algorithm. Assuming that m data packets are lost, if m < = (n-k), the RS algorithm can completely recover the lost data packets according to n-k-m original data and k redundant data packets; if m > (n-k), the RS algorithm cannot recover the lost packet, at which time a transmission request is made to retransmit the lost packet.
For example, the lost packet recovery process is performed through the RS (6, 4). The sending end has 4 original data packets, and 2 redundant packets are generated through RS algorithm coding, so that an FEC data block with 6 data packets is formed. The RS algorithm can recover up to 2 lost packets. The sending end sends out the FEC data block, and the No. 2 original data packet is lost in the transmission process. After receiving the FEC data block, the receiving end recovers the original data packet No. 2 that has been lost through the r1 redundant packet.
The forward error correction FEC algorithm is used, and the advantages are that the data packet only needs to be transmitted once, the transmission delay is not influenced by RTT (round trip time) and the additional delay time is not increased; the disadvantage is that redundant data packets need to be added, reducing the utilization of the transmission channel. The method is a space-time-changing strategy in general.
After the code rate adaptive ABC module estimates the bandwidth, a sending end distributes the bandwidth to an original data packet, an FEC check packet and an ARQ retransmission packet, and an intelligent bandwidth distribution strategy is needed. The bandwidth allocation strategy is to allocate bandwidth to the original data packets and the redundant data packets according to the network conditions, including RTT and PLR. The more bandwidth of the redundant data packets is allocated, the stronger the error correction capability of the QoS channel protection algorithm, however, the less the original data packets are correspondingly allocated, and the quality of the voice and video is relatively reduced. In contrast, the less the bandwidth of the redundant data packet is allocated, the weaker the error correction capability of the QoS channel protection algorithm is, however, the more the bandwidth of the original data packet is allocated, the relatively guaranteed quality of the voice and video is. Therefore, an intelligent bandwidth allocation strategy is to find a balance point between the quality of the voice video and the error correction capability of the QoS channel protection algorithm. In general, the policy of bandwidth allocation can be performed as follows:
the total bandwidth is estimated by a code rate self-adaptive ABC module;
estimating the bandwidth occupied by the retransmission data packet of the packet loss retransmission ARQ according to the RTT and the PLR;
the bandwidth occupied by the check data packet of the forward error correction FEC is estimated according to the RTT, the PLR after ARQ recovery and the total bandwidth;
the bandwidth occupied by the original packet is calculated from the ARQ, FEC and total bandwidth.
A method for transmitting an audio and video weak network comprises the following steps:
the method comprises the following steps: the method comprises the steps of partitioning streaming media data to be transmitted, marking the partitioned streaming media data to be transmitted as partitioned data, and carrying out isomorphic numbering on the partitioned data in the same batch;
acquiring a plurality of streaming media data from the Internet, identifying the type of the streaming media data, establishing a blocking protocol, integrating and marking the streaming media data, the type of the streaming media data and the blocking protocol as training input data, setting the corresponding blocked streaming media data for the training input data, and establishing an artificial intelligence model; integrating and marking training input data and corresponding blocked streaming media data as a training set, training an artificial intelligence model through the training set, and marking the trained artificial intelligence model as a blocked model;
acquiring streaming media data to be transmitted, identifying the type of the streaming media data to be transmitted, acquiring a blocking protocol, integrating and marking the streaming media data to be transmitted, the type of the media data and the blocking protocol as input data, inputting the input data into a blocking model, and acquiring corresponding blocked streaming media data.
Step two: the data of the blocks are backed up, and the backed-up data of the blocks are loaded into a message header of an RTP protocol for network transmission;
identifying a total code number in the same batch of block data serial numbers, establishing a plurality of storage nodes, labeling the storage nodes, establishing a storage node label table, correspondingly labeling the stored storage nodes in the storage node label table, storing the identified total code number in the storage node label table, acquiring corresponding storage node label numbers, and storing the same batch of block data into the corresponding storage nodes;
step three: checking the transmitted block data to obtain corresponding checking labels, wherein the checking labels comprise 01 and 02, and when the checking label is 01, the checking result is qualified; when the checking label is 02, the checking result is unqualified; when the check tag is 01, deleting the corresponding backup data;
when the checking label is 02, acquiring the serial number of the missing data, and retransmitting the block data with the corresponding serial number;
the method for checking the block data comprises the following steps:
inquiring a message header of an RTP protocol, acquiring the number of blocks of the block data and corresponding numbers, marking the number as the standard number and the standard number, identifying the received block data, acquiring the corresponding number and codes, marking the number as the identification number and the identification codes, comparing the identification number with the standard number, and comparing the standard number with the identification codes;
when the number of the identification blocks is different from the number of the standard blocks, acquiring codes lacking in the identification codes, and generating a check unqualified signal;
and when the number of the identification blocks is the same as that of the standard blocks, generating a checking qualified signal.
Step four: and integrating the retransmitted block data with the previously received corresponding data.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus, device and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and there may be other divisions when the actual implementation is performed; the modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the method of the embodiment.
It will also be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above examples are only intended to illustrate the technical process of the present invention and not to limit the same, and although the present invention has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that modifications or equivalent substitutions may be made to the technical process of the present invention without departing from the spirit and scope of the technical process of the present invention.
Claims (10)
1. An audio and video weak network transmission system is characterized by comprising a sending end, a receiving end and a server;
the sending end comprises a data coding unit, an intelligent sending unit and a backup data unit; the data coding unit is used for blocking the streaming media data to be transmitted, marking the blocked streaming media data to be transmitted as blocked data, numbering the blocked data of the same batch in the same form, respectively transmitting the numbered blocked data to the backup data unit for storage and transmission to the intelligent transmitting unit, processing the received blocked data of the same batch by the backup data unit, and marking the processed blocked data of the same batch as backup data; the intelligent sending unit loads the received data of the same batch of blocks into an RTP protocol message header and sends the data of the same batch of blocks to a receiving end;
the receiving end comprises a receiving unit, a checking unit and a feedback unit; the receiving unit receives the block data sent by the intelligent sending unit and sends the received block data to the checking unit, the checking unit checks the block data and generates corresponding checking labels according to a checking result, and the checking labels comprise 01 and 02; the checking label is sent to a feedback unit, and the feedback unit identifies the checking label;
when the checking label is 02, acquiring an absent item number, generating an absent item signal, and sending the absent item number and the absent item signal to the server; and the server processes the received information, controls the sending end to resend the block data corresponding to the missing number, and integrates the block data with the corresponding missing block data according to the number.
2. The system of claim 1, wherein the serial number includes a total code and a sequence code, and the total code of the block data of different batches is different.
3. The system according to claim 1, wherein the RTP protocol header includes the number of the blocks of the block data and the number of the block data.
4. The system of claim 1, wherein the method for partitioning the media data to be transmitted by the data encoding unit comprises:
acquiring a plurality of streaming media data from the Internet, identifying the type of the streaming media data, establishing a blocking protocol, integrating and marking the streaming media data, the type of the streaming media data and the blocking protocol as training input data, setting the corresponding blocked streaming media data for the training input data, and establishing an artificial intelligence model; integrating and marking training input data and corresponding blocked streaming media data as a training set, training an artificial intelligence model through the training set, and marking the trained artificial intelligence model as a blocked model;
acquiring streaming media data to be transmitted, identifying the type of the streaming media data to be transmitted, acquiring a blocking protocol, integrating and marking the streaming media data to be transmitted, the type of the media data and the blocking protocol as input data, inputting the input data into a blocking model, and acquiring corresponding blocked streaming media data.
5. The system of claim 1, wherein the method for processing the received data of the same batch of blocks by the backup data unit comprises:
identifying a total code number in the same batch of block data serial numbers, establishing a plurality of storage nodes, labeling the storage nodes, establishing a storage node label table, correspondingly labeling the stored storage nodes in the storage node label table, storing the identified total code number in the storage node label table, acquiring corresponding storage node label numbers, and storing the same batch of block data in the corresponding storage nodes.
6. The audio and video weak network transmission system according to claim 1, wherein when the check tag is 01, the check result is qualified; when the checking label is 02, the checking result is unqualified.
7. The audio and video weak network transmission system according to claim 1, wherein the feedback unit identifies the check tag, generates a reception success signal when the check tag is 01, acquires a block data code, and transmits the reception success signal and the block data code to the server;
the server generates a deleting signal, deletes the corresponding block data codes in the storage node number table in the sending end according to the block data codes, and deletes the data in the corresponding storage nodes.
8. The audio/video weak network transmission system according to claim 1, wherein the method for checking the block data by the checking unit comprises:
inquiring a message header of an RTP protocol, acquiring the number of blocks of the block data and corresponding numbers, marking the number as the standard number and the standard number, identifying the received block data, acquiring the corresponding number and codes, marking the number as the identification number and the identification codes, comparing the identification number with the standard number, and comparing the standard number with the identification codes;
when the number of the identification blocks is different from the number of the standard blocks, acquiring codes lacking in the identification codes, and generating a check unqualified signal;
and when the number of the identification blocks is the same as that of the standard blocks, generating a checking qualified signal.
9. The audio and video weak network transmission system according to claim 1, wherein the specific method for processing the received missing item numbers and the missing item signals by the server comprises: the method comprises the steps of sending a reissue instruction and an absent number to a sending end, obtaining a corresponding storage node in a storage node number table by an intelligent sending unit according to the absent number, obtaining block data with a corresponding number from the storage node, loading the block data with an RTP protocol message header, sending the block data to a receiving end, checking the retransmitted block data by a checking unit, and integrating the successfully checked block data with the previously corresponding absent block data according to the number.
10. An audio and video weak network transmission method is applied to the audio and video weak network transmission system according to any one of claims 1 to 9, and the specific method comprises the following steps:
the method comprises the following steps: the method comprises the steps of partitioning streaming media data to be transmitted, marking the partitioned streaming media data to be transmitted as partitioned data, and carrying out isomorphic numbering on the partitioned data in the same batch;
step two: the data of the blocks are backed up, and the backed-up data of the blocks are loaded into a message header of an RTP protocol for network transmission;
step three: checking the transmitted block data to obtain a corresponding check label, and deleting the corresponding backup data when the check label is 01; when the checking label is 02, acquiring the serial number of the missing data, and retransmitting the block data with the corresponding serial number;
step four: and integrating the retransmitted block data with the previously received corresponding data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111610243.3A CN114422864A (en) | 2021-12-27 | 2021-12-27 | Audio and video weak network resisting transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111610243.3A CN114422864A (en) | 2021-12-27 | 2021-12-27 | Audio and video weak network resisting transmission method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114422864A true CN114422864A (en) | 2022-04-29 |
Family
ID=81270161
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111610243.3A Pending CN114422864A (en) | 2021-12-27 | 2021-12-27 | Audio and video weak network resisting transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422864A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086285A (en) * | 2022-06-02 | 2022-09-20 | 深圳市欢太科技有限公司 | Data processing method and device, storage medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110196871A (en) * | 2019-03-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data storage method and system |
| CN111800600A (en) * | 2020-02-26 | 2020-10-20 | 衡阳师范学院 | Internet of things field video monitoring system based on low power consumption |
| CN113364814A (en) * | 2021-08-10 | 2021-09-07 | 北京翔东智能科技有限公司 | Anti-weak network transmission method based on RTP |
-
2021
- 2021-12-27 CN CN202111610243.3A patent/CN114422864A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110196871A (en) * | 2019-03-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data storage method and system |
| CN111800600A (en) * | 2020-02-26 | 2020-10-20 | 衡阳师范学院 | Internet of things field video monitoring system based on low power consumption |
| CN113364814A (en) * | 2021-08-10 | 2021-09-07 | 北京翔东智能科技有限公司 | Anti-weak network transmission method based on RTP |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086285A (en) * | 2022-06-02 | 2022-09-20 | 深圳市欢太科技有限公司 | Data processing method and device, storage medium and electronic equipment |
| CN115086285B (en) * | 2022-06-02 | 2024-05-17 | 深圳市欢太科技有限公司 | Data processing method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7224702B2 (en) | System and method for error-control for multicast video distribution | |
| US7376880B2 (en) | Transmission apparatus, transmission control program, and transmission method | |
| CN101061659B (en) | Adaptive forward error correction method and device | |
| US8499212B2 (en) | Method and apparatus for adaptive forward error correction with merged automatic repeat request for reliable multicast in wireless local area networks | |
| JP5442816B2 (en) | Streaming and buffering using variable FEC overhead and protection period | |
| CN100592670C (en) | System and method for controlling self-adaptive forward error dynamically in IPTV network | |
| US7681101B2 (en) | Hybrid corrective scheme for dropped packets | |
| EP2437421B1 (en) | Method, device and communication system for retransmitting based on forward error correction | |
| US9312989B2 (en) | Importance-based FEC-aware error-repair scheduling | |
| CN101867453B (en) | RTP anti-packet-loss method | |
| US20100214970A1 (en) | Method and system for transmitting data packets from a source to multiple receivers via a network | |
| EP2070067B1 (en) | Hybrid correction scheme for dropped packets | |
| CN106034011A (en) | Control method and system for multicast transport quality guarantee | |
| Prior et al. | Systematic network coding for packet loss concealment in broadcast distribution | |
| CN114422864A (en) | Audio and video weak network resisting transmission method and system | |
| Macker | Reliable multicast transport and integrated erasure-based forward error correction | |
| CN108667557B (en) | Self-adaptive FEC coding matrix design method based on media content | |
| Huang et al. | A hybrid FEC-ARQ protocol for low-delay lossless sequential data streaming | |
| Yoon et al. | Adaptive reliable multicast | |
| Chen et al. | Interleaved FEC/ARQ coding for QoS multicast over the internet | |
| Carle | Error Control for Real-Time Audio-Visual Services | |
| Lee et al. | System and method for error-control for multicast video distribution | |
| Hayasaka et al. | The concept of referential loss recovery for real-time applications and its improvements of QoS provision | |
| Chou | Rice University, Houston, TX77005 USA cakarz (a) ece. rice. edu | |
| Yao et al. | Experiments with error-correcting RTP gateways |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220429 |