CN111404862B - Multimedia processing method and equipment - Google Patents
Multimedia processing method and equipment Download PDFInfo
- Publication number
- CN111404862B CN111404862B CN201910000956.4A CN201910000956A CN111404862B CN 111404862 B CN111404862 B CN 111404862B CN 201910000956 A CN201910000956 A CN 201910000956A CN 111404862 B CN111404862 B CN 111404862B
- Authority
- CN
- China
- Prior art keywords
- multimedia service
- processing
- multimedia
- service module
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 279
- 238000000034 method Methods 0.000 claims abstract description 38
- 230000008569 process Effects 0.000 claims abstract description 19
- 230000006870 function Effects 0.000 claims description 58
- 230000006835 compression Effects 0.000 claims description 18
- 238000007906 compression Methods 0.000 claims description 18
- 238000004891 communication Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 6
- 230000011664 signaling Effects 0.000 abstract description 22
- 238000010586 diagram Methods 0.000 description 7
- 230000000977 initiatory effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229920006132 styrene block copolymer Polymers 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1016—IP multimedia subsystem [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a multimedia processing method and equipment, wherein the method comprises the following steps: receiving a multimedia service stream from a sending end; determining a corresponding multimedia service module, and sending a multimedia service stream and a multimedia service processing instruction to the multimedia service module; receiving a processing result of the multimedia service stream from the multimedia service module; and sending the processing result of the multimedia service flow to a receiving end. In the embodiment of the invention, the service control network element does not perform specific processing on the multimedia service stream, but transmits the multimedia service stream to the corresponding multimedia service module, and the multimedia service module processes the multimedia service stream, so that for the service control network element, signaling control is separated from multimedia processing, service logic nesting is reduced, a path is optimized, and new services are conveniently brought on line; meanwhile, the centralized processing of media resources can be realized for the multimedia service module, and the resource utilization rate is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a multimedia processing method and equipment.
Background
Referring to fig. 1a, a conventional call service flow is shown, which includes the following specific steps:
(1) a calling side Long-Term Evolution Voice bearer (VoLTE) terminal performs calling initiation and calling service triggering according to a standard IP Multimedia Subsystem (IMS) process: firstly, triggering a Service Centralization and Continuity (SCC) module, and then triggering a Service; the calling IMS domain routes the call to the called IMS domain according to the standard IMS flow;
(2) called IMS service triggering and called Access Domain Selection (T-ADS) flow;
(3) the domain selection result is IMS connection, and a Serving call Session control Function entity (S-CSCF) routes the call to a called Session Border Controller (SBC), and then to a Voice Over Broadband (VoBB) terminal.
In the above flow, since the VoBB terminal only supports g.721/g.723/g.729 codecs, and the VoLTE terminal does not support these types of codecs, the SBC in the call flow needs to perform codec conversion between Enhanced Voice Services (EVS)/Adaptive Multi-rate broadband (AMR-WB) and g.721/g.723/g.729. SBCs need to both route signaling plane messages and assume media processing functions.
Referring to fig. 1b, a conventional voice call handover service flow is shown, which includes the following specific steps:
(1) the calling VoLTE terminal and the called VoLTE terminal establish a normal call flow;
(2) one-side VoLTE terminal moves from LTE area to second generation communication technology during calling (2) nd generation, 2G)/Time Division (TD) region;
(3) an evolved node b (eNB) instructs a Mobile Management Entity (MME) to perform handover, and the MME selects an enhanced Mobile switching Center (eMSC) to send a handover request;
(4) after eMSC reserves resources, the eMSC notifies the eNB through the MME; simultaneously sending Session Initiation Protocol (SIP) invitation (INVITE) to Proxy Call Session Control Function (P-CSCF), and starting a Session layer switching process;
(5) the eNB instructs the terminal to start an air interface to switch to 2G/TD;
(6) the P-CSCF completes redirection of a Media plane through interaction of an Access Transfer Control Function (ATCF) and an Access Transfer Gateway (ATGW), and directs Media connection to an eMSC/Media Gateway (Media Gateway, MGW); meanwhile, a new INVITE message is constructed and sent to a service centralized and continuity application server (SCC application server, SCC AS);
(7) after receiving the INVITE message, the SCC AS associates the new signaling connection with the remote signaling connection, and releases the original signaling connection through the BYE message;
(8) after receiving the end (BYE) message, the P-CSCF deletes the local signaling connection; after the switching is completed, the media plane is switched through the ATGW and the eMSC/MGW.
In the above flow, the ATCF/ATGW (which is combined with the SBC during actual deployment) needs to complete media plane processing in the switching process, including coding/decoding conversion between EVS/AMR-WB coding/decoding and AMR. The SBC needs to both route signaling plane messages and assume media processing functions throughout the handover.
Referring to fig. 1c, a conventional multiparty video service flow (taking one-click initiation of multiparty call as an example) is shown, which includes the following specific steps:
(1) a calling VoLTE terminal initiates a multi-party video conference by adopting a one-key initiation mode;
(2) each terminal and VoLTE AS establish a normal call flow;
(3) the VoLTE AS completes the functions of sound mixing and frequency mixing through a Multimedia Resource Processor (MRFP) which is co-located with the VoLTE AS, and sends audio and video streams to each terminal one by one.
In the above flow, VoLTE AS not only needs to complete the signaling plane call flow processing, but also needs to complete the media processing functions such AS mixing sound and mixing screen through MRFP.
AS can be seen from the above multimedia processing flows, in the existing scheme, the media plane processing function is executed by the service control network element (e.g., SBC, VoLTE AS), which brings some adverse effects to service logic nesting, path optimization, and new service online. Taking VoLTE AS an example, in a call process, the trigger sequences of different functions of VoLTE AS an example need to be considered, and enhancing any signaling processing function may cause the change of the trigger sequence, thereby affecting the media processing function and being not beneficial to the on-line of a new function.
In addition, in multiple call flows such as voice intercommunication and multiparty conference, media plane processing functions borne by core network elements are similar, such as media routing forwarding, codec format conversion and the like, but the processing needs to be repeatedly realized in different network elements in a network, and the utilization rate of resource processing needs to be optimized.
For the above reasons, an optimized multimedia service processing scheme is needed.
Disclosure of Invention
The embodiment of the invention provides a multimedia processing method and equipment, which solve the problems that the existing scheme is not favorable for new business online and the resource utilization is low.
According to a first aspect of the embodiments of the present invention, there is provided a multimedia processing method applied to a service control network element, the method including: receiving a multimedia service stream from a sending end; determining a corresponding multimedia service module, and sending the multimedia service stream and a multimedia service processing instruction to the multimedia service module, wherein the multimedia service module has one or more multimedia service processing functions; receiving a processing result of the multimedia service stream from the multimedia service module; and sending the processing result of the multimedia service flow to a receiving end.
Optionally, the determining a corresponding multimedia service module and sending the multimedia service stream to the multimedia service module includes: determining a corresponding multimedia service module according to the service request and/or the multimedia service stream received from the sending end; sending a request for invoking a servitization interface to the multimedia service module, the request for invoking a servitization interface comprising: the multimedia service flow and a multimedia service processing indication.
Optionally, the sending end is a calling terminal, the receiving end is a called terminal, the multimedia service module has a code stream transcoding function, and the processing result is a result obtained by transcoding the multimedia service stream according to the multimedia service processing instruction by the multimedia service module;
or, the sending end and the receiving end are multi-party video terminals, the multimedia service module has a function of audio and/or video mixing processing, and the processing result is obtained by the multimedia service module performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a dynamic encoding and decoding function, and the processing result is obtained by the multimedia service module performing dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a media content compression function, and the processing result is a result obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
According to a second aspect of the embodiments of the present invention, there is provided a multimedia processing method applied to a multimedia service module, where the multimedia service module has one or more multimedia service processing functions, the method includes: receiving a multimedia service stream and a multimedia service processing indication from a service control network element; processing the multimedia service flow according to the multimedia service processing instruction to obtain a processing result; and sending the processing result to the service control network element.
Optionally, receiving the multimedia service stream and the multimedia service processing instruction from the service control network element includes: receiving a request for invoking a servitized interface from the traffic control network element, the request for invoking a servitized interface comprising: the multimedia service flow and a multimedia service processing indication.
Optionally, processing the multimedia service stream according to the multimedia service processing instruction to obtain a processing result, where the processing result includes: transcoding the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
or, according to the multimedia service processing instruction, performing audio and/or video mixing processing on the multimedia service stream to obtain the processing result;
or, according to the multimedia service processing instruction, performing dynamic encoding and decoding processing on the multimedia service stream to obtain the processing result;
or, according to the multimedia service processing instruction, performing media content compression processing on the multimedia service stream to obtain the processing result.
According to a third aspect of the embodiments of the present invention, there is provided a service control network element, including: the system comprises a first transceiver and a first processor, wherein the first transceiver is used for receiving a multimedia service stream from a transmitting end; the first processor is configured to determine a corresponding multimedia service module, and send the multimedia service stream and a multimedia service processing instruction to the multimedia service module, where the multimedia service module has one or more multimedia service processing functions; the first transceiver is further configured to receive a processing result of the multimedia service stream from the multimedia service module; the first transceiver is further configured to send a processing result of the multimedia service stream to a receiving end.
Optionally, the first processor is further configured to determine a corresponding multimedia service module according to the service request and/or the multimedia service stream received from the sending end; the first transceiver is further configured to send a request for invoking a servitization interface to the multimedia service module, where the request for invoking the servitization interface includes: the multimedia service flow and a multimedia service processing indication.
Optionally, the sending end is a calling terminal, the receiving end is a called terminal, the multimedia service module has a code stream transcoding function, and the processing result is a result obtained by transcoding the multimedia service stream according to the multimedia service processing instruction by the multimedia service module;
or, the sending end and the receiving end are multi-party video terminals, the multimedia service module has a function of audio and/or video mixing processing, and the processing result is obtained by the multimedia service module performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a dynamic encoding and decoding function, and the processing result is obtained by the multimedia service module performing dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a media content compression function, and the processing result is a result obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
According to a fourth aspect of the embodiments of the present invention, there is provided a multimedia service module, the multimedia service module having one or more multimedia service processing functions, the multimedia service module including: the second transceiver is used for receiving the multimedia service flow and the multimedia service processing instruction from the service control network element; the second processor is configured to process the multimedia service stream according to the multimedia service processing instruction, and obtain a processing result; the second transceiver is further configured to send the processing result to the service control network element.
Optionally, the second transceiver is further configured to receive a request for invoking a servitization interface from the traffic control network element, where the request for invoking the servitization interface includes: the multimedia service flow and a multimedia service processing indication.
Optionally, the second processor is further configured to perform transcoding processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result;
the second processor is further configured to perform audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
the second processor is further configured to perform dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
and the second processor is further configured to perform media content compression processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result.
According to a fifth aspect of embodiments of the present invention, there is provided a communication device comprising a processor, a memory, and a program stored on the memory and executable on the processor, the program, when executed by the processor, implementing the steps of the multimedia processing method according to the first aspect or the steps of the multimedia processing method according to the second aspect.
A sixth aspect according to embodiments of the present invention provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores thereon a computer program, which, when executed by a processor, implements the steps of the multimedia processing method according to the first aspect, or the steps of the multimedia processing method according to the second aspect.
In the embodiment of the invention, the service control network element sends the multimedia service stream sent by the sending end to the corresponding multimedia service module, the multimedia service module processes the multimedia service stream, and then the multimedia service module receives the processing result and sends the processing result to the receiving end. The signaling control is separated from the multimedia processing, the service logic nesting is reduced, the path is optimized, and the new service is convenient to be on line; meanwhile, the centralized resource processing is realized, and the resource utilization rate is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1a is a schematic diagram of a conventional call service flow;
FIG. 1b is a schematic diagram of a conventional voice call handover service flow;
FIG. 1c is a schematic diagram of a conventional multiparty video service flow;
FIG. 2 is a schematic diagram of a conventional SBA architecture;
FIG. 3 is a flowchart illustrating a multimedia processing method according to an embodiment of the present invention;
fig. 4 is a second flowchart illustrating a multimedia processing method according to an embodiment of the invention;
fig. 5 is a third schematic flowchart of a multimedia processing method according to an embodiment of the present invention;
FIG. 6 is a fourth flowchart illustrating a multimedia processing method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a service control network element according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a multimedia service module according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a communication device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
Referring to fig. 2, a Service Based Architecture (SBA) has been introduced into a 5th generation (5G) Architecture planning in the fifth generation communication technology, and the Architecture provides a plug-and-play new introduction manner for a new function of a 5G core network by building a basic communication framework between NFs/services through registration, discovery and invocation of services by using concepts such as a Service-Oriented Architecture (SOA), a micro-Service Architecture, and the like, which are mature in the industry. Where the servitization is critical to SBA applications. On one hand, the communication between the control plane network functions is realized by adopting an interface form based on service calling through a lightweight communication protocol; on the other hand, the service interface can be reused and called by a plurality of network function opposite terminals, so that the interface realization efficiency is improved, and the development difficulty is reduced.
The embodiment of the invention provides a multimedia processing method, the execution main body of the method is a service control network element, the service control network element can be SBC, VoLTE AS and other equipment, and the specific type of the service control network element is not limited in the implementation of the method.
Referring to fig. 3, the method comprises the following specific steps:
step 301: receiving a multimedia service stream from a sending end;
in the embodiment of the present invention, the signaling plane processing flow between the sending end, the receiving end and the service control network element may adopt the existing processing flow, and after the processing of the signaling plane is completed, the service control network element receives the multimedia service stream to be processed from the sending end.
The sending terminal can be a calling terminal, the receiving terminal can be a called terminal, and the multimedia service stream can be a first code stream sent by the calling terminal; or, the sending end and the receiving end may be a plurality of terminals participating in multi-party video, and the multimedia service stream may be a plurality of audio streams and/or video streams sent by the plurality of terminals; alternatively, the sending end may be a compressing end, the receiving end may be a decompressing end, and the multimedia service stream may be a to-be-compressed media stream sent by the compressing end.
Step 302: determining a corresponding multimedia service module, and sending a multimedia service stream and a multimedia service processing instruction to the multimedia service module;
in the embodiment of the present invention, the multimedia service module has one or more multimedia service processing functions, such as: the multimedia service processing function may be any one of the following: code stream transcoding function, audio and/or video mixing processing function, dynamic coding and decoding function, media content compression function and the like;
optionally, the service control network element determines a corresponding multimedia service module according to a service request received from a sending end in the signaling processing flow and/or a multimedia service stream to be processed, and sends a multimedia service stream and a multimedia service processing instruction to the determined multimedia service module, where the multimedia service processing instruction is used to instruct the multimedia service module to process the multimedia service stream, for example: the multimedia service module is instructed to carry out transcoding processing on the multimedia service stream, the multimedia service module is instructed to carry out audio and/or video mixing processing on the multimedia service stream, the multimedia service module is instructed to carry out dynamic coding and decoding processing on the multimedia service stream, and the multimedia service module is instructed to carry out media content compression processing on the multimedia service stream.
Further, the service control network element sends a request for invoking a servitization interface to the multimedia service module, where the request is used to invoke a servitization interface on the multimedia service module, and the request for invoking the servitization interface includes: multimedia service flow and multimedia service processing indication.
It can be understood that, the content of the service control network element may pre-configure the address of the multimedia service module and/or the relevant parameters of the service interface on the multimedia service module, so as to facilitate the call of the service control network element.
Step 303: receiving a processing result of the multimedia service stream from the multimedia service module;
in the embodiment of the invention, after the multimedia service module finishes processing the multimedia service stream, the multimedia service stream is processed from the multimedia service module.
Step 304: and sending the processing result of the multimedia service flow to a receiving end.
In the embodiment of the invention, the service control network element sends the processing result of the multimedia service stream to the corresponding receiving end.
In the embodiment of the invention, the service control network element does not perform specific processing on the multimedia service stream, but transmits the multimedia service stream to the corresponding multimedia service module, and the multimedia service module processes the multimedia service stream, so that for the service control network element, signaling control is separated from multimedia processing, service logic nesting is reduced, a path is optimized, and new services are conveniently brought on line; meanwhile, the multimedia service module can realize the centralized processing of media resources, and the resource utilization rate is improved.
Referring to fig. 4, an embodiment of the present invention provides a multimedia processing method, where an execution main body of the method is a multimedia service module, and the multimedia service module has one or more multimedia service processing functions, and it can be understood that the multimedia service module may be implemented by an entity device, or may also be implemented by a function module in the entity device, and the method includes the following specific steps:
step 401: receiving a multimedia service stream and a multimedia service processing instruction from a service control network element;
in the embodiment of the invention, the multimedia service processing instruction is used for instructing the multimedia service module to process the multimedia service stream.
Further, the multimedia service module receives a request for invoking a servitization interface from the traffic control network element, the request for invoking the servitization interface on the multimedia service module, the request for invoking the servitization interface comprising: multimedia service flow and multimedia service processing indication.
Step 402: processing the multimedia service flow according to the multimedia service processing instruction to obtain a processing result;
step 403: sending a processing result to a service control network element;
in the embodiment of the invention, after the multimedia service module finishes processing the multimedia service stream, the processing result of the multimedia service stream is sent to the service control network element.
In the embodiment of the invention, the multimedia service module receives the multimedia service stream and the multimedia service processing instruction from the service control network element, processes the multimedia service stream according to the multimedia service processing instruction, and sends the processing result to the service control network element. Therefore, signaling control and multimedia processing are separated, service logic nesting is reduced, a path is optimized, and new services can be conveniently brought to the online; meanwhile, the centralized resource processing is realized, and the resource utilization rate is improved.
Taking a call service scenario as an example, the sending end in fig. 3 is a calling terminal, the receiving end is a called terminal, and the multimedia service module has a code stream transcoding function. The specific steps are shown in fig. 5, and include:
step 501: a calling terminal sends a calling request to a service control network element;
step 502: the service control network element sends the call request to the called terminal;
step 503: the called terminal sends a call response for responding to the call request to the service control network element;
step 504: the service control network element sends the call response to the calling terminal;
step 505: a session is established between a calling terminal and a called terminal;
the foregoing steps 501 to 505 are signaling plane processing flows, where the calling terminal and the called terminal perform coding and decoding negotiation through signaling, and each sent message carries a coding and decoding type used by itself, and the service control network element determines that the call needs to be transcoded according to the coding and decoding types of the calling terminal and the called terminal.
Step 506: a calling terminal sends a first code stream to a service control network element;
in the embodiment of the present invention, the first code stream is a code stream supported by the calling terminal, and the type of the first code stream is different from the type of the second code stream supported by the called terminal, for example: the coding and decoding type of the first code stream is EVS or AMR-WB, and the coding and decoding type of the first code stream is g.721, g.723 or g.729.
Step 507: the service control network element sends a request for calling a servitization interface to the multimedia service module and sends a first code stream and a first multimedia service processing instruction to the multimedia service module;
in the embodiment of the present invention, a service control network element calls a service interface of a multimedia service module by calling a service interface request, where the calling the service interface request includes: the first code stream and the first multimedia service processing instruction.
Step 508: the multimedia service module carries out transcoding processing on the first code stream to obtain a second code stream;
in the embodiment of the present invention, the multimedia service module performs transcoding processing on the first code stream according to the first multimedia service processing instruction to obtain the second code stream, where the transcoding processing may adopt an existing transcoding processing manner, and a specific manner of transcoding processing in the embodiment of the present invention is not limited.
Step 509: the multimedia service module sends the second code stream to a service control network element;
step 510: and the service control network element sends the second code stream to the called terminal.
It can be understood that, when the called terminal needs to send the second code stream to the calling terminal, the service control network element invokes the multimedia service module to transcode the second code stream into the first code stream and send the first code stream to the calling terminal, with reference to the description in the above step 506 to step 510.
In the embodiment of the invention, aiming at a call service scene, by separating signaling control and transcoding processing in a call flow, service logic nesting is reduced, and a path is optimized; meanwhile, the resource processing is centralized, and the resource utilization rate is improved.
Taking a multiparty video service scenario as an example, the sending end and the receiving end in fig. 3 are both multiple terminals participating in multiparty video, and the multimedia service module has an audio and/or video mixing function. Referring to fig. 6, the specific steps include:
step 601: a plurality of terminals send multiparty video requests to a service control network element;
step 602: the service control network element sends a multiparty video response for responding to the multiparty video request to the plurality of terminals;
the above-mentioned steps 601 to 602 are signaling plane processing flows, and a plurality of terminals adopt a standard video conference establishing manner, for example: the method is initiated by a main terminal in a plurality of terminals through one key, a multi-party video request is sent to a service control network element, and the service control network element and each terminal interactively establish a video session.
Step 603: a plurality of terminals send a plurality of audio streams and/or video streams to a service control network element;
in this embodiment, after the service control network element establishes a video session with each terminal, it receives an audio stream and/or a video stream from the terminal.
Step 604: the service control network element sends a request for calling a service interface to the multimedia service module and sends a plurality of audio streams and/or video streams and a second multimedia service processing instruction to the multimedia service module;
in the embodiment of the present invention, a service control network element calls a service interface of a multimedia service module by calling a service interface request, where the calling the service interface request includes: a plurality of audio and/or video streams and a second multimedia service processing indication.
Step 605: the multimedia service module performs audio and/or video mixing processing on a plurality of audio streams and/or video streams to obtain mixed audio streams and/or video streams;
in this embodiment of the present invention, the multimedia service module performs audio and/or video mixing processing on the multiple audio streams and/or video streams according to the second multimedia service processing instruction to obtain a mixed audio stream and/or video stream, where the audio and/or video mixing processing may use an existing audio and/or video mixing processing method, and a specific method of the audio and/or video mixing processing is not limited in this embodiment of the present invention.
Step 606: the multimedia service module sends the mixed audio stream and/or the video stream to a service control network element;
step 607: and the service control network element sends the mixed audio stream and/or the mixed video stream to a plurality of terminals.
In the embodiment of the invention, aiming at a multi-party video service scene, by separating signaling control and transcoding processing in a multi-party video flow, service logic nesting is reduced, and a path is optimized; meanwhile, the centralized resource processing is realized, and the resource utilization rate is improved.
It should be noted that the embodiment of the present invention may also be applied to other multimedia service scenarios;
for example: and dynamic coding and decoding service, wherein the multimedia service module has a dynamic coding and decoding function, and the processing result corresponding to the multimedia service stream is the result obtained by the multimedia service module performing dynamic coding and decoding processing on the multimedia service stream according to the multimedia service processing instruction.
Another example is: and the multimedia service module has a function of compressing the media content, and the processing result corresponding to the multimedia service stream is the result obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
For other service scenarios, the specific execution flow may refer to the flow in fig. 5 or fig. 6, and details are not described herein.
Referring to fig. 7, an embodiment of the present invention provides a service control network element 700, including: a first transceiver 701 and a first processor 702;
the first transceiver 701 is configured to receive a multimedia service stream from a sending end;
the first processor 702 is configured to determine a corresponding multimedia service module, and send the multimedia service stream and a multimedia service processing instruction to the multimedia service module, where the multimedia service module has one or more multimedia service processing functions;
the first transceiver 701 is further configured to receive a processing result of the multimedia service stream from the multimedia service module;
the first transceiver 701 is further configured to send a processing result of the multimedia service stream to a receiving end.
Optionally, the first processor 702 is further configured to determine a corresponding multimedia service module according to the service request and/or the multimedia service flow received from the sending end;
the first transceiver 701 is further configured to send a request for invoking a servitization interface to the multimedia service module, where the request for invoking the servitization interface includes: the multimedia service flow and a multimedia service processing indication.
Optionally, the sending end is a calling terminal, the receiving end is a called terminal, the multimedia service module has a code stream transcoding function, and the processing result is a result obtained by transcoding the multimedia service stream according to the multimedia service processing instruction by the multimedia service module;
or, the sending end and the receiving end are multi-party video terminals, the multimedia service module has a function of audio and/or video mixing processing, and the processing result is a result obtained by the multimedia service module performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a dynamic encoding and decoding function, and the processing result is obtained by the multimedia service module performing dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction;
or, the multimedia service module has a media content compression function, and the processing result is a result obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
In the embodiment of the invention, the service control network element does not perform specific processing of the multimedia service stream, but transmits the multimedia service stream to the corresponding multimedia service module, and the multimedia service module processes the multimedia service stream, so that for the service control network element, signaling control and multimedia processing are separated, service logic nesting is reduced, a path is optimized, and new services can be conveniently brought on line; meanwhile, the centralized processing of media resources can be realized for the multimedia service module, and the resource utilization rate is improved.
Referring to fig. 8, an embodiment of the present invention provides a multimedia service module 800, where the multimedia service module 800 has one or more multimedia service processing functions, and the multimedia service module 800 includes: a second transceiver 801 and a second processor 802;
wherein, the second transceiver 801 is configured to receive a multimedia service stream and a multimedia service processing instruction from a service control network element;
the second processor 802 is configured to process the multimedia service stream according to the multimedia service processing instruction, so as to obtain a processing result;
the second transceiver 801 is further configured to send the processing result to the service control network element.
Optionally, the second transceiver 801 is further configured to receive a request for invoking a servitization interface from the traffic control network element, where the request for invoking the servitization interface includes: the multimedia service flow and a multimedia service processing indication.
Optionally, the second processor 802 is further configured to perform transcoding processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result;
the second processor 802 is further configured to perform audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result;
the second processor 802 is further configured to perform dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result;
the second processor 802 is further configured to perform media content compression processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result.
In the embodiment of the invention, the multimedia service module receives the multimedia service stream and the multimedia service processing instruction from the service control network element, processes the multimedia service stream according to the multimedia service processing instruction, and sends the processing result to the service control network element. Therefore, signaling control and multimedia processing are separated, service logic nesting is reduced, a path is optimized, and new services can be conveniently brought to the online; meanwhile, the centralized resource processing is realized, and the resource utilization rate is improved.
Referring to fig. 9, an embodiment of the present invention provides a communication apparatus 900, including: a processor 901, a transceiver 902, a memory 903 and a bus interface.
Among other things, the processor 901 may be responsible for managing the bus architecture and general processing. The memory 903 may store data used by the processor 901 in performing operations.
In this embodiment of the present invention, the communication device 900 may further include: a program stored on the memory 903 and executable on the processor 901, which when executed by the processor 901 performs the steps of the method provided by embodiments of the present invention.
In fig. 9, the bus architecture may include any number of interconnected buses and bridges, with one or more processors represented by processor 901 and various circuits of memory represented by memory 903 being linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further by the embodiments. The bus interface provides an interface. The transceiver 902 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the processes of the method embodiments, and can achieve the same technical effects, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A multimedia processing method applied to a service control network element, the method comprising:
receiving a multimedia service stream from a sending end;
determining a corresponding multimedia service module, and sending the multimedia service stream and a multimedia service processing instruction to the multimedia service module, wherein the multimedia service module has one or more multimedia service processing functions;
receiving a processing result of the multimedia service stream from the multimedia service module;
sending the processing result of the multimedia service flow to a receiving end;
the determining the corresponding multimedia service module and sending the multimedia service stream to the multimedia service module includes:
determining a corresponding multimedia service module according to the service request and/or the multimedia service stream received from the sending end;
sending a request for invoking a servitization interface to the multimedia service module, the request for invoking a servitization interface comprising: the multimedia service flow and a multimedia service processing indication.
2. The method of claim 1,
the sending terminal is a calling terminal, the receiving terminal is a called terminal, the multimedia service module has a code stream transcoding function, and the processing result is a result obtained by transcoding the multimedia service stream by the multimedia service module according to the multimedia service processing instruction;
or,
the sending end and the receiving end are multi-party video terminals, the multimedia service module has the function of audio and/or video mixing processing, and the processing result is the result obtained by the multimedia service module performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction;
or,
the multimedia service module has a dynamic coding and decoding function, and the processing result is obtained by the multimedia service module performing dynamic coding and decoding processing on the multimedia service stream according to the multimedia service processing instruction;
or,
the multimedia service module has a media content compression function, and the processing result is obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
3. A multimedia processing method applied to a multimedia service module, the multimedia service module having one or more multimedia service processing functions, the method comprising:
receiving a multimedia service stream and a multimedia service processing instruction from a service control network element;
processing the multimedia service flow according to the multimedia service processing instruction to obtain a processing result;
sending the processing result to the service control network element;
receiving a multimedia service stream and a multimedia service processing indication from a service control network element, comprising:
receiving a request to invoke a servitization interface from the traffic control network element, the request to invoke a servitization interface comprising: the multimedia service flow and a multimedia service processing indication.
4. The method of claim 3, wherein processing the multimedia service stream according to the multimedia service processing indication to obtain a processing result comprises:
transcoding the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
or,
performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction to obtain a processing result;
or,
performing dynamic coding and decoding processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
or,
and performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result.
5. A traffic controlling network element, comprising: a first transceiver and a first processor, wherein,
the first transceiver is used for receiving a multimedia service stream from a sending end;
the first processor is configured to determine a corresponding multimedia service module, and send the multimedia service stream and a multimedia service processing instruction to the multimedia service module, where the multimedia service module has one or more multimedia service processing functions;
the first transceiver is further used for receiving a processing result of the multimedia service flow from the multimedia service module;
the first transceiver is further configured to send a processing result of the multimedia service stream to a receiving end;
the first processor is further configured to determine a corresponding multimedia service module according to the service request and/or the multimedia service stream received from the sending end;
the first transceiver is further configured to send a request for invoking a servitization interface to the multimedia service module, where the request for invoking the servitization interface includes: the multimedia service flow and a multimedia service processing indication.
6. The traffic controlling network element according to claim 5,
the sending end is a calling terminal, the receiving end is a called terminal, the multimedia service module has a code stream transcoding function, and the processing result is obtained by transcoding the multimedia service stream according to the multimedia service processing instruction by the multimedia service module;
or,
the sending end and the receiving end are multi-party video terminals, the multimedia service module has the function of audio and/or video mixing processing, and the processing result is the result obtained by the multimedia service module performing audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction;
or,
the multimedia service module has a dynamic coding and decoding function, and the processing result is obtained by the multimedia service module performing dynamic coding and decoding processing on the multimedia service stream according to the multimedia service processing instruction;
or,
the multimedia service module has a media content compression function, and the processing result is obtained by the multimedia service module performing media content compression processing on the multimedia service stream according to the multimedia service processing instruction.
7. A multimedia service module having one or more multimedia service processing functions, the multimedia service module comprising: a second transceiver and a second processor, wherein,
the second transceiver is used for receiving the multimedia service stream and the multimedia service processing instruction from the service control network element;
the second processor is configured to process the multimedia service stream according to the multimedia service processing instruction, and obtain a processing result;
the second transceiver is further configured to send the processing result to the service control network element;
the second transceiver is further configured to receive a request to invoke a servitization interface from the traffic control network element, where the request to invoke a servitization interface includes: the multimedia service flow and a multimedia service processing indication.
8. The multimedia service module of claim 7,
the second processor is further configured to perform transcoding processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
the second processor is further configured to perform audio and/or video mixing processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
the second processor is further configured to perform dynamic encoding and decoding processing on the multimedia service stream according to the multimedia service processing instruction to obtain the processing result;
the second processor is further configured to perform media content compression processing on the multimedia service stream according to the multimedia service processing instruction, so as to obtain the processing result.
9. A communication device comprising a processor, a memory and a program stored on the memory and executable on the processor, the program, when executed by the processor, implementing the steps of the multimedia processing method according to any of claims 1 to 2 or the steps of the multimedia processing method according to any of claims 3 to 4.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the multimedia processing method according to any of the claims 1 to 2 or the steps of the multimedia processing method according to any of the claims 3 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000956.4A CN111404862B (en) | 2019-01-02 | 2019-01-02 | Multimedia processing method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000956.4A CN111404862B (en) | 2019-01-02 | 2019-01-02 | Multimedia processing method and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111404862A CN111404862A (en) | 2020-07-10 |
| CN111404862B true CN111404862B (en) | 2022-09-13 |
Family
ID=71413117
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910000956.4A Active CN111404862B (en) | 2019-01-02 | 2019-01-02 | Multimedia processing method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111404862B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810733B (en) * | 2021-09-22 | 2024-06-25 | 湖南快乐阳光互动娱乐传媒有限公司 | Media resource online method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064863A (en) * | 2006-04-27 | 2007-10-31 | 华为技术有限公司 | Method and system for providing media resource service in IMS network |
| CN101136907A (en) * | 2006-09-01 | 2008-03-05 | 中兴通讯股份有限公司 | Relay media gateway media conversion control method in next generation network |
| CN101184271A (en) * | 2007-11-19 | 2008-05-21 | 华为技术有限公司 | Multimedia resource service selecting method and multimedia resource function controller |
| CN101764802A (en) * | 2009-02-04 | 2010-06-30 | 华为终端有限公司 | Method, server and terminal equipment for playing multimedia tone during talking |
| CN102271137A (en) * | 2011-08-19 | 2011-12-07 | 中兴通讯股份有限公司 | Media server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321152B (en) * | 2007-06-06 | 2013-06-12 | 上海贝尔阿尔卡特股份有限公司 | Method and apparatus for receiving multimedia business and auxiliarily receiving multimedia business |
-
2019
- 2019-01-02 CN CN201910000956.4A patent/CN111404862B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101064863A (en) * | 2006-04-27 | 2007-10-31 | 华为技术有限公司 | Method and system for providing media resource service in IMS network |
| CN101136907A (en) * | 2006-09-01 | 2008-03-05 | 中兴通讯股份有限公司 | Relay media gateway media conversion control method in next generation network |
| CN101184271A (en) * | 2007-11-19 | 2008-05-21 | 华为技术有限公司 | Multimedia resource service selecting method and multimedia resource function controller |
| CN101764802A (en) * | 2009-02-04 | 2010-06-30 | 华为终端有限公司 | Method, server and terminal equipment for playing multimedia tone during talking |
| CN102271137A (en) * | 2011-08-19 | 2011-12-07 | 中兴通讯股份有限公司 | Media server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111404862A (en) | 2020-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10469545B2 (en) | Multimedia session call control method and application server | |
| CN113746808B (en) | Converged communication method, gateway, electronic equipment and storage medium for online conference | |
| JP4567359B2 (en) | Rapid network SIP / SDP procedures for meeting management in response to end-user requirements by optimizing network resources | |
| WO2017129129A1 (en) | Instant call method, device, and system | |
| US11108838B2 (en) | Method, user equipment and application server for adding media stream of multimedia session | |
| JP5174178B2 (en) | Method, system, and device for call transfer | |
| CN101884205B (en) | Dynamic initiation of i1-ps signaling in ims centralized services | |
| KR20080086782A (en) | Apparatus and mehtod for handover in a heterogeneous wireless communication system | |
| WO2009012665A1 (en) | Method for realizing multimedia call continuity, equipment and system thereof | |
| US9825997B2 (en) | Mediator for optimizing the transmission of media contents between a multimedia resource function and a plurality of terminals | |
| WO2017147959A1 (en) | Service carrying method, communication terminal, control element s-cscf and system | |
| JP2010515311A (en) | Method, terminal and network device for changing the state of a packet switched domain | |
| US20240244093A1 (en) | Communication method, signaling control network element, media control network element and communication system | |
| US8411597B2 (en) | Method, system and apparatus for setting up multimedia call | |
| CN107277420A (en) | A kind of video calling implementation method and terminal | |
| CN101938467B (en) | Communication system and method for supporting internetwork multimedia session splitting realization | |
| CN107172597B (en) | Group calling switching method and device for terminal roaming in broadband cluster system | |
| CN111404862B (en) | Multimedia processing method and equipment | |
| CN107689945B (en) | Media conversion equipment control method and device and media gateway | |
| WO2009121310A1 (en) | Method, system and device for selecting a gateway | |
| CN108616496A (en) | Implementation method, device, mostly logical terminal and the network side equipment of multi-party call | |
| CN101651585B (en) | Method for expanding capacity of mobile terminal | |
| CN102548025B (en) | Method for reducing mobile voice over internet protocol (VoIP) call setup delay | |
| CN107547819B (en) | Video switching method, device and system | |
| CN102801689B (en) | Multimedia conferencing processing method and processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |