US20200280747A1 - Apparatus and method for transmitting multimedia frame in broadcast system - Google Patents
Apparatus and method for transmitting multimedia frame in broadcast system Download PDFInfo
- Publication number
- US20200280747A1 US20200280747A1 US16/878,066 US202016878066A US2020280747A1 US 20200280747 A1 US20200280747 A1 US 20200280747A1 US 202016878066 A US202016878066 A US 202016878066A US 2020280747 A1 US2020280747 A1 US 2020280747A1
- Authority
- US
- United States
- Prior art keywords
- frame
- multimedia
- layer
- mmt
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23605—Creation or processing of packetized elementary streams [PES]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H04L29/06476—
-
- H04L29/0653—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W80/00—Wireless network protocols or protocol adaptations to wireless operation
- H04W80/04—Network layer protocols, e.g. mobile IP [Internet Protocol]
Definitions
- the present invention relates to an apparatus and a method for transmitting a multimedia frame in a broadcast system. More particularly, the present invention relates to an apparatus and a method for transmitting a multimedia frame through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
- a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) is typically used for transmitting a multimedia content in a broadcast network.
- the MPEG-2 TS is used as a representative transmission technology for transmitting bit streams (a plurality of encoded video bit streams) in which a plurality of broadcast programs are multiplexed in a transmission environment having an error.
- the MPEG-2 TS is suitable for being used for broadcasting a digital TV signal in a multimedia age.
- FIG. 1 illustrates a structure of layers for supporting the MPEG-2 TS according to the related art.
- layers for supporting the MPEG-2 TS include a media coding layer 110 , a synchronous (sync) layer 120 , a delivery layer 130 , a network layer 140 , a data link layer 150 , and a physical layer 160 .
- the media coding layer 110 and the sync layer 120 are constructed in a format by which media data may be easily used in the basic unit of a record or a transmission.
- the delivery layer 130 , the network layer 140 , the data link layer 150 , and the physical layer 160 record a data block (e.g. “AU”) of a format constructed by the sync layer 120 in a separate recording medium or configure a multimedia frame for a transmission.
- the configured multimedia frame is transmitted to a subscriber terminal through a predetermined network.
- the sync layer 120 includes a fragment block 122 and an access unit 124 .
- the delivery layer 130 includes an MPEG-2 TS/MP4 132 , an RTP/HTTP 134, and a UDP/TCP 136 .
- the MPEG-2 TS has several limitations in supporting a multimedia service.
- the limitations of the MPEG-2 TS include one-way communication, an inefficiency of a transmission due to a fixed frame size, and a generation of unnecessary overheads in a transmission using an Internet Protocol (IP) and a transmission protocol specialized for an audio/video.
- IP Internet Protocol
- a MPEG Media Transport (MMT) standard is newly proposed in the MPEG as a multimedia transmission technology for supporting a multimedia service based on an MPEG technology.
- the MMT standard is proposed by the MPEG in order to overcome the limitations of the MPEG-2 TS.
- the MMT standard may be applied for efficiently transmitting hybrid content through a heterogeneous network.
- Hybrid content denotes a set of contents having a multimedia element by a video/audio/application.
- the heterogeneous network denotes a network where a broadcast network and a communication network coexist.
- the MMT standard intends to define a transmission technology closer to an IP, which is a basic technology in a transmission network for a multimedia service. Accordingly, the MMT standard is to representatively provide an efficient MPEG transmission technology in a multimedia service environment changed based on the IP, and its standardization is in progress together with continuous research.
- a method is desired that provides effective MPEG transmission technology in a multimedia service environment intending to provide a hybrid network and hybrid content in the MMT standard.
- Another aspect of the present invention is to provide a method of configuring a multimedia frame based on multimedia data for hybrid content or a hybrid service based on an MMT technology.
- Another aspect of the present invention is to provide a method of configuring a multimedia frame for a transmission of an Access Unit (AU) according to hybrid content or a hybrid service based on an MMT technology and transmitting the configured multimedia frame.
- AU Access Unit
- Another aspect of the present invention is to provide a method of configuring a multimedia frame to be transmitted through a heterogeneous network such that header information contains a frame identifier and information used for measuring a quality of a connection service between network layers and end-to-end network capabilities in a broadcast system supporting a multimedia service based on an internet protocol.
- a method of configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol includes generating header information including a frame identifier identifying a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and combining the header information and multimedia data to configure the multimedia frame.
- an apparatus for configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol includes a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating header information including a frame identifier distinguishing a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and for combining the header information and multimedia data to configure the multimedia frame.
- a subscriber terminal includes a communication unit for transmitting and receiving a multimedia frame, a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating the header information, and for generating the multimedia frame based on the header information and at least a portion of the multimedia data, wherein the header information includes a frame identifier identifying the multimedia frame and Quality of Service (QoS) information identifying a quality of a connection service between network layers and end-to-end network capabilities.
- QoS Quality of Service
- exemplary embodiments of the present invention provide a hybrid service or hybrid content through a heterogeneous network, so that an effective MPEG transmission in a multimedia environment is supported. Meanwhile, other various effects will be implicitly or explicitly disclosed in a detailed description according to the exemplary embodiments of the present invention described below.
- FIG. 1 illustrates a structure of layers for supporting a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) according to the related art
- FIG. 2 is a view illustrating a concept of an MPEG Media Transport (MMT) service by a broadcast system based on an MMT standard according to an exemplary embodiment of the present invention
- FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention
- FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.
- Exemplary embodiments of the present invention described below discuss a structure of layers defined in a Motion Picture Experts Group (MPEG) Media Transport (MMT) standard. Further, the exemplary embodiments of the present invention propose to configure a multimedia frame and will describe in detail layers for generating the multimedia frame in a structure of the layers defined by the MMT standard.
- the multimedia frame denotes a transport frame for an MMT service and a packet of an MMT access unit.
- the multimedia frame includes a quality of service information related to required transport information.
- a payload of the multimedia frame may be replaced with a configuration of multimedia data having a desired size by fragmenting or combining the multimedia data provided in the unit of a predetermined size in a higher layer.
- FIG. 2 is a view illustrating a concept of an MMT service by a broadcast system (hereinafter, referred to as an “MMT system”) based on an MMT standard according to an exemplary embodiments of the present invention.
- MMT system a broadcast system
- content for the MMT service may include UHD, Video On Demand (VOD), live streaming, files, widgets, E-books, and metadata.
- VOD Video On Demand
- the content for the MMT service may include any content that can be expressed in an electrical signal.
- a multimedia frame is configured and the configured multimedia frame is transmitted to a subscriber terminal via a hybrid delivery through a heterogeneous network.
- the heterogeneous network denotes a network having a transmission environment in which a broadcast network and an IP network coexist.
- the subscriber terminal receives the multimedia frame transmitted in the hybrid delivery form through the heterogeneous network, extracts multimedia data corresponding to desired content from the multimedia frame, and provides a video/audio/application to a user based on the extracted multimedia data.
- Each multimedia data corresponding to the video/audio/application provided for a specific content is defined as an “MMT asset”.
- the subscriber terminal may include any terminal that can support a multimedia service.
- a representative example of the subscriber terminal may include an IP TV or a smart phone. Accordingly, the MMT service may achieve objects of providing a high quality content delivery, a hybrid content support, and a hybrid network support.
- FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention.
- the seven layers are required for transmitting a configured multimedia frame.
- the seven layers include a media coding layer 310 , an encapsulation layer (hereinafter, referred to as a “Layer E”) 320 , a delivery layer (hereinafter, referred to as a “Layer D” or a “Layer T”) 330 or 390 , a network layer 340 , a data link layer 350 , a physical layer 360 , and a control layer (hereinafter, referred to as a “Layer C”) 370 and 380 .
- multimedia data according to a multi-content or a multi-service is generated by the media coding layer 310 and the Layer E 320 , so that the two layers may be considered as elements of a “multimedia data generation part”.
- a multimedia frame is configured by the Layer D 330 , so that the Layer D 300 may be considered as an element of a “multimedia frame configuration part”.
- the Layer D 330 included in the multimedia frame configuration part includes header information containing a frame identifier and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities, and configures a multimedia frame by combining the header information and multimedia data.
- the three technology areas correspond to the Layer E 320 , the Layer D 330 and 390 , and the Layer C 370 and 380 , respectively.
- the Layer E 320 plays a role of generating hybrid content
- the Layer D 330 and 390 plays a role of efficiently transmitting the generated content through a heterogeneous network
- the Layer C 370 and 380 plays a role for a general control in a consumption management and a transmission management of the hybrid content.
- the Layer E 320 includes an MMT E.3 layer 322 , an MMT E.2 layer 324 , and an MMT E.1 layer 326 .
- the MMT E.3 layer 322 receives an input of coded multimedia data provided from the media coding layer 310 and generates a data fragment which is the basic unit for the MMT service.
- the MMT E.2 layer 324 generates an Access Unit (AU) for the MMT service based on the data fragment generated by the MMT E.3 layer 322 .
- the MMT E.1 layer 326 generates a format for generation, storage, and transmission of the hybrid content through a combination or a division of the AUs provided by the MMT E.2 layer 324 .
- the Layer D 330 and 390 includes an MMT D.1 layer 332 , an MMT D.2 layer 334 , and an MMT D.3 layer 390 .
- the MMT D.1 layer 332 corresponds to an Application Protocol (AP) performing a similar role as the Real-time Transfer Protocol (RTP) or the HyperText Transfer Protocol (HTTP).
- the MMT D.2 layer 334 corresponds to a network layer protocol performing a similar role as the User Datagram Protocol (UDP) or the Transmission Control Protocol (TCP).
- the MMT D.3 layer 390 performs an operation for an optimization between respective layers included in the Layer E 320 and respective layers included in the Layer D 330 .
- the Layer C 370 and 380 includes an MMT C.1 layer 370 and a MMT C.2 layer 380 .
- the MMT C.1 layer 370 provides information on generation and consumption of hybrid content and the MMT C.2 layer 380 provides information on transmission of the hybrid content.
- FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.
- FIG. 4 defines an operation performed by the MMT D.2 layer 334 included in the Layer D 330 among the layers shown in FIG. 3 .
- the MMT D.2 layer 334 receives an input of multimedia data provided from the MMT D.1 layer 332 in step 410 .
- Sufficient multimedia data to provide a hybrid service or hybrid content and an MMT asset for each multimedia data should be provided from the MMT D.1 layer 332 .
- the MMT D.2 layer 334 constructs header information for configuring a multimedia frame in step 412 .
- the header information contains at least a frame identifier distinguishing a multimedia frame and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities. A more detailed description for constructing the header information is provided below.
- a method of how to configure a multimedia frame (T Frame) by the Layer T2 in charge of transmitting the multimedia frame according to the MMT service proposed in exemplary embodiments of the present invention is described below.
- T Frame For the configuration of the multimedia frame (T Frame), header information to be recorded in a header region and multimedia data to be recorded in a payload region should be defined. Further, Quality of Service (QoS) for the multimedia frame (T Frame) according to exemplary embodiments of the present invention should be guaranteed.
- QoS Quality of Service
- a method should be provided to perform a flow control for the multimedia frame configured according to exemplary embodiments of the present invention.
- a function provided by an IP protocol should be replaced by means of the flow control and a QoS level according to exemplary embodiments of the present invention.
- exemplary embodiments of the present invention should define a procedure in which the Layer T2 exchanges information with other layers and content and a transmission method of information exchanged through the procedure in order to transmit the AU.
- the header information to be recorded in the header region of the multimedia frame (T Frame) is defined as follows.
- Table 1 below shows a structure of the multimedia frame.
- the multimedia frame has a frame header region and a payload region.
- the frame header region records header information corresponding to control information required to receive multimedia data according to a hybrid service/content transmitted through the multimedia frame.
- the payload region records multimedia data according to a hybrid service/content.
- Table 2 below shows an example of header information recorded in a frame header region included in a multimedia frame.
- Table 2 shows an example of 64 bit header information.
- a frame identifier is indicated by the first 16 bits (0 th -15 th bits).
- a length of a datagram obtained or assembled by multimedia data recorded in the multimedia frame is indicated by the second 16 bits (16 th -31 st bits).
- Flow Label is indicated by the third 16 bits (32 nd -47 th bits), and Media Access Unit (MAU) abstraction information (MAU Abstraction Information) is indicated by the fourth 16 bits (48 th -63 rd bits).
- MAU Media Access Unit
- the frame identifier corresponds to identification information for distinguishing a corresponding multimedia frame (T Frame). For example, when a transmitting side fragments multimedia data and transmits the fragmented multimedia data through a plurality of multimedia frames, the frame identifier (Frame ID) may be used for assembling a plurality of multimedia data through the plurality of multimedia frames by a receiving side.
- the length (Length) corresponds to a length of a datagram measured in the unit of bytes.
- the datagram refers to a data packet obtained by multimedia data transmitted through one or a plurality of multimedia frames.
- one datagram may be transmitted by a payload of one multimedia frame.
- one datagram may be divided into a plurality of multimedia data blocks, and the divided multimedia data blocks may be transmitted by payloads of different multimedia frames.
- the Flow_Label identifies a specific QoS required for each flow.
- the Flow_Label may be used as a field for identifying the MAU.
- 8 bits for indicating the Flow_Label may be defined as shown in Tables 3 to 7 below.
- a bit rate which may be expressed by the first 3 bits (1 th -3 rd bits), is defined in Table 3 below.
- a degree of delay which may be expressed by the next one bit (4 th bit), is defined in Table 4 below.
- a throughput which may be expressed by the next one bit (5 th bit), is defined in Table 5 below.
- the last 2 bits (7 th -8 th bits) may be used as reserved bits, as shown in Table 7 below.
- CBR Constant Bit Rate
- RT-VBR Real-Time Variable Bit Rate
- NRT-VBR Non-Real-Time Variable Bit Rate
- ABR Available Bit Rate
- URR Unspecified Bit Rate
- the MAU_Abstraction_Information provides abstract information for accessing flexible and efficient mechanism of a service class. For example, a set of parameters defined by the MAU_Abtraction_Information is negotiated when a connection is configured within a network. The parameters are used to measure QoS of a connection between network layers and end-to-end network capabilities. Accordingly, in the network, QoS should be guaranteed by the negotiation by satisfying a specific value of the parameters defined by the MAU_Abtraction_Information.
- the parameters defined by the MAU_Abstraction_Information may include Delay (range) and an AU loss rate (%).
- the Delay (range) denotes a maximum end-to-end delay time for a transmission of a multimedia frame and the AU loss rate (5) denotes an Access Unit Loss Ratio (AULR).
- AULR Access Unit Loss Ratio
- a percentage of the AU denotes an allowed loss.
- Table 8 below defines the Delay (range), which is the maximum end-to-end delay time as defined above.
- Table 9 below defines the AU loss rate (5), which is the AULR as defined above.
- the MMT D.2 layer communicates with the MMT D.1 layer or the MMT C.2 layer based on an Application Program Interface (API) or a Type-Length-Value (TLV) for exemplary embodiments of the present invention.
- API Application Program Interface
- TLV Type-Length-Value
- the MMT D.1 layer provides the ME D.2 layer with multimedia data in a predetermined unit, which is the AU.
- the MMT D.1 layer provides the MMT D.2 layer with characteristics of the AU for guaranteeing the setting in the configuration of the multimedia frame and the QoS in the transmission of the multimedia frame by the MMT D.2 layer.
- the MMT C.2 layer configures a multimedia frame and performs communication for providing the MMT D.2 layer with control information required for a transmission of the multimedia frame.
- the MMT C.2 layer provides the MMT D.2 layer with Session Management Information (SMI), Session Monitoring Information (SMI), and Error Control Information (ECI) through communication with the MMT D.2 layer.
- SMSI Session Management Information
- SMI Session Monitoring Information
- ECI Error Control Information
- the MMT D.2 layer receives the session management information from the MMT C.2 layer in order to manage a session control.
- the session management information contains an adaptive delivery and a change delivery path.
- the MMT D.2 layer manages a transport related to properties of a bit rate, a delay time, and a loss rate based on the session management information provided by the MMT C.2 layer.
- the MMT D.2 layer exchanges the session management information with the MMT C.2 layer in order to support a management as described above.
- a server may modify a transmission path to a client based on a re-negotiation configuration or a session modification message, which is requested by a client, transmitted to the server.
- the MMT D.2 layer receives session monitoring (feedback) information from the MMT C.2 layer in order to monitor a session.
- the MMT D.2 layer may provide information for a session monitoring through the Flow_Label and the MAU_Abtration_Information. Information on the delay time and the loss rate may be used as parameters for monitoring.
- the MMT C.2 layer may make a request for a Forward Error Correction (FEC) or a retransmission such as an error control from the MMT D.2 layer.
- the MMT D.2 layer may configure a multimedia frame such that the MMT D.2 layer supports the error correction or the error control when a request for the error correction or the error control is made from the MMT C.2 layer.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
- This application is a continuation application of prior application Ser. No. 14/684,808, filed on Apr. 13, 2015, which is a continuation of a prior application Ser. No. 13/973,241, filed on Aug. 22, 2013, which has issued as U.S. Pat. No. 9,009,347 on Apr. 14, 2015 and is a continuation of prior application Ser. No. 13/353,502, filed on Jan. 19, 2012, which has issued as U.S. Pat. No. 8,544,052 on Sep. 24, 2013, which claimed the benefit under 35 U.S.C. § 119(a) of a Korean patent application filed on Jan. 19, 2011 in the Korean Industrial Property Office and assigned Serial number 10-2011-0005650, the entire disclosure of each of which is hereby incorporated by reference.
- The present invention relates to an apparatus and a method for transmitting a multimedia frame in a broadcast system. More particularly, the present invention relates to an apparatus and a method for transmitting a multimedia frame through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
- A Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) is typically used for transmitting a multimedia content in a broadcast network. The MPEG-2 TS is used as a representative transmission technology for transmitting bit streams (a plurality of encoded video bit streams) in which a plurality of broadcast programs are multiplexed in a transmission environment having an error. For example, the MPEG-2 TS is suitable for being used for broadcasting a digital TV signal in a multimedia age.
-
FIG. 1 illustrates a structure of layers for supporting the MPEG-2 TS according to the related art. - Referring to
FIG. 1 , layers for supporting the MPEG-2 TS include amedia coding layer 110, a synchronous (sync)layer 120, adelivery layer 130, anetwork layer 140, adata link layer 150, and aphysical layer 160. - The
media coding layer 110 and thesync layer 120 are constructed in a format by which media data may be easily used in the basic unit of a record or a transmission. Thedelivery layer 130, thenetwork layer 140, thedata link layer 150, and thephysical layer 160 record a data block (e.g. “AU”) of a format constructed by thesync layer 120 in a separate recording medium or configure a multimedia frame for a transmission. The configured multimedia frame is transmitted to a subscriber terminal through a predetermined network. - For this purpose, the
sync layer 120 includes afragment block 122 and anaccess unit 124. Thedelivery layer 130 includes an MPEG-2 TS/MP4 132, an RTP/HTTP 134, and a UDP/TCP 136. - However, the MPEG-2 TS has several limitations in supporting a multimedia service. The limitations of the MPEG-2 TS include one-way communication, an inefficiency of a transmission due to a fixed frame size, and a generation of unnecessary overheads in a transmission using an Internet Protocol (IP) and a transmission protocol specialized for an audio/video.
- Accordingly, a MPEG Media Transport (MMT) standard is newly proposed in the MPEG as a multimedia transmission technology for supporting a multimedia service based on an MPEG technology. The MMT standard is proposed by the MPEG in order to overcome the limitations of the MPEG-2 TS.
- For example, the MMT standard may be applied for efficiently transmitting hybrid content through a heterogeneous network. Hybrid content denotes a set of contents having a multimedia element by a video/audio/application. The heterogeneous network denotes a network where a broadcast network and a communication network coexist.
- The MMT standard intends to define a transmission technology closer to an IP, which is a basic technology in a transmission network for a multimedia service. Accordingly, the MMT standard is to representatively provide an efficient MPEG transmission technology in a multimedia service environment changed based on the IP, and its standardization is in progress together with continuous research. A method is desired that provides effective MPEG transmission technology in a multimedia service environment intending to provide a hybrid network and hybrid content in the MMT standard.
- Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a method of configuring a multimedia frame, which can be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
- Another aspect of the present invention is to provide a method of configuring a multimedia frame based on multimedia data for hybrid content or a hybrid service based on an MMT technology.
- Another aspect of the present invention is to provide a method of configuring a multimedia frame for a transmission of an Access Unit (AU) according to hybrid content or a hybrid service based on an MMT technology and transmitting the configured multimedia frame.
- Another aspect of the present invention is to provide a method of configuring a multimedia frame to be transmitted through a heterogeneous network such that header information contains a frame identifier and information used for measuring a quality of a connection service between network layers and end-to-end network capabilities in a broadcast system supporting a multimedia service based on an internet protocol.
- In accordance with an aspect of the present invention, a method of configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol is provided. The method includes generating header information including a frame identifier identifying a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and combining the header information and multimedia data to configure the multimedia frame.
- In accordance with another aspect of the present invention, an apparatus for configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol is provided. The apparatus includes a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating header information including a frame identifier distinguishing a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and for combining the header information and multimedia data to configure the multimedia frame.
- In accordance with another aspect of the present invention, a subscriber terminal is provided. The subscriber terminal includes a communication unit for transmitting and receiving a multimedia frame, a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating the header information, and for generating the multimedia frame based on the header information and at least a portion of the multimedia data, wherein the header information includes a frame identifier identifying the multimedia frame and Quality of Service (QoS) information identifying a quality of a connection service between network layers and end-to-end network capabilities.
- Accordingly, exemplary embodiments of the present invention provide a hybrid service or hybrid content through a heterogeneous network, so that an effective MPEG transmission in a multimedia environment is supported. Meanwhile, other various effects will be implicitly or explicitly disclosed in a detailed description according to the exemplary embodiments of the present invention described below.
- Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
- The above and other aspects, features, and advantages of certain exemplary embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 illustrates a structure of layers for supporting a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) according to the related art; -
FIG. 2 is a view illustrating a concept of an MPEG Media Transport (MMT) service by a broadcast system based on an MMT standard according to an exemplary embodiment of the present invention; -
FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention; and -
FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention. - Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
- The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the exemplary embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
- The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention is provided for illustration purposes only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
- It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.
- Exemplary embodiments of the present invention described below discuss a structure of layers defined in a Motion Picture Experts Group (MPEG) Media Transport (MMT) standard. Further, the exemplary embodiments of the present invention propose to configure a multimedia frame and will describe in detail layers for generating the multimedia frame in a structure of the layers defined by the MMT standard. The multimedia frame denotes a transport frame for an MMT service and a packet of an MMT access unit. The multimedia frame includes a quality of service information related to required transport information.
- The exemplary embodiments of the present invention describe a construction of header information for configuring the multimedia frame in more detail. A payload of the multimedia frame may be replaced with a configuration of multimedia data having a desired size by fragmenting or combining the multimedia data provided in the unit of a predetermined size in a higher layer.
-
FIG. 2 is a view illustrating a concept of an MMT service by a broadcast system (hereinafter, referred to as an “MMT system”) based on an MMT standard according to an exemplary embodiments of the present invention. - Referring to
FIG. 2 , content for the MMT service may include UHD, Video On Demand (VOD), live streaming, files, widgets, E-books, and metadata. However, the content for the MMT service may include any content that can be expressed in an electrical signal. - After multimedia data according to each of the various contents are encapsulated in a predetermined format by an MMT encapsulator, a multimedia frame is configured and the configured multimedia frame is transmitted to a subscriber terminal via a hybrid delivery through a heterogeneous network. The heterogeneous network denotes a network having a transmission environment in which a broadcast network and an IP network coexist.
- The subscriber terminal receives the multimedia frame transmitted in the hybrid delivery form through the heterogeneous network, extracts multimedia data corresponding to desired content from the multimedia frame, and provides a video/audio/application to a user based on the extracted multimedia data. Each multimedia data corresponding to the video/audio/application provided for a specific content is defined as an “MMT asset”. The subscriber terminal may include any terminal that can support a multimedia service. A representative example of the subscriber terminal may include an IP TV or a smart phone. Accordingly, the MMT service may achieve objects of providing a high quality content delivery, a hybrid content support, and a hybrid network support.
-
FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention. - Referring to
FIG. 3 , seven layers are required for transmitting a configured multimedia frame. The seven layers include amedia coding layer 310, an encapsulation layer (hereinafter, referred to as a “Layer E”) 320, a delivery layer (hereinafter, referred to as a “Layer D” or a “Layer T”) 330 or 390, anetwork layer 340, adata link layer 350, aphysical layer 360, and a control layer (hereinafter, referred to as a “Layer C”) 370 and 380. - According to exemplary embodiments of the present invention, multimedia data according to a multi-content or a multi-service is generated by the
media coding layer 310 and theLayer E 320, so that the two layers may be considered as elements of a “multimedia data generation part”. A multimedia frame is configured by theLayer D 330, so that the Layer D 300 may be considered as an element of a “multimedia frame configuration part”. TheLayer D 330 included in the multimedia frame configuration part includes header information containing a frame identifier and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities, and configures a multimedia frame by combining the header information and multimedia data. - Technology areas corresponding to three layers among the seven layers are important for the MMT standard. The three technology areas correspond to the
Layer E 320, theLayer D 330 and 390, and the Layer C 370 and 380, respectively. TheLayer E 320 plays a role of generating hybrid content, theLayer D 330 and 390 plays a role of efficiently transmitting the generated content through a heterogeneous network, and the Layer C 370 and 380 plays a role for a general control in a consumption management and a transmission management of the hybrid content. TheLayer E 320 includes an MMT E.3layer 322, an MMT E.2layer 324, and an MMT E.1layer 326. The MMT E.3layer 322 receives an input of coded multimedia data provided from themedia coding layer 310 and generates a data fragment which is the basic unit for the MMT service. The MMT E.2layer 324 generates an Access Unit (AU) for the MMT service based on the data fragment generated by the MMT E.3layer 322. The MMT E.1layer 326 generates a format for generation, storage, and transmission of the hybrid content through a combination or a division of the AUs provided by the MMT E.2layer 324. - The
Layer D 330 and 390 includes an MMT D.1layer 332, an MMT D.2layer 334, and an MMT D.3 layer 390. The MMT D.1layer 332 corresponds to an Application Protocol (AP) performing a similar role as the Real-time Transfer Protocol (RTP) or the HyperText Transfer Protocol (HTTP). The MMT D.2layer 334 corresponds to a network layer protocol performing a similar role as the User Datagram Protocol (UDP) or the Transmission Control Protocol (TCP). The MMT D.3 layer 390 performs an operation for an optimization between respective layers included in theLayer E 320 and respective layers included in theLayer D 330. - The Layer C 370 and 380 includes an MMT C.1 layer 370 and a MMT C.2 layer 380. The MMT C.1 layer 370 provides information on generation and consumption of hybrid content and the MMT C.2 layer 380 provides information on transmission of the hybrid content.
-
FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.FIG. 4 defines an operation performed by the MMT D.2layer 334 included in theLayer D 330 among the layers shown inFIG. 3 . - Referring to
FIG. 4 , the MMT D.2layer 334 receives an input of multimedia data provided from the MMT D.1layer 332 instep 410. Sufficient multimedia data to provide a hybrid service or hybrid content and an MMT asset for each multimedia data should be provided from the MMT D.1layer 332. - The MMT D.2
layer 334 constructs header information for configuring a multimedia frame instep 412. The header information contains at least a frame identifier distinguishing a multimedia frame and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities. A more detailed description for constructing the header information is provided below. - The MMT D.2
layer 334 configures a multimedia frame for a hybrid multimedia service instep 414. A multimedia frame is configured by combining the multimedia data input instep 410 and the header information constructed instep 412. After the multimedia frame is configured, the MMT D.2 334 transmits the configured multimedia frame to a subscriber terminal through a heterogeneous network instep 416. - A method of how to configure a multimedia frame (T Frame) by the Layer T2 in charge of transmitting the multimedia frame according to the MMT service proposed in exemplary embodiments of the present invention is described below. For the configuration of the multimedia frame (T Frame), header information to be recorded in a header region and multimedia data to be recorded in a payload region should be defined. Further, Quality of Service (QoS) for the multimedia frame (T Frame) according to exemplary embodiments of the present invention should be guaranteed.
- In addition, a method should be provided to perform a flow control for the multimedia frame configured according to exemplary embodiments of the present invention. A function provided by an IP protocol should be replaced by means of the flow control and a QoS level according to exemplary embodiments of the present invention.
- Finally, exemplary embodiments of the present invention should define a procedure in which the Layer T2 exchanges information with other layers and content and a transmission method of information exchanged through the procedure in order to transmit the AU.
- The header information to be recorded in the header region of the multimedia frame (T Frame) according to exemplary embodiments of the present invention is defined as follows.
- Table 1 below shows a structure of the multimedia frame.
-
TABLE 1 Frame Header Payload - As shown in Table 1, the multimedia frame has a frame header region and a payload region. The frame header region records header information corresponding to control information required to receive multimedia data according to a hybrid service/content transmitted through the multimedia frame. The payload region records multimedia data according to a hybrid service/content.
- Table 2 below shows an example of header information recorded in a frame header region included in a multimedia frame.
-
TABLE 2 Bits 0-15 16-31 0 Frame ID Length 32 Flow_Label MAU_Abstraction_ Information - Table 2 shows an example of 64 bit header information. In the header information, a frame identifier is indicated by the first 16 bits (0th-15th bits). A length of a datagram obtained or assembled by multimedia data recorded in the multimedia frame is indicated by the second 16 bits (16th-31st bits). Flow Label is indicated by the third 16 bits (32nd-47th bits), and Media Access Unit (MAU) abstraction information (MAU Abstraction Information) is indicated by the fourth 16 bits (48th-63rd bits).
- The frame identifier (Frame ID) corresponds to identification information for distinguishing a corresponding multimedia frame (T Frame). For example, when a transmitting side fragments multimedia data and transmits the fragmented multimedia data through a plurality of multimedia frames, the frame identifier (Frame ID) may be used for assembling a plurality of multimedia data through the plurality of multimedia frames by a receiving side.
- Accordingly, indexes corresponding to an order of transmitted multimedia frames may be used as an example of the frame identifier (Frame ID). In some cases, the frame identifier (Frame ID) is used as an index corresponding to an identifier of an asset or a transmitted multimedia frame.
- The length (Length) corresponds to a length of a datagram measured in the unit of bytes. The datagram refers to a data packet obtained by multimedia data transmitted through one or a plurality of multimedia frames.
- For example, one datagram may be transmitted by a payload of one multimedia frame. Alternatively, one datagram may be divided into a plurality of multimedia data blocks, and the divided multimedia data blocks may be transmitted by payloads of different multimedia frames.
- Accordingly, a receiving side identifies a length of multimedia data recorded in the payload of the received multimedia frame through the length recorded in the header information of the received multimedia frame and then can identify whether the datagram is fragmented. For example, when a length recorded in the header information is the same as a length of multimedia data recorded in the payload, the receiving side considers the multimedia data recorded in the payload as the datagram. When a length recorded in the header information is not the same as a length of multimedia data recorded in the payload, the receiving side assembles the received multimedia data with multimedia data recorded in the payload of the multimedia frame received before or after the received multimedia data and obtains a datagram having a length recorded in the header information.
- A plurality of datagrams may be included within a payload of one multimedia frame. In this case, multimedia data corresponding to a plurality of services or contents recorded in one payload are separated from each other and an independent datagram is obtained only by the separated multimedia data or may be obtained by a combination of the separated multimedia data and multimedia data received before or to be received after the separated multimedia data in consideration of the length recorded in the header information.
- The Flow_Label identifies a specific QoS required for each flow. For example, the Flow_Label may be used as a field for identifying the MAU. When the Flow_Label is used as a field for identifying the MAU, 8 bits for indicating the Flow_Label may be defined as shown in Tables 3 to 7 below.
- A bit rate, which may be expressed by the first 3 bits (1th-3rd bits), is defined in Table 3 below. A degree of delay, which may be expressed by the next one bit (4th bit), is defined in Table 4 below. A throughput, which may be expressed by the next one bit (5th bit), is defined in Table 5 below. A synchronization expressed by the next one bit (6th bit), which is a relation with another multimedia frame, is defined in Table 6 below. The last 2 bits (7th-8th bits) may be used as reserved bits, as shown in Table 7 below.
-
TABLE 3 Bits 0-2 Bit rate 111 Constant Bit Rate (CBR) 110 Real-Time Variable Bit Rate (RT-VBR) 101 Non-Real-Time Variable Bit Rate (NRT-VBR) 100 Available Bit Rate (ABR) 011 Unspecified Bit Rate (UBR) 010 Reserved 001 Reserved 000 Reserved -
TABLE 4 bit 3 Delay 0 Normal delay 1 Low delay -
TABLE 5 Bit 4 Throughput 0 Normal throughput 1 High throughput -
TABLE 6 Bit 5 Synchronization 0 no relationship 1 relationship with another T-frame -
TABLE 7 bits 6-7 Reserved for future use - The MAU_Abstraction_Information provides abstract information for accessing flexible and efficient mechanism of a service class. For example, a set of parameters defined by the MAU_Abtraction_Information is negotiated when a connection is configured within a network. The parameters are used to measure QoS of a connection between network layers and end-to-end network capabilities. Accordingly, in the network, QoS should be guaranteed by the negotiation by satisfying a specific value of the parameters defined by the MAU_Abtraction_Information.
- For example, the parameters defined by the MAU_Abstraction_Information may include Delay (range) and an AU loss rate (%). The Delay (range) denotes a maximum end-to-end delay time for a transmission of a multimedia frame and the AU loss rate (5) denotes an Access Unit Loss Ratio (AULR). A percentage of the AU denotes an allowed loss.
- For example, when 5 bits are used for the MAU_Abstraction_Information, the Delay (range) is defined by the first 3 bits (1th-3rd bits) and the AU loss rate (%) is defined by the next 2 bits (4th-5th bits).
- Table 8 below defines the Delay (range), which is the maximum end-to-end delay time as defined above.
-
TABLE 8 Bit 0-2 Delay 111 500 ms 110 1 sec 101 5 sec 100 10 sec 011 unlimited 010 001 000 - Table 9 below defines the AU loss rate (5), which is the AULR as defined above.
-
TABLE 9 Bit 3-4 AULR 111 0% 110 10% 101 20% 100 30% 011 50% 010 not specified 001 000 - In the foregoing description, the structure of the multimedia frame and examples of the definition and the construction of the header information recorded in the header region included in the multimedia frame have been described, respectively.
- Hereinafter, it will be described that the MMT D.2 layer communicates with the MMT D.1 layer or the MMT C.2 layer based on an Application Program Interface (API) or a Type-Length-Value (TLV) for exemplary embodiments of the present invention.
- First, referring to communication with the MMT D.1 layer, the MMT D.1 layer provides the ME D.2 layer with multimedia data in a predetermined unit, which is the AU. The MMT D.1 layer provides the MMT D.2 layer with characteristics of the AU for guaranteeing the setting in the configuration of the multimedia frame and the QoS in the transmission of the multimedia frame by the MMT D.2 layer.
- The MMT C.2 layer configures a multimedia frame and performs communication for providing the MMT D.2 layer with control information required for a transmission of the multimedia frame. For example, the MMT C.2 layer provides the MMT D.2 layer with Session Management Information (SMI), Session Monitoring Information (SMI), and Error Control Information (ECI) through communication with the MMT D.2 layer.
- The MMT D.2 layer receives the session management information from the MMT C.2 layer in order to manage a session control. At this time, the session management information contains an adaptive delivery and a change delivery path. For example, the MMT D.2 layer manages a transport related to properties of a bit rate, a delay time, and a loss rate based on the session management information provided by the MMT C.2 layer. The MMT D.2 layer exchanges the session management information with the MMT C.2 layer in order to support a management as described above. A server may modify a transmission path to a client based on a re-negotiation configuration or a session modification message, which is requested by a client, transmitted to the server.
- The MMT D.2 layer receives session monitoring (feedback) information from the MMT C.2 layer in order to monitor a session. For example, the MMT D.2 layer may provide information for a session monitoring through the Flow_Label and the MAU_Abtration_Information. Information on the delay time and the loss rate may be used as parameters for monitoring.
- The MMT C.2 layer may make a request for a Forward Error Correction (FEC) or a retransmission such as an error control from the MMT D.2 layer. The MMT D.2 layer may configure a multimedia frame such that the MMT D.2 layer supports the error correction or the error control when a request for the error correction or the error control is made from the MMT C.2 layer.
- While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/878,066 US20200280747A1 (en) | 2011-01-19 | 2020-05-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2011-0005650 | 2011-01-19 | ||
KR20110005650A KR20120084234A (en) | 2011-01-19 | 2011-01-19 | Method for delivering mmt access unit for mpeg media transport |
US13/353,502 US8544052B2 (en) | 2011-01-19 | 2012-01-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
US13/973,241 US9009347B2 (en) | 2011-01-19 | 2013-08-22 | Apparatus and method for transmitting multimedia frame in broadcast system |
US14/684,808 US10694230B2 (en) | 2011-01-19 | 2015-04-13 | Apparatus and method for transmitting multimedia frame in broadcast system |
US16/878,066 US20200280747A1 (en) | 2011-01-19 | 2020-05-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/684,808 Continuation US10694230B2 (en) | 2011-01-19 | 2015-04-13 | Apparatus and method for transmitting multimedia frame in broadcast system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200280747A1 true US20200280747A1 (en) | 2020-09-03 |
Family
ID=46491757
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/353,502 Active 2032-03-23 US8544052B2 (en) | 2011-01-19 | 2012-01-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
US13/973,241 Active US9009347B2 (en) | 2011-01-19 | 2013-08-22 | Apparatus and method for transmitting multimedia frame in broadcast system |
US14/684,808 Active US10694230B2 (en) | 2011-01-19 | 2015-04-13 | Apparatus and method for transmitting multimedia frame in broadcast system |
US16/878,066 Abandoned US20200280747A1 (en) | 2011-01-19 | 2020-05-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/353,502 Active 2032-03-23 US8544052B2 (en) | 2011-01-19 | 2012-01-19 | Apparatus and method for transmitting multimedia frame in broadcast system |
US13/973,241 Active US9009347B2 (en) | 2011-01-19 | 2013-08-22 | Apparatus and method for transmitting multimedia frame in broadcast system |
US14/684,808 Active US10694230B2 (en) | 2011-01-19 | 2015-04-13 | Apparatus and method for transmitting multimedia frame in broadcast system |
Country Status (6)
Country | Link |
---|---|
US (4) | US8544052B2 (en) |
EP (1) | EP2666302A4 (en) |
JP (2) | JP6054305B2 (en) |
KR (5) | KR20120084234A (en) |
AU (1) | AU2012207725B2 (en) |
WO (1) | WO2012099429A2 (en) |
Families Citing this family (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20120084234A (en) * | 2011-01-19 | 2012-07-27 | 삼성전자주식회사 | Method for delivering mmt access unit for mpeg media transport |
JP2015503281A (en) * | 2011-11-23 | 2015-01-29 | エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute | Method and apparatus for a streaming service providing scalability and view information |
WO2013108954A1 (en) * | 2012-01-20 | 2013-07-25 | 전자부품연구원 | Method for transmitting and receiving program configuration information for scalable ultra high definition video service in hybrid transmission environment, and method and apparatus for effectively transmitting scalar layer information |
US20140344875A1 (en) * | 2012-01-20 | 2014-11-20 | Electronics And Telecommunications Research Institute | Method for transmitting media data having access unit divided into media fragment units in heterogeneous network |
JP5661206B2 (en) * | 2012-01-31 | 2015-01-28 | シャープ株式会社 | GENERATION DEVICE, REPRODUCTION DEVICE, DATA STRUCTURE, GENERATION METHOD, REPRODUCTION METHOD, CONTROL PROGRAM, AND RECORDING MEDIUM |
KR20130108198A (en) * | 2012-03-23 | 2013-10-02 | (주)휴맥스 | Method of hybrid delievery for mmt packaged svc video contents and method of recieving |
US9544641B2 (en) * | 2012-05-10 | 2017-01-10 | Humax Co., Ltd. | Hybrid transmission method through MMT packet format extension |
US10356143B2 (en) | 2012-10-10 | 2019-07-16 | Samsung Electronics Co., Ltd. | Method and apparatus for media data delivery control |
KR102048480B1 (en) * | 2012-10-11 | 2020-01-08 | 삼성전자주식회사 | Apparatus and method for transmitting transport characteristics of multimedia data in dynamic network environment |
KR102163338B1 (en) * | 2012-10-11 | 2020-10-08 | 삼성전자주식회사 | Apparatus and method for transmitting and receiving packet in a broadcasting and communication system |
KR102056438B1 (en) | 2012-10-12 | 2019-12-16 | 삼성전자주식회사 | Method and apparatus for transceiving data packet for transmitting and receiving multimedia data |
US11290510B2 (en) * | 2012-11-29 | 2022-03-29 | Samsung Electronics Co., Ltd. | Method and apparatus for encapsulation of motion picture experts group media transport assets in international organization for standardization base media files |
US9236932B2 (en) * | 2013-03-11 | 2016-01-12 | Nagravision S.A. | Configuration method of a multimedia system |
JP5641090B2 (en) | 2013-03-14 | 2014-12-17 | ソニー株式会社 | Transmitting apparatus, transmitting method, receiving apparatus, and receiving method |
KR102107514B1 (en) * | 2013-04-18 | 2020-05-07 | 삼성전자주식회사 | Method and apparatus for managing dynamic que in broadcasting system |
KR101484843B1 (en) | 2013-04-19 | 2015-01-20 | 삼성전자주식회사 | A method and apparatus for transmitting a media transport packet in a multimedia transport system |
KR102148158B1 (en) | 2013-04-23 | 2020-08-28 | 삼성전자주식회사 | Method and apparatus for transmitting/receiving packet in a communication system |
BR112015030043B1 (en) * | 2013-06-07 | 2023-01-10 | Sony Corporation | TRANSMISSION AND PROCESSING DEVICE, AND, TRANSMISSION METHOD OF A CONTINUOUS TRANSMISSION FLOW |
US10104406B2 (en) * | 2013-06-21 | 2018-10-16 | Saturn Licensing Llc | Transmission apparatus, transmission method, reproduction apparatus, reproduction method and reception apparatus |
KR102191970B1 (en) * | 2013-12-31 | 2020-12-17 | 삼성전자주식회사 | Apparatus and Method for Transmitting Data |
US9729903B2 (en) | 2013-12-31 | 2017-08-08 | Samsung Electronics Co., Ltd. | Data transmitting device and method |
ES2885548T3 (en) * | 2014-08-07 | 2021-12-14 | Sony Group Corp | Transmission device, transmission method and receiving device |
WO2016117904A1 (en) * | 2015-01-21 | 2016-07-28 | 엘지전자 주식회사 | Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method |
KR101743441B1 (en) | 2015-02-13 | 2017-06-05 | 에스케이텔레콤 주식회사 | Method for providing streaming data through node linking with base station, and node using the same |
JP6729379B2 (en) * | 2015-07-01 | 2020-07-22 | ソニー株式会社 | Transmitting apparatus and transmitting method, and receiving apparatus and receiving method |
JP6178370B2 (en) * | 2015-09-09 | 2017-08-09 | 株式会社メディアリンクス | Video transmission system and video receiver |
CN108141636B (en) * | 2015-10-07 | 2021-03-23 | 松下知识产权经营株式会社 | Receiving apparatus and receiving method |
US10750217B2 (en) * | 2016-03-21 | 2020-08-18 | Lg Electronics Inc. | Broadcast signal transmitting/receiving device and method |
FR3070566B1 (en) * | 2017-08-30 | 2020-09-04 | Sagemcom Broadband Sas | PROCESS FOR RECOVERING A TARGET FILE OF AN OPERATING SOFTWARE AND DEVICE FOR USE |
US11606528B2 (en) * | 2018-01-03 | 2023-03-14 | Saturn Licensing Llc | Advanced television systems committee (ATSC) 3.0 latency-free display of content attribute |
US11463747B2 (en) * | 2018-04-05 | 2022-10-04 | Tvu Networks Corporation | Systems and methods for real time control of a remote video production with multiple streams |
US10966001B2 (en) | 2018-04-05 | 2021-03-30 | Tvu Networks Corporation | Remote cloud-based video production system in an environment where there is network delay |
US10673957B2 (en) * | 2018-06-28 | 2020-06-02 | At&T Intellectual Property I, L.P. | Providing high availability in a software defined network |
US12081822B2 (en) * | 2020-01-08 | 2024-09-03 | Arris Enterprises Llc | Service switching for content output |
EP3908006A3 (en) * | 2020-05-01 | 2022-01-26 | TVU Networks Corporation | Systems and methods for real time control of a remote video production with multiple streams |
GB2598701B (en) * | 2020-05-25 | 2023-01-25 | V Nova Int Ltd | Wireless data communication system and method |
KR20220130394A (en) * | 2021-03-18 | 2022-09-27 | 삼성전자주식회사 | An electronic device for transmitting multiple media streams and a method of the same |
CN113709510A (en) * | 2021-08-06 | 2021-11-26 | 联想(北京)有限公司 | High-speed data real-time transmission method and device, equipment and storage medium |
Family Cites Families (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0637797A (en) * | 1992-05-20 | 1994-02-10 | Xerox Corp | Reserved ring mechanism of packet exchange network |
US6751221B1 (en) * | 1996-10-04 | 2004-06-15 | Kabushiki Kaisha Toshiba | Data transmitting node and network inter-connection node suitable for home network environment |
US5905872A (en) * | 1996-11-05 | 1999-05-18 | At&T Corp. | Method of transferring connection management information in world wideweb requests and responses |
US6839330B1 (en) * | 1997-07-15 | 2005-01-04 | Viasat, Inc. | Method and apparatus for improving asynchronous transfer mode operation over noisy, high speed wireless links |
JP3447207B2 (en) * | 1997-12-05 | 2003-09-16 | 松下電器産業株式会社 | Program information creation transmission apparatus and method |
GB9814412D0 (en) * | 1998-07-03 | 1998-09-02 | Northern Telecom Ltd | Communications method and apparatus |
EP0975123A1 (en) * | 1998-07-15 | 2000-01-26 | Telefonaktiebolaget L M Ericsson (Publ) | Communication device and method for reliable and low-delay packet transmission |
JP2000059370A (en) * | 1998-08-04 | 2000-02-25 | Fujitsu Ltd | Device and method for controlling traffic |
US6449588B1 (en) * | 1999-06-02 | 2002-09-10 | Accenture Llp | Customer-driven QOS in hybrid communication system |
DE10102159C2 (en) * | 2001-01-18 | 2002-12-12 | Fraunhofer Ges Forschung | Method and device for generating or decoding a scalable data stream taking into account a bit savings bank, encoder and scalable encoder |
US7515616B2 (en) * | 2001-11-24 | 2009-04-07 | Lg Electronics Inc. | Packet transmission scheduling technique |
US6789123B2 (en) * | 2001-12-28 | 2004-09-07 | Microsoft Corporation | System and method for delivery of dynamically scalable audio/video content over a network |
US20040181811A1 (en) * | 2003-03-13 | 2004-09-16 | Rakib Selim Shlomo | Thin DOCSIS in-band management for interactive HFC service delivery |
JP2004363841A (en) * | 2003-06-04 | 2004-12-24 | Hitachi Ltd | Packet transmitting device, packet receiving device, packet transfer device, and packet transmitting/receiving device |
JP4188774B2 (en) | 2003-08-14 | 2008-11-26 | 株式会社エヌ・ティ・ティ・ドコモ | Frame transmission / reception system, frame transmission apparatus, frame reception apparatus, and frame transmission / reception method |
KR20050044207A (en) * | 2003-11-07 | 2005-05-12 | 엘지전자 주식회사 | Method for measuring quality of service of wireless internet multimedia |
US7460468B2 (en) * | 2004-04-22 | 2008-12-02 | At&T Intellectual Property I, L.P. | Method and system for automatically tracking the rerouting of logical circuit data in a data network |
KR20060114080A (en) * | 2005-04-27 | 2006-11-06 | 삼성전자주식회사 | System and method of providing multimedia streaming service |
US7509021B2 (en) | 2005-06-27 | 2009-03-24 | Streaming Networks (Pvt.) Ltd. | Method and system for providing instant replay |
US7969997B1 (en) * | 2005-11-04 | 2011-06-28 | The Board Of Trustees Of The Leland Stanford Junior University | Video communications in a peer-to-peer network |
US8077707B2 (en) * | 2005-11-18 | 2011-12-13 | Sri International | Systems and methods for digital stream denting |
KR20070078238A (en) * | 2006-01-26 | 2007-07-31 | 에스케이 텔레콤주식회사 | Multimedia contents transmitting method and system in communication network |
EP1845685B1 (en) * | 2006-04-11 | 2012-06-27 | Alcatel Lucent | Optimised transmission of content IP packets by adding to the IP packets content-related information |
US7895635B2 (en) * | 2006-06-30 | 2011-02-22 | Versteeg William C | Systems and methods of assembling an elementary stream from an encapsulated multimedia transport stream |
US8948206B2 (en) | 2006-08-31 | 2015-02-03 | Telefonaktiebolaget Lm Ericsson (Publ) | Inclusion of quality of service indication in header compression channel |
US8630312B2 (en) * | 2006-12-04 | 2014-01-14 | Samsung Electronics Company, Ltd. | System and method for wireless communication of uncompressed video having connection control protocol |
JP5026167B2 (en) * | 2007-07-02 | 2012-09-12 | パナソニック株式会社 | Stream transmission server and stream transmission system |
KR100929774B1 (en) * | 2007-11-14 | 2009-12-03 | 한국전자통신연구원 | Cable Modem Initialization Technique and Apparatus Using Queue-length-Based Band Request Frame in Optical-Coaxial Networks |
KR100986990B1 (en) * | 2008-09-30 | 2010-10-11 | 전자부품연구원 | Apparatus and method for processing multi-protocol digital mobile broadcasting streams |
KR101354130B1 (en) * | 2008-12-22 | 2014-01-24 | 한국전자통신연구원 | Method for transmitting and receiving the frame in wireless LAN |
US8009567B2 (en) | 2009-02-05 | 2011-08-30 | Cisco Technology, Inc. | System and method for improved data transmission reliability over a network |
EP2529528B1 (en) * | 2010-01-28 | 2018-01-10 | Thomson Licensing | A method and apparatus for parsing a network abstraction-layer for reliable data communication |
US8650604B2 (en) * | 2010-10-27 | 2014-02-11 | Samsung Electronics Co., Ltd. | Method and system for synchronization of audio/video (A/V) stream format change in wireless communication systems |
KR20120084234A (en) * | 2011-01-19 | 2012-07-27 | 삼성전자주식회사 | Method for delivering mmt access unit for mpeg media transport |
KR20120138604A (en) | 2011-06-14 | 2012-12-26 | 삼성전자주식회사 | Method and apparatus for transmitting/receiving hybrid media content in a multimedia system |
KR101484843B1 (en) | 2013-04-19 | 2015-01-20 | 삼성전자주식회사 | A method and apparatus for transmitting a media transport packet in a multimedia transport system |
-
2011
- 2011-01-19 KR KR20110005650A patent/KR20120084234A/en unknown
-
2012
- 2012-01-19 EP EP12736315.8A patent/EP2666302A4/en not_active Ceased
- 2012-01-19 KR KR1020197019948A patent/KR102028430B1/en active IP Right Grant
- 2012-01-19 KR KR1020137021764A patent/KR101855484B1/en active Search and Examination
- 2012-01-19 WO PCT/KR2012/000514 patent/WO2012099429A2/en active Application Filing
- 2012-01-19 KR KR1020187012391A patent/KR101964419B1/en active IP Right Grant
- 2012-01-19 JP JP2013550410A patent/JP6054305B2/en active Active
- 2012-01-19 AU AU2012207725A patent/AU2012207725B2/en active Active
- 2012-01-19 US US13/353,502 patent/US8544052B2/en active Active
- 2012-01-19 KR KR1020197008748A patent/KR102000260B1/en active IP Right Grant
-
2013
- 2013-08-22 US US13/973,241 patent/US9009347B2/en active Active
-
2015
- 2015-04-13 US US14/684,808 patent/US10694230B2/en active Active
-
2016
- 2016-11-30 JP JP2016232384A patent/JP2017073813A/en active Pending
-
2020
- 2020-05-19 US US16/878,066 patent/US20200280747A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
KR101855484B1 (en) | 2018-05-09 |
KR20120084234A (en) | 2012-07-27 |
US20120185907A1 (en) | 2012-07-19 |
KR20190086038A (en) | 2019-07-19 |
KR101964419B1 (en) | 2019-04-01 |
CN103329555A (en) | 2013-09-25 |
AU2012207725A1 (en) | 2013-08-15 |
JP2017073813A (en) | 2017-04-13 |
AU2012207725B2 (en) | 2016-03-24 |
US20130336325A1 (en) | 2013-12-19 |
US8544052B2 (en) | 2013-09-24 |
JP2014507879A (en) | 2014-03-27 |
WO2012099429A2 (en) | 2012-07-26 |
KR20180050763A (en) | 2018-05-15 |
EP2666302A2 (en) | 2013-11-27 |
JP6054305B2 (en) | 2016-12-27 |
KR20140009315A (en) | 2014-01-22 |
EP2666302A4 (en) | 2014-12-31 |
KR102028430B1 (en) | 2019-10-04 |
US20150222936A1 (en) | 2015-08-06 |
WO2012099429A3 (en) | 2012-11-29 |
KR102000260B1 (en) | 2019-07-16 |
US10694230B2 (en) | 2020-06-23 |
KR20190035954A (en) | 2019-04-03 |
US9009347B2 (en) | 2015-04-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200280747A1 (en) | Apparatus and method for transmitting multimedia frame in broadcast system | |
JP7212102B2 (en) | Method for transmitting packets in multimedia transmission system | |
US11196786B2 (en) | Interface apparatus and method for transmitting and receiving media data | |
US11381625B2 (en) | Apparatus and method for transmitting multimedia data in hybrid network | |
KR101955690B1 (en) | Apparatus and method for delivering multimedia data in hybrid network | |
KR101855327B1 (en) | Apparatus and method for delivering multimedia data in hybrid network | |
KR20190021300A (en) | Apparatus and method for delivering multimedia data in hybrid network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |