Nothing Special   »   [go: up one dir, main page]

US20200280747A1 - Apparatus and method for transmitting multimedia frame in broadcast system - Google Patents

Apparatus and method for transmitting multimedia frame in broadcast system Download PDF

Info

Publication number
US20200280747A1
US20200280747A1 US16/878,066 US202016878066A US2020280747A1 US 20200280747 A1 US20200280747 A1 US 20200280747A1 US 202016878066 A US202016878066 A US 202016878066A US 2020280747 A1 US2020280747 A1 US 2020280747A1
Authority
US
United States
Prior art keywords
frame
multimedia
layer
mmt
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/878,066
Inventor
Kyung-Mo Park
Sung-Oh Hwang
Jae-Yeon Song
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US16/878,066 priority Critical patent/US20200280747A1/en
Publication of US20200280747A1 publication Critical patent/US20200280747A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23605Creation or processing of packetized elementary streams [PES]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04L29/06476
    • H04L29/0653
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/631Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/64322IP
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W80/00Wireless network protocols or protocol adaptations to wireless operation
    • H04W80/04Network layer protocols, e.g. mobile IP [Internet Protocol]

Definitions

  • the present invention relates to an apparatus and a method for transmitting a multimedia frame in a broadcast system. More particularly, the present invention relates to an apparatus and a method for transmitting a multimedia frame through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
  • a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) is typically used for transmitting a multimedia content in a broadcast network.
  • the MPEG-2 TS is used as a representative transmission technology for transmitting bit streams (a plurality of encoded video bit streams) in which a plurality of broadcast programs are multiplexed in a transmission environment having an error.
  • the MPEG-2 TS is suitable for being used for broadcasting a digital TV signal in a multimedia age.
  • FIG. 1 illustrates a structure of layers for supporting the MPEG-2 TS according to the related art.
  • layers for supporting the MPEG-2 TS include a media coding layer 110 , a synchronous (sync) layer 120 , a delivery layer 130 , a network layer 140 , a data link layer 150 , and a physical layer 160 .
  • the media coding layer 110 and the sync layer 120 are constructed in a format by which media data may be easily used in the basic unit of a record or a transmission.
  • the delivery layer 130 , the network layer 140 , the data link layer 150 , and the physical layer 160 record a data block (e.g. “AU”) of a format constructed by the sync layer 120 in a separate recording medium or configure a multimedia frame for a transmission.
  • the configured multimedia frame is transmitted to a subscriber terminal through a predetermined network.
  • the sync layer 120 includes a fragment block 122 and an access unit 124 .
  • the delivery layer 130 includes an MPEG-2 TS/MP4 132 , an RTP/HTTP 134, and a UDP/TCP 136 .
  • the MPEG-2 TS has several limitations in supporting a multimedia service.
  • the limitations of the MPEG-2 TS include one-way communication, an inefficiency of a transmission due to a fixed frame size, and a generation of unnecessary overheads in a transmission using an Internet Protocol (IP) and a transmission protocol specialized for an audio/video.
  • IP Internet Protocol
  • a MPEG Media Transport (MMT) standard is newly proposed in the MPEG as a multimedia transmission technology for supporting a multimedia service based on an MPEG technology.
  • the MMT standard is proposed by the MPEG in order to overcome the limitations of the MPEG-2 TS.
  • the MMT standard may be applied for efficiently transmitting hybrid content through a heterogeneous network.
  • Hybrid content denotes a set of contents having a multimedia element by a video/audio/application.
  • the heterogeneous network denotes a network where a broadcast network and a communication network coexist.
  • the MMT standard intends to define a transmission technology closer to an IP, which is a basic technology in a transmission network for a multimedia service. Accordingly, the MMT standard is to representatively provide an efficient MPEG transmission technology in a multimedia service environment changed based on the IP, and its standardization is in progress together with continuous research.
  • a method is desired that provides effective MPEG transmission technology in a multimedia service environment intending to provide a hybrid network and hybrid content in the MMT standard.
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame based on multimedia data for hybrid content or a hybrid service based on an MMT technology.
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame for a transmission of an Access Unit (AU) according to hybrid content or a hybrid service based on an MMT technology and transmitting the configured multimedia frame.
  • AU Access Unit
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame to be transmitted through a heterogeneous network such that header information contains a frame identifier and information used for measuring a quality of a connection service between network layers and end-to-end network capabilities in a broadcast system supporting a multimedia service based on an internet protocol.
  • a method of configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol includes generating header information including a frame identifier identifying a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and combining the header information and multimedia data to configure the multimedia frame.
  • an apparatus for configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol includes a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating header information including a frame identifier distinguishing a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and for combining the header information and multimedia data to configure the multimedia frame.
  • a subscriber terminal includes a communication unit for transmitting and receiving a multimedia frame, a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating the header information, and for generating the multimedia frame based on the header information and at least a portion of the multimedia data, wherein the header information includes a frame identifier identifying the multimedia frame and Quality of Service (QoS) information identifying a quality of a connection service between network layers and end-to-end network capabilities.
  • QoS Quality of Service
  • exemplary embodiments of the present invention provide a hybrid service or hybrid content through a heterogeneous network, so that an effective MPEG transmission in a multimedia environment is supported. Meanwhile, other various effects will be implicitly or explicitly disclosed in a detailed description according to the exemplary embodiments of the present invention described below.
  • FIG. 1 illustrates a structure of layers for supporting a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) according to the related art
  • FIG. 2 is a view illustrating a concept of an MPEG Media Transport (MMT) service by a broadcast system based on an MMT standard according to an exemplary embodiment of the present invention
  • FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention
  • FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.
  • Exemplary embodiments of the present invention described below discuss a structure of layers defined in a Motion Picture Experts Group (MPEG) Media Transport (MMT) standard. Further, the exemplary embodiments of the present invention propose to configure a multimedia frame and will describe in detail layers for generating the multimedia frame in a structure of the layers defined by the MMT standard.
  • the multimedia frame denotes a transport frame for an MMT service and a packet of an MMT access unit.
  • the multimedia frame includes a quality of service information related to required transport information.
  • a payload of the multimedia frame may be replaced with a configuration of multimedia data having a desired size by fragmenting or combining the multimedia data provided in the unit of a predetermined size in a higher layer.
  • FIG. 2 is a view illustrating a concept of an MMT service by a broadcast system (hereinafter, referred to as an “MMT system”) based on an MMT standard according to an exemplary embodiments of the present invention.
  • MMT system a broadcast system
  • content for the MMT service may include UHD, Video On Demand (VOD), live streaming, files, widgets, E-books, and metadata.
  • VOD Video On Demand
  • the content for the MMT service may include any content that can be expressed in an electrical signal.
  • a multimedia frame is configured and the configured multimedia frame is transmitted to a subscriber terminal via a hybrid delivery through a heterogeneous network.
  • the heterogeneous network denotes a network having a transmission environment in which a broadcast network and an IP network coexist.
  • the subscriber terminal receives the multimedia frame transmitted in the hybrid delivery form through the heterogeneous network, extracts multimedia data corresponding to desired content from the multimedia frame, and provides a video/audio/application to a user based on the extracted multimedia data.
  • Each multimedia data corresponding to the video/audio/application provided for a specific content is defined as an “MMT asset”.
  • the subscriber terminal may include any terminal that can support a multimedia service.
  • a representative example of the subscriber terminal may include an IP TV or a smart phone. Accordingly, the MMT service may achieve objects of providing a high quality content delivery, a hybrid content support, and a hybrid network support.
  • FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention.
  • the seven layers are required for transmitting a configured multimedia frame.
  • the seven layers include a media coding layer 310 , an encapsulation layer (hereinafter, referred to as a “Layer E”) 320 , a delivery layer (hereinafter, referred to as a “Layer D” or a “Layer T”) 330 or 390 , a network layer 340 , a data link layer 350 , a physical layer 360 , and a control layer (hereinafter, referred to as a “Layer C”) 370 and 380 .
  • multimedia data according to a multi-content or a multi-service is generated by the media coding layer 310 and the Layer E 320 , so that the two layers may be considered as elements of a “multimedia data generation part”.
  • a multimedia frame is configured by the Layer D 330 , so that the Layer D 300 may be considered as an element of a “multimedia frame configuration part”.
  • the Layer D 330 included in the multimedia frame configuration part includes header information containing a frame identifier and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities, and configures a multimedia frame by combining the header information and multimedia data.
  • the three technology areas correspond to the Layer E 320 , the Layer D 330 and 390 , and the Layer C 370 and 380 , respectively.
  • the Layer E 320 plays a role of generating hybrid content
  • the Layer D 330 and 390 plays a role of efficiently transmitting the generated content through a heterogeneous network
  • the Layer C 370 and 380 plays a role for a general control in a consumption management and a transmission management of the hybrid content.
  • the Layer E 320 includes an MMT E.3 layer 322 , an MMT E.2 layer 324 , and an MMT E.1 layer 326 .
  • the MMT E.3 layer 322 receives an input of coded multimedia data provided from the media coding layer 310 and generates a data fragment which is the basic unit for the MMT service.
  • the MMT E.2 layer 324 generates an Access Unit (AU) for the MMT service based on the data fragment generated by the MMT E.3 layer 322 .
  • the MMT E.1 layer 326 generates a format for generation, storage, and transmission of the hybrid content through a combination or a division of the AUs provided by the MMT E.2 layer 324 .
  • the Layer D 330 and 390 includes an MMT D.1 layer 332 , an MMT D.2 layer 334 , and an MMT D.3 layer 390 .
  • the MMT D.1 layer 332 corresponds to an Application Protocol (AP) performing a similar role as the Real-time Transfer Protocol (RTP) or the HyperText Transfer Protocol (HTTP).
  • the MMT D.2 layer 334 corresponds to a network layer protocol performing a similar role as the User Datagram Protocol (UDP) or the Transmission Control Protocol (TCP).
  • the MMT D.3 layer 390 performs an operation for an optimization between respective layers included in the Layer E 320 and respective layers included in the Layer D 330 .
  • the Layer C 370 and 380 includes an MMT C.1 layer 370 and a MMT C.2 layer 380 .
  • the MMT C.1 layer 370 provides information on generation and consumption of hybrid content and the MMT C.2 layer 380 provides information on transmission of the hybrid content.
  • FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.
  • FIG. 4 defines an operation performed by the MMT D.2 layer 334 included in the Layer D 330 among the layers shown in FIG. 3 .
  • the MMT D.2 layer 334 receives an input of multimedia data provided from the MMT D.1 layer 332 in step 410 .
  • Sufficient multimedia data to provide a hybrid service or hybrid content and an MMT asset for each multimedia data should be provided from the MMT D.1 layer 332 .
  • the MMT D.2 layer 334 constructs header information for configuring a multimedia frame in step 412 .
  • the header information contains at least a frame identifier distinguishing a multimedia frame and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities. A more detailed description for constructing the header information is provided below.
  • a method of how to configure a multimedia frame (T Frame) by the Layer T2 in charge of transmitting the multimedia frame according to the MMT service proposed in exemplary embodiments of the present invention is described below.
  • T Frame For the configuration of the multimedia frame (T Frame), header information to be recorded in a header region and multimedia data to be recorded in a payload region should be defined. Further, Quality of Service (QoS) for the multimedia frame (T Frame) according to exemplary embodiments of the present invention should be guaranteed.
  • QoS Quality of Service
  • a method should be provided to perform a flow control for the multimedia frame configured according to exemplary embodiments of the present invention.
  • a function provided by an IP protocol should be replaced by means of the flow control and a QoS level according to exemplary embodiments of the present invention.
  • exemplary embodiments of the present invention should define a procedure in which the Layer T2 exchanges information with other layers and content and a transmission method of information exchanged through the procedure in order to transmit the AU.
  • the header information to be recorded in the header region of the multimedia frame (T Frame) is defined as follows.
  • Table 1 below shows a structure of the multimedia frame.
  • the multimedia frame has a frame header region and a payload region.
  • the frame header region records header information corresponding to control information required to receive multimedia data according to a hybrid service/content transmitted through the multimedia frame.
  • the payload region records multimedia data according to a hybrid service/content.
  • Table 2 below shows an example of header information recorded in a frame header region included in a multimedia frame.
  • Table 2 shows an example of 64 bit header information.
  • a frame identifier is indicated by the first 16 bits (0 th -15 th bits).
  • a length of a datagram obtained or assembled by multimedia data recorded in the multimedia frame is indicated by the second 16 bits (16 th -31 st bits).
  • Flow Label is indicated by the third 16 bits (32 nd -47 th bits), and Media Access Unit (MAU) abstraction information (MAU Abstraction Information) is indicated by the fourth 16 bits (48 th -63 rd bits).
  • MAU Media Access Unit
  • the frame identifier corresponds to identification information for distinguishing a corresponding multimedia frame (T Frame). For example, when a transmitting side fragments multimedia data and transmits the fragmented multimedia data through a plurality of multimedia frames, the frame identifier (Frame ID) may be used for assembling a plurality of multimedia data through the plurality of multimedia frames by a receiving side.
  • the length (Length) corresponds to a length of a datagram measured in the unit of bytes.
  • the datagram refers to a data packet obtained by multimedia data transmitted through one or a plurality of multimedia frames.
  • one datagram may be transmitted by a payload of one multimedia frame.
  • one datagram may be divided into a plurality of multimedia data blocks, and the divided multimedia data blocks may be transmitted by payloads of different multimedia frames.
  • the Flow_Label identifies a specific QoS required for each flow.
  • the Flow_Label may be used as a field for identifying the MAU.
  • 8 bits for indicating the Flow_Label may be defined as shown in Tables 3 to 7 below.
  • a bit rate which may be expressed by the first 3 bits (1 th -3 rd bits), is defined in Table 3 below.
  • a degree of delay which may be expressed by the next one bit (4 th bit), is defined in Table 4 below.
  • a throughput which may be expressed by the next one bit (5 th bit), is defined in Table 5 below.
  • the last 2 bits (7 th -8 th bits) may be used as reserved bits, as shown in Table 7 below.
  • CBR Constant Bit Rate
  • RT-VBR Real-Time Variable Bit Rate
  • NRT-VBR Non-Real-Time Variable Bit Rate
  • ABR Available Bit Rate
  • URR Unspecified Bit Rate
  • the MAU_Abstraction_Information provides abstract information for accessing flexible and efficient mechanism of a service class. For example, a set of parameters defined by the MAU_Abtraction_Information is negotiated when a connection is configured within a network. The parameters are used to measure QoS of a connection between network layers and end-to-end network capabilities. Accordingly, in the network, QoS should be guaranteed by the negotiation by satisfying a specific value of the parameters defined by the MAU_Abtraction_Information.
  • the parameters defined by the MAU_Abstraction_Information may include Delay (range) and an AU loss rate (%).
  • the Delay (range) denotes a maximum end-to-end delay time for a transmission of a multimedia frame and the AU loss rate (5) denotes an Access Unit Loss Ratio (AULR).
  • AULR Access Unit Loss Ratio
  • a percentage of the AU denotes an allowed loss.
  • Table 8 below defines the Delay (range), which is the maximum end-to-end delay time as defined above.
  • Table 9 below defines the AU loss rate (5), which is the AULR as defined above.
  • the MMT D.2 layer communicates with the MMT D.1 layer or the MMT C.2 layer based on an Application Program Interface (API) or a Type-Length-Value (TLV) for exemplary embodiments of the present invention.
  • API Application Program Interface
  • TLV Type-Length-Value
  • the MMT D.1 layer provides the ME D.2 layer with multimedia data in a predetermined unit, which is the AU.
  • the MMT D.1 layer provides the MMT D.2 layer with characteristics of the AU for guaranteeing the setting in the configuration of the multimedia frame and the QoS in the transmission of the multimedia frame by the MMT D.2 layer.
  • the MMT C.2 layer configures a multimedia frame and performs communication for providing the MMT D.2 layer with control information required for a transmission of the multimedia frame.
  • the MMT C.2 layer provides the MMT D.2 layer with Session Management Information (SMI), Session Monitoring Information (SMI), and Error Control Information (ECI) through communication with the MMT D.2 layer.
  • SMSI Session Management Information
  • SMI Session Monitoring Information
  • ECI Error Control Information
  • the MMT D.2 layer receives the session management information from the MMT C.2 layer in order to manage a session control.
  • the session management information contains an adaptive delivery and a change delivery path.
  • the MMT D.2 layer manages a transport related to properties of a bit rate, a delay time, and a loss rate based on the session management information provided by the MMT C.2 layer.
  • the MMT D.2 layer exchanges the session management information with the MMT C.2 layer in order to support a management as described above.
  • a server may modify a transmission path to a client based on a re-negotiation configuration or a session modification message, which is requested by a client, transmitted to the server.
  • the MMT D.2 layer receives session monitoring (feedback) information from the MMT C.2 layer in order to monitor a session.
  • the MMT D.2 layer may provide information for a session monitoring through the Flow_Label and the MAU_Abtration_Information. Information on the delay time and the loss rate may be used as parameters for monitoring.
  • the MMT C.2 layer may make a request for a Forward Error Correction (FEC) or a retransmission such as an error control from the MMT D.2 layer.
  • the MMT D.2 layer may configure a multimedia frame such that the MMT D.2 layer supports the error correction or the error control when a request for the error correction or the error control is made from the MMT C.2 layer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

An apparatus and a method for transmitting a multimedia frame through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol are provided. The method includes generating header information including a frame identifier distinguishing a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and combining the header information and multimedia data to configure the multimedia frame.

Description

    PRIORITY
  • This application is a continuation application of prior application Ser. No. 14/684,808, filed on Apr. 13, 2015, which is a continuation of a prior application Ser. No. 13/973,241, filed on Aug. 22, 2013, which has issued as U.S. Pat. No. 9,009,347 on Apr. 14, 2015 and is a continuation of prior application Ser. No. 13/353,502, filed on Jan. 19, 2012, which has issued as U.S. Pat. No. 8,544,052 on Sep. 24, 2013, which claimed the benefit under 35 U.S.C. § 119(a) of a Korean patent application filed on Jan. 19, 2011 in the Korean Industrial Property Office and assigned Serial number 10-2011-0005650, the entire disclosure of each of which is hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION 1. Field of the Invention
  • The present invention relates to an apparatus and a method for transmitting a multimedia frame in a broadcast system. More particularly, the present invention relates to an apparatus and a method for transmitting a multimedia frame through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
  • 2. Description of the Related Art
  • A Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) is typically used for transmitting a multimedia content in a broadcast network. The MPEG-2 TS is used as a representative transmission technology for transmitting bit streams (a plurality of encoded video bit streams) in which a plurality of broadcast programs are multiplexed in a transmission environment having an error. For example, the MPEG-2 TS is suitable for being used for broadcasting a digital TV signal in a multimedia age.
  • FIG. 1 illustrates a structure of layers for supporting the MPEG-2 TS according to the related art.
  • Referring to FIG. 1, layers for supporting the MPEG-2 TS include a media coding layer 110, a synchronous (sync) layer 120, a delivery layer 130, a network layer 140, a data link layer 150, and a physical layer 160.
  • The media coding layer 110 and the sync layer 120 are constructed in a format by which media data may be easily used in the basic unit of a record or a transmission. The delivery layer 130, the network layer 140, the data link layer 150, and the physical layer 160 record a data block (e.g. “AU”) of a format constructed by the sync layer 120 in a separate recording medium or configure a multimedia frame for a transmission. The configured multimedia frame is transmitted to a subscriber terminal through a predetermined network.
  • For this purpose, the sync layer 120 includes a fragment block 122 and an access unit 124. The delivery layer 130 includes an MPEG-2 TS/MP4 132, an RTP/HTTP 134, and a UDP/TCP 136.
  • However, the MPEG-2 TS has several limitations in supporting a multimedia service. The limitations of the MPEG-2 TS include one-way communication, an inefficiency of a transmission due to a fixed frame size, and a generation of unnecessary overheads in a transmission using an Internet Protocol (IP) and a transmission protocol specialized for an audio/video.
  • Accordingly, a MPEG Media Transport (MMT) standard is newly proposed in the MPEG as a multimedia transmission technology for supporting a multimedia service based on an MPEG technology. The MMT standard is proposed by the MPEG in order to overcome the limitations of the MPEG-2 TS.
  • For example, the MMT standard may be applied for efficiently transmitting hybrid content through a heterogeneous network. Hybrid content denotes a set of contents having a multimedia element by a video/audio/application. The heterogeneous network denotes a network where a broadcast network and a communication network coexist.
  • The MMT standard intends to define a transmission technology closer to an IP, which is a basic technology in a transmission network for a multimedia service. Accordingly, the MMT standard is to representatively provide an efficient MPEG transmission technology in a multimedia service environment changed based on the IP, and its standardization is in progress together with continuous research. A method is desired that provides effective MPEG transmission technology in a multimedia service environment intending to provide a hybrid network and hybrid content in the MMT standard.
  • SUMMARY OF THE INVENTION
  • Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a method of configuring a multimedia frame, which can be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol.
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame based on multimedia data for hybrid content or a hybrid service based on an MMT technology.
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame for a transmission of an Access Unit (AU) according to hybrid content or a hybrid service based on an MMT technology and transmitting the configured multimedia frame.
  • Another aspect of the present invention is to provide a method of configuring a multimedia frame to be transmitted through a heterogeneous network such that header information contains a frame identifier and information used for measuring a quality of a connection service between network layers and end-to-end network capabilities in a broadcast system supporting a multimedia service based on an internet protocol.
  • In accordance with an aspect of the present invention, a method of configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol is provided. The method includes generating header information including a frame identifier identifying a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and combining the header information and multimedia data to configure the multimedia frame.
  • In accordance with another aspect of the present invention, an apparatus for configuring a multimedia frame to be transmitted through a heterogeneous network in a broadcast system supporting a multimedia service based on an internet protocol is provided. The apparatus includes a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating header information including a frame identifier distinguishing a multimedia frame and information measuring a quality of a connection service between network layers and end-to-end network capabilities, and for combining the header information and multimedia data to configure the multimedia frame.
  • In accordance with another aspect of the present invention, a subscriber terminal is provided. The subscriber terminal includes a communication unit for transmitting and receiving a multimedia frame, a multimedia data generator for generating multimedia data according to a hybrid content or a hybrid service, and a multimedia frame configuration unit for generating the header information, and for generating the multimedia frame based on the header information and at least a portion of the multimedia data, wherein the header information includes a frame identifier identifying the multimedia frame and Quality of Service (QoS) information identifying a quality of a connection service between network layers and end-to-end network capabilities.
  • Accordingly, exemplary embodiments of the present invention provide a hybrid service or hybrid content through a heterogeneous network, so that an effective MPEG transmission in a multimedia environment is supported. Meanwhile, other various effects will be implicitly or explicitly disclosed in a detailed description according to the exemplary embodiments of the present invention described below.
  • Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other aspects, features, and advantages of certain exemplary embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
  • FIG. 1 illustrates a structure of layers for supporting a Moving Picture Experts Group-2 Transport Stream (MPEG-2 TS) according to the related art;
  • FIG. 2 is a view illustrating a concept of an MPEG Media Transport (MMT) service by a broadcast system based on an MMT standard according to an exemplary embodiment of the present invention;
  • FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention; and
  • FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention.
  • Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
  • DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENT
  • The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the exemplary embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
  • The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention is provided for illustration purposes only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
  • It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.
  • Exemplary embodiments of the present invention described below discuss a structure of layers defined in a Motion Picture Experts Group (MPEG) Media Transport (MMT) standard. Further, the exemplary embodiments of the present invention propose to configure a multimedia frame and will describe in detail layers for generating the multimedia frame in a structure of the layers defined by the MMT standard. The multimedia frame denotes a transport frame for an MMT service and a packet of an MMT access unit. The multimedia frame includes a quality of service information related to required transport information.
  • The exemplary embodiments of the present invention describe a construction of header information for configuring the multimedia frame in more detail. A payload of the multimedia frame may be replaced with a configuration of multimedia data having a desired size by fragmenting or combining the multimedia data provided in the unit of a predetermined size in a higher layer.
  • FIG. 2 is a view illustrating a concept of an MMT service by a broadcast system (hereinafter, referred to as an “MMT system”) based on an MMT standard according to an exemplary embodiments of the present invention.
  • Referring to FIG. 2, content for the MMT service may include UHD, Video On Demand (VOD), live streaming, files, widgets, E-books, and metadata. However, the content for the MMT service may include any content that can be expressed in an electrical signal.
  • After multimedia data according to each of the various contents are encapsulated in a predetermined format by an MMT encapsulator, a multimedia frame is configured and the configured multimedia frame is transmitted to a subscriber terminal via a hybrid delivery through a heterogeneous network. The heterogeneous network denotes a network having a transmission environment in which a broadcast network and an IP network coexist.
  • The subscriber terminal receives the multimedia frame transmitted in the hybrid delivery form through the heterogeneous network, extracts multimedia data corresponding to desired content from the multimedia frame, and provides a video/audio/application to a user based on the extracted multimedia data. Each multimedia data corresponding to the video/audio/application provided for a specific content is defined as an “MMT asset”. The subscriber terminal may include any terminal that can support a multimedia service. A representative example of the subscriber terminal may include an IP TV or a smart phone. Accordingly, the MMT service may achieve objects of providing a high quality content delivery, a hybrid content support, and a hybrid network support.
  • FIG. 3 illustrates a structure of layers for transmitting a multimedia frame according to a multi-service/content through a heterogeneous network in an MMT system according to an exemplary embodiment of the present invention.
  • Referring to FIG. 3, seven layers are required for transmitting a configured multimedia frame. The seven layers include a media coding layer 310, an encapsulation layer (hereinafter, referred to as a “Layer E”) 320, a delivery layer (hereinafter, referred to as a “Layer D” or a “Layer T”) 330 or 390, a network layer 340, a data link layer 350, a physical layer 360, and a control layer (hereinafter, referred to as a “Layer C”) 370 and 380.
  • According to exemplary embodiments of the present invention, multimedia data according to a multi-content or a multi-service is generated by the media coding layer 310 and the Layer E 320, so that the two layers may be considered as elements of a “multimedia data generation part”. A multimedia frame is configured by the Layer D 330, so that the Layer D 300 may be considered as an element of a “multimedia frame configuration part”. The Layer D 330 included in the multimedia frame configuration part includes header information containing a frame identifier and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities, and configures a multimedia frame by combining the header information and multimedia data.
  • Technology areas corresponding to three layers among the seven layers are important for the MMT standard. The three technology areas correspond to the Layer E 320, the Layer D 330 and 390, and the Layer C 370 and 380, respectively. The Layer E 320 plays a role of generating hybrid content, the Layer D 330 and 390 plays a role of efficiently transmitting the generated content through a heterogeneous network, and the Layer C 370 and 380 plays a role for a general control in a consumption management and a transmission management of the hybrid content. The Layer E 320 includes an MMT E.3 layer 322, an MMT E.2 layer 324, and an MMT E.1 layer 326. The MMT E.3 layer 322 receives an input of coded multimedia data provided from the media coding layer 310 and generates a data fragment which is the basic unit for the MMT service. The MMT E.2 layer 324 generates an Access Unit (AU) for the MMT service based on the data fragment generated by the MMT E.3 layer 322. The MMT E.1 layer 326 generates a format for generation, storage, and transmission of the hybrid content through a combination or a division of the AUs provided by the MMT E.2 layer 324.
  • The Layer D 330 and 390 includes an MMT D.1 layer 332, an MMT D.2 layer 334, and an MMT D.3 layer 390. The MMT D.1 layer 332 corresponds to an Application Protocol (AP) performing a similar role as the Real-time Transfer Protocol (RTP) or the HyperText Transfer Protocol (HTTP). The MMT D.2 layer 334 corresponds to a network layer protocol performing a similar role as the User Datagram Protocol (UDP) or the Transmission Control Protocol (TCP). The MMT D.3 layer 390 performs an operation for an optimization between respective layers included in the Layer E 320 and respective layers included in the Layer D 330.
  • The Layer C 370 and 380 includes an MMT C.1 layer 370 and a MMT C.2 layer 380. The MMT C.1 layer 370 provides information on generation and consumption of hybrid content and the MMT C.2 layer 380 provides information on transmission of the hybrid content.
  • FIG. 4 is a flowchart in which a multimedia frame is configured and the configured multimedia frame is transmitted in an MMT system according to an exemplary embodiment of the present invention. FIG. 4 defines an operation performed by the MMT D.2 layer 334 included in the Layer D 330 among the layers shown in FIG. 3.
  • Referring to FIG. 4, the MMT D.2 layer 334 receives an input of multimedia data provided from the MMT D.1 layer 332 in step 410. Sufficient multimedia data to provide a hybrid service or hybrid content and an MMT asset for each multimedia data should be provided from the MMT D.1 layer 332.
  • The MMT D.2 layer 334 constructs header information for configuring a multimedia frame in step 412. The header information contains at least a frame identifier distinguishing a multimedia frame and information required for measuring a quality of a connection service between network layers and end-to-end network capabilities. A more detailed description for constructing the header information is provided below.
  • The MMT D.2 layer 334 configures a multimedia frame for a hybrid multimedia service in step 414. A multimedia frame is configured by combining the multimedia data input in step 410 and the header information constructed in step 412. After the multimedia frame is configured, the MMT D.2 334 transmits the configured multimedia frame to a subscriber terminal through a heterogeneous network in step 416.
  • A method of how to configure a multimedia frame (T Frame) by the Layer T2 in charge of transmitting the multimedia frame according to the MMT service proposed in exemplary embodiments of the present invention is described below. For the configuration of the multimedia frame (T Frame), header information to be recorded in a header region and multimedia data to be recorded in a payload region should be defined. Further, Quality of Service (QoS) for the multimedia frame (T Frame) according to exemplary embodiments of the present invention should be guaranteed.
  • In addition, a method should be provided to perform a flow control for the multimedia frame configured according to exemplary embodiments of the present invention. A function provided by an IP protocol should be replaced by means of the flow control and a QoS level according to exemplary embodiments of the present invention.
  • Finally, exemplary embodiments of the present invention should define a procedure in which the Layer T2 exchanges information with other layers and content and a transmission method of information exchanged through the procedure in order to transmit the AU.
  • The header information to be recorded in the header region of the multimedia frame (T Frame) according to exemplary embodiments of the present invention is defined as follows.
  • Table 1 below shows a structure of the multimedia frame.
  • TABLE 1
    Frame Header Payload
  • As shown in Table 1, the multimedia frame has a frame header region and a payload region. The frame header region records header information corresponding to control information required to receive multimedia data according to a hybrid service/content transmitted through the multimedia frame. The payload region records multimedia data according to a hybrid service/content.
  • Table 2 below shows an example of header information recorded in a frame header region included in a multimedia frame.
  • TABLE 2
    Bits 0-15 16-31
     0 Frame ID Length
    32 Flow_Label MAU_Abstraction_
    Information
  • Table 2 shows an example of 64 bit header information. In the header information, a frame identifier is indicated by the first 16 bits (0th-15th bits). A length of a datagram obtained or assembled by multimedia data recorded in the multimedia frame is indicated by the second 16 bits (16th-31st bits). Flow Label is indicated by the third 16 bits (32nd-47th bits), and Media Access Unit (MAU) abstraction information (MAU Abstraction Information) is indicated by the fourth 16 bits (48th-63rd bits).
  • The frame identifier (Frame ID) corresponds to identification information for distinguishing a corresponding multimedia frame (T Frame). For example, when a transmitting side fragments multimedia data and transmits the fragmented multimedia data through a plurality of multimedia frames, the frame identifier (Frame ID) may be used for assembling a plurality of multimedia data through the plurality of multimedia frames by a receiving side.
  • Accordingly, indexes corresponding to an order of transmitted multimedia frames may be used as an example of the frame identifier (Frame ID). In some cases, the frame identifier (Frame ID) is used as an index corresponding to an identifier of an asset or a transmitted multimedia frame.
  • The length (Length) corresponds to a length of a datagram measured in the unit of bytes. The datagram refers to a data packet obtained by multimedia data transmitted through one or a plurality of multimedia frames.
  • For example, one datagram may be transmitted by a payload of one multimedia frame. Alternatively, one datagram may be divided into a plurality of multimedia data blocks, and the divided multimedia data blocks may be transmitted by payloads of different multimedia frames.
  • Accordingly, a receiving side identifies a length of multimedia data recorded in the payload of the received multimedia frame through the length recorded in the header information of the received multimedia frame and then can identify whether the datagram is fragmented. For example, when a length recorded in the header information is the same as a length of multimedia data recorded in the payload, the receiving side considers the multimedia data recorded in the payload as the datagram. When a length recorded in the header information is not the same as a length of multimedia data recorded in the payload, the receiving side assembles the received multimedia data with multimedia data recorded in the payload of the multimedia frame received before or after the received multimedia data and obtains a datagram having a length recorded in the header information.
  • A plurality of datagrams may be included within a payload of one multimedia frame. In this case, multimedia data corresponding to a plurality of services or contents recorded in one payload are separated from each other and an independent datagram is obtained only by the separated multimedia data or may be obtained by a combination of the separated multimedia data and multimedia data received before or to be received after the separated multimedia data in consideration of the length recorded in the header information.
  • The Flow_Label identifies a specific QoS required for each flow. For example, the Flow_Label may be used as a field for identifying the MAU. When the Flow_Label is used as a field for identifying the MAU, 8 bits for indicating the Flow_Label may be defined as shown in Tables 3 to 7 below.
  • A bit rate, which may be expressed by the first 3 bits (1th-3rd bits), is defined in Table 3 below. A degree of delay, which may be expressed by the next one bit (4th bit), is defined in Table 4 below. A throughput, which may be expressed by the next one bit (5th bit), is defined in Table 5 below. A synchronization expressed by the next one bit (6th bit), which is a relation with another multimedia frame, is defined in Table 6 below. The last 2 bits (7th-8th bits) may be used as reserved bits, as shown in Table 7 below.
  • TABLE 3
    Bits
    0-2 Bit rate
    111 Constant Bit Rate
    (CBR)
    110 Real-Time Variable
    Bit Rate (RT-VBR)
    101 Non-Real-Time
    Variable Bit
    Rate (NRT-VBR)
    100 Available Bit Rate
    (ABR)
    011 Unspecified Bit
    Rate (UBR)
    010 Reserved
    001 Reserved
    000 Reserved
  • TABLE 4
    bit 3 Delay
    0 Normal delay
    1 Low delay
  • TABLE 5
    Bit 4 Throughput
    0 Normal throughput
    1 High throughput
  • TABLE 6
    Bit 5 Synchronization
    0 no relationship
    1 relationship with
    another T-frame
  • TABLE 7
    bits 6-7 Reserved for future use
  • The MAU_Abstraction_Information provides abstract information for accessing flexible and efficient mechanism of a service class. For example, a set of parameters defined by the MAU_Abtraction_Information is negotiated when a connection is configured within a network. The parameters are used to measure QoS of a connection between network layers and end-to-end network capabilities. Accordingly, in the network, QoS should be guaranteed by the negotiation by satisfying a specific value of the parameters defined by the MAU_Abtraction_Information.
  • For example, the parameters defined by the MAU_Abstraction_Information may include Delay (range) and an AU loss rate (%). The Delay (range) denotes a maximum end-to-end delay time for a transmission of a multimedia frame and the AU loss rate (5) denotes an Access Unit Loss Ratio (AULR). A percentage of the AU denotes an allowed loss.
  • For example, when 5 bits are used for the MAU_Abstraction_Information, the Delay (range) is defined by the first 3 bits (1th-3rd bits) and the AU loss rate (%) is defined by the next 2 bits (4th-5th bits).
  • Table 8 below defines the Delay (range), which is the maximum end-to-end delay time as defined above.
  • TABLE 8
    Bit
    0-2 Delay
    111 500 ms
    110  1 sec
    101  5 sec
    100 10 sec
    011 unlimited
    010
    001
    000
  • Table 9 below defines the AU loss rate (5), which is the AULR as defined above.
  • TABLE 9
    Bit
    3-4 AULR
    111  0%
    110 10%
    101 20%
    100 30%
    011 50%
    010 not
    specified
    001
    000
  • In the foregoing description, the structure of the multimedia frame and examples of the definition and the construction of the header information recorded in the header region included in the multimedia frame have been described, respectively.
  • Hereinafter, it will be described that the MMT D.2 layer communicates with the MMT D.1 layer or the MMT C.2 layer based on an Application Program Interface (API) or a Type-Length-Value (TLV) for exemplary embodiments of the present invention.
  • First, referring to communication with the MMT D.1 layer, the MMT D.1 layer provides the ME D.2 layer with multimedia data in a predetermined unit, which is the AU. The MMT D.1 layer provides the MMT D.2 layer with characteristics of the AU for guaranteeing the setting in the configuration of the multimedia frame and the QoS in the transmission of the multimedia frame by the MMT D.2 layer.
  • The MMT C.2 layer configures a multimedia frame and performs communication for providing the MMT D.2 layer with control information required for a transmission of the multimedia frame. For example, the MMT C.2 layer provides the MMT D.2 layer with Session Management Information (SMI), Session Monitoring Information (SMI), and Error Control Information (ECI) through communication with the MMT D.2 layer.
  • The MMT D.2 layer receives the session management information from the MMT C.2 layer in order to manage a session control. At this time, the session management information contains an adaptive delivery and a change delivery path. For example, the MMT D.2 layer manages a transport related to properties of a bit rate, a delay time, and a loss rate based on the session management information provided by the MMT C.2 layer. The MMT D.2 layer exchanges the session management information with the MMT C.2 layer in order to support a management as described above. A server may modify a transmission path to a client based on a re-negotiation configuration or a session modification message, which is requested by a client, transmitted to the server.
  • The MMT D.2 layer receives session monitoring (feedback) information from the MMT C.2 layer in order to monitor a session. For example, the MMT D.2 layer may provide information for a session monitoring through the Flow_Label and the MAU_Abtration_Information. Information on the delay time and the loss rate may be used as parameters for monitoring.
  • The MMT C.2 layer may make a request for a Forward Error Correction (FEC) or a retransmission such as an error control from the MMT D.2 layer. The MMT D.2 layer may configure a multimedia frame such that the MMT D.2 layer supports the error correction or the error control when a request for the error correction or the error control is made from the MMT C.2 layer.
  • While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.

Claims (4)

What is claimed is:
1. A method of receiving a frame in a broadcast system, the method comprising:
receiving a frame from a server over a heterogenous network based on a motion picture experts group (MPEG) media transport (MMT) protocol,
wherein the frame comprises header information and multimedia data,
wherein the header information includes type information and delay sensitivity information in case that when the generated frame supports quality of service (QoS),
wherein the type information identifies whether a bit rate is constant or not, and the delay sensitivity information indicates a delay sensitivity of the multimedia data, and
wherein the type information and the delay sensitivity information are used for flow control over the heterogeneous network.
2. The method as claimed in claim 1, wherein a flow for receiving the frame is controlled based on the type information and a flag included in the header information.
3. The method as claimed in claim 1, wherein the header information further comprises a flow label indicating a QoS requested for each flow.
4. The method as claimed in claim 1, wherein the header information further comprises information about segmentation or combination of the multimedia data.
US16/878,066 2011-01-19 2020-05-19 Apparatus and method for transmitting multimedia frame in broadcast system Abandoned US20200280747A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/878,066 US20200280747A1 (en) 2011-01-19 2020-05-19 Apparatus and method for transmitting multimedia frame in broadcast system

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
KR10-2011-0005650 2011-01-19
KR20110005650A KR20120084234A (en) 2011-01-19 2011-01-19 Method for delivering mmt access unit for mpeg media transport
US13/353,502 US8544052B2 (en) 2011-01-19 2012-01-19 Apparatus and method for transmitting multimedia frame in broadcast system
US13/973,241 US9009347B2 (en) 2011-01-19 2013-08-22 Apparatus and method for transmitting multimedia frame in broadcast system
US14/684,808 US10694230B2 (en) 2011-01-19 2015-04-13 Apparatus and method for transmitting multimedia frame in broadcast system
US16/878,066 US20200280747A1 (en) 2011-01-19 2020-05-19 Apparatus and method for transmitting multimedia frame in broadcast system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/684,808 Continuation US10694230B2 (en) 2011-01-19 2015-04-13 Apparatus and method for transmitting multimedia frame in broadcast system

Publications (1)

Publication Number Publication Date
US20200280747A1 true US20200280747A1 (en) 2020-09-03

Family

ID=46491757

Family Applications (4)

Application Number Title Priority Date Filing Date
US13/353,502 Active 2032-03-23 US8544052B2 (en) 2011-01-19 2012-01-19 Apparatus and method for transmitting multimedia frame in broadcast system
US13/973,241 Active US9009347B2 (en) 2011-01-19 2013-08-22 Apparatus and method for transmitting multimedia frame in broadcast system
US14/684,808 Active US10694230B2 (en) 2011-01-19 2015-04-13 Apparatus and method for transmitting multimedia frame in broadcast system
US16/878,066 Abandoned US20200280747A1 (en) 2011-01-19 2020-05-19 Apparatus and method for transmitting multimedia frame in broadcast system

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US13/353,502 Active 2032-03-23 US8544052B2 (en) 2011-01-19 2012-01-19 Apparatus and method for transmitting multimedia frame in broadcast system
US13/973,241 Active US9009347B2 (en) 2011-01-19 2013-08-22 Apparatus and method for transmitting multimedia frame in broadcast system
US14/684,808 Active US10694230B2 (en) 2011-01-19 2015-04-13 Apparatus and method for transmitting multimedia frame in broadcast system

Country Status (6)

Country Link
US (4) US8544052B2 (en)
EP (1) EP2666302A4 (en)
JP (2) JP6054305B2 (en)
KR (5) KR20120084234A (en)
AU (1) AU2012207725B2 (en)
WO (1) WO2012099429A2 (en)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120084234A (en) * 2011-01-19 2012-07-27 삼성전자주식회사 Method for delivering mmt access unit for mpeg media transport
JP2015503281A (en) * 2011-11-23 2015-01-29 エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute Method and apparatus for a streaming service providing scalability and view information
WO2013108954A1 (en) * 2012-01-20 2013-07-25 전자부품연구원 Method for transmitting and receiving program configuration information for scalable ultra high definition video service in hybrid transmission environment, and method and apparatus for effectively transmitting scalar layer information
US20140344875A1 (en) * 2012-01-20 2014-11-20 Electronics And Telecommunications Research Institute Method for transmitting media data having access unit divided into media fragment units in heterogeneous network
JP5661206B2 (en) * 2012-01-31 2015-01-28 シャープ株式会社 GENERATION DEVICE, REPRODUCTION DEVICE, DATA STRUCTURE, GENERATION METHOD, REPRODUCTION METHOD, CONTROL PROGRAM, AND RECORDING MEDIUM
KR20130108198A (en) * 2012-03-23 2013-10-02 (주)휴맥스 Method of hybrid delievery for mmt packaged svc video contents and method of recieving
US9544641B2 (en) * 2012-05-10 2017-01-10 Humax Co., Ltd. Hybrid transmission method through MMT packet format extension
US10356143B2 (en) 2012-10-10 2019-07-16 Samsung Electronics Co., Ltd. Method and apparatus for media data delivery control
KR102048480B1 (en) * 2012-10-11 2020-01-08 삼성전자주식회사 Apparatus and method for transmitting transport characteristics of multimedia data in dynamic network environment
KR102163338B1 (en) * 2012-10-11 2020-10-08 삼성전자주식회사 Apparatus and method for transmitting and receiving packet in a broadcasting and communication system
KR102056438B1 (en) 2012-10-12 2019-12-16 삼성전자주식회사 Method and apparatus for transceiving data packet for transmitting and receiving multimedia data
US11290510B2 (en) * 2012-11-29 2022-03-29 Samsung Electronics Co., Ltd. Method and apparatus for encapsulation of motion picture experts group media transport assets in international organization for standardization base media files
US9236932B2 (en) * 2013-03-11 2016-01-12 Nagravision S.A. Configuration method of a multimedia system
JP5641090B2 (en) 2013-03-14 2014-12-17 ソニー株式会社 Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
KR102107514B1 (en) * 2013-04-18 2020-05-07 삼성전자주식회사 Method and apparatus for managing dynamic que in broadcasting system
KR101484843B1 (en) 2013-04-19 2015-01-20 삼성전자주식회사 A method and apparatus for transmitting a media transport packet in a multimedia transport system
KR102148158B1 (en) 2013-04-23 2020-08-28 삼성전자주식회사 Method and apparatus for transmitting/receiving packet in a communication system
BR112015030043B1 (en) * 2013-06-07 2023-01-10 Sony Corporation TRANSMISSION AND PROCESSING DEVICE, AND, TRANSMISSION METHOD OF A CONTINUOUS TRANSMISSION FLOW
US10104406B2 (en) * 2013-06-21 2018-10-16 Saturn Licensing Llc Transmission apparatus, transmission method, reproduction apparatus, reproduction method and reception apparatus
KR102191970B1 (en) * 2013-12-31 2020-12-17 삼성전자주식회사 Apparatus and Method for Transmitting Data
US9729903B2 (en) 2013-12-31 2017-08-08 Samsung Electronics Co., Ltd. Data transmitting device and method
ES2885548T3 (en) * 2014-08-07 2021-12-14 Sony Group Corp Transmission device, transmission method and receiving device
WO2016117904A1 (en) * 2015-01-21 2016-07-28 엘지전자 주식회사 Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method
KR101743441B1 (en) 2015-02-13 2017-06-05 에스케이텔레콤 주식회사 Method for providing streaming data through node linking with base station, and node using the same
JP6729379B2 (en) * 2015-07-01 2020-07-22 ソニー株式会社 Transmitting apparatus and transmitting method, and receiving apparatus and receiving method
JP6178370B2 (en) * 2015-09-09 2017-08-09 株式会社メディアリンクス Video transmission system and video receiver
CN108141636B (en) * 2015-10-07 2021-03-23 松下知识产权经营株式会社 Receiving apparatus and receiving method
US10750217B2 (en) * 2016-03-21 2020-08-18 Lg Electronics Inc. Broadcast signal transmitting/receiving device and method
FR3070566B1 (en) * 2017-08-30 2020-09-04 Sagemcom Broadband Sas PROCESS FOR RECOVERING A TARGET FILE OF AN OPERATING SOFTWARE AND DEVICE FOR USE
US11606528B2 (en) * 2018-01-03 2023-03-14 Saturn Licensing Llc Advanced television systems committee (ATSC) 3.0 latency-free display of content attribute
US11463747B2 (en) * 2018-04-05 2022-10-04 Tvu Networks Corporation Systems and methods for real time control of a remote video production with multiple streams
US10966001B2 (en) 2018-04-05 2021-03-30 Tvu Networks Corporation Remote cloud-based video production system in an environment where there is network delay
US10673957B2 (en) * 2018-06-28 2020-06-02 At&T Intellectual Property I, L.P. Providing high availability in a software defined network
US12081822B2 (en) * 2020-01-08 2024-09-03 Arris Enterprises Llc Service switching for content output
EP3908006A3 (en) * 2020-05-01 2022-01-26 TVU Networks Corporation Systems and methods for real time control of a remote video production with multiple streams
GB2598701B (en) * 2020-05-25 2023-01-25 V Nova Int Ltd Wireless data communication system and method
KR20220130394A (en) * 2021-03-18 2022-09-27 삼성전자주식회사 An electronic device for transmitting multiple media streams and a method of the same
CN113709510A (en) * 2021-08-06 2021-11-26 联想(北京)有限公司 High-speed data real-time transmission method and device, equipment and storage medium

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0637797A (en) * 1992-05-20 1994-02-10 Xerox Corp Reserved ring mechanism of packet exchange network
US6751221B1 (en) * 1996-10-04 2004-06-15 Kabushiki Kaisha Toshiba Data transmitting node and network inter-connection node suitable for home network environment
US5905872A (en) * 1996-11-05 1999-05-18 At&T Corp. Method of transferring connection management information in world wideweb requests and responses
US6839330B1 (en) * 1997-07-15 2005-01-04 Viasat, Inc. Method and apparatus for improving asynchronous transfer mode operation over noisy, high speed wireless links
JP3447207B2 (en) * 1997-12-05 2003-09-16 松下電器産業株式会社 Program information creation transmission apparatus and method
GB9814412D0 (en) * 1998-07-03 1998-09-02 Northern Telecom Ltd Communications method and apparatus
EP0975123A1 (en) * 1998-07-15 2000-01-26 Telefonaktiebolaget L M Ericsson (Publ) Communication device and method for reliable and low-delay packet transmission
JP2000059370A (en) * 1998-08-04 2000-02-25 Fujitsu Ltd Device and method for controlling traffic
US6449588B1 (en) * 1999-06-02 2002-09-10 Accenture Llp Customer-driven QOS in hybrid communication system
DE10102159C2 (en) * 2001-01-18 2002-12-12 Fraunhofer Ges Forschung Method and device for generating or decoding a scalable data stream taking into account a bit savings bank, encoder and scalable encoder
US7515616B2 (en) * 2001-11-24 2009-04-07 Lg Electronics Inc. Packet transmission scheduling technique
US6789123B2 (en) * 2001-12-28 2004-09-07 Microsoft Corporation System and method for delivery of dynamically scalable audio/video content over a network
US20040181811A1 (en) * 2003-03-13 2004-09-16 Rakib Selim Shlomo Thin DOCSIS in-band management for interactive HFC service delivery
JP2004363841A (en) * 2003-06-04 2004-12-24 Hitachi Ltd Packet transmitting device, packet receiving device, packet transfer device, and packet transmitting/receiving device
JP4188774B2 (en) 2003-08-14 2008-11-26 株式会社エヌ・ティ・ティ・ドコモ Frame transmission / reception system, frame transmission apparatus, frame reception apparatus, and frame transmission / reception method
KR20050044207A (en) * 2003-11-07 2005-05-12 엘지전자 주식회사 Method for measuring quality of service of wireless internet multimedia
US7460468B2 (en) * 2004-04-22 2008-12-02 At&T Intellectual Property I, L.P. Method and system for automatically tracking the rerouting of logical circuit data in a data network
KR20060114080A (en) * 2005-04-27 2006-11-06 삼성전자주식회사 System and method of providing multimedia streaming service
US7509021B2 (en) 2005-06-27 2009-03-24 Streaming Networks (Pvt.) Ltd. Method and system for providing instant replay
US7969997B1 (en) * 2005-11-04 2011-06-28 The Board Of Trustees Of The Leland Stanford Junior University Video communications in a peer-to-peer network
US8077707B2 (en) * 2005-11-18 2011-12-13 Sri International Systems and methods for digital stream denting
KR20070078238A (en) * 2006-01-26 2007-07-31 에스케이 텔레콤주식회사 Multimedia contents transmitting method and system in communication network
EP1845685B1 (en) * 2006-04-11 2012-06-27 Alcatel Lucent Optimised transmission of content IP packets by adding to the IP packets content-related information
US7895635B2 (en) * 2006-06-30 2011-02-22 Versteeg William C Systems and methods of assembling an elementary stream from an encapsulated multimedia transport stream
US8948206B2 (en) 2006-08-31 2015-02-03 Telefonaktiebolaget Lm Ericsson (Publ) Inclusion of quality of service indication in header compression channel
US8630312B2 (en) * 2006-12-04 2014-01-14 Samsung Electronics Company, Ltd. System and method for wireless communication of uncompressed video having connection control protocol
JP5026167B2 (en) * 2007-07-02 2012-09-12 パナソニック株式会社 Stream transmission server and stream transmission system
KR100929774B1 (en) * 2007-11-14 2009-12-03 한국전자통신연구원 Cable Modem Initialization Technique and Apparatus Using Queue-length-Based Band Request Frame in Optical-Coaxial Networks
KR100986990B1 (en) * 2008-09-30 2010-10-11 전자부품연구원 Apparatus and method for processing multi-protocol digital mobile broadcasting streams
KR101354130B1 (en) * 2008-12-22 2014-01-24 한국전자통신연구원 Method for transmitting and receiving the frame in wireless LAN
US8009567B2 (en) 2009-02-05 2011-08-30 Cisco Technology, Inc. System and method for improved data transmission reliability over a network
EP2529528B1 (en) * 2010-01-28 2018-01-10 Thomson Licensing A method and apparatus for parsing a network abstraction-layer for reliable data communication
US8650604B2 (en) * 2010-10-27 2014-02-11 Samsung Electronics Co., Ltd. Method and system for synchronization of audio/video (A/V) stream format change in wireless communication systems
KR20120084234A (en) * 2011-01-19 2012-07-27 삼성전자주식회사 Method for delivering mmt access unit for mpeg media transport
KR20120138604A (en) 2011-06-14 2012-12-26 삼성전자주식회사 Method and apparatus for transmitting/receiving hybrid media content in a multimedia system
KR101484843B1 (en) 2013-04-19 2015-01-20 삼성전자주식회사 A method and apparatus for transmitting a media transport packet in a multimedia transport system

Also Published As

Publication number Publication date
KR101855484B1 (en) 2018-05-09
KR20120084234A (en) 2012-07-27
US20120185907A1 (en) 2012-07-19
KR20190086038A (en) 2019-07-19
KR101964419B1 (en) 2019-04-01
CN103329555A (en) 2013-09-25
AU2012207725A1 (en) 2013-08-15
JP2017073813A (en) 2017-04-13
AU2012207725B2 (en) 2016-03-24
US20130336325A1 (en) 2013-12-19
US8544052B2 (en) 2013-09-24
JP2014507879A (en) 2014-03-27
WO2012099429A2 (en) 2012-07-26
KR20180050763A (en) 2018-05-15
EP2666302A2 (en) 2013-11-27
JP6054305B2 (en) 2016-12-27
KR20140009315A (en) 2014-01-22
EP2666302A4 (en) 2014-12-31
KR102028430B1 (en) 2019-10-04
US20150222936A1 (en) 2015-08-06
WO2012099429A3 (en) 2012-11-29
KR102000260B1 (en) 2019-07-16
US10694230B2 (en) 2020-06-23
KR20190035954A (en) 2019-04-03
US9009347B2 (en) 2015-04-14

Similar Documents

Publication Publication Date Title
US20200280747A1 (en) Apparatus and method for transmitting multimedia frame in broadcast system
JP7212102B2 (en) Method for transmitting packets in multimedia transmission system
US11196786B2 (en) Interface apparatus and method for transmitting and receiving media data
US11381625B2 (en) Apparatus and method for transmitting multimedia data in hybrid network
KR101955690B1 (en) Apparatus and method for delivering multimedia data in hybrid network
KR101855327B1 (en) Apparatus and method for delivering multimedia data in hybrid network
KR20190021300A (en) Apparatus and method for delivering multimedia data in hybrid network

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION