KR101482099B1 - Method and apparatus for encoding/decoding Multi-media data - Google Patents

Abstract

The present invention relates to a method and an apparatus for encoding / decoding multimedia data including video, audio and image data, and a decoding method thereof includes a media data area including a video data area, an audio data area, and an image data area; A media information area including a plurality of track areas corresponding to each of a plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area; Displaying a menu using menu information; And extracting and decoding the media data corresponding to the user input using the menu among the media data included in the media data area, wherein the slide show track area corresponding to the image data area includes a plurality of The present invention is characterized by including timing information for constructing a slide show using images, and constituting a single file of a media data area, a media information area, and a menu description area.

According to the method and apparatus for encoding / decoding multimedia data according to the present invention, a plurality of media contents including a video content and a user interface for managing a plurality of media contents are constituted by one file so that only a small amount of data It is possible to efficiently manage and reproduce a plurality of media contents. Thereby reducing processing and transmission time of multimedia data.

Description

[0001] The present invention relates to a method and apparatus for encoding / decoding multi-media data,

The present invention relates to a method and apparatus for encoding / decoding multimedia data including video data, audio data, image data, and the like. More particularly, the present invention relates to a method and apparatus for encoding / And more particularly, to a coding / decoding method and apparatus for efficiently managing and reproducing multimedia data.

In multimedia data processing methods for integrating, encoding, and decoding various types of media data such as video, audio, image, and text data, the amount of data consumed is very large and the time consumed for encoding / decoding and the time consumed for data transmission There is a problem that it is difficult to integrate and manage many media contents as described above.

According to an aspect of the present invention, there is provided a multimedia data structure capable of effectively managing and encoding / decoding a plurality of media contents including video contents, and a method and an apparatus for encoding / decoding multimedia data using the multimedia data structure There is.

According to an aspect of the present invention, there is provided a decoding method comprising: a media data area including a video data area, an audio data area, and an image data area; A media information area including a plurality of track areas corresponding to each of the plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area, the method comprising: receiving multimedia data; Displaying a menu using the menu information; And extracting and decoding the media data corresponding to a user input using the menu among the media data included in the media data area, wherein the slide show track area corresponding to the image data area includes: And timing information for constructing a slide show using a plurality of included images, wherein the media data area, the media information area, and the menu description area constitute one file.

According to an aspect of the present invention, there is provided an encoding method comprising: generating a media data area including a video data area, an audio data area, and an image data area; Generating a media information area including a plurality of track areas corresponding to each of the plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area.

According to an aspect of the present invention, there is provided a decoding apparatus comprising: a media data area including a video data area, an audio data area, and an image data area; A media information area including a plurality of track areas corresponding to each of the plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area; A first decoding unit decoding the menu information to display a menu; And a second decoding unit for extracting and decoding the media data corresponding to the user input using the menu among the media data included in the media data area.

According to an aspect of the present invention, there is provided an encoding apparatus comprising: a multimedia track generation unit for generating a plurality of track areas corresponding to a video data area, an audio data area, and an image data area; A menu description area creating unit for creating a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area; And a file structure generation unit that configures the plurality of track areas and the menu description area as one multimedia data file.

The multimedia data having the above structure can be included in a digital broadcasting signal and can be transmitted through digital media.

According to the method and apparatus for encoding / decoding multimedia data according to the present invention, a plurality of media contents and a user interface for managing the plurality of media contents are constituted by one file, and a plurality of media contents Can be efficiently managed and reproduced. Thereby reducing processing and transmission time of multimedia data.

Hereinafter, a method and apparatus for encoding / decoding multimedia data according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 schematically shows the overall structure of multimedia data according to the present invention. As shown in FIG. 1, a multimedia data file may include a file type area, a file meta area, a media information area, and a media data area. have.

The file type field indicates the format of the multimedia data file and can be expressed in the form or version of the file. For example, if the file type is "mp42 ", it can indicate that the multimedia file format is the MPEG-4 version 2 format.

The media data area includes a plurality of media data areas, and may include, for example, a video data area and an audio data area as shown in FIG. 1, and each of the media data areas includes media data.

The media data area may further include a plurality of areas including text data or image data in addition to the video data area and the audio data area. In addition, the video data area may store data including a plurality of video contents, and the audio data area may store data including a plurality of audio contents.

The media information area includes track areas corresponding to a plurality of data areas included in the media data area, and each of the plurality of track areas includes information on media data included in the corresponding data area, for example, And temporal and spatial information of the media data.

Referring to FIG. 1, the media information area may include a video track area corresponding to the video data area and an audio track area corresponding to the audio track area.

The video track area includes time information of video data included in the video data area, spatial information or meta information about the video data, for example, title of video content included in the video data, information.

The audio track area may include time information of audio data included in the audio data area, spatial information, or meta information about the audio data, for example, a title, a composer, an artist, Can include the authoring information ff.

The time information and the spatial information included in the track area may be playback period information, position information, or size information of the corresponding media data.

The file meta area may include an identification / location information area and a menu description area.

The identification / position information area may include information about an attribute for distinguishing a plurality of media data included in the media data area. For example, the identification / position information area may include identification information and position information of each of the plurality of media data .

The identification / position information area may include a name, content type information, ID, position information, size information, and the like for each of the plurality of media data.

The following is an example of the information included in the identification / position information area, in which one video content and two audio contents are included in the media data area.

item_ID = 1 (video 1)

item_name = <rel. uri to video 1>

content_type = video

item_ID = 2 (audio 1)

item_name = <rel. uri to audio 1>

content_type = audio

item_ID = 3 (audio 2)

item_name = <rel. uri to audio 2>

content_type = audio

The item_ID is an identification number assigned to each of the media contents, item_name is a name of each of the media contents, and content_type is a kind of each of the media contents.

Also, the identification / position information area includes a first area and a second area, and the first and second areas may divide information on attributes of the media data. For example, the first area may include a name and a content type of each of the media contents included in the media data area, and the second area may include information on the physical location and size of the media contents.

The handler type of the file meta area can be designated as "lsr1 ".

Referring to FIG. 1, a menu description area includes a menu description having information for displaying a menu providing an interface between a user and media data. In order to provide the user with a more interesting and convenient interface, the animation effect is preferably applied to the menu.

The menu may display a plurality of media contents included in the media data area, and may provide input means for allowing a user to select a medium to be played out of the plurality of contents. The user can recognize the multimedia contents included in the media data area using the menu, and manage the multimedia contents.

The menu descriptor included in the menu description area and the media data included in the media data area may be connected using information included in the identification / position information area.

FIG. 2 illustrates an embodiment of the menu.

Referring to FIG. 2, the menu may include a background image 10 and one or more input means 20, 21, 22, 23 displayed on the background image 10.

An animation effect is applied to the background image 10 so that the change of the menu background image can be smoothly and interestingly displayed. For example, if there is a user input using the input means 20, 21, 22, 23, an animation effect is applied to the background image 10 to change the background image 10 according to the user input .

The image data used as the background image 10 may be stored in the media data area.

The user can select any one of the input means 20, 21, 22, and 23 through a mouse click or a key input to manage a plurality of media contents included in the media data area.

For example, the user can select a content list 21 to view a list of a plurality of media contents included in the media data area, select a content to be reproduced among them, select the reproduction 20, Can be reproduced.

In addition, the user can select chapters 22 to identify divided chapters of the media content, and can select any of the chapters. Then, the user can select the summary 23 to grasp the brief contents of the media content.

Since the input means 20, 21, 22, and 23 shown in FIG. 2 are merely an embodiment of the menu composition method according to the present invention, the menu may include, in addition to the input means shown in FIG. 2, Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt;

The text data necessary for composing the menu may be directly included in the menu descriptor, or may be stored in the media data area.

The menu descriptor includes information about graphics, which are visual elements displayed in the menu, information about a spatial layout of the visual elements, a temporal layout of media data to be displayed in the menu, for example, information for synchronizing the media data, information about animation effects to be applied to the menu, and interactive events between the user and the menu, such as mouse clicks or keystrokes, Information.

The menu descriptor may use a language such as Light-weigh Application Scene Representation (LASeR), Scalable Vector Graphics (SVG), or Binary Format for Scene (BIFS). The LASeR, SVG, or BIFS may be implemented in XML (extensible Mark-up Language) format or Binary encoded format.

The following is an embodiment of the menu descriptor described using LASeR.

<lsru: NewScene>

    <svg width = "400" height = "250" viewBox = "0 0 400 250">

<! - Main menu ->

<g id = "title_page" visibility = "visible">

<! - Background image ->

width = &quot; 400 " height = " 250 "x =" 0 " y = "0 " /> &lt; image id =" title_image "xlink: href =

<! - Menu options ->

"rect" = "10" y = "109" width = "100" height = "15" rx = "8" fill = "rgb

size = "12" fill = "white"> <text id = "play_btn" x = "20" y =

play </ text>

...

</ g>

<! - Video playback ->

<g id = "video_playback" visibility = "hidden">

<video xlink: href = "# item_ID_of_video" begin = "play_ btn.click" type = "video / mpeg" ...>

<audio xlink: href = "# item_ID_of_audio" begin = "play_bt n.click" type = "audio / mpeg" ...>

<a xlink:href="#item_ID_of_text" begin="play_bt n.click" type="text/3gpp" ...>

</ g>

...

</ svg>

</ lsru: NewScene>

The menu descriptor may include a plurality of elements for describing graphics, animation effects, spatial layout, temporal layout, and information about events between a user and a menu as described above.

For example, the menu descriptor may include elements for graphics, text, images for display, elements for multimedia data, animation effects to be applied to a menu, displayed on a menu have.

The information on the animation effect included in the menu descriptor may include grouping information of the animation effect, size information of the media data to which the animation is applied, opacity effect information, and geometric transformation effect information. The grouping information is information indicating a combination of animation effects to be applied to a menu, and the size information is information describing a change in size of an image.

The opacity effect information means information describing a fade-in or fade-out effect of the image. In addition, the geometric transformation information may be information describing effects such as transition between images, scale transformation of images, rotation, skew, and the like.

The animation area may include information on a motion path of an image or information on a motion path of objects included in the image, and may include color change information or shape information of an image. The shape information of the image may be a rectangle, a circle, an ellipse, a line, a polyline, a polygon, or the like. In addition, the animation area may include attribute control information for changing attributes of the media data for various animation effects applicable to the media data.

The following describes the opacity effect information, the scale conversion information, and the size conversion information as examples of the animation information included in the menu descriptor.

<lsru: NewScene>

<svg>

<g id = "Article_Image">

<animate attributeName = "opacity" calcmode = "linear"

values = "0.00: 1.00: 1.00: 1.00: 1.00: 1.00: 1.00: 1.00"

dur = "8.0" repeatDur = "indefinite" />

<animate Transform attributeName = "Transform" type = "scale" additive = "sum" calcmode = "linear"

values = "1.00 1.00: 1.00 1.00: 1.00 1.00: 1.00 1.00: 0.50 1.00: 0.00 1.00: 1.00 1.00 &

dur = "8.0" repeatDur = "indefinite" />

<image width = "200" height = "15-" #sampleID = 1>

</ image>

</ g>

</ svg>

</ lsru: NewScene>

The symbol (<) means start and the symbol (>) means end. The symbol (/) means the end of the context to be defined. For example, if <svg> through </ svg> are a bundle and <g id = "Article_image"> through </ g> are a bundle, then <image width = "200" height = "150" # sample = 1> to </ image>. In the <g id = "Article_image">, "g" represents the group, Article_iamge represents the name of the group (g), "opacity" and "transform" are the names of the animation attributes or animation effects, . A symbol (sum) means to represent the animation properties together. The symbol dur indicates information on the reproduction interval of the image data, and the symbol infinite is not defined.

When the image data is regarded as one sample, the size of the image to be implemented by the image data (# sampleID = 1) having the identification number (ID) of '1' is 200 in width and 150 in height to be. Then, the transparency of the image data (# sampleID = 1) is changed from full transparency (value = 0.00) to linear (value = 1.00) linearly (calcMode = ) Repeatedly (repeatDur = "indefinite"). Further, the size change ("transform", "scale") of the image data (#sampleID = 1) is set to half the size of the image (value = y; x = 1.00; 0.50) in the horizontal direction from the original image size (RepeatDur = "indefinite") for 8 seconds (dur = "8.0") in a linear (calcMode- "linear") manner. Further, it is described that the two animation effects are performed together (additive = "sum").

The image data consisting of one or more samples is divided into chunks, and the samples in each chunk can be arranged in chronological order. At this time, each sample included in the chunk has its own unique identification number (ID), and the unique identification number (ID) of each sample can be assigned from '1'. In this case, the image data (# sampleID = 1) having a unique identification number (ID) of '1' represents its sample, not the data itself.

3, the video data area and the audio data area may each include a plurality of media contents, and the video track area and the audio track area may include track areas corresponding to each of the plurality of media contents .

That is, the video data area includes data corresponding to N video contents, such as main feature, making of clips, actor interviews, or image galleries. And the video track area may include N video track areas corresponding to each of the N video contents.

In addition, the audio data area includes data corresponding to M audio contents, and the audio track area may include M audio track areas corresponding to each of the M audio contents.

Each of the N video track areas and M audio track areas may include temporal information, spatial information, or meta information for the corresponding media content.

Referring to FIG. 4, the media information area may include a media meta area or a track meta area including metadata about a plurality of media contents included in the media data area. As shown in FIG. 4, the media meta area is included in the media data area at the same level as the video track area and the audio track area, and the track meta area may be included in the track area.

The metadata may be used to provide the user with additional information about the media content.

The metadata may include creation information about the media contents, summary information about the contents of the media contents, usage histories information of the user's access to the media contents, etc. . &Lt; / RTI &gt;

The creation information includes at least one of a title, a created artist, a clip description, a comment of a user, or a date / time when the media content is included in the multimedia data file, (File date / time). In addition to the above-described information, the creation information may variously include attribute information related to generation of the media contents, such as a performer of a video content, a creation date, a number of audio contents, information on a player, and the like.

The creation information may be included in the media meta area or may be included in the track meta area in the track area. For example, the authoring information on the entire video contents included in the video data area may be included in the media meta area, and the authoring information on each of the video contents may be included in the corresponding video track area.

More specifically, the title of the movie included in the multimedia data file or the information about the author is included in the media meta area, and the title or author information of each of the plurality of video contents included in the movie corresponds thereto Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt;

Generation information for the audio content included in the audio data area may also be included in the media meta area or the track meta area in the audio track area corresponding thereto.

The media data included in the media data area may be hierarchically classified according to a predetermined criterion and the metadata may include summary data including summary grouping information on the classified media data, meta data).

The user can easily grasp and search media data included in the media data area using the summary metadata. Hierarchical grouping information included in the summary metadata for that may be displayed on the displayed menu.

Preferably, the summary metadata are included in the media meta area, and the summary summary information on each of the media contents in the summary metadata may be included in the track meta area corresponding thereto.

The video content included in the video data area may be divided into a plurality of chapters, and the summary metadata may include chapter information on the plurality of chapters. For example, the summary metadata may include summary information on each of the chapters of the video content, information on scenes belonging to the chapter, information on representative scene or representative image per chapter, and the like.

FIG. 5 illustrates an embodiment of the configuration of the chapter information.

Referring to FIG. 5, video contents including L scenes can be classified into K chapters according to the contents of each scene. Each of the L scenes has summary information on its contents, and the L scenes can be classified into K chapters according to the summary information of the scenes.

The summary metadata includes information on the number K of sorted chapters, the position in the index and video data, the summary contents of each chapter, the indexes of the scenes belonging to the respective chapters, and the summary contents of the respective scenes, As shown in FIG.

The user can grasp the approximate contents of the video contents without viewing the entire video contents by using the chapter information displayed on the menu and thereby can easily retrieve and reproduce the portion or information to be viewed of the video contents .

In FIG. 5, a plurality of scenes belonging to a video content are classified into chapters of one layer, but chapters may be classified using two or more layers. That is, two or more chapters of the K chapters shown in FIG. 5 can be re-grouped into one upper chapter, and in this case, the information on the re-grouping can be included in the summary metadata as the chapter information.

The plurality of video contents included in the video data area may be classified into a plurality of groups according to respective topics, and the summary metadata may include information on the plurality of groups. For example, the summary metadata may include summary information that briefly shows the subject of each of the plurality of groups.

FIG. 6 illustrates an embodiment of the configuration of the summary information, in which video contents having six different topics are included in the video data area.

Referring to FIG. 6, six video contents can be classified into three groups according to their subjects. As shown in FIG. 6, each of the six video contents is classified into three groups: a science, an area, a mathematics, a ballet, an opera, a baseball, a soccer, Can be classified.

The summary metadata may include information on the number (3) of the classified groups (3) and the index, the subject of each group, the index of video contents belonging to each group, and the subject of each video content.

In addition, images included in one video content may be classified into a plurality of groups according to respective subjects, and the summary metadata may include the summary information as described above for the plurality of grouped image groups .

The user can easily grasp the contents of many video contents included in the video data area using the summary information displayed on the menu, and can easily search for the video contents related to a desired one of the video contents.

 In FIG. 6, a plurality of video contents belonging to video data are classified into groups of one layer, but they may be classified into two or more layers. That is, any two of the three groups shown in FIG. 5 may be regrouped into one higher group, in which case the information on the regrouping may be included in the summary metadata as the summary information .

In addition, the metadata may include usage histories information, which is information on user inputs performed on media contents included in the media data area. For example, the user history information may be information on a record in which the user accessed the media contents included in the media data area for a certain period of time in the past.

The user history information may include identification information of a video content viewed by a user, information on a point where reproduction is stopped when the user does not watch the video content to the end, information on a viewing start time or end time of the user, And the media content access information of the user.

If there are a plurality of users of the multimedia file including the media contents, the user history information is preferably generated for each user.

In order to manage user history information for each user, the user history information is included in a metadata file separate from the multimedia data file including a file type area, a file meta area, a media information area, and a media data area .

The user can grasp the access contents and the time that he / she has performed in the past with respect to the corresponding multimedia data file by using the user history information. More specifically, when the user views one of the video contents included in the video data area The user can start watching the video content from the stopped position when the user wishes to view the video content again.

FIG. 8 shows an embodiment of a structure of a multimedia data file according to the present invention.

Referring to FIG. 8, the media data area may further include a text data area or an image data area in addition to the video data area and the audio data area. When the media data area includes a text data area, the media information area preferably includes a text track area corresponding to the text data area.

The text data included in the text data area may be data having a character string divided in line units, in which case each line can be treated as a sample which is a reproduction unit.

The text data may be displayed in synchronism with any one of a plurality of media data included in the media data area. For this purpose, any one of the plurality of track areas, for example, the text track area, . &Lt; / RTI &gt;

For example, the text data may include information about subtitles of the video content or lyrics of the audio content, in which case they may be displayed in synchronism with the video or audio content.

If the text data includes a plurality of character strings, any one of the plurality of track areas may include play period information, position information, and size information for each of the plurality of text strings, The plurality of strings can be displayed in synchronization with the media content.

The image data included in the image data area can be used as a background image of the menu displayed by the menu descriptor and the animation effect described by the menu descriptor can be applied to the image data as described above.

The video data included in the video data area may be data compressed according to various video coding schemes such as MPEG-4 AVC (Advanced Video Coding), MPEG-2, H.263, MPEG-4 Part 2, May be compressed data using a video coding scheme defined in ITU-T H.264.

The audio data included in the audio data area may be data compressed according to various audio coding schemes such as MP3 or AAC (Advanced Audio Coding), and MPEG-4 HE-AAC (High Efficiency Advanced Audio Coding) among various audio coding schemes. It may be efficient to use compressed data. The audio data may be compressed using a scalable audio coding scheme such as BSAC (Bit Sliced Arithmetic Coding) capable of adjusting the bit rate.

The image data included in the image data area may be data compressed by a coding method such as JPEG (Joint Picture Expert Group) or the like.

8 shows another embodiment of the structure of a multimedia data file according to the present invention.

8, the media data area includes a slide show image data area including a plurality of images corresponding to image data, and a media information area includes a timing for constructing a slide show by sequentially reproducing the plurality of images Lt; RTI ID = 0.0 &gt; information. &Lt; / RTI &gt;

The timing information of each of the plurality of image data may include information on an interval or reproduction order in which the media data is reproduced on the time line.

The slide show track area may include playback interval information, data position information, and data size information for each of the plurality of image data. An image to be reproduced from the media data area can be searched and extracted using the position and size information.

The image data included in the slide show image data area may be a still image compressed by a JPEG (Joint Picture Expert Group) or the like.

The timing information may be expressed using a language such as a Light-weigh Application Scene Representation (LASeR), a Scalable Vector Graphics (SVG), or a Binary Format for Scene (BIFS). The LASeR, SVG, or BIFS may be implemented in XML (extensible Mark-up Language) format or Binary encoded format.

FIG. 9 illustrates an embodiment of a method of constructing a slide show using the above-described timing information. The slide show image data area has six pieces of image data, and the audio data area includes three pieces of audio data. , And the text data area has four text data.

As shown in FIG. 9, the data may be synchronously reproduced by timing information of image data, audio data, and text data included in the slide show track area.

The media data are dependent on one timeline, but have different timing information so that playback intervals may not coincide with each other. Each of the media data included in the media data area preferably has playback section information, location information, and size information.

FIG. 10 is a block diagram of a configuration of an apparatus for encoding multimedia data according to the present invention. The encoding apparatus includes a file structure generation unit 100, a multimedia track generation unit 120, And a data generating unit 130.

The file structure generation unit 100 generates a structure of a multimedia file composed of a file type area, a file meta area, a media information area and a media data area as described above.

The multimedia track generating unit 120 stores a plurality of input media data in a plurality of data areas, and generates a plurality of track areas corresponding to each of the plurality of data areas in the media information area. For example, the multimedia track generation unit 120 generates a multimedia track corresponding to the video track area corresponding to the video data area, the audio track area corresponding to the audio data area, the text track area corresponding to the text data area, You can create a slideshow track area. In addition, the multimedia track generating unit 120 may generate timing information of a plurality of media data for slideshow configuration and store the generated timing information in the slide show track area.

The metadata generating unit 130 generates metadata and stores the metadata in a file meta area, a track meta area, or a media meta area. Also, the metadata generating unit 130 may generate the menu descriptor as described above and store it in the menu description area.

The order of operations of the file structure generator 100, the multimedia track generator 120, and the metadata generator 130 may be changed and two or more operations may be simultaneously performed.

FIG. 11 is a block diagram of a first embodiment of a configuration of an apparatus for decoding multimedia data according to the present invention. The decoding apparatus includes a data input unit 200, a parser 210, a first decoder 220 And a second decoder 230. [0031] The operation of the decoding apparatus shown in Fig. 11 will be described in connection with a flowchart showing a first embodiment of a decoding method according to the present invention shown in Fig.

The data input unit 200 receives the multimedia data (operation 500). The parser 210 extracts a menu descriptor from the input multimedia data (operation 510).

The second decoder 230 displays a menu providing an interface between the user and the media data using the extracted menu descriptor (operation 520).

13, the second decoder 430 for displaying the menu may include a descriptor decoder 431 and a rendering unit 432. The descriptor decoder 431 decodes the menu descriptor to generate a menu The rendering unit 432 extracts information for display, and the rendering unit 432 performs rendering using the extracted information to display a menu.

The user can select a plurality of media contents included in the multimedia data, for example, a plurality of video contents included in the video data area, using the displayed menu.

The parser 210 extracts media data corresponding to the media content selected by the user from the media data area of the multimedia data using the menu (operation 530).

The first decoder 220 decodes the extracted media data (operation 540) and displays the selected media content (operation 550).

Referring to FIG. 13, the first decoder 420 for decoding the media data may include a video decoder 421, an audio decoder 422, a text decoder 423, and an image decoder 424. The video decoder 421, the audio decoder 422, the text decoder 423 and the image decoder 424 decode video data, audio data, text data and image data included in the media data area, respectively.

The parser 410 extracts timing information for the slideshow configuration from the slide show track area of the multimedia data and the plurality of images decoded by the image decoder 424 are decoded using the timing information to the audio decoder 422 or the text decoder 423 in synchronization with the decoded audio data or text data.

FIG. 12 is a block diagram of a second embodiment of a configuration of an apparatus for decoding multimedia data according to the present invention. The decoding apparatus includes a data input unit 300, a first parser 310, A first decoder 320, a second decoder 330, and a second parser 340. The operation of the decoding apparatus shown in Fig. 11 will be described in connection with a flowchart showing a second embodiment of a decoding method according to the present invention shown in Fig. The operation of the decoding apparatus shown in FIG. 11 will not be described with reference to FIGS. 10, 12, and 13, and description of the same operations as described above will be omitted.

The data input unit 300 checks whether there is user history information which is a record of the user's past input in the input multimedia data (operation 600).

If there is user history information, the first parser 310 extracts metadata including the user history information from the inputted multimedia data, and the second server 340 extracts the user history information Information is extracted.

As described above, the user history information may be composed of a metadata file separate from the multimedia data file. In such a case, the second parser 340 extracts the user history information from the input metadata file .

In operation 610, the first decoder 320 may decode the video data whose viewing is interrupted while the user is watching, using the extracted user history information, and may display the decoded video data. The decoding apparatus according to the present invention can confirm whether or not the user should view the video content whose viewing has been stopped from the stop point before the step 610. [

If the user history information does not exist, it is checked whether the decryption apparatus can process the menu descriptor implemented by LASeR or the like (operation 620).

If the decoding apparatus can process the menu descriptor, the second decoder 330 displays the menu using the menu descriptor extracted from the first parser 310 (step 640), and the first decoder 320 determines whether the user The selected video content is decoded and displayed (step 650).

If the decoding apparatus can not process the menu descriptor, the first decoder 320 decodes and displays the first video content among the plurality of video contents included in the video data area (step 630).

However, even if the decoding apparatus can handle the menu descriptor, if there is no menu descriptor in the input multimedia data, the first decoder 320 selects one of the plurality of video contents included in the video data area The first video content is decoded and displayed.

The first video content may be video data located at the frontmost position among the data included in the video data area. In addition, in the case of the video content having the highest priority among the plurality of video contents, It may also mean the main feature. The priority may be specified by the user.

The encoding / decoding apparatus according to the present invention is provided in a multimedia broadcasting transmitting / receiving apparatus such as a digital audio broadcasting (DAB) and a digital multimedia broadcasting (DMB), and can be used for encoding / decoding an audio signal or a voice signal . The multimedia broadcasting transmitting / receiving apparatus may include a mobile communication terminal. In addition, the multimedia data having the above structure may be included in the multimedia broadcasting signal.

The encoding / decoding method according to the present invention may be implemented as a program for execution in a computer and stored in a computer-readable recording medium. The multimedia data having the data structure according to the present invention may be read by a computer. Lt; RTI ID = 0.0 &gt; media. &Lt; / RTI &gt; The computer-readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. Functional programs, code, and code segments for implementing the user tracking method can be easily inferred by programmers of the art to which the present invention pertains. In addition, the bit stream generated by the above-described encoding method can be stored in the computer-readable recording medium or transmitted using a wired / wireless communication network.

The decoding apparatus according to the present invention may be provided in a reproducing apparatus such as a mobile communication terminal, a multimedia player such as a portable multimedia player (PMP), and a personal digital assistant (PDA). The above-described decoding apparatus may be embodied in hardware and incorporated in a reproducing apparatus, or may be embodied in a reproducing apparatus in software as described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

1 is a diagram schematically showing the overall structure of multimedia data according to the present invention.

FIG. 2 is a view showing an embodiment of a configuration of a menu which is a user interface.

FIGS. 3, 4, 7, and 8 are views showing embodiments of a structure of multimedia data according to the present invention.

FIG. 5 is a view showing an embodiment of the configuration of chattering information included in the metadata.

6 is a diagram illustrating an example of the configuration of summary information included in the metadata.

9 is a diagram showing an embodiment of a method for constructing a slideshow.

10 is a block diagram illustrating a structure of a multimedia data encoding apparatus according to an embodiment of the present invention.

11 to 13 are block diagrams showing embodiments of a structure of a multimedia data decoding apparatus according to the present invention.

14 and 15 are flowcharts illustrating embodiments of a method of decoding multimedia data according to the present invention.

Claims (16)

A media data area including a video data area, an audio data area and an image data area; A media information area including a plurality of track areas corresponding to each of the plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area, the method comprising: receiving multimedia data; Displaying a menu using the menu information; And Extracting and decoding the media data corresponding to the user input using the menu among the media data included in the media data area, Wherein the slide show track area corresponding to the image data area includes timing information for constructing a slide show using a plurality of images included in the image data area, and the media data area, the media information area, Constitute one file, Wherein the media data included in the media data area is hierarchically classified according to a predetermined criterion and the hierarchical grouping information of the hierarchically classified media data is displayed on the displayed menu. Way. The method according to claim 1, Wherein the menu description area is described as one of LASeR, SVG, and BIFS. 3. The method of claim 2, Wherein one of the LASeR, SVG, and BIFS is implemented as an XML foramt or a binary encoded format. The method according to claim 1, Wherein the menu displays information on a plurality of media contents included in the media data area. The method according to claim 1, Wherein the menu includes a background image, and an animation effect included in the menu information is applied to the background image. The method according to claim 1, Wherein the slide show track area includes play interval information, position information, and size information for each of the plurality of images. The method according to claim 1, Wherein the media data area further includes a text data area, the media information area including a text track area corresponding to the text data area, Wherein the text track area includes timing information for displaying a plurality of character strings included in the text data area in synchronization with at least one of a plurality of media data included in the media data area. Way. The method according to claim 1, Wherein the multimedia data is included in a broadcast signal and is input. delete Creating a media data area including a video data area, an audio data area and an image data area; Generating a media information area including a plurality of track areas corresponding to each of the plurality of data areas; And Generating a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area, Wherein the slide show track area corresponding to the image data area includes timing information for constructing a slide show using a plurality of images included in the image data area, and the media data area, the media information area, Constitute one file,  Wherein the media data included in the media data area is hierarchically classified according to a predetermined criterion. 11. The method of claim 10, Wherein the menu includes a background image, and an animation effect included in the menu information is applied to the background image. 11. The method of claim 10, Wherein the slide show track area includes play interval information, position information, and size information for each of the plurality of images. 11. The method of claim 10, Wherein the media data area further includes a text data area, the media information area including a text track area corresponding to the text data area, Wherein the text track area includes timing information for displaying a plurality of character strings included in the text data area in synchronization with at least one of a plurality of media data included in the media data area. Way. A media data area including a video data area, an audio data area and an image data area; A media information area including a plurality of track areas corresponding to each of the plurality of data areas; And a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area; A first decoding unit decoding the menu information to display a menu; And And a second decoding unit for extracting and decoding the media data corresponding to the user input using the menu among the media data included in the media data area, Wherein the slide show track area corresponding to the image data area includes timing information for constructing a slide show using a plurality of images included in the image data area, and the media data area, the media information area, Constitute one file, Wherein the media data included in the media data area is hierarchically classified according to a predetermined criterion and the hierarchical grouping information of the hierarchically classified media data is displayed on the displayed menu. Device. 15. The method of claim 14, Wherein the slide show track area includes play interval information, position information, and size information for each of the plurality of images. A multimedia track generating unit for generating a plurality of track areas corresponding to each of the video data area, the audio data area and the image data area; A menu description area creating unit for creating a menu description area including menu information for displaying a menu providing an interface between a user and data included in the media data area; And And a file structure generation unit that configures the plurality of track areas and the menu description area as one multimedia data file, Wherein the slide show track area corresponding to the image data area includes play section information of each of the plurality of images for constructing a slide show using a plurality of images included in the image data area, Wherein the media data included in the media data area is hierarchically classified according to a predetermined criterion.

Images