JP3552945B2 - MPEG2 data insert editing method and system - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an insert editing method and system for MPEG2 data, and more particularly to an insert editing method and system capable of editing audio data in MPEG2 data in real time.
[0002]
[Prior art]
In order to highly compress a moving image and handle it as digital moving image data, a data format of the MPEG (motion photocoding encodings group) standard is used. In the editing process for digital moving image data (hereinafter, referred to as MPEG data) using the MPEG data format, image and audio are individually edited, and finally the image and audio are combined, and the MPEG data and I do.
[0003]
FIG. 1 is a diagram showing an example of a configuration of a conventional insert editing system that performs an editing process of MPEG data. In FIG. 1, 1 is an MPEG2-TS data file, 2 is an audio data conversion / extraction unit, 3 is an audio data file, 4 is a video data editing processing unit, 5 is an audio data editing processing unit, 6 is a video data output unit, 7, an audio data output unit; and 8, a synchronization processing unit.
[0004]
Since the MPEG data includes coded and highly compressed video data and audio data mixed with each other as packet data, an insert editing system for editing MPEG2 data requires an edit processing of the video data. And audio data editing processing are performed individually. As shown in FIG. 1, the video data editing process is performed by a video data editing unit 4 on a video data packet of MPEG data extracted from an MPEG2-TS data file 1, Then, the edited video data resource is extracted. In this case, the video data editing processor 4 edits the video by displaying the frame image of the video data on a monitor screen or the like.
[0005]
Regarding the audio data editing process, first, the audio data conversion / extraction unit 2 extracts an audio data packet, which is the audio data portion of MPEG2-TS data, from the MPEG2-TS data file 1 and converts it into another data format (WAVE). (Data, PCM data), and extract it, and store it in the audio data file 3. Then, audio data is extracted from the audio data file 3, edited by the audio data editing processing unit 5, and the edited audio data resource is extracted from the audio data output unit 7. Then, in order to match the audio with the video, the video data output unit 6 and the audio data output unit 7 are controlled by the control of the synchronization processing unit 8, and the edited results are output from different resources while being synchronized, so that the insertion is performed. Edit.
[0006]
In other words, in this case, one MPEG2-TS data is subjected to separate editing processing (4, 5) for its video data and audio data, and the edited result is set as a separate data resource (6, 7) and synchronized ( 8) The insert editing is realized by outputting while taking.
[0007]
By the way, in such an insert editing system, an edit result obtained by insert editing such as adding audio data to video data is output with the video output and the audio output synchronized, but the video output and the audio output are synchronized. Since the output is a signal of a different system, and the data is returned to video data and audio data having a large data amount, these can be combined into one data and handled as compact MPEG2-TS data. To do so, the video data and audio data resulting from the editing must be re-encoded into MPEG data.
[0008]
Therefore, an insert editing system that handles MPEG2-TS data is provided with an encoding processing unit that encodes video data (video resources, video output) and audio data (audio resources, voice output) into MPEG data.
[0009]
FIG. 2 is a diagram showing another example of a configuration of a conventional insert editing system that performs editing processing of MPEG2 data. 2, 10 is an MPEG2-TS data file, 11 is an audio data conversion / extraction unit, 12 is an audio data file, 13 is a video data edit processing unit, 14 is an audio data edit processing unit, 15 is a video data output unit, Reference numeral 16 denotes an audio data output unit, 17 denotes a synchronization processing unit, 18 denotes an encoding processing unit, and 19 denotes an edited MPEG2-TS data file.
[0010]
The MPEG2 data insert editing system shown in FIG. 2 encodes video data (video resource, video output) and audio data (audio resource, audio output) into MPEG data with respect to the insert editing system shown in FIG. The configuration is such that an encoding processing unit is provided.
[0011]
As shown in FIG. 2, the insert editing system for MPEG2 data performs editing processing of video data on the MPEG data extracted from the MPEG2-TS data file 10 by a video data editing processing unit 13 and a synchronization processing unit. Under the control of 17, the video data is extracted from the video data output unit 15 as an edited video data resource. In the audio data editing process, the audio data conversion / extraction unit 11 converts the audio data portion of the MPEG2-TS data from the MPEG2-TS data file 10 into audio data of another data format (WAVE data, PCM data). To extract and store it in the audio data file 12. Then, audio data is extracted from the audio data file 12, edited by the audio data editing processing unit 14, and the edited audio data is extracted from the audio data output unit 16 as an audio data resource under the control of the synchronization processing unit 17. At this time, in order to output the audio together with the video, the synchronization processing unit 17 controls the video data output unit 15 and the audio data output unit 16 to output the video data and the audio data while synchronizing them. , To the encoding processing unit 18. The encoding processing unit 18 encodes and outputs the video data and the audio data input in synchronization with each other to MPEG2 data, and stores the encoded data in the MPEG2-TS data file 19.
[0012]
[Problems to be solved by the invention]
As described above, in the conventional insert editing system, the editing process of the video data and the editing process of the audio data are separately performed, and the editing result of the insert editing such as adding the audio data to the video data is: The video output and the audio output are output in synchronization with each other. However, since the video output and the audio output are signals of different systems, it is necessary to collectively handle them as one data and easily handle them. In addition, the video data and the audio data must be encoded again into MPEG data.
[0013]
Encoding processing to MPEG data has a problem that the load is heavy because it compresses video data and audio data at a high level, requires a lot of processing time, and does not allow real-time insert editing. In other words, even when performing simple insert editing such as adding audio data to video data of MPEG data, the video output and audio output of the edited result are output as signals of different systems, respectively. However, in order to combine the data into one piece of MPEG data, re-encoding processing must be performed, which requires a lot of processing time, and there is a problem that real-time insert editing cannot be performed.
[0014]
Therefore, an object of the present invention is to provide an MPEG2 data insert editing method and system capable of editing audio data of MPEG2 data in real time.
[0015]
[Means for Solving the Problems]
In order to achieve the above object, the MPEG2 data insert editing method according to the present invention extracts MPEG2-TS data audio data in a format that does not require re-encoding after editing, and collects the extracted audio data packet data. The audio data is edited in units of one frame, the edited audio data is decomposed into packet data, the decomposed packet data is merged with the corresponding position of the audio data portion of the MPEG2-TS data, and output from the same resource as MPEG2-TS data. It is characterized by the following. Further, the system configuration of the MPEG2 data insert editing system according to the present invention is an extracting means for extracting audio data of MPEG2-TS data in a format that does not need to be re-encoded after editing , for example, in an MPEG1 Audio Layer II-ES data format. And editing means for editing the extracted audio data, and output means for overwriting the edited audio data on the audio data portion of the MPEG2-TS data and outputting it as MPEG2-TS data.
[0016]
The insert editing system for MPEG2 data according to the present invention takes out the packet data of the audio data portion of the MPEG2 data in consideration of the data format of MPEG2, edits the packet data, and performs the encoding process on the MPEG data having a large processing load. It outputs MPEG2 data with the audio data part edited. This enables insert editing in real time.
[0017]
That is, the extracting unit extracts the audio data of the MPEG2-TS data in the MPEG1 Audio Layer II-ES data format, edits the extracted audio data by the editing unit, and outputs the edited audio data by the output unit. It overwrites the audio data part of the data and outputs it as MPEG2-TS data. As a result, the audio data portion of the MPEG2 data can be extracted in the MPEG data format and edited, and the edited result can be output as MPEG2 data from the same resource each time.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be specifically described with reference to the drawings. The data handled by the insert editing system according to the present invention is data in the MPEG2 data format. Specifically, the MPEG2 data format is based on GOP = 1 or 2 of MPEG2-TS.
[0019]
FIG. 3 is a diagram showing a configuration of an insert editing system for performing an editing process of MPEG data according to one embodiment of the present invention. 3, reference numeral 20 denotes an MPEG2-TS data file, 21 denotes an audio data extraction unit, 22 denotes an audio data file of "MPEG1 Audio", 23 denotes a video data editing processing unit, 24 denotes an audio data editing processing unit, and 25 denotes a merge processing. , 26 is an edited MPEG2-TS data file, and 27 is an output processing unit.
[0020]
The MPEG2-TS data to be edited is taken out from the MPEG2-TS data file 20 as shown in FIG. And edit processing of the video data. In this case, for example, the video data editing processing unit 23 edits the video data by displaying a frame image of the video data on a monitor screen or the like.
[0021]
In the audio data editing process, the audio data extraction unit 21 extracts an audio data packet, which is the audio data portion of the MPEG2-TS data, from the MPEG2-TS data file 1. Here, the extracted audio data is not converted into audio data of another data format (WAVE data, PCM data), so the audio data portion of the extracted MPEG2-TS data is packet data of “MPEG1 Audio” audio data. It has become. The packet data is arranged in order and, for example, excluding the header portion, is set as “MPEG1 Audio” audio data, and is stored in the audio data file 22 in order to determine one frame portion of the audio data distinguished by the synchronization word. As will be described later, since one frame of the audio data is the smallest unit that can be decoded, the audio data of one frame is determined based on the synchronization word, and the audio data is decoded in units of frames. Edit data.
[0022]
In other words, in the audio data editing process, the audio data editing processing unit 24 extracts audio data from the audio data file 22, determines audio data in units of one frame based on synchronization words, and decodes the audio data in units of frames. Then, the audio data is edited as needed. Then, the audio data editing processing unit 24 encodes the edited audio data again, adds a header portion thereto, decomposes the data into packet data as packet data of “MPEG1 Audio” audio data, 25, overwrites and merges the corresponding position of the packet data of the video data portion. As a result, it becomes the MPEG2-TS data that has been insert-edited as it is. The edited MPEG2-TS data is stored in an MPEG2-TS data file 26 that stores the edited result, and is reproduced by an output processing unit 27 that decodes and reproduces the MPEG2-TS data. As a result, a video output and an audio output subjected to insert editing are obtained. In the insert edit processing here, encoding processing on MPEG2 data that places a lot of load is not performed, and real-time editing becomes possible.
[0023]
FIG. 4 is a view for explaining the data format of MPEG2 related to the embodiment of the present invention. This will be described with reference to FIG. As described above, the MPEG2 data format applied in the present invention is based on GOP = 1 or 2 of MPEG2-TS.
[0024]
In the MPEG2-TS data, as shown in FIG. 4, a video data stream 30 and an audio data stream 31 are each divided into packets (TS packets) in units of 188 bytes and further multiplexed. One frame 32 of the video data is composed of a plurality of TS packets, and the data segment of one frame always matches the segment of the TS packet.
[0025]
On the other hand, the data segment of one frame 33 of the audio data does not match the segment of the TS packet in most cases. One frame 33 of the audio data is the minimum unit that can be decoded. This is distinguished by the synchronization word. Therefore, in order to edit the audio data, the audio data of one frame is determined by the synchronization word. The audio data is decoded frame by frame, and the audio data is edited as needed.
[0026]
The data size of one frame 32 of the video data of the MPEG2-TS data varies greatly depending on the type of picture (image) (I picture, P picture) (variable length), whereas the sampling frequency of audio data is different. Even if the quality is increased and the quality is increased, the data amount is not so large due to the nature of the data, and the data size of one frame 33 of the audio data is fixed.
[0027]
FIG. 5 is a diagram illustrating a method of insert editing MPEG2-TS data according to the present invention. According to the insert editing method of the MPEG2-TS data, as shown in FIG. 5, only the audio data of the MPEG2-TS data is extracted from the MPEG2 file 40 storing the MPEG2-TS data, and the MPEG1 Audio layer II- The audio data stored and extracted in the ES file 42 is subjected to an editing process such as decoding as necessary and merging it with another audio resource as an audio signal to obtain one frame corresponding to one frame of video. (Approximately 1/30 second) audio data 43. The audio data is decomposed into packet data, and a merge process is performed to replace the audio data in the MPEG2-TS data with packet data. The editing result is output from the same resource as MPEG2-TS data each time. Here, the packet data size of the video data and the audio data is managed to replace the packet data of the audio data in the MPEG2-TS data. Here, the data size of each frame based on video is managed using the data size management file 41. With reference to the data size managed here, only the packet of the audio data portion is sequentially replaced from the MPEG2-TS data, and each time it is output from the same resource as MPEG2-TS data.
[0028]
That is, in the insert editing method of the MPEG2 data, the audio data of the MPEG2-TS data is extracted, the packet data of the extracted audio data is collectively edited in units of one frame, and the edited audio data is converted into packet data. The packet data is disassembled, the packet data is merged with the corresponding position of the audio data part of the MPEG2-TS data, and insert editing is performed such that the packet data is output as MPEG2-TS data from the same resource. Also in this editing process, encoding processing for creating MPEG2 data is not required, and insert editing can be performed in real time.
[0029]
FIG. 6 is a flowchart showing a processing flow of insert editing processing of MPEG2-TS data according to the present invention. This will be described with reference to FIG.
[0030]
In the insert editing process, first, in order to edit the MPEG2 data to be edited, the data corresponding to the portion where the reproduction instruction is issued is extracted (step 51). Next, for the video data, the data size management file 41 which manages the data size of one frame unit based on the video is analyzed to obtain the data size (step 52). Then, one frame worth of MPEG2-TS data is acquired from the MPEG2 file 40 (step 53).
[0031]
Next, as for the audio data, the corresponding data of about 1/30 second (corresponding to one video frame) of the MPEG1 Audio layer II-ES is obtained from the MPEG1 Audio layer II-ES file 42 (step 54). . Then, the MPEG2-TS audio packet acquired from the MPEG2 file 40 is replaced with the audio packet acquired from the MPEG1 Audio layer II-ES file 42, and the MPEG2 data is reorganized (step 55). Subsequently, the rearranged MPEG2 data is output from the same resource (step 56).
[0032]
【The invention's effect】
As described above, according to the MPEG2 data insert editing method and system of the present invention, the audio data portion of MPEG2 data is extracted and edited, and the edited result is output as MPEG2 data from the same resource each time. Thus, insert editing of audio data is realized. Thereby, insert editing of MPEG2 data can be performed in real time.
[Brief description of the drawings]
FIG. 1 is a diagram showing an example of a configuration of a conventional insert editing system for performing an editing process of MPEG data;
FIG. 2 is a diagram showing another example of the configuration of a conventional insert editing system for performing editing processing of MPEG2 data;
FIG. 3 is a diagram illustrating a configuration of an insert editing system that performs an MPEG data editing process according to an embodiment of the present invention;
FIG. 4 is a view for explaining the data format of MPEG2 related to the embodiment of the present invention;
FIG. 5 is a diagram for explaining an insert editing method of MPEG2-TS data according to the present invention;
FIG. 6 is a flowchart showing a processing flow of insert editing processing of MPEG2-TS data according to the present invention.
[Explanation of symbols]
1 ... MPEG2-TS data file,
2 ... Sound data conversion / extraction unit
3: Audio data file,
4: Video data editing processing unit
5. Audio data editing processing unit
6 ... video data output unit
7 audio data output unit,
8 synchronization processing unit 10 MPEG2-TS data file
11 ... voice data conversion / extraction unit
12 ... Audio data file,
13 ... Video data editing processing unit
14 audio data editing processing unit
15 ... Video data output unit
16 audio data output unit
17: Synchronization processing unit,
18. Encoding processing unit,
19 ... edited MPEG2-TS data file 20 ... MPEG2-TS data file
21 ... audio data extraction unit
22: "MPEG1 Audio" audio data file,
23 ... Video data editing processing unit
24 audio data editing processing unit
25 ... Merge processing unit
26 ... edited MPEG2-TS data file,
27 output processing unit,
30 ... video data stream,
31 ... audio data stream,
32 ... 1 frame of video,
33 ... one frame of audio
40 ... MPEG2-TS data file,
41: Data size management file
42... MPEG1 Audio Layer II-ES file,
43 1 voice frame.

Claims (3)

Extract audio data of MPEG2-TS data in a format that does not require re-encoding after editing ,
Edit the packet data of the extracted audio data collectively in units of one frame,
Decompose the edited audio data into packet data,
The decomposed packet data is merged with the corresponding position of the audio data portion of the MPEG2-TS data,
A method for inserting and editing MPEG2 data, wherein the method is output from the same resource as MPEG2-TS data. Extracting means for extracting audio data of MPEG2-TS data after editing in a format that does not require re-encoding ;
Editing means for editing the extracted audio data;
Output means for merging the edited audio data with the audio data portion of the MPEG2-TS data and outputting the merged audio data as MPEG2-TS data. The MPEG2 data insert editing system according to claim 2,
The MPEG2 data insert editing system, wherein the extracting means extracts the audio data of the MPEG2-TS data in an MPEG1 Audio layer II-ES data format.

Images