JP2008005521A - Mpeg data recording and reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a recording and reproduction method for realizing seamless reproduction with high quality without causing contradiction of overflow and underflow at the connection of the VBV buffer in the case of joining the first MPEG image data to the second MPEG image data and reproducing the resulting image data. <P>SOLUTION: Data of a joining interval B of the second MPEG image data are decoded and then re-encoded. The re-encoding is executed while being controlled so that transition of a VBV buffer occupied value is started from a VBV buffer occupied value at a position (i) and finished up to a VBV buffer occupied value at a position (l). Then the first MPEG image data are reproduced until the position (i) of the first MPEG image data, and then re-encoded MPEG image data at the joining interval B are reproduced, and thereafter connection is made to the VBV buffer at its address position (l) of the second MPEG image data and the second MPEG image data after the position (l) are reproduced. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to first and second MPEGs which are image data encoded by the MPEG encoding method.
The image data is stored in the first designated connection position in each MPEG image data.
The present invention relates to an MPEG data recording / reproducing method for realizing seamless reproduction when the MPEG image data is reproduced by being linked to the second MPEG image data.

The conventional MPEG used in this patent will be briefly described.
Since MPEG is described in detail in ISO-IEC11172-2 and ITU-T H.262 / ISO-IEC13818-2, only the outline will be described here. MPEG is the name of the organization that examines video coding standards established in 1988 in ISO / IEC JTC1 / SC2 (International Organization for Standardization / International Electrotechnical Standards Meeting Technical Committee 1 / Technical Committee 2, now SC29) ( Abbreviation for Moving Pictures Expert Group. MPEG1
(MPEG Phase 1) is a standard for storage media of about 1.5 Mbps, and is intended for JPEG for still image coding and video compression for low transfer rates of ISDN video conferences and videophones. It inherits the basic technology of H.261 (CCITT SGXV, standardized by the current ITU-T SG15) and introduces new technology for storage media. These were established in August 1993 as ISO / IEC 11172.

MPEG1 is created by combining several technologies. FIG. 5 shows a conventional MPEG encoder that performs encoding by the MPEG encoding method, which will be briefly described below. For the input image, the difference between the image decoded by the motion compensation predictor 1 and the input image is taken by the differencer 2 to reduce the time redundant portion.

There are three modes of prediction from the past and the future. These can be used by switching every 16 pixels × 16 pixels MB (Macroblock). The prediction direction is Pict given to the input image
Determined by ure Type. One-way inter-picture predictive coded images (P-pictures) exist in two modes: a mode in which encoding is performed by prediction from the past and a mode in which MB is independently encoded without prediction. In addition, there are four modes of bi-directional inter-picture prediction: a mode that encodes by prediction from the future, a mode that encodes by prediction from the past, a mode that encodes by prediction from both, and a mode that encodes independently. This is a B-picture. All MBs are independently encoded in an intra-picture independently encoded image (I-picture).

In motion compensation, the motion region is subjected to pattern matching for each MB, a motion vector is detected with half-pel accuracy, and prediction is performed after shifting by the motion amount. The motion vector has a horizontal direction and a vertical direction, and is transmitted as additional information of the MB together with an MC (Motion Compensation) mode indicating where the motion vector is predicted.

In general, GOP (Group Of Picture) from I picture to the picture before the next I picture
), When used in storage media, etc.
Used as OP section. (However, two or more I pictures may be included in one GOP section. In short, one or more I pictures may be included in one GOP section.)
The difference image is subjected to orthogonal transformation in the DCT unit 3. DCT (Discrete Cosine Transform) is an orthogonal transformation that discretely transforms an integral transformation with a cosine function as an integral kernel into a finite space. MPEG
Then, the MB is divided into four, and the two-dimensional DCT is performed on the 8 × 8 DCT block. In general, video signals have many low-frequency components and few high-frequency components. Therefore, when DCT is performed, coefficients are concentrated in the low frequency range.

The image data (DCT coefficient) subjected to DCT is quantized by the quantizer 4. Quantization is a quantized value obtained by multiplying the 8 × 8 two-dimensional frequency called the quantization matrix by the visual characteristic weighted by the value of the quantization scale that multiplies the whole by a scalar, and the DCT coefficient is quantized. Calculate by value. When inverse quantization is performed by the MPEG decoder (decoder), a value approximating the original DCT coefficient is obtained by multiplying by the quantized value.

The quantized data is variable length encoded by the VLC unit 5. Of the quantized values, the direct current (D
C) component is one of predictive coding DPCM (differential pulse code modulation)
Is used. Also, AC (AC) components are zigzag scanned from low to high, with zero run length and effective coefficient value as one event, and Huffman coding assigning codes with short code lengths from those with high appearance probability. Is done.

The variable-length encoded data is stored in the temporary buffer 6 and output as encoded data at a predetermined transfer rate. The generated code amount for each macroblock of the output data is transmitted to the code amount controller 21, and the error code amount with respect to the generated code amount with respect to the target code amount is fed back to the quantizer 4 to quantize the scale. The amount of code is controlled by adjusting.

The quantized image data is inversely quantized by the inverse quantizer 7, inversely DCTed by the inverse DCT unit 8, temporarily stored in the image memory 10 via the adder 9, and then the motion compensated predictor 1. Are used as reference decoded images for calculating difference images.

FIG. 6 shows an MPEG decoder (decoder) for decoding the encoded data encoded in this way.
Incoming encoded data (stream) is buffered by the buffer 11, and the data from the buffer 11 is input to the VLD unit 12. The VLD unit 12 performs variable length decoding and performs direct current (
DC) component and alternating current (AC) component are obtained. AC component data is zi from low to high
They are arranged in an 8x8 matrix in the order of gzag scan. This data is input to the inverse quantizer 13 and is inversely quantized by the quantization matrix. The inverse quantized data is converted into an inverse DCT unit 14.
Is subjected to inverse DCT and output as image data (decoded data). The decoded data is temporarily stored in the image memory 16 and then used as a reference decoded image for calculating a difference image in the motion compensation predictor 17.

In the case of video, the encoded bit stream has a variable amount of code for each picture. This is because MPEG uses information conversion such as DCT, quantization, and Huffman coding, and at the same time, it is necessary to adaptively change the amount of code allocated to each picture to improve image quality. This is because the entropy of the encoded image itself changes greatly, such as encoding the input image as it is in some cases and encoding a difference image that is the difference between the predicted images in some cases.

In this case, in many cases, the code amount is controlled while allocating the entropy ratio of the image and keeping the limitation of the buffer. The buffer manager monitors the relationship between the generated code amount and the encoding rate, and sets the target code amount so as to be within a predetermined buffer. This value is fed back to the variable length encoder and enters the code amount controller, where the generated code amount is suppressed by increasing the quantized value set in the quantizer or by reducing the quantized value. Or make it smaller.

When encoding such variable-length data at a fixed transfer rate (encoding rate), if the maximum buffer amount of the decoder is the upper limit value, the data is input at a constant speed and only a predetermined value is accumulated. Therefore, MPEG is specified to use a model that performs decoding instantaneously at a predetermined time (1 / 29.97 sec unit for NTSC video signals) and encodes the buffer so that neither overflow nor underflow occurs. ing. If this rule (VBV buffer rule) is observed, the rate in the VBV buffer changes locally, but if the observation time is long, it becomes a fixed transfer rate. In MPEG, this is a fixed rate. Defined.

In the case of a fixed transfer rate, when the amount of generated code is small, the buffer occupation amount is stuck to the upper limit value. In this case, it is necessary to increase the code amount so as not to overflow by adding an invalid bit.

In the case of variable transfer rate, the definition of this fixed transfer rate is expanded so that when the buffer occupancy reaches the upper limit value, it is defined so that overflow will not occur in principle by stopping reading of the decoder. ing. Such a buffer transition is shown in FIG. Even if the amount of generated code is very small, reading of the decoder is stopped, so there is no need to insert invalid bits as in the case of a fixed transfer rate. Therefore, encoding is performed so that only underflow does not occur.

The MPEG system stipulates a method for reproducing a bit stream that is encoded with MPEG video and audio, etc., and multiplexed into one bit stream while ensuring synchronization. The contents specified in the system are roughly divided into the following five points.
1) Synchronous playback of multiple encoded bitstreams 2) Multiplexing of multiple encoded bitstreams into a single bitstream 3) Buffer initialization at playback start 4) Continuous buffer management 5) Determining the time for decoding and playback
In order to multiplex in the MPEG system, it is necessary to packetize information. Packet multiplexing means, for example, when video and audio are multiplexed, each is divided into streams of appropriate length called packets, attached with additional information such as headers, and video and audio packets are switched appropriately. Time-division transmission. The header includes information for identifying video, audio, etc., and time information for synchronization. The packet length depends on the transmission medium and application, and ranges from 53 bytes like ATM to as long as 4 Kbytes like optical disc. In MPEG, the packet length is variable and can be specified arbitrarily.

Data is packed and packetized, and one pack is composed of several packets. Pack start code and SCR (System Clock Referance) are described in the head part of each P pack, and stream id and time stamp are described in the head part of the packet. Audio for timestamps,
Describes the time information for synchronization such as video, DTS (Decoding Time Stamp), PTS (Pr
esentation Time Stamp) exists. PCR (Program Clock Reference) is 27MH
It is described with z time accuracy and is information for locking the reference clock of the decoder. DTS indicates the decoding start time of the first access unit (1 picture for video, 1152 samples for audio) in the packet data, and PTS indicates the display (playback) start time. As shown in FIG. 11, the audio, video, and other decoders constantly monitor a common reference clock locked by PCR, and perform decoding and display when they coincide with the DTS or PTS time. . Multiplexed data is buffered by each decoder, and a virtual decoder for synchronized display is called STD (System Target Decoder), and multiplexed so that this STD does not cause overflow or underflow. Must be.

MPEG systems can be broadly divided into TS (Transport Stream) and PS (Program Strea).
m) exists. These are composed of packets including PES (Packetized Elementary Stream) and other necessary information. PES is defined as an intermediate stream for enabling conversion between both streams, and is a packet of a private stream or the like in addition to video and audio data encoded with MPEG.

PS can multiplex video and audio of programs with a common reference time. The packet layer is called PES, and this structure is shown in FIG.
And can be used interchangeably with each other. In the PS STD model, streams are switched by the stream id in the PES packet.

TS can also multiplex video and audio of programs that have a common reference time like PS, but TS can also multiplex multi-programs such as communications and broadcasts that have different reference times It is said. The TS is composed of a 188-byte fixed-length packet in consideration of the ATM cell length and error correction coding, and is considered so that it can be used even in a system in which an error exists. Although the structure of TS packet itself is not so complicated, its operation is complicated because it is a multi-program stream. A characteristic of PS is that although TS packets have a higher structure, they are (usually) shorter than PES packets, and are divided into TS packets for transmission. In the STD model of TS, the stream is switched by the PID (packet ID) in the TS packet.

The MPEG system TS has a mechanism for indicating which PID is a packet related to information of the multiplexed program. This will be described with reference to FIG. First, from the TS packet group
Search for PID = 0. It is an information packet called PAT (Program Association Table), in which information PID corresponding to the PROGRAM number PR is described in a linked form. Next, when reading the PID packet corresponding to the target PR, PMT (Program Map Ta
ble), which contains information on the PID of the video packet of the program corresponding to the PR and the PID of the audio packet.

PAT and PMT are called PSI (Program Specific Information), which is an information system that allows access (entry) to the channel of the target program.
Conventionally, according to the invention of Japanese Patent Laid-Open No. 11-74799, when editing compressed data such as MPEG data recorded on a recording medium, in order to maintain the continuity of the MPEG data, the editing point is VB.
There are described methods for performing coding in consideration of continuity, such as controlling the amount of generated code so that the V-buffer is always fixed, and coding GOP as closed GOP.

Further, according to the invention of Japanese Patent Laid-Open No. 11-187354, there is no restriction on the encoded data, and the information indicating the data extracted as the editing material in the partial section of the data and the reproduction order thereof. A method is described in which information can be described and video editing can be realized on a single recording medium without changing the recorded data.

However, in the conventional method described above, when MPEG image data is simply connected, a contradiction occurs in the connection of the VBV buffer, and overflow and underflow occur.
In the invention of Japanese Patent Laid-Open No. 11-74799, the generated code amount is controlled so that the VBV buffer is always fixed for each GOP, or the GOP is closed GOP so that it can be edited anywhere.
As a result, encoding restrictions are considered in consideration of continuity, which is a disadvantageous factor in terms of encoding efficiency.

In the invention disclosed in Japanese Patent Laid-Open No. 11-187354, playback is displayed as if it had been edited, but the continuity at the editing point is incomplete, and temporary rest such as initialization of the decoder buffer of MPEG data is performed. There was a possibility that the phenomenon occurred.

The present invention provides first and second MPEG image data (or packet-multiplexed first MPEG multiplexed data including the first MPEG image data as element encoded data) and a second MP.
Packet-multiplexed second MPEG multiplexed data including EG image data as element-encoded data) from the first MPEG image data to the second MPEG image at each designated connection designation position. When connecting to data and reproducing (from the first MPEG multiplexed data to the second
MPEG data recording and playback method that can realize seamless and high-quality playback without causing overflow or underflow inconsistency in VBV buffer connection (when playing back to MPEG multiplexed data) The purpose is that.

Therefore, in order to solve the above problems, the present invention provides the following recording / reproducing method.
(1) In each of the first and second MPEG multiplexed data that is packet-multiplexed by the MPEG method recorded on the first recording medium, the first MPEG multiplexed data is used as element encoded data. First MPEG image data encoded by the included MPEG encoding method, second MPEG image data encoded by the MPEG encoding method including the second MPEG multiplexed data as element encoded data, and As a data to be reproduced from the first MPEG image data to the second MPEG image data at the designated connection designation position in each of the MPEG image data, the linkage encoded by the MPEG encoding method is used. A recording step for generating and recording interval re-encoded data is provided, and
Two MPEG image data, which are image data encoded by the MPEG encoding method, are reproduced by connecting from one MPEG image data to the other MPEG image data at a specified connection specification position in each MPEG image data. An MPEG data recording / reproducing method provided with a connected reproduction step for performing
The recording step includes
The connection specified position in the second MPEG image data is set as a start position, and a section having a position after a predetermined time from the connection specified position in the second MPEG image data as an end position is set as a connection section.
Re-encoding the connection interval decoded image data, which is image data obtained by decoding the second MPEG image data of the connection interval, using the MPEG encoding method, and generating the connection interval re-encoded data, The first and second MPEG multiplexed data of the first recording medium is obtained by combining the segmented MPEG multiplexed data generated by packet multiplexing according to the MPEG method, including the segmented recoded data as the element encoded data. Are recorded in a different area from each recorded area,
In the re-encoding, information on the VBV buffer occupancy value at the time of encoding the first MPEG image data at a position corresponding to the connection designated position is a transition of an information value related to the VBV buffer occupancy value at the time of re-encoding. The code amount control is performed so that the code value is controlled so as to end up to the information value related to the VBV buffer occupation value at the time of encoding the second MPEG image data at the position corresponding to the end position of the connecting section. Is,
The splicing reproduction step has a first splicing reproduction step of reproducing from the first recording medium and a second splicing reproduction step of reproducing from the second recording medium,
The first splicing reproduction step includes
The first MPEG image data is obtained from the first MPEG multiplexed data recorded on the first recording medium, and from the second MPEG multiplexed data recorded on the first recording medium. Obtaining the second MPEG image data, obtaining the joint section re-encoded data from the joint section MPEG multiplexed data recorded on the first recording medium,
After the first MPEG image data is reproduced up to the connection designated position in the first MPEG image data, the connection section re-encoded data is reproduced from the start position to the end position of the connection section. A joint reproduction step of reproducing the second MPEG image data from an end position of the joint section in the MPEG image data of 2;
The second splicing reproduction step includes
Third MPEG multiplexing that is generated by packet multiplexing according to the MPEG method, including the third MPEG image data encoded by the MPEG encoding method as element encoded data, and recorded on the second recording medium The third MPEG image data is obtained from the data, the fourth MPEG image data encoded by the MPEG encoding method is included as element encoded data, packet-multiplexed by the MPEG method, and generated by the second multiplexing. The MPEG format is obtained by obtaining the fourth MPEG image data from the fourth MPEG multiplexed data recorded on the recording medium, and including re-encoded data as segment encoded data, which is data to be reconstructed. Or connected segment MPEG multiplexed data generated by packet multiplexing and recorded in a region different from each of the third and fourth MPEG multiplexed data recorded on the second recording medium. To obtain the re-encoded data of the connecting section,
After the third MPEG image data is reproduced up to the connection designated position in the third MPEG image data, the connection section re-encoded data is used as a start of a predetermined connection section set in the fourth MPEG image data. Replaying from a position to an end position, and then replaying the fourth MPEG image data from the end position of the splicing section in the fourth MPEG image data,
The splice section re-encoded data recorded on the second recording medium has a splice designated position in the fourth MPEG image data as a start position, and is predetermined from the splice designated position in the fourth MPEG image data. Using the section having a position after time as an end position as the joining section, the joint section decoded image data, which is image data obtained by decoding the fourth MPEG image data of the joining section, is converted into the MPEG encoding method. Re-encoded data generated by re-encoding at
The joint section re-encoded data recorded on the second recording medium has the third MPEG at a position where the transition of the information value related to the VBV buffer occupation value at the time of the re-encoding corresponds to the joint designation position. Starting from an information value related to the VBV buffer occupancy value at the time of encoding image data, up to an information value related to the VBV buffer occupancy value at the time of encoding the fourth MPEG image data at a position corresponding to the end position of the splicing section The code amount control is performed so as to end with the re-encoding,
MPEG data recording and reproducing method characterized by the above.

As described above, according to the present invention, the first MPEG multiplexed data packet-multiplexed including the first and second MPEG image data (or the first MPEG image data as the element encoded data). And the second MPEG multiplexed data packet-multiplexed including the second MPEG image data as the element encoded data) at each designated connection designation position.
When the image data is played back by connecting to the second MPEG image data (when the first MPEG multiplexed data is played back by connecting to the second MPEG multiplexed data), the VBV buffer connection overflows Seamless and high-quality playback can be realized without any inconsistency of the underflow and underflow.

First, the concept of joint reproduction that can be realized by the present invention will be described. As shown in FIG. 8, when the second MPEG image data exists in the same way as the first MPEG image data which is the image data encoded by the first MPEG encoding method, the middle of the first MPEG image data (specified Consider that the second MPEG image data is connected and reproduced from the connection designated position). Assuming that the connection point (connection designation position in the first MPEG image data) is the position b, the reproduction is performed up to the position b in the first MPEG image data, and then the data is connected to the second MPEG image data. However, when MPEG image data are simply connected, there is a problem in that the connection of the VBV buffer is inconsistent and overflow or underflow occurs.

Therefore, first, the information of the VBV buffer at the time of encoding the first MPEG image data and the second MPEG image data by the MPEG encoding method is set to a predetermined section unit (the first predetermined image in the first MPEG image data). It is generated as side information in a section unit, and in the second MPEG image data, a second predetermined section unit) and is described in the recording medium.

Note that it is also possible to realize splicing reproduction without describing the information of the VBV buffer in this side information. In this case, two methods can be considered, which will be described later.
The information of the VBV buffer related to the first MPEG image data is the first of the first MPEG image data.
First VBV buffer occupancy value related information indicating the information value related to the VBV buffer occupancy value at the MPEG encoding start or end time of the last picture in the predetermined interval
This is first address information indicating the information value related to the VBV buffer occupation value at which position of the first MPEG image data the information value related to the V buffer occupation value.

The information of the VBV buffer regarding the second MPEG image data is the second of the second MPEG image data.
Second VBV buffer occupancy value related information indicating an information value related to the VBV buffer occupancy value at the time of starting or ending the MPEG encoding of the last picture in the predetermined interval
The second address information indicates the information value related to the VBV buffer occupation value at which position of the second MPEG image data the information value related to the V buffer occupation value.

The information value related to the VBV buffer occupancy value is, for example, a VBV buffer occupancy value or a VBV delay value defined by MPEG.
As described later, one unit of the first and second predetermined sections may be about 3 frames or about 1 GOP. The predetermined interval unit is assumed to be between ab in FIG. 8 for the first MPEG image data and between cd in FIG. 8 for the second MPEG image data.

In the information list of the VBV buffer, the position of a (the boundary of the first predetermined section before the first predetermined time from the connection specified position in the first MPEG image data: that is, the start of section A described later) The VBV buffer information at the position (position) and the VBV buffer information at the position b (the connection designation position in the first MPEG image data: that is, the end position of the section A described later) are described. Also, VB at the position c of the second MPEG image data (the boundary position of the second predetermined section in the second MPEG image data for the second predetermined time before the connection specified position).
Information on the V buffer and information on the VBV buffer at the position of the connection point d (the connection designation position in the second MPEG image data: the boundary position of the second predetermined section in this example) are also present.

Therefore, the data in the ab section (first connection section: here, section A) of the first MPEG image data is once decoded to obtain decoded image data, and the decoded image data (first connection section). (Decoded image data) is re-encoded by the MPEG encoding method. The re-encoded data created thereby is re-encoded MPEG image data of section A (first connected section re-encoded data).
I will call it. In this re-encoding, the transition of the information value related to the VBV buffer occupation value becomes a
Starting from the information value related to the VBV buffer occupancy value obtained based on the detected first VBV buffer occupancy value related information at the position d, and the detected second VBV buffer occupancy value related information at the position d Then, the rate control is performed so that the process ends up to the information value related to the VBV buffer occupation value obtained based on the above, and re-encoding is performed by the MPEG encoding method.

The operation of performing the conventional joint reproduction operation of reproducing to the position of b of the first MPEG image data and then reproducing the data by connecting to the position of d of the second MPEG image data is performed in section A. The following operation is performed using the re-encoded MPEG image data. That is, the first M
The first MPEG image data is reproduced up to the position a of the PEG image data (start position of section A), and then the re-encoded MPEG image data of section A is reproduced from the start position to the end position of the section. Then, the second MPEG image data is connected to the d position (connection designated position) of the second MPEG image data, and the second MPEG image data after d is reproduced. This is realized by providing a connecting reproduction means for performing this operation on the reproduction apparatus side.

By performing this joint playback operation, it is possible to realize seamless connection playback that has the same content content as the original first and second MPEG image data and that does not cause the VBV buffer to fail.

It should be noted that the re-encoding MP of the section shown in FIG. 8 based on only the first MPEG image data side.
In order to obtain EG image data, information in the VBV buffer at the position of the connection point d (connection designation position in the second MPEG image data) is required. As described above, the information in the VBV buffer is information at the start or end of MPEG encoding of the last picture in the predetermined section of the MPEG image data. It becomes. Therefore, the position of the connection point (connection specification position) needs to be specified as the boundary of the second predetermined section at least in the second MPEG image data. (That is, the position of the connection point d in the second MPEG image data needs to be specified as the boundary of the second predetermined section.)
Further, when re-encoded MPEG image data of the connecting section is obtained based only on the first MPEG image data side, as described above, VB at the position a (starting position of the connecting section A) shown in FIG.
V buffer information is also required. However, since the position of a is designated as the boundary of the first predetermined section before the first predetermined time from the connection point (connection designation position) b in the first MPEG image data, the position of the connection point b is set. Regardless, the information of the VBV buffer is obtained at the position a. Therefore, the position of the connection point b in the first MPEG image data does not necessarily have to be specified as the boundary of the first predetermined section.

Next, application examples thereof are shown in FIGS. 9 (2) and 9 (3). FIG. 1A is the same as the example shown in FIG. In the example shown in FIG. 8, the re-encoded MPEG image data of the section is obtained based on only the first MPEG image data side, and the joint reproduction is realized. However, only the second MPEG image data side is connected. It is also possible to obtain the re-encoded MPEG image data of the section and realize the joint reproduction. An example of this is shown in FIG. 9 (2), in which re-encoded MPEG image data in the connection section B in the second MPEG image data is used.

In FIG. 9 (2), a connection point (connection designation position) in the first MPEG image data is a position i, and a connection point (connection designation position) in the second MPEG image data is a position k. One unit of the first and second predetermined sections, which are units having the information of the VBV buffer described above, is a first unit.
In the MPEG image data, between ij, and in the second MPEG image data, between k−1. l
Is the boundary position of the second predetermined section after the second predetermined time from the connection point (connection designated position) k in the second MPEG image data. A section having the connection point k as the start position and the position l as the end position is defined as a connection section B (second connection section).

The data of the section B (k-1 section) connecting the second MPEG image data is once decoded to obtain decoded image data, and the decoded image data (second connection section decoded image data) is converted into MPEG.
Re-encoding is performed using the encoding method. The re-encoded data created thereby will be referred to as re-encoded MPEG image data (second connected interval re-encoded data) in the connection interval B. This re-encoding is started from the information value related to the VBV buffer occupancy value obtained from the transition of the information value related to the VBV buffer occupancy value based on the first VBV buffer occupancy value related information at the position i. The rate control is performed so as to end up to the information value related to the VBV buffer occupation value obtained based on the second VBV buffer occupation value related information at the position, and re-encoding is performed by the MPEG encoding method.

Then, using the re-encoded MPEG image data in the connection section B, connection reproduction from the first MPEG image data to the second MPEG image data is performed. That is, the first MPEG image data is reproduced up to the connection point i (connection designated position) of the first MPEG image data, and then the re-encoded MPEG image data of the section B is ended from the start position of the section. To the position, and then connected to the position 1 of the second MPEG image data (end position of the connecting section B) to reproduce the data of the second MPEG image data after the position l. . This is realized by providing a connecting reproduction means for performing this operation on the reproduction apparatus side.

By performing this joint playback operation, it is possible to realize seamless connection playback that has the same content content as the original first and second MPEG image data and that does not cause the VBV buffer to fail.

In addition, when obtaining re-encoded MPEG image data of a section connected based only on the second MPEG image data side shown in FIG. 9B, the position of the connection point i (in the first MPEG image data) Information of the VBV buffer at the connection designated position) is required. As described above, the information in the VBV buffer is information at the start or end of MPEG encoding of the last picture in the predetermined section of the MPEG image data. It becomes.
Therefore, the position of the connection point (connection specification position) needs to be specified as the boundary of the first predetermined section at least in the first MPEG image data. (That is, the position of the connection point i in the first MPEG image data needs to be specified as the boundary of the first predetermined section.)
Further, when re-encoded MPEG image data of a connection section is obtained based only on the second MPEG image data side, the position of l shown in FIG. position)
The VBV buffer information is also required. However, the position of l is specified as the boundary of the second predetermined section after the second predetermined time from the connection point (connection specification position) k in the second MPEG image data, so that the position of the connection point k is set. Regardless, information on the VBV buffer is obtained at position l. Therefore, the position of the connection point k in the second MPEG image data does not necessarily have to be specified as the boundary of the second predetermined section.

Next, an application example shown in FIG. 9 (3) will be described. In this example, the re-encoded MPEG image data of the section is obtained based on the first and second MPEG image data before and after the connection point, and the joint reproduction is realized.
In FIG. 9 (3), the connection point (connection designation position) in the first MPEG image data is set as the n position, and the connection point (connection specification position) in the second MPEG image data is set as the p position. One unit of the first and second predetermined sections, which are units having the information of the VBV buffer described above, is a first unit.
In the MPEG image data, the interval is mn, and in the second MPEG image data, the interval is p-q.

The position of m is the boundary position of the first predetermined section before the first predetermined time from the connection point (connection designated position) n in the first MPEG image data. A section having the position of m as the start position and the position of the connection point n as the end position is defined as a connection section A (first connection section). The position of q is the boundary position of the second predetermined section after the second predetermined time from the connection point (connection designated position) p in the second MPEG image data. The section B (second) is connected to a section having the connection point p as the start position and the position of q as the end position.
).

The data of the connection section A (mn section) of the first MPEG image data is once decoded to obtain decoded image data (connection section A decoded image data: first connection section decoded image data).
Further, the data of the segment B (pq segment) connecting the second MPEG image data is once decoded and decoded image data (joint segment B decoded image data: second segmented decoded image data).
Get.

The joint section A + B decoded image data (third joint section decoded image data) obtained by combining the joint section A decoded image data and the joint section B decoded image data is re-encoded by the MPEG encoding method. The re-encoded data created thereby connects the re-encoded MPEG image data in the section A + B (
This will be referred to as “third connected section re-encoded data”. This re-encoding is started from the information value related to the VBV buffer occupancy value obtained based on the first VBV buffer occupancy value related information at the position of m when the transition of the information value related to the VBV buffer occupancy value is The rate control is performed so as to end up to the information value related to the VBV buffer occupation value obtained based on the second VBV buffer occupation value related information at the position, and re-encoding is performed by the MPEG encoding method.

Then, using the re-encoded MPEG image data in the connection section A + B, connection reproduction from the first MPEG image data to the second MPEG image data is performed. That is, the first MPEG image data is reproduced until the start position m of the first MPEG image data connection section A, and then the re-encoded MPEG image data of the connection section A + B is ended from the start position of the section. The reproduction is performed up to the position, and then the second MPEG image data after the q position is reproduced by connecting to the end position q of the second MPEG image data connection section B. This is realized by providing a connecting reproduction means for performing this operation on the reproduction apparatus side.

By performing this joint playback operation, it is possible to realize seamless connection playback that has the same content content as the original first and second MPEG image data and that does not cause the VBV buffer to fail.

In the example shown in FIG. 9 (3), the position of m (the start position of the connecting section A) as described above.
VBV buffer information is required. Since the position of m is designated as the boundary of the first predetermined section for the first predetermined time before the connection point (connection designation position) n in the first MPEG image data, regardless of the position of the connection point n. Information on the VBV buffer is obtained at the position m. Therefore, the position of the connection point n in the first MPEG image data is not necessarily designated as the boundary of the first predetermined section.

Further, as described above, the VBV at the position of q (end position of the connecting section B) shown in FIG.
Buffer information is also required. Since the position of q is designated as the boundary of the second predetermined section after the second predetermined time from the connection point (connection specification position) p in the second MPEG image data, regardless of the position of the connection point p. Information of the VBV buffer is obtained at the position of q. Therefore, the second
The position of the connection point p in the MPEG image data is not necessarily designated as the boundary of the second predetermined section.

As described above, all the methods shown in FIGS. 9 (1) to 9 (3) can realize seamless and high-quality connection reproduction. As shown in FIG. It is also possible to realize linked reproduction in which the MPEG image data, the second MPEG image data, and the third and fourth MPEG image data are branched halfway as shown in the figure. Thus, with the present invention, the original MPEG
Re-encoding of connected sections without processing the image data itself. By simply generating and using MPEG image data, it can be freely connected to other MPEG data, so programs that make up various branch stories can be encoded. In this case, it is possible to efficiently use the media without recording redundant MPEG image data over the entire story for each branch story. (If the present invention is used, one set of each of the first to fourth MPEG image data and the re-encoded MPEG image data of the connecting section for each branch story may be prepared.)
If the method shown in FIG. 9 (3) is used, as described above, the position of the connection point in the first MPEG image data does not necessarily have to be specified as the boundary of the first predetermined section.
Since the position of the connection point in the MPEG image data does not necessarily need to be specified as the boundary of the second predetermined section, the information of the VBV buffer is smaller than the predetermined section unit described as side information in the predetermined section unit. This can be applied when editing with accuracy, for example, in units of one frame. This example will be described with reference to FIG. The predetermined unit may be about 3 frames or about 1 GOP, but here it is 1 GOP.

Assume that there are two MPEG streams to be connected as shown in FIG. At the points g and h indicated by arrows in the first MPEG stream, the VBV buffer information at the position g and the VBV buffer information at the position h are described in the VBV buffer information list. .
The second MPEG image data also includes information on the VBV buffer at position i and VBV at position j.
Buffer information is also present.

When connecting from the position of p of the first MPEG stream 1 to the head of the second MPEG stream, the data of the section A from g to p of the first MPEG stream is decoded, and further, the second MPEG stream The data of the section B from i to j is decoded, and both images are re-encoded so that the buffer transition starts from the buffer occupation value at the position g and becomes the buffer occupation value at the position j.

If the data thus created is referred to as re-encoded MPEG image data in the section A + B, reproduction is performed up to the position p of the first MPEG image data, which is a conventional reproduction operation, and then the second MPEG image is reproduced. The operation of connecting to data and reproducing the data is the first M
Playback to the position of g of PEG image data, and then re-encoding MPE of the section A + B
Seamless connection playback with the same content and no VBV buffer failure by playing back G image data and then connecting to j of the second MPEG image data to play back the data Can do.

Next, two methods for realizing connected reproduction similar to the above-described examples without describing the VBV buffer information as side information will be described. (A method for calculating the information value related to the VBV buffer occupation value, which is necessary when generating the re-encoded data of the connected sections will be described.)
First, the first method will be described. In the MPEG standard, basically CBR (consta
nt bit rate), that is, a fixed transfer rate, a VBV delay value indicating the buffer occupancy rate of the VBV buffer is defined in the picture layer of MPEG video. In this case, since the VBV delay value is described in units of pictures, by observing the MPEG image bitstream only with the picture header alone, the MPEG encoding start time (or the picture corresponding to the predetermined position of the MPEG image data) (or VBV buffer occupancy value at the time of termination) can be detected. In this case, for example, the function of the VBV buffer information detector 33 in FIG. 4 to be described later is the bit stream picture header (0x00000 in MPEG).
100-byte code) and then 10-bit temporal ref
This can be realized by detecting 16 bits of VBV delay following 10 bits of erence and 3 bits of picture coding type. What is VBV delay value?
VBV delay = 90000 x B / R
B: Buffer occupancy value R: Since it is defined by the bit rate, in the case of a fixed rate, VBV de
The VBV buffer occupancy value can also be calculated from the lay value. (For example, the calculation is performed by the VBV buffer information detector 33 shown in FIG. 4.)
In MPEG, it is necessary to pay attention to the VBV delay value at the vertex position of the graph as shown in FIG.

Next, the second method will be described. This is the case for a variable transfer rate rather than a fixed transfer rate. In the MPEG standard, basically, in the case of VBR (variable bit rate), the VBV delay value indicating the buffer occupancy of the VBV buffer in the MPEG video picture layer is all 1 (0xffff because all 16 bits are 1). It becomes. Therefore, the first method cannot be used.

Therefore, the following calculation is performed from the information obtained by observing the MPEG image bit stream. First, it is assumed that the VBV buffer is occupied from the very beginning of the bitstream up to the maximum value defined by MPEG (for example, 1.75 Mbit in the main profile main level). Next, the code amount of the first picture is subtracted. Next, using the transmission rate information of the peak rate in variable transfer rate coding, the transmission amount when the time between display pictures has elapsed is added, and the coding amount of the next picture is subtracted. By repeating such a series of addition and subtraction processes up to a predetermined bitstream position, a picture corresponding to a predetermined position in the MPEG image data is obtained by simulating a graph as shown in FIG. The VBV buffer occupation value at the MPEG encoding start time (or end time) can be obtained. The peak rate at the variable transfer rate is the sequence header in MPEG.
It is specified to be described in the syntax part of bit rate, so it can be obtained by referring to it.

For example, the VBV buffer information detector 33 shown in FIG. 4 to be described later is realized by providing the above-described MPEG image bit stream with an observation function and a calculation function. (In the case of the second method, the generated code amount of each picture must be observed and calculated from the head of the MPEG image bitstream. However, as in the first method, information in the VBV buffer is previously used as side information. There is no need to prepare.)
Next, a brief description will be given of the generation of re-encoded data for connected sections when the first and second methods are used. In addition, the connection reproduction | regeneration operation | movement using this connection area re-encoding data is as follows.
Since it is the same as the case where the joint section re-encoded data generated by the information of the VBV buffer recorded as side information in advance is used, the description is omitted here.

Re-encoded MPEG of sections connected based only on the first MPEG image data side shown in FIG.
When obtaining image data, the connection point (connection designated position) in the first MPEG image data
A section in which the position a in the first predetermined time before b is the start position and the connection designated position b in the first MPEG image data is the end position is defined as a first connection section (connection section A). The restriction such as the boundary of the first predetermined section as in the case of using the side information is not necessary for specifying the start position a of the connection section A. Similarly, there is no need to limit the boundary of the second predetermined section as in the case of using side information for specifying the connection point (connection specification position) d in the second MPEG image data.

The data of the ab section (joining section A) of the first MPEG image data is once decoded to obtain decoded image data, and the decoded image data (first joining section decoded image data) is re-encoded by the MPEG encoding method. Encoding is performed to obtain re-encoded MPEG image data (first joint section re-encoded data) in the joint section A. In this re-encoding, the transition of the VBV buffer occupancy value is MPEG-encoded (first MPE) of the picture corresponding to the position a calculated by the first or second method.
It starts from the VBV buffer occupancy value at the start (or end) of MPEG encoding at the time of G image data generation. Then, the transition of the VBV buffer occupancy value is calculated by the first or second method, and the MPEG encoding of the picture corresponding to the position d (MPEG encoding at the time of generating the second MPEG image data) is started. The rate control is performed to re-encode with the MPEG encoding method so as to end up to the VBV buffer occupation value at (or the end time). The obtained re-encoded MPEG image data of the connection section A (first connection section re-encoded data) is recorded on the recording medium. (For example, recording is performed by a data writing unit 37 shown in FIG. 4 described later.)
Next, the re-encoding M of the section is performed based only on the second MPEG image data side shown in FIG.
A case where PEG image data is obtained will be described. In FIG. 9 (2), a connection point (connection designation position) in the first MPEG image data is a position i, and a connection point (connection designation position) in the second MPEG image data is a position k. A second MPEG having a connection point k as a start position and a position l that is a position after a second predetermined time from the connection point (connection designated position) k as an end position.
A section of image data is defined as a connecting section B (second connecting section). A restriction such as the boundary of the second predetermined section as in the case where the side information is used to specify the end position 1 of the connection section B is not necessary. Similarly, there is no need to limit the boundary of the first predetermined section as in the case where the side information is used for specifying the connection point (connection specification position) i in the first MPEG image data.

The data of the connecting section B (k-1 section) of the second MPEG image data is once decoded to obtain decoded image data, and the decoded image data (second connecting section decoded image data) is MPEG-encoded. Re-encoding is performed according to the method to obtain re-encoded MPEG image data (second connection interval re-encoded data) of the connection interval B. In this re-encoding, the transition of the VBV buffer occupancy value is calculated by the above first or second method, and the VBV buffer occupancy at the MPEG encoding start time (or end time) of the picture corresponding to the position i is calculated. Start with a value. The transition of the VBV buffer occupancy value ends up to the VBV buffer occupancy value calculated at the MPEG encoding start point (or end point) of the picture corresponding to the position l calculated by the first or second method. As described above, rate encoding is performed and re-encoding is performed using the MPEG encoding method. The re-encoded MPEG image data (second connected section re-encoded data) of the obtained connecting section B is recorded on the recording medium. (For example, recording is performed by a data writing unit 37 shown in FIG. 4 described later.)
Next, a case where re-encoded MPEG image data in a section is obtained based on the first and second MPEG image data before and after the connection point shown in FIG. 9 (3) will be described.

In FIG. 9 (3), the connection point (connection designation position) in the first MPEG image data is set as the n position, and the connection point (connection specification position) in the second MPEG image data is set as the p position.
Let m be a position a first predetermined time before a connection point (connection designated position) n in the first MPEG image data. A section of the first MPEG image data having the position of m as the start position and the position of the connection point n as the end position is defined as a connection section A (first connection section). The position after the second predetermined time from the connection point (connection designated position) p in the second MPEG image data is q. A section of the second MPEG image data having the connection point p as the start position and the position of q as the end position is defined as a connection section B (second connection section).

In order to specify the start position m of the connection section A, there is no need to restrict the first predetermined section as in the case of using side information. Similarly, there is no need to limit the boundary of the second predetermined section as in the case of using side information to specify the end position q of the connection section B.

The data of the connection section A (mn section) of the first MPEG image data is once decoded to obtain decoded image data (connection section A decoded image data: first connection section decoded image data).
Also, the data of the connection section B (pq section) of the second MPEG image data is once decoded to obtain decoded image data (connection section B decoded image data: second connection section decoded image data). .

Then, the joint section A + B decoded image data (third joint section decoded image data), which is a combination of the joint section A decoded image data and the joint section B decoded image data, is re-encoded by the MPEG encoding method. The re-encoded data created thereby is assumed to be re-encoded MPEG image data (third connected interval re-encoded data) in the connection interval A + B. In this re-encoding, the transition of the VBV buffer occupancy value is M of the picture corresponding to the position of m calculated by the first or second method.
It starts from the VBV buffer occupancy value at the start (or end) of PEG encoding. The transition of the VBV buffer occupancy value ends up to the VBV buffer occupancy value calculated at the MPEG encoding start time (or end time) of the picture corresponding to the position q calculated by the first or second method. As described above, rate control is performed and re-encoding is performed using the MPEG encoding method. The resulting re-encoded MPEG image data (third re-encoded data) is recorded on a recording medium. (For example, recording is performed by a data writing unit 37 shown in FIG. 4 described later.)
Also in the example shown in FIG. 10, it is of course possible to obtain the VBV buffer occupancy value at a required position by the above-described calculation method, and to obtain desired connected section re-encoded data).

Next, VBV buffer information to be recorded on the recording medium by one embodiment of the recording / reproducing apparatus to which the present invention is applied (for each predetermined section of the MPEG image data, the MPEG of the last picture in the section)
VBV buffer occupancy value related information indicating an information value related to the VBV buffer occupancy value at the start or end of encoding, and an information value related to the VBV buffer occupancy value at which position of the MPEG image data the information value related to the VBV buffer occupancy value Address information indicating whether or not) and a recording structure relating to MPEG image data will be described in detail. MPEG recording media
MPEG image data that is image data compressed by the encoding method is recorded. The MPEG image data is recorded as a bit stream in which a plurality of continuously reproducible data encoded and generated in one recording unit is continuously connected.

In addition to these encoded MPEG image data bitstreams, the V at the end of picture encoding one frame before the I picture in the MPEG image data bitstream.
BV buffer value (occupancy value), VBV buffer value (occupation value) at the end of picture encoding one frame before the P picture, and each VBV buffer value is the VBV buffer occupancy value at which position in the MPEG image data Address information (in this example, a relative address from the beginning of the MPEG image data file) indicating whether or not there is recorded. A data structure of VBV buffer information including these data is shown in FIG.

VBV buffer information has a hierarchical structure. There is an entry point information structure first, followed by a VBV information structure. The entry point information structure starts with 32 bits for the number of entry point (EP) addresses, followed by EPn (n is a natural number of 1 or more).
Address is described in order of 32 bits. The EPn address indicates a position where EPn information (n is a natural number of 1 or more) of the VBV information structure is described, and describes a relative address from the top of the VBV buffer information. On the other hand, the VBV information structure is described in order from the EP1 information, and the contents of the EP1 information describe the relative address, the PTM value, and the VBV value in order.

As shown in FIG. 2, the relative address in the EPn information of the VBV information structure is the picture encoding end point one frame before the I picture in the bit stream of MPEG image data, P
The MP at the end of picture encoding one frame before the picture and at the end of recording
This is a relative address from the beginning of the EG image data. For example, the unit is a byte. When recorded on a disk medium, a sector or the like is used as a relative address.

The PTM value in the EPn information of the VBV information structure is a time stamp recorded with a clock of 90 kHz or 27 MHz in the MPEG system standard (multiplexing standard). MPE
In the G standard, it is called PTS (Presentation Time Stamp) or DTS (Decoding Time Stamp). Here, the DTS is recorded as time information at the end of picture encoding one frame before the I picture of the bit stream of the MPEG image data, at the end of picture encoding one frame before the P picture, and at the end of recording. . One DTS is recorded in one picture, and an NTSC video signal is recorded at an interval of 3003 clocks per picture with a 90 kHz clock. Therefore, in the case where an I picture or a P picture exists for every three pictures as in the present invention, when starting from 0 at the very beginning, 9009, 1801
PTM information is described in the EPn information at intervals of 8 ....

The VBV value in the EPn information of the VBV information structure is a virtual buffer occupation value of the decoder defined by MPEG. This can be derived from the amount of generated code for each picture of MPEG image data and the transfer rate value. As shown in FIG. 3, the picture code of one frame before the I picture and P picture of the compressed bit stream information Describe the VBV occupation value at the position of ○ in the figure at the end of conversion. Or, describe the VBV delay value specified by MPEG. This value is a value converted to the time required for the transfer rate at that time to the VBV occupation value. In the present invention, any information regarding the VBV buffer occupation value may be used. V
The relationship between the BV buffer occupation value and the VBV delay value is shown in FIG. The occupancy value OCC of the VBV buffer has a relationship of VBV delay = 90000 * OCC / R, where R is the encoding rate, and 90000 is a value for indicating a count number of 90 kHz.

In MPEG compression, encoding is basically performed using I or P picture types in units of 3 frames such as IBB and PBB. In MPEG compression, B picture may be predicted from both directions, so in the encoded bit stream order, data linkage is added only at the end of picture encoding one frame before the I picture and P picture of the bit stream. Is not easy. For this reason, the present invention is described on the assumption that VBV information is described at the end of picture encoding one frame before the I picture and P picture of the bit stream.

However, in essence, an information value related to the VBV occupation value may be included in each picture.
Further, the encoding start point may be used instead of the picture encoding end point. FIG. 16 (1) is a conceptual diagram in the case of having a value of the encoding end point in the list, but in this case, there is no information value regarding the first VBV occupation value, so there is a virtual before the first frame. As a result, the information value related to the VBV occupancy value at the end of encoding of the virtual frame is calculated as an initial value. The calculation is performed by adding the first picture code amount to the information value related to the first VBV occupancy value, and from the added value, from the gradient due to the encoding rate, how much code is required in the time of (1 / picture rate) By subtracting the calculated value of the transmission amount, the initial value of the black circle part in FIG. FIG. 16 (2) is a conceptual diagram in the case of having the value of the encoding start point in the list. In this case, since there is no information value regarding the last VBV occupation value, a virtual is behind the last frame. If there is a specific frame, the information value related to the VBV occupancy value at the start of encoding of the virtual frame is calculated as the final value. The calculation is performed by subtracting the final picture code amount from the information value related to the final VBV occupancy value, and from the subtracted value, from the gradient by the encoding rate, (1 /
When the value calculated for how much code transmission amount is obtained by the time of only (picture rate) is added, the final value of the black circle portion in FIG.

Next, the configuration of an embodiment of a recording / reproducing apparatus to which the present invention is applied is shown in FIG. 4, and the operation of creating VBV buffer information while encoding image data by the MPEG encoding method will be described.
When there is no encoded data in the recording medium 31, that is, when encoding is performed for the first time, the data reading unit 32 from the recording medium 31 indicates that no data is present, so that information indicating no data is indicated as VBV buffer information. Transmit to detector 33. VBV buffer information detector 3
Since no data exists even at 3, the initial value set in advance in the parameter setting unit 34, that is, the VBV value is set to, for example, 80% of the maximum value of VBV defined by MPEG, and the PTM timestamp information is 0. And These initial set values are transmitted to the image encoder 35.

The image encoder 35 starts encoding from an initial set value. The image encoder 35 performs encoding while one frame before the I picture of the bit stream and 1 of the P picture.
The generated code amount, PTM value, and VBV value at the end of picture encoding before the frame are transmitted to the VBV buffer information creator 36 each time. At the same time, the encoded data is transmitted to the data writing unit 37. Further, the image encoder 35 transmits the generated code amount, the PTM value, and the VBV value when the user temporarily stops or ends the image compression recording to the VBV buffer information creator 36.

The VBV buffer information creator 36 creates VBV buffer information data having the structure shown in FIG. 1 from the generated generated code amount value, PTM value, and VBV value. Alternatively, data necessary for creating the data structure is stored in memory and recorded and held in a predetermined format. The information created by the VBV buffer information creator 36 may be written in bursts simultaneously when encoded data (MPEG image data) is written on the recording medium 31 by the data writing unit 37. The information generated by the VBV buffer information generator 36 is recorded and held in a predetermined format after the encoded data (MPEG image data) has been written, that is, after the user has paused or ended the image compression recording. The written data may be converted into the structure shown in FIG.

Next, for the first and second MPEG image data recorded on the recording medium 31,
A case where re-encoding of the section A in order to enable splicing reproduction from a predetermined position will be described with reference to FIG.

First, from the user interface (not shown), the first and second already recorded
The point where the two MPEG image data are to be connected and played back is specified.
The recording medium 31 has already recorded the first and second MPEG image data (compressed encoded stream) and the VBV buffer information generated by the recording / reproducing apparatus shown in FIG. Therefore, the data reading unit 32 shown in FIG.
The VBV value at the position a in FIG. 8 at the position before the section A from the (designated connection position), PTM
Get value, relative address.

When the connection playback position is specified from the user interface, for example, when the specification method is position information of the relative address of the data, the value closest to the relative address information in the EPn information of the structure of the VBV buffer information is set. Use VBV and PTM values linked to data. Also, if the method of designation is the time from the start time of the data or the time stamp information of the points to be played back, the PTM value in the EPn information of the structure of the VBV buffer information is similarly used, If this value is recorded with a 90 kHz clock, the time of seconds can be obtained by multiplying that value by the value of 1/90000 seconds.
VBV and PTM values can be obtained.

These values are input to the parameter setter 34, and the image encoder 35 starts encoding from the set values. On the other hand, the encoded data search unit 38 searches the bit stream already recorded for the start position of the section A to be re-encoded. In the search, a pointer is set at a position from the head of the bit stream file using the relative address of the data.

The image encoder 35 decodes the first MPEG image data corresponding to the section A, and the transition of the VBV buffer occupation value is started again from the VBV value at the position a using the decoded image.
Rate control is performed so that the processing is completed up to the VBV value at the position d, and re-encoding is performed by the MPEG encoding method. For re-encoding, an image completely decoded as described above may be used, but a code amount control technique on a bit stream as disclosed in Japanese Patent Laid-Open No. 11-234677 may be used.

Here, if the section A to be re-encoded is longer than the minimum unit of the VBV buffer information, the re-encoding occurs at the end of picture encoding one frame before the I picture and P picture of the bit stream. The code amount, the PTM value, and the VBV value are transmitted to the VBV buffer information creator 36 each time. At the same time, the re-encoded data is transmitted to the data writing unit 37.

The VBV buffer information creator 36 creates data having the structure shown in FIG. 1 from the input generated code amount value, PTM value, and VBV value. Alternatively, data necessary for creating the data structure is stored in memory and recorded and held in a predetermined format. The information in the VBV buffer information generator 36 may be written in bursts at the same time when the encoded data is written, or when the encoded data is written, that is, the user compresses the image. From the data recorded and held in a predetermined format when the recording is paused or terminated, FIG.
It is also possible to write after converting into the structure of

The re-encoded image data of the section A (joined section A re-encoded data) is the first and second M
It is recorded as a separate file separated from the PEG image data. Or record second MP
The EG image data is recorded linked to the head.

First MPEG image data, second MPEG image data, information on the VBV buffer occupancy value and data address information thereof, re-encoded image data of section A (or re-encoded image data of section B, Alternatively, the re-encoded image data of the section A + B) may be recorded on the same recording medium, recorded on a plurality of recording media in any combination, or recorded on different recording media. It doesn't matter. In the case of being recorded separately on a plurality of recording media, it indicates that they are the same information group so that each recording medium is linked and operated (each data and information is linked). information,
For example, an ID or the like may be recorded on each recording medium. First MPEG image data and second
When MPEG image data and re-encoded image data of section A (or re-encoded image data of section B or re-encoded image data of section A + B) are recorded on the same recording medium Can control joint playback on the playback device side with a single recording medium.

In addition, information regarding the VBV buffer occupancy value for obtaining the connected section re-encoded image data,
When calculating by calculation instead of reading from the side information recorded on the medium,
It is not necessary to record information about the VBV buffer occupation value and its data address information.

In the above embodiment, the recording medium is described as a recording medium in the recording / reproducing apparatus. However, the recording medium may be a recording medium detachably attached to the recording / reproducing apparatus or a recording medium (database) via a network.

In the above embodiment, an example of connecting image data by focusing on single MPEG image data has been described. However, it is MPEG multiplexed data that is packet-multiplexed by the MPEG method together with audio data and the like.
You may apply when connecting the MPEG image data in an MPEG transport stream.

In many cases, variable-length-encoded MPEG image data, fixed-length-encoded MPEG 1 layer 2 audio, AC3, or the like are multiplexed in the transport stream. Therefore, when connecting MPEG image data, which is one of the element encoded data in the multiplexed data, a connection method that takes into account the consistency of the STD buffer (VBV buffer in video) defined by MPEG at the point of connection As described above, the method of the embodiment described above may be applied.

For example, the first and second MPEG image data to be connected are extracted from the first and second MPEG transport streams, respectively, and connected in the same manner as in the above-described embodiment. Linked segment re-encoded data (re-encoded image data of interval A, re-encoded image data of interval B, re-encoded image data of interval A + B) used for splicing reproduction is packet-multiplexed by the MPEG method. The generated MPEG multiplexed data may be recorded.

The state shown in FIG. 14 (1) indicates the state of the packet multiplexed data of the MPEG transport stream. Packets marked V are video packets, packets marked A are audio packets, packets marked S are PAT used by the system
And information packets such as PMT. It is recorded in a form that complies with the rules of each MPEG2 system. The video packet has a light gray color. The state showing these as a whole is FIG. The state where only the video packets are collected is shown in FIG. The contents of this video packet are typically an I picture, followed by two B pictures, followed by one P picture, as shown in Figure 4 (4). is there.

The code amount is adjusted by re-encoding in one or more of these pictures. For example, FIG. 5 shows a state in which the code amount is reduced. The code amount of each picture is small. The packetized state in this state is FIG. The reduced area is black. This packet reduces the overall amount of video. Then rebuild the TS. This state is expressed as a whole (7). FIG. 8 is an enlarged view of FIG. As a result, a part of the V packet is reduced, and the other element data packets are multiplexed as they are.

In the MPEG system, PCR clock information must be recorded once every 100 msec. Since the data length is changed, the PCR clock information described in each element packet is changed as necessary. In addition, PTS and DTS are described in a packet in which the PES header at the head of an access unit (frame or field picture unit) is present in the video packet. In the audio packet, one or a plurality of audio frames are packed with PES, and the PTS is described in the packet having the leading PES header. These time stamp information does not need to be changed if the number of pictures is not increased or decreased in the image, and the audio does not need to be changed unless the playback time length is increased or decreased. Add and modify appropriate PTS and DTS.

Furthermore, when re-encoding is simply performed, I is the reset timing of predictive encoding.
If the GOP unit from the picture is easy to handle, but the GOP is not independent, that is, if the border B picture is predicted across both GOPs (if GOP closed gop = 0), then one It may be necessary to decode the last reference picture of the previous GOP and store it in an image re-encoding memory (not shown).

First MPEG multiplexed data (first MPEG transport stream), second MPEG image data (second MPEG transport stream), information on the VBV buffer occupancy value, its data address information, and the section A spliced section generated by packet multiplexing according to the MPEG method including A recoded image data (or the recoded image data of the section B or the recoded image data of the section A + B) as element coded data What is MPEG multiplexed data?
It may be recorded on the same recording medium, recorded on a plurality of recording media in any combination, or recorded on different recording media. In the case of being recorded separately on a plurality of recording media, it indicates that they are the same information group so that each recording medium is linked and operated (each data and information is linked). Information, such as an ID, may be recorded on each recording medium. First MPEG multiplexed image data, second MPEG multiplexed image data, re-encoded image data of section A (or re-encoded image data of section B, or re-encoded image of section A + B) (Data) splicing section MPEG multiplexed data is recorded on the same recording medium, it is possible to control splicing playback on the playback device side with a single recording medium.

It is a figure which shows the VBV buffer information structure based on one Example of the recording / reproducing apparatus to which this invention is applied. It is a figure which shows the relationship between MPEG image data and a relative address in one Example. It is explanatory drawing explaining the VBV value in one Example. It is a block diagram which shows one Example of the recording / reproducing apparatus to which this invention is applied. It is a figure which shows an example of the conventional MPEG encoder. It is a figure which shows an example of the conventional MPEG decoder. It is a figure for demonstrating the VBV buffer concept in MPEG. It is a figure for demonstrating the concept of the joint reproduction | regeneration which can be implement | achieved by this invention. It is a figure for demonstrating the concept of the joint reproduction | regeneration which can be implement | achieved by this invention. It is a figure for demonstrating the concept of the joint reproduction | regeneration which can be implement | achieved by this invention. It is explanatory drawing which shows the conventional MPEG multiplexing system. It is explanatory drawing which shows the relationship between MPEGTS, PS, and PES. It is explanatory drawing which shows the usage example of PSI of MPEGTS. It is explanatory drawing which shows MPEGTS packet arrangement | positioning. It is a figure for demonstrating the concept of the joint reproduction | regeneration which can be implement | achieved by this invention. It is a figure for demonstrating the information value regarding the VBV buffer occupation value in one Example. It is a figure which shows the relationship between a VBV buffer occupation value and a VBV delay value.

Explanation of symbols

Reference Signs List 31 Recording medium 32 Data reading unit 33 VBV buffer information detector 34 Parameter setting unit 35 Image encoder 36 VBV buffer information generator 37 Data writing unit 38 Encoded data search unit

Claims (1)

In each of the first and second MPEG multiplexed data packet-multiplexed by the MPEG method recorded on the first recording medium, the MPEG code included in the first MPEG multiplexed data as element encoded data MPEG data of the first MPEG image data encoded by the encoding method and the second MPEG image data encoded by the MPEG encoding method that includes the second MPEG multiplexed data as element encoded data As a data to be reproduced by connecting from the first MPEG image data to the second MPEG image data at a specified connection specification position in the image data, a re-encoding of a connection section encoded by the MPEG encoding method is performed. Providing a recording step for generating and recording digitized data;
Two MPEG image data, which are image data encoded by the MPEG encoding method, are reproduced by connecting from one MPEG image data to the other MPEG image data at a specified connection specification position in each MPEG image data. An MPEG data recording / reproducing method provided with a connected reproduction step for performing
The recording step includes
The connection specified position in the second MPEG image data is set as a start position, and a section having a position after a predetermined time from the connection specified position in the second MPEG image data as an end position is set as a connection section.
Re-encoding the connection interval decoded image data, which is image data obtained by decoding the second MPEG image data of the connection interval, using the MPEG encoding method, and generating the connection interval re-encoded data, The first and second MPEG multiplexed data of the first recording medium is obtained by combining the segmented MPEG multiplexed data generated by packet multiplexing according to the MPEG method, including the segmented recoded data as the element encoded data. Are recorded in a different area from each recorded area,
In the re-encoding, information on the VBV buffer occupancy value at the time of encoding the first MPEG image data at a position corresponding to the connection designated position is a transition of an information value related to the VBV buffer occupancy value at the time of re-encoding. The code amount control is performed so that the code value is controlled so as to end up to the information value related to the VBV buffer occupation value at the time of encoding the second MPEG image data at the position corresponding to the end position of the connecting section. Is,
The splicing reproduction step has a first splicing reproduction step of reproducing from the first recording medium and a second splicing reproduction step of reproducing from the second recording medium,
The first splicing reproduction step includes
The first MPEG image data is obtained from the first MPEG multiplexed data recorded on the first recording medium, and from the second MPEG multiplexed data recorded on the first recording medium. Obtaining the second MPEG image data, obtaining the joint section re-encoded data from the joint section MPEG multiplexed data recorded on the first recording medium,
After the first MPEG image data is reproduced up to the connection designated position in the first MPEG image data, the connection section re-encoded data is reproduced from the start position to the end position of the connection section. A joint reproduction step of reproducing the second MPEG image data from an end position of the joint section in the MPEG image data of 2;
The second splicing reproduction step includes
Third MPEG multiplexing that is generated by packet multiplexing according to the MPEG method, including the third MPEG image data encoded by the MPEG encoding method as element encoded data, and recorded on the second recording medium The third MPEG image data is obtained from the data, the fourth MPEG image data encoded by the MPEG encoding method is included as element encoded data, packet-multiplexed by the MPEG method, and generated by the second multiplexing. The MPEG format is obtained by obtaining the fourth MPEG image data from the fourth MPEG multiplexed data recorded on the recording medium, and including re-encoded data as segment encoded data, which is data to be reconstructed. Or connected segment MPEG multiplexed data generated by packet multiplexing and recorded in a region different from each of the third and fourth MPEG multiplexed data recorded on the second recording medium. To obtain the re-encoded data of the connecting section,
After the third MPEG image data is reproduced up to the connection designation position in the third MPEG image data, the connection section re-encoded data is started as a predetermined connection section set in the fourth MPEG image data. Replaying from a position to an end position, and then replaying the fourth MPEG image data from the end position of the splicing section in the fourth MPEG image data,
The splice section re-encoded data recorded on the second recording medium has a splice designated position in the fourth MPEG image data as a start position, and is predetermined from the splice designated position in the fourth MPEG image data. Using the section having a position after time as an end position as the joining section, the joint section decoded image data, which is image data obtained by decoding the fourth MPEG image data of the joining section, is converted into the MPEG encoding method. Re-encoded data generated by re-encoding at
The joint section re-encoded data recorded on the second recording medium has the third MPEG at a position where the transition of the information value related to the VBV buffer occupation value at the time of the re-encoding corresponds to the joint designation position. Starting from an information value related to the VBV buffer occupancy value at the time of encoding image data, up to an information value related to the VBV buffer occupancy value at the time of encoding the fourth MPEG image data at a position corresponding to the end position of the splicing section The code amount control is performed so as to end with the re-encoding,
MPEG data recording and reproducing method characterized by the above.

Images