JP4810298B2 - Image encoding apparatus, encoding method, image decoding apparatus, and decoding method - Google Patents

Abstract

An encoding method and apparatus which include a coded picture that enables special playback to be easily performed while suppressing reduction in coding efficiency are provided. Coding is performed per a certain number of pictures, including pictures for special playback. When coded pictures for special playback using an interframe predictive coding scheme, referencing is limited to coded pictures encoded using an intraframe predictive coding scheme or coded pictures encoded using the interframe predictive coding scheme having the same reference limitation.

Description

  The present invention relates to a technique for encoding video information, particularly moving picture information, and a technique for decoding the encoded moving picture information.

  In recent years, there is an increasing need for high image quality for video information, and television broadcasting is also shifting from the conventional SD (standard image quality) of 720 × 480 pixels to HD (high image quality) of 1920 × 1080 pixels.

  Since the amount of data increases as a result of higher image quality, development of a more efficient encoding algorithm is desired. In ITU-T SG16 and ISO / IEC JTC1 / SC29 / WG11, standardization work of a compression coding method using interframe prediction is in progress.

Currently, H.264 is an encoding method that is said to realize the most efficient encoding. H.264 / AVC (MPEG-4 PART10). One of the technical features newly introduced in this encoding method is that a reference image used for interframe predictive encoding can be selected from a plurality of frames. That is, even an image frame that is separated in time can be adopted as a reference image if an improvement in encoding efficiency is expected.
However, realization of high-efficiency coding by allowing such flexible reference image selection raises a problem during special reproduction (see Patent Document 1).

  Conventionally, in the MPEG2 system widely used for encoding moving image information, each image frame is encoded by either intraframe encoding, forward interframe encoding, or bidirectional interframe encoding. . The encoded frames are referred to as I picture, P picture, and B picture depending on the applied encoding scheme.

  In the MPEG2 system, the reference picture of the P picture is limited to the immediately preceding I picture or P picture. Therefore, it is possible to extract only the I picture and the P picture and correctly decode and reproduce them. For example, high-speed reproduction can be easily realized.

  However, H. In the H.264 system, not only a P picture can be used as a reference image but also a B picture can be used as a reference picture. Accordingly, when only the I picture and the P picture are extracted from the encoded image stream and reproduced, it is difficult to perform normal decoding on the P picture using the B picture as a reference image.

  In Patent Document 1, when performing high-speed playback, a group of temporally continuous frames from an I picture to at least the first P picture is decoded between the I picture and the picture immediately before the next I picture. To do. Only the I picture and P picture included in the decoded frame group are reproduced.

JP 2004-328511 A (paragraph [0166], FIG. 12 and paragraph [0187])

  As mentioned above, H.M. In the H.264 system, since a reference image at the time of interframe coding can be flexibly selected, in principle, only pictures that can be used for special reproduction are I pictures.

  Note that Patent Document 1 describes that if pictures from I picture to P picture are extracted, the I picture and the P picture can be decoded. However, H. In the H.264 / AVC standard, a B picture referred to by a P picture allows a picture older than an I picture to be referenced, and therefore there is a possibility that the P picture cannot be decoded. Patent Document 1 does not disclose a countermeasure for such a case.

  Although it is conceivable that encoding is performed by increasing the number of I pictures for the special playback mode, the encoding efficiency is lowered, and a high-efficiency encoding is realized by allowing a flexible reference relationship. The characteristics of the H.264 system cannot be used.

The present invention has been made in view of the above-described problems of the prior art, and encodes moving image information while including a coded picture that can easily perform special reproduction while suppressing a decrease in coding efficiency. It is an object of the present invention to provide an encoding device and an encoding method that can be encoded.
Another object of the present invention is to provide a decoding device and a decoding method for decoding moving picture information encoded by the encoding device and the encoding method according to the present invention.

That is, the above-described object is an encoding apparatus that encodes each picture constituting a moving image using either an intra-frame predictive encoding scheme or an inter-frame predictive encoding scheme, and is applied to each picture. A control unit that selects an encoding method; and an encoding unit that encodes each picture based on the encoding method selected by the control unit. The control unit applies each picture corresponding to a predetermined period to each picture. On the other hand, whether or not to select the intra-frame prediction encoding method is determined according to a predetermined criterion, and when it is determined that the intra-frame prediction encoding method is selected, the intra-frame prediction encoding method is selected, and the frame between the inner predictive coding referenced picture when determining not to select the other corresponding to the period defined in the predictive-coded picture or pre-frame frame prediction coding picture relevant Restricted select predictive coding between frames, out of the picture that does not correspond to a predetermined cycle, for some pictures, limits the coded picture corresponding to the referenced picture predetermined period It has been selected predictive coding scheme between frames, for the remaining pictures, selecting one of the intra-frame predictive coding or inter the referenced image without restrictions frame prediction coding method, coding means However, among pictures corresponding to a predetermined cycle, a picture for which the interframe predictive coding method with a limited reference image is selected by the control means is used for high-speed playback at a predetermined search speed. Information indicating that it is the first limited interframe predictive coded picture to be decoded is added, and one of the pictures not corresponding to a predetermined cycle is added. Characterized in that for the picture, adding information indicating the predictive coded picture between the second restricted frames processed decoded when high-speed reproduction by fast search speed than the predetermined search speed This is achieved by the encoding device of the present invention.

In addition, the above-described object is a decoding apparatus that receives and decodes moving picture information in which a plurality of pictures are encoded, and the encoded moving picture information is used for encoding each picture. It includes information indicating a coding method, coding picture corresponding to the predetermined cycle is, the encoded frame prediction coded picture in the intra-frame predictive coding scheme, the referenced picture frame predictive coding It is composed of a first restricted inter-frame predictive coding picture which has been encoded in other inter-frame prediction coded picture in between the restriction frame predictive coding scheme corresponding to the picture or predetermined period, in advance Among the encoded pictures that do not correspond to a predetermined period, an interframe prediction code in which some of the encoded pictures are limited to encoded pictures whose reference destination image corresponds to a predetermined period It consists of the second restricted inter-frame predictive coding picture which has been coded in the manner, the remaining coded picture, inter-frame predictive coding scheme frame prediction coded picture or the referenced image is not limited The decoding apparatus is composed of encoded inter-frame prediction encoded pictures , and the decoding apparatus includes an acquisition unit that acquires information representing an encoding scheme from the encoded moving image information, and an encoding scheme acquired by the acquisition unit A decoding unit that decodes each encoded picture included in the encoded video information, a detection unit that detects a high-speed playback execution instruction, and a detection unit configured to perform a predetermined search speed when detecting an instruction to execute high-speed reproduction, among the video information encoded, the decoding means and predictive coded picture between a first restricted frames and predictive coded picture frame Is Goka, when the detection means detects an instruction to execute high-speed reproduction by fast search speed than the predetermined search speed is one prediction coding picture and the first restricted inter-frame predictive coded picture frames and parts, also achieved by the decoding device of the present invention characterized by having a decoding control means for decrypted the decoding means and the predictive coded picture between the second restricted frame.

The above-described object is an encoding method for encoding each picture constituting a moving image using either an intra-frame predictive encoding method or an inter-frame predictive encoding method. A control step for selecting an encoding scheme to be applied to the picture, and an encoding means for encoding each picture based on the encoding scheme selected in the control step; For each picture corresponding to a predetermined period, whether or not to select an intra-frame predictive coding method is determined according to a predetermined criterion, and if it is determined to select an intra-frame predictive coding method, a frame select inner predictive coding method, circumferential the referenced picture has been determined in predictive-coded picture or pre-frame, if it is determined not to select the intra-frame predictive coding scheme As well as select other Inter frame predictive coding scheme is limited to picture corresponding to, among the picture that does not correspond to a predetermined cycle, for some picture, referenced picture in advance select frame predictive coding scheme is limited to a coded picture corresponding to the prescribed period, for the remaining pictures, intraframe predictive coding or inter no limit to the referenced picture frame predictive coding In the encoding step, among pictures corresponding to a predetermined cycle, an interframe predictive encoding method with a limited reference image is selected for a picture selected by the control means. Is information indicating that it is the first limited inter-frame predictive coded picture that is decoded during high-speed playback at a predetermined search speed. In addition, for some of the pictures that do not correspond to a predetermined period, a second restricted frame that is decoded at the time of high-speed playback at a search speed faster than a predetermined search speed This can also be achieved by the encoding method of the present invention characterized by adding information indicating that the picture is an inter prediction encoded picture .

Also, the above-described object is a decoding method for receiving and decoding moving picture information in which a plurality of pictures are encoded, and the encoded moving picture information is used for encoding each picture. It includes information indicating a coding method, coding picture corresponding to the predetermined cycle is, the encoded frame prediction coded picture in the intra-frame predictive coding scheme, the referenced picture frame predictive coding It is composed of a first restricted inter-frame predictive coding picture which has been encoded in other inter-frame prediction coded picture in between the restriction frame predictive coding scheme corresponding to the picture or predetermined period, in advance Among the encoded pictures that do not correspond to a predetermined period, an interframe prediction code in which some of the encoded pictures are limited to encoded pictures whose reference destination image corresponds to a predetermined period It consists of the second restricted inter-frame predictive coding picture which has been coded in the manner, the remaining coded picture, inter-frame predictive coding scheme frame prediction coded picture or the referenced image is not limited It is composed of encoded inter-frame predictive encoded pictures , and the decoding method includes an acquisition step in which an acquisition unit acquires information representing an encoding method from encoded video information, and a decoding unit includes: A decoding step for decoding each encoded picture included in the encoded moving image information based on the information indicating the encoding method acquired in the acquisition step, and a detection means detect an execution instruction for high-speed playback a detection step, when the reproduction control means, the detection step detects an execution instruction for high-speed reproduction at a given search speed, of the moving image information encoded intraframe pre A coded picture and the first inter-restricted-frame predictive coded picture is decoded in the decoding step, when the detecting step detects an execution instruction for the high-speed reproduction by fast search speed than the predetermined search speed has a portion of the predictive coding picture and the first restricted inter-frame predictive coded picture frames, the decoding control step of decrypted by the second decoding step and a restricted inter-frame predictive coded picture This is also achieved by the decoding method of the present invention.

  With such a configuration, according to the present invention, an encoding apparatus, an encoding method, and an encoding method capable of performing encoding including an encoded picture that can easily perform special reproduction while suppressing a decrease in encoding efficiency, and A corresponding decoding device and decoding method can be realized.

Hereinafter, the present invention will be described based on preferred embodiments with reference to the drawings.
<First Embodiment>
FIG. 2 is a block diagram illustrating a configuration example of a video camera (VCR) as an example of an image encoding device and an image decoding device according to the first embodiment of the present invention.

  In the figure, a UI processing unit 10 includes a switch, a button, a touch panel, a dial, and the like, and is used by a user to perform operation instructions and settings for a video camera. An operation on the UI processing unit 10 is transmitted to the control unit 20.

  The control unit 20 is a microcomputer, for example, and controls the entire video camera by executing a control program stored in an internal ROM and controlling the operation of each unit, for example. The video input unit 100 includes a lens, an image sensor, an A / D converter, and the like, converts a subject video into digital data and outputs the digital data. The encoding processing unit 200 compresses and encodes the digital image data from the video input unit 100.

  The recording processing unit 300 records the digital image data compressed and encoded by the encoding processing unit 200 on a recording medium 400 such as a tape, a disk, or a semiconductor memory by a predetermined recording method. The reproduction processing unit 500 reads encoded image data from the recording medium 400. The decoding processing unit 600 decodes the encoded image data read by the reproduction processing unit 500. The video output unit 700 includes a display unit such as an LCD, and displays decoded image data, a setting screen, and the like.

A recording operation of the video camera having such a configuration will be described.
When the user instructs to start recording via the UI processing unit 10, the control unit 20 controls the video input unit 100, the encoding processing unit 200, and the recording processing unit 300 to start the recording process. At the time of recording, the subject video is captured by the video input unit 100 and output as digital image data. The image data is encoded by the encoding processing unit 200 and output as encoded image data in which the data amount is compressed. In the present embodiment, the encoding processing unit 200 also performs special playback picture processing, which will be described later. The encoded image data is recorded on the recording medium 400 after the recording processing unit 300 performs signal processing suitable for the recording medium 400.

Next, the special reproduction operation will be described. When the user instructs the start of special playback via the UI processing unit 10, the control unit 20 controls the playback processing unit 500, the decoding processing unit 600, and the video output unit 700 to start the special playback processing.

  The reproduction processing unit 500 reads out encoded image data of a special reproduction picture (to be described later) from the encoded image data recorded on the recording medium 400, and performs signal processing suitable for decoding processing. The encoded image data of the read special reproduction picture is decoded by the decoding processing unit 600 as image data. The decoded image data is sequentially output by the video output unit 700, and special reproduction display is realized.

(Encoding process)
Next, the configuration and operation of the encoding processing unit 200 of this embodiment will be described.
FIG. 3 is a block diagram illustrating a configuration example of the encoding processing unit 200 according to the present embodiment.
In the figure, digital image data output from the video input unit 100 is supplied via an image input unit 210. The subtractor 212 subtracts predicted image information described later from the input image data. The transform unit (DCT) 214 applies 4 × 4 integer orthogonal transform to the difference data (prediction error data) of the image output from the subtractor 212.

  The quantization unit (Q) 216 quantizes the transform coefficient output from the transform unit 214 with a predetermined quantization scale. The entropy encoding unit (EC) 218 performs entropy encoding processing on the quantized transform coefficient to compress the data.

  The inverse quantization unit (I-Q) 230 performs an inverse quantization process on the quantized transform coefficient. The inverse transform unit (I-DCT) 232 performs inverse integer orthogonal transform on the inversely quantized transform coefficient and returns the difference data of the image. The adder 234 adds predicted image data to be described later to the restored image difference data.

  The first frame memory (FM) 236 holds image data (local decoded image data) restored by predicted image data described later. The intra prediction encoding unit (Intra) 240 divides the image data held in the first frame memory 236 into predetermined block units, predicts the image data of each block from pixels around the block, and generates predicted image data. To do. The switch unit 260 outputs one output of the intra prediction encoding unit 240 and an inter prediction encoding unit 256 described later as predicted image data in accordance with the control of the picture control unit 280.

  The deblocking filter (DBF) 250 corrects discontinuity (so-called block noise) at the boundary of the encoding unit block with respect to image data restored by predictive image data described later. The second frame memory 252 holds the restored image data on which the block boundary correction processing has been performed in order to use it as a reference image of predicted image data described later.

  The inter prediction encoding unit 256 obtains motion information from the current image data input from the image input unit 210 and the reference image stored in the second frame memory 252 and generates predicted image data of the current image data. To do. The picture control unit 280 determines a predictive coding method to be applied for each picture (frame).

Next, the encoding operation will be described.
The image data input from the image input unit 210 is subtracted from the predicted image data by the subtractor 212 to obtain difference data from the predicted image data. The difference data is subjected to integer orthogonal transformation such as DCT in the transformation unit 214 and transformed into frequency component data. The transform coefficient corresponding to each frequency component is quantized by the quantization unit 216 with a predetermined step width. The quantized transform coefficient data is compression encoded by the entropy encoding unit 218. Furthermore, the entropy encoding unit 218 multiplexes and compresses and encodes information including information related to predictive encoded pictures described later.

  Next, processing of predicted image data will be described. Predictive image data includes a generation method based on an intra-prediction encoding scheme that refers to the input prediction encoding target image, and a generation method based on an inter-prediction encoding scheme that refers to other than the input prediction encoding target image.

First, a method for generating predicted image information using an intra-coded prediction method will be described.
The transform coefficient quantized by the quantization unit 216 is inversely quantized by the inverse quantization unit 230 to restore the transform coefficient. The restored transform coefficient is further restored as difference data between the input image data and the predicted image data by performing inverse integer orthogonal transform in the inverse integer orthogonal transform unit 232. By adding predicted image data, which will be described later, to the restored difference data, an adder 234 provides restored image data (local decoded image data) of the input image.

The restored image data is stored in the first frame memory 236. Then, intra prediction encoding is performed on the restored image data using the intra prediction encoding unit 240. Specifically, the restored image data is divided into blocks of a predetermined size, and the restored image data in each block is predicted from the peripheral pixel values of the block. The predicted image data is sent to the switch unit 260. The switch unit 260 is controlled by a control unit 280, which will be described later, and when outputting predicted image data based on the intra prediction encoding method, the control unit 280 causes the switch 260c to select 260a.
Predicted image data by this intra prediction encoding method is sent from the switch unit 260 to the subtractor 212 and the adder 234, and is used to generate predicted image difference data and restored image data.

Next, a prediction image data generation method using the inter prediction encoding method will be described.
The process until the restored image data is obtained by the adder 234 is the same as described above, and a description thereof will be omitted. The restored image data obtained by the adder 234 is sent to the deblocking filter unit 250 in order to eliminate data discontinuity (block distortion) at a block unit boundary, which will be described later. The deblocking filter unit 250 performs predetermined filter processing on the pixel data adjacent to the block boundary, and suppresses discontinuity of the data on the block boundary. However, the deblocking filter is an option, and when it is determined that the block distortion in the restored image data is sufficiently small, the filtering process may not be performed.

  The restored restored image data is stored in the second frame memory 252. The second frame memory 252 has a capacity capable of holding restored image data for a plurality of frames (pictures).

  The inter prediction encoding unit 256 obtains a correlation between the input image to be predicted encoding supplied from the image input unit 210 and a plurality of restored image data stored in the second frame memory 252 in units of blocks. Then, the relative positional relationship between the encoding target block and the block having the highest correlation among the blocks in the restored image data is detected as motion information. Further, the motion information and predicted image data based on the restored image data are generated.

The generated prediction image data by the inter prediction encoding method is sent to the switch unit 260. The switch unit 260 is controlled by a control unit 280, which will be described later. When outputting predicted image data based on the inter prediction encoding method, the control unit 280 causes the switch 260c to select 260b.
Predicted image data by this inter prediction encoding method is sent from the switch unit 260 to the subtractor 212 and the adder 234, and is used to generate predicted image difference data and restored image data.

  The control unit 280 switches the switch 260c to 260a in the case of the intra-prediction coding method (I), and switches to 260a in the case of the inter-prediction coding method (P, B) according to a predetermined method for selecting the prediction coding method. Connect 260c to 260b.

  Furthermore, in the case of the inter prediction encoding method, the control unit 280 makes a forward prediction inter prediction coding method (forward prediction method: P) or a bi-directional prediction inter coding method (both for the inter prediction coding unit 256). The direction prediction method: B) is generated for each picture.

The forward prediction method is an inter prediction coding method in which reference image data used for predictive coding is limited to restored image data restored from one image before the encoding target picture in display order. On the other hand, the bi-directional prediction method is not limited with respect to such display order, and can be predictively encoded with reference to restored image data restored from a maximum of two images.
The predictive coding scheme (I, P, B) selected in units of pictures in the control unit 280 is sent to the entropy coding unit 218 and multiplexed into the coded data.

  In the present embodiment, for simplification of description, the predictive encoding method is selected in units of pictures, but different predictive encoding methods can be applied in units of pixel blocks. For example, an intra prediction method or a forward prediction method is used for a pixel block that forms a P picture, and an intra prediction method, a forward prediction method, or a bidirectional prediction method is used for a pixel block that forms a B picture. You can choose.

  With this encoding scheme association, an I picture can be decoded only from encoded data of an I picture, and a P picture has encoded data of a P picture and encoded data of one reference image. Decoding is possible.

Hereinafter, a method for selecting a predictive coding method in the present embodiment will be described.
FIG. 5 shows a picture to be encoded input to the encoding processing unit 200 in FIG. 2 is a conceptual diagram illustrating an example of a reference relationship allowed in the H.264 encoding scheme. FIG.

  In FIG. 5, I, P, and B represent the aforementioned intra prediction coded picture (I picture), forward predictive coded picture (P picture), and bidirectional predictive coded picture (B picture), respectively. The pictures are input to the encoding processing unit 200 in FIG. 2 in order from the picture. The input order is equal to the display order after decoding.

  In this embodiment, I pictures are set at intervals of 15 pictures. A plurality of coded picture groups including at least one I picture are called a group of pictures (GOP) and managed separately. In FIG. 5, a picture group 1000 consisting of 15 pictures B0 to P14 is one GOP.

  As described above, an I picture can be decoded using only encoded data of the I picture. Therefore, if the position of the I picture is managed in each GOP, the encoded data of the I picture can be extracted from the encoded data and decoded. In this embodiment, the decoded display is performed at intervals of 15 pictures. It becomes possible. If the I picture extracted from each GOP and decoded is displayed at a normal frame rate, special reproduction display equivalent to 15 × speed can be realized.

In FIG. 5, numerals 0 to 14 following I, P, and B indicate the order of input to the encoding processing unit 200 of FIG. 2 in units of GOP.
Furthermore, the arrows in the figure indicate reference image data used by inter prediction coded pictures (P pictures or B pictures). That is, in this example, the picture P5 refers to the picture P14 of the previous GOP. The picture P11 refers to the picture P5. The picture P8 refers to the picture I2. The picture P14 refers to the picture P8. On the other hand, picture B0 refers to pictures P14 and B1. Picture B1 refers to pictures P14 and I2.

  In this way, H.C. In the H.264 system, it is also possible to refer to an I picture or a P picture that is not the closest to the P picture, and further, although not shown, reference to a B picture is allowed. Also, it is allowed for a B picture to refer to another B picture, or to refer to a picture temporally separated from the most recent I picture or P picture. By allowing such flexible reference picture selection, it is possible to select a picture with the highest correlation as a reference image, and as a result, highly efficient encoding is possible.

  However, if free reference as shown in FIG. 5 is allowed, as described above, a harmful effect occurs during special reproduction, particularly when high-speed reproduction is performed. In FIG. 5, since 1 GOP is composed of 15 pictures, 15-times playback / display is possible by decoding only I pictures included in each GOP. However, for example, when displaying at 6 × speed, decoding of a P picture is also necessary.

Next, the principle by which the control unit 280 in the present embodiment selects the encoding prediction method will be described with reference to FIG.
In FIG. 6, 2000 and 2001 represent GOPs, 2100 and 2101 represent I pictures, and 2200 to 2203 and 2300 to 2303 represent P pictures.

  Here, the P picture 2200 refers to the I picture 2100 in the same GOP 2000 by skipping the latest P picture 2300. The P picture 2201 refers to the P picture 2200 in the same GOP 2000 by skipping the latest P picture 2301. Further, the P picture 2202 refers to the latest I picture 2101 in the same GOP 2001. Also, the P picture 2203 refers to the P picture 2202 in the same GOP 2001 by skipping the latest P picture 2302.

  According to the present embodiment, the I picture 2100 and the P pictures 2200 to 2203 are arranged at equal intervals for every six pictures. Also, in order to decode these pictures, a reference relationship is maintained in which the pictures 2100 and 2200 to 2203 can be decoded by further decoding the I picture 2101. In the present embodiment, since there are pictures that can be decoded every 6 frames (every 5 frames), if these pictures are extracted and displayed at a normal frame rate, 6 × speed playback display is possible.

  As described above, in this embodiment, the reference image of the forward predictive coded picture used for high-speed playback display is limited to an I picture in the same GOP or a forward P picture separated by a number of pictures corresponding to the playback speed. To do. As a result, it is possible to decode an equally-spaced picture composed of an I-picture and a P-picture with a limited reference destination using only encoded data of an I-picture in the same GOP or an equally-spaced P-picture. It becomes possible.

  In other words, an arbitrary playback speed can be realized by arranging an I picture and a P picture for special playback (a P picture with a limited reference picture) at equal intervals so that a desired playback speed can be realized. Is possible.

Next, the encoding method selection operation in the encoding processing unit 200 according to this embodiment will be described with reference to the flowchart of FIG.
First, selection of an encoding method for each picture is started at the time of encoding. When an encoding target picture is input to the encoding processing unit 200 (S2401), it is determined by a predetermined method whether or not the intra encoding scheme is applied to the input picture (S2402). If the intra coding method is not applied, the H.264 The encoding method is selected by a normal method performed by the H.264 method (S2403). In general, the bi-directional predictive coding method is selected and determined for the first two pictures to be input.

  On the other hand, when the intra coding method is selected (S2402), the counter (variable k) is initialized to 1 and the intra coding process is performed on the input picture (S2410). When the next picture is input to the encoding processing unit (S2411), it is determined whether or not the counter value k is 6 (S2413). If k = 6 is not satisfied, the counter value is incremented by 1 (S2414), and the encoding method is selected by a predetermined method that is normally performed (S2415). After performing the encoding process with the selected encoding method, it is determined whether or not the end of the encoding process is instructed (S2416). If there is no end instruction, the picture is continuously input to the encoding processing unit 200. (S2411). If there is an end instruction, the encoding process is also ended, and the selection of the encoding method is also ended.

  On the other hand, in S2413, if the counter value k = 6, first, the counter value k is reset to 1 (S2420), and it is determined whether or not the I picture is set in the same manner as S2402 (S2421). If it is determined that the picture is an I picture, an intra coding method is selected (S2422), and the process proceeds to S2416.

If it is determined in S2421 that the picture is not an I picture, a forward predictive coding method with a limited reference destination is selected (S2423). That is, as described with reference to FIG. 6, forward predictive coding using an I picture or a P picture encoded under the same reference destination restriction (a restricted P picture) in the same GOP as a reference picture Select a method.
The encoded image data of the restricted P picture is multiplexed as metadata indicating that it is a restricted P picture.

Next, a method for reproducing the restricted P picture will be described with reference to FIG.
FIG. 4 is a block diagram illustrating a configuration example of the decoding processing unit 600 of FIG.
The encoded data from the reproduction processing unit 500 is input from the data input unit 610. In addition, an instruction for decoding processing from the control unit (20 in FIG. 2) of the entire system is input via the control input unit 611. The entropy decoding processing unit 612 performs a decoding process on the entropy-encoded encoded data to decompress the data. The entropy decoding processing unit 612 also generates metadata such as motion information multiplexed on the encoded data.

  The inverse quantization processing unit (IQ) 614 calculates the integer transform coefficient by performing inverse quantization on the digital data subjected to the entropy decoding process with a predetermined quantization scale. The inverse integer transform unit (I-DCT) 616 performs inverse integer transform on the calculated integer transform coefficient to restore the image data. An adder 618 adds predicted image data, which will be described later, to the restored image data.

The switch unit 635 is controlled by the prediction method control unit 680, and outputs the output (decoded image data) of the adder 618 to either the third frame memory (FM) 636 or the deblocking filter unit (DBF) 650. . The third frame memory 636 holds the decoded image data supplied from the switch unit 635. The intra prediction decoding unit 640 uses the image data held in the third frame memory 636 to predict the image data in the block from the peripheral pixels of the block to be decoded. The switch unit 660 is controlled by the prediction scheme control unit 680 and outputs the output of either the intra prediction decoding unit 640 or the inter prediction decoding unit 656 to the adder 618.

  The deblocking filter unit 650 corrects block boundary discontinuity for the decoded image data. The fourth frame memory 652 holds the locally decoded image data that has undergone the block boundary correction processing as a reference image.

The inter prediction decoding unit 656 generates predicted image data using a plurality of reference images held in the fourth frame memory and metadata such as motion information generated by the entropy decoding process.
The prediction scheme control unit 680 controls the prediction decoding processing method on a picture-by-picture basis in accordance with metadata relating to prediction encoding such as motion information generated by the entropy decoding processing unit 612.

  With reference to FIG. 4, the special reproduction process in this embodiment is demonstrated. Here, as an example of special reproduction, a 6 × speed reproduction process using the encoded data generated by the above encoding process will be described.

  The encoded data input from the data input unit 610 is entropy decoded by the entropy decoding processing unit 612, and is divided into image data and metadata multiplexed into the encoded data. Metadata is data indicating information related to motion information and an encoding method. When the 6 × speed reproduction process is performed, only the image data of the I picture or the P picture whose reference destination is limited is decoded with reference to the metadata.

First, the inverse quantization unit 614 inversely quantizes the entropy-decoded image data with a predetermined quantization scale to generate integer transform coefficients. The inverse integer transform unit 616 performs inverse integer transform on the integer transform coefficient, thereby restoring the pixel data. The restored pixel data is added with predicted image data, which will be described later, by an adder 618 to generate image data as a final decoding result. The decoded image data is output from the output unit 620 .

  The decoded image data is sent to the switch unit 635 as reference image data used in the subsequent decoding process. On the other hand, the metadata related to the prediction encoding method generated by the entropy decoding processing unit 612 is sent to the prediction method control unit 680. The prediction method control unit 680 controls the switch unit 635 based on whether or not a special reproduction instruction is received from the control unit 20 of the entire system via the control input unit 611 and the metadata.

  That is, when there is a special reproduction instruction (in this case, a 6 × speed reproduction instruction), only the I picture or the P picture whose reference destination is restricted is selected by referring to the metadata. In the case of the I picture, the switches 635c and 635a are selected. Are connected, and switches 635c and 635b are connected in the case of a P picture whose reference destination is restricted. As a result, the decoded picture of the I picture is stored in the third frame memory 636, and the intra prediction decoding unit 640 generates predicted image data that has been intra prediction decoded from the peripheral decoded image data, and the switch unit Send to 660. In the case of an I picture, the switches 660 a and 660 c are connected according to an instruction from the prediction method control unit 680, and predicted image data is sent to the adder 618.

  On the other hand, in the case of a P picture whose reference destination is restricted, the decoded image data is subjected to block boundary correction by the deblocking filter unit 650 and then held in the fourth frame memory 652. The stored image data is stored as a reference image of another P picture whose reference destination is limited, and inter-prediction decoding is performed from this data and metadata related to predictive encoding generated by the entropy decoding processing unit 612. The generating unit 656 generates predicted image data. The predicted image data is sent to the switch unit 660. In the switch unit 660, the switches 660b and 660c are connected by the prediction method control unit 680, and the predicted image data is sent to the adder 618 and used for the decoding process of the image data.

  As described above, according to the present embodiment, when an instruction for special reproduction is given, the decoding processing unit 600 can decode only an I picture or a P picture with a limited reference destination, and smooth special reproduction. Can be done.

  In addition, I pictures used for special reproduction or P pictures with a limited reference destination are encoded so as to be included at equal intervals for every predetermined number of pictures, so that special reproduction at a predetermined multiple speed can be easily realized. It becomes possible.

  In this embodiment, the case of realizing 6 × speed playback as an example of special playback has been described. However, by further thinning and playing back the decoded picture, high speed generation such as 12 × speed, 18 × speed, and 24 × speed is possible. Needless to say. In addition, it is easily understood that reproduction at 2 × to 5 × speed (and its multiple speed) can be realized by increasing the appearance frequency of an I picture and a P picture with a limited reference destination. Like. Furthermore, it is possible to use a conventional special reproduction method in which only the I picture is extracted and reproduced.

  Further, in the present embodiment, the appearance frequency of the special reproduction picture can be set independently of the number of pictures constituting the GOP, so that the appearance frequency of the special reproduction picture can be set flexibly.

  Further, in the present embodiment, the special reproduction picture is realized mainly by using the P picture having higher encoding efficiency than the I picture, thereby enabling easy special reproduction while suppressing a decrease in the encoding efficiency. .

  In this embodiment, the P picture for which the reference destination is limited to an I picture in the same GOP or another P picture whose reference destination is limited is used as a special reproduction P picture. However, as long as such a reference relationship is satisfied, a picture of another encoding method may be used. For example, a randomly accessible inter-coded prediction picture that has a predetermined number of reference picture relationships may be used as a special reproduction picture.

<Second Embodiment>
Next, a second embodiment will be described.
Since the present embodiment is also applicable to the video camera described in the first embodiment, the contents described in the first embodiment are omitted.

  FIG. 7 is a diagram illustrating an example of selecting an encoding method performed by the video camera according to the present embodiment. In the figure, 2500 to 2505 represent picture groups managed as GOPs, 2600 to 2605 represent I pictures, 2700 to 2711 and 2800 to 2811 represent P pictures, respectively.

  Here, the P pictures 2800 and 2700 refer to the I picture 2600 in the same GOP 2500. Next, the P picture 2701 refers to the P picture 2700 in the same GOP 2500, and the P picture 2702 refers to the I picture 2601 in the same GOP 2501. Further, the P picture 2703 refers to the P picture 2702 in the same GOP 2501, the P picture 2803 refers to the P picture 2703 in the same GOP 2501, and there is an I picture 2602 after 3 pictures of the P picture 2703.

  Further, the P picture 2704 refers to the I picture 2602 in the same GOP 2502, and the P pictures 2805 and 2705 refer to the P picture 2704 in the same GOP 2502. Further, the P picture 2706 refers to the I picture 2603 in the same GOP 2503, and the P pictures 2806 and 2707 refer to the P picture 2706 in the same GOP 2503. Thereafter, the reference relationship of P pictures 2808, 2708, 2709, 2710, 2711, and 2811 is limited in the same pattern.

  In the present embodiment, the limitation on the reference destination of the P pictures 2700 to 2711 is the same as that in the first embodiment. If this is the first limited encoding scheme, P pictures 2800, 2803, 2805, 2806, 2808, and 2811 are the second limited encoding scheme with new limitations.

  According to the present embodiment, the I pictures 2600, 2602, 2604 and the P pictures 2700 to 2711 are arranged at equal intervals every 6 pictures (every 5 pictures). In order to decode these pictures, other I pictures 2601, 2603, and 2605 may be decoded in addition to the pictures themselves.

  Therefore, all the extracted pictures can be decoded by extracting the I picture and the P picture to which the first limited encoding method is applied. As a result, all the pictures can be decoded every six frames. Therefore, if the decoding results are displayed at a normal frame rate, 6 × speed reproduction display is possible. This is the same as in the first embodiment.

  In the case of the present embodiment, in addition to the P picture (first restricted P picture) to which the first restriction coding method is applied, the second restriction code is added to the P pictures 2800, 2803, 2805, 2806, 2808, and 2811. The system is applied.

  The P picture (second restricted P picture) to which the second restricted encoding method is applied is also restricted so as to refer only to the I picture or the first restricted P picture in the same GOP. As a result, the reference relationship is completed only with the I picture and the first and second restricted P pictures. That is, decoding can be performed independently of the remaining picture groups.

  Here, special reproduction exceeding 10 × speed is considered. For example, when considering 12 × speed playback that is twice as fast as 6 × speed, the simplest implementation method is that every other I picture or the first restricted P picture included in every 6 frames, that is, per 12 pictures. In this method, one piece of image data is reproduced and displayed at a normal rate.

  However, every 11 pictures may not have a high correlation, and in this case, the user is given an unnatural impression such as displaying a moving image with dropped frames or displaying a sequence of still images. Therefore, in the present embodiment, an image having a strong correlation with the displayed special reproduction picture is further displayed between the special reproduction pictures displayed every 12 frames. As a result, visual unnaturalness can be suppressed, and moving images can be impressed smoothly.

  In the present embodiment, a second restricted P picture is provided in addition to the special playback P picture (hereinafter referred to as the first restricted P picture) in which the reference image is restricted as described in the first embodiment. As a result, the above-described improvement in visual characteristics during high-speed playback is realized.

That is, in the case of high-speed reproduction exceeding a predetermined reproduction speed (here, the case of 12 times or higher speed), for example, the following pictures are sequentially reproduced and displayed.
Decoding processing I picture 2600,
Decoding process second restricted P picture 2800,
Decoding process First restricted P picture 2701,
Decoding processing I picture 2601,
Decoding process First restricted P picture 2703,
Decoding process second restricted P picture 2803,
Decoding process First restricted P picture 2704,
Decoding process second restricted P picture 2805,
Decoding process First restricted P picture 2706,
Decoding process second restricted P picture 2806,
Decoding processing I picture 2604,
Decoding process second restricted P picture 2808,
Decoding process First restricted P picture 2709,
Decoding processing I picture 2605,
Decoding process First restricted P picture 2711,
Decoding process second restricted P picture 2811,
:

  In this example, every other picture for special playback (2600, 2701, 2703, 2704, 2706, 2604, 2709, 2711) to be displayed every 12 pictures, the pictures after 2 pictures (2800, 2601, 2803, 2805) 2806, 2808, 2605, 2811) are additionally displayed as pictures having a strong correlation with the special reproduction picture.

  As a result, it is possible to reduce visual unnaturalness due to low correlation between pictures that are 12 pictures apart, and to perform smooth display like a moving image. In addition, since the number of pictures to be displayed is increased in this way, the picture update speed is 6 × speed reproduction, although it is actually every 12 pictures. However, the present embodiment focuses on visual improvement at the time of high-speed search for pictures with low correlation, and the numerical value itself of 12 times speed is not very meaningful. In other words, if the search speed of a high-speed picture with low correlation is 24 times speed, the actual update speed is reduced by the number of inserted sheets, so it becomes 12 times speed. However, the experiential search speed is not halved, and it is possible to provide practical high-speed playback due to the effect of improving visual characteristics. In this embodiment, since the explanation was made at 12 times speed for the sake of simplicity of explanation, the explanation is the same as the screen update rate of 6 times speed, but this is practical for the purpose of making the contents easy to grasp. Explain that this is not a problem. If there is a user who feels uncomfortable that the display time does not change from 6 × speed search to 12 × speed search, the next high speed search speed of 6 × speed may be set to 24 × speed. Also, even if only one field of a picture extracted at 12 × speed is displayed and the frame is updated in 1/60 seconds, this uncomfortable feeling is resolved.

  As described above, in this embodiment, two restricted encoding methods are used. In the first limited coding scheme, a reference destination of a forward prediction picture (P picture) used for high-speed playback is set as an I picture in the same GOP or another P to which the first limited coding scheme is applied. Restrict to pictures. In the second limited coding method, the reference destination of the forward prediction picture having a strong correlation with the picture used for high-speed playback is the I picture in the same GOP or the first limited coding method is applied. Restrict to other P pictures.

  In the present embodiment, the picture to which the second restricted coding method is applied is an I picture or P picture that appears next to a picture used for high-speed playback. If the I, P, and B pictures are arranged as shown in FIG. 7, the picture is three pictures after the picture used for high-speed playback.

  As a result, decoding of a picture made up of an I picture and the first and second restricted P pictures can be realized only by the encoded data of the I picture or the first and second restricted P pictures in the same GOP. become.

Next, the encoding method selection operation in the encoding processing unit according to the present embodiment will be described with reference to the flowchart of FIG.
First, selection of an encoding method for each picture is started at the time of encoding. When the encoding target picture is input to the encoding processing unit 200 (S2901), it is determined by a predetermined method whether or not the intra encoding scheme is applied to the input picture (S2902). If the intra coding method is not applied, the H.264 The encoding method is selected by a normal method performed by the H.264 method (S2903). In general, the bi-directional predictive coding method is selected and determined for the first two pictures to be input.

  On the other hand, when the intra picture is applied to the input picture (S2902), the first counter k = 1, the second counter l = 0, and the second restricted encoding flag flag = 1 are initialized. Then, intra coding processing is performed on the input picture (S2910).

  When the next picture is input to the encoding processing unit 200 (S2911), it is determined whether or not the first counter value k is 6 (S2913). If k = 6 is not satisfied, it is determined whether the second restricted encoding flag flag = 1 and whether the picture is an I or P picture (S2914). Usually, since the I picture is followed by the B picture, the condition is not satisfied, and the first counter value k is incremented by 1 (S2915), and the encoding method is selected by a predetermined method normally performed (S2916).

  After performing the encoding process with the selected encoding method, it is determined whether an instruction to end the encoding process is given (S2917). If there is no instruction to end, the picture is continuously input to the encoding processing unit 200. (S2911). If there is an end instruction, the encoding process is also ended, and the selection of the encoding method is also ended (S2950).

  If the first counter k is not 6 (S2913) and the second restricted encoding flag flag = 1 and is an I or P picture (S2914, Yes) in the processing of the picture that is subsequently input, go to S2940. move on. For example, this process is performed when, for example, a P picture following two B pictures is input. First, the first counter value k is incremented by 1 and returned to the second restricted encoding flag flag = 0 (S2940). Then, the second restricted encoding method is selected (S2941).

  As a result, the nearest P or I picture is placed in the second restricted coding every other picture selected at the first restricted coding method, which is arranged at equal intervals (here, every six pictures). The method is selected. Here, even if the second limited coding method is selected, in the case of an I picture, no special processing is performed, and normal intra prediction coding is performed. On the other hand, in the case of a P picture, inter prediction encoding is performed in which the reference destination is limited to an I picture or the first restricted P picture in the same GOP. Note that the P picture is managed as metadata that it is the second restricted encoded picture, and is superposed on the stream.

  Incidentally, when the first counter k = 6 (S2913), first, the first counter k is reset to 1 and the second counter l is incremented by 1 (S2920). Next, it is determined whether or not the remainder of 2 of the value of the second counter l is 0 (S2921). If it is 0, the second restricted encoding flag flag is set to 1 (S2930). As a result, for every first restricted picture (P or I picture) set at equal intervals, a flag for setting every second restricted picture is set. After this processing (S2930) or when the remainder of 2 of the second counter 1 is 1 (S2921), it is determined whether or not to make an I picture in the same manner as S2902. If it is determined that the picture is an I picture, an intra coding method is selected (S2924), and the process proceeds to S2917.

  If it is determined in S2923 that the picture is not an I picture, the first restricted coding method is selected (S2922). That is, as described with reference to FIG. 6, forward predictive coding using an I picture or a P picture encoded under the same reference destination restriction (a restricted P picture) in the same GOP as a reference picture Select a method. It should be noted that the encoded image data encoded by the first restricted encoding method is managed as metadata that it is a picture to which the first restricted encoding method is applied, and is superposed on the stream.

  The method for reproducing the encoded data stream generated in the present embodiment can be performed in the same procedure as that of the first embodiment described with reference to FIG. The difference from the first embodiment is that the picture to be decoded and displayed is switched according to the playback speed of the high-speed playback instruction input from the control input unit 611.

  That is, in this embodiment, when the instruction for 6 × speed reproduction is given from the control input unit 611, the high speed reproduction display processing as described in the first embodiment is performed. On the other hand, when an instruction for high-speed playback at a speed higher than a predetermined speed (here, 12 × speed playback) is input, an I picture and a first restricted P picture are generated based on metadata generated by the entropy decoding processing unit 612. In addition, the second restricted P picture is also subject to decoding. Then, as described with reference to FIG. 7, equidistant pictures every 12 pictures and the second restricted P picture are displayed.

  In the present embodiment, the second restricted picture is used in order to suppress deterioration in visual characteristics due to an increase in the interval between pictures to be displayed during high-speed playback and a decrease in correlation between displayed images. In the above description, the second restricted picture is not reproduced in 6 × speed reproduction, and the second restricted picture is reproduced in 12 × speed reproduction. However, these reproduction speeds can be determined as appropriate. .

  Furthermore, in the present embodiment, the picture to which the second restricted coding method is applied is limited to the P picture. However, the same effect can be obtained by restricting the reference destination of the B picture sandwiched between the first restricted pictures to the first restricted picture in the same GOP.

  Further, in the present embodiment, the appearance frequency of the special reproduction picture can be set independently of the number of pictures constituting the GOP, so that the appearance frequency of the special reproduction picture can be set flexibly.

  Further, in the present embodiment, the special reproduction picture is realized mainly by using the P picture having higher encoding efficiency than the I picture, thereby enabling easy special reproduction while suppressing a decrease in the encoding efficiency. .

  As in the first embodiment, also in this embodiment, a P picture for which the reference destination is restricted to an I picture in the same GOP or another P picture with a restricted reference destination is used as a special reproduction P picture. . However, as long as such a reference relationship is satisfied, a picture of another encoding method may be used. For example, a randomly accessible inter-coded prediction picture that has a predetermined number of reference picture relationships may be used as a special reproduction picture.

(Other embodiments)
In the above-described embodiment, the case where the present invention is applied to a video camera using an inter prediction method has been described. However, the present invention can be similarly applied to other devices such as a video player and a video recorder using an inter prediction method. By applying the present invention, special reproduction can be easily performed while suppressing a decrease in encoding efficiency.

  The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.).

  Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto.

  A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code.

Then, the program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers.
That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which a computer program for realizing the above-described embodiment is encrypted and stored is distributed to the user, and key information for decrypting is supplied to the user who satisfies a predetermined condition, and the user's computer It is also possible to enable installation on Windows. The key information can be supplied by being downloaded from a homepage via the Internet, for example.

Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer.
Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

It is a flowchart explaining the selection operation | movement of the encoding system in the encoding process part which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structural example of the video camera as an example of the image coding apparatus which concerns on embodiment of this invention, and an image decoding apparatus. It is a block diagram which shows the structural example of the encoding process part which concerns on embodiment of this invention. It is a block diagram which shows the structural example of the decoding process part which concerns on embodiment of this invention. The encoding target picture input to the encoding processing unit in FIG. 2 is a conceptual diagram illustrating an example of a reference relationship allowed in the H.264 encoding scheme. FIG. It is a figure explaining the selection method of the encoding prediction system in the 1st Embodiment of this invention. It is a figure explaining the selection method of the encoding prediction system in the 2nd Embodiment of this invention. It is a flowchart explaining the selection operation | movement of the encoding system in the encoding process part which concerns on the 1st Embodiment of this invention.

Claims (12)

An encoding device that encodes each picture constituting a moving image using either an intra-frame prediction encoding scheme or an inter-frame prediction encoding scheme,
Control means for selecting an encoding scheme to be applied to each picture;
Encoding means for encoding each picture based on the encoding method selected by the control means,
The control means is
For each picture corresponding to a predetermined cycle, whether or not to select the intra-frame prediction encoding method is determined according to a predetermined criterion, and it is determined to select the intra-frame prediction encoding method If the intra-frame predictive coding method is selected and it is determined that the intra-frame predictive coding method is not selected, the reference picture corresponds to the intra-frame predictive coded picture or the predetermined period. select predictive coding method between the frames is limited to predictive coded picture between frames,
Among the pictures that do not correspond to the predetermined period, for some pictures, the inter-frame prediction encoding method in which the reference image is limited to the encoded picture corresponding to the predetermined period is selected. , for the remaining pictures, and selecting one of the intra-frame predictive coding scheme or, no limit to the referenced picture the interframe predictive coding method,
The encoding means performs a predetermined search for a picture in which an inter-frame predictive encoding scheme in which the reference image is limited is selected by the control means among pictures corresponding to the predetermined period. Information indicating that the picture is a first limited inter-frame predictive encoded picture that is decoded at the time of high-speed reproduction by speed, and the part of the pictures not corresponding to the predetermined period Information indicating that the picture is a second limited inter-frame predictive encoded picture that is decoded at the time of high-speed reproduction at a search speed higher than the predetermined search speed is added to the picture. An encoding device. And further comprising a management means for managing the pictures as a group every predetermined number in succession,
The control means is
When selecting an interframe predictive coding method in which the reference image is limited for a picture corresponding to the predetermined period, the reference image belongs to the same group as the picture, and The encoding apparatus according to claim 1, wherein the encoding apparatus is limited to other inter-frame prediction encoded pictures corresponding to a predetermined cycle. When the control means selects an inter-frame predictive coding method in which the reference image is limited for a picture corresponding to the predetermined period, the reference image is more temporally selected than the picture. prior encoding apparatus according to claim 1 or 2, wherein that the picture to be. For the pictures within a predetermined time with respect to each of n pictures (n is a natural number) of pictures corresponding to the predetermined period, among the pictures constituting the moving image. the encoding apparatus according to any one of claims 1乃optimum 3, characterized in that for selecting the picture the same coding method corresponding to said predetermined period. The data to which the encoding means is encoding, applied according to any one of claims 1乃optimum 4, characterized by further comprising an output means for adding and outputting information indicating the coding scheme Encoding device. A decoding device that receives and decodes moving picture information in which a plurality of pictures are encoded,
The encoded video information is
Including information representing the encoding scheme used to encode each picture;
Coded picture corresponding to a predetermined period, in intra-frame prediction coding method and coding frame prediction coded picture, the referenced picture has been determined prediction coded picture or said pre-frame period A first limited inter-frame predictive encoded picture encoded with an inter-frame predictive encoding scheme limited to other corresponding inter- frame predictive encoded pictures ,
Among the encoded pictures that do not correspond to the predetermined period, some of the encoded pictures are inter-frame prediction encoding schemes in which the reference image is limited to the encoded picture corresponding to the predetermined period. The encoded second limited interframe predictive encoded picture,
The remaining coded picture is constructed between encoded frames in the predictive coded picture by inter-frame predictive coding method in which the intra-frame predictive coding picture or referenced image is not limited,
The decoding device
Obtaining means for obtaining information representing the encoding method from the encoded moving image information;
Decoding means for decoding each encoded picture included in the encoded moving image information based on the information indicating the encoding method acquired by the acquisition means;
Detection means for detecting an instruction to execute high-speed playback;
When the detection means detects an execution instruction for high-speed playback at a predetermined search speed, the intra-frame prediction encoded picture and the first limited inter-frame prediction among the encoded moving image information. a coded picture is decoded in the decoding means, when said detecting means detects an instruction to execute high-speed reproduction by fast search speed than the predetermined search speed is in the frame predictive coding picture and and having the a portion of the first restricted inter-frame predictive coded picture, the decoding control means for decrypted the predictive coded picture and the second restricted frame to the decoding means Decryption device. Before Symbol decoding control means,
When the detection means detects an execution instruction for high-speed playback at a search speed higher than the predetermined search speed, the intra-frame prediction encoded picture and the first limited inter-frame prediction code according to the search speed decoding apparatus according to claim 6, wherein Rukoto is decoded in said decoding means selects a part of the reduction picture. An encoding method for encoding each picture constituting a moving image using either an intra-frame prediction encoding scheme or an inter-frame prediction encoding scheme,
A control step in which the control means selects a coding method to be applied to each picture;
The encoding means includes an encoding step for encoding each picture based on the encoding method selected in the control step;
In the control step,
For each picture corresponding to a predetermined cycle, whether or not to select the intra-frame prediction encoding method is determined according to a predetermined criterion, and it is determined to select the intra-frame prediction encoding method If the intra-frame predictive coding method is selected and it is determined that the intra-frame predictive coding method is not selected, the reference picture corresponds to the intra-frame predictive coded picture or the predetermined period. Selecting the inter-frame predictive encoding scheme limited to the inter-frame predictive encoded pictures,
Among the pictures that do not correspond to the predetermined period, for some pictures, the inter-frame prediction encoding method in which the reference image is limited to the encoded picture corresponding to the predetermined period is selected. , for the remaining pictures, and selecting one of the intra-frame predictive coding scheme or, no limit to the referenced picture the interframe predictive coding method,
In the encoding step, among pictures corresponding to the predetermined period, a predetermined search is performed for a picture for which the interframe predictive encoding method in which the reference image is limited is selected by the control unit. Information indicating that the picture is a first limited inter-frame predictive encoded picture that is decoded at the time of high-speed reproduction by speed, and the part of the pictures not corresponding to the predetermined period Information indicating that the picture is a second limited inter-frame predictive encoded picture that is decoded at the time of high-speed reproduction at a search speed higher than the predetermined search speed is added to the picture. The encoding method. A decoding method for receiving and decoding moving picture information in which a plurality of pictures are encoded,
Dynamic image information the coding,
Including information representing the encoding scheme used to encode each picture;
Coded picture corresponding to a predetermined period, in intra-frame prediction coding method and coding frame prediction coded picture, the referenced picture has been determined prediction coded picture or said pre-frame period A first limited inter-frame predictive encoded picture encoded with an inter-frame predictive encoding scheme limited to other corresponding inter- frame predictive encoded pictures ,
Among the encoded pictures that do not correspond to the predetermined period, some of the encoded pictures are inter-frame prediction encoding schemes in which the reference image is limited to the encoded picture corresponding to the predetermined period. The encoded second limited interframe predictive encoded picture,
The remaining coded picture is constructed between encoded frames in the predictive coded picture by inter-frame predictive coding method in which the intra-frame predictive coding picture or referenced image is not limited,
The decoding method is:
An obtaining step for obtaining information representing the coding method from the coded moving image information;
A decoding step for decoding each encoded picture included in the encoded moving image information based on information representing the encoding method acquired by the acquiring step;
A detecting step for detecting a high-speed playback execution instruction;
When the reproduction control unit detects an instruction to execute high-speed reproduction at a predetermined search speed, the reproduction control means includes the intra-frame prediction encoded picture and the first frame of the encoded moving image information. and inter-restricted-frame predictive coded picture is decoded in the decoding step, when said detecting step detects an execution instruction for the high-speed reproduction by fast search speed than the predetermined search speed is in the frame having a portion of the predictive coded picture and the first inter-restricted-frame predictive coded picture, a decoding control step of decrypted the predictive coded picture between the second restricted frame by the decoding step A decoding method characterized by the above. A program for a computer to function as each means of the encoding device according to any one of claims 1乃optimum 5. The program for functioning a computer as each means of the decoding apparatus of Claim 6 or 7 . The computer-readable recording medium which stored at least one of the programs of Claim 10 or 11 .

Images