WO2012099352A2

WO2012099352A2 - Device and method for encoding/deciding multi-viewpoint images

Info

Publication number: WO2012099352A2
Application number: PCT/KR2012/000138
Authority: WO
Inventors: 이진영; 이재준
Original assignee: 삼성전자주식회사
Priority date: 2011-01-20
Filing date: 2012-01-06
Publication date: 2012-07-26
Also published as: WO2012099352A3

Abstract

Provided are a device and method for encoding/decoding multi-viewpoint images. The encoding device synthesizes an image of a surrounding viewpoint to generate a virtual image of the current view to be encoded, and encodes an actual image of the current view using the virtual image.

Description

Multi-view image encoding / decoding apparatus and method

Embodiments of the present invention relate to an apparatus and method for encoding / decoding an image, and more particularly, to an apparatus and method for encoding / decoding an image of a current view using an image that is already encoded / decoded.

The stereoscopic image refers to a 3D image that simultaneously provides depth and space information. Unlike stereo images, which provide images of different viewpoints to the left and right eyes, stereoscopic images provide different images according to the viewer's viewpoint. As a result, the stereoscopic image is composed of a plurality of images taken from the observer's point of view.

Images taken from a plurality of viewpoints have a large amount of data. As described above, when images captured from a plurality of viewpoints are encoded by a single-view video encoding method such as MPEG-2 and H.264 / AVC, it is impossible to realize network infrastructure and terrestrial bandwidth.

Therefore, it is necessary to encode images photographed at a plurality of viewpoints according to a multiview video encoding method. However, because network infrastructure and terrestrial bandwidth are still limited, there is a need for more efficient multi-view video compression.

An encoding apparatus according to an embodiment of the present invention includes an image generator for generating a virtual image of a current view to be encoded; And an image encoder which encodes an actual image of a current view using the virtual image.

Decoding apparatus according to an embodiment of the present invention includes an image generating unit for generating a virtual image of the current view to be decoded; And an image decoder which decodes an actual image of a current view using the virtual image.

An encoding method according to an embodiment of the present invention includes generating a virtual image of a current view to be encoded; And encoding the real image of the current view by using the virtual image.

Decoding method according to an embodiment of the present invention comprises the steps of generating a virtual image of the current view to be decoded; And decoding the real image of the current view by using the virtual image.

According to an embodiment of the present invention, the encoding efficiency of the actual image may be improved by synthesizing the image of the neighboring view, which is already encoded, to generate a virtual image of the current view, and using the virtual image to encode the actual image.

According to an embodiment of the present invention, by varying the encoding scheme according to the contour information of the actual image, it is possible to improve encoding efficiency and minimize distortion due to the contour.

According to an embodiment of the present invention, the coding efficiency may be improved by changing the coding scheme according to the motion information of the neighboring view.

According to an embodiment of the present invention, the encoding efficiency may be improved by changing the encoding scheme according to the encoding mode information of the neighboring view.

1 is a diagram illustrating an encoding device and a decoding device according to an embodiment of the present invention.

2 is a block diagram illustrating a detailed configuration of an encoding apparatus according to an embodiment of the present invention.

3 is a block diagram showing a detailed configuration of a decoding apparatus according to an embodiment of the present invention.

4 is a diagram illustrating a structure of a multiview video according to an embodiment of the present invention.

5 is a diagram illustrating an example of an image of a neighboring view used to encode an actual image of a current view according to an embodiment of the present invention.

6 is a diagram illustrating a process of generating a virtual image of a current view using an image of a neighboring view according to an embodiment of the present invention.

7 illustrates a process of synthesizing an image according to an embodiment of the present invention.

8 illustrates contour information of a virtual image according to an embodiment of the present invention.

9 is a diagram illustrating a process of encoding an actual image based on contour information of a virtual image according to one embodiment of the present invention.

10 is a flowchart illustrating an encoding method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The encoding apparatus 101 may encode the real image of the current view by using the virtual image of the current view to be encoded. In this case, the encoding apparatus 101 may generate a virtual image by synthesizing an image corresponding to a neighboring viewpoint. In an embodiment of the present invention, the virtual image and the real image may include all images, such as a color image, a depth image, a disparity image, and an occlusion image. Here, the depth image refers to an image representing a distance between an object and a viewer in a color image with a value of 0 to 255 (8 bits).

And, synthesis means generating a virtual image of the current view by using the image of the neighboring view that is already encoded. For example, the encoding apparatus 101 may generate a virtual image of another B view by synthesizing an image of an I view, a B view, or a P view that is already encoded. In addition, a virtual image of another P view may be generated by synthesizing an image of an I view or a P view that is already encoded. As a result, the encoding apparatus 101 may generate virtual images of all views except the I view by using the information of at least one view that is already encoded. The generated virtual image may be utilized when encoding the actual image.

For example, the encoding apparatus 101 may encode the real image by replacing the real image with the virtual image of the current view generated from the image of the neighboring view, which is already encoded, without encoding the real image of the current view.

In addition, the encoding apparatus 101 may encode the real image by partially using the virtual image according to the area of the real image. In detail, the encoding apparatus 101 may encode the actual image for each block based on at least one of contour information of the actual image, encoding mode information of the neighboring viewpoint, or motion information of the neighboring viewpoint.

In detail, the encoding apparatus 101 may extract contour information of an actual image from contour information of a virtual image. In addition, when an outline exists in a block of an actual image, the encoding apparatus 101 may encode according to an existing scheme. On the contrary, when no contour line exists in the convexity of the real image, the encoding apparatus 101 may encode the real image by substituting the virtual image without encoding the real image or by setting a strong encoding level.

The encoding apparatus 101 does not have an outline when the encoding mode information of the peripheral view of the actual image is preset encoding mode information (Skip mode, direct mode, intra 16 * 16 mode, inter 16 * 16 mode). It can be processed in the same way as if not. In addition, when the motion information of the neighboring view is relatively small, the encoding apparatus may process the same as when the contour does not exist.

Since the decoding apparatus 102 is almost the same as the operation of the encoding apparatus 101, a detailed description thereof will be omitted.

Referring to FIG. 2, the encoding apparatus 101 may include an image generator 201 and an image encoder 202.

The image generator 201 may generate a virtual image of the current view by synthesizing the images corresponding to the neighboring views of the current view. Here, the current view means a view of the current block to be encoded, and the neighbor view means a view different from the current view.

The image encoder 202 may encode the actual image of the current view by using the virtual image.

For example, the image encoder 202 may replace the real image of the current view with a virtual image without directly encoding the image.

The image encoder 202 may encode the real image by partially using the virtual image according to the area of the real image. In detail, the image encoder 202 may encode the real image using the virtual image partially for each region according to at least one of contour information of the actual image, encoding mode information of the neighboring viewpoint, or motion information of the neighboring viewpoint. .

For example, the image encoder 202 may extract contour information of the real image using the virtual image, and encode the real image based on the contour information of the real image.

In the first embodiment, when an outline exists in a block of the real image, the image encoder 202 may encode the block of the real image based on the motion search and the shift search according to a conventional method. In contrast, when no contour line exists in the block of the real image, the image encoder 202 may skip the encoding process for the block of the real image.

In the second embodiment, when the contour is present in the block of the real image, the image encoder 202 may encode the block of the real image with a relatively low quantization coefficient. In contrast, when no contour line exists in the block of the real image, the image encoder 202 may encode the block of the real image with a relatively high quantization coefficient.

In the third embodiment, when an outline exists in a block of an actual image, the image encoder 202 may encode a block of the actual image with a relatively high bit amount. In contrast, when no contour line exists in a block of the real image, the image encoder 202 may encode a block of the real image with a relatively low bit amount.

According to the fourth embodiment, when an outline exists in a block of an actual image, the image encoder 202 may encode the original block size of the actual image. On the contrary, when an outline exists in a block of an actual image, the image encoder 202 may downsample the block of the actual image, reduce the block size to a smaller block size than the original block size, and then encode the same.

In the first to fourth embodiments, whether or not the contour exists in the block of the actual image may be determined according to the contour information of the virtual image. Contour information of the virtual image may be determined based on a difference in brightness values of pixels in the virtual image. Alternatively, the contour information of the virtual image may be determined through the contour detector.

In conclusion, since the contour has a great influence on image processing, the encoding apparatus 101 may encode the encoding by varying the strength of the encoding according to whether or not the contour exists in the actual image.

In the same manner, when the encoding mode information of the peripheral view is the skip mode, the direct mode, the inter 16 * 16 mode, or the intra 16 * 16 mode, the image encoder 202 is as if the outline does not exist. Can be processed. That is, when the encoding mode of the peripheral view is the skip mode, the direct mode, the inter 16 * 16 mode, or the intra 16 * 16 mode, the image encoder 202 increases the coding strength of the real image or the virtual image. Can be replaced with

When the motion information of the peripheral view is relatively small, the image encoder 202 may process the same as in the case where no contour line exists. That is, when the motion information of the neighboring view is relatively small, the image encoder 202 may increase the coding strength of the actual image or replace it with a virtual image.

The encoding result of the actual image may be transmitted to the decoding apparatus 102 through the bitstream.

Referring to FIG. 3, the decoding apparatus 102 may include an image generator 301 and an image decoder 302.

Since the image generator 301 performs the same operation as the image generator 201 described above, a detailed description thereof will be omitted.

The image decoder 302 may decode the actual image of the current view using the virtual image. For example, the image decoder 302 may replace the actual image of the current view with a virtual image without directly decoding the image.

The image decoder 302 may decode the real image by partially using the virtual image according to the area of the real image. In detail, the image decoder 302 may decode the real image using the virtual image partially for each region according to at least one of contour information of the actual image, decoding mode information of the neighboring viewpoint, or motion information of the neighboring viewpoint. .

For example, the image decoder 302 may extract the contour information of the real image using the virtual image, and decode the real image based on the contour information of the real image.

In the first embodiment, when an outline exists in a block of an actual image, the image decoder 302 may decode the block of the actual image based on the motion search and the disparity search according to a conventional method without using a virtual image. Can be. On the contrary, when no contour line exists in the block of the real image, the image decoder 302 may decode the block of the real image using the block of the virtual image.

In the second embodiment, when an outline exists in a block of an actual image, the image decoder 302 may decode the block of the actual image with a relatively low quantization coefficient. On the contrary, when the contour does not exist in the block of the real image, the image decoder 302 may decode the block of the real image with a relatively high quantization coefficient. In this case, the quantization coefficients used by the image decoder 302 correspond to the quantization coefficients used by the image encoder 202.

In the third embodiment, when an outline exists in a block of an actual image, the image decoder 302 may decode the block of the actual image with a relatively high bit amount. On the contrary, when the contour does not exist in the block of the actual image, the image decoder 302 may decode the block of the actual image with a relatively low bit amount.

In the fourth embodiment, when an outline exists in a block of an actual image, the image decoder 302 may decode the original block size of the actual image. On the contrary, when the contour does not exist in the block of the actual image, the image decoder 302 may desample the block of the actual image to a block size smaller than the original block size and then upsample it.

In conclusion, since the contour has a great influence on image processing, the decoding apparatus 102 may decode by varying the strength of decoding depending on whether the contour exists in the actual image.

In the same manner, when the decoding mode information of the peripheral view is the skip mode, the direct mode, the inter 16 * 16 mode, and the intra 16 * 16 mode, the image decoder 302 is as if the outline does not exist. Can be processed. That is, when the decoding mode of the peripheral view is the skip mode, the direct mode, the inter 16 * 16 mode, the intra 16 * 16 mode, the image decoder 302 increases the decoding strength of the actual image or the virtual image. Can be replaced with

When the motion information of the peripheral view is relatively small, the image decoder 302 may process the same as in the case where the contour does not exist. That is, when the motion information of the neighboring view is relatively small, the image decoder 302 may increase the decoding strength of the actual image or replace it with the virtual image.

Referring to FIG. 4, when a video of three viewpoints (Left, Center, Right) is received, a multiview video coding method of encoding GOP (Group of Picture) '8' is shown. In order to encode a multi-view image, a hierarchical B picture is basically applied to a temporal axis and a view axis, thereby reducing redundancy between images.

According to the structure of a multiview video illustrated in FIG. 4, the multiview video encoding apparatus 101 first encodes a left picture (I-view), and then a right picture (P-view) and a center picture (Center). A picture corresponding to three viewpoints can be encoded by sequentially encoding Picture: B-view.

In this case, the left image may be encoded in such a manner that temporal redundancy is removed by searching for similar regions from previous images through motion estimation. In addition, since the right image is encoded by using the previously encoded left image as a reference image, the right image may be encoded in such a manner that temporal redundancy based on motion estimation and view redundancy based on disparity estimation are removed. have. In addition, since the center image is encoded by using both the left image and the right image, which are already encoded, as a reference image, the inter-view redundancy may be removed according to the estimation of the shift in both directions.

Referring to FIG. 4, in a multi-view video encoding method, an image encoded without using a reference image of another view, such as a left image, may be encoded by predicting and encoding a reference image of another view in one direction, such as an I-View and a right image. An image that is predicted and encoded in both directions, such as a P-View and a center image, is defined as a B-View.

Frames of MVC are largely classified into six groups according to the prediction structure. Specifically, the six groups include an I-view anchor frame for intra coding, an I-view non-anchor frame for inter-time inter-coding, a P-view anchor frame for inter-view unidirectional inter coding, and a unidirectional inter-coding between views. Classified into P-view non-anchor frame for bidirectional inter-coding between time bases, B-view anchor frame for bidirectional inter-coding between views, and B-view non-anchor frame for bidirectional inter-coding between time-bases. Can be.

When the encoding apparatus 101 compresses the current block located in the current frame, which is the current image 501, the

reference images

502 and 503 located in time around the current frame and the

reference images

504 and 505 located in the periphery in view. Can be used. In detail, the encoding apparatus 101 may search a prediction block most similar to the current block in the reference images 502 ˜ 505 and compress the residual signal between the current block and the prediction block. As such, the compression mode for searching the prediction block using the reference image may include P Slice Only / Direct (B Slice Only), 16x16, 16x8, 8x16, and P8x8 modes.

The encoding apparatus 101 may use the Ref1 image 502 and the Ref2 image 503 to search for motion information of the current image 501, and the Ref3 image 504 to search for variation information of the current image 501. ) And the Ref4 image 505 can be used.

According to an embodiment of the present invention, the encoding apparatus 101 may generate a virtual image of the current view by synthesizing the images of the

reference images

504 and 505 corresponding to the neighboring view of the current view. The encoding apparatus 101 may encode the actual image using the contour information of the virtual image. In this case, the encoding apparatus 101 may change the encoding scheme according to the contour information of the real image, and the contour information of the real image may be extracted from the contour information of the virtual image. The decoding device 102 may also be performed in substantially the same manner as the encoding device 101.

In FIG. 6, the encoding apparatus 101 generates a virtual image 601 at V _n , which is the current view, by synthesizing an image 602 of V _n-1 , which is a neighboring view, and an image 603 of V _{n + 1} . Can be. At this time, the image 602 of V _n-1 and the image 603 of V _{n + 1 which} are peripheral viewpoints need to be encoded already. If the current view is a B-view, the virtual image 601 of the B-view may be generated by synthesizing the virtual image of the already-coded I-view and the virtual image of the P-view. In this case, camera information may also be utilized when generating the virtual image 601 of the B-view.

In FIG. 7, the encoding apparatus 101 may generate the virtual image 703 of the current view by synthesizing the

images

701 and 702 of the surrounding view. The encoding apparatus 101 may extract contour information from the generated virtual image 703 of the current view. In addition, the encoding apparatus 101 may encode the actual image of the current view using the virtual image 703.

According to an embodiment of the present invention, the encoding apparatus 101 generates a virtual image of the current view by synthesizing the image of the neighboring view, which is already encoded, and uses the virtual image to encode the actual image, thereby encoding the actual image. Can improve.

In addition, when a color image is generated from an actual image, distortion may occur in an outline region of the actual image. Accordingly, the encoding apparatus 101 may improve encoding efficiency and minimize distortion due to the outline by changing the encoding scheme according to the outline information of the actual image. In this case, the encoding apparatus 101 may increase the strength of the encoding in the region where the contour does not exist, without weakening the strength of the encoding in the region where the contour exists in the actual image or by utilizing the virtual image. Here, the contour information of the actual image may be derived from the contour information of the virtual image.

Referring to FIG. 8, in the

images

801 and 802, a black block is an area not including an outline, and a white block is an area including an outline. The encoding apparatus 101 may encode a relatively high bit amount for an area including an outline and a relatively low bit amount for an area not including an outline.

In FIG. 9, the virtual image 901 and the real image 902 are shown. As described above, the virtual image 901 and the real image 902 mean an image of a current view to be encoded. The virtual image 901 is generated by synthesizing an image of a neighboring viewpoint. In an embodiment of the present invention, the virtual image and the real image may include all images, such as a color image, a depth image, a disparity image, and an occlusion image.

The encoding apparatus 101 may differently set a coding scheme of the real image 902 based on the contour information of the real image 902. In this case, the contour information of the real image 902 may be derived from the contour information of the virtual image 901.

In the real image 902, block 1 does not include an outline and block 2 means an area including an outline. As described above, whether the blocks of the actual image 902 include the contour may be determined according to the contour information of the virtual image 901.

The encoding apparatus 101 may encode the first block of the actual image 902 with a relatively low bit amount or may encode the virtual image 901. In addition, the encoding apparatus 101 may encode block 2 of the actual image 902 with a relatively high bit amount or directly encode it according to an existing method without using the virtual image 901.

The encoding method of FIG. 10 may be equally applied to the decoding method performed by the decoding apparatus.

In operation S1001, the encoding apparatus 101 may encode an image corresponding to a peripheral view of the current view.

In operation S1002, the encoding apparatus 101 may generate a virtual image of the current view by synthesizing the image of the neighboring view that is already encoded. For example, the encoding apparatus 101 may generate a virtual image of another B view by synthesizing an image of an I view, a B view, or a P view that is already encoded. In addition, a virtual image of another P view may be generated by synthesizing an image of an I view or a P view that is already encoded. As a result, the encoding apparatus 101 may generate virtual images of all views except the I view by using the information of at least one view that is already encoded. The generated virtual image may be utilized when encoding the actual image.

In operation S1003, the encoding apparatus 101 may extract the outline from the virtual image. In operation S1004, the encoding apparatus 101 may determine an encoding criterion of a block of an actual image. In detail, the encoding apparatus 101 may change the encoding scheme in consideration of whether an outline is included in a block of an actual image, whether motion information of a neighboring view is relatively small, and whether the encoding mode of the neighboring view is encoding mode 1. Can be. Here, the encoding mode 1 may include a skip mode, a direct mode, an inter 16 * 16 mode, an intra 16 * 16 mode, and the type of the encoding mode 1 may vary according to the configuration of the system. Encoding mode 2 may include other encoding modes except encoding mode 1.

Basically, the encoding apparatus 101 may substitute a virtual image without directly encoding an actual image. If the block of the actual image does not include an outline, the motion information of the neighboring view is relatively small, or the encoding mode of the neighboring view is the encoding mode 1, in operation S1005, the encoding apparatus 101 may perform the first encoding scheme. According to the real video can be encoded.

On the contrary, when the block of the actual image includes an outline, the motion information of the neighboring view is relatively large, or the encoding mode of the neighboring view is encoding mode 2, in step S1006, the encoding apparatus 101 according to the second encoding scheme. The actual image can be encoded.

In this case, the first encoding method means replacing the real video with the virtual video without encoding the real video or encoding the real video with a relatively low bit amount. In addition, the second encoding method means encoding an actual video with a relatively high bit amount.

Methods according to an embodiment of the present invention can be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

Claims

An image generator generating a virtual image of a current view to be encoded; And

An image encoder which encodes an actual image of a current view using the virtual image.

Encoding apparatus comprising a.
The method of claim 1,

The image generator,

Generating a virtual image of the current view by synthesizing the images corresponding to the neighboring views of the current view,

The image encoder,

And encoding the real image with a virtual image without encoding the real image.
The method of claim 1,

The image encoder,

And encoding the real image based on at least one of encoding mode information of a neighboring viewpoint, motion information of a neighboring viewpoint, and contour information of the virtual image.
The method of claim 3,

The image encoder,

If an outline exists in a block of the real image, a block of the real image is encoded based on a motion search and a shift search.

And if an outline does not exist in the block of the real image, the encoding process for the block of the real image is skipped.
The method of claim 3,

The image encoder,

If an outline exists in a block of the real image, the block of the real image is encoded with a relatively low quantization coefficient,

And if the contour does not exist in the block of the real image, the block of the real image is encoded with a relatively high quantization coefficient.
The method of claim 3,

The image encoder,

If an outline exists in a block of the real image, the block of the real image is encoded with a relatively high bit amount,

And if the contour does not exist in the block of the real image, the block of the real image is encoded with a relatively low bit amount.
The method of claim 3,

The image encoder,

If an outline exists in a block of the real picture, the original block size of the real picture is encoded.

And if the contour does not exist in the block of the real image, down-sampling the block of the real image to reduce the block size to a smaller block size than the original block size and encoding.
The method of claim 3,

The image encoder,

When the encoding mode information of the peripheral view is a skip mode, a direct mode, an inter 16 * 16 mode, or an intra 16 * 16 mode, replacing the real image with a virtual image or encoding the real image with a relatively low bit amount An encoding device characterized by the above-mentioned.
The method of claim 3,

The image encoder,

And when the motion information of the neighboring view is relatively small, replace the real image with a virtual image or encode the real image with a relatively low bit amount.
An image generator generating a virtual image of a current view to be decoded; And

An image decoder which decodes the real image of the current view by using the virtual image.

Decoding apparatus comprising a.
The method of claim 10,

The image generator,

Generating a virtual image of the current view by synthesizing the images corresponding to the neighboring views of the current view,

The image decoder,

And a real image is replaced with a virtual image without decoding the real image.
The method of claim 10,

The image decoder,

And decoding the real image based on at least one of decoding mode information of a neighboring viewpoint, motion information of a neighboring viewpoint, and contour information of the virtual image.
The method of claim 12,

The image decoder,

If an outline exists in the block of the real image, the block of the real image is decoded based on the motion search and the shift search.

And if the contour does not exist in the block of the real image, the block of the real image is decoded using the block of the virtual image.
The method of claim 12,

The image decoder,

If an outline exists in a block of the real image, the block of the real image is decoded with a relatively low quantization coefficient,

And if the contour does not exist in the block of the real image, the block of the real image is decoded with a relatively high quantization coefficient.
The method of claim 12,

The image decoder,

If an outline exists in a block of the real image, the block of the real image is decoded with a relatively high bit amount,

And if the contour does not exist in the block of the real image, the block of the real image is decoded with a relatively low bit amount.
The method of claim 12,

The image decoder,

If an outline exists in a block of the real picture, the original block size of the real picture is decoded.

And if the contour does not exist in the block of the real image, the block of the real image is decoded to a block size smaller than the original block size and then upsampled.
The method of claim 12,

The image decoder,

When the decoding mode information of the peripheral view is a skip mode, a direct mode, an inter 16 * 16 mode, or an intra 16 * 16 mode, replacing the real image with a virtual image or decoding the real image with a relatively low bit amount. Decoding apparatus characterized by.
The method of claim 12,

The image decoder,

And when the motion information of the neighboring view is relatively small, replace the real image with a virtual image or decode the real image with a relatively low bit amount.
Generating a virtual image of a current view to be encoded; And

Encoding an actual image of a current view using the virtual image

Encoding method comprising a.
The method of claim 19,

Generating the virtual image of the current view to be encoded,

Generating a virtual image of the current view by synthesizing the images corresponding to the neighboring views of the current view,

The encoding of the actual image of the current view may include:

And encoding the real image with a virtual image without encoding the real image.
The method of claim 19,

The encoding of the actual image of the current view may include:

And encoding the real image based on at least one of encoding mode information of a neighboring viewpoint, motion information of a neighboring viewpoint, and contour information of the virtual image.
The method of claim 21,

The encoding of the actual image of the current view may include:

If a contour line exists in the block of the real image, encoding a block of the real image based on a motion search and a shift search; or

Skipping the encoding process for the block of the real image when the contour does not exist in the block of the real image

Encoding method comprising a.
The method of claim 21,

The encoding of the actual image of the current view may include:

If an outline exists in a block of the real image, encoding the block of the real image with a relatively low quantization coefficient; or

Encoding the block of the real image with a relatively high quantization coefficient when there is no contour line in the block of the real image

Encoding method comprising a.
The method of claim 21,

The encoding of the actual image of the current view may include:

If an outline exists in a block of the real image, encoding a block of the real image with a relatively high bit amount; or

If no contour line exists in the block of the real image, encoding the block of the real image with a relatively low bit amount

Encoding method comprising a.
The method of claim 21,

The encoding of the actual image of the current view may include:

If an outline exists in a block of the real image, encoding the original block size of the real image; or

If an outline exists in a block of the real image, down-sampling the block of the real image to reduce the block size to a smaller block size than the original block size and then encoding

Encoding method comprising a.
The method of claim 21,

The encoding of the actual image of the current view may include:

When the encoding mode information of the peripheral view is a skip mode, a direct mode, an inter 16 * 16 mode, or an intra 16 * 16 mode, replacing the real image with a virtual image or encoding the real image with a relatively low bit amount An encoding method characterized by the above-mentioned.
The method of claim 21,

The encoding of the actual image of the current view may include:

And when the motion information of the neighboring view is relatively small, replace the real image with a virtual image or encode the real image with a relatively low bit amount.
Generating a virtual image of a current view to be decoded; And

Decoding an actual image of a current view using the virtual image

Decryption method comprising a.
The method of claim 28,

Generating the virtual image,

Generating a virtual image of the current view by synthesizing the images corresponding to the neighboring views of the current view,

Decoding the real video,

And deciphering the real video with a virtual video without decoding the real video.
The method of claim 28,

Decoding the actual video of the current view,

And decoding the real image based on at least one of decoding mode information of a neighboring viewpoint, motion information of a neighboring viewpoint, and contour information of the virtual image.
The method of claim 30,

Decoding the actual video of the current view,

Decoding the block of the real image based on the motion search and the shift search when an outline exists in the block of the real image; or

When the contour does not exist in the block of the real image, decoding the block of the real image using the block of the virtual image

Decryption method comprising a.
The method of claim 30,

Decoding the actual video of the current view,

If an outline exists in a block of the real image, decoding the block of the real image with a relatively low quantization coefficient; or

Decoding a block of the real image with a relatively high quantization coefficient when there is no contour line in the block of the real image

Decryption method comprising a.
The method of claim 30,

Decoding the actual video of the current view,

If an outline exists in a block of the real image, decoding the block of the real image with a relatively high bit amount; or,

Decoding a block of the real image with a relatively low bit amount when no contour line exists in the block of the real image

Decryption method comprising a.
The method of claim 30,

Decoding the actual video of the current view,

If an outline exists in a block of the real image, decoding the original block size of the real image; or

If an outline exists in the block of the real image, decoding the block of the real image to a block size smaller than the original block size and then upsampling

Decryption method comprising a.
The method of claim 30,

Decoding the actual video of the current view,

When the decoding mode information of the peripheral view is a skip mode, a direct mode, an inter 16 * 16 mode, or an intra 16 * 16 mode, replacing the real image with a virtual image or decoding the real image with a relatively low bit amount. A decoding method characterized by the above-mentioned.
The method of claim 30,

Decoding the actual video of the current view,

And if the motion information of the peripheral view is relatively small, replace the real video with a virtual video or decode the real video with a relatively low bit amount.
A computer-readable recording medium having recorded thereon a program for executing the method of claim 19.