Nothing Special   »   [go: up one dir, main page]

CN101860754B - Method and device for coding and decoding motion vector - Google Patents

Method and device for coding and decoding motion vector Download PDF

Info

Publication number
CN101860754B
CN101860754B CN2010101742829A CN201010174282A CN101860754B CN 101860754 B CN101860754 B CN 101860754B CN 2010101742829 A CN2010101742829 A CN 2010101742829A CN 201010174282 A CN201010174282 A CN 201010174282A CN 101860754 B CN101860754 B CN 101860754B
Authority
CN
China
Prior art keywords
motion vector
predictor
fallout predictor
template
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010101742829A
Other languages
Chinese (zh)
Other versions
CN101860754A (en
Inventor
杨雯
区子廉
代晶静
邹峰
刘雨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hong Kong Applied Science and Technology Research Institute ASTRI
Original Assignee
Hong Kong Applied Science and Technology Research Institute ASTRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hong Kong Applied Science and Technology Research Institute ASTRI filed Critical Hong Kong Applied Science and Technology Research Institute ASTRI
Publication of CN101860754A publication Critical patent/CN101860754A/en
Application granted granted Critical
Publication of CN101860754B publication Critical patent/CN101860754B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention relates to a video coding method. Specifically, the invention relates to motion vector (MV) coding, wherein the MV coding is based on edge matching or adaptive template matching, namely the motion vector coding based on boundary matching (MVCBM) and the motion vector coding based on adaptive template matching (MVCATM). Generally speaking, the invention limits a prediction candidate set, wherein a predictor adaptively changes based on the current distribution of the adjacent MV. Subsequently, a matching technique (boundary matching in MVCBM and adaptive template matching in MVCATM) is used for reducing the number of the prediction and reducing the number of bits used by indexing. Afterwards, an optimal motion vector predicator is selected from the reduced concentrated predictor. The guessing strategy based on the least MVD standard further saves the number of indexing bits.

Description

The method and apparatus of motion vector encoder and decoding
Technical field
The present invention relates generally to Digital Video Processing.Especially, the present invention relates to comprise the method and apparatus of encoding and decoding motion vector encoder.
Background technology
Estimation (Motion estimation, be called for short ME) and motion compensation (Motioncompensation, be called for short MC) be the modern video coding standard (as MPEG-1, MPEG-2, MPEG-4, H.261, H.263, H.264 and AVS) in important tool, with the press time redundancy, thereby reach high coding efficiency.In ME/MC, present frame is divided into nonoverlapping block.For each current block in present frame, limit search district in reference frame.Every bit in the field of search is corresponding to a candidate blocks, and this candidate blocks is the good predict of current block potentially.Limiting similarity measurement and in the field of search, search for to search candidate blocks based on similarity measurement,, even the similitude of this candidate blocks and current block is not maximum, is also very large.This candidate blocks with maximum comparability will be best matching blocks.Relative displacement between the fast and current block of optimum Match is called as motion vector, and it need to be encoded.The coding of motion vector (motion vector is called for short MV) is also referred to as motion vector encoder (motion vectorcoding is called for short MVC).
On the other hand, for decoding end realizes motion compensation, coding side need to expend a large amount of bit streams and be used for transmitting motion vector information.For example in H.264, when bit rate very low (for example QP=40), the percentage that the spent bit number of motion vector information accounts for the total coding number is very high, even reaches 50%.So this area is carried out motion vector encoder in the urgent need to more effective method and is improved its code efficiency.
In up-to-date motion vector encoder method, many instruments have been introduced to improve the efficiency of motion vector encoder.For example, for the quantity of the compressed-bit that reduces motion vector, the H.264 simple predictive coding encoding motion vector of standard utilization., for each current block, H.264 utilize a formation motion vector predictor (motion vector predictor is called for short MVP) of the centre of three adjacent motion vectors (MV).The motion vector difference of the true MV of MVP and current block (motion vector difference is called for short MVD) is encoded in bit stream.Should " middle MVP " effectively reduce the position that is used for the MV coding, because it in most of the cases is similar to the true MV of current block.But middle MVP can not always optimally predict current MV.Need more effective MVP further to reduce the coding figure place for MV.
Also once there is additive method to attempt to obtain the effective motion vector coding.for example, put down in writing to some extent in the following discloses file: S.Kamp, " the Decoder side motion vectorderivation for inter frame video coding " of M.Evertz and M.Wien, come from the international image of IEEE and process meeting (IEEEInternational Conference on Image Processing), pp.1120-1123, 2008, (hereinafter referred to as " people's such as S.Kamp articles ") and the 7th, 023, No. 919, name is called the United States Patent (USP) of " Method for coding motionvector using 2-dimentional minimum bitrate predicting technique ".
In the people's such as S.Kamp article, a kind of method of obtaining motion vector has been described.The method is carried out the method for similar estimation to obtain motion vector and reference key in decoding end.But, the method can not adaptively modifying MV fallout predictor Candidate Set, and the method abandon with existing accurate ME method obtain MV but directly in decoding end with not being that the template matches mode obtains MV very accurately, and do not use guess strategy in the method.In addition, template matches is used the template of fixed size and shape.Do not use reference key or MVD in the method.Generally speaking, the method is very complicated, and the use template matches obtains MV and reference key self is always not reliable.
In No. 7023919 U.S. Patent application, a kind of method of motion vector encoder has been described.The method does not use matching technique to reduce MV fallout predictor Candidate Set, and the self-adapted candidate collection is not provided yet.Even the use guess strategy, it is based on minimum bit rate but not minimum MVD.Time-based MV fallout predictor is not used as the candidate in the method.The method lacks efficiency, particularly in the situation that MVD is very little all the more so.Different MVD may have identical bit rate in addition, makes the standard based on minimum bit rate lack efficiency.
Also have method for distinguishing to utilize Boundary Match to attempt.for example in the following discloses file: YanChen, Yang Hu, Oscar C.Au, Houqiang Li, " the Video ErrorConcealment Using Spatio-Temporal Boundary Matching and Partial DifferentialEquation " of Chang Wen Chen, IEEE multimedia journal (IEEE TRANSACTIONS ON MULTIMEDIA), VOL.10, NO.1, in January, 2008 (hereinafter referred to as " people's such as Yan Chen articles "), the and the 5th, 596, No. 370, name is called the United States Patent (USP) of " Boundary matching motion estimation apparatus ".
In the people's such as Yan Chen article, provide a kind of system and method for the mistake for hiding vision signal.Boundary Match only limits to for error concealing.Thereby the method for the disclosure is not pointed out the accuracy of utilizing Boundary Match to select to improve the MV fallout predictor and is reduced MVD, does not utilize the existing MV that obtains from the accurate estimation of coding side yet.In addition, do not use template matches in this method.The shortcoming of the method is to utilize Boundary Match always not reliable to obtain MV itself.
, the 5th, 596, in No. 370 United States Patent (USP)s, provide a kind of device that carries out estimation.Boundary Match only limits to obtain motion vector, and the purpose of this method is to provide a kind of alternative method of estimation.The method does not have to use the MV that obtains in the coding side estimation, and shortcoming is to utilize Boundary Match but not estimation acquisition MV itself is always not reliable.Boundary Match only limits to obtain motion vector, and the method does not provide the information of motion vector encoder.Due to not self-adapted candidate setting, so this mode is inefficent, and the method do not consider other matching techniques, for example the adaptive template coupling.
Thereby, need to provide a kind of system and method for motion vector encoder, to solve above-mentioned one or more problem.
Other background technologies of relevant Video coding can be with reference to file once: the H.264and M-PEG-4VideoCompression of Iain Richardson, Wiley﹠amp; Sons,
Figure GSA00000108193400031
2003 and the The Essential Guide to Video Processing of Alan Bovik, Academic Press
Figure GSA00000108193400032
2009.These disclosed files all are introduced as a reference.
Summary of the invention
In view of above-mentioned, the present invention needs the method and apparatus of a kind of motion vector encoder and decoding, and method efficiency in above-mentioned technology is low to overcome, the problem of poor reliability.
Particularly, the invention provides a kind of motion vector encoder method, comprise the following steps:
Step 1: limit the Candidate Set of fallout predictor, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector;
Step 2: the figure place that the number that utilizes matching process to reduce the fallout predictor in described Candidate Set uses to reduce index;
Step 3: based on selected optimum fallout predictor in the remaining predicted device of standard in described Candidate Set of minimum movement phasor difference, and it is poor to obtain current motion vector;
Step 4: poor based on remaining predicted device and current motion vector, utilize guess strategy to survey motion vector predictor further to save the figure place for code index;
Step 5: judge whether to detect correct motion vector predictor, if detect correct motion vector predictor, encoding, current motion vector is poor at least,, if can't detect correct motion vector predictor, to current motion vector is poor at least, with index, encodes.
Wherein, described matching process is Boundary Match method or adaptive template matching process.
Wherein, described Boundary Match method is, will paste the current data space corresponding to a part of data of the fallout predictor in described Candidate Set, obtains the Boundary Match error, removes one or more fallout predictors of Boundary Match error maximum in described Candidate Set.
Wherein, described adaptive template matching process is to be identified for the shape of the adaptive template in current data space based on correlation possible between adaptive template and current data; Perhaps based on the consistency in adaptive template, be identified for the size of the adaptive template in current data space.
Wherein, described adaptive template matching process also comprises and utilizing based on displacement corresponding to fallout predictor in Candidate Set, calculates poor between the template of the data space after displacement in the template in current data space and reference picture.
Wherein, in the adaptive template matching process, width and the shape of described adaptive template are specified.
Wherein, after described step 5,, if detect correct motion vector predictor, send the current motion vector of at least having encoded poor; , if can't detect correct motion vector predictor, send the position as index that the current motion vector of at least having encoded is poor and encoded.
Wherein, the Candidate Set of described fallout predictor comprises some proportional room and time fallout predictors.
Wherein, in described step 1, the motion vector adjacent with described motion vector be adjacent with the described motion vector time, space is adjacent, the time and space is adjacent or based on the adjacent motion vector of analysis strategy.
Wherein, guess strategy in step 4, the number of described remaining predicted device is at least 1, to each remaining predicted device and intermediate parameters of the poor generation of current motion vector, standard based on the minimum movement phasor difference reselects fallout predictor to be selected for each intermediate parameters, if the fallout predictor to be selected that reselects is identical with the remaining predicted device that produces this intermediate parameters, judge that this remaining predicted device is optional fallout predictor, if the number of optional fallout predictor is 1, this optional fallout predictor is correct motion vector predictor.
The present invention also provides the method for the motion vector that a kind of decoding encoded, and described motion vector of having encoded is encoded by the method for claim 1, comprises the following steps:
Step 1: decoding motion vectors is poor;
Step 2: limit the Candidate Set of fallout predictor, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector;
Step 3: utilize matching process to reduce the number of the fallout predictor in described Candidate Set;
Step 4:, based on the remaining predicted device in described Candidate Set and the motion vector difference of decoding, utilize the guess strategy judgement can determine motion vector predictor;
Step 5:, if can determine motion vector predictor, utilize motion vector difference and the fixed motion vector predictor of decoding to obtain motion vector; If can not determine motion vector predictor, the index and judge motion vector predictor of decoding, utilize the motion vector difference of decoding and the motion vector predictor of having judged to obtain motion vector.
The matching process that described matching process and when coding adopt is identical.
The present invention also provides a kind of motion vector encoder device, comprises following part:
First selects module, in order to select to form the fallout predictor of Candidate Set;
The first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set;
Second selects module, with described the first processing module, is connected, and receives the remaining predicted device in described Candidate Set, based on standard selected optimum fallout predictor in described remaining predicted device of minimum movement phasor difference;
The second processing module, select module to be connected with described second, obtains current motion vector according to the fallout predictor of the optimum of selecting poor;
Detecting module, with described the second processing module be connected processing module and be connected, poor based on remaining predicted device and current motion vector in the described Candidate Set that receives, utilize guess strategy to survey motion vector predictor;
Judge module, be connected with described detecting module,, if the result of detection of detecting module is to detect correct motion vector predictor, judged result sent to coding module;
Coding module, receive described judged result, and the current motion vector of encoding at least is poor or the current motion vector of encoding at least is poor and index.
The present invention also provides a kind of motion vector decoding apparatus, comprises following part:
Receiver module, receive the motion vector difference of at least having encoded;
The first decoder module, connect described receiver module, and according to the motion vector difference of at least having encoded that receives, decoding motion vectors is poor;
First selects module, in order to select to form the fallout predictor of Candidate Set;
The first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set;
Can judge module, connect described the first processing module and described the first decoder module,, based on the remaining predicted device in described Candidate Set and the motion vector difference of decoding, utilize the guess strategy judgement determine motion vector predictor;
The second decoder module, connect described judge module, according to described judged result decoding index;
Analysis module, connect described the first processing module and the second decoder module, according to the index of decoding, judges motion vector predictor;
The second processing module, connect described judge module, described the first decoder module and described analysis module,, according to judged result, utilizes motion vector difference and definite motion vector predictor of having decoded of decoding to obtain motion vector; Perhaps utilize the motion vector difference of decoding and the motion vector predictor of having judged to obtain motion vector.
The method of motion vector encoder provided by the invention and decoding can be rapidly, reliably, effectively motion vector is carried out the processing of encoding and decoding, improved the efficiency of system.And the present invention can be used for the video coding system of any employing estimation, and movable information need to be sent to decoder, such as but not limited to H.264, KTA, AVS, MPEG.In addition, the present invention also can be used for the encoder of any employing hybrid predicting coding.
By the embodiment of following explanation, other aspects of the present invention are also disclosed.
Description of drawings
Below with reference to the accompanying drawings, describe these and other purpose of the present invention, aspect and execution mode in detail, wherein:
Fig. 1 represents the exemplary expression according to the current block of the embodiment of the present invention and adjacent block thereof.
Fig. 2 represents according to the inner boundary pixel of the piece of the embodiment of the present invention and outer boundary pixel.
Fig. 3 represents the exemplary template according to the template matches of the embodiment of the present invention.
Fig. 4 represents the exemplary template that the template width according to the embodiment of the present invention equals 4.
Fig. 5 represents the flow chart according to the MVCBM of the embodiment of the present invention.
Fig. 6 represents the flow chart according to the MVCATM of the embodiment of the present invention.
Fig. 7 represents the block diagram according to the embodiment of a video coding system of the embodiment of the present invention.
Fig. 8 represents the block diagram according to the embodiment of a video decoding system of the embodiment of the present invention.
Fig. 9 represents the schematic diagram according to the motion vector encoder device of the embodiment of the present invention.
Figure 10 represents the schematic diagram according to the motion vector decoding apparatus of the embodiment of the present invention.
Embodiment
The present invention relates to method for video coding.Especially, it relates to motion vector (MV) coding, wherein the MV coding is based on Boundary Match or adaptive template coupling, namely based on the motion vector encoder (MVCBM) of Boundary Match and the motion vector encoder (MVCATM) that mates based on adaptive template.In general, the present invention limits the fallout predictor Candidate Set, and wherein fallout predictor changes adaptively based on the current distribution of adjacent MV.Subsequently, matching technique (Boundary Match in MVCBM and the coupling of the adaptive template in MVCATM) is used for reducing the size of fallout predictor Candidate Set to reduce the coding figure place of index use.Then, select optimum motion vector predictor in the fallout predictor among being contained in the collection of minimizing.Further saved the figure place of index based on the guess strategy of minimum MVD standard.
Particularly, possible MVP Candidate Set comprises some proportional room and time fallout predictors.In order to increase the diversity of fallout predictor, spatial predictors is based on the feature adaptively modifying of adjacent motion vectors.In order to select good fallout predictor from Candidate Set (CS), the matching technique of use is such as but not limited to Boundary Match (BM) and adaptive template coupling (ATM).Select the optimum MVP of current block so that MVD is minimum from the fallout predictor of selecting by matching technique.The standard that is based on minimum MVD due to optimum MVP is selected, thus introduce guess strategy, thus can save the bit number that the MVP index signal is transferred to decoder in some cases.The present invention can reduce bit rate significantly with respect to standard H.264.
A. proportional motion vector predictor
The motion vector of adjacent block is used as the fallout predictor of the motion vector of current block.The different reference frames of the motion vector of adjacent block in can corresponding embodiment, a plurality of reference frames in for example allowing H.264 in this embodiment.During reference frame corresponding to the motion vector of two adjacent pieces, the relative present frame of its time gap is different.Thereby in using the embodiment of a plurality of reference frames, before being used as predicting the motion vector of current block, the motion vector of adjacent block according to its time gap by convergent-divergent pro rata.Fig. 1 represents the exemplary expression of current block and adjacent block thereof.With mv A(MV of the piece A in the left side of current block) is example, supposes that the time gap between piece A and its reference block is d p, the time gap between current block and its reference block is d cCalculate proportional fallout predictor mv by following mode SA
m v SA = mv A × d c d p - - - ( 1 )
Utilize the mv that identical method can computing block B SB, the mv of piece C SCDeng.Therefore, each fallout predictor proportional convergent-divergent before using.
The B.MVP Candidate Set
One aspect of the present invention is to provide fallout predictor and coding method for the parameter generating in data compression and expression, for example encoding motion vector in video compression.Select adaptively two or more candidates according to adjacent data message.The data message of " adjacent " comprises but is not limited to space is adjacent, the time is adjacent, adjacent combination and based on some adjacent functions of analysis strategy.Analysis strategy includes but not limited to current relevant, distribution, for example selects the similar not adjacent motion vector of vector adjacent with other as the candidate, in order to the current motion vector of coding in video compression.
Possible MVP Candidate Set comprises some proportional room and time fallout predictors.In order to increase the diversity of fallout predictor, spatial predictors is based on the feature adaptively modifying of adjacent motion vectors.
In one embodiment, in order to make MVP, reach high accuracy, the MVP Candidate Set comprises the MVP in time and space.The MVP Candidate Set comprises a plurality of such MVP, and its quantity according to circumstances becomes, such as but not limited to 5 MVP or 8 MVP.
In further embodiment, for a given Candidate Set, the fallout predictor that comprises changes adaptively based on the current distribution of MVP.For example, do not lose generality, the size of Candidate Set is selected as 3, and size equals 3 Candidate Set and comprises mv Scol, mv SH.264And mv Sneimv ScolThe common location MV (referring to have at former frame and current block the motion vector of the piece of same position) according to the proportional convergent-divergent of formula (1).It is time MVP candidate.mv SH.264And mv SneiFor space MVP candidate.
mv SH.264Be one (these 3 adjacent motion vectors are according to the proportional convergent-divergent of formula (1)) of the centre of 3 adjacent motion vectors, for example it can be from mv SA, mv SBAnd mv SCAn acquisition of centre.
mv SneiThree proportional adjacent motion vectors mv SA, mv SBAnd mv SCIn one, it is from mv SH.264Farthest:
mv Snei = arg max mv x | | mv x - mv SH , 264 | | 2 , x = SA , SB , SC - - - ( 2 )
This fallout predictor mv is set SneiReason be, in adjacent piece A, B and C only one while belonging to the object that comprises current block, try to obtain more effective MVP.In this case, the correlation of the actual MV of middle MVP and current block may be very low.
So MVP Candidate Set (Candidate Set, be called for short CS) is comprised of three MVP under this concrete exemplary condition, wherein under this condition the size of Candidate Set equal 3 (size-3CS):
CS={mv SH.264,mv Scol,mv Snei} (3)
C.CS reduces and optimizes MVP
Initial MVP Candidate Set can comprise many MVP, and the index of of selecting needs many positions with explanation., in order to reduce the position for the index of optimum MVP, reduce CS to comprise the fallout predictor of lesser number.In an embodiment, use the method that is called Boundary Match.In another embodiment, use the method that is called the adaptive template coupling.Based on matching status, Candidate Set (Reduced CandidateSet, the be called for short RCS) size of minimizing is fixed or variable.For example select the optimum prediction device, also select the several good fallout predictor of back if the fallout predictor of back is close to well.If perhaps best fallout predictor is much better than other fallout predictors, we also can only select best fallout predictor.Has mv at this Scol, mv SH.264And mv SneiThe special case of size-3CS in, we can use the RCS that is of a size of 2 fixed dimension.
D. Boundary Match
One aspect of the invention is: determine the self-adapted candidate collection; Reduce Candidate Set to save the figure place of index by matching technique; Execution is based on guess strategy and the whole MV cataloged procedure of minimum MVD; Utilize Boundary Match as matching technique in the MV coding.
Further aspect of the present invention also comprises: carry out Boundary Match, for example will arrive in the current data space harmony and continuity between the adjacent data in measurement current data space and the data division of stickup corresponding to a part of data Replica of each candidate.
In following article to Boundary Match (Boundary matching, be called for short BM) existing explanation: Yan Chen, Yang Hu, Oscar C.Au, Houqiang Li, " the Video ErrorConcealment Using Spatio-Temporal Boundary Matching and Partial DifferentialEquation " of Chang Wen Chen, come from IEEE multimedia journal (IEEE TRANSACTIONS ONMULTIMEDIA), VOL.10, NO.1, in January, 2008, be incorporated herein its disclosure.
Boundary Match is widely used in error concealment to find the motion vector of most probable that points in reference frame, to recover the loss piece.BM estimates based on the search of the spatial continuity between piece and adjacent block thereof fallout predictor.If use incorrect fallout predictor, corresponding reconstructed block is adjacent piece not have the successional possibility of high spatial very large.If but used correct fallout predictor, piece and the adjacent block rebuild should be continuous.
Match-on criterion is Boundary Match error (boundary matching error is called for short BME), the space discontinuity between the inner boundary pixel of its measurement candidate blocks and the outer boundary pixel of current block, as shown in Figure 2.Fig. 2 represents inner boundary pixel and the outer boundary pixel of piece.Letter N, W, E, S represent direction north, west, Dong Henan.BME has two parts: level and smooth discontinuous distortion (smoothdiscontinuity distortion is called for short SDD) and the discontinuous distortion in edge (edge discontinuitydistortion is called for short EDD):
BME=α×SDD+(1-α)×EDD (4)
Wherein weight factor α is the real number between 0 to 1.
In the MV coding method of noticing in this instantiation, BM can carry out to find suitable fallout predictor in encoder., owing to not yet decoding at decoder usually in east side and the southern side of current block, only use the boundary information that easily obtains, for example information on north side and/or border, west side.SDD and EDD are calculated as follows:
SDD = Σ k = 0 N X - 1 | p rec ( x + k , y ) - p rec ( x + k , y - 1 ) | + Σ k = 0 N W - 1 | p rec ( x , y + k ) - p rec ( x - 1 , y + k ) | - - - ( 5 )
EDD = Σ k - 0 N w - 1 | ▿ ( Δp rec ( x + k , y ) ) | ▿ ( Δ p rec ( x + k , y ) ) | · ▿ ⊥ p rec ( x + k , y ) | ▿ ⊥ p rec ( x + k , y ) | | × | ▿ p rec ( x + k , y ) |
+ Σ k - 0 N h - 1 | ▿ ( Δp rec ( x , y + k ) ) | ▿ ( Δ p rec ( x , y + k ) ) | · ▿ ⊥ p rec ( x , y + k ) | ▿ ⊥ p rec ( x , y + k ) | | × | ▿ p rec ( x , y + k ) | - - - ( 6 )
If wherein (x, y) points to outer boundary, p rec(x, y) refers to the current reconstruction pixel value of (x, y) position, if (x, y) points in inner boundary, and p rec(x, y) refers to possible candidate blocks.
Figure GSA00000108193400104
Gradient operator,
Figure GSA00000108193400105
The normal operator with the direction of gradient direction quadrature,
Figure GSA00000108193400106
It is Laplacian.In an exemplary embodiments, these relevant operators can be calculated as follows:
| ▿ ⊥ p rec ( x , y ) | = | ▿ p rec ( x , y ) = [ ∂ p rec ( x , y ) ∂ x ] 2 + [ ∂ p rec ( x , y ) ∂ y ] 2
∂ p rec ( x , y ) ∂ x = p rec ( x + 1 , y ) - p rec ( x - 1 , y ) 2
∂ p rec ( x , y ) ∂ y = p rec ( x , y + 1 ) - p rec ( x , y - 1 ) 2
∂ 2 p rec ( x , y ) ∂ 2 x = p rec ( x + 1 , y ) + p rec ( x - 1 , y ) - 2 p rec ( x , y )
∂ 2 p rec ( x , y ) ∂ 2 y = p rec ( x , y + 1 ) + p rec ( x , y - 1 ) - 2 p rec ( x , y ) - - - ( 7 )
In equation (6), (▽ (Δ))/(| (▽ (Δ)) |) represents the normalized gradient of Laplace estimation, (▽ )/(| ▽ |) be tangential normalized vector.If cross-border structure is mated suitably, two should be orthogonal and inner product be zero.But if mate improperly, it is large that the absolute value of the inner product of two tends to become, and causes that inner product becomes large.In addition, for each pixel in equation (6), inner product is multiplied by gradient magnitude | ▽ | and, this tends to make the number range of EDD and the number range of SDD to have comparativity.Inner product has also reflected the situation of the piece of boundary.
For each fallout predictor in CS, corresponding reference block is used for calculating BME.Those fallout predictors with less BME are included in RCS.For example, has mv Scol, mv SH.264And mv SneiThe special case of CS of size-3 in, remove the fallout predictor with maximum BME, RCS comprises other two fallout predictors.
E. adaptive template mates
Another aspect of the invention is: determine the self-adapted candidate collection; Reduce Candidate Set to save the figure place of index by matching technique; Exploitation adaptive template shape and width strategy; Execution is based on guess strategy and the whole MV cataloged procedure of minimum MVD; Utilize the adaptive template coupling as matching technique in the MV coding.In addition, the invention provides the strategy of determining shape of template and width based on correlation and similarity standard, this strategy is applicable to multiple application, such as but not limited to motion vector encoder.
Further aspect of the present invention also comprises:
Be identified for the shape of template in current data space based on correlation possible between template and current data, for example, as block-based video compression system H.264 in, if macro block is divided into different subregions (this means that the correlation between different subregions can be very low) by rate-distortion criterion, the template of this subregion may not comprise the pixel in another subregion;
Be identified for the template size in current data space based on the consistency in template, for example, calculate the poor of possible template inside, if with current data space pixel a long way off be not similar to the current data space from close to pixel, can remove pixel a long way off from template; And
Template matching technique can include but not limited to, utilizes the displacement based on the candidate, calculates in the template in current data space and reference picture poor based between the template of displacement.
Fig. 3 represents the exemplary template of template matches.Template matches illustrates in following article: S.Kamp, " the Decoder side motion vector derivation for inter framevideo coding " of M.Evertz and M.Wien, come from the international image of IEEE and process meeting (IEEE International Conference onImage Processing), pp.1120-1123,2008, at this by reference to introducing., in order to obtain the good predict of current block, around left margin and the coboundary of object block, limit L shaped template region (TR).Limit template width M_left and M_up and be the width of the pixel of the target left side that extends to template region and top.For the template of testing current block and corresponding to the similitude between the template of the candidate blocks of MVP, the absolute difference and (sum of absolute difference is called for short SAD) that only need to calculate two templates.When template belongs to the object identical with current block,, if the template SAD that MVP provides is very little, can infer rationally that the piece corresponding to MVP also can provide the good predict of current block.
But if the some parts in template region belongs to another object with different motion, even MVP is good, this still can draw a large form SAD.In an embodiment,, for avoiding this situation, do not use M_left and the M_up of fixed dimension, and be based on possible correlation between template and object block and the similitude of template inside, use adaptive shape of template and width.In preferred embodiment, owing to providing more significant template SAD, so use large form.But any pixel that belongs to the affiliated object of different current blocks should be not included in this template.
L shaped template comprises two parts: upper section and left part.Term " left side template " refers to the left part of L shaped template.Similarly, term " top template " refers to the upper portion of L shaped template.Typically, we to allow template be L shaped template, left side template or top template.
Has mv Scol, mv SH.264And mv SneiThe one exemplary embodiment of CS of size-3 in, we limit the shape of template selection strategy as follows according to the correlation that current block is adjacent between piece:
If (blocktype=P16*16)
Use left side template and top template;
The subregion * of the subregion of 16x8 and below 16x8 above (blocktype=P16*8)/* has else if/
The top subregion uses left side template and top template, and the below subregion only uses the left side template;
(blocktype=P8*16)/* has the subregion of left side 8x16 else if, the subregion * of right side 8x16/
The left side subregion only uses the top template with use left side template and top template, right partition;
(blocktype=P8*8)/* has the subregion of four 8x8 else if, some of them can be further divided into the subregion * of the less 4x8 of being of a size of, 8x4,4x4/
The left upper subregion of current MB uses left side template and top template,
The left margin punishment district of current MB only uses the left side template,
The punishment district, coboundary of current MB only uses the top template,
Other subregions use left side template and top template.
This tactful reason is also the reason that we wish macro block (MB) is divided into different subregions.Often have relatively low correlation or different motion conditions between different subregions.So when using template SAD to select good MVP, the pixel in another subregion is included in template and may brings risk to the correctness of selected good MVP.But also can use other shape of template selection strategy.
, if current block is level and smooth, need the pixel in template to have similar brightness and flatness., if current block is texture block, need the pixel in template to have similar texture.If current block has edge, need the pixel in template to have edge, this edge is the extension at the edge in piece, and in template, the pixel on both sides of edges is similar to the interior pixel of piece.In other words, according to the consistency between template and piece or similarity, the template width is set.
Has mv Scol, mv SH.264And mv SneiThe one exemplary embodiment of CS of size-3 in, limit the structure standard of template width as follows:
Fig. 4 represents the exemplary template that the template width equals 4.
The Breadth Maximum of template is N=4; / * namely template have N row pixel */
Poor in calculation template between adjacent row., take the top template as example, as shown in Figure 4, calculate:
Absolute value difference sum (SAD) between SAD12=1 row and 2 rows;
SAD between SAD23=2 row and 3 rows;
SAD between SAD34=3 row and 4 rows;
(if SAD12>SAD23+ threshold value 1)
The top template only comprises 1 row; Otherwise
(if SAD23>SAD12+ threshold value 2 ‖ SAD12>SAD34+ threshold values 3)
The top template comprises 1 row and 2 rows; Otherwise
(if SAD34>SAD12+ threshold value 2)
The top template comprises 1 row, 2 rows, 3 rows;
Otherwise
The top template comprises 1 row, 2 rows, 3 rows, 4 rows;
Same, use identical method to obtain the width of left side template.In case current block has been set shape of template and width, has had the template of reference block of identical shaped and width just in order to calculation template SAD.Better matching template zone in reference picture has and less template SAD between the front template.Because the spatial coherence of template and current block is very high, so have reason to suppose that the piece corresponding to better matching template can provide good predict for current block.
In the present invention, all calculate corresponding template SAD for each fallout predictor in CS.Those fallout predictors with less template SAD are included in RCS.For example, has mv Scol, mv SH.264And mv SneiThe special case of CS of size-3 in, remove the fallout predictor with maximum template SAD, RCS comprises other two fallout predictors.
F. final MVP determines
Another aspect of the present invention is that all candidates in the Candidate Set that reduces are carried out comparison and counting process, and has compared the difference of candidate and parameter current and the poor of minimum of encoding in each comparison and counting process.
In the present invention, according to the strategy that arranges, the Candidate Set after matching technique reduces may comprise one or more MVP.For example, has mv Scol, mv SH.264And mv SneiThe special case of CS of size-3 in, RCS comprises two fallout predictors.So also need to select final fallout predictor from two fallout predictors.Now with the pmv of the final MVP of current block optLimit as follows:
pmv opt = arg min pmv i D ( mv - pmv i ) - - - ( 8 )
Pmv wherein iRefer to i the MVP that is included in RCS, D () is the function in order to measuring distance, and mv represents the motion vector of current block.The final MVD of current block is (mv-pmv opt).
G. index is encoded
Another aspect of the present invention is by encode candidate's index of guess strategy, this candidate compare with parameter current has minimum poor.Guess strategy is based on the difference of the minimum of having encoded and the Candidate Set of minimizing: generally speaking, N candidate produced N possible parameter, the standard based on the difference of minimum reselects optimal candidate and obtains new lowest difference for each possible parameter subsequently.If this optimal candidate identical with the candidate who produces this possibility parameter (new lowest difference also equates with original encoded lowest difference simultaneously), this candidate may; Otherwise set this candidate for impossible.Candidate if possible only has one, does not need code index, otherwise needs code index.
When all MVP in RCS are identical, do not need the index notice selected.Otherwise, need one or more the index of notifying final MVP.But optimum MVP can obtain at the decoder place in some cases, does not need to transmit index.Illustrated below how optimum MVP obtains: HyunDuk Cho, " the Method for coding motion vector using 2-dimentionalminimum bitrate predicting technique " of Sung Deuk Kim, the 7023919B2 United States Patent (USP), in April, 2006, herein by reference to introducing its disclosure.Guess strategy has been proposed.Different is that the present embodiment use minimizes MVD as standard, replaces using minimum bit rate as standard, and when the latter has identical bits speed at different MVD, efficiency is not high.
In the present embodiment, suppose after matching technique, in Candidate Set, the number of remaining predicted device is N, and has determined optimum prediction device and MVD., for each fallout predictor MVP_i, suppose that at first it is final fallout predictor, thereby can obtain a new motion vector (value of MVP_i adds MVD).This new motion vector is again selected in N fallout predictor optimum one according to poor minimum standard,, if that selection is MVP_i, illustrate that MVP_i is possible, otherwise MVP_i is impossible.
To have mv Scol, mv SH.264And mv Snei(have 2 MVPmv in RCS BM1And mv BM2) size-3 CS one exemplary embodiment as an example, the expression how to work:
Step 1: obtain two possible motion vector MV1=MVD+mv BM1And MV2=MVD+mv BM2
Step 2: suppose that MV1 is real motion vector, select to be used for the optimum prediction device of MV1 according to equation 8.If being used for the optimum prediction device of MV1 is mv BM1, flag_BM1=1 is set, otherwise flag_BM1=0;
Step 3: suppose that MV2 is real motion vector, select to be used for the optimum prediction device of MV2 according to equation 8.If being used for the optimum prediction device of MV2 is mv BM2, flag_BM2=1 is set, otherwise flag_BM2=0;
Step 4: if ((flag_BM1=1 ﹠amp; ﹠amp; Flag_BM2=1) ‖ (flag_BM1=0﹠amp; ﹠amp; Flag_BM2=0)), the index of final MVP will be transmitted.Otherwise do not transmit index, according to flag_BM1 and flag_BM2, can obtain the optimum prediction device.
Fig. 5 represents the flow chart for MVCBM.With Boundary Match as matching technique with the one exemplary embodiment of carrying out motion vector encoder in:
In coder side
MVCBM (encoder):
Step 501: be calculated to be the medium range forecast device (mv_SH.264) of proportional zoom, altogether location fallout predictor (mv_Scol) and the fallout predictor (mv_Snei) least identical with medium range forecast device in contiguous fallout predictor, but by with equation (1) similarly method will be total to location fallout predictor (mv_Scol) and the proportional convergent-divergent of vicinity fallout predictor.
Step 503: utilize Boundary Match to select two fallout predictors (mv_bm1 and mv_bm2) to enter the Candidate Set (RCS) of the minimizing with less Boundary Match error.Can certainly select more than two detectors.
Step 505:, based on the MVD standard of minimum, select final MVP for current block between mv_bm1 and mv_bm2, obtain MVD.
Step 507:, based on current MVD, utilize guess strategy to judge whether to detect correct MVP; , if can detect correct MVP, need to not encode subsequently and send position as index; Otherwise need to encode subsequently and send 1 as index (number of fallout predictor, can be greater than 1 as the position of index greater than 2 after Boundary Match);
Step 509: coding MVD and other information also need code index in the situation that can not detect correct MVP.Other information for example comprise the residual error of coded block pattern (Coded Block Pattern is called for short CBP), quantification etc.
In described step 509, in the coding flow process of reality, in macro block, the MVP index of all subregions is put together to encode and is exported, and is in whole macroblock coding output backmost.The reason of doing like this is in decoding end, just consider decoding MVP index in process of reconstruction, and other information of macro block is all decoded before.
At decoder-side
MVCBM (decoder):
Step 511: decoding MVD and other information start to rebuild current block.Other information are such as comprising such as residual error that comprises CBP, quantification etc.
The step 501 of step 513 and step 515 and encoder, 503 identical.
Step 517:, based on the MVD of decoding, utilize the guess strategy judgement can determine MVP; , if can't determine which is MVP, decode 1 and be index.
Step 519: utilize MVP and MVD to obtain the MV of current block.
Fig. 6 represents the flow chart of MVCATM.In with adaptive template coupling another one exemplary embodiment as the matching technique of motion vector encoder:
Coder side
MVCATM (encoder)
Step 601: be calculated to be the medium range forecast device (mv_SH.264) of proportional zoom, altogether location fallout predictor (mv_Scol) and the fallout predictor (mv_Snei) least identical with medium range forecast device in contiguous fallout predictor, but by with equation (1) similarly method will be total to location fallout predictor (mv_Scol) and the proportional convergent-divergent of vicinity fallout predictor.
Step 603:, based on similarity possible between template and object block and correlation, for current block limits, have the template of self adaptation shape and width;
Step 605: utilize the adaptive template match selection to have two fallout predictors (mv_tm1 and mv_tm2) of less template SAD.
Step 607:, based on the MVD standard of minimum, select final MVP for current block between mv_tm1 and mv_tm2, obtain MVD.
Step 609:, based on current MVD, utilize guess strategy to judge whether to detect correct MVP; , if can detect correct MVP, need to not encode subsequently and send position as index; Otherwise need to encode subsequently and send 1 position as index;
Step 611: coding MVD and other information also need code index in the situation that can not detect correct MVP.Other information such as the residual error that comprises CBP, quantification etc.
Decoder-side
MVCATM (decoder):
Step 621: decoding MVD and other information start to rebuild current block.Other information such as the residual error that comprises CBP, quantification etc.
Step 623, step 625 and step 627: with step 601,603 in coder side, 605 identical.
Step 629:, based on the MVD of decoding, utilize the guess strategy judgement can determine MVP; , if can't determine which is MVP, be 1 of index decoding.
Step 631: utilize MVP and MVD to obtain the MV of current block.
Fig. 7 represents the block diagram of an embodiment of video coding system.The present invention carries out motion vector encoder (MVC) after estimation (ME).Motion vector will offer macro block, if this macro block is inter prediction (inter-prediction is called for short Inter-Pred) type.If macro block is infra-frame prediction (Intra-Pred) type, a motion vector does not need yet.Also by quantizing (Q) quantification residual, provide the residual of quantification by conversion (T) conversion residual.Encode the residual of MVD and quantification and need encode together with the index of transmission by entropy, decoder will be delivered in the output that will be used for transmitting.Carry out de-quantization (Q-1) and inverse transformation (T-1) on the residual that quantizes.The residual of rebuilding joins in the result of the prediction piece that ME obtains to provide reference picture.
Fig. 8 represents the block diagram of an embodiment of video decoding system.When the macro block of decoding was inter prediction (Inter-Pred) type, MVD further decoded.Decode bit stream to obtain the residual error of decoding by entropy.By the residual of de-quantization (Q-1) de-quantization decoding and by inverse transformation (T-1) inverse transformation to provide signal.Carry out the decoding (DMVC) of motion vector encoder method in process of reconstruction., if the guess strategy in DMVC can't be determined motion vector predictor (MVP), may need the further extra index of decoding.The MV that DMVC produces is used for motion compensation (MC).The result of MC adds signal to provide the frame of reconstruction.
Fig. 9 has represented a kind of motion vector encoder device according to the embodiment of the present invention, comprises following part:
901, first select module, in order to select to form the fallout predictor of Candidate Set;
903, the first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set;
905, second select module, with described the first processing module, be connected, receive the remaining predicted device in described Candidate Set, based on standard selected optimum fallout predictor in described remaining predicted device of minimum movement phasor difference;
907, the second processing module, select module to be connected with described second, obtains current motion vector according to the fallout predictor of the optimum of selecting poor;
909, detecting module, with described the second processing module be connected processing module and be connected, poor based on the remaining fallout predictor and the current motion vector that obtain from the first processing module, utilize guess strategy to survey motion vector predictor;
911, judge module, be connected with described detecting module,, if the result of detection of detecting module is to detect correct motion vector predictor, judged result sent to coding module;
913, coding module, receive described judged result, and the current motion vector of encoding at least is poor or the current motion vector of encoding at least is poor and index.
Figure 10 has represented a kind of motion vector decoding apparatus of the embodiment of the present invention more, comprises following part:
1001, receiver module, receive the motion vector difference of at least having encoded;
1003, the first decoder module, connect described receiver module, and according to the motion vector difference of at least having encoded that receives, decoding motion vectors is poor;
1005, first select module, in order to select to form the fallout predictor of Candidate Set;
1007, the first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set;
Can 1009, judge module, connect described the first processing module and described the first decoder module,, based on the motion vector difference of remaining predicted device and decoding in described Candidate Set, utilize the guess strategy judgement determine motion vector predictor;
1011, the second decoder module, connect described judge module, according to described judged result decoding index;
1013, analysis module, connect described the first processing module and the second decoder module, according to the index of decoding, judges motion vector predictor;
1015, the second processing module, connect described judge module, described the first decoder module and described analysis module,, according to judged result, utilizes motion vector difference and definite motion vector predictor of having decoded of decoding to obtain motion vector; Perhaps utilize the motion vector difference of decoding and the motion vector predictor of having judged to obtain motion vector.
In general, the numerous embodiments of coding and decoding video and motion vector encoding and decoding can be implemented in multiple terminal equipment or subscriber equipment, terminal equipment or subscriber equipment include but not limited to mobile phone and other radio communication devices, personal digital assistant (PDA), portable and desktop computer, image/video device (as digital camera), audio-video (AV) equipment (as video player), game device, permission are accessed and the possible internet of browsing or movably unit or the device that local area network (LAN) (LAN) installs and these functions combine.
Embodiments of the invention can be implemented in the mode of software, hardware, applied logic or software, hardware and applied logic combination.Software, applied logic and/or hardware can retain on integrated circuit (IC) chip, module or memory.If necessary, part software, hardware and/or applied logic can retain on integrated circuit (IC) chip, part software, hardware and/or applied logic can retain on module, and a part of software, hardware and/or applied logic can retain on memory.In one example, applied logic, software or instruction set remain in any in various conventional computer computer-readable recording mediums.In context of the present invention, " computer-readable medium " can be any medium or device, and it comprises, storage, communication, propagation or move instruction uses for instruction execution system, device or equipment (as computer) or and instruction executive system, device or equipment use jointly.Computer-readable medium can comprise the computer-readable storage media, and it can be contain or store any medium of instruction or install for instruction execution system, device or equipment (as computer) use or and instruction executive system, device or equipment and jointly use.
If necessary, difference in functionality discussed herein can be with order and/or the execution simultaneously that differs from one another.In addition, if necessary, the one or more of above-mentioned functions can be maybe can making up of choosing wantonly.
Although the many aspects of the present invention of pointing out in independent claims, other aspects of the present invention comprise feature and the combination thereof in above-described embodiment and/or the dependent claims with feature of independent claims, and are not only the combination that clearly provides in claim.
Should also be noted that in above explanation one exemplary embodiment of the present invention, these explanations should not regarded the meaning of restriction as herein.Can also make multiple conversion and improvement and not deviate from the scope of the present invention that claim limits.

Claims (10)

1. a motion vector encoder method, is characterized in that, comprises the following steps:
Step 1: the Candidate Set that limits fallout predictor, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector, in the situation that use a plurality of reference frames, adjacent motion vector before being used as predicting described motion vector, according to its time gap by convergent-divergent pro rata;
Step 2: the figure place that the number that utilizes matching process to reduce the fallout predictor in described Candidate Set uses to reduce index;
Step 3: based on selected optimum fallout predictor in the remaining predicted device of standard in described Candidate Set of minimum movement phasor difference, and it is poor to obtain current motion vector, the poor minimum of the fallout predictor that this is optimum and current motion vector value;
step 4: poor based on remaining predicted device and current motion vector, utilize guess strategy to survey motion vector predictor further to save the figure place for code index, wherein guess strategy refers to that the number of described remaining predicted device is at least 1, to each remaining predicted device and intermediate parameters of the poor generation of current motion vector, N remaining predicted device produced N intermediate parameters, standard based on the minimum movement phasor difference reselects fallout predictor to be selected and obtains new minimum movement phasor difference for each intermediate parameters, if the fallout predictor to be selected that reselects is identical with the remaining predicted device that produces this intermediate parameters, judge that this remaining predicted device is optional fallout predictor, otherwise set this remaining predicted device and be not optional fallout predictor, if the number of optional fallout predictor is 1, this optional fallout predictor is correct motion vector predictor,
Step 5: judge whether to detect correct motion vector predictor, if detect correct motion vector predictor, encoding, current motion vector is poor at least,, if can't detect correct motion vector predictor, to current motion vector is poor at least, with index, encodes;
Wherein said matching process is the adaptive template matching process, described adaptive template matching process is, be identified for the shape of the adaptive template in current data space based on correlation possible between adaptive template and current data, if the correlation between the different subregions in current data space is very low, the template of this subregion may not comprise the pixel in another subregion; Perhaps based on the consistency in adaptive template, be identified for the size of the adaptive template in current data space, wherein said consistency refers to the difference of the interior pixels of described adaptive template.
2. a kind of motion vector encoder method according to claim 1, it is characterized in that, described adaptive template matching process also comprises and utilizing based on displacement corresponding to fallout predictor in Candidate Set, calculates poor between the template of the data space after displacement in the template in current data space and reference picture.
3. a kind of motion vector encoder method according to claim 1, is characterized in that, in the adaptive template matching process, the shape of described adaptive template is specified.
4. a kind of motion vector encoder method according to claim 1, is characterized in that, after described step 5,, if detect correct motion vector predictor, sends the current motion vector of at least having encoded poor; , if can't detect correct motion vector predictor, send the position as index that the current motion vector of at least having encoded is poor and encoded.
5. a kind of motion vector encoder method according to claim 1, is characterized in that, the Candidate Set of described fallout predictor comprises some proportional room and time fallout predictors.
6. a kind of motion vector encoder method according to claim 1, it is characterized in that, in described step 1, the motion vector adjacent with described motion vector be adjacent with the described motion vector time, space is adjacent, the time and space is adjacent or based on the adjacent motion vector of analysis strategy.
7. the method for the decoding motion vector of having encoded, described motion vector of having encoded is encoded by the method for claim 1, it is characterized in that, comprises the following steps:
Step 1: decoding motion vectors is poor;
Step 2: limit the Candidate Set of fallout predictor, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector;
Step 3: utilize matching process to reduce the number of the fallout predictor in described Candidate Set, obtain the remaining predicted device;
step 4: based on the remaining predicted device in described Candidate Set and the motion vector difference of decoding, utilize the guess strategy judgement can determine motion vector predictor, wherein guess strategy refers to that the number of described remaining predicted device is at least 1, motion vector difference to each remaining predicted device and decoding produces an intermediate parameters, N remaining predicted device produced N intermediate parameters, standard based on the minimum movement phasor difference reselects fallout predictor to be selected and obtains new minimum movement phasor difference for each intermediate parameters, if the fallout predictor to be selected that reselects is identical with the remaining predicted device that produces this intermediate parameters, judge that this remaining predicted device is optional fallout predictor, otherwise set this remaining predicted device and be not optional fallout predictor, if the number of optional fallout predictor is 1, this optional fallout predictor is correct motion vector predictor,
Step 5:, if can determine motion vector predictor, utilize motion vector difference and the fixed motion vector predictor of decoding at least to obtain motion vector; If can not determine motion vector predictor, the index and judge motion vector predictor of decoding, utilize the motion vector difference of decoding at least and the motion vector predictor of having judged to obtain motion vector;
Wherein said matching process is the adaptive template matching process, described adaptive template matching process is, be identified for the shape of the adaptive template in current data space based on correlation possible between adaptive template and current data, if the correlation between the different subregions in current data space is very low, the template of this subregion may not comprise the pixel in another subregion; Perhaps based on the consistency in adaptive template, be identified for the size of the adaptive template in current data space, wherein said consistency refers to the difference of the interior pixels of described adaptive template.
8. the method for a kind of decoding according to claim 7 motion vector of having encoded, is characterized in that, the matching process that described matching process adopts during with coding is identical.
9. motion vector encoder device is characterized in that comprising following part:
First selects module, in order to select to form the fallout predictor of Candidate Set, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector, in the situation that use a plurality of reference frames, adjacent motion vector before being used as predicting described motion vector, according to its time gap by convergent-divergent pro rata;
The first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set;
Second selects module, with described the first processing module, is connected, and receives the remaining predicted device in described Candidate Set, based on standard selected optimum fallout predictor in described remaining predicted device of minimum movement phasor difference;
The second processing module, select module to be connected with described second, obtains current motion vector according to the fallout predictor of selected optimum poor, the fallout predictor that this is optimum and current motion vector value differ from minimum;
Detecting module, with described the second processing module be connected processing module and be connected, poor based on remaining predicted device and current motion vector in the described Candidate Set that receives, utilize guess strategy to survey motion vector predictor; Wherein guess strategy refers to that the number of described remaining predicted device is at least 1, to each remaining predicted device and intermediate parameters of the poor generation of current motion vector, N remaining predicted device produced N intermediate parameters, standard based on the minimum movement phasor difference reselects fallout predictor to be selected and obtains new minimum movement phasor difference for each intermediate parameters, if the fallout predictor to be selected that reselects is identical with the remaining predicted device that produces this intermediate parameters, judge that this remaining predicted device is optional fallout predictor, otherwise set this remaining predicted device, be not optional fallout predictor; If the number of optional fallout predictor is 1, this optional fallout predictor is correct motion vector predictor;
Judge module, be connected with described detecting module, judges that the result of detection of detecting module, whether as detecting correct motion vector predictor, sends to coding module with judged result;
Coding module, receive described judged result, if judged result is to detect correct motion vector predictor, encoding, current motion vector is poor at least,, if judged result is to detect correct motion vector predictor, to current motion vector is poor at least, with index, encode;
Wherein said matching process is the adaptive template matching process, described adaptive template matching process is, be identified for the shape of the adaptive template in current data space based on correlation possible between adaptive template and current data, if the correlation between the different subregions in current data space is very low, the template of this subregion may not comprise the pixel in another subregion; Perhaps based on the consistency in adaptive template, be identified for the size of the adaptive template in current data space, wherein said consistency refers to the difference of the interior pixels of described adaptive template.
10. motion vector decoding apparatus is characterized in that comprising following part:
Receiver module, receive the motion vector difference of at least having encoded;
The first decoder module, connect described receiver module, and according to the motion vector difference of at least having encoded that receives, decoding motion vectors is poor;
First selects module, in order to select to form the fallout predictor of Candidate Set, wherein said fallout predictor is based on the motion vector adaptive variation adjacent with described motion vector, in the situation that use a plurality of reference frames, adjacent motion vector before being used as predicting described motion vector, according to its time gap by convergent-divergent pro rata;
The first processing module, receive the described first Candidate Set of selecting the fallout predictor of module, in order to utilize matching process, reduces the number of the fallout predictor in described Candidate Set, obtains the remaining predicted device;
Can judge module, connect described the first processing module and described the first decoder module,, based on the remaining predicted device in described Candidate Set and the motion vector difference of decoding, utilize the guess strategy judgement determine motion vector predictor; Wherein guess strategy refers to that the number of described remaining predicted device is at least 1, motion vector difference to each remaining predicted device and decoding produces an intermediate parameters, N remaining predicted device produced N intermediate parameters, standard based on the minimum movement phasor difference reselects fallout predictor to be selected and obtains new minimum movement phasor difference for each intermediate parameters, if the fallout predictor to be selected that reselects is identical with the remaining predicted device that produces this intermediate parameters, judge that this remaining predicted device is optional fallout predictor, otherwise set this remaining predicted device, be not optional fallout predictor; If the number of optional fallout predictor is 1, this optional fallout predictor is correct motion vector predictor;
The second decoder module, connect described judge module, if can not determine motion vector predictor, and the index of decoding;
Analysis module, connect described the first processing module and the second decoder module, according to the index of decoding, judges motion vector predictor;
The second processing module, connect described judge module, described the first decoder module and described analysis module,, if can determine motion vector predictor, utilizes motion vector difference and the fixed motion vector predictor of decoding to obtain motion vector; Otherwise utilize the motion vector difference of decoding and the motion vector predictor of having judged to obtain motion vector;
Wherein said matching process is the adaptive template matching process, described adaptive template matching process is, be identified for the shape of the adaptive template in current data space based on correlation possible between adaptive template and current data, if the correlation between the different subregions in current data space is very low, the template of this subregion may not comprise the pixel in another subregion; Perhaps based on the consistency in adaptive template, be identified for the size of the adaptive template in current data space, wherein said consistency refers to the difference of the interior pixels of described adaptive template.
CN2010101742829A 2009-12-16 2010-04-30 Method and device for coding and decoding motion vector Expired - Fee Related CN101860754B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US28706409P 2009-12-16 2009-12-16
US61/287,064 2009-12-16

Publications (2)

Publication Number Publication Date
CN101860754A CN101860754A (en) 2010-10-13
CN101860754B true CN101860754B (en) 2013-11-13

Family

ID=42946354

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010101742829A Expired - Fee Related CN101860754B (en) 2009-12-16 2010-04-30 Method and device for coding and decoding motion vector

Country Status (1)

Country Link
CN (1) CN101860754B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9445120B2 (en) 2011-04-12 2016-09-13 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US9456217B2 (en) 2011-05-24 2016-09-27 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US9456214B2 (en) 2011-08-03 2016-09-27 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9560373B2 (en) 2011-05-31 2017-01-31 Sun Patent Trust Image coding method and apparatus with candidate motion vectors

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071460B (en) * 2010-12-14 2020-03-06 M&K控股株式会社 Apparatus for encoding moving picture
GB2487200A (en) 2011-01-12 2012-07-18 Canon Kk Video encoding and decoding with improved error resilience
JP2012147331A (en) * 2011-01-13 2012-08-02 Sony Corp Image processing apparatus and method
CN102651814B (en) * 2011-02-25 2015-11-25 华为技术有限公司 Video encoding/decoding method, coding method and terminal
CN102685479A (en) * 2011-03-11 2012-09-19 华为技术有限公司 Video encoding and decoding processing method and device
SI3937497T1 (en) * 2011-03-21 2023-06-30 Lg Electronics, Inc. Motion vector predictor selection
CN102227132B (en) * 2011-05-25 2017-04-12 深圳市云宙多媒体技术有限公司 Motion vector prediction coding and decoding method, apparatus thereof and coding and decoding system
US9485518B2 (en) 2011-05-27 2016-11-01 Sun Patent Trust Decoding method and apparatus with candidate motion vectors
PL4007276T3 (en) 2011-05-27 2023-12-11 Sun Patent Trust Apparatus, method and program for coding moving pictures
PL3879834T3 (en) * 2011-05-31 2024-07-29 Jvckenwood Corporation Moving image encoding device, moving image encoding method and moving image encoding program, as well as moving image decoding device, moving image decoding method and moving image decoding program
WO2012164908A1 (en) 2011-05-31 2012-12-06 パナソニック株式会社 Video encoding method, video encoding device, video decoding method, video decoding device, and video encoding/decoding device
GB2491589B (en) 2011-06-06 2015-12-16 Canon Kk Method and device for encoding a sequence of images and method and device for decoding a sequence of image
CA3101406C (en) * 2011-06-14 2023-05-09 Tammy Lee Method and apparatus for encoding motion information and method and apparatus for decoding same
CN102843554A (en) * 2011-06-21 2012-12-26 乐金电子(中国)研究开发中心有限公司 Interframe image prediction encoding and decoding methods and video encoding and decoding device
US10063876B2 (en) 2011-06-24 2018-08-28 Hfi Innovation Inc. Method and apparatus for removing redundancy in motion vector predictors
CN104811725B (en) * 2011-06-27 2017-12-29 三星电子株式会社 The method decoded to movable information
CN107071403B (en) * 2011-06-30 2019-09-24 Jvc建伍株式会社 Picture coding device, image encoding method, picture decoding apparatus and picture decoding method
BR112013029425B1 (en) * 2011-06-30 2022-03-29 Sun Patent Trust Image decoding method, image encoding method, image decoding device, image encoding device, and image encoding/decoding device
CN102868889A (en) * 2011-07-06 2013-01-09 乐金电子(中国)研究开发中心有限公司 Interframe image video coding and decoding motion vector predicting method and video codec
GB2493755B (en) 2011-08-17 2016-10-19 Canon Kk Method and device for encoding a sequence of images and method and device for decoding a sequence of images
CN104837024B (en) * 2011-08-29 2016-04-27 苗太平洋控股有限公司 For the device of the movable information under merging patterns of decoding
CN107483925B (en) 2011-09-09 2020-06-19 株式会社Kt Method for decoding video signal
CN103024370B (en) * 2011-09-23 2018-03-23 中兴通讯股份有限公司 A kind of motion vector second-compressed decoding method and device
CN108881903B (en) 2011-10-19 2022-01-04 太阳专利托管公司 Image encoding method and device, image decoding method and device, and encoding and decoding device
KR20130050405A (en) 2011-11-07 2013-05-16 오수미 Method for determining temporal candidate in inter prediction mode
MX362024B (en) 2011-11-08 2019-01-04 Kt Corp Method and apparatus for coefficient scan based on partition mode of prediction unit.
CN105791855A (en) * 2012-01-18 2016-07-20 Jvc建伍株式会社 Moving picture decoding device and moving picture decoding method
WO2014007521A1 (en) * 2012-07-02 2014-01-09 삼성전자 주식회사 Method and apparatus for predicting motion vector for coding video or decoding video
CN104244002B (en) * 2013-06-14 2019-02-05 北京三星通信技术研究有限公司 The acquisition methods and device of motion information in a kind of video coding/decoding
US10986360B2 (en) * 2017-10-16 2021-04-20 Qualcomm Incorproated Various improvements to FRUC template matching
US20240357083A1 (en) * 2021-08-19 2024-10-24 Mediatek Singapore Pte. Ltd. Method and Apparatus for Low-Latency Template Matching in Video Coding System

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5596370A (en) * 1995-01-16 1997-01-21 Daewoo Electronics Co., Ltd. Boundary matching motion estimation apparatus
CN1358026A (en) * 2000-12-06 2002-07-10 Lg电子株式会社 Two-dimensional minimal bit rate pre-estimating technology for encoding mobile vector
CN1885948A (en) * 2005-06-21 2006-12-27 中国科学院计算技术研究所 Motion vector space prediction method for video coding
CN101198064A (en) * 2007-12-10 2008-06-11 武汉大学 Movement vector prediction method in resolution demixing technology

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5596370A (en) * 1995-01-16 1997-01-21 Daewoo Electronics Co., Ltd. Boundary matching motion estimation apparatus
CN1358026A (en) * 2000-12-06 2002-07-10 Lg电子株式会社 Two-dimensional minimal bit rate pre-estimating technology for encoding mobile vector
CN1885948A (en) * 2005-06-21 2006-12-27 中国科学院计算技术研究所 Motion vector space prediction method for video coding
CN101198064A (en) * 2007-12-10 2008-06-11 武汉大学 Movement vector prediction method in resolution demixing technology

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Jingjing Dai,et al.Motion Vector Coding based on Predictor Selection and Boundary-matching Estimation.《MMSP"09》.2009,全文. *
Jungyoup Yang,et al.Motion vector coding with selection of an optimal predictive motion vector.《Optical Engineering OE letters》.2009,第48卷(第1期),文献第2部分. *
Yan Chen,et al.Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation.《IEEE TRANSACTIONS ON MULTIMEDIA》.2008,第10卷(第1期),文献第2页右栏第2段、第II部分. *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9445120B2 (en) 2011-04-12 2016-09-13 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US9456217B2 (en) 2011-05-24 2016-09-27 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US9560373B2 (en) 2011-05-31 2017-01-31 Sun Patent Trust Image coding method and apparatus with candidate motion vectors
US9456214B2 (en) 2011-08-03 2016-09-27 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus

Also Published As

Publication number Publication date
CN101860754A (en) 2010-10-13

Similar Documents

Publication Publication Date Title
CN101860754B (en) Method and device for coding and decoding motion vector
CN103891290B (en) Motion vector processing
CN100468982C (en) Method and apparatus for performing high quality fast predictive motion search
CN105072449B (en) The device decoded to image
CN101933329B (en) Methods and apparatus for implicit block segmentation in video encoding and decoding
AU2010265451B2 (en) Method, apparatus and device for obtaining video image motion information and template construction method
CN104769947B (en) A kind of more hypothesis motion compensation encoding methods based on P frame
CN102316317B (en) Method and device for generating predicted value of picture
CN104412597B (en) The method and device that unified difference vector for 3D Video codings is derived
CN101873500B (en) Interframe prediction encoding method, interframe prediction decoding method and equipment
CN104488271B (en) A kind of more hypothesis motion compensation process based on P frame
CN109218733B (en) Method for determining prediction motion vector prediction and related equipment
CN109792520A (en) For the method and apparatus using omnidirectional's video coding of most probable mode in adaptive frame
CN101986716B (en) Quick depth video coding method
US9438928B2 (en) Mechanism for video encoding based on estimates of statistically-popular motion vectors in frame
TW202021356A (en) Efficient affine merge motion vector derivation
CN101827269B (en) Video coding method and device
WO2020140915A1 (en) Video processing method and apparatus
CN104363451A (en) Image forecasting method and related device
CN106803960A (en) Picture decoding method
CN104980761A (en) Method and device for coding and decoding motion vector
CN101394566A (en) Cross rhombic motion estimation searching method
CN108076347A (en) A kind of acquisition methods and device for encoding starting point
CN104093034A (en) H.264 video streaming self-adaptive error concealing method of similarity face constraining region
CN110062243B (en) Light field video motion estimation method based on neighbor optimization

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20131113

CF01 Termination of patent right due to non-payment of annual fee