CN1037311C - Video correction apparatus for camcorder - Google Patents
Video correction apparatus for camcorder Download PDFInfo
- Publication number
- CN1037311C CN1037311C CN94102226A CN94102226A CN1037311C CN 1037311 C CN1037311 C CN 1037311C CN 94102226 A CN94102226 A CN 94102226A CN 94102226 A CN94102226 A CN 94102226A CN 1037311 C CN1037311 C CN 1037311C
- Authority
- CN
- China
- Prior art keywords
- mentioned
- representative point
- data
- marginal date
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000001514 detection method Methods 0.000 claims abstract description 46
- 238000003860 storage Methods 0.000 claims description 9
- 230000000007 visual effect Effects 0.000 claims description 6
- 230000008676 import Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 12
- 206010044565 Tremor Diseases 0.000 description 3
- 240000001439 Opuntia Species 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/223—Analysis of motion using block-matching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6811—Motion detection based on the image signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/144—Movement detection
- H04N5/145—Movement estimation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Color Television Systems (AREA)
Abstract
A video correction apparatus for a camcorder comprising a filter for removing a noise component from digital input video data, a mask processor for calculating a difference between a pixel value of the resultant video data from the filter and each of adjacent vertical and horizontal pixel values, taking absolute values of the calculated differences and adding the taken absolute values, to detect edge data for selection of an accurate characteristic point of the video data from the filter, a representative point determination circuit for selecting a maximum value in each motion vector detection region every field in response to the edge data from the mask processor and determining positions of the selected maximum values as representative point data, and a correlation calculator for inputting the edge data from the mask processor and the representative point data from the representative point determination circuit and calculating a correlation of the inputted data in a search region of a desired range.
Description
The present invention relates generally to video camera, relate more specifically to a kind of video correction apparatus that video camera is used, wherein, select representative point and be used for the correlation that calculating kinematical vector detects, this calculating is to proofread and correct owing to the moving video that causes of end user's hand tremor shakes necessary.
Fig. 1 is the diagram of representative point in the motion vector detection district of illustration routine and each motion vector detection district.As shown in the drawing, an input video is divided into four equal motion vector detection districts that motion vector detection is used.Each motion vector detection district that equates has 30 representative points that arrange in equally distributed fixed position.
Fig. 2 is the block diagram of the motion vector detection of routine.As shown in the drawing, conventional motion vector detection comprises a filter 1, is used for removing denoising and high fdrequency component from digital input video frequency signal.The output signal of coming out from filter 1 is applied on representative point memory 2 and the correlation calculator 3.
30 pixel values of representative point memory 2 storages, they are arranged in the equally distributed fixed position in each district in four motion vector detection districts.Just, being stored in as representative point in the representative point memory 2 is 120 pixel values of the input picture of a visual field.These 120 representative points from representative point memory 2 are applied on the correlation calculator 3.Correlation calculator 3 is calculated from 120 representative points of representative point memory 2 correlation to the surrounding pixel value.Maximum correlation detector 4 is applicable to detection by the maximum in the correlation of correlation calculator 3 calculating.
But conventional motion vector detection has a shortcoming, is exactly that it can not utilize the video data information that can make image more accurate fully, because it selects the representative point data in the fixed position.And the number that accurately obtains the required representative point of motion vector is very big.This causes the complexity of calculating and constructing.
Therefore, the present invention considers the problems referred to above, its purpose provides the video correction apparatus that a kind of video camera is used, wherein, select the correlation that accurate representative point is used for calculating accurate motion vector detection, this calculating is to proofread and correct owing to the moving video that causes of end user's hand tremor shakes necessary.
Another object of the present invention provides the video correction apparatus that a kind of video camera is used, it has reduced the number of the representative point of the correlation that is used for calculating accurate motion vector detection, this calculating is that correction is necessary owing to the moving video that causes of end user's hand tremor shakes, and calculates and hardware thereby can simplify.
According to the present invention, above-mentioned and other purpose can be finished by the video correction apparatus that provides a kind of video camera to use, and this equipment comprises: filter is used for removing noise component(s) from digital inputting video data; Shelter processing unit, be used to calculate difference between a pixel value of the next generation video data of above-mentioned the filter vertical and horizontal pixel value adjacent with each, take out the absolute value of calculated difference and the absolute value that addition is taken out, select the marginal date that the accurate feature points of video data is used to detect from above-mentioned filter; The representative point determinator is used for according to sheltering the marginal date that processing unit obtains and select the maximum in each motion vector detection district of each visual field from above-mentioned, and measures the selected peaked position as the representative point data; And the correlation calculations device, be used to import from above-mentioned and shelter the marginal date of processing unit and the representative point data of coming, and calculate the input correlation of data in a field of search of want scope from above-mentioned representative point determinator.
From the following detailed description with accompanying drawings, can more be expressly understood above and other objects of the present invention, feature and advantage, in the accompanying drawing:
Fig. 1 is the diagram of representative point in conventional motion vector detection district and each motion vector detection district;
Fig. 2 is the block diagram of the motion vector detection of routine;
Fig. 3 is the block diagram according to motion vector detection of the present invention;
Fig. 4 is the detailed diagram that the representative point of motion vector detection among Fig. 3 is measured circuit;
Fig. 5 A is the diagram of illustration according to motion vector detection of the present invention district;
Fig. 5 B is the diagram of the representative point data in each motion vector detection district among illustration Fig. 5 A.
With reference to figure 3, illustrate a block diagram according to motion vector detection of the present invention.As shown in the drawing, motion vector detection comprise a filter 1 ' and one shelter processor 5, filter 1 ' be used for removing noise component(s) from digital inputting video data, sheltering processor 5 is used to calculate from the difference between a pixel value of the generation video data of filter 1 ' the come vertical and horizontal pixel value adjacent with each, take out the absolute value of calculated difference and the absolute value that addition is taken out, to detect the marginal date of using from the accurate feature points of filter 1 ' select video data.
Be provided with a representative point in the motion vector detection and measure circuit 6, in order to according to selecting maximum each motion vector detection district of each visual field, and measure selected peaked position as the representative point data from sheltering marginal date that processor 5 obtains.
Also be provided with a correlation calculator 7 in the motion vector detection, measure the representative point data of circuit 6 in order to input from the marginal date of sheltering processor 5 with from representative point, and calculate the input correlation of data in a field of search of institute's claimed range.
Consult Fig. 4, illustrate the detailed diagram that a representative point is measured circuit 6.As shown in the drawing, representative point is measured circuit 6 and is comprised a marginal date memory cell 6a, a maximum value detector 6b, a line address counter 6c, a column address counter 6d and a representative point address storaging unit 6e, marginal date memory cell 6a is used to store from sheltering the marginal date of processor 5, maximum value detector 6b is used for finishing the compare operation of the marginal date that marginal date memory cell 6a stores, to detect the maximum in each motion vector detection district, line address counter 6c is used for row address count, column address counter 6d is used for column address counter, the column address that representative point address storaging unit 6e is used to store the row address from row address memory 6c and comes from column address counter 6d.
Representative point address storaging unit 6e comprises representative point row address memory 6e1 and representative point column address memory 6e2 that storage is used from the next column address of column address counter 6d that a storage is used from the next row address of line address counter 6c.
And, representative point is measured circuit 6 and is correspondingly comprised a controller 6f and a representative point memory 6g, controller 6f is used to finish system's control operation, being chosen in the representative point data of address stored among the representative point address storaging unit 6e, representative point memory 6g is used for storing the maximum of coming from the maximum value detector 6b representative point data as the motion vector detection district respectively according to the selection signal that slave controller 6f comes.
Marginal date memory cell 6a comprises first and second register 6a1 and the 6a2, is used to store from sheltering the marginal date of processor 5.
Describe the operation of motion vector detection below in detail with said structure of the present invention.
At first, digital inputting video data then is applied to and shelters on the processor 5 by filter 1 ' remove denoising.
Shelter processor 5 and finish the masked operation of a regulation, in order to from filter 1 ' the select accurate feature points of video data.Just, in order to detect from the marginal date of the video data of filter 1 ' come, sheltering processor 5 calculates from the difference between the pixel value of the video data of filter 1 ' the come vertical and horizontal pixel value adjacent with each, take out the absolute value of calculated difference and the absolute value that addition is taken out, shown in following equation:
G(i，j)＝|P(i，j)-P(i，j-1)|+|P(i，j)-P(i-1，j)|
+|P(i，j)-P(i+1，j)|+|P(i，j)-P(i，j+1)|
In the formula, (i j) is the grey level of each pixel to P, and (i is that (i is j) with respect to the variation (marginal date) of neighborhood pixels for P j) to G.
The marginal date of Ce Dinging is applied on correlation calculator 7 and the representative point mensuration circuit 6 in the above described manner.
Now, describe the operation that representative point is measured circuit 6 in detail with reference to Fig. 4, Fig. 5 A and Fig. 5 B.Fig. 5 A is the diagram of illustration according to motion vector detection of the present invention district, and Fig. 5 B is the diagram of the representative point data in each motion vector detection district among illustration Fig. 5 A.
At first, temporarily be stored in the first register 6a1, compare by the initial value of storing among comparator 6b1 and the second register 6a2 then from the marginal date of sheltering processor 5.Multiplexer 6b2 is according to selecting the value lieutenant colonel that is stored in the first and second register 6a1 and the 6a2 big according to the output signal of coming from comparator 6b1 and selected data being fed back among the second register 6a2.The compare operation of the value among the first and second register 6a1 and the 6a2 repeats with respect to 16 motion vector detection districts shown in Fig. 5 A.Because above-mentioned repetitive operation, according to the selection signal that slave controller 6f comes, the maximum of coming from maximum value detector 6b correspondingly is stored in the representative point memory 6g, as the representative point data in motion vector detection district.And calculate by the row and column address counter position of representative point data, then is stored among the representative point address storaging unit 6e.
Then, the representative point data in the field of search of the scope of wanting shown in the correlation calculator 7 calculating chart 5B are with respect to the correlation in the motion vector detection district shown in Fig. 5 A.
As Fig. 5 A finding, input video is divided into the motion vector detection district of 4 * 4 fixed sizes with the interval of hope, proposes representative point from each detection zone.
In Fig. 5 B,, be shown in the value (representative point in a certain motion vector detection district) that a certain position b obtains having maximum grey level in the occasion that does not have video motion.Occasion there being the video vibrations is shown in the value (the new representative point in this same motion vector detection district) that a certain position C obtains having maximum grey level.Herein, Ref. No. d and e represent the original and new field of search respectively.
On the other hand, when having certain motion in the motion vector detection district simultaneously, moving in the motion vector detection district in peaked position, thereby causes new representative point to be selected.Just, in the motion vector detection district of each visual field, select maximum, and its position is confirmed as the representative point of motion vector detection.
Can clearly be seen that from above-mentioned explanation, according to the present invention, reduced the number of the representative point of the correlation that is used to calculate accurate motion vector, and this calculating is that the correcting video vibrations are necessary.This has simplifies the effect of calculating and constructing.Accurate Calculation to the correlation of each visual field is selected peaked representative point.Therefore, motion vector detection can be finished more accurately.And except video camera, the present invention can be applied to any other processing system for video.
Though most preferred embodiment of the present invention is for purposes of illustration and disclosed, the professional and technical personnel will be understood that, can carry out various modifications, increase and replacement and do not depart from disclosed scope and spirit of the present invention in the appending claims.
Claims (4)
1. video correction apparatus that video camera is used comprises:
Filter is used for removing noise component(s) from digital inputting video data;
It is characterized in that it also comprises:
Shelter processing unit, be used to calculate difference between a pixel value of the next generation video data of above-mentioned the filter vertical and horizontal pixel value adjacent with each, take out the absolute value of calculated difference and the absolute value that addition is taken out, select the marginal date that the accurate feature points of video data is used to detect from above-mentioned filter;
The representative point determinator is used for according to sheltering the marginal date that processing unit obtains and select the maximum in each motion vector detection district of each visual field from above-mentioned, and measures the selected peaked position as the representative point data; And
The correlation calculations device is used to import from above-mentioned marginal date of sheltering processing unit with from the representative point data of above-mentioned generation point determinator, and calculates the input correlation of data in a field of search of want scope.
2. the video correction apparatus that video camera as claimed in claim 1 is used is characterized in that, above-mentioned representative point determinator comprises:
The marginal date storage device is used to store the marginal date of sheltering processing unit from above-mentioned;
The maximum checkout gear is used for finishing the compare operation of the marginal date that above-mentioned marginal date storage device stores, to detect the maximum in each motion vector detection district;
A line address counter is used for row address count;
A column address counter is used for column address counter;
The representative point address storage devices is used to store from above line and the next row and column address of column address counter;
Control device is used to finish system's control operation, to be chosen in the representative point data of address stored in the above-mentioned representative point address storage devices; And
A representative point memory is used for according to the representative point data of one that comes from the above-mentioned control device maximum of selecting signal to store respectively to come from above-mentioned maximum checkout gear as the motion vector detection district.
3. the video correction apparatus that video camera as claimed in claim 2 is used is characterized in that, above-mentioned marginal date storage device comprises:
First and second registers are used to store the marginal date of sheltering processing unit from above-mentioned.
4. the video correction apparatus that video camera as claimed in claim 3 is used is characterized in that, above-mentioned maximum checkout gear comprises:
A comparator is used for the marginal date of relatively storing at first and second registers of above-mentioned marginal date storage device mutually; And
A multiplexer is used for according to the higher value of selecting the marginal date of storing at above-mentioned first and second registers from the next output signal of above-mentioned comparator, and selected data is fed back in above-mentioned second register.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1019930003118A KR970011540B1 (en) | 1993-03-03 | 1993-03-03 | Image correction system for a camcorder |
| KR3118/93 | 1993-03-03 | ||
| KR3118/1993 | 1993-03-03 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1100248A CN1100248A (en) | 1995-03-15 |
| CN1037311C true CN1037311C (en) | 1998-02-04 |
Family
ID=19351555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN94102226A Expired - Fee Related CN1037311C (en) | 1993-03-03 | 1994-03-03 | Video correction apparatus for camcorder |
Country Status (4)
| Country | Link |
|---|---|
| JP (1) | JPH0795469A (en) |
| KR (1) | KR970011540B1 (en) |
| CN (1) | CN1037311C (en) |
| DE (1) | DE4406837A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3534551B2 (en) * | 1996-09-20 | 2004-06-07 | シャープ株式会社 | Motion detection device |
| JP4806584B2 (en) * | 2006-04-27 | 2011-11-02 | 富士通セミコンダクター株式会社 | Image processing method and image processing circuit |
| JP4804238B2 (en) * | 2006-06-20 | 2011-11-02 | 三菱電機株式会社 | Motion vector detection device |
| DE112007003664T5 (en) * | 2007-09-19 | 2010-07-22 | Thermo King Corporation, Minneapolis | Wall construction for an insulated enclosure |
| JP2010016447A (en) * | 2008-07-01 | 2010-01-21 | Mitsubishi Electric Corp | Image processing apparatus and method |
| JP6011569B2 (en) * | 2014-03-13 | 2016-10-19 | カシオ計算機株式会社 | Imaging apparatus, subject tracking method, and program |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5062056A (en) * | 1989-10-18 | 1991-10-29 | Hughes Aircraft Company | Apparatus and method for tracking a target |
| US5148281A (en) * | 1990-03-24 | 1992-09-15 | Sony Corporation | Iris stabilizer for automatic video camera |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0293644B1 (en) * | 1987-06-02 | 1992-03-25 | Siemens Aktiengesellschaft | Method for determining movement vector fields from digital image sequences |
| DE68909271T2 (en) * | 1988-02-23 | 1994-03-24 | Philips Nv | Method and arrangement for estimating the extent of movement in a picture element of a television picture. |
-
1993
- 1993-03-03 KR KR1019930003118A patent/KR970011540B1/en not_active IP Right Cessation
-
1994
- 1994-03-02 DE DE4406837A patent/DE4406837A1/en not_active Withdrawn
- 1994-03-02 JP JP6032437A patent/JPH0795469A/en not_active Withdrawn
- 1994-03-03 CN CN94102226A patent/CN1037311C/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5062056A (en) * | 1989-10-18 | 1991-10-29 | Hughes Aircraft Company | Apparatus and method for tracking a target |
| US5148281A (en) * | 1990-03-24 | 1992-09-15 | Sony Corporation | Iris stabilizer for automatic video camera |
Also Published As
| Publication number | Publication date |
|---|---|
| DE4406837A1 (en) | 1994-09-08 |
| KR970011540B1 (en) | 1997-07-11 |
| CN1100248A (en) | 1995-03-15 |
| JPH0795469A (en) | 1995-04-07 |
| KR940023177A (en) | 1994-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100268311B1 (en) | System and method for electronic image stabilization | |
| US5210559A (en) | Camera shake correcting device | |
| US6226388B1 (en) | Method and apparatus for object tracking for automatic controls in video devices | |
| US7474802B2 (en) | Method and apparatus for automatically estimating the layout of a sequentially ordered series of frames to be used to form a panorama | |
| US20060203098A1 (en) | Method and apparatus for producing frame accurate position data in a PTZ dome camera with open loop control | |
| Morimoto et al. | Fast 3D stabilization and mosaic construction | |
| US8098963B2 (en) | Resolution conversion apparatus, method and program | |
| MXPA04002210A (en) | Image stabilization using color matching. | |
| WO1994018788A1 (en) | Imaging apparatus and method for determining range from focus and focus information | |
| EP0589643A1 (en) | Digital image stabilization using binary edge data | |
| US5329368A (en) | Image tracking system and technique | |
| CN1037311C (en) | Video correction apparatus for camcorder | |
| EP0493872A2 (en) | Method and apparatus for image rotation | |
| JP2005526318A (en) | Method and apparatus for determining optical flow | |
| JPH0591492A (en) | Moving vector detector | |
| JPH09116809A (en) | Picture steadiness correcting method in television film scanning of prescribed sequence changing method for performing picture object and device for performing the correcting method | |
| EP0172433A2 (en) | Display method and apparatus employing cursor panning | |
| US6002431A (en) | Video correction apparatus for camcorder | |
| EP0488721B1 (en) | Movement detection | |
| JPH04213973A (en) | Image shake corrector | |
| CN102117128B (en) | High resolution image sensing device and image sensing method thereof | |
| EP0673575B1 (en) | Higher definition video signals from lower definition sources | |
| EP0454483B1 (en) | Movement vector detection device | |
| US20090051775A1 (en) | Signal processing device | |
| US5173770A (en) | Movement vector detection device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 19980204 Termination date: 20110303 |