CN102298769A - Colored fusion method of night vision low-light image and infrared image based on color transmission - Google Patents
Colored fusion method of night vision low-light image and infrared image based on color transmission Download PDFInfo
- Publication number
- CN102298769A CN102298769A CN2011101559584A CN201110155958A CN102298769A CN 102298769 A CN102298769 A CN 102298769A CN 2011101559584 A CN2011101559584 A CN 2011101559584A CN 201110155958 A CN201110155958 A CN 201110155958A CN 102298769 A CN102298769 A CN 102298769A
- Authority
- CN
- China
- Prior art keywords
- image
- component
- color
- average
- night vision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Editing Of Facsimile Originals (AREA)
- Image Processing (AREA)
Abstract
The present invention discloses the Color Fusion of a kind of the night vision low light image based on color transmitting and infrared image. The present invention will be seen that light and infrared image carry out linear fusion first, obtain grayscale fusion image
,
,
Component. Using the brightness and distribution of color of reference picture to grayscale fusion image
,
,
It is adjusted, image data adjusted is gained into rgb space by yuv space contravariant and obtains final color fusion image, the blending image obtained using the method for the present invention is similar with color reference image Luminance Distribution, has good visual effect.
Description
Technical field
The invention belongs to image processing field, what relate to is a kind of visible images and infrared image fusion method based on color and brightness transmission.
Background technology
Infrared and visible light allos image co-registration can improve the target detection ability, can't detection feature when disclosing target and in single image, observing, important use value is arranged in fields such as security protection, driver assistances.Especially nighttime driving backup system, light image ground effectively processing can be expanded driver's visual range greatly, improve security.Improve the colouring information of image, fused images is shown as the natural color that is fit to eye-observation, can obviously improve the recognition performance of human eye, reduce operator's sense of fatigue.
Patent based on color notation conversion space has: unify method of adjustment (CN200810162135.2) based on the multi-level image of color transmission and disclose a kind of masstone coloured image based on the color transmission and unify method of adjustment, the image clarification method in foggy day (CN200810018174.5) that transmits based on self-adaption cluster color discloses a kind of image clarification method in foggy day that transmits based on self-adaption cluster color, but above-mentioned two kinds of methods only are applicable to single visible images.A kind ofly a kind of non-sampling Contourlet transfer pair gray scale visible images is proposed and infrared image decomposes based on the infrared of colour transmission and entropy information and color visible image fusion method (CN200810017443.6), employing is delivered in the fused images based on the colored transmission method of the l α β color space chromatic information with visible images, obtains the color integration image.Therefore this method need be utilized the color of visible light, is not suitable for the night vision low light level image under car bulb and the color integration of infrared image.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, provide a kind of based on the night vision low light level image of color transmission and the Color Fusion of infrared image.
The step of the inventive method is as follows:
Step 1. is with reference picture
TBe transformed into
YUVThe space.
YUVThe space is another kind of color representation,
YBe brightness,
U,
VBe the colourity of image, respectively expression blue and red with
YDifference
R-Y,
B-Y, also claim colour difference signal.Utilize
YUVThe space and
RGBBetween transformational relation obtain reference picture
T YUVThe space:
Step 2. night vision low light level image and infrared image fusion obtain fused images
P
At first night vision low light level image is carried out monochromatization, obtain the gray-scale value of monochromatic visible light image
In the formula
,
,
It is night vision low light level image
R,
G,
BThe gray-scale value of component.Again with the gray-scale value of monochromatic visible light image
Gray-scale value with infrared image
Merge and obtain fused images
PPuppet
Y,
U,
VComponent, method is:
Step 3. is according to reference picture
T Y,
U,
VThe average of component and variance are adjusted fused images
PPseudo-
Y,
U,
VThe average and the variance of component (3) are delivered to fused images with the reference brightness distribution
PIn, obtain the color integration image
CSpecifically may further comprise the steps:
3-1. with fused images
P Y,
U,
VComponent deducts its average respectively, eliminates the influence of background to transmission effect.
3-2. the image pixel value after handling is carried out convergent-divergent according to its ratio with the standard variance of reference picture, and adds the average of reference picture, that is:
Wherein
,
,
The expression fused images
PEach pixel
,
,
Component.
,
The expression reference picture
The Y of T,
U,
VThe standard deviation of component and average.
,
The expression fused images
P Y,
U,
VThe standard deviation of component and average.
Be the proportional zoom coefficient, be used to regulate the brightness of fused image, span is usually
,
,
Expression color integration image
CEach pixel
,
,
Component.
Step 4. is passed through
YUVInverse transformation obtains the color integration image
C R,
G,
BValue, inverse transformation method:
The invention has the beneficial effects as follows:
1. utilize and ask the image puppet
Y,
U,
VThe method of component, with the chromatic information amount seldom night-viewing twilight image and the infrared image of black and white merge, set up the color contact between weak coloured image, black white image and the normal coloured image, provide necessary condition for weak coloured image, black white image carry out the colour enhancing.
2. according to reference picture
Y,
U,
VEach component has carried out the color enhancement process to fused image, makes fused image have color component with the reference picture same distribution.
Description of drawings
Fig. 1 is the inventive method process flow diagram.
Embodiment
The invention will be further described below in conjunction with accompanying drawing.
As shown in Figure 1, the inventive method may further comprise the steps:
Step (1) is with reference picture
TBy
RGBSpace conversion is
YUVThe space obtains reference picture
T Y,
U,
VThe space:
Step (2) obtains fused images with the fusion of night vision low light level image and infrared image
PPseudo-
Y,
U,
VComponent, concrete grammar is: earlier night vision low light level image is carried out monochromatization, obtain the gray-scale value of monochromatic visible light image
, the gray-scale value of monochromatic visible light image again
Gray-scale value with infrared image
Merge and obtain fused images
PPuppet
Y,
U,
VComponent, method is:
In the formula
,
,
It is night vision low light level image
R,
G,
BThe gray-scale value of component;
Step (3). regulate the color component of fused image according to reference picture, concrete grammar is: earlier with fused images
PPuppet
Y,
U,
VComponent deducts its average respectively, eliminates the influence of background to transmission effect; Again the image pixel value after handling is carried out convergent-divergent according to its ratio with the standard variance of reference picture, and add the average of reference picture, that is:
Wherein
,
,
The expression fused images
PEach pixel
,
,
Component.
,
The expression reference picture
The Y of T,
U,
VThe standard deviation of component and average.
,
The expression fused images
P Y,
U,
VThe standard deviation of component and average.
Be the proportional zoom coefficient, be used to regulate the brightness of fused image, span is usually
,
,
Expression color integration image
CEach pixel
,
,
Component.
Step (4). by
YUVInverse transformation obtains the color integration image
C R,
G,
BValue.Inverse transformation method:
Claims (1)
1. based on the night vision low light level image of color transmission and the Color Fusion of infrared image, it is characterized in that the concrete steps of this method are:
Step 1. is with reference picture
TBe transformed into
YUVThe space, detailed process is:
Step 2. night vision low light level image and infrared image fusion obtain fused images
P
At first night vision low light level image is carried out monochromatization, obtain the gray-scale value of monochromatic visible light image
In the formula
,
,
It is night vision low light level image
R,
G,
BThe gray-scale value of component; Again with the gray-scale value of monochromatic visible light image
Gray-scale value with infrared image
Merge and obtain fused images
PPuppet
Y,
U,
VComponent, detailed process is:
Step 3. is according to reference picture
T Y,
U,
VThe average of component and variance are adjusted fused images
PPseudo-
Y,
U,
VThe average of component and variance are delivered to fused images with the reference brightness distribution
PIn, obtain the color integration image
CSpecifically may further comprise the steps:
3-1. with fused images
P Y,
U,
VComponent deducts its average respectively, eliminates the influence of background to transmission effect;
3-2. the image pixel value after handling is carried out convergent-divergent according to its ratio with the standard variance of reference picture, and adds the average of reference picture, that is:
Wherein
,
,
Represent fused images respectively
PEach pixel
,
,
Component;
,
Represent reference picture respectively
The Y of T,
U,
VThe standard deviation of component and average;
,
Represent fused images respectively
P Y,
U,
VThe standard deviation of component and average,
Be the proportional zoom coefficient, be used to regulate the brightness of fused image;
,
,
Expression color integration image
CEach pixel
,
,
Component;
Step 4. is passed through
YUVInverse transformation obtains the color integration image
C R,
G,
BValue, the inverse transformation detailed process is:
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2011101559584A CN102298769A (en) | 2011-06-11 | 2011-06-11 | Colored fusion method of night vision low-light image and infrared image based on color transmission |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2011101559584A CN102298769A (en) | 2011-06-11 | 2011-06-11 | Colored fusion method of night vision low-light image and infrared image based on color transmission |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102298769A true CN102298769A (en) | 2011-12-28 |
Family
ID=45359167
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2011101559584A Pending CN102298769A (en) | 2011-06-11 | 2011-06-11 | Colored fusion method of night vision low-light image and infrared image based on color transmission |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102298769A (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102547063A (en) * | 2012-02-08 | 2012-07-04 | 南京航空航天大学 | Natural sense color fusion method based on color contrast enhancement |
CN104601953A (en) * | 2015-01-08 | 2015-05-06 | 中国航空无线电电子研究所 | Video image fusion-processing system |
CN104796577A (en) * | 2015-03-20 | 2015-07-22 | 南京理工大学 | Colored night vision imaging device and method based on EMCCD and single-color CCD |
CN105046869A (en) * | 2015-07-06 | 2015-11-11 | 北京理工大学 | Forest fire prevention monitoring system based on double-wave-band fusion theory |
CN105701765A (en) * | 2015-09-23 | 2016-06-22 | 河南科技学院 | Image-processing method and mobile terminal |
CN105917641A (en) * | 2013-08-01 | 2016-08-31 | 核心光电有限公司 | Thin multi-aperture imaging system with auto-focus and methods for using same |
CN104156992B (en) * | 2014-07-18 | 2017-02-15 | 北京理工大学 | Visible light black and white video image natural colorization method based on color transferring |
CN106570850A (en) * | 2016-10-12 | 2017-04-19 | 成都西纬科技有限公司 | Image fusion method |
CN106815826A (en) * | 2016-12-27 | 2017-06-09 | 上海交通大学 | Night vision image Color Fusion based on scene Recognition |
CN107005639A (en) * | 2014-12-10 | 2017-08-01 | 索尼公司 | Image pick up equipment, image pickup method, program and image processing equipment |
CN107169950A (en) * | 2017-06-02 | 2017-09-15 | 江苏北方湖光光电有限公司 | A kind of high-definition picture fusion treatment circuit |
CN104143183B (en) * | 2014-08-07 | 2017-12-12 | 北京理工大学 | The gray scale fusion method of visible ray and infrared black and white video image is transmitted based on brightness |
CN108040243A (en) * | 2017-12-04 | 2018-05-15 | 南京航空航天大学 | Multispectral 3-D visual endoscope device and image interfusion method |
CN110211083A (en) * | 2019-06-10 | 2019-09-06 | 北京宏大天成防务装备科技有限公司 | A kind of image processing method and device |
CN110651301A (en) * | 2017-05-24 | 2020-01-03 | 黑拉有限责任两合公司 | Method and system for automatically coloring night vision images |
CN111402306A (en) * | 2020-03-13 | 2020-07-10 | 中国人民解放军32801部队 | Low-light-level/infrared image color fusion method and system based on deep learning |
CN111476732A (en) * | 2020-04-03 | 2020-07-31 | 江苏宇特光电科技股份有限公司 | Image fusion and denoising method and system |
CN112217962A (en) * | 2019-07-10 | 2021-01-12 | 杭州海康威视数字技术股份有限公司 | Camera and image generation method |
CN112767298A (en) * | 2021-03-16 | 2021-05-07 | 杭州海康威视数字技术股份有限公司 | Method and device for fusing visible light image and infrared image |
CN113362261A (en) * | 2020-03-04 | 2021-09-07 | 杭州海康威视数字技术股份有限公司 | Image fusion method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7620265B1 (en) * | 2004-04-12 | 2009-11-17 | Equinox Corporation | Color invariant image fusion of visible and thermal infrared video |
CN101673396A (en) * | 2009-09-07 | 2010-03-17 | 南京理工大学 | Image fusion method based on dynamic object detection |
CN101853492A (en) * | 2010-05-05 | 2010-10-06 | 浙江理工大学 | Method for fusing night-viewing twilight image and infrared image |
-
2011
- 2011-06-11 CN CN2011101559584A patent/CN102298769A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7620265B1 (en) * | 2004-04-12 | 2009-11-17 | Equinox Corporation | Color invariant image fusion of visible and thermal infrared video |
CN101673396A (en) * | 2009-09-07 | 2010-03-17 | 南京理工大学 | Image fusion method based on dynamic object detection |
CN101853492A (en) * | 2010-05-05 | 2010-10-06 | 浙江理工大学 | Method for fusing night-viewing twilight image and infrared image |
Non-Patent Citations (3)
Title |
---|
史世明等: "基于YUV空间色彩传递的可见光/热成像双通道彩色成像系统", 《兵工学报》, vol. 30, no. 1, 15 January 2009 (2009-01-15) * |
王岭雪等: "基于YUV空间的双通道视频图像色彩传递及实时系统", 《北京理工大学学报》, vol. 30, no. 1, 30 March 2007 (2007-03-30) * |
金伟其等: "彩色夜视成像处理算法的新进展", 《红外与激光工程》, vol. 37, no. 1, 25 February 2008 (2008-02-25) * |
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102547063B (en) * | 2012-02-08 | 2014-06-11 | 南京航空航天大学 | Natural sense color fusion method based on color contrast enhancement |
CN102547063A (en) * | 2012-02-08 | 2012-07-04 | 南京航空航天大学 | Natural sense color fusion method based on color contrast enhancement |
CN108989649A (en) * | 2013-08-01 | 2018-12-11 | 核心光电有限公司 | With the slim multiple aperture imaging system focused automatically and its application method |
CN105917641A (en) * | 2013-08-01 | 2016-08-31 | 核心光电有限公司 | Thin multi-aperture imaging system with auto-focus and methods for using same |
CN104156992B (en) * | 2014-07-18 | 2017-02-15 | 北京理工大学 | Visible light black and white video image natural colorization method based on color transferring |
CN104143183B (en) * | 2014-08-07 | 2017-12-12 | 北京理工大学 | The gray scale fusion method of visible ray and infrared black and white video image is transmitted based on brightness |
CN107005639A (en) * | 2014-12-10 | 2017-08-01 | 索尼公司 | Image pick up equipment, image pickup method, program and image processing equipment |
CN107005639B (en) * | 2014-12-10 | 2020-04-14 | 索尼公司 | Image pickup apparatus, image pickup method, and image processing apparatus |
CN104601953B (en) * | 2015-01-08 | 2017-12-15 | 中国航空无线电电子研究所 | A kind of video image fusion processing system |
CN104601953A (en) * | 2015-01-08 | 2015-05-06 | 中国航空无线电电子研究所 | Video image fusion-processing system |
CN104796577B (en) * | 2015-03-20 | 2017-10-24 | 南京理工大学 | Color night vision imaging device and method based on EMCCD and monochrome CCD |
CN104796577A (en) * | 2015-03-20 | 2015-07-22 | 南京理工大学 | Colored night vision imaging device and method based on EMCCD and single-color CCD |
CN105046869A (en) * | 2015-07-06 | 2015-11-11 | 北京理工大学 | Forest fire prevention monitoring system based on double-wave-band fusion theory |
CN105701765A (en) * | 2015-09-23 | 2016-06-22 | 河南科技学院 | Image-processing method and mobile terminal |
CN106570850B (en) * | 2016-10-12 | 2019-06-04 | 成都西纬科技有限公司 | A kind of image interfusion method |
CN106570850A (en) * | 2016-10-12 | 2017-04-19 | 成都西纬科技有限公司 | Image fusion method |
CN106815826A (en) * | 2016-12-27 | 2017-06-09 | 上海交通大学 | Night vision image Color Fusion based on scene Recognition |
CN110651301A (en) * | 2017-05-24 | 2020-01-03 | 黑拉有限责任两合公司 | Method and system for automatically coloring night vision images |
CN107169950A (en) * | 2017-06-02 | 2017-09-15 | 江苏北方湖光光电有限公司 | A kind of high-definition picture fusion treatment circuit |
CN108040243A (en) * | 2017-12-04 | 2018-05-15 | 南京航空航天大学 | Multispectral 3-D visual endoscope device and image interfusion method |
CN110211083A (en) * | 2019-06-10 | 2019-09-06 | 北京宏大天成防务装备科技有限公司 | A kind of image processing method and device |
CN112217962A (en) * | 2019-07-10 | 2021-01-12 | 杭州海康威视数字技术股份有限公司 | Camera and image generation method |
CN112217962B (en) * | 2019-07-10 | 2022-04-05 | 杭州海康威视数字技术股份有限公司 | Camera and image generation method |
CN113362261A (en) * | 2020-03-04 | 2021-09-07 | 杭州海康威视数字技术股份有限公司 | Image fusion method |
CN113362261B (en) * | 2020-03-04 | 2023-08-11 | 杭州海康威视数字技术股份有限公司 | Image fusion method |
CN111402306A (en) * | 2020-03-13 | 2020-07-10 | 中国人民解放军32801部队 | Low-light-level/infrared image color fusion method and system based on deep learning |
CN111476732A (en) * | 2020-04-03 | 2020-07-31 | 江苏宇特光电科技股份有限公司 | Image fusion and denoising method and system |
CN112767298A (en) * | 2021-03-16 | 2021-05-07 | 杭州海康威视数字技术股份有限公司 | Method and device for fusing visible light image and infrared image |
CN112767298B (en) * | 2021-03-16 | 2023-06-13 | 杭州海康威视数字技术股份有限公司 | Fusion method and device of visible light image and infrared image |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102298769A (en) | Colored fusion method of night vision low-light image and infrared image based on color transmission | |
Chang | The Effect on Gamut Expansion of Real Object Colors in Multi-primary Display | |
CN103402117A (en) | Method for detecting color cast of video image based on Lab chrominance space | |
WO2018036096A1 (en) | Method for adjusting colour drift in white balance process of four colour display device | |
CN106448591B (en) | Method and device for converting RGB (red, green and blue) to RGBW (red, green and blue) color gamut | |
CN102547063A (en) | Natural sense color fusion method based on color contrast enhancement | |
CN102858072B (en) | Lighting control method and system | |
CN101930596A (en) | Color constancy method in two steps under a kind of complex illumination | |
CN103632351A (en) | All-weather traffic image enhancement method based on brightness datum drift | |
CN106296620B (en) | A kind of color rendition method based on histogram translation | |
CN111107330B (en) | Color cast correction method for Lab space | |
CN109658367A (en) | Image interfusion method based on Color transfer | |
WO2015172336A1 (en) | Display method and display system for image | |
CN106098009B (en) | A kind of driving method and device of liquid crystal display panel | |
CN109035175A (en) | Facial image Enhancement Method based on color correction and Pulse Coupled Neural Network | |
CN104092919B (en) | Chromatic adaptation transformation optimizing method and system for color digital imaging system | |
CN101854558B (en) | Method for correcting color domain in treating video signals of LED display screen | |
CN208353496U (en) | A kind of white balance correction device based on RGB-IR image data | |
CN106815602A (en) | A kind of runway FOD image detection method and devices based on multi-level features description | |
CN100476946C (en) | Four color data transformation method and apparatus therefor | |
Jin et al. | Image Enhancement Based on Selective-Retinex Fusion Algorithm. | |
CN105809648A (en) | Color deviation judgment and normalization method based on Lab color space | |
CN109712093A (en) | A kind of color of image restoring method and device based on sky and ocean background | |
CN109068111A (en) | A kind of monitoring device, monitoring method and electronic equipment | |
CN101945301B (en) | Method for converting 2D (two-dimensional) character scene into 3D (three-dimensional) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20111228 |