CN107302668A - High dynamic range imaging module based on runner dynamic light splitting - Google Patents
High dynamic range imaging module based on runner dynamic light splitting Download PDFInfo
- Publication number
- CN107302668A CN107302668A CN201710704693.6A CN201710704693A CN107302668A CN 107302668 A CN107302668 A CN 107302668A CN 201710704693 A CN201710704693 A CN 201710704693A CN 107302668 A CN107302668 A CN 107302668A
- Authority
- CN
- China
- Prior art keywords
- camera
- image
- exposure
- light
- dynamic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a high dynamic range imaging module based on dynamic light splitting of a rotating wheel. By combining the main mirror, the plurality of adapters and the plurality of cameras, and adopting a dynamic adjustment technology of parameters such as light splitting ratio, light intensity transmittance, lens aperture, camera exposure time and the like and a multi-source image high dynamic synthesis technology, the method realizes clear imaging in a large dynamic range under the condition of extreme variation of scene light intensity, solves the problem of dynamic adjustment of exposure required by imaging in the high dynamic range, and has important significance in realizing high-quality target imaging in optical measurement.
Description
Technical field
The present invention relates to sensor high dynamic imaging field, and in particular to a kind of high dynamic range based on the dynamic light splitting of runner
Enclose image-forming module.
Background technology
It is existing that flash ranging tests vision record, exception due to its noncontact, directly perceived, high-precision feature, in new-type weapon and equipment
There is irreplaceable effect in the tasks such as picture analysis, attitude measurement.But compared to rocket launching, guided missile initial flight stage
High dynamic scene, existing separate unit set imaging device dynamic range is relatively low, under a certain exposure intensity, and existing equipment is difficult capture
All details in scene, the part details of image can not expose well, thus cannot clearly display.Using multiple
Camera constitutes camera array, and each camera sets the different time for exposure, and short exposure time is conducive to capturing scenes highlight regions
Details, the long time for exposure can then capture dark areas details.All cameras with different exposure time expose simultaneously so that scene
Target under middle different luminance backgrounds can have preferable exposure in some camera, i.e., every image all some regions are thin
Section is done well；Method by the way that different exposure images are synthesized afterwards, obtaining all details in scene can clearly show
Image.
The method of high dynamic scene is shown using many exposure images can be divided into two major classes, and one kind is to be based on imaging process
The high dynamic imaging method of the illumination image of restoration scenario, the result that this method finally gives be high-dynamics image, it is necessary to through
Overtone is mapped, and result could be shown on conventional equipment.Another is the method for Weighted Fusion, i.e., by exposure image according to it
Quality assigns corresponding weights, is merged further according to certain fusion rule so that the result images finally given include institute
There is the image for exposing that all positions all preferably expose in preferable scene, i.e. scene in input picture.
At present, most of many exposure high-dynamics image generating algorithms are only applicable to the scene of low speed or static state, at a high speed
The scene of change, or dynamic range super large is (such as>More than 120dB) scene, this scheme still seems helpless.
Towards special screne application aspect, according to incomplete information inference, the U.S. passes through the design of many bores, optics
Breakthrough in terms of camera lens and Light Electrical structure design and new imaging detector, and rely on America and Japan to design system in optical lens
Make, Light Electrical structure design and control are realized, technology and industrial advantage in terms of image detector, realize super big dynamic range
Imaging, obtain HDR in the emission test of NASA rockets related to U.S. army side, space shuttle and guided missile
Image, can obtain more real transmitting scene, including light intensity and resolution information and multiband information etc., effectively support
The space flight in the U.S. and weapon industrial development.
China is reviewed, due to not possessing ripe leading technology and industrial level on image detector, while in imaging
It is many poor that technology and industrial level and the leading level in the world in terms of lens design manufacture, Light Electrical design and control realization also have
Away from, therefore China is used for such as special screnes such as photogrammetries there is presently no ripe high dynamic range imaging scheme and system
High dynamic range imaging task.But, domestic Changchun ray machine institute, Zhejiang University, Nankai University, Guizhou University, science and techniques of defence
The units such as university, Tsing-Hua University and some photoelectricity research institutes and incorporated business are joined inside and outside camera response curve generation, camera
Number demarcation, image alignment and registration, image mosaic, optical lens manufacture and design, Light Electrical structure design, imaging sensor should
With there is good progress in terms of control design case, the technical strength of submodule, and answering in some new devices are formd
Breakthrough is achieved with research aspect, such as Changchun ray machine utilizes DMD and CCD combination, realizes the spectrum assignment of Pixel-level, can
What is needed with realizing the imaging dynamic range for reaching 96dB, but being imaged with photogrammetry is more than 120dB (or even more than 150dB)
Dynamic range also have many gaps.Moreover, the design that current domestic high dynamic range imaging also lacks large scale system level should
Use ability.
The content of the invention
To solve the above problems, the present invention is special to propose a kind of high dynamic range imaging module based on the dynamic light splitting of runner,
By the combination of primary mirror, multiple adapters and Duo Tai cameras, during using splitting ratio, light intensity transmitance, lens aperture, camera exposure
Between etc. parameter dynamic adjustment technique and multi-source image high dynamic synthetic technology, realize and move greatly under the conditions of scene light intensity extreme variation
The blur-free imaging of state scope, the light exposure required for solving high dynamic range imaging dynamically adjusts problem, and mesh is realized in flash ranging
The imaging of absolute altitude quality is significant.
A kind of high dynamic range imaging module based on the dynamic light splitting of runner of the present invention, by the dynamic based on light splitting runner
Light-dividing device and light path control and image fusion software module composition.Dynamic light-dividing device is real according to different imaging tasks
Splitting ratio regional dynamics now to camera target surface are adjustable.With reference to image co-registration and enhancing Processing Algorithm, using the teaching of the invention it is possible to provide dynamic model
Enclose and reach 136dB, the overall dynamic range of system will be greater than 150dB, realize the high dynamic range imaging to target.
A kind of high dynamic range imaging modular structure based on the dynamic light splitting of runner of the present invention is as shown in figure 1, including dynamic
State light-dividing device, the device includes primary mirror 1, adapter 2, light splitting runner spatial light modulator 4, camera 7, computer 8, wherein suitable
Orchestration 2 is increased one group of camera lens between primary mirror and camera in order to adapt to the camera of different target surface sizes, and adapter is comprising dynamic
The dynamic adjustable mechanism 6 of state adjustable light splitting mechanism 5, light intensity.The design principle of adaptation module is imaged according to high dynamic, for different targets
The camera of face size, has corresponding adapter to correspond.
The light splitting runner spatial light modulator is located at primary mirror end, adapter front end；
The quantity of the adapter is consistent with camera quantity；
Each camera sends synchronizing signal, and the synchronizing signal of each camera will be produced by the capture card of each camera；
The computer completes the synthesis of the IMAQ and high dynamic range images of camera.
Target is divided into n bar branch roads by being imaged in after primary mirror on the focal plane of primary mirror by light splitting runner spatial light modulator,
Respectively by different adapters, on the camera for imaging in corresponding different target surface sizes.In Optical System Design, in order to keep away
Exempt from influence of the camera resolution ratio to system imaging quality, in the design process, differentiated with the minimum of each target surface size camera
Rate is designed.
The synthesis of the IMAQ and high dynamic range images of HDR camera is by being provided with the meter of image pick-up card
Calculation machine is completed, or according to actual needs by more multicomputer progress IMAQ and control.During actual image acquisition, camera
Synchronous to be realized using external trigger, synchronizing signal will be produced by capture card therein.Ensure in global design of the present invention with as far as possible few
Camera combination ensure linear response dynamic range all standing, according to imaging task, using splitting ratio, light intensity transmitance, camera lens
The dynamic adjustment technique and multi-source image high dynamic synthetic technology of the parameters such as aperture, camera exposure time, light channel structure can be carried
The dynamic range of confession reaches 136dB, and the overall dynamic range of system will be greater than 150dB, realizes scene light intensity extreme variation condition
The blur-free imaging of lower Larger Dynamic scope.
High dynamic range images building-up process is：Camera inside and outside parameter demarcation → many exposure image alignment → picture qualities are commented
Valency is to determine the measured region of matter in each image → high-dynamics image fusion.
Compared with prior art, the present invention has following clear advantage：
(1) the imaging dynamic range capabilities bigger than existing light measuring system are realized, are adjusted by the incident intensity of light path, with reference to height
The use of dynamic camera and many luminance picture blending algorithms, can obtain the image with large dynamic range of target.Dynamically divided based on runner
The dynamic range that the high dynamic image-forming module of light can be provided can reach 136dB, for example, the same of body and highlighted wake flame can be realized
When blur-free imaging, realize critical process high-resolution detection；
(2) the real-time dynamic regulation of camera exposure amount is realized.According to the real-time change of target emanation light characteristic, adjust dynamic flexible
Light exposure is saved, to lift imaging dynamic range, the purpose of optimal imaging is reached.To ensure the quality of imaging, algorithm has efficient
Rate and real time characteristic, target imaging feature can be analyzed in real time, and optimal light intensity control is targetedly selected within the shortest time
System strategy.
(3) overall and subregional dynamic light splitting is realized, supporting the imaging spectrometer of different task needs；
(4) high-dynamics image integration technology, realizes that almost linear responds all standing high-dynamics image, solves target rocket body and flame is same
When high-quality imaging technical barrier.
Brief description of the drawings
Fig. 1 is based on light splitting runner high dynamic range imaging system structure diagram；
Fig. 2 high dynamic range images synthetic schemes；
Fig. 3 high dynamics imaging lens and its visual field schematic diagram；
High-dynamics image blending algorithm flow charts of the Fig. 4 based on wavelet transformation.
Embodiment
It is as shown in Figure 1 based on light splitting runner high dynamic range imaging modular structure frame.System include primary mirror 1, adapter 2,
Light splitting runner spatial light modulator 4, camera 7, computer master control interface 8, wherein adapter include dynamic adjustable light splitting mechanism 5,
Light intensity dynamic adjustable mechanism 6, the light of primary mirror collection takes in the phase of diverse location respectively after light splitting runner spatial light modulator
Machine, is imaged after the interchangeable adapter collection of camera front end in camera target surface.Dynamic adjustable light splitting mechanism according to it is different into
As task, the splitting ratio of realization to different cameral is adjustable, and the light exposure required for solving high dynamic range imaging is dynamically adjusted
Problem.
1 hardware is constituted and general principle
(1) Design of Hardware Architecture
High dynamic image-forming module includes：Primary mirror, adapter, light splitting runner spatial light modulator, camera, computer,
1) primary mirror
The high dynamic image-forming module primary mirror can be chosen according to specific measurement task, by taking the rocket launching stage as an example, target range
The distance of optical measuring device is 2km, and target size is about 50m, in order to its complete imaging, need to completely cover about 120m yardstick model
Enclose, its visual field subtended angle that converts now is about 20mm imaging target surface, corresponding lens focus is about for 3.4 ° for diagonal
500mm, therefore select 500mm tight shot；
2) light splitting runner spatial light modulator
The light splitting runner spatial light modulator realizes system light splitting in the form of light splitting runner.During the conversion of the light splitting runner
Between ＜ 1s, precision be ± 2 °, the splitting ratio of wherein light splitting piece has 1:1、2:8、3:5、5:3、8:2、1:9；
3) adapter
In order to adapt to the camera of different target surface sizes, increase by one group of camera lens between primary mirror and camera, be allowed to corresponding phase
Machine is matched, and this group of camera lens is corresponded with camera, referred to as adapter.Adapter can cause picture centre in Renewal process
Skew, to successive image fusion have an impact.The main cause for causing image shift is its datum clamp face after adapter is changed
Error band come optical axis skew.
2 software modules
(1) the dynamic adjustable strategies of camera exposure amount and control software
Dynamically adjustment needs by adjusting aperture size, adapter splitting ratio, the light intensity percent of pass to each camera camera exposure amount
And the combination such as the time for exposure of camera and gain multiplication factor is realized；
Wherein, adjustment aperture size will directly influence the luminous flux for entering adapter, first in adjustment, subsequent difference
It is that dynamic adjustable light splitting mechanism realizes that the dynamic adjustable mechanism of splitting ratio adjustment, light intensity realizes the adjustment of light intensity percent of pass and camera exposure
Time/Gain tuning, finally realize that the quasi-continuous light exposure of multistage of any camera is dynamically adjusted.Camera (m, n) (m-th of primary mirror
N-th of camera) the light exposure relative value such as following formula that is obtained, do not consider the gain coefficient of camera herein, that is, assume camera
Gain coefficient is consistent：
RHm,n=E0AmSm,nWm,nCm,n (1)
Wherein, E0For primary mirror entrance pupil light total amount, AmThe luminous flux and the ratio of maximum ring determined for the aperture stop number of the primary mirror
(using during maximum ring as 1), Sm,nFor point of the past camera (m, n) of optical filter point of the dynamic adjustable light splitting mechanism in whole beam microscope group
Light ratio, Wm,nThe light intensity percent of pass realized for the optical filter of the dynamic adjustable mechanism of light intensity in the corresponding adapter of the camera, Cm,n
For the time for exposure of the camera；
, can be advance according to live illumination condition and predictable radiance and its dynamic range according to the requirement of flash ranging task
The default exposure of each camera is adjusted by setting each primary mirror aperture size, splitting ratio, light intensity percent of pass, camera exposure time
Amount.If table 1,2 is two groups of default light exposure parameter configurations；
The parameter preset of table 1 configuration 1
The parameter preset of table 2 configuration 2
Under parameter configuration as shown in Table 1 and Table 2, the dynamic range that light channel structure can be provided reaches 136dB, system it is whole
Body dynamic range will be greater than 150dB, it is sufficient to tackle the high dynamic range imaging of extreme rocket launching process.If moreover, needed
Dynamic range that will be bigger, the aperture permissible value of visor head and the most short shutter permissible value of camera, it is sufficient to deal with rocket and various
The emission process high dynamic range imaging task of guided missile.
For high dynamic imaging, image that the above is obtained may be simultaneously non-optimal, and change with dbjective state and
Flying distance becomes remote, it is necessary to which dynamic adjusts light exposure, now by mainly according to maximum exposure amount and the image matter of minimum exposure amount
Amount is estimated, provide how adjusting parameter configuration judgement.The image of maximum exposure amount is mainly for offer target is compared with dark space
The clear figure in domain, and minimum exposure spirogram picture is mainly for the clear figure of offer target brightest area.Therefore, if maximum exposure
The dark space Partial exposure of spirogram picture is not enough, then under the premise of the shutter for guaranteeing acquisition moving image is set, sets increase to expose
The parameter configuration of light quantity；, whereas if the dark space Partial exposure of maximum exposure spirogram picture excessively, then sets the ginseng for reducing light exposure
Number configuration.If the problem of image of minimum exposure amount produces under-exposed, parameter configuration is carried out according to light exposure is heightened, such as
Overexposure then according to turn down light exposure carry out parameter configuration.Match somebody with somebody in the camera exposure parameter for setting light exposure pole maximum and minimum
Postpone, as benchmark, according to the principle of balanced incremented/decremented, set the exposure parameter configuration of remaining camera.In light exposure
In the case that great camera can not realize restructuring exposure, will set splitting ratio is the situation using only one of passage, this
When will only allow 3 cameras according to identical light exposure parameter configuration work.
More than under the guidance of strategy, coordinate the running parameter of system, to ensure the high-quality picture rich in detail needed for obtaining.
More than under the guidance of strategy, with reference to the driver and image quality evaluation Processing Algorithm of each electric control part, establishment is formed
Dynamic adjustment control software, is electronically controlled to the mechanism of required regulation via interface unit, reaches the purpose of strategy execution.
(2) high-dynamics image blending algorithm
The general principle of many exposure image Weighted Fusion methods is to assign each image of different light exposures according to its picture quality
Corresponding weights are given, are merged further according to certain fusion rule so that the result images finally given include all inputs
The image that all positions all preferably expose in preferable scene, i.e. scene is exposed in image.High dynamic range images blending algorithm
Handling process is as shown in Figure 4；
Camera array image registration
The different time for exposure are set to different cameral in camera array, while capturing scenes illumination, obtains serial different exposures
The image of light, due to the difference of each camera position, causes the image obtained to there is certain parallax, it is necessary to before fusion
Registration and correction are carried out to image；
The system can have been overlapped using 3 main lens and 6 cameras, in actual use, the visual field of three camera lenses, and 6
Individual camera is possible to obtain a certain apart from upper scene, but will have certain overlapping and dislocation apart from front and rear scene herein
(in the range of the blur-free imaging that main lens allow)；
Under conditions of previously known lens group and phase unit inside and outside parameter, and the actual distance of known target scene, due to
Same main lens is employed during design and whole beam microscope group is designed, and ensures that other pattern distortions, institute will not be brought during light splitting
So that according to the relation between the ideal image of the scene in the camera between each image of acquisition (different camera lenses can be mainly
Image acquired in camera) relative displacement obtain moving parameter, pair of image is then realized by the translation of image sequence
Together.Can ensure in this way in the case where certain target scene distance changes (when distance is 1000 meters about ±
100 meters), realize the good alignment of image sequence.This is in the case where ensuring that parameters can be obtained in advance, due to this
When the calculating detection process of image can be ignored, therefore be possible to ensure the real-time of high-dynamics image synthesis；
If the inside and outside parameter of accurate camera lens and camera can not be provided previously by, and target scene actual distance, or clap
Photographic range scope beyond calibration scope it is larger in the case of (such as calibration distance be 1000 meters when coverage exceed ± 200
Rice), then need the selected characteristic region in each image (first camera of general each mirror provides image) to carry out rim detection
And positioning, so as to obtain the translation parameters between each image, it is then based on these parameters and carries out image alignment operation.But,
Feature detection and position fixing process due to image will consume certain amount of calculation, therefore in the case where picture size is larger, this
Individual process will influence the real-time of high-dynamics image synthesis to a certain extent.
Usual image registration is divided into following two processes：
1) image calibration (offline pre- demarcation) based on light field synthesizing bore diameter theory
Demarcated firstly the need of to camera, obtain the inside and outside parameter of each camera.The internal reference of camera and outer ginseng pass through conventional
Positive friend's plane reference method is obtained.By scaling board be placed on four cameras while it is observed that place demarcated, can obtain
Each camera direction and the outer ginseng of position are characterized under unified coordinate system, is that the follow-up image calibration based on light field synthesizing bore diameter theory is carried
For parameter；
In video camera array, the coordinate system for choosing a video camera is reference frame, and the outer ginseng of other video cameras is relative
In the parameter with reference to video camera.If the Intrinsic Matrix with reference to video camera is C, the Intrinsic Matrix of non-reference video camera is Cf。
The point P in space is taken, its coordinate in two camera coordinate systems is respectively Q=(X, Y, Z)T, Qf=(Xf,Yf,Zf)T,
Point P in both images as coordinate (being represented with homogeneous coordinates) be q=(x, y, 1)T, q=(xf,yf,1)TIf, with reference to shooting
Relative rotation matrices between machine and video camera f are Rf, it is t with reference to coordinate of the center in video camera f coordinate systems of video cameraf,
If π is a plane in space, n is the normal vector with reference to π under camera coordinate system, wherein n=m/dπ, m is π unit normal direction
Amount, for the distance with reference to video camera origin to plane π, then for the institute in plane π a little, below equation is set up：
Order
Hf=Cf(Rf+tfnT)C-1 (3)
Then HfIt is the homography matrix between two images induced by plane π.Therefore deduce that, in scene in a plane
Point o'clock in a camera review can coincide by homography matrix conversion with the point in reference picture.By original above
Reason can be focused on to the reference planes in scene, when scene depth change is little, and the list that each point is asked in scene should change less.
The image that thus different cameral of camera array is shot has been calibrated to approximately the same plane by projective transformation；
It must just can guarantee that synthetic effect is optimal in approximately the same plane when synthesizing scene based on light field synthesizing bore diameter theory, depth
The image effect of the bigger synthesis of conversion is poorer, but it is difficult to ensure that scene is in same depth plane in actual conditions, this is just needed
Carry out the accuracy registration of second step.
2) image registration based on middle bitmap value
It is right because the number of the point bright and darker than it than it is certain for any point in certain moment scene
Any one respective pixel in the two images of different exposures, brighter than it the ratio between with the number of pixels darker than it is certain
's.Based on this thought, according to the intermediate value of different exposure images by image binaryzation, that is, intermediate value bitmap is obtained, according to intermediate value position
Figure carries out secondary registration to image, can obtain the higher registering image of precision.
Blending algorithm
1) image interfusion method based on image quality evaluation
The basic thought of image interfusion method based on image quality evaluation is：Using image quality evaluation index, relatively more all exposure images
The picture matter characteristic at (i, j) place, filters out optimum value as the pixel value at output image (i, j) place after fusion.Finally to the output
Image does light field smoothly, prevents mutation between different light exposure pixel values；
Wherein, Pixel-level quality evaluation contrast, saturation degree and exposure carry out image quality evaluation to each pixel in image.Because
Overexposure or it is under-exposure caused by it is flat, should be assigned to less value without color region, it is and bright in image, details
Pixel should give larger value.Assuming that Cij,k,Sij,k,Dij,kRepresent that (i, j) place pixel qualities are evaluated in kth frame image respectively
The evaluation of estimate of index contrast, saturation degree and exposure, then (i, j) place pixel qualities comprehensive evaluation value be：
Wherein ωC,ωS,ωDIt is contrast, the weight shared by three desired values of saturation degree and exposure respectively, calculates each
After the comprehensive evaluation value of pixel, in order to avoid influence of the pixel to fusion results of poor quality, we only choose and commented
The best point of valency result is merged.This fusion method is possible to that the image of fusion can be caused not smooth enough, occurs obvious
Block effect.Thus need to carry out smooth treatment to it.
2) many exposure image fusion methods based on wavelet decomposition
Wavelet transformation has multiple dimensioned, multiresolution and multi-direction characteristic, and it meets in level, the decomposition vertically and on 45 degree of angles
The vision mechanism of human eye.Therefore, wavelet transformation is incorporated into exposure fusion, obtained fused images visual effect can be more preferable；
In many exposure image fusion methods based on wavelet decomposition, first, n-layer wavelet transformation is carried out to source images, by its point
Solve the HFS for 1 low frequency subgraph and 3n different directions.HFS highlights the grain details of image, therefore to each figure
As the HFS decomposed takes maximum, summation is weighted for low frequency part, weights by saturation degree and the exposure of pixel when
Between determine.Then, the weights figure after normalization is subjected to gaussian pyramid decomposition, Decomposition order and the number of plies phase of wavelet decomposition
Together, then weights figure is top identical with the size of low-frequency image after wavelet decomposition after decomposing, and the low frequency part of image is melted
Close, obtain the low-frequency image of fused images.The low frequency part and HFS of fused images are rebuild, final melt is obtained
Close image.
Many exposure image blending algorithm steps based on wavelet decomposition are：
(1) Pixel-level quality evaluation
Details in image shows as high frequency subgraph in wavelet decomposition, and flat region shows as low frequency subgraph.We are
The details of enhancing image and the color of flat site, are handled high and low frequency subgraph respectively.To low frequency part using weighting
The mode of fusion；
(2) blending weight is determined
Weights of the pixel of each in image when low frequency subgraph is merged are：
Wherein ωS,ωDIt is saturation degree and exposure respectively it is determined that proportion shared during weights.Weights are normalized to：
(3) Weighted Fusion
First, source images are decomposed into 1 low frequency subgraphWith the high frequency subgraph of 3n different directionsHFS is merged
Rule is：
Wherein, N is the quantity of different exposure images,The high frequency subgraph that kth width picture breakdown goes out is represented,For
The HFS of fused images；
The fusion formula of image low frequency part is：
WhereinThe low frequency subgraph decomposed for kth width image wavelet,For the top of weight map gaussian pyramid,To melt
Close the low frequency part of image；
Now, we have been obtained for the high and low frequency part of fused images, and they are carried out into wavelet reconstruction, finally melted
The image of conjunction.
Claims (3)
1. a kind of high dynamic range imaging module based on the dynamic light splitting of runner, including dynamic light-dividing device, it is characterised in that institute
Stating dynamic light-dividing device includes primary mirror (1), adapter (2), light splitting runner spatial light modulator (4), camera (7), calculating owner
Control interface (8), wherein adapter includes dynamic adjustable light splitting mechanism (5) and the dynamic adjustable mechanism (6) of light intensity, adapter is located at master
Between mirror and camera,
The light splitting runner spatial light modulator is located at primary mirror end, adapter front end；
The quantity of the adapter is consistent with camera quantity；
Each camera sends synchronizing signal, and the synchronizing signal of each camera will be produced by the capture card of each camera；
The computer completes the synthesis of the IMAQ and high dynamic range images of camera；
High dynamic range images building-up process is：Camera inside and outside parameter demarcation → many exposure image alignment → image quality evaluations →
High-dynamics image is merged.
2. a kind of high dynamic range imaging module based on the dynamic light splitting of runner according to claim 1, it is characterised in that
The camera inside and outside parameter demarcation uses the dynamic adjustable strategies of camera exposure amount, is specially：
Camera exposure amount is dynamically adjusted when including adjustment aperture size, splitting ratio adjustment, the adjustment of light intensity percent of pass, camera exposure
Between/Gain tuning, finally realize that the quasi-continuous light exposure of multistage of any camera is dynamically adjusted；
Camera (m, n), n-th of camera of m-th of primary mirror, the light exposure relative value such as following formula obtained, it is assumed herein that camera
Gain coefficient is consistent：
RHm,n=E0AmSm,nWm,nCm,n (1)
Wherein, E0For primary mirror entrance pupil light total amount, AmThe luminous flux and the ratio of maximum ring determined for the aperture stop number of the primary mirror,
Using during maximum ring as 1, Sm,nFor the light splitting of the past camera (m, n) of optical filter point of the dynamic adjustable light splitting mechanism in whole beam microscope group
Than Wm,nThe light intensity percent of pass realized for the optical filter of the dynamic adjustable mechanism of light intensity in the corresponding adapter of the camera, Cm,nFor
The time for exposure of the camera；
It is logical in advance according to live illumination condition and predictable radiance and its dynamic range according to the requirement of flash ranging task
Cross and set the default exposure that each primary mirror aperture size, splitting ratio, light intensity percent of pass, camera exposure time adjust each camera
Amount.
3. a kind of high dynamic range imaging module based on the dynamic light splitting of runner according to claim 1, it is characterised in that
Many exposure images fusion of the high-dynamics image fusion including the image interfusion method based on image quality evaluation, based on wavelet decomposition
Method；
The image interfusion method based on image quality evaluation：Using image quality evaluation index, relatively more all exposure image (i, j) places
As matter characteristic, optimum value is filtered out as the pixel value at output image (i, j) place after fusion, light field finally is done to the output image
Smoothly, mutation between different light exposure pixel values is prevented；
Source images first, are carried out n-layer wavelet transformation, by its point by many exposure image fusion methods based on wavelet decomposition
The HFS for 1 low frequency subgraph and 3n different directions is solved, maximum is taken to the HFS of each picture breakdown, for low
Frequency is partly weighted summation, and weights are determined by the saturation degree and time for exposure of pixel, then, and the weights figure after normalization is entered
Row gaussian pyramid is decomposed, and Decomposition order is identical with the number of plies of wavelet decomposition, then weights figure is top after decomposing and wavelet decomposition
The size of low-frequency image is identical afterwards, and the low frequency part of image is merged, and obtains the low-frequency image of fused images, and fusion is schemed
The low frequency part and HFS of picture are rebuild, and obtain final fused images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710704693.6A CN107302668A (en) | 2017-08-17 | 2017-08-17 | High dynamic range imaging module based on runner dynamic light splitting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710704693.6A CN107302668A (en) | 2017-08-17 | 2017-08-17 | High dynamic range imaging module based on runner dynamic light splitting |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107302668A true CN107302668A (en) | 2017-10-27 |
Family
ID=60131988
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710704693.6A Pending CN107302668A (en) | 2017-08-17 | 2017-08-17 | High dynamic range imaging module based on runner dynamic light splitting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107302668A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108717690A (en) * | 2018-05-21 | 2018-10-30 | 电子科技大学 | A kind of synthetic method of high dynamic range photo |
| CN110738627A (en) * | 2019-09-04 | 2020-01-31 | 深圳市华星光电技术有限公司 | Multi-exposure image fusion device and multi-exposure image fusion method |
| CN111527743A (en) * | 2017-12-28 | 2020-08-11 | 伟摩有限责任公司 | Multiple modes of operation with extended dynamic range |
| CN112489134A (en) * | 2020-11-26 | 2021-03-12 | 南方科技大学 | Motion estimation-oriented design method of cross-frame ultrahigh-speed camera and motion estimation method |
| CN115760663A (en) * | 2022-11-14 | 2023-03-07 | 辉羲智能科技(上海)有限公司 | Method for synthesizing high dynamic range image from low dynamic range image based on multi-frame multi-exposure |
| CN116389682A (en) * | 2023-03-07 | 2023-07-04 | 华中科技大学 | Dual-event camera synchronous acquisition system and noise event suppression method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1874499A (en) * | 2006-05-12 | 2006-12-06 | 北京理工大学 | High dynamic equipment for reconstructing image in high resolution |
| CN101078776A (en) * | 2007-06-29 | 2007-11-28 | 西安奥华电子仪器有限责任公司 | Nuclear logging data multi-measure processing method |
| CN101726365A (en) * | 2009-10-20 | 2010-06-09 | 西北工业大学 | Non-refrigeration type multiband far infrared thermal imager |
| CN102521814A (en) * | 2011-10-20 | 2012-06-27 | 华南理工大学 | Wireless sensor network image fusion method based on multi-focus fusion and image splicing |
| CN202710912U (en) * | 2012-07-16 | 2013-01-30 | 耿征 | Optical processing device and high-frame-frequency colour display imaging device |
| US20140153246A1 (en) * | 2012-12-05 | 2014-06-05 | Delta Electronics, Inc. | Light source system for a stereoscopic projection apparatus |
| US20150124080A1 (en) * | 2013-11-04 | 2015-05-07 | Digital Film Technology GmbH | Method and device for scanning a film |
-
2017
- 2017-08-17 CN CN201710704693.6A patent/CN107302668A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1874499A (en) * | 2006-05-12 | 2006-12-06 | 北京理工大学 | High dynamic equipment for reconstructing image in high resolution |
| CN101078776A (en) * | 2007-06-29 | 2007-11-28 | 西安奥华电子仪器有限责任公司 | Nuclear logging data multi-measure processing method |
| CN101726365A (en) * | 2009-10-20 | 2010-06-09 | 西北工业大学 | Non-refrigeration type multiband far infrared thermal imager |
| CN102521814A (en) * | 2011-10-20 | 2012-06-27 | 华南理工大学 | Wireless sensor network image fusion method based on multi-focus fusion and image splicing |
| CN202710912U (en) * | 2012-07-16 | 2013-01-30 | 耿征 | Optical processing device and high-frame-frequency colour display imaging device |
| US20140153246A1 (en) * | 2012-12-05 | 2014-06-05 | Delta Electronics, Inc. | Light source system for a stereoscopic projection apparatus |
| US20150124080A1 (en) * | 2013-11-04 | 2015-05-07 | Digital Film Technology GmbH | Method and device for scanning a film |
Non-Patent Citations (1)
| Title |
|---|
| 吴晓军: ""基于多曝光图像的高动态范围图像生成"", 《中国优秀硕士学位论文全文数据库（电子期刊）信息科技辑》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111527743A (en) * | 2017-12-28 | 2020-08-11 | 伟摩有限责任公司 | Multiple modes of operation with extended dynamic range |
| CN108717690A (en) * | 2018-05-21 | 2018-10-30 | 电子科技大学 | A kind of synthetic method of high dynamic range photo |
| CN108717690B (en) * | 2018-05-21 | 2022-03-04 | 电子科技大学 | Method for synthesizing high dynamic range picture |
| CN110738627A (en) * | 2019-09-04 | 2020-01-31 | 深圳市华星光电技术有限公司 | Multi-exposure image fusion device and multi-exposure image fusion method |
| CN110738627B (en) * | 2019-09-04 | 2022-04-26 | Tcl华星光电技术有限公司 | Multi-exposure image fusion device and multi-exposure image fusion method |
| CN112489134A (en) * | 2020-11-26 | 2021-03-12 | 南方科技大学 | Motion estimation-oriented design method of cross-frame ultrahigh-speed camera and motion estimation method |
| CN112489134B (en) * | 2020-11-26 | 2024-05-14 | 南方科技大学 | Motion estimation-oriented frame-crossing ultra-high-speed camera design method and motion estimation method |
| CN115760663A (en) * | 2022-11-14 | 2023-03-07 | 辉羲智能科技(上海)有限公司 | Method for synthesizing high dynamic range image from low dynamic range image based on multi-frame multi-exposure |
| CN115760663B (en) * | 2022-11-14 | 2023-09-22 | 辉羲智能科技(上海)有限公司 | Method for synthesizing high dynamic range image based on multi-frame multi-exposure low dynamic range image |
| CN116389682A (en) * | 2023-03-07 | 2023-07-04 | 华中科技大学 | Dual-event camera synchronous acquisition system and noise event suppression method |
| CN116389682B (en) * | 2023-03-07 | 2024-02-06 | 华中科技大学 | Dual-event camera synchronous acquisition system and noise event suppression method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107343130A (en) | High dynamic imaging module based on DMD dynamic light splitting | |
| CN107302668A (en) | High dynamic range imaging module based on runner dynamic light splitting | |
| CN107302667B (en) | Camera-interchangeable dynamic spectral imaging system and method for applying same to high dynamic imaging | |
| CN105118055B (en) | Camera position amendment scaling method and system | |
| CN101963751B (en) | Device and method for acquiring high-resolution full-scene image in high dynamic range in real time | |
| US8786718B2 (en) | Image processing apparatus, image capturing apparatus, image processing method and storage medium | |
| EP3356887A1 (en) | Method for stitching together images taken through fisheye lens in order to produce 360-degree spherical panorama | |
| CN107800979B (en) | High dynamic range video image pickup method and filming apparatus | |
| CN108702437A (en) | High dynamic range depth for 3D imaging systems generates | |
| JP5818697B2 (en) | Image generation method, imaging device, display device, program, and storage medium | |
| CN103780840A (en) | High-quality imaging double camera shooting and imaging device and method thereof | |
| CN107113370A (en) | Image capture apparatus and image-capturing method | |
| JP2009188973A (en) | Imaging apparatus, and optical axis control method | |
| JP6746359B2 (en) | Image processing device, imaging device, image processing method, program, and storage medium | |
| US9667853B2 (en) | Image-capturing apparatus | |
| JP7378219B2 (en) | Imaging device, image processing device, control method, and program | |
| CN115150561B (en) | High dynamic imaging system and method | |
| JP6700986B2 (en) | Image processing device, imaging device, image processing method, and program | |
| JP5850648B2 (en) | Imaging device | |
| JP6942480B2 (en) | Focus detector, focus detection method, and focus detection program | |
| JP6254843B2 (en) | Image processing apparatus and control method thereof | |
| CN108156395A (en) | Panorama optical field acquisition device, processing method and computing device based on camera array | |
| CN114612574A (en) | Vehicle-mounted panoramic aerial view camera panoramic aerial view calibration and conversion splicing method based on unmanned aerial vehicle | |
| CN110650331B (en) | Array camera module testing method and target device thereof | |
| JP2020171050A (en) | Image processing apparatus, imaging apparatus, image processing method, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171027 |