CN101080921A - Image pickup device - Google Patents
Image pickup device Download PDFInfo
- Publication number
- CN101080921A CN101080921A CNA2005800432305A CN200580043230A CN101080921A CN 101080921 A CN101080921 A CN 101080921A CN A2005800432305 A CNA2005800432305 A CN A2005800432305A CN 200580043230 A CN200580043230 A CN 200580043230A CN 101080921 A CN101080921 A CN 101080921A
- Authority
- CN
- China
- Prior art keywords
- image
- mentioned
- images
- image pickup
- pickup optical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 116
- 238000012545 processing Methods 0.000 claims description 40
- 230000015572 biosynthetic process Effects 0.000 claims description 11
- 238000003786 synthesis reaction Methods 0.000 claims description 11
- 230000002194 synthesizing effect Effects 0.000 abstract description 4
- 238000012937 correction Methods 0.000 description 55
- 238000007781 pre-processing Methods 0.000 description 24
- 238000000034 method Methods 0.000 description 15
- 230000000694 effects Effects 0.000 description 11
- 150000001875 compounds Chemical class 0.000 description 10
- 238000003384 imaging method Methods 0.000 description 10
- 238000013461 design Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000009977 dual effect Effects 0.000 description 6
- 210000004209 hair Anatomy 0.000 description 6
- 238000005259 measurement Methods 0.000 description 6
- 230000005855 radiation Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 238000011426 transformation method Methods 0.000 description 3
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000000691 measurement method Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000002730 additional effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001915 proofreading effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N25/611—Correction of chromatic aberration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
- H04N23/15—Image signal generation with circuitry for avoiding or correcting image misregistration
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Cameras In General (AREA)
- Color Television Image Signal Generators (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The present invention relates to a image device. A plurality of image pickup regions (104, 105, 106) pick up a plurality of images through a plurality of image pickup optical systems (101, 102, 103) which correspond to the image pickup regions one by one. An image synthesizing means (115) eliminates shifts between the images and synthesizes the plurality of images into one image. Thus, a high quality synthesized image is provided.
Description
Technical field
The present invention relates to synthesize the camera head of 1 high precise image by carrying out parallax correction by a plurality of images that use a plurality of image pickup optical systems to obtain.
Background technology
As by a plurality of images that use a plurality of image pickup optical systems (compound eye camera system) to obtain being synthesized the principle mode that obtains 1 high meticulous image, known have for example " being used for the basic research that the superelevation precise image is obtained " (damp mutually clear fine two people in addition that reach, the pre-original text 90-03-04 of image electronic association, p.23～28 disclosed mode).In this mode, be the pixel of between the pixel of an image, inserting another image by two image congruencings that will use two image pickup optical systems to obtain, obtain 1 high meticulous image.
This principle is applied in the coloured image too.That is, have: use method with a plurality of image pickup optical systems that possess colored filter of configurations such as pattra leaves arrangement or striped arrangement as the method that obtains the meticulous coloured image of height; The method of a plurality of image pickup optical systems mutual different with using the chromatic sensitivity characteristic.
Utilize Figure 15 that general compound eye imaging device is described.In Figure 15, a plurality of image pickup optical systems 101,102,103 are imaged on a plurality of imageing sensors 104,105,106 the subject image respectively.The shooting of a plurality of imageing sensors 104,105,106 is subjected to light characteristic different mutually, and imageing sensor 104 is taken red (R) wavelength region may, and imageing sensor 105 is taken green (G) wavelength region may, and imageing sensor 106 is taken blue (B) wavelength region may.A plurality of images that a plurality of imageing sensors 104,105,106 are taken respectively are after carrying out image processing by R signal processing circuit 107, G signal processing circuit 108 and B signal processing circuit 109 respectively, synthesize by the synthetic treatment circuit 110 of image, export as coloured image.
In this compound eye imaging device, each optical axis of a plurality of image pickup optical systems 101,102,103 is different mutually, with respect to the normal of the subject that is in certain position tilt angle theta (radiation angle) and disposing only symmetrically.For example, radiation angle θ is being set under the optimum and fixing situation with respect to the subject position b of Figure 15, if the subject that is in position a or position c is made a video recording, then above-mentioned radiation angle θ is with different with respect to subject position a, the only radiation angle of c, so between the image that imageing sensor 104,105,106 is taken respectively deviation can take place.
Utilize Figure 16 A, Figure 16 B, Figure 16 C that this situation is described.Figure 16 A, Figure 16 B, Figure 16 C are the figure of the composograph that obtained by compound eye imaging device shown in Figure 15 of expression, Figure 16 A represents to take the situation of the subject of the position a that is in Figure 15, Figure 16 B is the situation that the subject that is in position b has been taken in expression, and Figure 16 C has represented to take the situation of the subject that is in position c.In this example, suppose in the background of black, to take the white subject of circle.
Be in subject under the situation of position a, shown in Figure 16 A, because the radiation angle of a plurality of image pickup optical systems 101,102,103 is improper, distinguish the to the left and right image of deviation with blue images (B) with respect to green image so become red image (R), the image after synthesizing is exported the amount of its deviation as colo(u)r bias.That is, the part that has lacked blue images becomes yellow (Ye) by green image and red image, and the part that has lacked red image becomes dark green (Cy) by green image and blue images, and the part that has lacked blue images and red image becomes green image (G).In this example, because the optical axis of a plurality of image pickup optical systems 101,102,103 disposes one-dimensionally, thus in composograph on its configuration direction the one dimension deviation takes place, but two-dimentional deviation takes place under the situation of two-dimensional arrangement.Taken place in composograph under the situation of two-dimentional deviation, the part that has lacked green image becomes carmetta (Mg) by red image and blue images.
Be in subject under the situation of position b, shown in Figure 16 B, because the radiation angle of a plurality of image pickup optical systems 101,102,103 is suitable, so output does not have the high meticulous image of colo(u)r bias.
Be in subject under the situation of position c, shown in Figure 16 C, become red image and blue images with respect to being in the composograph (with reference to Figure 16 A) that obtains under the situation of position a in subject respectively to the composograph of skew in the other direction.
And then, if small difference (for example deviation of multiplying power, inclination, distortion etc.) is arranged between a plurality of images that obtain by each imageing sensor 104,105,106, then be difficult to proofread and correct exactly parallax, can make the image quality of composograph, particularly resolution variation significantly.
With respect to this, in Japan speciallys permit No. 3397758 communique, following technology is disclosed: in order to eliminate the deviation of multiplying power, will set in the same manner corresponding to the focal length of the 1st image pickup optical system of the 1st wavelength and the focal length corresponding to the 2nd image pickup optical system of the 2nd wavelength.But,, particularly, impossible as thinking substantially under the different situation of the wavelength band of object in each optical system if the viewpoint that realizes from reality considers that it is very difficult making focal length identical.
As mentioned above, to synthesize by a plurality of images that the compound eye camera system obtains and synthesize in the camera head of 1 image, if between a plurality of images that obtain by each optical system, multiplying power, inclination, distortion etc. have small deviation, then be difficult to utilize these images correctly to proofread and correct parallax, image quality, the particularly resolution that makes the image after synthetic is variation significantly.
Summary of the invention
The present invention is in view of above-mentioned problem in the past, and purpose provides a kind of camera head, in camera head with compound eye camera system, and can be by the synthetic high quality images of a plurality of images with parallax.
Camera head of the present invention is characterised in that to possess: a plurality of image pickup optical systems; A plurality of camera watch regions, corresponding one to one with above-mentioned a plurality of image pickup optical systems, take a plurality of images respectively via above-mentioned a plurality of image pickup optical systems; The image synthesis unit has function that makes the deviation unanimity between above-mentioned a plurality of image and the function of being synthesized 1 image by above-mentioned a plurality of images.
The invention effect
According to camera head of the present invention, before synthetic a plurality of images, make the parallax deviation unanimity in addition between a plurality of images, so can synthesize a plurality of images accurately, can access the composograph of high image quality.
Description of drawings
Fig. 1 is the block diagram of schematic configuration of the camera head of the relevant one embodiment of the present invention of expression.
Fig. 2 is the flow chart that is illustrated in the flow process of taking in the camera head of relevant one embodiment of the present invention.
Fig. 3 is the figure of the relation of the subject of camera head of the relevant one embodiment of the present invention of expression and image.
Fig. 4 is the figure of the overview of the device of the focal length of measurement image pickup optical system in the camera head of the relevant one embodiment of the present invention of expression.
Fig. 5 A is the figure that is illustrated in the focal-length measurement method under the principal point of detected lens in the device of Fig. 4 situation consistent with rotary middle spindle.
Fig. 5 B is illustrated in the principal point of detected lens in the device of Fig. 4 and the figure of the focal-length measurement method under the inconsistent situation of rotary middle spindle.
Fig. 6 is the flow chart of algorithm of multiplying power treatment for correcting of the camera head of the relevant one embodiment of the present invention of expression.
Fig. 7 is the figure that is used for illustrating that the interpolation of the camera head of relevant one embodiment of the present invention is handled.
Fig. 8 is the figure that is illustrated in an example of the position relation of each imageing sensor and shot object image in the camera head of relevant one embodiment of the present invention.
Fig. 9 is the figure that is illustrated in an example of the image that obtains via each imageing sensor in the camera head of relevant one embodiment of the present invention.
Figure 10 A is the figure that is used for illustrating the method for the anglec of rotation of detected image transducer in the camera head of relevant one embodiment of the present invention.
Figure 10 B is the figure that is used for illustrating the method for the anglec of rotation of detected image transducer in the camera head of relevant one embodiment of the present invention.
Figure 11 is the flow chart of the algorithm handled of the rotation correction of the camera head of the relevant one embodiment of the present invention of expression.
Figure 12 A is the figure of the subject of expression lattice-shaped.
Figure 12 B is the figure of an example that is illustrated in the camera head of relevant one embodiment of the present invention the shot object image of the lattice-shaped by the shooting of the 1st image pickup optical system.
Figure 12 C is the figure of an example that is illustrated in the camera head of relevant one embodiment of the present invention the shot object image of the lattice-shaped by the shooting of the 2nd image pickup optical system.
Figure 12 D is the figure of an example that is illustrated in the camera head of relevant one embodiment of the present invention the shot object image of the lattice-shaped by the shooting of the 3rd image pickup optical system.
Figure 13 is the figure that is used for illustrating the method for the amount of distortion that detects image pickup optical system in the camera head of relevant one embodiment of the present invention.
Figure 14 is the flow chart of the algorithm handled of the distortion correction of the camera head of the relevant one embodiment of the present invention of expression.
Figure 15 is a block diagram of representing the schematic configuration of compound eye imaging device in the past.
Figure 16 A is the figure of the composograph under the situation of the compound eye imaging device of expression by Figure 15 subject of taking the white circular that is in position a.
Figure 16 B is the figure of the composograph under the situation of the compound eye imaging device of expression by Figure 15 subject of taking the white circular that is in position b.
Figure 16 C is the figure of the composograph under the situation of the compound eye imaging device of expression by Figure 15 subject of taking the white circular that is in position c.
Embodiment
In above-mentioned camera head of the present invention, preferably, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes the multiplying power unanimity of above-mentioned a plurality of images.
In the case, above-mentioned camera head is preferably, and also possesses the multiplying power recording of information portion of the above-mentioned a plurality of image pickup optical systems of record; Above-mentioned image synthesis unit utilizes the above-mentioned multiplying power information of above-mentioned a plurality of image pickup optical systems to make the multiplying power unanimity of above-mentioned a plurality of images.
Perhaps, above-mentioned camera head is preferably, and also possesses the recording portion of the focus information that has write down above-mentioned a plurality of image pickup optical systems; Above-mentioned image synthesis unit utilizes the above-mentioned focus information of above-mentioned a plurality of image pickup optical systems to make the multiplying power unanimity of above-mentioned a plurality of images.
In addition, in above-mentioned camera head of the present invention, preferably, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes the inclination unanimity of above-mentioned a plurality of images.
In the case, above-mentioned camera head is preferably, and also possesses the recording portion of the inclination information that has write down above-mentioned a plurality of camera watch regions; Above-mentioned image synthesis unit utilizes the above-mentioned inclination information of above-mentioned a plurality of camera watch regions to make the inclination unanimity of above-mentioned a plurality of images.
In addition, in above-mentioned camera head of the present invention, preferably, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes above-mentioned a plurality of distortion in images unanimities.
In the case, above-mentioned camera head is preferably, and also possesses the amount of distortion recording of information portion that has write down above-mentioned a plurality of image pickup optical systems; Above-mentioned image synthesis unit utilizes the above-mentioned amount of distortion information of above-mentioned a plurality of image pickup optical systems to make above-mentioned a plurality of distortion in images unanimity.
Below, with reference to the description of drawings embodiments of the present invention.
Fig. 1 is the block diagram of schematic configuration of the camera head of the relevant one embodiment of the present invention of expression, gives identical label for the part identical with Figure 15 of expression camera head in the past.
In Fig. 1, a plurality of image pickup optical systems 101,102,103 with its corresponding one to one a plurality of imageing sensors 104,105,106 on make the shot object image imaging respectively.The shooting of a plurality of imageing sensors 104,105,106 is subjected to light characteristic different mutually, and imageing sensor 104 is taken red (R) wavelength region may, and imageing sensor 105 is taken green (G) wavelength region may, and imageing sensor 106 is taken blue (B) wavelength region may.As making shooting be subjected to the light characteristic diverse ways, both can make imageing sensor possess the wavelength interdependence, also can wait and realize wavelength selectivity by the insertion filter.
A plurality of images that a plurality of imageing sensors 104,105,106 are taken respectively are after carrying out image processing by R signal processing circuit 107, G signal processing circuit 108 and B signal processing circuit 109 respectively, make deviation unanimity between a plurality of images except parallax by image pre processing circuit 111, then export as coloured image by the synthetic treatment circuit of image 110 is synthetic.
In the present embodiment, in order to make explanation become easy, to import by a plurality of imageing sensors 104,105,106 a plurality of picture signals that obtain and export the image synthesis unit 115 of synthesized image signal, the image pre processing circuit 111 that is divided into function with the deviation unanimity that makes between a plurality of images, with have synthetic after handling by image pre processing circuit 111 a plurality of images and the synthetic treatment circuit 110 of image of making the function of 1 image (composograph) describes, but in the camera head of reality, do not need difference image pre processing circuit 111 and the synthetic treatment circuit 110 of image clearly.
Fig. 2 is the flow chart of flow process of shooting of the camera head of expression present embodiment.
In step S10, begin shooting by pressing shooting button etc.
In step S20, carry out obtaining processing from the image that a plurality of imageing sensors 104,105,106 are taken into a plurality of images.This processing is undertaken by signal processing circuit 107,108,109.
In step S30, a plurality of images are implemented to carry out the deviation of 104,105,106 of a plurality of imageing sensors and the intensity correction processing that sensitivity is regulated.This processing is undertaken by signal processing circuit 107,108,109.
In step S40, it is the origin correction processing of main purpose that a plurality of images are carried out with the installation deviation of proofreading and correct a plurality of image pickup optical systems 101,102,103 and a plurality of imageing sensor 104,105,106.This processing is undertaken by signal processing circuit 107,108,109.
In step S50, a plurality of images are made the multiplying power treatment for correcting of the multiplying power unanimity of a plurality of images.This processing is undertaken by image pre processing circuit 111.
In step S60, a plurality of images are made the rotation correction of the inclination unanimity of a plurality of images handle.This processing is undertaken by image pre processing circuit 111.
In step S70, the distortion correction of a plurality of distortion in images unanimities is handled to a plurality of images.This processing is undertaken by image pre processing circuit 111.
In step S80, calculate parallax amount between a plurality of images, proofread and correct this parallax amount and synthetic a plurality of images and synthetic processing of parallax correction of making 1 image (composograph).This processing is undertaken by the synthetic treatment circuit 110 of image.
In step S90, carry out to handling to the image output of the device output composograph of the exportable image of CRT, TV, PC (personal computer), printer etc. with the display unit of the incorporate LCD of camera head etc. or via the wiring cable.
In the present embodiment, in the leading portion of the synthetic processing of parallax correction (step S80), make multiplying power, inclination and the distortion consistent (step S50, S60, S70) of a plurality of images.Thus, the synthetic processing of parallax correction become easily, can access high-precision thin composograph.
In addition, the flow chart that Fig. 2 is is purpose with final output composograph, but also can be according to distance between the optical axis of the focal length of the parallax amount that obtains by step S80, a plurality of image pickup optical system 101,102,103 and a plurality of image pickup optical systems 101,102,103 that in the parallax amount computing, use, utilize the principle of triangulation to calculate the distance of subject.Thereby, in the camera head of present embodiment, can obtain composograph and the range information that arrives subject simultaneously.Perhaps, also can not carry out the synthetic processing of a plurality of images and only obtain the range information of subject.In the case, by in step S50, S60, S70, making the processing of the deviation unanimity between a plurality of images, can improve the precision of range information.
Below, illustrate that successively above-mentioned multiplying power treatment for correcting (step S50), rotation correction are handled (step S60), distortion correction is handled (step S70).
(execution mode 1)
In execution mode 1, the multiplying power treatment for correcting (the step S50 of Fig. 2) of the multiplying power unanimity that makes a plurality of images is described.
At first utilize Fig. 3 that the reason that the deviation of multiplying power takes place between a plurality of images is described.Fig. 3 is the figure that represents the relation of lens 1, subject 2, shot object image 3 simply.4, the 5th, from representational the 1st light, the 2nd light of subject 2, z is an optical axis, and F is the front side focus, and F ' is the rear side focus, and H is the front side principal point, and H ' is the rear side principal point, and y is the height of subject 2, and y ' is the height of shot object image 3, and f ' is the focal length of rear side.Here, be β if establish multiplying power, then multiplying power β defines with following formula (1).
β＝y′/y ……(1)
If establishing from rear side focal point F ' to the distance of shot object image 3 is z ', then formula (1) is out of shape as following formula (2).
β＝-z′/f′ ……(2)
By formula (2) as can be known, if the focal distance f ' variation of lens 1, then the multiplying power β of shot object image 3 also changes.
Generally, in having the camera head of a plurality of optical systems, be difficult to make the focal length of each lens identical.Under the situation of each optical system corresponding to separately wavelength band, it is more difficult making focal length identical.Thus, in camera head in the past shown in Figure 15, the multiplying power of a plurality of images that obtain respectively via a plurality of image pickup optical systems 101,102,103 is different slightly.Thereby, carry out parallax correction come what may closely and synthesize, if the size of a plurality of images before synthetic is different slightly mutually, then can not reproduce radio-frequency component in the image after synthetic, be difficult to reproduce the image of having guaranteed sufficient resolution, quality.
Therefore, preferably before parallax correction and image are synthetic, make the multiplying power treatment for correcting (step 50 of Fig. 2) of the multiplying power unanimity of a plurality of images.
Below, make the processing of the multiplying power unanimity between a plurality of images that two examples are shown to image pre processing circuit 111.
In the 1st example, when the assembling of camera head, take the benchmark subject, recently measure the multiplying power of each image pickup optical system, this information is recorded in the interior recording portion 112 (with reference to Fig. 1) of image pre processing circuit 111 as initial value according to the size of subject and shot object image.When shooting, utilize this multiplying power information that a plurality of images are carried out multiplying power treatment for correcting (step 50 of Fig. 2).
As the 2nd example, when the assembling of camera head, measure the focal length of each image pickup optical system, obtain multiplying power, this information is recorded in the recording portion 112 (with reference to Fig. 1) in the image pre processing circuit 111 as initial value by this information is updated in the above-mentioned formula (2).When shooting, utilize this multiplying power information that a plurality of images are carried out multiplying power treatment for correcting (step 50 of Fig. 2).Perhaps, also can in recording portion 112, write down the focus information of each image pickup optical system in advance, when shooting, utilize focus information that a plurality of images are carried out multiplying power treatment for correcting (step 50 of Fig. 2).
Measure the example of method of the focal length of each image pickup optical system when being illustrated in the assembling of camera head exactly.Fig. 4 is the figure of expression measurement as the device of the focal length of the lens 11 of image pickup optical system.The 6th, collimator, the 7th, moving stage, the 8th, rotatable stage, the 9th, lens carrier, the 10th, directional light, the 11st, detected lens, the 12nd, video camera.Detected lens 11 are kept by moving stage 7 and rotatable stage 8 via lens carrier 9.Moving stage 7 can make detected lens 11 move along optical axis direction, and it is that the center rotates in the face perpendicular to the paper that comprises optical axis with rotary middle spindle 8a that rotatable stage 8 can make detected lens 11.With respect to detected lens 11, dispose collimator 6 in a side, dispose video camera 12 at opposite side.The directional light 10 that is formed by collimator 6 incides in the video camera 12 by detected lens 11.
Shown in Fig. 5 A, under the principal point 11a of detected lens 11 situation consistent with the rotary middle spindle 8a of rotatable stage 8, even make detected lens 11 rotations by rotatable stage 8, the position of the picture of taking in video camera 12 does not change yet, and the distance from rotary middle spindle 8a (perhaps principal point 11a) to the shooting face 12a of video camera 12 becomes focal distance f.
But, shown in Fig. 5 B, under the inconsistent situation of rotary middle spindle 8a of the principal point 11a of detected lens 11 and rotatable stage 8, if make detected lens 11 rotations by rotatable stage 8, then the position of the picture of taking in video camera 12 can be offset (side-play amount S).In the case, Yi Bian detected lens 11 are tilted,, make principal point 11a consistent with rotary middle spindle 8a Yi Bian detected lens 11 are moved along the direction parallel with optical axis by moving stage 7.Thus, can measure the focal distance f of detected lens 11.
Measure the multiplying power of each image pickup optical system or focal length operation if at camera head or the initialization in-process when carrying its assembling of commodity carry out once just much of that.
Multiplying power treatment for correcting as the multiplying power of having used a plurality of image pickup optical systems or focus information, following dual mode is arranged, a kind of mode is to make up new image again by image pre processing circuit 111, with this picture signal and original picture signal replacement, and pass to the synthetic treatment circuit 110 of next stage image; Another kind of mode is that image pre processing circuit 111 is only managed multiplying power or focus information, to the synthetic treatment circuit 110 transitive graph image signals of next stage image and multiplying power or focus information; But, can both obtain same effect because dual mode is proofreaied and correct the multiplying power of image, so select which kind of mode all no problem.Below, be that the center describes in the former mode.
One example of the multiplying power treatment for correcting (step 50 of Fig. 2) of carrying out when utilizing Fig. 6 that each the photography is described.
In step S51, to arrive via a plurality of images (output of photodiode (following note is made PD)) placeholder record of a plurality of image pickup optical system shootings in the two-dimensional space information recording part (not shown) in the image pre processing circuit 111, to the pixel that constitutes each image additional with the initial point of handling extraction by the origin correction of step S40 (with reference to Fig. 2) be initial point coordinate (x, y).
In step S52, will (x, y) coordinate system transformation be for being (r, θ) polar coordinate system at center with the initial point.This conversion can easily be carried out by the coordinate transformation method that utilizes following formula (3) and formula (4).
r＝(x
2+y
2)
1/2 ……(3)
θ＝cos
-1(x/(x
2+y
2)
1/2) ……(4)
In step S53, carry out multiplying power and proofread and correct.Here, each multiplying power to image pickup optical system 101,102,103 is that known situation describes.According to the multiplying power β i (i=1,2,3) that is recorded in the image pickup optical system 101,102,103 in the recording portion 112, (r θ) is transformed to (R, θ ') with coordinate to utilize following formula (5) and formula (6).
R＝r/βi ……(5)
θ′＝θ ……(6)
Here, as the multiplying power β i (i=1,2,3) of image pickup optical system 101,102,103, also can use corresponding to the multiplying power in a plurality of images as the image of benchmark.For example, be β 1 if establish corresponding to multiplying power as the image pickup optical system of the image of benchmark, then in above-mentioned formula (5), also can be made as β 1=β 1/ β 1, β 2=β 2/ β 1, β 3=β 3/ β 1.But, under the situation of β 2/1＞1 or β 3/ β 1＞1, by formula (5), R＜r, it is littler than the size of images of extracting from imageing sensor before the multiplying power correction that image after multiplying power is proofreaied and correct becomes, the data of the periphery of the image after multiplying power is proofreaied and correct can lack, and can significant resolution deteriorates take place at periphery in composograph.Thereby, need to select corresponding to multiplying power (β 1), so that β 2/ β 1≤1, β 3/ β 1≤1 as the image pickup optical system of the image of benchmark.
By above-mentioned formula (5) and formula (6) are carried out all pixels of composing images, can access the image of having proofreaied and correct multiplying power.
Then, in step S54, (R, θ ') is transformed to (X, Y) coordinate system with polar coordinate system.This conversion can be undertaken by utilizing following formula (7) and formula (8).
X＝Rcos?θ′ ……(7)
Y＝Rsin?θ′ ……(8)
In step S55, carry out the interpolation of data and handle.The major part of the view data after the coordinate transform among the step S54 is the data of the position (pixel and pixel between) different with the location of pixels of grid point-like.So the view data of periphery that need be by utilizing pixel is carried out interpolation and is handled, and makes the view data at locations of pixels place.
Utilize Fig. 7 that the example that interpolation is handled is described.Suppose to have obtained 4 data V that locate of the periphery of pixel P by the coordinate transform among the step S54
(i, j), V
(i+1, j), V
(i, j+1), V
(i+1, j+1)Can utilize corresponding to having data V
(i, j)Positional information px, the py (0≤px≤1,0≤py≤1) of pixel P of point, obtain the view data at pixel P place by following formula (9).
px·py(V
(i，j)-V
(i+1，j)-V
(i，j+1)+V
(i+1，j+1))+px(V
(i+1，j)-V
(i，j))+py(V
(i，j+1)-V
(i，j))+V
(i，j) ……(9)
In addition, above-mentioned is the example that interpolation is handled, and the present invention is not limited to this, also can carry out handling with above-mentioned different interpolation, also can access same effect in the case.
By more than, finish multiplying power treatment for correcting (the step S50 of Fig. 2).
In above-mentioned multiplying power treatment for correcting, use the camera head of actual assembled directly to measure the multiplying power separately or the focal length of a plurality of image pickup optical systems, utilize this information to make the multiplying power unanimity of a plurality of images, but the present invention is not limited to this.For example, the multiplying power of each image pickup optical system or focal length are considered as with its design load situation about equally under, also can utilize its design load to carry out the multiplying power treatment for correcting, also can access in the case and above-mentioned same effect.
(execution mode 2)
In execution mode 2, illustrate that the rotation correction of the inclination unanimity that makes a plurality of images is handled (the step S60 of Fig. 2).
At first, utilize Fig. 8 that the reason of the deviation of run-off the straight between a plurality of images (anglec of rotation) is described.Fig. 8 is the figure from the position relation of a plurality of imageing sensors 104,105,106 of object side observation camera head shown in Figure 1 and shot object image.Give identical label for the part identical with Fig. 1.Consider to take the situation of criss-cross subject.As shown in the figure, on each imageing sensor 104,105,106, be formed with criss-cross shot object image 120.Here, as an example, suppose that imageing sensor 105 is with respect to the only angle of inclination φ setting of other imageing sensors 104,106.This is the deviation of hypothesis when being installed to imageing sensor 104,105,106 on the same substrate.
To be expression be presented at result on the other display unit (for example display) with the image of the subject of imageing sensor 104,105,106 shooting via R signal processing circuit 107, G signal processing circuit 108, B signal processing circuit 109 to Fig. 9.Picture shows 104 ', 105 ', 106 ' successively corresponding to imageing sensor 104,105,106.According to Fig. 9 as can be known, the image 120 of the subject of imageing sensor 105 shooting ' with the image 120 of the subject of other imageing sensors 104,106 shootings ' compare, only rotated φ.Even these 3 images are only carried out parallax correction (promptly, make the only parallel correction of moving the parallax amount of a plurality of image pickup optical systems 101,102,103 of image) and overlap, can not with the image 120 ' coincidence of imageing sensor 105 the image 120 of other imageing sensor 104,106 ' on.
So, preferably before parallax correction and image are synthetic, make the rotation correction of the inclination unanimity of a plurality of images handle (the step S60 of Fig. 2).
Below, presentation video pre processing circuit 111 is handled the rotation correction of the deviation unanimity of the inclination between a plurality of images.
At first, when the assembling of camera head, the adjusting that poor contrast is very big is made a video recording as subject with image.It for example is the cross hairs of the black on the background of white.The live width of this cross hairs is considered the multiplying power of optical system and is preferably more than 2 times of pel spacing of imageing sensor 104,105,106.In addition, also need to make the intersection point of cross hairs consistent with the center of image pickup optical system 101,102,103.
Installation diagram image-position sensor 104,105,106 and image pickup optical system 101,102,103 o'clock, the center of supposing the center of image pickup optical system 101,102,103 and imageing sensor 104,105,106 was by mechanical adjustment or software adjustment and aligned position.The deviation of the inclination (anglec of rotation) during separately the installation of imageing sensor 104,105,106 is shown as the image from each imageing sensor 104,105,106 output.
Utilize Figure 10 A and Figure 10 B explanation to use the example of cross hairs as the anglec of rotation detection method of the output image under the situation of subject.Shown in Figure 10 A, cross hairs 131 is at horizontal pixel count H, longitudinally on the display unit 130 of pixel count V, is that the center only rotates rotationangle and shows with point of origin P c.In this image, be benchmark with the pixel A that has moved from point of origin P c along continuous straight runs after the H/2 pixel, while make object pixel from moving in the vertical direction the output valve that detects from each pixel here.To in Figure 10 B, represent from the summary of the testing result of the output valve of pixel.In Figure 10 B, transverse axis is to be the pixel count of the vertical direction of benchmark with the pixel A, and the longitudinal axis is the output valve (pixel output) from pixel.As shown in the figure, if pixel B (from pixel A n pixel vertically), detect the variation of bigger output valve, then obtain horizontal rotationangle with respect to the cross hairs of the horizontal direction of this imageing sensor by following formula (10).
φ＝tan
-1(2n/H) ……(10)
Formula (10) is the identical situation of each pel spacing of horizontal direction and vertical direction, under both different situations, need multiply by its ratio.
All imageing sensors 104,105,106 are carried out this measurement, the inclination information of each imageing sensor as initial value (φ 1, φ 2, φ 3), is recorded in the recording portion 112 (with reference to Fig. 1) in the image pre processing circuit 111.When shooting, utilize this inclination information that a plurality of images are rotated treatment for correcting (the step S60 of Fig. 2).
Measure each imageing sensor inclination operation if at camera head or the initialization in-process when carrying its assembling of commodity carry out once just much of that.
Rotation correction as the inclination information of using a plurality of imageing sensors is handled, following dual mode is arranged: a kind of mode is to make up new image again by image pre processing circuit 111, with this picture signal and original picture signal replacement, pass to the synthetic treatment circuit 110 of next stage image; Another kind of mode is that image pre processing circuit 111 is only managed inclination information, and picture signal and inclination information are passed to the synthetic treatment circuit 110 of next stage image; But, because dual mode can both obtain same effect about the slant correction of image, so select which kind of mode all no problem.Below, be that the center describes in the former mode.
The rotation correction that utilizes Figure 11 to illustrate that each photography is carried out is handled an example of (the step S60 of Fig. 2).
In step S61, be temporarily recorded in the two-dimensional space information recording part (not shown) in the image pre processing circuit 111 via a plurality of images (output of PD) of a plurality of image pickup optical systems shooting, additional to the pixel that constitutes each image with origin correction processing by step S40 (with reference to Fig. 2)) initial point that extracts be initial point coordinate (x, y).
In step S62, will (x, y) coordinate system transformation be for being (r, θ) polar coordinate system at center with the initial point.This conversion can easily be carried out by the coordinate transformation method that utilizes following formula (3) and formula (4).
r＝(x
2+y
2)
1/2 ……(3)
θ＝cos
-1(x/(x
2+y
2)
1/2) ……(4)
In step S63, be rotated correction.According to the inclination angle phi i (i=1,2,3) that is recorded in the imageing sensor 104,105,106 in the recording portion 112, (r θ) is transformed to (R, θ ') with coordinate to utilize following formula (11) and formula (12).
R＝r ……(11)
θ′＝θ-φi ……(12)
All pixels of composing images are utilized the coordinate transform of above-mentioned formula (11) and formula (12), can access the image that has carried out rotation correction thus.
Then, in step S64, (R, θ ') is transformed to (X, Y) coordinate system with polar coordinate system.This conversion can be undertaken by utilizing following formula (7) and formula (8).
X＝Rcos?θ′ ……(7)
Y＝Rsin?θ′ ……(8)
Carrying out the interpolation of data in step S65 handles.The major part of the view data after the coordinate transform among the step S64 is the data that the position (pixel and pixel between) different with the location of pixels of grid point-like located.So the view data of periphery that need be by utilizing pixel is carried out interpolation and is handled, and makes the view data at locations of pixels place.
Utilize Fig. 7 that the example that interpolation is handled is described.Suppose to have obtained 4 data V that locate of the periphery of pixel P by the coordinate transform among the step S64
(i, j), V
(i+1, j), V
(i, j+1), V
(i+1, j+1)Can utilize corresponding to having data V
(i, j)Positional information px, the py (0≤px≤1,0≤py≤1) of pixel P of point, obtain the view data at pixel P place by following formula (9).
px·py(V
(i，j)-V
(i+1，j)-V
(i，j+1)+V
(i+1，j+1))+px(V
(i+1，j)-V
(i，j))+py(V
(i，j+1)-V
(i，j))+V
(i，j) ……(9)
In addition, above-mentioned is the example that interpolation is handled, and the present invention is not limited to this, also can carry out handling with above-mentioned different interpolation, also can access same effect in the case.
By more than, rotation correction is handled (the step S60 of Fig. 2) and is finished.
In above-mentioned rotation correction is handled, use the camera head of actual assembled to detect the anglec of rotation of a plurality of images of exporting respectively from a plurality of imageing sensors, utilize this information to make the inclination unanimity of a plurality of images, but the present invention is not limited to this.For example, also can when assembling, survey the anglec of rotation of a plurality of imageing sensors respectively, utilize this measured value to be rotated treatment for correcting, also can access in the case and above-mentioned same effect.
(execution mode 3)
In execution mode 3, the distortion correction processing (the step S70 of Fig. 2) that makes a plurality of distortion in images unanimities is described.
There is so existing picture in common optical lens, that is, at the periphery of camera watch region, the subject of linearity is deformed into curve and imaging (it is called distortion).Utilize Figure 12 A～Figure 12 D that the example of distortion of the image pickup optical system of camera head of the present invention is described.
Figure 12 A represents the subject of lattice-shaped.Figure 12 B is the image of imageing sensor 104 via the subject of the lattice-shaped of image pickup optical system 101 shooting Figure 12 A, Figure 12 C is the image of imageing sensor 105 via the subject of the lattice-shaped of image pickup optical system 102 shooting Figure 12 A, and Figure 12 D is the image of imageing sensor 106 via the subject of the lattice-shaped of image pickup optical system 103 shooting Figure 12 A.With respect to the subject shown in Figure 12 A, all images of Figure 12 B～Figure 12 D all are deformed into tubbiness.And then the image of the image of Figure 12 B and Figure 12 D is roughly the same, but they have differently slightly with the picture shape of Figure 12 C, and the distortion in images of Figure 12 C is bigger than the image of Figure 12 B and Figure 12 D.
If 3 images that the degree that will distort like this is different are synthetic, the different situations of the degree that then distorts are big more, the remarkable more reduction of resolution of the image after synthesizing.Thereby the distortion between a plurality of images inhomogeneous also becomes bigger problem in having the camera head of a plurality of optical systems.
So, preferably before parallax correction and image are synthetic, make the distortion correction of a plurality of distortion in images unanimities handle (the step S70 of Fig. 2).
Below, the example that presentation video pre processing circuit 111 is handled the distortion correction of the deviation unanimity of the distortion between a plurality of images.
At first, when the assembling of camera head, measure the amount of distortion of each image pickup optical system, this information is recorded in the recording portion 112 (with reference to Fig. 1) of image pre processing circuit 111 as initial value.Also design load can be recorded in the recording portion 112 (with reference to Fig. 1) under the roughly the same situation of the amount of distortion of actual each image pickup optical system and design load thinking.
Measure the example of method of the amount of distortion of each image pickup optical system when being illustrated in the assembling of camera head.
The subject of the lattice-shaped that a plurality of straight lines by mutually orthogonal shown in Figure 12 A are constituted is made a video recording, and can measure the amount of distortion of image pickup optical system according to the image that obtains from each imageing sensor.For example, suppose that output image from imageing sensor is that the solid line 142 of Figure 13 is such.In Figure 13, consider the multiplying power of image pickup optical system and with dashed lines 141 represent the part of subject of the lattice-shaped of amplification (or dwindling) together.Some P on the subject 141
1Corresponding to the some P on the output image 142
2Point P
0The position of expression optical axis.From optical axis P
0Some P on the subject 141
1Distance, by the distortion aberration of image pickup optical system, be changed to from optical axis P0 to output image the point P on 142
2Distance y
0The amount of distortion D of image pickup optical system in the case can obtain with following formula (13).
D(y)＝(y
0-y)/y ……(13)
All image pickup optical systems 101,102,103 are carried out this measurement, the amount of distortion information of each image pickup optical system 101,102,103 is recorded in the recording portion 112 (with reference to Fig. 1) in the image pre processing circuit 111 as initial value (D1 (y), D2 (y), D3 (y)).When shooting, utilize this amount of distortion information that a plurality of images are carried out distortion correction and handle (the step S70 of Fig. 2).
Measure the operation of the amount of distortion of each image pickup optical system, if at camera head or the initialization in-process when carrying its assembling of commodity carry out once just much of that.
Distortion correction as the amount of distortion information of utilizing a plurality of image pickup optical systems is handled, following dual mode is arranged: a kind of mode is to make up new image again by image pre processing circuit 111, with this picture signal and original picture signal replacement, and pass to the synthetic treatment circuit 110 of next stage image; Another kind of mode is that image pre processing circuit 111 is only managed amount of distortion information; Picture signal and amount of distortion information are passed to the synthetic treatment circuit 110 of next stage image; But, can both obtain same effect because dual mode is proofreaied and correct about distortion in images, so select which kind of mode all no problem.Below, be that the center describes in the former mode.
The distortion correction that utilizes Figure 14 to illustrate that each photography is carried out is handled an example of (the step S70 of Fig. 2).
In step S71, via a plurality of images (output of PD) of a plurality of image pickup optical systems shooting by in the two-dimensional space information recording part (not shown) of placeholder record in the image pre processing circuit 111, handle with origin correction the pixel that constitutes each image is additional by step S40 (with reference to Fig. 2)) extract the coordinate that same initial point is an initial point (x, y).
In step S72, will (x, y) coordinate system transformation be for being (r, θ) polar coordinate system at center with the initial point.This conversion can easily be carried out by the coordinate transformation method that utilizes following formula (3) and formula (4).
r＝(x
2+y
2)
1/2 ……(3)
θ＝cos
-1(x/(x
2+y
2)
1/2) ……(4)
In step S73, carry out distortion correction.According to the amount of distortion Di (r) (i=1,2,3) that is recorded in the image pickup optical system in the recording portion 112, (r θ) is transformed to (R, θ ') with coordinate to utilize following formula (14) and formula (6).
R＝(Di(r)+1)·r ……(14)
θ′＝θ ……(6)
All pixels of composing images are utilized the coordinate transform of above-mentioned formula (14) and formula (6), can access the image behind the distortion correction.
Then, in step S74, (R, θ ') is transformed to (X, Y) coordinate system with polar coordinate system.This conversion can be undertaken by utilizing following formula (7) and formula (8).
X＝Rcos?θ′ ……(7)
Y＝Rsin?θ′ ……(8)
In step S75, carry out the interpolation of data and handle.The major part of the view data after the coordinate transform among the step S74 is the data that the position (pixel and pixel between) different with the location of pixels of grid point-like located.So the view data of periphery that need be by utilizing pixel is carried out interpolation and is handled, and makes the view data at locations of pixels place.
Utilize Fig. 7 that the example that interpolation is handled is described.Suppose to have obtained 4 data V that locate of the periphery of pixel P by the coordinate transform among the step S74
(i, j), V
(i+1, j), V
(i, j+1), V
(i+1, j+1)Can utilize corresponding to having data V
(i, j)Positional information px, the py (0≤px≤1,0≤py≤1) of pixel P of point, obtain the view data at pixel P place by following formula (9).
px·py(V
(i，j)-V
(i+1，j)-V
(i，j+1)+V
(i+1，j+1))+px(V
(i+1，j)-V
(i，j))+py(V
(i，j+1)-V
(i，j))+V
(i，j) ……(9)
In addition, above-mentioned is the example that interpolation is handled, and the present invention is not limited to this, also can carry out handling with above-mentioned different interpolation, also can access same effect in the case.
By more than, distortion correction is handled (the step S70 of Fig. 2) and is finished.
In above-mentioned distortion correction was handled, the camera head of use actual assembled directly detected the amount of distortion separately of a plurality of image pickup optical systems, utilize this information to make a plurality of distortion in images unanimities, but the present invention is not limited to this.For example, the amount of distortion of each image pickup optical system is regarded as with its design load situation unanimous on the whole under, also can utilize this design load to carry out distortion correction and handle, also can access in the case and above-mentioned same effect.
In above-mentioned distortion correction is handled, preferably make a plurality of distortion in images unanimities, so that the amount of distortion of a plurality of image pickup optical systems is consistent with very little benchmark distortion value.Here, the benchmark amount of distortion both can be the amount of distortion of the image pickup optical system of the amount of distortion minimum in a plurality of image pickup optical systems, also can be the amount of distortion littler than the amount of distortion of a plurality of image pickup optical systems.Thus, as additional effect, can access the composograph of having proofreaied and correct distortion fully.And then, owing to do not need image pickup optical system is obtained required distortion performance,, also can realize the slim image pickup optical system that did not in the past have so the design of image pickup optical system becomes easily.
And then, as mentioned above, only obtain in the synthetic processing of not carrying out a plurality of images under the situation of range information of subject, preferably utilize a plurality of images that do not carry out the distortion correction processing to obtain parallax amount, utilize amount of distortion to proofread and correct resulting parallax amount, according to the parallax amount computing after this correction and obtain the range information of subject.In the case, because if the amount of distortion in the specific pixel of only considering when obtaining parallax amount, to use, so can shorten operation time.With respect to this, a plurality of images are being carried out the distortion correction processing, obtain under the situation of parallax according to a plurality of images after this correction,, need long operation time owing in the distortion in images treatment for correcting, need all view data are used for the computing of distortion correction.But, to obtain under the situation of parallax amount not carrying out distortion correction to handle, the deviation of the amount of distortion between a plurality of image pickup optical systems is preferably ± below about 5%.If the deviation ratio of this amount of distortion ± 5% is big, then function can not be normally brought into play in the computing of obtaining parallax amount according to a plurality of images, and the possibility that can not obtain correct parallax amount increases.
When camera head of the present invention is made a video recording at every turn, in order to carry out multiplying power treatment for correcting (step S50) shown in Figure 2, rotation correction processing (step S60), distortion correction processing (step S70), preferably in the process of the manufacturing of camera head or assembling, carry out following operation: measure the multiplying power separately of a plurality of image pickup optical systems or focal length and it is recorded in operation (the multiplying power initial value is set operation) in the recording portion 112 as initial value; Measure the inclination separately of a plurality of imageing sensors and it is recorded in operation in the recording portion 112 (the inclination initial value is set operation) as initial value; And measure the distortion separately of a plurality of image pickup optical systems and it is recorded in operation in the recording portion 112 (the distortion initial value is set operation) as initial value.
Below, illustrate that these 3 initial values set the preferred enforcement order of operations.
Set in the operation at the inclination initial value, for example the criss-cross subject of explanation is used suitable subject like that in execution mode 2, then between a plurality of images of shooting, even multiplying power and distort inhomogeneously also can irrespectively be carried out inclination measurement exactly with them.Thereby the initial value that preferably tilts is at first set operation.
Set in the operation at the distortion initial value,, the image 142 and the subject 141 of making a video recording compared (with reference to Figure 13) as explanation in the execution mode 3.When this compares, need the multiplying power or the focus information of image pickup optical system.Thereby, preferably before the distortion initial value is set operation, carry out the multiplying power initial value and set operation.
Thus, preferably carry out according to the order that inclination initial value setting operation, multiplying power initial value are set operation, the initial value that distorts is set operation.
But by subject is designed, the order that also can make inclination initial value setting operation and multiplying power initial value setting operation is perhaps carried out them simultaneously with above-mentioned opposite.
Below the expression initial value that can tilt is simultaneously set an example of operation and the subject of multiplying power initial value setting operation.
This subject is made of the 1st mutually orthogonal straight line and the 2nd straight line.The 1st straight line is preferably with horizontal direction parallel, its length and is sufficiently long to the degree outside the visual field that extends to image pickup optical system.The 1st straight line is used for the inclination measurement (with reference to Figure 10 A) of imageing sensor.The 2nd straight line is preferably parallel with vertical direction.The length of the 2nd straight line is preferably the degree in the visual field that is included in image pickup optical system, particularly, preferably be set at and make the length that is imaged on its picture on the imageing sensor about about 8 one-tenth for the length on the limit (minor face) of the vertical direction of effective camera watch region of this imageing sensor.The live width of the 1st and the 2nd straight line preferably is set at, and making the live width that is imaged on its picture on the imageing sensor is more than 2 times of pel spacing of imageing sensor.The color of the 1st and the 2nd straight line is made black in order to enlarge markedly contrast, its background is preferably white.When measuring, need to regulate the relative position of subject and camera head, so that on the datum mark (initial point) that the intersection point of the 1st straight line and the 2nd straight line is imaged on the image that carries out camera head when synthesizing.Usually, initial point is provided in a side of the point of the subject imaging of infinity.
In the above-described embodiment, 3 camera head (camera head with 3 image pickup optical systems and 3 imageing sensors) has been described, but the present invention is not limited to this.For example, also can be the camera head more than 2 or 4, also can access in the case and above-mentioned same effect.
Particularly, in the camera head more than 4, can obtain two homochromy images by 2, and, can also obtain in order to obtain the image of required red, blue, green each color of color composite image.In the case, if relatively with two images (being preferably green image usually) of color, obtain the parallax amount between these images, then the calculation process of parallax amount becomes simpler.And then the precision of synthetic a plurality of images and computing improve significantly to the precision of the distance of subject.
In 3 camera head, in order to carry out the processing same with above-mentioned 4 camera head, the information processing that interpolation is extracted the image (for example Lv Se image) of other colors in the information of any (for example red or blue image) that need be from the image of obtained each red, blue, green color.
In the above-described embodiment, the example that uses a plurality of imageing sensors one to one corresponding to a plurality of image pickup optical systems has been described, but camera head of the present invention is not limited to this.For example, also can use 1 imageing sensor shared, and this imageing sensor and a plurality of image pickup optical system are divided into a plurality of camera watch regions one to one accordingly a plurality of image pickup optical systems.
In the above-described embodiment, carry out once when each shooting has been described that multiplying power treatment for correcting (step S50) shown in Figure 2, rotation correction are handled (step S60), distortion correction is handled (step S70), but the order of these 3 treatment for correcting is not limited to this.In addition, also can omit in these 3 treatment for correcting 1 or two.For example, under the situation of using 1 imageing sensor shared as described above, also can omit rotation correction and handle (step S60) a plurality of image pickup optical systems.
More than Shuo Ming execution mode is all only in order to make technology contents of the present invention become clear, the present invention can not only be defined in such concrete example and make an explanation, in purport of the present invention be recorded in and carry out various changes in the scope in claims and implement, should broadly explain the present invention.
Industrial applicibility
Relevant camera head of the present invention utilize the field without limits, still, even optical axis side To size littler, also can take high-quality image, so use as portable equipment for example Camera module etc. practicality is arranged.
Claims (8)
1, a kind of camera head is characterized in that, possesses:
A plurality of image pickup optical systems;
A plurality of camera watch regions, corresponding one to one with above-mentioned a plurality of image pickup optical systems, take a plurality of images respectively via above-mentioned a plurality of image pickup optical systems;
The image synthesis unit has function that makes the deviation unanimity between above-mentioned a plurality of image and the function of being synthesized 1 image by above-mentioned a plurality of images.
2, camera head as claimed in claim 1 is characterized in that, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes the multiplying power unanimity of above-mentioned a plurality of images.
3, camera head as claimed in claim 2 is characterized in that,
Also possesses the multiplying power recording of information portion that has write down above-mentioned a plurality of image pickup optical systems;
Above-mentioned image synthesis unit utilizes the above-mentioned multiplying power information of above-mentioned a plurality of image pickup optical systems to make the multiplying power unanimity of above-mentioned a plurality of images.
4, camera head as claimed in claim 2 is characterized in that,
The recording portion that also possesses the focus information that has write down above-mentioned a plurality of image pickup optical systems;
Above-mentioned image synthesis unit utilizes the above-mentioned focus information of above-mentioned a plurality of image pickup optical systems to make the multiplying power unanimity of above-mentioned a plurality of images.
5, image processing apparatus as claimed in claim 1 is characterized in that, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes the inclination unanimity of above-mentioned a plurality of images.
6, camera head as claimed in claim 5 is characterized in that,
The recording portion that also possesses the inclination information that has write down above-mentioned a plurality of camera watch regions;
Above-mentioned image synthesis unit utilizes the above-mentioned inclination information of above-mentioned a plurality of camera watch regions to make the inclination unanimity of above-mentioned a plurality of images.
7, image processing apparatus as claimed in claim 1 is characterized in that, the function that makes the deviation unanimity between above-mentioned a plurality of image is the function that makes above-mentioned a plurality of distortion in images unanimities.
8, camera head as claimed in claim 7 is characterized in that,
Also possesses the amount of distortion recording of information portion that has write down above-mentioned a plurality of image pickup optical systems;
Above-mentioned image synthesis unit utilizes the above-mentioned amount of distortion information of above-mentioned a plurality of image pickup optical systems to make above-mentioned a plurality of distortion in images unanimity.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004363867 | 2004-12-16 | ||
| JP363867/2004 | 2004-12-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101080921A true CN101080921A (en) | 2007-11-28 |
Family
ID=36587825
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2005800432305A Pending CN101080921A (en) | 2004-12-16 | 2005-12-12 | Image pickup device |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US7742087B2 (en) |
| JP (1) | JPWO2006064770A1 (en) |
| CN (1) | CN101080921A (en) |
| WO (1) | WO2006064770A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102318331A (en) * | 2010-03-31 | 2012-01-11 | 富士胶片株式会社 | Stereoscopic image pick-up apparatus |
| CN102783162A (en) * | 2010-03-03 | 2012-11-14 | 株式会社尼康 | Image capture device |
| US8502863B2 (en) | 2010-03-31 | 2013-08-06 | Fujifilm Corporation | Stereoscopic imaging apparatus |
| CN103258320A (en) * | 2012-02-13 | 2013-08-21 | 全视科技有限公司 | Method and system for combining images |
| CN106803872A (en) * | 2017-03-02 | 2017-06-06 | 苏州苏大维格光电科技股份有限公司 | Camera lens and mobile phone |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7742624B2 (en) * | 2006-04-25 | 2010-06-22 | Motorola, Inc. | Perspective improvement for image and video applications |
| US8300108B2 (en) | 2009-02-02 | 2012-10-30 | L-3 Communications Cincinnati Electronics Corporation | Multi-channel imaging devices comprising unit cells |
| GB0906461D0 (en) * | 2009-04-15 | 2009-05-20 | Siemens Medical Solutions | Partial volume correction via smoothing at viewer |
| CN102118551A (en) * | 2009-12-31 | 2011-07-06 | 鸿富锦精密工业（深圳）有限公司 | Imaging device |
| JP2011209269A (en) * | 2010-03-08 | 2011-10-20 | Ricoh Co Ltd | Image pickup apparatus and range obtaining system |
| JP5639024B2 (en) * | 2011-09-27 | 2014-12-10 | 富士重工業株式会社 | Image processing device |
| JP5950678B2 (en) * | 2012-04-27 | 2016-07-13 | キヤノン株式会社 | Imaging apparatus, control method, and program |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07303207A (en) * | 1994-05-09 | 1995-11-14 | Canon Inc | Image pickup device |
| JPH08116490A (en) * | 1994-10-14 | 1996-05-07 | Olympus Optical Co Ltd | Image processing unit |
| JP3792832B2 (en) * | 1997-05-07 | 2006-07-05 | 富士重工業株式会社 | Stereo camera adjustment device |
| JP3284190B2 (en) | 1998-05-14 | 2002-05-20 | 富士重工業株式会社 | Image correction device for stereo camera |
| JP3397758B2 (en) | 1999-06-30 | 2003-04-21 | キヤノン株式会社 | Imaging device |
| US6882368B1 (en) | 1999-06-30 | 2005-04-19 | Canon Kabushiki Kaisha | Image pickup apparatus |
| JP2001223931A (en) * | 2000-02-10 | 2001-08-17 | Olympus Optical Co Ltd | Image pickup device and image system |
| JP2002158929A (en) * | 2000-11-16 | 2002-05-31 | Canon Inc | Solid state image pickup element, device thereof, and image pickup system |
| US6952228B2 (en) | 2000-10-13 | 2005-10-04 | Canon Kabushiki Kaisha | Image pickup apparatus |
| US7262799B2 (en) | 2000-10-25 | 2007-08-28 | Canon Kabushiki Kaisha | Image sensing apparatus and its control method, control program, and storage medium |
| JP3703424B2 (en) * | 2000-10-25 | 2005-10-05 | キヤノン株式会社 | IMAGING DEVICE, ITS CONTROL METHOD, CONTROL PROGRAM, AND STORAGE MEDIUM |
| JP2002171537A (en) * | 2000-11-30 | 2002-06-14 | Canon Inc | Compound image pickup system, image pickup device and electronic device |
| JP2002330332A (en) * | 2001-04-27 | 2002-11-15 | Canon Inc | Image processing unit, image pickup device, its control method, and recording medium |
| JP2003283907A (en) * | 2002-03-20 | 2003-10-03 | Japan Science & Technology Corp | Imaging device |
-
2005
- 2005-12-12 WO PCT/JP2005/022792 patent/WO2006064770A1/en not_active Application Discontinuation
- 2005-12-12 US US11/720,684 patent/US7742087B2/en active Active
- 2005-12-12 CN CNA2005800432305A patent/CN101080921A/en active Pending
- 2005-12-12 JP JP2006548830A patent/JPWO2006064770A1/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102783162A (en) * | 2010-03-03 | 2012-11-14 | 株式会社尼康 | Image capture device |
| CN102318331A (en) * | 2010-03-31 | 2012-01-11 | 富士胶片株式会社 | Stereoscopic image pick-up apparatus |
| US8363091B2 (en) | 2010-03-31 | 2013-01-29 | Fujifilm Corporation | Stereoscopic image pick-up apparatus |
| US8502863B2 (en) | 2010-03-31 | 2013-08-06 | Fujifilm Corporation | Stereoscopic imaging apparatus |
| CN102318331B (en) * | 2010-03-31 | 2014-07-30 | 富士胶片株式会社 | Stereoscopic image pick-up apparatus |
| CN103258320A (en) * | 2012-02-13 | 2013-08-21 | 全视科技有限公司 | Method and system for combining images |
| CN103258320B (en) * | 2012-02-13 | 2016-12-28 | 豪威科技股份有限公司 | Method and system for combination image |
| CN106803872A (en) * | 2017-03-02 | 2017-06-06 | 苏州苏大维格光电科技股份有限公司 | Camera lens and mobile phone |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2006064770A1 (en) | 2006-06-22 |
| US7742087B2 (en) | 2010-06-22 |
| US20080211956A1 (en) | 2008-09-04 |
| JPWO2006064770A1 (en) | 2008-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100344147C (en) | Apparatus for forming images onto record paper | |
| CN1284073C (en) | Information display system and its information processing apparauts, indicator and mark displaying method | |
| CN1217533C (en) | Signal processing equipment and method and image sensing equipment | |
| CN1226864C (en) | Image sensing equipment, mask correction method, program and storage medium | |
| CN1577051A (en) | Image processing system, projector,and image processing method | |
| CN1823523A (en) | Projector apparatus, inclination angle obtaining method, and projection image correction method | |
| CN101076085A (en) | Method and apparatus for image capturing and electronic apparatus using the same | |
| CN1897649A (en) | Image processing device and method, recording medium, and program | |
| CN101080921A (en) | Image pickup device | |
| CN1717006A (en) | Be used for improving the equipment and the method for picture quality at imageing sensor | |
| CN1822660A (en) | Image processing system, projector, and image processing method | |
| US20100134660A1 (en) | Signal processing apparatus, image sensing apparatus, image sensing system, and signal processing method | |
| CN1892756A (en) | Projection image position adjustment method | |
| CN101047799A (en) | Image device camera system and its drive method | |
| CN1822661A (en) | Image processing system, projector, and image processing method | |
| CN1512434A (en) | 2-D code reading method and reading device, digital camera and its portable terminal | |
| CN1510913A (en) | Image processing system projector, portable device and image processing method | |
| CN101067762A (en) | Information processing apparatus, control method thereof, and image processing apparatus | |
| CN1543207A (en) | Image processing system, projector, and image processing method | |
| CN1487374A (en) | Image forming apparatus | |
| CN1748413A (en) | Projector and projection image correction method thereof | |
| CN1744675A (en) | Image input device | |
| CN1833156A (en) | Inclination angle detection device and inclination angle detection method | |
| CN1867047A (en) | Image processing apparatus and method and program | |
| CN1777222A (en) | Member mounting structure and member mounting apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |