JP2001016611A - Parallax image pickup device and camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a parallax image pickup device and a camera that can detect a parallax amount with high accuracy so as to obtain accurate depth information of an object. SOLUTION: The parallax image pickup device and the camera are provided with an optical image forming section 2 with a single optical axis forming an image of an object, a light receiving section where a plurality of light receiving elements are placed and on which the image of the object is formed through the optical image forming section 12, a light passing section 14 with 1st and 2nd openings to pass the light through the optical image forming section 12, and an optical separation section that allows different light receiving elements to simultaneously pick up a 1st image passing through the 1st opening and a 2nd image passing through the 2nd opening. Then the parallax image pickup device and the camera simultaneously pick up a plurality of parallax images obtained when viewing an object from different points.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a parallax image pickup device and a camera for picking up a parallax image obtained when a subject is viewed from a different point. In particular, the present invention relates to a parallax image capturing device and a camera that capture a plurality of parallax images simultaneously.

[0002]

2. Description of the Related Art In the field of image processing and image recognition, as a technique for extracting information in the depth direction of an object, a plurality of parallax images obtained when the object is viewed from different points are used. In general, a method of detecting the amount of parallax and calculating the depth of the target object from the amount of parallax has been adopted.

Conventionally, there has been a parallax image capturing device shown in FIG. 1 as a device for capturing a plurality of parallax images. The conventional parallax image capturing apparatus has a light passing unit 5 having an opening through which light on the pupil plane of the optical lens 4 passes, and moves the opening in a direction parallel to the optical lens to convert an image passing through the opening. A plurality of parallax images are sequentially captured by causing the light receiving unit to capture images (Japanese Patent Laid-Open No. 10-42314).

In FIG. 1, when the opening is located at a position 6a, an in-focus image 3c of the object 3 is formed at a position distant from the light receiving section 7, and the defocused image 3a is formed at the light receiving section 7. It is imaged. When the opening moves to the position 6b, the focused image 3c of the object 3 is formed at the same position, but the light-receiving unit 7 captures the out-of-focus image 3b at a position different from the image 3a. You. Image 3a to image 3b captured by light receiving unit 7
Is called a parallax amount. If the parallax amount is measured, the distance from the position 6a to 6b of the opening and the focal length of the optical lens 4 are known, so that the distance from the optical lens 4 to the object 3 can be calculated by the lens formula. it can.
When the amount of parallax is detected for all regions of the subject and the distance from the optical lens 4 to the region is calculated, the distance distribution of the subject is obtained.

[0005] As another parallax image capturing method, a plurality of openings are provided in the light passing section 5, one of the openings is opened at a predetermined time interval, and the remaining openings are closed. Can be sequentially imaged (Japanese Patent Laid-Open No. 10-27153).
No. 4).

[0006]

In order to obtain the depth of a subject, it is necessary to compare parallax images and detect the amount of parallax. However, when a plurality of parallax images are captured by the above method, after capturing the first parallax image,
There is a time difference before the second parallax image is captured. If the camera is held in hand, an error due to camera shake may occur during this time difference. The subject may move during this time difference. Therefore, it is inevitable that an error occurs in a plurality of captured parallax images, and a problem arises in that accurate depth information of a subject cannot be obtained.

Accordingly, an object of the present invention is to provide a parallax image pickup apparatus and a camera capable of detecting a parallax amount with high accuracy and obtaining an accurate depth of a subject in order to solve the above-mentioned problems. . This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous embodiments of the present invention.

[0008]

That is, a parallax image capturing apparatus according to a first embodiment of the present invention is a parallax image capturing apparatus that captures a plurality of parallax images obtained when a subject is viewed from different points. A single optical axis image forming unit for forming an image of a subject, a plurality of light receiving elements are arranged, a light receiving unit on which the subject is formed by the image forming unit, and first and second image forming units. A first method of irradiating the light receiving unit with light having passed through the region;
And a light-passing portion having a second opening, and a first image passing through the first opening and a second image passing through the second opening are simultaneously captured by different light-receiving elements of a light-receiving portion. And an optical separation unit.

[0009] The first and second openings of the light passing portion may include first and second opening optical filters that transmit different light components, respectively.

[0010] The first light-receiving section optical filter, in which the optical separation section transmits the light component transmitted through the first opening optical filter again, and the second, which transmits the light component transmitted through the second opening optical filter again. Two light receiving unit optical filters may be provided, and the first light receiving unit optical filter and the second light receiving unit optical filter may be alternately arranged.

The first and second aperture optical filters of the light passage portion may be aperture specific wavelength component transmission filters that transmit specific wavelength components of different lights.

[0012] The optical separation section is provided with first and second light transmission sections.
The first and second light-receiving unit specific wavelength component transmission filters each transmit the same wavelength component as the aperture-specific wavelength component transmission filter, and the first and second light-receiving unit specific wavelength component transmission filters alternate. And may cover the light receiving unit.

The first light-receiving unit specific wavelength component transmission filter has a filter for transmitting specific RGB wavelength components λR1, λG1, and λB1, respectively, and the second light-receiving unit specific wavelength component transmission filter is for a specific RGB wavelength component. λR
2, a filter that transmits the wavelength component λR1 and a filter that transmits the wavelength component λR2 are adjacent to each other.
The filter that transmits the wavelength component λG2 and the filter that transmits the wavelength component λB1 may be adjacent to each other, and the filter that transmits the wavelength component λB2 may be adjacent to the filter.

[0014] The first and second aperture optical filters of the light passage portion may be aperture-specific polarization component transmission filters that transmit light having polarization planes in the horizontal and vertical directions, respectively.

The optical separation unit has a specific polarization component transmitting light receiving filter that transmits light having polarization planes in the horizontal and vertical directions, and the specific polarization transmitting light having polarization planes in the horizontal and vertical directions. The component transmitting light receiving unit filters may be alternately arranged to cover the light receiving unit.

The optical separation section has a polarization component separation section for separating light having horizontal and vertical polarization planes, and the light receiving section detects the horizontal polarization plane separated by the polarization component separation section. The light receiving device may have a first light receiving surface for receiving the light having the first light receiving surface and a second light receiving surface for receiving the light having a vertical polarization plane separated by the polarization component separating unit.

[0017] The light receiving section may further include an electrical separating section for separating the first and second images picked up.

The light receiving element may be a charge-coupled device, and the light receiving section may be a photoelectric conversion imaging body in which a plurality of the charge-coupled devices are arranged.

A camera according to a second embodiment of the present invention is a camera for acquiring information relating to a distance to a subject, wherein the camera has a first optical imaging unit having a single optical axis for forming an image of the subject.
A plurality of light receiving elements are arranged, and a first light receiving unit on which a subject is imaged by the first optical imaging unit, and a light passing through the first and second regions in the first optical imaging unit. A light-passing portion having first and second openings for irradiating the first light-receiving portion, and a light-receiving element different between a first image passing through the first opening and a second image passing through the second opening. And a distance calculation unit that calculates a distance from the first optical imaging unit to at least one point on the subject based on the first and second images. Features.

A second optical imaging section for forming an image of the subject, a second light receiving section on which the subject is formed by the second optical imaging section, and a second distance calculated by the distance calculation section. The image processing apparatus may further include a control unit that controls at least one of a focus and an aperture of the optical imaging unit and an exposure time of the second light receiving unit.

The focus, aperture, and second focus of the first optical imaging unit are determined by the second light receiving unit on which the subject is imaged by the first optical imaging unit and the distance calculated by the distance calculation unit.
And a control unit for controlling at least one of the exposure times of the light receiving unit.

The image forming apparatus may further include a driving unit that moves the light passing unit and the optical separating unit out of the optical path while the object is received by the light receiving unit.

The light passing portion is the third optical imaging portion.
And a third opening for irradiating the light receiving portion with light that has passed through the region, the optical separation portion opens the first and second openings in the light passing portion, and opens the third opening. In a closed state, the first image passing through the first opening and the second image passing through the second opening are simultaneously imaged by different light receiving elements, and the third opening in the light passing section is taken out. The light-receiving element may be caused to capture an image passing through the third opening in a state where the opening is opened and the first and second openings are closed.

The first, second and third openings of the light passage may have a liquid crystal light shutter.

The distance calculating section corresponds to a first pixel address of the captured first image and a first pixel address.
A second pixel address of the second image is calculated, and a first pixel address and a second pixel address are sequentially read to calculate a distance from the optical imaging unit to at least one point on the subject. You may.

The image processing apparatus may further include a recording unit for recording the image picked up by the second light receiving unit and the distance calculated by the distance calculation unit.

Note that the above summary of the present invention does not list all of the necessary features of the present invention, and sub-combinations of these features may also constitute the present invention.

[0028]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described through embodiments of the present invention. However, the following embodiments do not limit the invention according to the claims and are described in the embodiments. Not all combinations of the features described above are essential to the solution of the invention.

(Embodiment 1) FIG. 2 is a configuration diagram of a camera according to a first embodiment of the present invention. The camera according to the present embodiment includes a parallax image capturing unit 10 as an example of a parallax image capturing apparatus, a lens 52, an aperture 54, and a shutter 56.
, A color filter 58, and a CCD (charge coupled device)
60, a multiplexer 32, and an A / D converter 34
, A memory 36, a distance calculator 38, a controller 39,
A recording unit 40.

The parallax image capturing section 10 captures a parallax image of a subject and inputs an output signal to the multiplexer-32.
The lens 52 forms an image of the subject, the aperture 54 adjusts the aperture amount, and the shutter 56 adjusts the exposure time. The color filter 58 is for RGB of light received through the lens 52.
Break down components. The CCD 60 receives the image of the subject formed by the lens 52, converts the image into an electric signal, and outputs the electric signal to the multiplexer 32.

The multiplexer 32 outputs an output signal of the parallax image capturing unit 10 or the CCD 60 to the A / D converter 34. The A / D converter 34 converts the input analog signal into a digital signal and outputs the digital signal to the memory 36. The memory 36 stores the input digital signal. Memory 3
Reference numeral 6 stores an image of the subject captured by the lens 60 on the CCD 60 and a parallax image of the subject captured by the parallax image capturing unit 10.

The distance calculator 38 reads the parallax image from the memory 36 and calculates the distance from the camera to the subject based on the parallax image.

The control unit 39 controls the color information, brightness, saturation, and distance of the image of the subject read out from the memory 36.
At least one of the focus of the lens 52, the stop amount of the stop 54, and the exposure time of the shutter 56 is controlled based on the distance information output by the switch 8.

The recording section 40 records the subject image read from the memory 36 and the subject distance information output by the distance calculation section 38. The recording unit 40 may be a magnetic recording medium such as a floppy disk or a nonvolatile memory such as a flash memory.

Conventionally, a main subject is extracted based on a color distribution, a luminance distribution, a texture distribution, and the like of an image of the subject. However, a color distribution, a luminance distribution, and a texture distribution are extracted between the main subject and other subjects. If the distribution does not differ,
It was difficult to distinguish the main subject from the other subjects, and it was difficult to determine which subject should be adjusted for shooting conditions such as focus, aperture, and exposure time.

According to the camera of the present embodiment, it is possible to obtain the distance distribution of the subject imaged at each pixel of the object, so that the information can be obtained in addition to the information such as the color distribution, luminance distribution, and texture distribution of the image of the object. The main subject can be more reliably extracted based on the distance distribution information of the subject. For this reason, it is possible to appropriately adjust the photographing conditions such as the focus, the aperture amount, and the exposure time for the extracted main subject.

FIG. 3 is a configuration diagram of the parallax image pickup unit 10. The parallax image imaging unit 10 includes an optical imaging unit 12 that images light of a subject, and an imaging unit 1 that outputs light that has passed through the optical imaging unit 12.
The optical imaging unit 12 includes a light passing unit 14 having first and second openings 15a and 15b for irradiating the object 6 and an imaging unit 16 for imaging a subject formed by the optical imaging unit 12.

The light transmitting section 14 is placed on the pupil plane of the optical imaging section 12, passes light through the first and second openings 15a and 15b, and transmits light outside the first and second openings. Cut off. First and second openings 15a, 15 of light passage portion
b has first and second aperture specific wavelength component transmission filters 22a and 22b that transmit different light components, respectively, as an example of an aperture optical filter. The first aperture specific wavelength component transmission filter 22a transmits light having three wavelength components, a red wavelength component λR1, a green wavelength component λG1, and a blue wavelength component λB1. The second aperture specific wavelength component transmission filter 22b transmits light having three wavelength components, a red wavelength component λR2, a green wavelength component λG2, and a blue wavelength component λB2.

FIG. 4 is a configuration diagram of the image pickup unit 16. The imaging unit 16 includes a light receiving unit 20 in which a plurality of light receiving elements are arranged in a matrix, and a subject is imaged by the optical imaging unit.
And a light-receiving unit specific wavelength component transmission filter 18 as an example of a light-receiving unit optical filter that covers the surface of the light-receiving unit 20. The light receiving element of the light receiving unit 20 may be, for example, a photoelectric conversion element such as a CCD (charge coupled device), and the light receiving unit 20 may be a photoelectric conversion imaging body in which a plurality of CCDs are arranged.

In FIG. 4, the light-receiving portion specific wavelength component transmission filter 18 has the same wavelength component (red region wavelength component λR) as the first aperture portion specific wavelength component transmission filter 22a.
1. The wavelength component λG1 in the green region and the wavelength component λB in the blue region
The wavelength components (the wavelength component λR2 in the red region, the wavelength component in the green region) that are the same as those of the first light-receiving unit specific wavelength component transmission filter 18a that transmits the light having a second light-receiving unit specific wavelength component transmission filter 18b that transmits light having a wavelength component of λG2 and a blue region having λB2).

The first light receiving portion specific wavelength component transmission filter 18a has a filter that transmits the wavelength components λR1, λG1, and λB1, respectively. The second light-receiving unit specific wavelength component transmission filter 18b includes the wavelength components λR2, λG2
And λB2.

A filter that transmits the wavelength components λR1, λG1, and λB1, respectively, and a wavelength component λR2, λG2
The first and second light-receiving unit specific wavelength component transmission filters 18a and 18b are arranged such that the filters transmitting the wavelengths λB2 and λB2 are evenly distributed without bias.

For example, the first and second light-receiving unit specific wavelength component transmission filters 18a and 18b are arranged in a horizontal direction so as to cover the light-receiving unit 20 (perpendicular to the direction in which the openings 15a and 15b in FIG. In different directions). In this case, in the first light receiving unit specific wavelength component transmission filter 18a, the wavelength components λR1 and λ
Filters that respectively transmit G1 and λB1 are sequentially arranged. In the second light-receiving unit specific wavelength component transmission filter 18b, filters that respectively transmit the wavelength components λR2, λG2, and λB2 in the horizontal direction are sequentially arranged.

Further, a filter that transmits the wavelength component λR1 and a filter that transmits the wavelength component λR2 are adjacent in the vertical direction (the direction in which the openings 15a and 15b in FIG. 3 are arranged), and a filter that transmits the wavelength component λG1. A filter that transmits the wavelength component λG2 is vertically adjacent, and a filter that transmits the wavelength component λB1 and a filter that transmits the wavelength component λB1.
The filters that transmit B2 are arranged vertically adjacent to each other.

The operation of the arrangement of the light-receiving unit specific wavelength component transmission filters 18a and 18b in this way is shown in FIG.
It is explained together with.

The light component transmitted through the first opening portion specific wavelength component optical filter 22a passes through the light receiving portion specific wavelength component transmission filter 18a again, and is received at a position corresponding to the light receiving portion 20. The light component transmitted through the second opening portion specific wavelength component optical filter 22a passes through the light receiving portion specific wavelength component transmission filter 18b again, and is received at a corresponding position of the light receiving portion 20.

Therefore, the first image formed through the first opening and formed through the second opening is optically separated from the first image formed through the second opening. Different light receiving elements of the section 20 can be imaged simultaneously.

FIG. 5 is a configuration diagram of a processing section for a captured parallax image. In FIG. 5, the light receiving unit specific wavelength component transmission filter 18, the light receiving unit 20, the A / D conversion unit 34,
The memory 36 and the distance calculator 38 are shown.

The A / D converter 34 converts the output signal of the light receiving unit 20 into a digital signal and outputs the digital signal to the memory 36. Although the multiplexer is omitted in this figure, in an actual operation, the output signal of the light receiving unit 20 is sent to the A / D conversion unit via the multiplexer.

The memory 36 has parallax image storage units 37a and 37
b. The parallax image storage units 37a and 37b store a first image 20a and a second image 20b that have been transmitted through the light-receiving unit specific wavelength component transmission filter 18 and captured by the light-receiving unit 20, respectively.

The operation of the parallax image storage units 37a and 37b will be described with reference to FIGS.

Each pixel of the light receiving section 20 is provided with a first or second light receiving section specific wavelength component transmission filter 18a, 18 shown in FIG.
Which of the light beams b has been received can be known from the arrangement of the light receiving portion wavelength component transmission filters 18a and 18b.

Accordingly, the first image transmitted through the first opening and the second image transmitted through the second opening in FIG. Further electrically separated, the parallax image storage units 37a, 37b
Can be stored.

The parallax image storage units 37a and 37b convert the analog output of the light receiving element of the light receiving unit 20 into a digital signal by the A / D conversion unit 34, and then separate and store the first image and the second image. can do. As another implementation method, a circuit for separating the analog output of the light receiving element of the light receiving unit 20 is provided, and is separated into a first image and a second image at the stage of an analog signal. It may be converted into a signal and stored.

The distance calculation section 38 includes a parallax image storage section 37a,
The first image and the second image stored in 37b are read, the amount of parallax is detected, and distance distribution information of the subject is calculated.

In the above, the first and second images picked up by the light receiving section 20 are electrically separated and the parallax image storage section 37 is provided.
a and 37b have been described, but the first and second
May be stored in the memory 36 in a state where the image is not electrically separated. In that case, the distance calculation unit 38 reads the image stored in the memory 36 and determines which pixel is the first or second pixel.
It is possible to logically identify the first and second images, detect the amount of parallax, and calculate the distance distribution information of the subject by identifying whether the pixel is a pixel of the image from the storage position in the memory 36. .

A method in which the distance calculator 38 detects the amount of parallax from the first and second images and calculates distance distribution information of the subject will be described. The subject area captured in the first image and the second image has a certain parallax amount. If this parallax amount is detected, the openings 15a,
Since the distance between 5b and the focal length of the optical imaging unit 12 is known, the distance from the optical imaging unit 12 to the area of the subject can be calculated by the lens formula. In this way, when the parallax amount is detected for all regions of the subject and the distance from the optical imaging unit 12 to that region is calculated, the distance distribution of the subject is obtained.

As described above, the memory 36 stores the first and second
Are stored without separation, the pixels of the first image and the pixels of the second image are stored alternately. in this case,
The distance calculator 38 calculates the distance to the subject by reading necessary data from the memory 36 based on the pixel address of the first image and the pixel address of the second image corresponding to the pixel. be able to.

(Embodiment 2) FIG. 6 is a configuration diagram of a camera according to a second embodiment of the present invention. The camera according to the present embodiment includes an optical imaging unit 12, a light passing unit 14, and a light receiving unit 20.
A light receiving unit optical filter tray 44, a filter driving unit 42, an A / D conversion unit 34, a memory 36, a distance calculation unit 38, a control unit 39, and a recording unit 40.

In FIG. 6, the optical imaging unit 12, the light receiving unit 2
0, A / D converter 34, memory 36, distance calculator 38,
The control unit 39 and the recording unit 40 are the same as those in the first embodiment, and a description thereof will be omitted.

The light receiving unit optical filter tray 44 has a light receiving unit specific wavelength component transmission filter 18 and a normal color filter 19.

The first and second openings 15 of the light passage section 14
Reference numerals a and 15b respectively have aperture specific wavelength component transmission filters 22a and 22b.

The filter driving section 42 can move the light passing section 14 and the light receiving section optical filter tray 44 at the same time. When capturing a parallax image of a subject, the filter driving unit 42 controls the light passing unit 14 and the light receiving unit specific wavelength component transmission filter 18 from the optical imaging unit 12 to the light receiving unit 2.
Move in the optical path to zero. This allows the camera to capture a parallax image of the subject.

When capturing an image of a subject, the filter driving unit 42 moves the light passing unit 14 and the light receiving unit specific wavelength component transmission filter 18 out of the optical path from the optical image forming unit 12 to the light receiving unit 20, and performs the normal operation. The color filter 19 is moved into the optical path. Thereby, the camera can capture an image of the subject.

The process of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as in the first embodiment, and a description thereof will be omitted.

According to the present embodiment, unlike the first embodiment, the parallax image and the subject can be captured using the same optical imaging unit and the same light receiving unit. Therefore, by using the common optical imaging unit and the light receiving unit in imaging the subject and measuring the distance distribution of the subject, the size of the camera can be reduced, and the camera can be manufactured at low cost.

(Embodiment 3) FIG. 7 is a configuration diagram of a parallax image pickup section 10 in a camera according to a third embodiment of the present invention. The camera according to the present embodiment is obtained by replacing the parallax image capturing unit 10 according to the first embodiment shown in FIG. 2 with the configuration shown in FIG. 7, and the other configuration is the same as the configuration shown in FIG. The description of the configuration and operation of the common part is omitted.

In FIG. 7, a parallax image capturing unit 10 includes an optical image forming unit 12 for forming light of a subject and an optical image forming unit 12.
The light passing unit 14 having the first and second openings for irradiating the light passing therethrough, the polarization component separation unit 26 for separating a specific polarization component of the light, and the subject formed by the optical imaging unit 12. It has imaging units 16a and 16b for imaging.

The first opening 15a of the light transmitting section 14 has an opening specific polarization component transmission filter 24a that transmits light having a plane of polarization in the horizontal direction, as an example of an opening optical filter. The opening 15b has, as an example of the opening optical filter, an opening specific polarization component transmission filter 24b that transmits light having a polarization plane in the vertical direction.

As an example of an optical separation unit, a polarization component separation unit that passes light having a horizontal polarization plane and reflects light having a vertical polarization plane in an optical path from the optical imaging unit 12 to the imaging unit 16. The unit 26 is provided so that the image capturing unit 16a captures light having a horizontal plane of polarization and the image capturing unit 16b captures light having a vertical direction of polarization.

The image pickup sections 16a and 16b are respectively composed of light receiving sections 20a and 20b on which a plurality of light receiving elements are arranged, and a normal color filter 1 covering the surfaces of the light receiving sections 20a and 20b.
9a and 19b.

The first and second images picked up by the light receiving units 20a and 20b respectively pass through the A / D conversion unit 34,
These are stored in the parallax image storage units 37a and 37b, respectively.

The operation of the distance calculating section 38 for detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as that of the first embodiment, and will not be described.

(Embodiment 4) FIG. 8 is a configuration diagram of a camera according to a fourth embodiment of the present invention. The camera according to the present embodiment includes an optical imaging unit 12, a light passing unit 14, an imaging unit 16
A polarization component separating unit 26, a filter driving unit 42,
A / D converter 34, memory 36, distance calculator 38
, A control unit 39 and a recording unit 40.

In FIG. 8, the optical imaging unit 12, the light passing unit 14, the A / D converter 34, the memory 36, and the distance calculator 3
8, the control unit 39, and the recording unit 40 are the same as those in the first embodiment, and thus description thereof is omitted. The imaging units 16a and 16b and the polarization component separation unit 26, which are denoted by the same reference numerals as those in FIG. 7, are the same as those in the third embodiment, and thus description thereof will be omitted.

The first and second openings 15 of the light passage section 14
a and 15b have aperture-specific polarization component transmission filters 24a and 24b, respectively.

The filter driving section 42 can move the light passing section 14. When capturing a parallax image, the filter driving unit 42 connects the light passing unit 14 to the optical imaging unit 12.
Is moved in the optical path from the camera to the imaging unit 16. This allows the camera to capture a parallax image of the subject.

When capturing an image of a subject, the filter driving unit 42 moves the light passing unit 14 out of the optical path from the optical imaging unit 12 to the imaging unit 16. Thereby, the camera can capture an image of the subject.

The operation of the distance calculation unit 38 for detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as that of the first embodiment, and a description thereof will be omitted.

According to the present embodiment, unlike the third embodiment, the same optical imaging section, the same polarization component separating section and the same image pickup section are used to pick up a parallax image and a subject. It can be carried out. Therefore, by using the common optical imaging unit and the light receiving unit in imaging the subject and measuring the distance distribution of the subject, the size of the camera can be reduced, and the camera can be manufactured at low cost.

(Embodiment 5) FIG. 9 is a configuration diagram of a parallax image pickup section 10 in a camera according to a fifth embodiment of the present invention. The camera according to the present embodiment is obtained by replacing the parallax image capturing unit 10 according to the first embodiment shown in FIG. 2 with the configuration shown in FIG. 9, and the other configuration is the same as the configuration shown in FIG. The description of the configuration and operation of the common part is omitted.

In FIG. 9, a parallax image pickup unit 10 includes an optical image forming unit 12 for forming light of a subject and an optical image forming unit 12.
A light passing section 14 having first and second openings for irradiating the light passing through the imaging section 16 to the imaging section 16, and an imaging section 16 for imaging a subject formed by the optical imaging section 12.

The first opening 15a of the light transmitting section 14 has an opening specific polarization component transmitting filter 24a for transmitting light having a horizontal plane of polarization, and the second opening 15b
Has an aperture-specific polarization component transmission filter 24b that transmits light having a polarization plane in the vertical direction.

The imaging section 16 includes a light receiving section 20 and a light receiving section 20.
And a light-receiving unit specific polarization component transmission filter 28 as an example of a light-receiving unit optical filter that covers the surface of the light-receiving unit.

Light-receiving part specific polarization component transmission filter 28
Has a light-receiving unit horizontal polarization component transmission filter 28a for transmitting light having a horizontal polarization plane and a light-receiving unit vertical polarization component transmission filter 28b for transmitting light having a vertical polarization plane.

The horizontal polarization component transmission filter 28a and the vertical polarization component transmission filter 28b may be arranged as long as the respective filters are evenly distributed without bias.

The operation of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as that of the first embodiment, so that the description is omitted.

(Embodiment 6) FIG. 10 is a configuration diagram of a camera according to a sixth embodiment of the present invention. The camera according to the present embodiment includes an optical imaging unit 12, a light passing unit 14, a light receiving unit 20, a light receiving unit optical filter tray 44, a filter driving unit 42, an A / D conversion unit 34, a memory 36, ,
It has a distance calculation unit 38, a control unit 39, and a recording unit 40.

In FIG. 10, the optical imaging section 12, the light receiving section 20, the A / D conversion section 34, the memory 36, the distance calculation section 3
8, the control unit 39 and the recording unit 40 are the same as those in the first embodiment, and thus the description is omitted. The optical filter tray 44 with the same reference numerals as in FIG. 6 is the same as in the second embodiment, and a description thereof will be omitted.

The light passage section 14 is a liquid crystal light shutter having first, second and third openings 15a, 15b and 15c, and electrically switches between light transmission and light blocking in the openings by the electro-optic effect. Can be done

The first and second openings 15a and 15b are
Liquid crystal shutters having specific wavelength component transmission filters 25a and 25b that transmit different wavelength components are provided, respectively, and switching between light transmission and light blocking is electrically performed, and the opening can be freely opened and closed.

The third opening 15c has a liquid crystal light shutter 25c having no specific wavelength component transmission filter, and can electrically switch between light transmission and light blocking, and can freely open and close the opening.

The filter driving section 42 can move the light receiving section optical filter tray. When capturing a parallax image of a subject, the filter driving unit 42 moves the light-receiving unit specific wavelength component transmission filter 18 into an optical path from the optical imaging unit 12 to the light-receiving unit 20, and the light passing unit 14
Electrically opening the first and second openings 15a, 15b,
The third opening 15c is electrically closed. This allows the camera to capture a parallax image of the subject.

When capturing an image of a subject, the filter driving unit 42 moves the light-receiving unit specific wavelength component transmission filter 18 out of the optical path from the optical imaging unit 12 to the light-receiving unit 20, and moves the normal color filter 19 to the optical path. Move it in,
The light passing portion electrically opens the third opening 15c and electrically closes the first and second openings 15a and 15b. Thereby, the camera can capture an image of the subject.

The process of detecting the amount of parallax from the parallax image and calculating the distance distribution of the subject is the same as that in the first embodiment, and a description thereof will be omitted.

According to the present embodiment, the imaging of the parallax image and the imaging of the object can be performed by the same optical imaging unit and the same optical imaging unit without moving the light passing unit 14 out of the optical path from the optical imaging unit to the imaging unit. This can be performed using the same light receiving unit. Therefore, in imaging the subject and measuring the distance distribution of the subject,
By using a common optical imaging unit, light passing unit, and light receiving unit, the size of the camera can be reduced, and the camera can be manufactured at low cost.

(Embodiment 7) FIG. 11 is a configuration diagram of a camera according to a seventh embodiment of the present invention. The camera of the present embodiment includes a parallax image capturing unit 10, a lens 52, an optical path splitting element 53, an aperture 54, a relay lens 55, a shutter 56, a color filter 58, a CCD 60
, A multiplexer 32, an A / D converter 34, a memory 36, a distance calculator 38, a controller 39, and a recorder 40.

In FIG. 11, the lenses 52, the aperture 54, the shutter 56, the A / D converter 34, the memory 36, the distance calculator 38, the controller 39, and the recorder 40, which are denoted by the same reference numerals as those in FIG. Since it is the same as that of the first embodiment, the description is omitted.

The camera of this embodiment forms an image of a subject using the lens 52. The optical path splitting element 53 includes a lens 52
Divides the optical path of the light passing through the aperture 54 and the shutter 5
6 and the light received by the CCD 60 via the color filter 58 and the light input to the parallax image capturing unit 10 via the relay lens 55.

The parallax image capturing section 10 may be any of the parallax image capturing sections 10 of the first embodiment, the third embodiment, and the fifth embodiment. The image of the subject formed by the lens 52 is input to the parallax image capturing unit 10 via the relay lens 55. Since the configuration and operation of the parallax image capturing unit 10 have already been described, description thereof will be omitted.

The process of detecting the amount of parallax from the parallax image, calculating the distance distribution of the subject, and controlling the photographing conditions of the camera is the same as in the first embodiment, and therefore the description is omitted.

The relay lens 55 may be a reduction relay system for reducing an image, and the parallax image capturing unit 10 may be composed of a small optical system and a light receiving unit. On the other hand, the CCD 60 that receives the image of the subject may be a high-definition CCD having a large number of elements. With this configuration, using the common lens 52, an image of a high-resolution subject is formed on the CCD 60, and the parallax image capturing unit 10 can capture a parallax image of a low-resolution subject. it can.

According to the camera of this embodiment, the lens 52
The imaging of the subject and the imaging of the parallax image can be performed using the image of the subject formed by the above. By using a common lens for imaging a subject, the camera can be miniaturized, and the camera can be manufactured at low cost.

(Eighth Embodiment) FIG. 12 is a block diagram of a camera according to an eighth embodiment of the present invention. The camera according to the present embodiment includes a parallax image capturing unit 10, a lens 52, and an aperture 5.
4, a shutter 56, an imaging unit 46, an A / D conversion unit 34, a memory 36, a distance calculation unit 38, and a control unit 39
And a recording unit 40.

In FIG. 12, the lenses 52, the aperture 54, the shutter 56, the A / D converter 34, the memory 36, the distance calculator 38, the controller 39, and the recorder 40, which are denoted by the same reference numerals as those in FIG. Since it is the same as that of the first embodiment, the description is omitted.

The parallax image capturing unit 10 may be any of the parallax image capturing units 10 according to the first embodiment, the third embodiment, and the fifth embodiment. Parallax image capturing unit 10
Since the configuration and operation have already been described, description thereof will be omitted.

The image pickup section 46 picks up an image of a subject on a silver halide photosensitive film or the like by a photochemical reaction.

The process of detecting the amount of parallax from the parallax image, calculating the distance distribution of the subject, and controlling the photographing conditions of the camera is the same as in the first embodiment, and therefore the description is omitted.

According to the camera of this embodiment, the distance distribution of the object is obtained, and the photographing conditions such as the focus, the aperture, and the exposure time are appropriately adjusted based on the distance distribution information of the object, and the image of the object is obtained. Can be imaged on a silver halide photosensitive film or the like.

(Embodiment 9) FIG. 13 is a configuration diagram of a camera according to a ninth embodiment of the present invention. The camera according to the present embodiment is a video camera that captures a moving image, and includes a parallax image capturing unit 10, a lens 52, an aperture 54, a color filter 58, a CCD 60, and A / D converters 34a and 34a.
4b, memories 36a and 36b, and a distance calculator 38
, A control unit 39 and a recording unit 40.

In FIG. 13, a lens 52, a diaphragm 54, a color filter 58,
CD 60, A / D converters 34a and 34b, memory 36
a, 36b, distance calculation unit 38, control unit 39, and recording unit 4
For 0, the same operation as in the first embodiment is performed, and the description is omitted.

The parallax image capturing unit 10 may be any of the parallax image capturing units according to the first embodiment, the third embodiment, and the fifth embodiment. The parallax image captured by the parallax image capturing unit 10 is stored in the memory 36a, and the distance calculation unit 38 reads the parallax image from the memory 36a,
The amount of parallax is detected, and the distance distribution of the subject is calculated. The image of the subject formed by the lens 52 is received by the CCD 60,
It is stored in the memory 36b. The captured image of the subject is stored in the recording unit 40. The recording unit 40 is a video tape,
Recording media such as MO and DVD may be used.

(Embodiment 10) FIG. 14 shows a first embodiment of the present invention.
It is a lineblock diagram of a camera concerning an embodiment of 0. The camera according to the present embodiment is an endoscope apparatus, and captures an image of a body such as a stomach and an intestine as an image for medical diagnosis or treatment. In order to observe minute irregularities on the wall surface of an organ in the body, it is important to extract information on the depth of the subject.
The endoscope apparatus according to the present embodiment captures an image of a subject while acquiring distance distribution information of the subject by capturing a parallax image.

[0114] The endoscope apparatus of the present embodiment is an endoscope 70.
, A signal processing unit 72, a recording unit 40, and a monitor 74. The distal end of the endoscope 70 of the present embodiment
, CCD 60, optical imaging unit 12, light passing unit 14
And an imaging unit 16 to form a parallax image of the subject.

The inside of the tube of the endoscope 70 is a transmission cable 78.
, And transmits output electric signals of the CCD 60 and the imaging unit 16. An optical imaging unit 12 for capturing a parallax image,
The configuration of the light passing unit 14 and the imaging unit 16 may be the parallax image imaging unit 10 of any of the first embodiment, the third embodiment, and the fifth embodiment.

The signal processing section 72 is for processing an image picked up by the CCD 60 and the image pickup section 16, detects the amount of parallax from the parallax image, calculates distance distribution information of the object, and converts the distance distribution information of the object into an image of the object. The image is subjected to image processing, output to the monitor 74, and output to the recording unit 40. The signal processing unit 72 outputs to the monitor 74.

The monitor 74 displays the image of the subject together with the distance information of the subject. The monitor 74 may display a stereoscopic image of the subject.

In this embodiment, the CCD 60 and the image pickup body 1
Although 6 is provided at the distal end of the endoscope, the embodiment is not limited to this. The CCD 60 and the imaging body 16 are provided at the rear of the endoscope, a plurality of relay lenses are provided inside the tube of the endoscope 70, and the image formed by the lens 52 and the optical imaging unit 12 is
The image may be captured by the CCD 60 and the imaging body 16 at the rear of the endoscope by relaying the image through a relay lens.

According to the endoscope apparatus according to the present embodiment, the subject can be photographed while measuring the distance distribution information of the subject, and fine irregularities on the wall surface of the organ in the body can be observed.

Although the present invention has been described with reference to the embodiment, the technical scope of the present invention is not limited to the scope described in the above embodiment. It is apparent to those skilled in the art that various changes or improvements can be added to the above embodiment. It is apparent from the description of the appended claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

[0121]

As is apparent from the above description, according to the present invention, a plurality of parallax images when the subject is viewed from different points are simultaneously captured, the parallax amounts of the plurality of parallax images are detected, and the depth of the subject is detected. Information can be obtained.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a conventional parallax image capturing apparatus.

FIG. 2 is a configuration diagram of a camera according to the first embodiment of the present invention.

FIG. 3 is a configuration diagram of a parallax image capturing unit.

FIG. 4 is a configuration diagram of an imaging unit.

FIG. 5 is a configuration diagram of a parallax image processing unit.

FIG. 6 is a configuration diagram of a camera according to a second embodiment of the present invention.

FIG. 7 is a configuration diagram of a parallax image capturing unit of a camera according to a third embodiment of the present invention.

FIG. 8 is a configuration diagram of a camera according to a fourth embodiment of the present invention.

FIG. 9 is a configuration diagram of a parallax image capturing unit of a camera according to a fifth embodiment of the present invention.

FIG. 10 is a configuration diagram of a camera according to a sixth embodiment of the present invention.

FIG. 11 is a configuration diagram of a camera according to a seventh embodiment of the present invention.

FIG. 12 is a configuration diagram of a camera according to an eighth embodiment of the present invention.

FIG. 13 is a configuration diagram of a video camera according to a ninth embodiment of the present invention.

FIG. 14 is a configuration diagram of an endoscope according to a tenth embodiment of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 10 Parallax image imaging part 12 Optical imaging part 14 Light transmission part 16 Imaging part 18 Light receiving part specific wavelength component transmission filter 19 Color filter 20 Light receiving part 22a, 22b Opening specific wavelength component transmission filter 24a, 24b Opening specific polarization component transmission Filter 26 Polarization component separation unit 28 Light reception unit specific polarization component transmission filter 32 Multiplexer 34 A / D conversion unit 36 Memory 37a, 37b
Parallax image storage unit 38 Distance calculation unit 39 Control unit 40 Recording unit 42 Filter driving unit 44 Light receiving unit optical filter tray 46 Imaging unit 52 Lens 54 Aperture 56 Shutter 58 Shutter 58 Color filter 60
CCD

 ──────────────────────────────────────────────────続 き Continuing on the front page F term (reference) 2F065 AA06 AA51 BB05 CC16 DD02 FF04 FF09 FF23 JJ03 JJ26 LL04 LL10 LL21 LL22 LL30 LL32 LL46 NN11 QQ03 QQ23 QQ24 QQ28 2F112 AC06 BA10 CA02 DA10 FA17 A21 FA19 5B057 BA02 BA13 BA15 BA29 DA07 DB03 DB06 DC03 DC32 5C061 AA29 AB02 AB03 AB04 AB08 AB21 AB24

Claims (19)

[Claims] 1. A parallax image capturing apparatus that captures a plurality of parallax images obtained when a subject is viewed from different points, comprising: a single optical axis optical imaging unit configured to form the subject; A light receiving element is provided, a light receiving unit on which the subject is imaged by the optical imaging unit, and first and second light sources for irradiating the light receiving unit with light having passed through first and second regions in the optical imaging unit. A light passing unit having a second opening, a first image passing through the first opening, and a second image passing through the second opening, the light receiving element being different from the light receiving unit. A parallax image capturing apparatus, comprising: an optical separation unit that simultaneously captures images. 2. The first and second openings of the light passing portion, wherein the first and second openings respectively transmit different light components.
The parallax image capturing apparatus according to claim 1, further comprising an aperture optical filter. 3. A first light receiving unit optical filter for transmitting the light component transmitted through the first opening optical filter again by the optical separating unit, and a light component transmitting the light component transmitted through the second opening optical filter. 3. A second light-receiving unit optical filter that transmits light again, and the first light-receiving unit optical filter and the second light-receiving unit optical filter are alternately arranged. Parallax image capturing device. 4. The optical filter according to claim 3, wherein the first and second aperture optical filters of the light passing portion are aperture specific wavelength component transmission filters that transmit specific wavelength components of different lights, respectively. A parallax image capturing device according to claim 1. 5. The first light-receiving unit specific wavelength component transmission filter that transmits the same wavelength component as the first aperture specific wavelength component transmission filter of the light passing unit, wherein the optical separation unit includes: And a second light receiving unit specific wavelength component transmitting filter that transmits the same wavelength component as the second opening specific wavelength component transmitting filter, wherein the first and second light receiving unit specific wavelength component transmitting filters are alternately arranged. The parallax image capturing apparatus according to claim 4, wherein the parallax image capturing apparatus is arranged to cover the light receiving unit. 6. The first light-receiving unit specific wavelength component transmission filter comprises a specific RGB wavelength component λR1, λG1, and λB.
1, the second light-receiving unit specific wavelength component transmission filter includes filters that respectively transmit specific RGB wavelength components λR2, λG2, and λB2, and a filter that transmits the wavelength component λR1. And a filter that transmits the wavelength component λG2 is adjacent, a filter that transmits the wavelength component λG1 is adjacent to the filter that transmits the wavelength component λG2, and a filter that transmits the wavelength component λB1 and the filter that transmits the wavelength component λB2
The parallax image capturing apparatus according to claim 5, wherein filters that transmit light are adjacent to each other. 7. The first and second aperture optical filters of the light passing portion are aperture specific polarization component transmission filters that transmit light having a horizontal or vertical polarization plane, respectively. The parallax image capturing device according to claim 3. 8. The light having the horizontal and vertical polarization planes, wherein the optical separation unit has a light receiving unit specific polarization component transmission filter that transmits the light having the horizontal and vertical polarization planes. The parallax image capturing apparatus according to claim 7, wherein light-receiving unit specific polarization component transmission filters that transmit light are arranged alternately to cover the light-receiving unit. 9. The optical separation unit has a polarization component separation unit that separates the light having the horizontal and vertical polarization planes, and the light receiving unit is separated by the polarization component separation unit. It has a first light receiving surface for receiving light having a horizontal polarization plane and a second light receiving surface for receiving light having a vertical polarization plane separated by the polarization component separation section. The parallax image capturing device according to claim 7, wherein: 10. The parallax image capturing apparatus according to claim 1, further comprising an electrical separating unit configured to separate the first and second images captured by the light receiving unit. 11. The light receiving device is a charge coupled device,
The parallax image pickup device according to claim 1, wherein the light receiving unit is a photoelectric conversion image pickup body in which a plurality of the charge-coupled devices are arranged. 12. A camera for acquiring information on a distance to a subject, comprising: a first optical imaging unit having a single optical axis for forming an image of the subject; and a plurality of light receiving elements, A first light receiving unit on which the subject is imaged by the optical image forming unit; and a light passing through the first and second regions in the first optical image forming unit are irradiated on the first light receiving unit. 1st and 2nd
A light passing portion having an opening, and an optical separating portion for simultaneously imaging the first image passing through the first opening and the second image passing through the second opening on different light receiving elements. And a distance calculating unit that calculates a distance from the first optical imaging unit to at least one point on the subject based on the first and second images. . 13. A second optical imaging unit that forms an image of the subject, a second light receiving unit that forms an image of the subject by the second optical imaging unit, and a distance calculated by the distance calculation unit. According to the distance, the second
The camera according to claim 12, further comprising: a control unit configured to control at least one of a focus and an aperture of the optical imaging unit and an exposure time of the second light receiving unit. 14. The first light-receiving section on which the subject is imaged by the first optical imaging section and the distance calculated by the distance calculation section, the first light-receiving section.
The camera according to claim 12, further comprising: a control unit configured to control at least one of a focus and an aperture of the optical imaging unit and an exposure time of the second light receiving unit. 15. A drive unit for moving the light passing unit and the optical separating unit out of an optical path while the subject is received by the first light receiving unit. The camera according to claim 12. 16. The optical system according to claim 16, wherein the light transmitting unit further includes a third opening for irradiating the first light receiving unit with light having passed through a third region in the first optical imaging unit. The separating unit is configured such that in the light passing unit, the first
And opening the second opening and closing the third opening, the first image passing through the first opening and the second image passing through the second opening. An image obtained by simultaneously imaging different light receiving elements and passing through the third opening in a state where the third opening is opened and the first and second openings are closed in the light passing section. The camera according to claim 12, wherein the light-receiving element captures an image. 17. The camera according to claim 16, wherein the first, second, and third openings of the light passing portion have liquid crystal light shutters. 18. The method according to claim 18, wherein the distance calculation unit includes a first pixel address of the first image and a second pixel address of the subject imaged at the first pixel address in the second image. From the optical imaging unit based on
13. The camera according to claim 12, wherein a distance to the subject formed at the first pixel address of the image of (b) is calculated. 19. An image picked up by the second light receiving unit,
And a recording unit for recording the distance calculated by the distance calculation unit.
The camera according to.