JP5089674B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus that captures a subject image.

  In recent years, digital still cameras mainly used for still image shooting have come to use image sensors with a maximum pixel number of 10 million pixels, and movie cameras mainly used for moving image shooting have image sensors with millions of pixels. Came to be used. In the above applications, it is common to shoot with a high number of pixels in high-definition shooting that requires high resolution, and with a low number of pixels when low resolution is acceptable. At that time, almost all pixel signals are read from the image sensor in high-definition shooting, and in order to prevent battery consumption of the camera or to increase the number of shots in low-resolution shooting, pixel signal decimation and pixel signal decimation and addition are added. Both of these are read (see, for example, Patent Document 1 and Patent Document 2).

  In the embodiment shown in Patent Document 1 (FIG. 3 of the publication), the same color is thinned out in units of 4 × 4 pixels to perform read-out addition.

  In the embodiment shown in Patent Document 2 (FIG. 1 of the publication), 4 × 4 pixels are grouped so that the spatial color arrangement of each color before addition is the same as the spatial arrangement of each color after addition. A plurality of pixel signals are added.

Japanese Patent Laid-Open No. 9-247689 Japanese Patent Laid-Open No. 2001-36920

  In Patent Document 1, the number of effective pixels used in 4 × 4 pixels is small. In recent years, it has been pointed out that the image sensor of recent years has a smaller unit pixel size due to an increase in the number of pixels and insufficient sensitivity. Digital still cameras can compensate for the lack of sensitivity by shooting with a strobe when shooting dark objects, but moving images are expensive and heavy, and there is a lot of noise. In addition, image quality is greatly deteriorated due to generation of moire due to a decrease in the sampling frequency of the image due to thinning out of the pixel signals.

  In Patent Document 2, although the sensitivity is improved by increasing the number of pixel signals added in one group, there is a problem that there is a pixel signal that is not yet used (thrown away). In addition, a plurality of pixel signals are added so that the spatial color arrangement of each color before and after the addition is the same within one group. However, when the captured image is enlarged, a slight moire occurs. There is.

  As described above, the conventional technique has a problem that the sensitivity improvement is insufficient because the pixel signals are thinned out, and the moire is generated although the spatial color arrangement is the same.

  SUMMARY OF THE INVENTION An object of the present invention is to solve the problems of the prior art and to provide a color imaging apparatus and an imaging system that can capture high-definition images and lower-resolution images with good image quality.

  In order to solve the above problems, the plurality of photoelectric conversion units arranged in the horizontal direction and the vertical direction and the plurality of photoelectric conversion units from the plurality of photoelectric conversion units so that the centroids of the signals after addition are equal pitches between the signals. An image pickup apparatus is provided that includes addition means for adding signals having color components of the same color.

  According to the present invention, the addition of pixel signals is made to coincide with the spatial sampling centroid of each color signal, so that moire can be reduced. In addition, the addition of pixel signals improves sensitivity, enabling high-speed reading and low-power driving. Furthermore, since the addition circuit can be made small, the image sensor can be supplied at low cost.

It is an arrangement example of each color before pixel signal addition. It is explanatory drawing which shows the color arrangement | positioning after the addition of a pixel signal, and the addition signal for each color. It is an image sensor block diagram which comprises an imaging device. It is a partial circuit diagram of a pixel signal readout signal processing circuit from an imaging region. It is explanatory drawing which reads the signal in the several line unit to add. It is explanatory drawing which reads the signal after addition within a screen. It is explanatory drawing at the time of utilizing a mechanical shutter. FIG. 6 is a timing diagram of pixel signal readout and addition. It is a system diagram. It is a unit pixel circuit diagram of a pixel part. It is a common amplifier pixel structural example figure.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is an arrangement diagram of each color before pixel signal addition. FIG. 2 is a diagram showing the color arrangement after addition of pixel signals and the addition signal for each color.

  First, in the color arrangement example in FIG. 1, color filters G (green), R (red), and B (blue) are configured on each photodiode of the image sensor. In this example, G is checkered, R and B are line-sequential, in other words, 2 × 2 = 4 pixels of R, G, G, and B are two-dimensionally arranged as one unit pixel color array. Has been placed.

  In the pixel signal addition reading shooting mode of the present embodiment, as shown in FIG. 2A, the pixel signals are added in the image pickup device so as to have the same color arrangement as in FIG. It is. The embodiment of FIG. 2 is an addition example of 3 × 3 = 9 pixels of the same color. FIG. 2B shows the addition of the Rij signal. The signals of the Rn column, Rn + 2 column, and Rn + 4 column of m row, m + 2 row, and m + 4 row are added. Similarly, FIG. 2-C shows the addition of Gi, j + 1 signals, FIG. 2-D shows the addition of Gi + 1, j signals, and FIG. 2-E shows the addition of Bi + 1, j signals. In this case, the colors are spatially overlapped and added, but this makes the center of spatial sampling between the added color signals equal in pitch, and all the pixel signals are used. Accordingly, the moire of the image due to the spatial sampling shift is eliminated, and the sensitivity (particularly, light shot noise) is improved by √9 = 3 times. For example, if the present invention is applied to an image pickup device having 5 million pixels, the number of pixels is about VGA after addition, and high-speed shooting with high sensitivity is possible. If a lower resolution is required, the number of added pixels may be increased to 5 × 5 or 7 × 7. This has the effect of increasing sensitivity. Even if the number of added pixels is increased, it is only necessary to increase the memory CA of an adder circuit described later by the number of added rows.

  Next, an internal configuration example of the image sensor will be described. FIG. 3 is an image sensor block diagram of the image pickup apparatus of the present embodiment. In the figure, a pixel portion composed of a photodiode for photoelectric conversion as shown in FIG. 10 and a pixel amplifier as shown in FIG. The pixel portion of the imaging region is controlled by a plurality of drive pulses from the vertical scanning circuit (V.SR) 10. The odd-numbered vertical signal lines in the imaging region are connected to the CDS / amplifier circuit 20-1, and the even-numbered vertical signal lines are connected to the CDS / amplifier / memory circuit 20-2. Hereinafter, since the upper and lower circuits of the imaging region in the figure have the same configuration, the lower circuit block will be described. The signal from the pixel portion is subjected to CDS, amplifier circuit, and memory 1 circuit 20-1 to remove noise in the pixel portion, and only the signal component is amplified and then temporarily stored in the memory 1. When the imaging apparatus is not in the addition readout mode but in the all-pixel readout mode, the signal of the memory 1 is the scan pulse φhn (φhn (1), φhn (2), φhn (3) from the horizontal scanning circuit (H.SR). ) And is read out to the output signal line. In the addition reading mode, the signal of the memory 1 is guided to the addition circuit 30-1. In the adder circuit 30-1, signals of the same color from the memory 1 are added. The added signal is temporarily stored in the memory 2 and then controlled by the scanning pulse φhn (a) from the horizontal scanning circuit (H.SR) and read out to the output signal line.

  FIG. 10 is a unit pixel circuit diagram of the pixel portion, FIG. 4 is a partial circuit diagram of a pixel signal readout signal processing circuit from the imaging region, and FIG. 8 is a pixel signal addition timing diagram. The signal readout from the pixel unit and the signal addition will be described with reference to these drawings. In the embodiment of FIG. 4, an addition example diagram of 3 × 3 pixels in the imaging block diagram of FIG. 3 is shown.

  The pixel portion of FIG. 10 shows the residual charges in the gate portions (floating diffusion) of the pixel amplifiers MSF and MSF connected to the transfer switches MTX and MTX for controlling the transfer of signal charges from the photodiodes PD and PD which are photoelectric conversion portions. A reset switch MRES for resetting and a select switch MSEL for controlling transfer of signals from the pixel amplifier. A current source switch MRV of the pixel amplifier is provided outside the imaging region.

  The read signal processing circuit in FIG. 4 will be described. A circuit including a capacitor C, a clamp switch MC, a reference voltage source VR, and an amplifier Amp connected to the vertical signal line is a CDS circuit that removes noise in the pixel portion. The memory capacity CT1, CT2, CT3 of the memory 1 circuit temporarily accumulates the CDS signals of the three columns. It is the memory capacity CA1 that adds and temporarily stores the three signals of the memory 1. Similarly, the memory capacities CA2 and CA3 temporarily accumulate addition signals of different horizontal pixel rows. It is the capacity CT2 of the memory 2 circuit that adds the signals of these memory capacitors CA1, CA2 and CA3 and temporarily accumulates them.

  Next, description will be made using the timing of FIG. When an arbitrary exposure period elapses, the residual charge at the node of each circuit unit is reset by the control of each pulse. At time t1, the gate portion of the pixel amplifier MSF is reset by the pulse φRES, the memory 1 circuit is reset by the pulses φC1 and φTS1, and the adding portion capacitors CA1, CA2, CA3 and CT2 are reset by the pulses φAD4, φC2 and φAD5, respectively. At time t2, pixel amplifier noise is clamped in the clamp capacitor C when the pulse φC1 is OFF, and the charge of the photodiode is input to the clamp capacitor via the pixel amplifier by the pulse φTX.

  As a result, the pixel noise is removed from the CDS and temporarily stored in the memory 1 via the amplifier Amp. Now, assuming that the vertical scanning is the scanning of m rows in FIG. 1, the signals from the vertical signal lines V1, V2, and V3 are Rm, n for the memory capacitor CT1, Rm for CT2, n + 2, and Rm, n + 4 for CT3. Are temporarily stored.

  At time t3, the transfer of the photoelectric conversion signals of the m-row pixels is completed by turning off the pulses φSEL and φTS1. At time t4, the signal of the memory 1 is added by the addition memory capacity CA1 by the pulses φTS2 and φAD1.

  By similar scanning and operation, the pixel signal of m + 2 row is added to the memory capacitor CA2 at time t5, and the signal of pixel of m + 4 row is added to the memory capacitor CA3 at time t6 and temporarily accumulated. At time t7, the signals of the memory capacitors CA1, CA2, and CA3 are added to the memory capacitor CT2n by the pulses φAD4 and φAD5. As a result, the R signal for 9 pixels is added to the memory capacitor CT2n to obtain the added signal Ri, j.

  By a similar operation, the G signal for 9 pixels is added to the memory CT2n + 1, and the added signal Gi + 1, j can be obtained. In this embodiment, a memory capacity for two pixels in the vertical direction is provided. However, the memory 2 may have the number of added pixels, for example, the number equivalent to VGA. This is based on the concept of the imaging system. It is also possible to transfer the pixels of the entire screen at high speed, add them in arbitrary units, temporarily store them in the memory 2, and sequentially read out the signals. In the present embodiment, as shown in FIG. 4, the memory 1 is used to support the all-pixel readout mode and the addition readout mode, and in particular, despite the addition of a plurality of multiple pixels of 3 × 3 = 9 pixels. Since the addition is performed using the memory 1, the number of memories may be small. This is effective in reducing the image sensor size.

  In the 9-pixel additive readout mode described above, the sensitivity is improved by a factor of 3 (light shot noise). Therefore, the system controls the exposure amount and sets the incident light amount to about 1/3. This means that the photoelectric conversion signal at each photodiode becomes 1/3. If the image pickup device is a CCD, the signal charge amount after addition is tripled by adding nine pixel charges even if the incident light quantity is 1/3. Therefore, signal saturation becomes a problem in this state. There is a drawback that sensitivity and saturation characteristics are traded off.

  In the CMOS sensor according to the present embodiment, since the average value of the signal voltage is added, the signal level becomes about 1/3 even after the addition of the nine pixel signals if the decrease in the signal level due to the capacity division is ignored. This means that the saturation of the signal has been enhanced three times. However, when the level of the signal is low, the noise of the output amplifier connected to the horizontal output line (not shown in FIG. 4) is closed up. Therefore, in the present invention, in the addition readout mode, the amplifier gain of the amplifier circuit Amp after CDS is set to about three times that in the all-pixel readout mode. As a result, the noise of the output amplifier can be reduced, the sensitivity is increased by adding pixel signals, the high-speed reading is achieved by reducing the number of readout pixels, the high dynamic range is maintained, and the power is reduced.

Examples of the signal readout method in the addition readout mode are shown in FIGS.
FIG. 5 shows an example of signal readout in units of a plurality of rows to be added. This reads out a signal from a pixel in units of rows to be added, and performs addition with the signal memory. Thereafter, a signal is output from the memory to the outside during one horizontal scanning period. FIG. 6 shows that all pixels in the imaging area are collectively reset, and after the exposure is completed, the pixel signals of the entire screen are added in an arbitrary addition unit, and then, for example, added pixels equivalent to VGA are temporarily stored in the plurality of memories 2. Signals are sequentially output from the memory 2. FIG. 7 shows a case where a mechanical shutter is used. All pixels in the image pickup area are collectively reset, and after completion of exposure with the mechanical shutter, a pixel signal is added in an arbitrary addition unit, and a signal is externally output from the memory 2 in one horizontal scanning period. Is output.

  As the pixel portion of the imaging region, one pixel amplifier configuration is described above for one photodiode in FIG. 10, but FIG. 11 shows a common amplifier pixel configuration as another pixel portion embodiment. This is an example in which two photodiodes are configured for one pixel amplifier. If a plurality of photodiodes are arranged for one amplifier, the area of the pixel amplifier for one photodiode is reduced, and as a result, the aperture ratio of the photodiode is improved.

  FIG. 9 shows a system schematic diagram using the image sensor. As shown in the figure, the subject light incident through the optical system 71 forms an image on the sensor 72. The light information is converted into an electrical signal by the pixels arranged in the sensor. The electric signal is subjected to signal conversion processing by a signal processing circuit 73 by a predetermined method. The signal processed signal is recorded or transmitted by the information recording apparatus through the recording system and communication system 74. The recorded or transferred signal is reproduced and displayed in a reproduction system and a display system. The sensor 72 and the signal processing circuit 73 are controlled by the timing control circuit 75, and the timing control circuit 75, the recording system, the communication system 74, the reproduction system, and the display system 77 are controlled by the system control circuit 76. The timing control circuit 75 selects the all-pixel readout mode or the addition readout mode.

  The horizontal and vertical drive pulses are different in the all-pixel readout mode and the addition readout mode. Therefore, it is necessary to change the drive timing of the sensor, the resolution processing of the signal processing circuit, and the number of recording pixels of the recording system for each readout mode. These controls are performed in accordance with each read mode by the system control circuit. Also, the sensitivity varies depending on the addition in the readout mode. The system control circuit controls the diaphragm (not shown), and the control pulse (not shown) from the timing control circuit is switched to increase the amplification circuit Amp gain of the sensor to obtain an appropriate signal.

  With this system, all pixels are read out in high-definition shooting, and high sensitivity, high-speed reading, and high image quality are possible in low-resolution shooting.

71 Optical System 72 Sensor 73 Signal Processing Circuit 74 Recording System, Communication System 75 Timing Control Circuit 76 System Control Circuit 77 Playback System, Display System

Claims (5)

A pixel unit provided with a plurality of pixels, each of which is arranged in a matrix and has a photoelectric conversion unit and a pixel amplification unit that outputs a signal based on the charge accumulated in the photoelectric conversion unit;
A noise removing unit for removing noise generated in the pixel;
A Bayer array color filter provided corresponding to each of the plurality of pixels,
Each has a plurality of readout circuits provided corresponding to each of the plurality of pixel columns, and the readout circuit corresponding to an adjacent column among the plurality of readout circuits is connected to the pixel portion. Provided on the opposite side of the direction along the row,
The imaging device includes an addition mode,
In the addition mode,
In the pixel array, there are a plurality of adjacent regions of pixels of 5 rows × 5 columns, and the center pixel of the region of pixels of the 5 rows × 5 columns is the other pixels of 5 rows × 5 columns 2 pixels are adjacent to each other in the direction along the row or column with respect to the center pixel of the region consisting of 5 pixels × 5 columns in the region composed of pixels of 5 rows × 5 columns. An image pickup apparatus comprising: adding signals from pixels located in the first, third, and fifth rows and in the first, third, and fifth columns of the region.   The imaging apparatus according to claim 1, further comprising: a plurality of column amplifying units provided corresponding to the columns of the plurality of pixels. The imaging device includes a mode for adding signals from the plurality of pixels;
It is possible to operate in a mode in which signals from the plurality of pixels are not added, and the gain of the column amplification unit in the mode in which signals from the plurality of pixels are added does not add signals from the plurality of pixels. The imaging apparatus according to claim 2, wherein the imaging apparatus is higher than the mode. The readout circuit has addition means,
In the addition mode, the adding means obtains an inter-column addition signal obtained by adding signals from the pixels in different columns for the plurality of rows, and then adds the plurality of column addition signals.
The imaging device according to any one of claims 1 to 3. An imaging device according to any one of claims 1 to 4,
And a signal processing circuit that processes a signal output from the imaging device.
An imaging system characterized by the above.

Images