1. Introduction
In the development of Internet of Things (IoT), complementary metal oxide semiconductor (CMOS) image sensors are expected to be used under extreme-illumination conditions, e.g., outdoors, in which a high-dynamic-range (HDR) CMOS image sensor is required to prevent objects from becoming overexposed or underexposed. For instance, the intra-scene dynamic range required to cover both an LED sign and a person on a sidewalk in a night scene at a local town is over 86 dB [
1]. The intra-scene dynamic range is defined as the ratio between electron-referred noise floor and maximum signal electrons within a single image [
2]. Furthermore, an intra-scene dynamic range of greater than 100 dB is required for driver-assistance systems in automotive vehicles [
1,
3,
4].
In order to realize HDR CMOS image sensors, many approaches have been proposed. Non-linear response approaches such as logarithmic compression [
5,
6,
7] and knee compression [
8] can reduce the data bandwidth because of their low bit-resolution, but are not preferred in terms of complex image signal processing. Linear response approaches such as multiple-exposure, high-dynamic-range (MEHDR) [
9,
10,
11,
12] and single-exposure, high-dynamic-range (SEHDR) approaches are preferred for simple image-signal processing. Even though the MEHDR approach is widely adopted, MEHDR images that combine two images taken at different exposure timings will be distorted due to the misalignment of the timings, as shown in
Figure 1a. Thus, the SEHDR approach is becoming increasingly attractive. SEHDR is realized with dual conversion gain (DCG) pixels [
13,
14,
15] or lateral overflow integration capacitor (LOFIC) pixels [
14,
15,
16,
17,
18,
19,
20,
21,
22,
23], in which the low-conversion-gain (LCG) signal and high-conversion-gain (HCG) signal are combined, as shown in
Figure 1b. In DCG pixels, the photoelectrons integrated in a photodiode (PD) are read out twice in different gains, namely LCG and HCG. Since the electron-referred noise is low for the HCG, even though the maximum number of the electron readout is limited due to a given signal voltage range, as shown in
Figure 2, the pixel signal under low illuminance is visible. On the other hand, since the maximum number of electrons in the read-out at LCG is high, as shown in
Figure 2, the pixel signal under high illuminance is extended. Thus, the combined signal can achieve HDR with low read-out noise and large PD full-well capacity. The LOFIC pixel utilizes a similar two-times read-out scheme, HCG and LCG, and can achieve a higher dynamic range than DCG pixels because the photo-electrons are integrated not only in the PD but also in high-density capacitors. However, the circuit area for the LOFIC pixels is large due to the two-channel read-out chain for polarity-inverted LCG and HCG signals [
20,
22,
23], while the DCG pixel signal has a one-channel read-out chain because the signal polarities of the LCG and HCG signals are the same [
13]. Challenges to the read-out chain for LOFIC-CMOS image sensors are summarized as follows:
The LOFIC pixels outputs polarity-inverted HCG and LCG signals.
The circuit area of the two-channel read-out chain for the LOFIC pixels is larger than that for DCG pixel.
The chip cost of LOFIC-CMOS image sensors will be high because of the large circuit area.
Figure 1.
Image generation methods of MEHDR and SEHDR. (a) MEHDR; (b) SEHDR.
Figure 1.
Image generation methods of MEHDR and SEHDR. (a) MEHDR; (b) SEHDR.
The read-out chain performs double-sampling for both HCG and LCG signals to cancel the pixel offset voltage and/or pixel reset noise, followed by analog/digital conversion. To realize a single-channel read-out chain and reduce the chip cost of LOFIC-CMOS image sensors, an up/down double-sampling circuit composed of an inverting amplifier and non-inverting attenuator is proposed in this paper.
Figure 3 represents the signal processing function of the double-sampling circuit.
Figure 2.
Photo−conversion characteristics of LOFIC−CMOS image sensors.
Figure 2.
Photo−conversion characteristics of LOFIC−CMOS image sensors.
The pixel HCG signal, which is the voltage difference between the reset level and signal level from LOFIC pixel, is read out with the inverting amplifier for low-input referred circuit noise. The pixel LCG signal, which is the voltage difference between reset level and signal level from the LOFIC pixel, is then read out with the attenuator to increase the maximum signal range. Even though the polarity of the LCG and HCG signal output from the LOFIC pixel is inverted, the polarity of the input signal to the following analog/digital converter (ADC) is the same and a single ADC can process both the HCG and LCG signals. Moreover, the attenuator is merged with the ADC, such as column parallel successive-approximation-register (SAR) ADC, to further decrease the area of the double-sampling circuit. A test chip of the proposed double sampling circuit was fabricated with a standard CMOS process with metal–insulator–metal (MIM), and evaluated to estimate the dynamic range of LOFIC-CMOS image sensors with the proposed double-sampling circuit. Our contribution is summarized as follows:
We propose a single-channel read-out chain for the LOFIC pixel to realize a small-area peripheral circuit for LOFIC-CMOS image sensors.
We present a design methodology of signal voltage range from the pixel to the ADC to maximize the effective full-well capacity (FWC) of the LOFIC-CMOS image sensors.
We estimate the LOFIC pixel dynamic range with the proposed up/down double-sampling circuit based on the measurement results of a fabricated test chip.
Section 2 provides a basic pixel schematic and the operation timing of the LOFIC pixel. The proposed single-channel read-out chain with the up/down double-sampling circuit is described in
Section 3, followed by the design and measurement results of a fabricated test chip shown in
Section 4.
Section 5 provides a summary of this paper.
2. Lateral Overflow Integration Capacitor (LOFIC) Pixel
Figure 4a shows a schematic diagram of the LOFIC pixel that is composed of a photodiode PD, a transfer gate TG, a switching gate SG, a reset gate R, a source-follower transistor SF, and a select transistor SEL, the parasitic capacitance on FD node CFD, and a charge storage capacitor CS. The double-sampling circuit, DS, derives the voltage difference between a reset level (
) and a signal level (
) from LOFIC pixel, and the voltage difference is then digitized by an ADC. The photo-electrons from the pixel are read out twice by SF, which is composed of a source-follower transistor and bias (Id). First, the photo-electrons integrated in the PD are read out in the HCG mode while SG is turned off. The HCG signal is suitable for the case with low illuminance. Secondly, the photo-electrons integrated in the PD, CFD and CS are read out in the LCG mode while SG is turned on. The photo-electrons generated in PD overflow into the FD node beyond the potential barrier of the TG when the PD is saturated. Then, photo-electrons overflow into the CS capacitor beyond the potential barrier of the SG when FD is saturated. The LCG signal is suitable for the case with high illuminance.
The operation timing and electric potential diagrams of the LOFIC pixel are shown in
Figure 4b,c, respectively. At the beginning of the exposure period (
), the transistors R, SG, and TG are turned on to reset the PD, the CFD, and the CS. During the exposure period (
), as shown in
Figure 4c, photo-electrons generated under low illuminance are integrated in the PD, while photo-electrons under high illuminance are integrated in the PD, CFD, and/or CS. At the end of the exposure period, the pixel signal readout is provided when the SEL transistor is turned on.
The readout for the HCG reset level
is provided at
after the SG is pulsed to share a dark current charge integrated in the small CFD with a large CS (
). Then, the HCG signal level
readout is provided at
after the charge transfer pulse is applied to the TG gate at
. The voltage difference between
and
is derived using the following double-sampling circuit. Since the same FD reset noise is included in both
and
, a low-noise signal is readout under low illuminance. The conversion gain obtained by
is as high as 160
in our previous work [
16], where
and CFD are the elementary charge and parasitic capacitance for the FD node, respectively. The HCG signal shows a linear photoconversion response for low-input illuminance, in which the generated photo-electron charge is lower than the charge storage capacity of the PD. It is noted that the voltage difference between
and
is negative because the electric potential at the FD node increases during the transition from
to
.
The LCG signal level
readout is provided at
after the SG gate is turned on and the TG is pulsed again at
to merge the photo-electrons integrated in the PD, CFD, and the CS. Then, the LCG reset level
readout is provided at
after R is pulsed again to reset the CFD and CS at
. The voltage difference between
and
is derived from the following double-sampling circuit. Since the conversion gain provided by
is as low as 10
[
16], the LCG signal shows a linear photoconversion response up to a high level of illuminance. Even though the reset noise in the LCG signal is large due to the uncorrelated double-sampling in
and
, the noise is not visible as long as it is lower than the optical shot noise. It is noted that the voltage difference between
and
is positive because the electric potential at the FD node reduces during the transition from
to
.
A post-processing circuit selects the HCG signal if the LCG signal is lower than a given threshold voltage; conversely, it selects the LCG signal if the LCG signal is higher than the threshold voltage. The LCG signal is also multiplied for signal linearization from low illuminance to high illuminance, and an HDR image is realized thanks to the low-noise HCG signal and the high-FWC LCG signal. However, both HCG and LCG signal readouts should be provided for the post-processing stage. Thus, a two-channel read-out chain is typically utilized for HCG and LCG signals for which the polarity is inverted.
3. Proposed Readout Circuit
A read-out chain for the LOFIC pixel to process both HCG and LCG pixel signals is presented in this section. First, a conceptual view of the voltage domain level diagram is shown to visualize the critical voltage signal. Then, an up/down double-sampling circuit is proposed in accordance with the voltage diagram, along with the evaluation results of the test chip.
3.1. Voltage Domain-Level Diagram
For LOFIC-CMOS image sensors, a voltage domain-level diagram is designed, as shown in
Figure 5. The voltage diagram is given for the pinning voltage of the PD (
), the signal voltage swing at the FD node and at the pixel SF output, and the input window of an ADC.
For the HCG signal shown in
Figure 5a, the voltage gain of the double-sampling circuit needs to be high enough and
is selected to decrease the input-referred circuit noise to achieve a high dynamic range. The input window of the double sampling circuit is therefore provided by 0.1 V for the 0.8 V ADC input window [
2], and the signal voltage swing at the FD node is limited to below 0.118 V with a
source-follower gain. Even though the clock feedthrough caused on small CFDs is as large as 0.2 V when the SG is turned off, the voltage margin used to transfer the photo-electrons integrated in the PD to the FD node is large enough.
For the LCG signal shown in
Figure 5b, to transfer all PD charges to the FD node, the voltage swing at the FD node is limited to below
for
, and a 2.8 V power supply voltage and voltage margin in PVT variations. It is noted that the clock feedthrough caused for CFD and CS is as small as 0.03 V when the RST is turned off. The maximum voltage swing at the FD node is set to be 1.3 V because the FWC is given by
. The input window of the double-sampling circuit is given by 1.105 V with a
source-follower gain, and the gain of the double-sampling circuit is set as
for a 0.8 V ADC input range.
3.2. Read-Out Chain with an up/down Double-Sampling Circuit
A baseline read-out chain that satisfies the voltage domain level diagram is shown in
Figure 6. The LOFIC pixel output signal
is fed to an inverting amplifier when
is high. The voltage difference between the reset level
and signal level
is inverted, amplified by 8 times, and then digitized with a SAR ADC. The inverting amplifier is composed of a sampling capacitor
, a feedback capacitor
, and an amplifier [
24,
25]. The ADC is composed of a sampling capacitor
, an SAR capacitor digital/analog converter (DAC), and a comparator. The LOFIC pixel output signal is fed to the attenuator when
is high. The voltage difference between the signal level
and reset level
is attenuated
times and then digitized with the ADC. The attenuator is composed of a coupling capacitor
, an attenuation capacitor
, and a voltage-follower [
26]. Since the signal polarities of the HCG and LCG signal at the ADC input are the same, the same ADC circuit is used for HCG and LCG signals. However, this two-channel circuit requires a large area and will increase the cost of LOFIC-CMOS image sensor chips. The total capacitance of this baseline read-out chain is 6.29 pF, which can be used to roughly estimate the circuit area that is dominated by the layout area of the capacitors.
In order to reduce the area of the read-out chain, an area-efficient read-out chain with an up/down double-sampling circuit is proposed, as shown in
Figure 7. While the inverting amplifier is the same as the baseline circuit, the attenuator is merged in the ADC. The pixel output signal
is sampled in a
and attenuated with
when
is high, in which the coupling capacitor
also operates as a sampling capacitor of the ADC. The ADC is also shared for the HCG and LCG signals. The attenuation capacitor
is disconnected during the HCG mode when
is turned off. The total capacitance of the proposed double-sampling circuit is 3.29 pF. The area of the proposed read-out chain will be reduced by around
compared to the baseline read-out chain.
Figure 8 shows a timing diagram of the read-out chain with the up/down double-sampling circuit. In the HCG mode,
is high. First,
and
are increased to sample the pixel reset level
and reset the amplifier and the comparator (
). Then,
is decreased to hold
in
(
), and
is decreased to hold the bias voltage difference given by
in a clamp capacitor
(
). After the pixel output voltage
drops to
, the amplifier output voltage
at
is obtained as follows
The comparator input voltage
at
is given by
After this operation, the correlated double-sampling signal with gain is converted into a digital signal with the SAR-ADC when is high.
In the LCG mode,
is high. First,
is increased to sample the pixel signal level
and to reset the comparator (
).
is then reduced to hold
in
(
). After the pixel output voltage
rises to the pixel reset level
, the comparator input voltage
at
is given by
After this operation, the differential double-sampling signal with a gain of is converted into a digital signal with the ADC. Equations (2) and (3) indicate that the signal polarities of HCG and LCG signals at the comparator input are alined.
3.3. Noise Analysis
In the HCG mode, the input-referred circuit noise needs to be low to achieve a high dynamic range. On the other hand, in the LCG mode, the noise requirement can be relaxed as long as the noise of the read-out chain is lower than the photon-shot noise at the switching point between the HCG mode and the LCG mode.
The HCG noise is analyzed with the equivalent circuits shown in
Figure 9, where
,
,
for simplicity. At the sampling of
in
when
is turned off (
), the reset noise of the amplifier,
, is also sampled in
. When
is turned off, the reset noise
, pixel output noise
, amplifier output noise
and comparator reset noise
are sampled in
(
). The total noise
in
,
, is thus given by
During the analog/digital conversion of the HCG signal, the total noise at the comparator input,
, is given by
Since the amplifier reset noise is removed, the total HCG noise is simulated with the sum of the noise at and the noise at . The input-referred noise is given by .
The LCG noise is analyzed with equivalent circuits shown in
Figure 10, where
for simplicity. When the LCG signal voltage
is sampled in
, with
turned off, the pixel output noise
and the comparator reset noise
are also sampled in
(
). The total noise
held in
,
, is thus given by
During the analog/digital conversion of the LCG signal, the total noise at the comparator input,
, is given by
The noise
is lower than that of the baseline circuit (
Figure 6) in which the voltage-follower noise is also imposed. The LCG noise is estimated using the sum of the AC noise simulation results with the pulse signal-setting at
and
. The input-referred noise is given by
.
SPICE simulation results are summarized in
Table 1. The input-referred HCG noise is given by
. The input referred LCG noise is given by 545.9
. Since the LCG noise of the baseline circuit is 652.6
, the LCG noise of the proposed double-sampling circuit is lower than that of the baseline circuit by
. The total capacitance and LCG noise of the baseline circuit and proposed double-sampling circuit is summarized in
Table 2.
4. Fabrication and Evaluation of a Test Chip
In order to verify the concept of the proposed read-out chain, a test circuit, which is shown in
Figure 11, was fabricated with the
m 1P5M CMOS process and with MIM capacitors. The pseudo-pixel signal is supplied from external voltages, namely the HCG and LCG reset voltage VR, HCG signal voltage VSH, and LCG signal voltage VSL. An output buffer is implemented in the test chip to drive an off-chip 12-bit SAR-ADC.
A photograph of the fabricated test chip is shown in
Figure 12. The 160 column of the up/down double-sampling circuits are laid in parallel to represent the layout constraint in the CMOS image sensor. The column pitch is 6.02
m, which is obtained according to the minimum design rule of an MIM capacitor. The layout height of a column double sampling circuit is 977
m. Since the capacitance density of the MIM capacitor is as low as 1.0 fF/
m
,
of the layout area of the column double-sampling circuit is occupied by the capacitors.
The measurement setup of the test chip is shown in
Figure 13. The fabricated chip, the off-chip 12-bit ADC, and an FPGA is mounted on a PCB board. The power supply voltage Vdd and pseudo-pixel voltage VR, VSH and VSL are supplied from external power sources. The control signal of the test chip is supplied by an FPGA. The digital output of the ADC was transferred to the PC via USB and then analyzed.
Figure 14a shows the measured input and output characteristics, where the X-axis differs between reset and signal voltages, as it is VR−VSH for HCG or VR−VSL for LCG, and the Y-axis is the output voltage swing. The power supply voltage Vdd varied from 2.6 V to 3.0 V. The HCG output signal below a 0.8 V ADC input window shows high gains for a small input signal and is saturated for a large input signal. The LCG output signal is not saturated for a large input signal, and the input window of the double-sampling circuit is 1.19 V for a 0.8 V ADC input window.
Figure 14b shows the gain in the double-sampling circuit derived from the input and output characteristics. The gain of the HCG signal was
for a small input signal, but lower than our target value of
. The root cause is supposed to be a parasitic capacitance caused in a narrow 6.02
m pitch layout. The gain decreases as the output signal is saturated for a large input signal. The minimum confidence interval with a
slope is 0.18 V under a 2.6 V power supply voltage, and the minimum output range for the HCG signal is 1.03 V; these results are wider than a 0.15 V double-sampling input window and a 0.8 V ADC input window. The gain of the LCG signal is constant over a 1.19 V double-sampling input window. The measured gain was
, which is also lower than our target value of
.
Next, the measured noise for HCG and LCG is listed in
Table 3. The input-referred dark noise values at
are, respectively, 130.6
at HCG and 452.9
at LCG, which are close to the noise values from the SPICE simulation results, The HCG and LCG conversion gain of the LOFIC pixel are, respectively, supposed to be 160
, 10
according to our previous work [
16]. Considering the SF gain as
, the expected input-referred HCG noise at FD node is converted to
, while the 1.19 V LCG input window at FD node is converted to 140 ke
. Thus, the dynamic range of the proposed read-out chain is given by
. The specifications and performance of the proposed up/down double-sampling circuit are summarized in
Table 4.
Discussion
The test chip was fabricated with an MIM capacitor whose capacitance density is only 1.0 fF/m, and of the layout area of the column double-sampling circuit was occupied by the capacitors. In a CMOS image sensor, a depletion MOS capacitor is typically utilized. For the case of a 3.3 V MOS transistor with a 75 Åoxide thickness, the capacitance density is 4.5 fF/m. Therefore, the layout height of the column double-sampling circuit will be reduced by if the proposed double-sampling is implemented in LOFIC-CMOS image sensors.
The gain of the HCG signal was
, which is lower than our target value
. The root cause is supposed to be a parasitic capacitance. In the narrow 6.02
m pitch layout, a wiring to the negative input of the amplifier and a wiring from the amplifier output are laid in parallel, and the parasitic capacitance between the wires increases the feedback capacitor
. According to Equation (
2), the gain decreases as
increases. The MIM capacitor of
will be reduced considering the degradation of the gain in our future work. Furthermore, the higher-density MOS capacitor will decrease the length of the wire and will reduce the parasitic capacitor. The input-referred total noise will be reduced further by adjusting the gain to
. The gain of the LCG signal was
which is also lower than our target value
. As a result, the voltage swing at FD node is over the limit to transfer all PD charge to the FD node. The voltage swing at FD node will be decreased to the limit by adjusting the gain to
. Even though the LCG FWC on LCG will be decreased, the dynamic range will be kept, since the noise on HCG will also be decreased.
The noise of the double-sampling circuit is required to be less than the pixel noise.
Figure 15 plots the measured double-sampling circuit noise and the theoretical pixel noise. In the HCG mode, the pixel noise plot is obtained by using the photon shot noise that follows
for the input signal
. The measured double-sampling circuit noise is lower than the pixel noise. For input signals above 1.0 k e
, the HCG signal is saturated and the LCG signal is selected. In the LCG mode, the pixel noise is characterized as the photon shot noise and the FD reset noise, which is given by
, where k is the Boltzmann constant, T is the absolute temperature, and C is the capacitance value of CFD and CS. The FD noise is not cancelled due to the non-correlated double-sampling operations. The double-sampling circuit noise is high in the LCG mode; however, this is still less than the pixel noise, which is
at the transition point to the LCG mode.
5. Conclusions
An SEHDR-CMOS image sensor is realized with LOFIC pixels, in which the LCG signal and HCG signals are combined. However, the circuit area for the LOFIC pixel is large due to the two-channel read-out chain for polarity-inverted LCG and HCG signals. In order to realize a single-channel read-out chain and to reduce the chip cost of LOFIC-CMOS image sensors, an up/down double-sampling circuit composed of a inverting amplifier and non-inverting attenuator is proposed in this paper. Even though the polarity of the LCG and HCG signals output from the LOFIC pixel is inverted, the polarity of the input signal to a following ADC is the same and a single ADC can process both the HCG and LCG signals. Moreover, the attenuator is merged with the ADC to further decrease the area of the double-sampling circuit. The area of the proposed read-out chain is roughly reduced by compared to the baseline two-channel read-out chain.
For LOFIC-CMOS image sensors, a voltage domain-level diagram is designed. The voltage gain of the double-sampling circuit in the HCG mode is selected to be to decrease the input-referred circuit noise. The gain of the double-sampling circuit at the LCG mode is selected to be to maximize FWC. In order to verify the concept of the proposed read-out chain, a test circuit is fabricated with a 0.18 m CMOS process. According to the measurement results, the LCG input window of the double-sampling circuit is 1.19 V, while the input-referred dark noise for the HCG signal is 130.6 V. Supposing the pixel conversion gain of LOFIC-pixel, the dynamic range of the proposed read-out chain can be obtained at 103 dB using the expected input-referred HCG noise and LCG input window. It is also confirmed that the measured noise of the double-sampling circuit is less than the theoretical pixel noise throughout the input range of HCG and LCG.