JP7047857B2 - Image sensor and image sensor - Google Patents

Description

The present invention relates to an image pickup device and an image pickup apparatus.

An electronic device including an image pickup device in which a back-illuminated image pickup chip and a signal processing chip are laminated (hereinafter referred to as a stacked image pickup device) has been proposed (see Patent Document 1). In the stacked image sensor, the back-illuminated image pickup chip and the signal processing chip are laminated so as to be connected to each other by a predetermined region via micro bumps.

Japanese Unexamined Patent Publication No. 2006-49361

However, in the conventional image sensor, there are not many proposals to divide an image into the above regions and acquire an image captured in each region, and it cannot be said that the usability of the image sensor is sufficient.

The image pickup elements according to the present invention are arranged side by side in the row direction, and transfer a plurality of photoelectric conversion units that convert light into electric charges and a charge converted by the first photoelectric conversion unit among the plurality of photoelectric conversion units. A transfer unit, a second transfer unit that transfers charges converted by a second photoelectric conversion unit arranged next to the first photoelectric conversion unit among the plurality of photoelectric conversion units, and a plurality of the transfer units. The photoelectric conversion unit includes a third transfer unit that transfers charges converted by the third photoelectric conversion unit, and the second photoelectric conversion unit includes the first photoelectric conversion unit and the third photoelectric conversion unit in the row direction. The first transfer timing, which is arranged between the conversion unit and starts the transfer of the charge converted by the first photoelectric conversion unit by the first transfer unit, and the second photoelectric conversion unit by the second transfer unit. The period between the second transfer timing at which the transfer of the converted charge is started is the second transfer timing and the transfer of the charge converted by the third photoelectric conversion unit by the third transfer unit is started. 3 Shorter than the period between transfer timings .

According to the present invention, it is possible to realize an image pickup device that is easy to use by suppressing image distortion at a boundary portion that partitions a unit area.

It is sectional drawing of the laminated type image sensor. It is a figure explaining the pixel arrangement and the unit area of an image pickup chip. It is a figure explaining the circuit of a unit area. It is a block diagram which shows the functional structure of an image pickup device. It is a figure which illustrates the arrangement of the unit area on the image pickup surface of an image pickup element, and the arrangement of a cell. FIG. 6 (a) is a diagram illustrating read control for pixels included in four unit areas in a cell, and FIG. 6 (b) shows the read order of pixel signals read by the read control of FIG. 6 (a). It is a figure which shows. It is a figure which shows the reading order of the pixel signal about four adjacent cells. It is a block diagram which illustrates the structure of the image pickup apparatus by one Embodiment. It is a figure which illustrates the pixel string for a focal point detection. FIG. 10 (a) is a diagram illustrating read control for pixels included in the four unit regions in the cell in the modification 1, and FIG. 10 (b) is a pixel signal read by the read control of FIG. 10 (a). It is a figure which shows the reading order of. It is a figure which shows the reading order of the pixel signal by the modification 1 about four adjacent cells. FIG. 12 (a) is a diagram illustrating read control for pixels included in the four unit regions in the cell in the modified example 5, and FIG. 12 (b) is a pixel signal read by the read control of FIG. 12 (a). It is a figure which shows the reading order of.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
<Explanation of stacked image sensor>
First, a stacked image sensor 100 mounted on an electronic device (for example, an image pickup device 1) according to an embodiment of the present invention will be described. The laminated image sensor 100 is described in Japanese Patent Application No. 2012-139026 previously filed by the applicant of the present application. FIG. 1 is a cross-sectional view of the stacked image sensor 100. The image pickup device 100 includes a back-illuminated image pickup chip 113 that outputs a pixel signal corresponding to incident light, a signal processing chip 111 that processes the pixel signal, and a memory chip 112 that stores the pixel signal. The image pickup chip 113, the signal processing chip 111, and the memory chip 112 are laminated and electrically connected to each other by a conductive bump 109 such as Cu.

As shown in the figure, the incident light is mainly incident in the Z-axis plus direction indicated by the white arrow. In the present embodiment, in the image pickup chip 113, the surface on the side where the incident light is incident is referred to as a back surface. Further, as shown in the coordinate axes, the left direction of the paper surface orthogonal to the Z axis is defined as the X-axis plus direction, and the Z-axis and the front direction of the paper surface orthogonal to the X-axis are defined as the Y-axis plus direction. In some of the subsequent figures, the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes of FIG.

An example of the image pickup chip 113 is a back-illuminated MOS image sensor. The PD layer 106 is arranged on the back surface side of the wiring layer 108. The PD layer 106 has a plurality of PDs (photodiodes) 104 arranged two-dimensionally and accumulating charges according to incident light, and a transistor 105 provided corresponding to the PD 104.

A color filter 102 is provided on the incident side of the incident light in the PD layer 106 via the passivation film 103. The color filter 102 has a plurality of types that transmit different wavelength regions from each other, and has a specific arrangement corresponding to each of the PD 104. The arrangement of the color filters 102 will be described later. A set of a color filter 102, a PD 104, and a transistor 105 forms one pixel.

A microlens 101 is provided on the incident side of the incident light in the color filter 102 corresponding to each pixel. The microlens 101 collects incident light toward the corresponding PD 104.

The wiring layer 108 has a wiring 107 that transmits a pixel signal from the PD layer 106 to the signal processing chip 111. The wiring 107 may have multiple layers, and may be provided with passive elements and active elements.

A plurality of bumps 109 are arranged on the surface of the wiring layer 108. The plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the facing surfaces of the signal processing chip 111, and the image pickup chip 113 and the signal processing chip 111 are aligned by being pressurized or the like. The bumps 109 are joined together and electrically connected.

Similarly, a plurality of bumps 109 are arranged on the surfaces of the signal processing chip 111 and the memory chip 112 facing each other. These bumps 109 are aligned with each other, and the signal processing chip 111 and the memory chip 112 are pressurized, so that the aligned bumps 109 are joined to each other and electrically connected.

The bonding between the bumps 109 is not limited to the Cu bump bonding by solid phase diffusion, but the micro bump bonding by solder melting may be adopted. Further, for example, about one bump 109 may be provided for one unit area described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. Further, in the peripheral region other than the pixel region in which the pixels are arranged, a bump larger than the bump 109 corresponding to the pixel region may be provided together.

The signal processing chip 111 has TSVs (Through Silicon Vias) 110 that connect circuits provided on the front and back surfaces to each other. The TSV 110 is preferably provided in the peripheral region. Further, the TSV 110 may also be provided in the peripheral area of the image pickup chip 113 and the memory chip 112.

FIG. 2 is a diagram illustrating a pixel arrangement of the image pickup chip 113 and a unit region 131. In particular, the state in which the image pickup chip 113 is observed from the back surface side is shown. For example, 20 million or more pixels are arranged in a matrix in the pixel area. In the present embodiment, for example, 16 pixels of adjacent 4 pixels × 4 pixels form one unit region 131. The grid lines in the figure show the concept that adjacent pixels are grouped to form a unit region 131. The number of pixels forming the unit region 131 is not limited to this, and may be about 1000, for example, 32 pixels × 64 pixels, or more or less.

As shown in the partially enlarged view of the pixel region, the unit region 131 includes four so-called Bayer arrays including four pixels of green pixels Gb, Gr, blue pixels B, and red pixels R in the vertical and horizontal directions. The green pixel is a pixel having a green filter as the color filter 102, and receives light in the green wavelength band among the incident light. Similarly, the blue pixel is a pixel having a blue filter as a color filter 102 and receives light in the blue wavelength band, and the red pixel is a pixel having a red filter as the color filter 102 and receives light in the red wavelength band. Receive light.

In the present embodiment, a plurality of blocks are defined so as to include at least one unit region 131 per block, and each block can control the pixels included in each block with different control parameters. That is, it is possible to acquire an imaging signal having different imaging conditions between the pixel group included in a certain block and the pixel group included in another block. Examples of control parameters are frame rate, gain, decimation rate, number of rows or columns to be added to add pixel signals, charge accumulation time or number of times, digitization bits, and the like. Further, the control parameter may be a parameter in image processing after the image signal is acquired from the pixel.

FIG. 3 is a diagram illustrating a circuit in a unit area. In FIG. 3, the unit region 131 is formed by 9 pixels of adjacent 3 pixels × 3 pixels. The number of pixels included in the unit area 131 is not limited to this. The two-dimensional position of the unit region 131 is indicated by pixels A and the like.

The pixel reset transistors included in the unit region 131 are individually turned on and off for each pixel. In the example shown in FIG. 3, a reset wiring 300 for turning on / off the reset transistor of the pixel A is provided, and a reset wiring 310 for turning on / off the reset transistor of the pixel B is provided separately from the reset wiring 300. Similarly, the reset wiring 320 for turning on and off the reset transistor of the pixel C is provided separately from the reset wirings 300 and 310. A dedicated line for turning on / off each reset transistor is also arranged from the other pixel D to the pixel I.

The pixel transfer transistors included in the unit region 131 are also turned on and off individually for each pixel. In the example shown in FIG. 3, the transfer wiring 302 for turning on / off the transfer transistor of pixel A, the transfer wiring 312 for turning on / off the transfer transistor of pixel B, and the transfer wiring 322 for turning on / off the transfer transistor of pixel C are separately provided. .. A dedicated line for selecting each transfer transistor is also arranged from the other pixel D to the pixel I.

The pixel selection transistors included in the unit region 131 are also turned on and off individually for each pixel. In the example shown in FIG. 3, the selection wiring 306 for turning on / off the selection transistor of pixel A, the selection wiring 316 for turning on / off the selection transistor of pixel B, and the selection wiring 326 for turning on / off the selection transistor of pixel C are separately provided. .. A dedicated line for selecting each selection transistor is also arranged for the other pixels D to the pixel I.

The power supply wiring 304 is commonly connected by pixels I from each pixel A included in the unit area 131. Similarly, the output wiring 308 is commonly connected by pixels I from each pixel A included in the unit area 131. Further, the power supply wiring 304 is commonly connected between the plurality of unit areas, but the output wiring 308 is provided for each unit area.

By turning on / off the reset transistor and the transfer transistor of the unit region 131 individually, each pixel A included in the unit region 131 includes the charge accumulation start time, the accumulation end time, and the transfer timing independently of the pixel I. Charge accumulation can be controlled. Further, by individually turning on and off the selection transistor of the unit region 131, the pixel signal of the pixel I can be output from each pixel A via the common output wiring 308.

Here, there is a so-called rolling shutter method in which charge accumulation is controlled in a regular order with respect to rows and columns for pixels A to I included in the unit region 131. In the rolling shutter method, since the pixels are selected for each row and then the columns are specified, the pixel signals are output in the order of "ABCDEFGHI" in the example of FIG.

By configuring the circuit with the unit region 131 as a reference in this way, the charge accumulation time can be controlled for each unit region 131. In other words, pixel signals with different frame rates can be output between the unit regions 131. Furthermore, while one unit region 131 is made to perform one charge accumulation, the other unit region 131 is made to repeat charge accumulation many times to output a pixel signal each time. It is also possible to output each frame for moving images at different frame rates between the unit areas 131.

FIG. 4 is a block diagram showing a functional configuration of the image pickup device 100. The analog multiplexer 411 sequentially selects nine PD 104s forming the unit region 131, and outputs each pixel signal to the output wiring 308 provided corresponding to the unit region 131. The multiplexer 411 is formed on the image pickup chip 113 together with the PD 104.

The pixel signal output via the multiplexer 411 is CDS and A / by a signal processing circuit 412 formed on the signal processing chip 111 for performing correlated double sampling (CDS) analog / digital (A / D) conversion. D conversion is performed. The A / D converted pixel signal is passed to the demultiplexer 413 and stored in the pixel memory 414 corresponding to each pixel. The demultiplexer 413 and the pixel memory 414 are formed on the memory chip 112.

The arithmetic circuit 415 processes the pixel signal stored in the pixel memory 414 and hands it over to the image processing unit in the subsequent stage. The arithmetic circuit 415 may be provided on the signal processing chip 111 or the memory chip 112. Note that FIG. 4 shows the connections for one unit area 131, but in reality, these exist for each unit area 131 and operate in parallel. However, the arithmetic circuit 415 does not have to exist for each unit region 131. For example, even if one arithmetic circuit 415 processes sequentially while referring to the values of the pixel memory 414 corresponding to each unit region 131 in order. good.

As described above, the output wiring 308 is provided corresponding to each of the unit regions 131. Since the image pickup element 100 has an image pickup chip 113, a signal processing chip 111, and a memory chip 112 laminated, each chip can be oriented in the plane direction by using an electrical connection between the chips using the bump 109 for the output wiring 308. Wiring can be routed without making it large.

The pixel sequential readout control for the unit area 131 is performed in coordination with the control performed independently for each of the four adjacent unit areas 131. Here, for convenience, the four adjacent unit regions 131 are named cell C. FIG. 5 is a diagram illustrating an arrangement of unit regions 131 and an arrangement of cells C on the image pickup surface of the image pickup device 100 (imaging chip 113).

FIG. 6 is an enlarged view of one cell C in FIG. 5, and FIG. 6A is a diagram illustrating read control for pixels included in the four unit regions 131a to 131d in the cell C. In FIG. 6A, 16 pixels are included in each of the four adjacent unit regions 131a to 131d. In the present embodiment, among the unit regions 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines partitioning the four unit regions 131a to 131d is read out as the start pixel (indicated by diagonal lines in FIG. 6A). Show). Then, the pixel signal is sequentially read out in the direction away from the point P in the horizontal direction and the direction away from the point P in the vertical direction, and the pixel at the position farthest from the point P in each unit region 131a to 131d is read out and completed. Let it be a pixel.

Specifically, in the case of the unit area 131a, reading is performed vertically upward while reading from the reading start pixel located at the lower right in the horizontal left direction, and the reading is read sequentially up to the reading end pixel located at the upper left. Be controlled. As a result, the pixel signals of 16 pixels forming the unit region 131a are sequentially read out.

In the case of the unit area 131b, the reading is controlled so as to scan vertically downward while reading from the reading start pixel located in the upper right in the horizontal left direction, and read in sequence to the reading end pixel located in the lower left. As a result, the pixel signals of 16 pixels forming the unit region 131b are sequentially read out.

In the case of the unit area 131c, the reading is controlled so as to scan vertically upward while reading from the reading start pixel located at the lower left in the horizontal right direction, and read in sequence to the reading end pixel located at the upper right. As a result, the pixel signals of 16 pixels forming the unit region 131c are sequentially read out.

In the case of the unit area 131d, the reading is controlled so as to scan vertically downward while reading from the reading start pixel located at the upper left in the horizontal right direction, and read in sequence to the reading end pixel located at the lower right. As a result, the pixel signals of 16 pixels forming the unit region 131d are sequentially read out.

When the read control in each of the four unit regions 131a to 131d is performed in parallel at the same timing in the cell C, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times in order. Is read out.

FIG. 6B is a diagram showing the reading order of the pixel signals read by the reading control exemplified in FIG. 6A. No. 1 corresponds to the read start pixel, and No. 16 corresponds to the read end pixel. Since each of the four unit regions 131a to 131d is performed in parallel at the same timing, pixel signals are read out from the four pixels indicated by the same numbers in the cell C at the same timing. According to FIG. 6B, pixel signals are read out at the same timing from pixels that are vertically adjacent to each other with a horizontal boundary line partitioning the four unit regions 131a to 131d. Further, pixel signals are also read out at the same timing from pixels adjacent to the left and right with a vertical boundary line partitioning the four unit areas 131a to 131d.

When the read-out control for coordinating the control performed independently for each of the four adjacent unit regions described above is performed in parallel in all the cells C exemplified in FIG. 5 at the same timing, all the cells included in the image pickup chip 113 are included. The pixel signal of the pixel is read out in order in 16 steps.

FIG. 7 is a diagram showing the reading order of the pixel signals read by the reading control described above for the four adjacent cells C. No. 1 corresponds to the read start pixel, and No. 16 corresponds to the read end pixel. Since each of the four cells C is performed in parallel at the same timing, pixel signals are read out from the 16 pixels represented by the same numbers in FIG. 7 at the same timing.

According to FIG. 7, pixel signals are read out at the same timing from pixels that are vertically adjacent to each other with a horizontal boundary line that partitions the four adjacent cells C. Further, pixel signals are also read out at the same timing from pixels adjacent to the left and right with a vertical boundary line partitioning the four adjacent cells C.

As described above, according to the present embodiment, pixel signals acquired at the same timing are obtained from pixels adjacent to each other on the upper, lower, left and right sides of the boundary line partitioning the four unit regions 131a to 131d constituting the cell C. be able to. Further, pixel signals acquired at the same timing can be obtained from pixels adjacent to the top, bottom, left and right with a boundary line partitioning the adjacent four cells C.

When pixel sequential reading is performed, as described above, the charge accumulation timing is slightly shifted between the 16 pixels forming the unit region 131. This timing shift appears as image distortion when a moving subject is photographed by the image pickup apparatus 1.

Such image distortion also occurs at the boundary between the unit region 131 and the unit region 131, but in the present embodiment, the boundary line partitioning the four unit regions 131a to 131d constituting the cell C is interposed therebetween. Since the readout control is performed so that the acquisition timings of the pixel signals are the same between the adjacent pixels, the image distortion at the boundary portion partitioning the four unit regions 131a to 131d in the cell C (pixel signals are generated on both sides of the boundary portion). Image cracking caused by large differences) can be prevented.

Further, the distortion of the image as described above also occurs at the boundary between the adjacent cells C and the cells C, but in the present embodiment, the pixels adjacent to each other across the boundary line partitioning the adjacent four cells C. Since the readout control is performed so that the acquisition timings of the pixel signals are the same, image distortion (image cracking caused by large differences in the pixel signals on both sides of the boundary portion) at the boundary portion partitioning the adjacent cell C is also prevented. Can be.

<Explanation of imaging device>
FIG. 8 is a block diagram illustrating the configuration of the image pickup apparatus 1 having the above-mentioned image pickup element 100. In FIG. 8, the image pickup apparatus 1 includes an image pickup optical system 10, an image pickup unit 20, an image processing unit 30, a work memory 40, a display unit 50, a recording unit 60, and a control unit 70.

The image pickup optical system 10 is composed of a plurality of lenses, and guides a light flux from the field of view to the image pickup unit 20. The image pickup optical system 10 may be integrally configured with the image pickup device 1 or may be interchangeably configured with respect to the image pickup device 1. Further, the image pickup optical system 10 may have a built-in focus lens or a built-in zoom lens.

The image pickup unit 20 includes the above-mentioned image pickup element 100 and a drive unit 21 that drives the image pickup element 100. By driving and controlling the image sensor 100 by a control signal output from the driving unit 21, as described above, it is possible to perform readout control in which control is performed independently for each of the four adjacent unit regions in a coordinated manner. The control unit 70 gives an instruction for read control to the drive unit 21.

The image processing unit 30 cooperates with the work memory 40 to perform image processing on the image data captured by the image pickup unit 20. In the present embodiment, the image processing unit 30 also performs detection processing of a main subject included in the image in addition to normal image processing (color signal processing, gamma correction, etc.). The image processing unit 30 can detect the main subject by using a known face detection function. Further, in addition to face detection, for example, as described in Japanese Patent Application Laid-Open No. 2010-16621 (US2010 / 0002940), the human body included in the image may be detected as the main subject.

The work memory 40 temporarily stores image data before and after JPEG compression and before and after MPEG compression. The display unit 50 is composed of, for example, a liquid crystal display panel 51, and displays images (still images and moving images) captured by the image pickup unit 20 and various information, and displays an operation input screen. The display unit 50 has a configuration in which the touch panel 52 is laminated on the display surface of the liquid crystal display panel 51. The touch panel 52 outputs a signal indicating a position where the user touches the liquid crystal display panel 51.

The recording unit 60 stores various data such as image data acquired in response to this imaging instruction (release operation by a release button (not shown)) in a storage medium such as a memory card. The control unit 70 has a CPU and controls the entire operation by the image pickup device 1. The control unit 70 coordinates to acquire an image at a predetermined frame rate and gain in each unit region 131 of the image sensor 100 (imaging chip 113), and to perform control independently for each of the four adjacent unit regions. A control parameter is instructed to the drive unit 21 so as to perform read control.

Further, the control unit 70 causes the AE and AWB calculation units 72 to perform automatic exposure calculation and determination of the white balance adjustment value based on the pixel signal read from the image sensor 100. The AE and AWB calculation units 72 calculate the exposure (exposure time, gain, etc.) so that, for example, the average level of the pixel signal approaches a predetermined level. Further, the AE and AWB calculation units 72 determine the adjustment value used to express the white color as white.

Further, the control unit 70 causes the AF (autofocus) calculation unit 71 to calculate the focus adjustment state by the image pickup optical system 10 based on the pixel signal read from the image pickup element 100. The AF calculation unit 71 detects the focus adjustment state by the phase difference detection method. For this reason, focus detection pixels are provided in place of the image pickup pixels at predetermined positions on the image pickup surface of the image pickup device 100 (image pickup chip 113). FIG. 9 is a diagram illustrating the pixel rows 91 to 95 for focus detection.

For example, when acquiring a live view image, the AF calculation unit 71 performs a phase difference detection calculation using output signals from the focus detection pixels constituting the pixel rows 91 to 95, thereby adjusting the focus by the imaging optical system 10. The state (specifically, the amount of defocus) is detected. The live view image is also called a preview image before the main image pickup (imaging performed in response to the release operation) is performed, and refers to an image for a monitor acquired by the image pickup element 100 at a predetermined frame rate (for example, 30 fps). Since the pixel for focus detection and the phase difference detection operation are known as described in, for example, Japanese Patent Application Laid-Open No. 2009-94881, detailed description thereof will be omitted. The control unit 70 adjusts the focus on the main subject by moving the position of the focus lens constituting the image pickup optical system 10 according to the defocus amount calculated by the AF calculation unit 71.

Here, the influence of the image distortion generated during pixel sequential readout on the AF calculation (phase difference detection calculation) will be described. As described above, the difference in charge accumulation timing between pixels when sequentially reading pixels appears as image distortion when a moving subject is photographed. As illustrated in FIG. 9, when the pixel rows 91 to 95 are provided so as to straddle between the plurality of cells C, the pixel rows 91 to 95 also straddle between the unit regions 131 included in the cell C. Become.

Assuming that the control for making the acquisition timing of the pixel signal the same is not performed between the pixels for focus detection adjacent to each other with the boundary line partitioning the unit areas 131a to 131d described above, the boundary line is sandwiched. Therefore, the phase difference information will be significantly different, and the detection accuracy of the focus adjustment state (specifically, the defocus amount) will be deteriorated.

However, in the present embodiment, since the reading control is performed so that the acquisition timing of the pixel signal is the same between the pixels adjacent to each other across the boundary line partitioning the four unit regions 131a to 131d constituting the cell C, the cell is used. It is possible to prevent a decrease in the detection accuracy of the focus adjustment state (specifically, the defocus amount) at the boundary portion partitioning the four unit regions 131a to 131d in C.

Further, the phenomenon in which the phase difference information is significantly different across the boundary line as described above may occur at the boundary between the adjacent cells C and C. However, in the present embodiment, the four adjacent cells C Since the readout control is performed so that the acquisition timing of the pixel signals is the same between the adjacent pixels across the boundary line that partitions the adjacent cells C, the focus adjustment state (specifically, the defocus amount) at the boundary portion that partitions the adjacent cells C. It is also possible to prevent a decrease in the detection accuracy of.

According to the embodiment described above, the following effects can be obtained.
(1) The image pickup device 100 has a plurality of pixels, and the image pickup chip 113 in which a plurality of unit regions 131 capable of reading pixel signals of sequentially selected pixels are arranged and each unit region 131 adjacent to each other Includes an output wiring 308 that outputs pixel signals by sequentially selecting pixels from the adjacent unit regions 131 at substantially the same time in the mutually adjacent unit regions 131 in a direction symmetric with respect to the adjacent boundary line. I did it. As a result, the acquisition timing of the pixel signal can be made the same between the pixels adjacent to each other across the boundary line partitioning the unit area 131, so that the image is distorted at the boundary portion partitioning the unit area 131 (pixel signals are generated on both sides of the boundary portion). It is possible to obtain a high-quality image by suppressing (image cracking caused by a large difference).

(2) In the image pickup element 100 of the above (1), the output wiring 308 has two vertically adjacent unit regions (131a and 131b, 131c and 131d) for each of two vertically adjacent unit regions (131a and 131a). And 131b, 131c and 131d), pixels are sequentially selected in a direction symmetrical to the horizontal boundary line that divides two vertically adjacent unit regions, and a pixel signal is output. As a result, the acquisition timing of the pixel signal can be made the same between the pixels adjacent to the top and bottom of the horizontal boundary line that partitions the unit area 131, so that the image is distorted at the boundary portion that partitions the unit area 131 (both sides of the boundary portion). It is possible to obtain a high-quality image by suppressing image cracking caused by a large difference in pixel signals.

(3) In the image pickup element 100 of (1) above, the output wiring 308 has two horizontally adjacent unit regions (131a and 131c, 131b and 131d) for each two horizontally adjacent unit regions (131a). And 131c, 131b and 131d) at substantially the same time, pixels are sequentially selected in a direction symmetric with respect to the vertical boundary line that divides two horizontally adjacent unit regions, and a pixel signal is output. As a result, the acquisition timing of the pixel signal can be made the same between the pixels adjacent to the left and right sides of the vertical boundary line that partitions the unit area 131, so that the image is distorted at the boundary portion that partitions the unit area 131 (both sides of the boundary portion). It is possible to obtain a high-quality image by suppressing image cracking caused by a large difference in pixel signals.

(4) In the image pickup element 100 of the above (1), the output wiring 308 has four unit regions (131a, 131b) for every four unit regions (131a, 131b, 131c, 131d) adjacent in the vertical direction and the horizontal direction. , 131c, 131d) at approximately the same time, pixels are sequentially selected in a direction symmetrical to the intersection P of the boundary lines in the vertical and horizontal directions that partition the four unit regions, and a pixel signal is output. As a result, the acquisition timing of the pixel signal can be made the same between the pixels adjacent to the top, bottom, left and right with the boundary line partitioning the unit areas 131a to 131d, so that the image at the boundary portion partitioning the unit areas 131a to 131d can be made the same. It is possible to obtain a high-quality image by suppressing the distortion (image cracking caused by a large difference in pixel signals on both sides of the boundary portion).

(5) In the image pickup devices 100 of the above (1) to (4), since the plurality of pixels include the image pickup pixel and the focus detection pixel, in addition to suppressing image cracking at the boundary portion partitioning the unit region 131. It is also possible to suppress a decrease in the detection accuracy of the focus adjustment state (specifically, the defocus amount) at the boundary portion partitioning the unit region 131.

(6) In the image pickup device 1 of the above (5), since the image pickup chip 113 and the signal processing chip 111 for processing the signal from the image pickup chip 113 are laminated, each chip is not enlarged in the plane direction. The image pickup device 100 can be compactly configured.

(7) Since the image pickup device 1 which is an example of an electronic device includes a camera unit having an image pickup element 100, it is possible to provide an image pickup device 1 for obtaining a high-quality image.

(Modification 1)
The reading direction for the pixels included in the four unit regions 131a to 131d in the cell C may be different from that of the above-described embodiment. FIG. 10 is an enlarged view of one cell C in FIG. 5, and FIG. 10 (a) illustrates read control for pixels included in the four unit regions 131a to 131d in the cell C in the modified example 1. It is a figure. In FIG. 10A, 16 pixels are included in each of the four adjacent unit regions 131a to 131d.

In the first modification, among the unit regions 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines partitioning the four unit regions 131a to 131d is read out as a pixel (indicated by diagonal lines in FIG. 10A). Show). Then, in the horizontal direction, the pixel signal is sequentially read out in a pixel-sequential manner in a direction away from the point P and then back to the point P side, and in a vertical direction away from the point P, and is vertical in each unit region 131a to 131d. The pixel at the position farthest from the point P in the direction is defined as the read end pixel.

In the case of the unit area 131a, scanning is performed vertically upward while repeating the operation of reading horizontally to the left from the reading start pixel located at the lower right, folding back, and reading horizontally to the right, and sequentially pixels up to the reading end pixel located at the upper right. Read control is performed so that it is read. As a result, the pixel signals of 16 pixels forming the unit region 131a are sequentially read out.

In the case of the unit area 131b, scanning is performed vertically downward while repeating the operation of reading horizontally to the left from the reading start pixel located in the upper right, folding back, and reading in the horizontal right direction, and sequentially pixels up to the reading end pixel located in the lower right. Read control is performed so that it is read. As a result, the pixel signals of 16 pixels forming the unit region 131b are sequentially read out.

In the case of the unit area 131c, while repeating the operation of reading horizontally to the right from the reading start pixel located at the lower left, folding back, and reading horizontally to the left, scanning is performed vertically upward, and the reading end pixels located at the upper left are sequentially pixeled. Read control is performed so that it is read. As a result, the pixel signals of 16 pixels forming the unit region 131c are sequentially read out.

In the case of the unit area 131d, while repeating the operation of reading horizontally to the right from the reading start pixel located at the upper left, folding back, and reading horizontally to the left, scanning is performed vertically downward, and the pixels are sequentially read up to the reading end pixel located at the lower left. Read control is performed so as to read to. As a result, the pixel signals of 16 pixels forming the unit region 131d are sequentially read out.

When the read control in each of the four unit regions 131a to 131d is performed in parallel at the same timing in the cell C, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times in order. Is read out.

FIG. 10B is a diagram showing the reading order of the pixel signals read by the reading control exemplified in FIG. 10A. No. 1 corresponds to the read start pixel, and No. 16 corresponds to the read end pixel. Since each of the four unit regions 131a to 131d is performed in parallel at the same timing, pixel signals are read out from the four pixels indicated by the same numbers in the cell C at the same timing. According to FIG. 10B, pixel signals are read out at the same timing from pixels that are vertically adjacent to each other with a horizontal boundary line partitioning the four unit regions 131a to 131d. Further, pixel signals are also read out at the same timing from pixels adjacent to the left and right with a vertical boundary line partitioning the four unit areas 131a to 131d.

When the read-out control for coordinating the control performed independently for each of the four adjacent unit regions described above is performed in parallel in all the cells C exemplified in FIG. 5 at the same timing, all the cells included in the image pickup chip 113 are included. The pixel signal of the pixel is read out in order in 16 steps. FIG. 11 is a diagram showing the reading order of the pixel signals read by the reading control according to the modification 1 for the four adjacent cells C. No. 1 corresponds to the read start pixel, and No. 16 corresponds to the read end pixel. Since each of the four cells C is performed in parallel at the same timing, pixel signals are read out from the 16 pixels represented by the same numbers in FIG. 11 at the same timing.

According to FIG. 11, pixel signals are read out at the same timing from pixels that are vertically adjacent to each other with a horizontal boundary line that partitions the four adjacent cells C. Further, pixel signals are also read out at the same timing from pixels adjacent to the left and right with a vertical boundary line partitioning the four adjacent cells C.

As described above, also in the case of the modification 1, the pixel signals acquired at the same timing are obtained from the pixels adjacent to each other on the upper, lower, left and right sides of the boundary line partitioning the four unit regions 131a to 131d constituting the cell C. Obtainable. Further, pixel signals acquired at the same timing can be obtained from pixels adjacent to the top, bottom, left and right with a boundary line partitioning the adjacent four cells C.

When the pixel sequential reading is performed as described above, the charge accumulation timing is slightly shifted between the 16 pixels forming the unit region 131. When shooting a moving subject, image distortion due to this timing shift can occur even at the boundary between the unit region 131, but in the first modification, the cell C is configured. Since the read control is performed so that the acquisition timing of the pixel signal is the same between the adjacent pixels across the boundary line that partitions the four unit areas 131a to 131d, the four unit areas 131a to 131d in the cell C are partitioned. It is possible to prevent image distortion at the boundary portion (image cracking caused by a large difference in pixel signals on both sides of the boundary portion).

Further, the distortion of the image as described above may occur at the boundary between the adjacent cells C and the cell C, but in the modified example 1, the images are adjacent to each other with the boundary line partitioning the adjacent four cells C. Since the readout control is performed so that the acquisition timing of the pixel signal is the same between the pixels, image distortion (image cracking caused by a large difference in the pixel signals on both sides of the boundary portion) at the boundary portion partitioning the adjacent cell C also occurs. Can be prevented.

(Modification 2)
The relationship between the horizontal direction and the vertical direction in the above description may be configured to be appropriately switchable. That is, the configuration is switched to scanning in the horizontal direction while reading the pixel signal in the vertical direction starting from the point P.

(Modification 3)
Although the pixel rows 91 to 95 for focus detection arranged in the horizontal direction are illustrated in FIG. 9, the pixel rows for focus detection may be arranged in the vertical direction as well.

(Modification example 4)
The reading direction for the pixels included in the four unit regions 131a to 131d in the cell C may be oblique. FIG. 12 is an enlarged view of one cell C in FIG. 5, and FIG. 12 (a) illustrates read control for pixels included in the four unit regions 131a to 131d in the cell C in the modified example 4. It is a figure. In FIG. 12A, 16 pixels are included in each of the four adjacent unit regions 131a to 131d.

In the modification 4, among the unit regions 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines partitioning the four unit regions 131a to 131d is read out as a pixel (indicated by diagonal lines in FIG. 12A). Show). Then, while reading diagonally in order from the pixel at the position closest to the point P, the pixel at the position farthest from the point P in each unit region 131a to 131d is set as the read end pixel.

In the case of the unit area 131a, reading is performed from the reading start pixel located at the lower right, then diagonally read in the upper right direction, folded back, and diagonally read in the lower left direction. Wrap it again and read it diagonally to the upper right, then wrap it and read it diagonally to the lower left. Further, the reading is controlled in pixel order so as to fold back and read diagonally in the upper right direction and finally read from the end pixel. As a result, the pixel signals of 16 pixels forming the unit region 131a are sequentially read out.

In the case of the unit area 131b, reading is performed from the reading start pixel located at the upper right, then diagonally read in the lower right direction, folded back, and diagonally read in the upper left direction. Wrap it again and read it diagonally to the lower right, then wrap it and read it diagonally to the upper left. Further, the reading is controlled in pixel order so as to fold back and read diagonally in the lower right direction and finally read from the end pixel. As a result, the pixel signals of 16 pixels forming the unit region 131b are sequentially read out.

In the case of the unit area 131c, reading is performed from the reading start pixel located at the lower left, then diagonally read in the upper left direction, folded back, and diagonally read in the lower right direction. Wrap it again and read it diagonally to the upper left, then wrap it and read it diagonally to the lower right. Further, the reading is controlled in pixel order so as to fold back and read diagonally in the upper left direction and finally read from the end pixel. As a result, the pixel signals of 16 pixels forming the unit region 131c are sequentially read out.

In the case of the unit area 131d, reading is performed from the reading start pixel located at the upper left, then diagonally read in the lower left direction, folded back, and diagonally read in the upper right direction. Wrap it again and read it diagonally to the lower left, then wrap it and read it diagonally to the upper right. Further, the reading is controlled in pixel order so as to fold back and read diagonally in the lower left direction and finally read from the end pixel. As a result, the pixel signals of 16 pixels forming the unit region 131d are sequentially read out.

When the read control in each of the four unit regions 131a to 131d is performed in parallel at the same timing in the cell C, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times in order. Is read out.

FIG. 12B is a diagram showing the reading order of the pixel signals read by the reading control exemplified in FIG. 12A. No. 1 corresponds to the read start pixel, and No. 16 corresponds to the read end pixel. Since each of the four unit regions 131a to 131d is performed in parallel at the same timing, pixel signals are read out from the four pixels indicated by the same numbers in the cell C at the same timing. According to FIG. 12 (b), pixel signals are read out at the same timing from pixels that are vertically adjacent to each other with a horizontal boundary line partitioning the four unit regions 131a to 131d. Further, pixel signals are also read out at the same timing from pixels adjacent to the left and right with a vertical boundary line partitioning the four unit areas 131a to 131d.

When the read-out control for coordinating the control performed independently for each of the four adjacent unit regions described above is performed in parallel in all the cells C exemplified in FIG. 5 at the same timing, all the cells included in the image pickup chip 113 are included. The pixel signal of the pixel is read out in order in 16 steps. Further, also in the modified example 4, as in the case of the above-described embodiment and the modified example 1, the pixel signal is transmitted between the pixels adjacent to each other with the boundary line partitioning the four unit regions 131a to 131d constituting the cell C. Since the acquisition timings are the same, it is possible to prevent image distortion (so-called image cracking) at the boundary portion partitioning the four unit regions 131a to 131d in the cell C.

Further, also in the modified example 4, the acquisition timing of the pixel signal is the same between the adjacent pixels across the boundary line partitioning the adjacent four cells C, as in the case of the above-described embodiment and the modified example 1. Therefore, it is possible to prevent image distortion (so-called image cracking) at the boundary portion partitioning the adjacent cells C.

(Modification 5)
In the above-described embodiment, an example in which the charge accumulation timing is shifted in the horizontal direction in the pixel sequence with respect to the pixels in the unit region 131 has been described. The stacked image sensor 100 is a unit by changing the method of providing the reset wiring 300, 310, 320, ..., the transfer wiring 302, 312, 322, ..., And the selection wiring 306, 316, 326, ... With respect to the unit region 131. It can also be configured to enable reset and pixel signal readout for each horizontal or vertical line in region 131. Therefore, the case where the pixel signal is read out sequentially in the horizontal line will be described below.

In the modification 5, the horizontal line at the position closest to the intersection P in the unit regions 131a to 131d described above is set as the read start line. Then, on both the upper side and the lower side of the point P, the timing is shifted so that the charge accumulation timing is delayed as the horizontal line is farther from the point P, respectively. In this way, in each unit area 131a to 131d, the horizontal line farthest from the point P is set as the read end line.

When the read control in each of the above four unit regions 131a to 131d constituting the cell C is performed in parallel at the same timing, the pixel signals of the 16 horizontal lines (4 × 4 horizontal lines) included in the cell C are reduced to four times. It is divided and read out in order.

Then, in the modification 5, the horizontal lines adjacent to each other with the horizontal boundary line partitioning the upper and lower sides by the four unit regions 131a to 131d constituting the cell C are both read start lines, so that the 4 in the cell C It is possible to prevent image distortion (so-called image cracking) at the boundary portion that divides the unit regions 131a to 131d into upper and lower parts. In the case of sequential reading of horizontal lines, the adjacent horizontal lines sandwiching the vertical boundary line that divides the four unit regions 131a to 131d in the cell C to the left and right originally have the same charge accumulation timing, so that the image at this boundary portion is used. Distortion (so-called image cracking) does not occur originally.

Further, in the modified example 5, since the horizontal lines adjacent to each other with the horizontal boundary line partitioning the upper and lower sides of the four adjacent cells C are both read end lines, the adjacent cell C is divided into upper and lower boundaries. Image distortion (so-called image cracking) can also be prevented. In the case of sequential reading of horizontal lines, the adjacent horizontal lines sandwiching the vertical boundary line that divides the adjacent cells C to the left and right originally have the same charge accumulation timing, so image distortion (so-called image cracking) at this boundary portion. Does not occur originally.

(Modification 6)
The image pickup apparatus 1 according to the above-described embodiment may be configured by a high-performance mobile phone or a tablet terminal. In this case, the camera unit mounted on the high-performance mobile phone (or tablet terminal) is configured by using the stacked image sensor 100.

The above description is merely an example, and is not limited to the configuration of the above embodiment. The configurations of the above-described embodiment and each modification may be combined as appropriate.

1 ... Image pickup device 10 ... Image pickup optical system 20 ... Image pickup unit 30 ... Image processing unit 40 ... Work memory 50 ... Display unit 60 ... Recording unit 70 ... Control unit 71 ... AF calculation unit 100 ... Image pickup element 109 ... Bump 111 ... Signal processing Chip 112 ... Memory chip 113 ... Image pickup chip 131, 131a to 131d ... Unit area 308 ... Output wiring

Claims (23)

Multiple photoelectric conversion units that are arranged side by side in the row direction and convert light into electric charges,
Of the plurality of photoelectric conversion units, the first transfer unit that transfers the charge converted by the first photoelectric conversion unit, and the first transfer unit.
Of the plurality of photoelectric conversion units, a second transfer unit that transfers the charge converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit, and a second transfer unit.
A third transfer unit that transfers the charge converted by the third photoelectric conversion unit among the plurality of photoelectric conversion units, and a third transfer unit.
Equipped with
The second photoelectric conversion unit is arranged between the first photoelectric conversion unit and the third photoelectric conversion unit in the row direction.
The first transfer timing for starting the transfer of the charge converted by the first photoelectric conversion unit by the first transfer unit and the transfer of the charge converted by the second photoelectric conversion unit by the second transfer unit are started. The period between the second transfer timing is from the period between the second transfer timing and the third transfer timing at which the transfer of the charge converted by the third photoelectric conversion unit by the third transfer unit is started. Also a short image sensor. In the image pickup device according to claim 1,
An image sensor whose period between the first transfer timing and the second transfer timing is shorter than the period between the first transfer timing and the third transfer timing. Multiple photoelectric conversion units that are arranged side by side in the row direction and convert light into electric charges,
Of the plurality of photoelectric conversion units, the first transfer unit that transfers the charge converted by the first photoelectric conversion unit, and the first transfer unit.
Of the plurality of photoelectric conversion units, a second transfer unit that transfers the charge converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit, and a second transfer unit.
A third transfer unit that transfers the charge converted by the third photoelectric conversion unit among the plurality of photoelectric conversion units, and a third transfer unit.
Equipped with
The second photoelectric conversion unit is arranged between the first photoelectric conversion unit and the third photoelectric conversion unit in the row direction.
The first transfer timing for starting the transfer of the charge converted by the first photoelectric conversion unit by the first transfer unit and the transfer of the charge converted by the second photoelectric conversion unit by the second transfer unit are started. The period between the second transfer timing is from the period between the first transfer timing and the third transfer timing at which the transfer of the charge converted by the third photoelectric conversion unit by the third transfer unit is started. Also a short image sensor. The image pickup device according to any one of claims 1 to 3.
The third photoelectric conversion unit is an image sensor arranged side by side next to the second photoelectric conversion unit. The image pickup device according to any one of claims 1 to 4.
A first transfer control line that is connected to the first transfer unit and outputs a control signal for controlling the first transfer timing.
A second transfer control line that is connected to the second transfer unit and outputs a control signal for controlling the second transfer timing.
A third transfer control line that is connected to the third transfer unit and outputs a control signal for controlling the third transfer timing.
An image sensor comprising. In the image pickup device according to claim 5,
A first reset unit for resetting the potential of the first floating diffusion to which the electric charge converted by the first photoelectric conversion unit is transferred by the first transfer unit.
A second reset unit for resetting the potential of the second floating diffusion to which the electric charge converted by the second photoelectric conversion unit is transferred by the second transfer unit.
A third reset unit for resetting the potential of the third floating diffusion to which the charge converted by the third photoelectric conversion unit is transferred by the third transfer unit is provided.
Between the first reset timing at which the first reset unit starts resetting the potential of the first floating diffusion and the second reset timing at which the second reset unit starts resetting the potential of the second floating diffusion. The period is shorter than the period between the second reset timing and the third reset timing at which the third reset unit starts resetting the potential of the third floating diffusion. In the image pickup device according to claim 6,
An image sensor whose period between the first reset timing and the second reset timing is shorter than the period between the first reset timing and the third reset timing. In the image pickup device according to claim 5,
A first reset unit for resetting the potential of the first floating diffusion to which the electric charge converted by the first photoelectric conversion unit is transferred by the first transfer unit.
A second reset unit for resetting the potential of the second floating diffusion to which the electric charge converted by the second photoelectric conversion unit is transferred by the second transfer unit.
A third reset unit for resetting the potential of the third floating diffusion to which the charge converted by the third photoelectric conversion unit is transferred by the third transfer unit is provided.
Between the first reset timing at which the first reset unit starts resetting the potential of the first floating diffusion and the second reset timing at which the second reset unit starts resetting the potential of the second floating diffusion. The period is shorter than the period between the first reset timing and the third reset timing at which the third reset unit starts resetting the potential of the third floating diffusion. The image pickup device according to any one of claims 6 to 8.
A first reset control line that is connected to the first reset unit and outputs a control signal for controlling the first reset timing.
A second reset control line connected to the second reset unit and outputting a control signal for controlling the second reset timing, and a second reset control line.
A third reset control line that is connected to the third reset unit and outputs a control signal for controlling the third reset timing.
An image sensor comprising. The image pickup device according to any one of claims 1 to 9.
The plurality of photoelectric conversion units have a fourth photoelectric conversion unit arranged side by side next to the first photoelectric conversion unit in the column direction.
A fourth transfer unit for transferring the charge converted by the fourth photoelectric conversion unit is provided.
The period between the first transfer timing and the fourth transfer timing at which the transfer of the charge converted by the fourth photoelectric conversion unit by the fourth transfer unit is started is the second transfer timing and the third transfer timing. An image sensor that is shorter than the period between the transfer timings. Multiple photoelectric conversion units that are arranged side by side in the row direction and convert light into electric charges,
Of the plurality of photoelectric conversion units, the first reset unit that resets the potential of the first floating diffusion to which the charge converted by the first photoelectric conversion unit is transferred, and
A second reset unit that resets the potential of the second floating diffusion to which the electric charge converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit is transferred among the plurality of photoelectric conversion units. When,
Of the plurality of photoelectric conversion units, the third reset unit that resets the potential of the third floating diffusion to which the charge converted by the charge converted by the third photoelectric conversion unit is transferred, and the third reset unit.
Equipped with
The second photoelectric conversion unit is arranged between the first photoelectric conversion unit and the third photoelectric conversion unit in the row direction.
Between the first reset timing at which the first reset unit starts resetting the potential of the first floating diffusion and the second reset timing at which the second reset unit starts resetting the potential of the second floating diffusion. The period is shorter than the period between the second reset timing and the third reset timing at which the third reset unit starts resetting the potential of the third floating diffusion. In the image pickup device according to claim 11,
An image sensor whose period between the first reset timing and the second reset timing is shorter than the period between the first reset timing and the third reset timing. Multiple photoelectric conversion units that are arranged side by side in the row direction and convert light into electric charges,
Of the plurality of photoelectric conversion units, the first reset unit that resets the potential of the first floating diffusion to which the charge converted by the first photoelectric conversion unit is transferred, and
A second reset unit that resets the potential of the second floating diffusion to which the electric charge converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit is transferred among the plurality of photoelectric conversion units. When,
Of the plurality of photoelectric conversion units, the third reset unit that resets the potential of the third floating diffusion to which the charge converted by the charge converted by the third photoelectric conversion unit is transferred, and the third reset unit.
Equipped with
The second photoelectric conversion unit is arranged between the first photoelectric conversion unit and the third photoelectric conversion unit in the row direction.
Between the first reset timing at which the first reset unit starts resetting the potential of the first floating diffusion and the second reset timing at which the second reset unit starts resetting the potential of the second floating diffusion. The period is shorter than the period between the first reset timing and the third reset timing at which the third reset unit starts resetting the potential of the third floating diffusion. The image pickup device according to any one of claims 11 to 13.
The third photoelectric conversion unit is an image sensor arranged side by side next to the second photoelectric conversion unit. The image pickup device according to any one of claims 11 to 14.
A first reset control line that is connected to the first reset unit and outputs a control signal for controlling the first reset timing.
A second reset control line connected to the second reset unit and outputting a control signal for controlling the second reset timing, and a second reset control line.
A third reset control line that is connected to the third reset unit and outputs a control signal for controlling the third reset timing.
An image sensor comprising. The image pickup device according to any one of claims 11 to 15.
The plurality of photoelectric conversion units have a fourth photoelectric conversion unit arranged side by side next to the first photoelectric conversion unit in the column direction.
A fourth reset unit for resetting the potential of the fourth floating diffusion to which the electric charge converted by the fourth photoelectric conversion unit is transferred is provided.
The period between the first reset timing and the fourth reset timing at which the fourth reset unit starts resetting the potential of the fourth floating diffusion is the second reset timing and the third reset timing. An image sensor that is shorter than the period in between. The image pickup device according to any one of claims 1 to 16.
A first signal line that outputs a first signal based on the electric charge converted by the first photoelectric conversion unit, and
A second signal line that outputs a second signal based on the electric charge converted by the second photoelectric conversion unit, and
An image sensor comprising. In the image pickup device according to claim 17,
The second signal line is an image pickup device that outputs a third signal based on the electric charge converted by the third photoelectric conversion unit. In the image pickup device according to claim 17 or 18.
A first conversion unit for converting the first signal output to the first signal line into a digital signal, and
A second conversion unit for converting the second signal output to the second signal line into a digital signal is provided.
The first photoelectric conversion unit and the second photoelectric conversion unit are arranged on the first semiconductor substrate, and the first photoelectric conversion unit and the second photoelectric conversion unit are arranged on the first semiconductor substrate.
The first conversion unit and the second conversion unit are image pickup devices arranged on a second semiconductor substrate connected to the first semiconductor substrate. In the image pickup device according to claim 19,
The first semiconductor substrate is an image pickup device laminated on the second semiconductor substrate. In the image pickup device according to claim 17 or 18.
A first conversion unit for converting the first signal output to the first signal line into a digital signal, and
A second conversion unit for converting the second signal output to the second signal line into a digital signal, and
A first storage unit that stores the first signal converted into a digital signal using the first conversion unit, and a first storage unit.
A second storage unit for storing the second signal converted into a digital signal by using the second conversion unit is provided.
The first photoelectric conversion unit and the second photoelectric conversion unit are arranged on the first semiconductor substrate, and the first photoelectric conversion unit and the second photoelectric conversion unit are arranged on the first semiconductor substrate.
The first conversion unit and the second conversion unit are arranged on a second semiconductor substrate connected to the first semiconductor substrate.
The first storage unit and the second storage unit are image pickup devices arranged on a third semiconductor substrate connected to the second semiconductor substrate. In the image pickup device according to claim 21,
The first semiconductor substrate is laminated on the second semiconductor substrate, and the first semiconductor substrate is laminated.
The second semiconductor substrate is an image pickup device laminated on the third semiconductor substrate. An image pickup device comprising the image pickup device according to any one of claims 1 to 22.

Images