JP6381274B2 - Imaging device, control method thereof, and control program - Google Patents

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a control program, and more particularly, to an imaging apparatus using an imaging element including a pixel having a plurality of photoelectric conversion units corresponding to one microlens.

  In general, an imaging apparatus is known that performs focus detection according to the output of an imaging element and obtains an image. For example, there is an image pickup apparatus using an image pickup element including a pixel having a plurality of photoelectric conversion units corresponding to one microlens (see Patent Document 1). Here, an image signal is generated in accordance with an image signal while performing focus detection by phase difference detection in accordance with an image signal obtained by light passing through different areas of the exit pupil.

JP 2008-134389 A

  By the way, in the imaging apparatus described in Patent Literature 1, image signals obtained from a plurality of photoelectric conversion units are separately read out to acquire a phase difference detection signal. For this reason, in order to generate an image signal, it is necessary to add the image signal.

  However, when the addition process is performed, noise is amplified and an S / N ratio is deteriorated when an image signal having a predetermined video signal level is obtained. When the number of photoelectric conversion units corresponding to one microlens is increased, the S / N ratio is further deteriorated.

  Accordingly, an object of the present invention is to provide an imaging apparatus capable of obtaining a phase difference detection signal and an image signal without deteriorating the S / N ratio, a control method therefor, and a control program.

In order to achieve the above object, an imaging apparatus according to the present invention is an imaging apparatus including an imaging element that forms an optical image through an imaging optical system and outputs an image signal corresponding to the optical image, The imaging device includes a plurality of pixels arranged in a two-dimensional matrix, and each of the pixels includes a plurality of photoelectric conversion units that receive light beams passing through different pupil regions of the imaging optical system and perform photoelectric conversion. For each of the pixels, either a first readout mode for reading out the outputs of the plurality of photoelectric conversion units provided in the pixel or a second readout mode for individually reading out the outputs of the plurality of photoelectric conversion units The first control means for performing read control by selecting these and the pixels for which the read control has been performed in the second read mode, add image signals corresponding to the outputs of the plurality of photoelectric conversion units to obtain an image Adding means for the items, a distance measuring means for obtaining a difference between the current focus position and the target focus position by the phase difference detection in accordance with an image signal corresponding to an output of said plurality of photoelectric conversion unit, said first read For the pixels read in the mode, the image signal output from the image sensor is used, and for the pixels read in the second readout mode, the image output from the image sensor and added by the adding means. A calculation unit that calculates a contrast evaluation value indicating contrast using a signal, and a focus control of the imaging optical system by selectively using a distance measurement result by the distance measurement unit and a calculation result by the calculation unit ; and second control means, possess, said first control means is read by the first read mode than near the out-of-focus state when close to the focus state Characterized by a lot of oxygen.

An image pickup apparatus control method according to the present invention includes an image pickup device that forms an optical image through an image pickup optical system and outputs an image signal corresponding to the optical image, and the image pickup device includes a plurality of two-dimensional matrixes. A control method of an imaging apparatus including a plurality of photoelectric conversion units, each of which includes a plurality of photoelectric conversion units configured to receive light beams passing through different pupil regions of the imaging optical system and perform photoelectric conversion. The first read mode for reading out the outputs of the plurality of photoelectric conversion units provided in the pixel and the second read mode for reading out the outputs of the plurality of photoelectric conversion units individually are selected. The image signal corresponding to the outputs of the plurality of photoelectric conversion units is added to the first control step for performing the read control and the pixels for which the read control is performed in the second read mode. An addition step, a distance measuring step of obtaining a difference between the current focus position and the target focus position by the phase difference detection in accordance with an image signal corresponding to an output of said plurality of photoelectric conversion unit, read by the first read mode For the output pixel, the image signal output from the image sensor is used, and for the pixel read out in the second readout mode, the image signal output from the image sensor and added in the adding step is used. A calculation step for calculating a contrast evaluation value indicating contrast, and a second control for performing focusing control of the imaging optical system by selectively using the distance measurement result in the distance measurement step and the calculation result in the calculation step a step, was closed, wherein in the first control step, said first reading than near the out-of-focus state when close to the focus state Characterized by a lot of pixels read by out mode.

The control program used in the image pickup apparatus according to the present invention includes an image pickup device that forms an optical image through an image pickup optical system and outputs an image signal corresponding to the optical image, and the image pickup device has a two-dimensional matrix shape. A plurality of pixels are arranged, each of the pixels is a control program used in an imaging apparatus including a plurality of photoelectric conversion units that receive a light beam passing through different pupil regions of the imaging optical system and perform photoelectric conversion, A first readout mode in which the outputs of the plurality of photoelectric conversion units provided in the pixels are added and read out for each of the pixels and the outputs of the plurality of photoelectric conversion units are individually read out to a computer included in the imaging apparatus. when performing the selected and read control either the second read mode, when close to the focus state in the first read mode than close to out-of-focus state A first control step of increasing the pixel Desa seen, for the pixel readout controlled by the second read mode is performed, the image signal by adding the image signal corresponding to an output of said plurality of photoelectric conversion unit and An adding step, a distance measuring step for obtaining a difference between a current focus position and a target focus position by phase difference detection according to image signals corresponding to outputs of the plurality of photoelectric conversion units, and the first readout mode. For the read pixel, the image signal output from the image sensor is used, and for the pixel read in the second readout mode, the image signal output from the image sensor and added in the adding step is used. using a calculation step of calculating a contrast evaluation value indicating the contrast, due to the distance measurement result and the calculation step by the distance measuring step A second control step of leaving selectively using the results performs a focusing control of the imaging optical system, characterized in that to the execution.

  According to the present invention, for each of the pixels, the first readout mode and the second readout mode are selected to perform readout control, and the pixels for which readout control is performed in the second readout mode are performed. Image signals corresponding to the outputs of the plurality of photoelectric conversion units are added to obtain an image signal. As a result, a phase difference detection signal and an image signal can be obtained without deteriorating the S / N ratio.

It is a block diagram which shows the structure about an example of the imaging device by embodiment of this invention. 2A and 2B are diagrams for explaining the configuration of the image sensor illustrated in FIG. 1, in which FIG. 1A is a diagram of pixels of the image sensor as viewed from the upper surface side, and FIG. It is a figure for demonstrating an example of a structure of an image pick-up element provided with the pixel part shown in FIG. It is a figure which shows the example about the structure of the signal calculating part shown in FIG. It is a block diagram which shows the structure about an example of the phase difference ranging part shown in FIG. 2 is a flowchart for explaining an AF control operation performed by an AF control unit shown in FIG. 1. It is a figure which shows typically the cross section along the AA line shown to Fig.2 (a). FIG. 6 is a diagram for explaining calculation of a subject distance performed by a phase difference ranging unit shown in FIG. 5. It is a figure for demonstrating determination of the non-addition area | region performed by the ranging area determination part shown in FIG.

  Hereinafter, an example of an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an example of an imaging apparatus according to an embodiment of the present invention.

  The illustrated imaging apparatus is, for example, a digital camera (hereinafter simply referred to as a camera) and includes an imaging optical system (hereinafter simply referred to as an optical system) 101. Although not shown, the optical system 101 includes a focus lens, a zoom lens, a diaphragm, and the like. The optical system driving unit 102 drives and controls the optical system 101 under the control of an AF control unit 107 described later.

  An imaging device 103 such as a CMOS image sensor is disposed at the subsequent stage of the optical system 101, and an optical image (subject image) is formed on the imaging device 103 via the optical system 101. The image sensor 103 photoelectrically converts the subject image and outputs an image signal (image data) corresponding to the subject image. Note that the image sensor 103 is read out and read out in accordance with instruction information that is output from an instruction information generation unit 109 described later.

  The signal calculation unit 104 performs a predetermined calculation process on the image signal and outputs it as display recording image data (display recording image). The signal calculation unit 104 performs predetermined calculation processing based on the instruction information that is output from the instruction information generation unit 109. The phase difference distance measuring unit 105 receives the image signal output from the image sensor 103, performs distance measurement by phase difference distance measurement based on the pupil-divided image signal, and outputs distance information indicating the distance to the subject.

  The contrast calculation unit 106 receives the image data obtained by the signal calculation unit 104 and obtains its contrast value. The AF control unit 107 generates optical system driving information indicating the driving amount of the optical system 101, particularly the driving amount of the focus lens for focusing on the subject, based on the distance information and the contrast value. Thereby, the AF control unit 107 performs focusing control of the optical system 101.

  The camera signal processing unit 108 performs image processing such as color conversion processing, white balance processing, and gamma correction processing on the image data obtained by the signal calculation unit, and also performs resolution conversion processing, image compression processing, and the like. The ranging area determination unit 110 determines a non-addition area for performing phase difference ranging according to the AF control information that is output from the AF control unit, and sends it to the instruction information generation unit 109 as ranging area information. .

  The instruction information generation unit 109 generates instruction information according to the distance measurement area information that is output from the distance measurement area determination unit 110. Then, the instruction information generation unit 109 sends the instruction information to the image sensor 103 and the signal calculation unit 104.

  FIG. 2 is a diagram for explaining the configuration of the image sensor 103 shown in FIG. 2A is a diagram of the pixels of the image sensor 103 as viewed from the upper surface side, and FIG. 2B is a diagram illustrating a circuit configuration of the pixels included in the image sensor 103.

  The image sensor 103 has a plurality of pixels (also referred to as pixel portions) arranged in a two-dimensional matrix. The image sensor 103 is, for example, a CMOS image sensor, and is read out and controlled by so-called XY address type scanning. For example, a CMOS image sensor.

  2A, the pixel unit 203 includes a plurality of photoelectric conversion units (for example, photodiodes), and the photoelectric conversion unit receives incident light and converts it into electric charges. In the illustrated example, the pixel unit 203 includes two photoelectric conversion units 201 and 202, and one microlens (ML) 204 corresponds to (that is, in common with) the photoelectric conversion units (PD) 201 and 202. Has been placed.

  As will be described later, other pixel units included in the image sensor 103 also have the same configuration as the pixel unit 203 shown in FIG. 2A. In the following description, PDs 201 and 202 are included. They may be referred to as PD1 and PD2, respectively.

  In FIG. 2B, the pixel unit 203 includes a pixel region 211 and a selection switch 302. In the pixel region 211, the aforementioned PDs 201 and 202 are disposed, and transfer switches 2051 and 2052, a floating diffusion unit (FD) 206, a reset switch 207, and an amplification MOS amplifier 208 functioning as a source follower amplifier are disposed. ing. A power supply line 209 is connected to the reset switch 207 and the amplification MOS amplifier 206, and a vertical signal output line (hereinafter referred to as a signal output line) 210 is connected to the selection switch 302.

  FIG. 3 is a diagram for explaining an example of a configuration of an imaging element including the pixel portion illustrated in FIG.

  In FIG. 3, for the sake of convenience of explanation, an image sensor having a pixel portion 203 of 3 rows × 4 columns is shown, but in reality hundreds of thousands to tens of millions of pixel portions 203 are arranged. Further, the pixel portion 203 is two-dimensionally arranged with a predetermined aspect ratio. Each pixel unit 203 may be covered with a color filter having a hue of R (red), G (green), or B (blue). For example, R, G, and B color filters may be covered. It may be arranged in a Bayer arrangement.

  Here, referring to FIG. 2 and FIG. 3, FD 206 is an accumulation region in which charges generated in PDs 201 and 202 are temporarily accumulated. The transfer switch 2051 is on / off controlled by a transfer pulse pTX1. When the transfer switch 2051 is turned on, the charge generated in the PD 201 is transferred to the FD 206. Similarly, the transfer switch 2052 is ON / OFF controlled by the transfer pulse pTX2. When the transfer switch 2052 is turned on, the charge generated in the PD 202 is transferred to the FD 206.

  The reset switch 207 is on / off controlled by a reset pulse pRES. When the reset switch 207 is turned on, the charge accumulated in the FD 206 is reset.

  The gate electrodes of the transfer switches 2051 and 2052, the reset switch 207, and the selection switch 302 are connected to signal lines to which the transfer pulses pTX1 and pTX2, the reset pulse pRES, and the selection pulse pSEL are supplied in units of rows, respectively. Then, the vertical scanning circuit 301 selectively scans the pixel unit 203 with the transfer pulses pTX1 and pTX2, the reset pulse pRES, and the selection pulse pSEL.

  The constant current source 304 serves as a load of the amplification MOS amplifier 208, and the pixel unit 203 and the constant current source 304 are connected to the column AD conversion circuit 305 by the signal output line 210 in units of columns. The FD 206, the amplification MOS amplifier 208, and the constant current source 304 constitute a floating diffusion amplifier, and the signal charges of the pixel portion selected by the selection switch 302 are converted into voltage signals. Then, the voltage signal is input to the column AD conversion circuit 208 via the signal output line 210.

  In the pixel unit 203, the charges generated in the PDs 201 and 202 are output by adjusting the operation timing of the transfer pulses pTX1 and pTX2, the reset pulse pRES, and the selection switch pSEL. Further, the charges of the PDs 201 and 202 can be accumulated in the FD 206 and a voltage signal can be output.

  Now, if the instruction information output from the instruction information generation unit 109 indicates non-addition (second readout mode), the vertical scanning circuit 301 first turns on the transfer pulse pTX1 to generate a voltage signal corresponding to the charge of the PD 201. Is read to the column AD conversion circuit 208. The vertical scanning circuit 301 turns on the reset pulse pRES to reset the FD 206, and then turns on the transfer pulse pTX2. As a result, a voltage signal corresponding to the charge of the PD 202 is read out to the column AD conversion circuit 208. In this way, voltage signals corresponding to the charges of the PDs 201 and 202 are sequentially output to the column AD conversion circuit 208.

  On the other hand, if the instruction information indicates addition (first readout mode), the vertical scanning circuit 301 turns on the transfer pulse pTX2 after turning on the transfer pulse pTX1. As a result, the charges of the PDs 201 and 202 are sent to the FD 206, and charge addition is performed in the FD 206. The voltage signal after the charge addition is read by the column AD conversion circuit 208. In this way, a voltage signal obtained by adding the charges of the PDs 201 and 202 by the FD 206 is output to the column AD conversion circuit 208.

  The column AD conversion circuit 208 is a circuit that converts a voltage signal that is an output of the pixel unit 203 into a digital signal. For example, the column AD conversion circuit 208 compares the voltage signal and the ramp signal with a comparator, operates the counter when the output of the ramp signal starts, and sets the counter value when the voltage signal and the ramp signal match with the digital signal ( (Digital code)

  The line memory 306 stores a digital signal that is an output of the column AD conversion circuit 305. A pair of line memories 306 are provided and output digital signals corresponding to the PDs 201 and 202 shown in FIG. 2 as an image signal L and an image signal R, respectively. The line memory 306 is driven and controlled by the horizontal drive circuit 307.

  Here, when the instruction information indicates addition, the digital signal corresponding to the voltage signal subjected to the addition processing is set in one of the line memories 306 (for example, the image signal L). The other of the line memories 306 is not used.

  FIG. 4 is a diagram showing an example of the configuration of the signal calculation unit 104 shown in FIG.

  The signal calculation unit 104 includes an addition circuit 501 and a selection circuit 502. In the signal calculation unit 104, the adding circuit 501 adds the image signals L and R and outputs the added image signal. The selection circuit 502 receives the image signal L and the added image signal, and the selection circuit 502 selects either the image signal L or the added image signal according to the instruction information and outputs it as a selected image signal.

  When the instruction information indicates addition, since addition processing has already been performed by the FD 206 as described above, it is not necessary for the signal calculation unit 104 to perform addition processing. Therefore, the selection circuit 502 selects the image signal L on which the addition processing has been performed and outputs it as a selected image signal.

  On the other hand, if the instruction information indicates non-addition, the image sensor 103 has not performed addition processing. Therefore, when both the image signal L and the image signal R are output, the signal calculation unit 104 selects the added image signal by the selection circuit 502 and outputs it as the selected image signal.

  FIG. 5 is a block diagram showing a configuration of an example of the phase difference distance measuring unit 105 shown in FIG.

  The phase difference distance measuring unit 105 includes a determination unit 801, and an image signal is input from the image sensor 103 to the determination unit 801. As will be described later, the determination unit 801 determines a signal necessary for phase difference distance measurement (hereinafter referred to as a distance measurement signal) from the image signal. The determination unit 801 stores the distance measurement signal in the storage unit 804.

  The correlation calculation unit 802 performs a correlation calculation on the distance measurement signal stored in the storage unit 804 and outputs a correlation result. The subject distance information calculation unit 803 obtains the distance to the subject based on the correlation result output from the correlation calculation unit 802 and sends the subject distance information to the AF control unit 107.

  FIG. 7 is a flowchart for explaining an AF control operation performed by the AF control unit 107 shown in FIG.

  When the AF control is started, the contrast calculation unit 106 calculates a contrast evaluation value (also referred to as a contrast value) for detecting the in-focus state according to the image data output from the signal calculation unit 104 (step). S701). When calculating the contrast evaluation value, the contrast calculation unit 106 performs a predetermined bandpass filter process on the image data. Then, the contrast calculation unit 106 integrates the absolute values of the filter outputs obtained as a result of the bandpass filter process, and uses the integrated value as a contrast evaluation value.

  For example, the contrast evaluation value of the subject may be calculated and the focus lens position where the contrast evaluation value is maximized may be set to the in-focus state.

  Subsequently, based on the contrast evaluation value, the AF control unit 107 moves the focus lens along the optical axis by the optical system driving unit 102 to a focused state, that is, a position where the contrast evaluation value is maximized (step S702). ). The AF control using the contrast evaluation value is generally called a hill climbing method.

  In the phase difference distance measuring unit 105, image signals corresponding to the two PDs 201 and 202 are input to the determination unit 801. That is, the determination unit 801 determines image signals corresponding to the PDs 201 and 202 in the image signal that is the output of the image sensor 103 and stores them in the storage unit 804 as an A image and a B image. At this time, the image sensor 103 outputs an image signal in accordance with the instruction information that is output from the instruction information generation unit 109.

  Subsequently, the phase difference distance measuring unit 105 obtains subject distance information according to the A image and the B image, that is, by detecting the phase difference, as described later (step S703).

  Here, the phase difference detection performed by the phase difference distance measuring unit 105 shown in FIG. 5 will be described.

  FIG. 7 is a diagram schematically showing a cross section taken along line AA shown in FIG.

  An exit pupil 901 indicates the exit pupil of the imaging optical system 101 when viewed from the image side. At the time of focusing, the distance from the imaging plane 906 to the exit pupil 901 by the imaging optical system 101 is called the exit pupil position. The exit pupil position changes depending on the curvature of the lens group located behind (imaging plane side) the diaphragm (not shown) provided in the imaging optical system 101 and the positional relationship between the diaphragm and the exit pupil. Furthermore, the size of the exit pupil changes depending on the aperture diameter of the stop.

  The exit pupils 904 and 905 are exit pupils of the PDs 202 and 201 projected onto the exit pupil position by the microlens 204, respectively. The PD 201 is designed so that the light beam 903 passing through the exit pupil 905 is incident, and the PD 202 is designed so that the light beam 902 passing through the exit pupil 904 is incident.

  The other pixel units constituting the image sensor 103 are designed in the same manner, and in the plurality of photoelectric conversion units (PD1) at the same position as the PD 201, the left side of the exit pupil 901 of the imaging optical system 101 is arranged. An image viewed in the area of the exit pupil 904 is obtained. Similarly, in the plurality of photoelectric conversion units (PD2) at the same position as the PD 202, an image viewed in the region of the right exit pupil 905 of the exit pupil 901 of the imaging optical system 101 is obtained.

  Now, assuming that an image obtained by the image sensor 103 by the light beam 902 is an A image and an image obtained by the image sensor 103 by the light beam 903 is a B image, the image signal includes parallax depending on whether the image is in focus A signal (that is, a ranging signal) is obtained.

  FIG. 8 is a diagram for explaining the calculation of the subject distance performed by the phase difference distance measuring unit 105 shown in FIG.

  FIG. 8 shows the relationship between the pixel position and the signal intensity for the A image (image obtained by PD2) 1002 and the B image (image obtained by PD1) 1001 in a so-called front pin state. When the subject distance is obtained by phase difference detection, the relative relationship between the A image 1002 and the B image 1001, the inter-image distance 1003, and the distance from the imaging plane to the exit pupil at the focus position are used.

  When obtaining the inter-image distance 1003, the distance measurement signal stored in the storage unit 804, that is, the outputs of the two adjacent PDs 201 and 202 without being subjected to the addition processing in the FD 206, are used for the A image and B with different parallaxes. It is an image. The distance between the pixel positions where the signal intensities of the A image and the B image are maximum is set as an inter-image distance 1003.

  Here, the correlation calculation unit 802 separates the distance measurement signal stored in the storage unit 804 into an A image and a B image, and obtains a correlation value between the A image and the B image. Then, the correlation calculation unit 802 calculates the deviation amount between the A image and the B image when the correlation value is the highest as the inter-image distance 1003.

  The subject distance information calculation unit 803 obtains the subject distance according to the inter-image distance 1003 and the distance from the imaging plane to the exit pupil at the current focus position, and sends the subject distance information to the AF control unit 107.

  Referring to FIG. 6 again, the AF control unit 107 obtains a target focus position (Tp) as a target based on the subject distance information. Then, the AF control unit 107 obtains a difference between the current focus position (T) and the target focus position (Tp), and the absolute value (| Tp−T |) of the difference has a predetermined threshold value (Tth). It is determined whether or not it exceeds (step S704).

  Here, the larger the | Tp−T | is than the threshold value Tth, the more out of focus. The threshold value Tth is set in advance according to the degree of the out-of-focus state. The threshold value Tth may be adjusted according to the condition of the subject.

  If | Tp−T | ≦ Tth (NO in step S704), that is, if it is equal to or smaller than the threshold value, the process returns to step S702, and the AF control unit 107 outputs the contrast evaluation value that is the output of the contrast calculation unit 106 That is, focus detection processing by contrast detection is performed.

  If | Tp−T |> Tth (YES in step S704), the AF control unit 107 controls the optical system driving unit 102 to drive the focus lens along the optical axis based on the target focus position Tp. (Step S705). That is, the AF control unit 107 generates optical system drive information based on the target focus position Tp, and sends the optical system drive information to the optical system drive unit 102. Then, the optical system driving unit 102 drives and controls the focus lens according to the optical system driving information. Thereafter, the AF control unit 107 returns to the process of step S701.

  In this way, the AF control unit 107 performs AF control by selectively using contrast detection and phase difference detection according to the image signal that is the output of the image sensor 103.

  On the other hand, the AF control unit 107 sends AF control information described later to the distance measurement area determination unit 110. The ranging area determination unit 110 determines a non-addition area for performing phase difference ranging according to the AF control information, and outputs area information indicating the non-addition area to the instruction information generation unit 109.

  Here, the AF control information is, for example, a contrast evaluation value that is an output of the contrast calculation unit 106. The larger the contrast evaluation value, the closer to the in-focus state, and the smaller the contrast evaluation value, the closer to the out-of-focus (out-of-focus) state.

  FIG. 9 is a diagram for explaining the determination of the non-addition area performed by the ranging area determination unit 110 shown in FIG.

  FIG. 9 shows the relationship between the AF control information and the non-addition area, and here, pixels that perform addition processing in the image sensor (hereinafter also referred to as a sensor) 103 are colored. When the AF control information, that is, the contrast evaluation value is small and in the out-of-focus state (contrast evaluation value <first contrast threshold), the ranging area determination unit 110 sets all pixels of the image sensor 103 as non-addition areas. (See the diagram on the left in FIG. 9).

  The ranging area determination unit 110 determines a non-addition area as an addition pixel at a predetermined ratio (equal interval) with respect to the pixels of the image sensor 103 as the contrast evaluation value increases. That is, the distance measurement area determination unit 110 changes the number of added pixels, that is, the number of pixels to be read-controlled in the first read mode, according to the contrast evaluation value.

  For example, if first contrast threshold ≦ contrast evaluation value <second contrast threshold (first contrast threshold <second contrast threshold), the ranging area determination unit 110 sets an additional line every other line. A non-addition area is determined (see the second figure from the left in FIG. 9). When the second contrast threshold value ≦ the contrast evaluation value <the third contrast threshold value (the second contrast threshold value <the third contrast threshold value), the ranging area determination unit 110 adds pixels every other pixel in the non-addition row. Is set to determine the non-addition area (see the third figure from the left in FIG. 9).

  If third contrast threshold ≦ contrast evaluation value <fourth contrast threshold (third contrast threshold <fourth contrast threshold), the ranging area determination unit 110 displays the third figure from the left in FIG. The addition pixel is further increased from the state shown in FIG. 9, and the non-addition region is determined in the state shown in the right diagram in FIG.

By the way, when reading is performed for each photoelectric conversion unit, if the signal amount obtained in one vertical synchronization period in one photoelectric conversion unit is S, the signal level of one pixel in the image signal is expressed by the following equation (1). Is done.
S + S = 2S (1)

At this time, if the amount of noise generated in one vertical synchronization period in one photoelectric conversion unit (random noise component independent of the amount of incident light) is N, the total amount of noise included in one pixel in the image signal is expressed by the following equation ( 2).

  On the other hand, when performing readout by performing addition processing for a plurality of photoelectric conversion units, similarly, the signal level of one pixel in the image signal is 2S, which is the same signal level as when performing readout for each photoelectric conversion unit. Further, when reading is performed by performing addition processing for a plurality of photoelectric conversion units, the noise level is N, and therefore, the noise level is reduced by 3 dB when expressed in decibels.

  When it is close to the in-focus state, it is difficult to accurately measure the subject distance by detecting the phase difference. On the other hand, in contrast AF, AF control can be performed in the direction in which the contrast evaluation value in the image increases, so that AF control with higher accuracy than phase difference detection can be performed when close to the in-focus state. Therefore, when the focus state is close, in order to improve the S / N ratio by reducing the number of pixels used for phase difference detection, the number of pixels to be added in the image sensor 103 is increased.

  When the subject is far from the in-focus state, the subject distance can be measured by detecting the phase difference. As a result, the focus lens can be moved to near the in-focus state at high speed. On the other hand, since the focus lens is moved at a predetermined speed in contrast AF, the time until the in-focus state is reached is longer than that in phase difference detection. Therefore, when the subject is far from the in-focus state, the number of pixels used in the phase difference detection is increased to improve the detection accuracy by the phase difference detection.

  As described above, when addition processing is performed in the image sensor 103, the pixel density used for phase difference detection is reduced. As a result, the pixels used for phase difference detection are referred to in a thinned state, and the detection accuracy is lower than before addition processing due to moiré and lack of reference pixels. End up.

  For this reason, when close to the in-focus state, the improvement in the S / N ratio is prioritized over the accuracy obtained by the phase difference detection, and the number of pixels to be added is increased. Then, as the distance from the in-focus state increases, the detection accuracy required for phase difference detection increases, so control is performed to gradually reduce the number of pixels to be added.

  The non-addition area shown in FIG. 9 is an example, and the number of pixels to be added may be increased as the contrast evaluation value increases.

  The instruction information generation unit 109 outputs instruction information indicating addition or non-addition of pixels in the image sensor 103 to the image sensor 103 and the signal calculation unit 104 in accordance with the area information indicating the non-addition area.

  As described above, the pixel region used for phase difference detection is determined according to the image signal obtained from the image sensor 103, and readout control of the image sensor 103 is performed according to the pixel region. Thus, only the pixel area for phase difference detection can be read out by pupil division. That is, the image sensor 103 is read and controlled according to the instruction information indicating the pixel region used for phase difference detection according to the contrast evaluation value. Thereby, the image signals of the photoelectric conversion units 201 and 202 constituting the pixel unit 203 can be individually read out. Furthermore, the image signals of the photoelectric conversion units 201 and 202 constituting the pixel unit 203 located in the pixel region not used for phase difference detection can be output in a state of being added.

  Thus, in the embodiment of the present invention, the addition process in the image sensor 103 is controlled according to the state of AF control, so that the S / N ratio is improved without affecting the AF control. be able to.

  As is clear from the above description, in the example shown in FIG. 1, the AF control unit 107, the distance measurement region determination unit 110, and the instruction information generation unit 109 function as a first control unit. Further, the signal calculation unit 104 functions as an addition unit, and the phase difference distance measurement unit 105 functions as a distance measurement unit. Further, the contrast calculation unit 106 functions as a calculation unit, and the AF control unit 107 and the optical system driving unit 102 function as a second control unit.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  Moreover, what is necessary is just to make an imaging device perform this control method by using the function of said embodiment as a control method. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus. The control program is recorded on a computer-readable recording medium, for example.

  Each of the above control method and control program has at least a first control step, an addition step, a distance measurement step, a calculation step, and a second control step.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and the computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

DESCRIPTION OF SYMBOLS 101 Optical system 102 Optical system drive part 103 Image pick-up element 104 Signal calculating part 105 Phase difference ranging part 106 Contrast calculation part 107 AF control part 108 Camera signal processing part 109 Instruction information generation part 110 Distance measurement area determination part

Claims (6)

An imaging apparatus including an imaging element that forms an optical image through an imaging optical system and outputs an image signal corresponding to the optical image,
The imaging device includes a plurality of pixels arranged in a two-dimensional matrix, and each of the pixels includes a plurality of photoelectric conversion units that receive light beams passing through different pupil regions of the imaging optical system and perform photoelectric conversion. ,
For each of the pixels, either a first readout mode for reading out the outputs of the plurality of photoelectric conversion units provided in the pixel or a second readout mode for individually reading out the outputs of the plurality of photoelectric conversion units First control means for selecting and performing read control;
Addition means for adding an image signal corresponding to the output of the plurality of photoelectric conversion units to obtain an image signal for a pixel that has been subjected to readout control in the second readout mode;
Ranging means for obtaining a difference between the current focus position and the target focus position by phase difference detection according to an image signal corresponding to the output of the plurality of photoelectric conversion units;
For the pixels read in the first readout mode, the image signal output from the image sensor is used, and for the pixels read in the second readout mode, the adder is output from the image sensor. A calculating means for calculating a contrast evaluation value indicating contrast using the image signal added in
Have a, a second control means for performing focus control of the imaging optical system selectively using the calculated result of the distance measurement results and the calculation unit by the distance measuring means,
The imaging apparatus according to claim 1, wherein the first control unit increases the number of pixels read out in the first readout mode when close to the in-focus state than when close to the out-of-focus state . It said second control means, when the absolute value of the difference between the previous SL target focus position and the current focus position exceeds the predetermined threshold value, the imaging optical system according to the distance measurement result obtained by the distance measuring means The image pickup apparatus according to claim 1 , wherein drive control is performed. 3. The imaging apparatus according to claim 2 , wherein when the absolute value of the difference is equal to or less than the threshold, the second control unit drives and controls the imaging optical system according to a calculation result by the calculation unit. . The case close to the in-focus state is a case where the contrast evaluation value is greater than or equal to a predetermined contrast threshold, and the case close to the out-of-focus state is a case where the contrast evaluation value is less than the contrast threshold. The imaging device according to any one of claims 1 to 3. An optical image is formed through an imaging optical system, and includes an imaging device that outputs an image signal corresponding to the optical image. The imaging device has a plurality of pixels arranged in a two-dimensional matrix, and each of the pixels is An imaging apparatus control method comprising a plurality of photoelectric conversion units that receive light beams passing through different pupil regions of the imaging optical system and perform photoelectric conversion,
For each of the pixels, either a first readout mode for reading out the outputs of the plurality of photoelectric conversion units provided in the pixel or a second readout mode for individually reading out the outputs of the plurality of photoelectric conversion units A first control step for selecting and performing read control;
An addition step of adding an image signal corresponding to the output of the plurality of photoelectric conversion units to obtain an image signal for a pixel subjected to read control in the second read mode;
A distance measuring step for obtaining a difference between a current focus position and a target focus position by phase difference detection according to an image signal corresponding to an output of the plurality of photoelectric conversion units;
For the pixel read in the first readout mode, the image signal output from the imaging element is used, and for the pixel read out in the second readout mode, the addition step is output from the imaging element. A calculation step for calculating a contrast evaluation value indicating contrast using the image signal added in the step;
Have a, a second control step of selectively using the calculated result of the distance measurement results and the calculation step performs a focusing control of the imaging optical system according to the distance measuring step,
In the first control step, the control method of an image pickup apparatus characterized by increasing the pixels read by the first read mode than near the out-of-focus state when close to the focus state. An optical image is formed through an imaging optical system, and includes an imaging device that outputs an image signal corresponding to the optical image. The imaging device has a plurality of pixels arranged in a two-dimensional matrix, and each of the pixels is A control program used in an imaging apparatus including a plurality of photoelectric conversion units that receive light beams passing through different pupil regions of the imaging optical system and perform photoelectric conversion,
In the computer provided in the imaging device,
For each of the pixels, either a first readout mode for reading out the outputs of the plurality of photoelectric conversion units provided in the pixel or a second readout mode for individually reading out the outputs of the plurality of photoelectric conversion units A first control step for increasing the number of pixels read out in the first readout mode when close to the in-focus state when performing read control by selecting the
An addition step of adding an image signal corresponding to the output of the plurality of photoelectric conversion units to obtain an image signal for a pixel subjected to read control in the second read mode;
A distance measuring step for obtaining a difference between a current focus position and a target focus position by phase difference detection according to an image signal corresponding to an output of the plurality of photoelectric conversion units;
For the pixel read in the first readout mode, the image signal output from the imaging element is used, and for the pixel read out in the second readout mode, the addition step is output from the imaging element. A calculation step for calculating a contrast evaluation value indicating contrast using the image signal added in the step;
A second control step of performing focusing control of the imaging optical system by selectively using the distance measurement result of the distance measurement step and the calculation result of the calculation step ;
A control program used in an imaging apparatus, characterized in that