JP5479123B2 - Imaging apparatus and electronic apparatus - Google Patents

Description

  The present invention relates to an imaging apparatus and an electronic apparatus that include an imaging device and includes an optical system.

  In response to the digitization of information, which has been rapidly developing in recent years, the response in the video field is also remarkable.

  In particular, as symbolized by a digital camera, a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor, which is a solid-state image sensor, is used in most cases instead of a conventional film.

  As described above, an imaging lens device using a CCD or CMOS sensor as an imaging element is for taking an image of a subject optically by an optical system and extracting it as an electrical signal by the imaging element. In addition to a digital still camera, It is used in video cameras, digital video units, personal computers, mobile phones, personal digital assistants (PDAs), image inspection devices, industrial cameras for automatic control, and the like.

  FIG. 17 is a diagram schematically illustrating a configuration and a light flux state of a general imaging lens device.

  The imaging lens device 1 includes an optical system 2 and an imaging element 3 such as a CCD or CMOS sensor.

  In the optical system, the object side lenses 21 and 22, the diaphragm 23, and the imaging lens 24 are sequentially arranged from the object side (OBJS) toward the image sensor 3 side.

  In the imaging lens device 1, as shown in FIG. 17, the best focus surface is matched with the imaging device surface.

  FIGS. 18A to 18C show spot images on the light receiving surface of the imaging element 3 of the imaging lens device 1.

  In addition, imaging devices have been proposed in which light beams are regularly dispersed by a phase plate and restored by digital processing to enable imaging with a deep depth of field (for example, Non-Patent Documents 1 and 2 and Patent Documents). 1-5).

  In addition, an automatic exposure control system for a digital camera that performs filter processing using a transfer function has been proposed (see, for example, Patent Document 6).

  In addition, in an apparatus having an image input function such as a CCD or CMOS, it is often very useful to read a close still image such as a barcode together with a desired image such as a landscape.

  For barcode reading, for example, as a first example, a technique for focusing by auto-focusing that extends a lens, and as a second example as a depth expansion technique, the depth of field is expanded by, for example, reducing the F value in a camera. Some have fixed focus.

USP 6,021,005 USP 6,642,504 USP 6,525,302 USP 6,069,738 JP 2003-235794 A JP 2004-153497 A

“Wavefront Coding; jointly optimized optical and digital imaging systems”, Edward R. Dowski, Jr., Robert H. Cormack, Scott D. Sarama. “Wavefront Coding; A modern method of achieving high performance and / or low cost imaging systems”, Edward R. Dowski, Jr., Gregory E. Johnson.

In the technique described above, image restoration processing is premised, and noise and cost increase associated with image processing are problematic. Furthermore, an optical transfer function (OTF: Optical) is used for the restoration process.
Since (Transfer Function) must not depend on the object distance, an optical system in which the OTF remains constant even after out-of-focus must be designed.

  Also, even if depth expansion is realized for an F value of a certain characteristic, there is a disadvantage that the depth expansion action is usually lost or the efficiency is remarkably reduced by changing the aperture diameter. In order to cope with various environmental conditions, it is very important to vary the aperture diameter. In particular, when close-up photography is required, it is possible to expand the depth further by making the aperture diameter variable, and it can be expected to widen the photographing range.

  It is an object of the present invention to provide an imaging apparatus and an electronic apparatus that can prevent a decrease in depth expansion function even when the aperture diameter is changed, and can obtain a necessary depth even in close-up photography.

An imaging apparatus according to a first aspect of the present invention includes an aberration control optical system including an aberration control unit having an aberration control function for generating aberrations, and restricts a light beam that passes through the aberration control optical system, and a size of an aperture diameter. An aperture that can change the image, an image sensor that captures the subject image that has passed through the aberration control optical system, and a shooting mode selection unit that can select a plurality of shooting modes. The aperture selects the shooting mode. aberration characteristic of setting the opening diameter, and the aberration control optical system according to the a plurality of inflection points in the effective diameter of the diaphragm, the inflection point even when narrowed down from opening the aperture At least one of them remains and exhibits a depth expansion effect.

Preferably, the shooting mode includes a shooting mode that requires close-up shooting,
When the shooting mode that requires close-up shooting is selected by the shooting mode selection unit, the aperture is set to a state of being narrowed from the open position.

  Preferably, the aberration control optical system has a plurality of peaks in the main image plane shift region of an arbitrary frequency in the MTF characteristic against defocus of the aberration control optical system.

  Preferably, the aberration control unit includes a function of expanding the depth by generating spherical aberration.

  Preferably, in the aberration control optical system, an aberration control unit having the aberration control function is disposed adjacent to the stop.

  The aberration control optical system has a depth expansion effect regardless of the aperture diameter of the stop.

  Preferably, the aberration characteristic of the aberration control optical system is such that the light beam passes from the region through which the light beam passes when the variable diaphragm has an open aperture, when the aperture diameter is minimum and has a depth extending effect by the aberration control function. One or more inflection points are provided in the region excluding the region to be operated.

  Preferably, the aberration characteristic of the aberration control optical system has three or more inflection points in a spherical aberration curve generated within the aperture diameter of the stop.

  Preferably, the amount of amplitude of the spherical aberration curve has a characteristic of gradually increasing from the central part to the peripheral part.

  Preferably, the image processing unit includes an image processing unit that performs image processing on an image signal obtained by the imaging device and improves image characteristics that are deteriorated due to the aberration of the aberration control optical system.

An electronic apparatus according to a second aspect of the present invention includes an imaging device, and the imaging device passes through the aberration control optical system including an aberration control optical system including an aberration control unit having an aberration control function for generating aberration. A diaphragm capable of limiting the luminous flux to be changed and changing the size of the aperture diameter, an image sensor that captures a subject image that has passed through the aberration control optical system, and a shooting mode selection unit that can select a plurality of shooting modes. The aperture has an aperture diameter set according to the selection of the shooting mode, and the aberration characteristic of the aberration control optical system has a plurality of inflection points within the effective diameter of the aperture, At least one inflection point remains even in the state that is narrowed from the open position, and the depth expansion effect is exhibited.

  According to the present invention, not only can the optical system be simplified and the cost can be reduced, but also the depth can be expanded without performing image restoration processing, and the aperture diameter can be changed according to the selection of the shooting mode. However, it is possible to prevent the depth extension function from being lowered.

It is an external view which shows an example of the information code reader as an electronic device which concerns on embodiment of this invention. It is a figure which shows the example of an information code. It is a block diagram which shows the structural example of the imaging device applied to the information code reader of FIG. It is a figure which shows the basic structural example of the imaging lens unit which forms the optical system which concerns on this embodiment. It is a figure for demonstrating the spherical aberration generation amount of the aberration control optical system which concerns on this embodiment, Comprising: It is a figure which shows the relationship between a sensor and PSF when an image pick-up element (sensor) is fixed. It is a figure for demonstrating the spherical aberration generation amount of the aberration control optical system which concerns on this embodiment, Comprising: It is a figure which shows the relationship between a sensor and PSF when an aberration control optical system is fixed. It is a figure which shows the state of MTF with respect to the defocus of the normal optical system and the aberration control optical system which concerns on this embodiment. It is a figure which shows that MTF with respect to a defocus can be performed for 2 minutes in the arbitrary frequencies in the aberration control optical system which suppressed the high frequency OTF fluctuation | variation. It is a figure which shows that MTF with respect to a defocus can be divided into 2 by the arbitrary frequency in the aberration control optical system which suppressed the OTF fluctuation | variation of the low frequency. It is a figure which compares and shows the spherical aberration by the difference in aperture diameter according to imaging | photography mode, defocus MTF, and the depth of this optical system and a normal optical system. It is a figure which compares and shows the spherical aberration and defocus MTF by the difference in the number of inflection points in a spherical aberration curve. It is a figure for demonstrating the MTF correction process in the image processing apparatus which concerns on this embodiment. It is a figure for demonstrating concretely the MTF correction process in the image processing apparatus which concerns on this embodiment. It is a figure which shows the response (response) of MTF when an object exists in a focus position in the case of a normal optical system, and when it remove | deviated from a focus position. It is a figure which shows the response of MTF when an object exists in a focus position and remove | deviates from a focus position in the case of the optical system of this embodiment which has an aberration control element. It is a figure which shows the response of MTF after the image process of the imaging device which concerns on this embodiment. It is a figure which shows typically the structure and light beam state of a general imaging lens apparatus. FIG. 18A is a diagram showing a spot image on the light receiving surface of the imaging element of the imaging lens device of FIG. 17, where FIG. 17A shows a case where the focal point is shifted by 0.2 mm (Defocus = 0.2 mm), and FIG. In the case (Best focus), (C) is a diagram showing each spot image when the focal point is shifted by -0.2 mm (Defocus = -0.2 mm).

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is an external view showing an example of an information code reader as an electronic apparatus according to an embodiment of the present invention.

  2A to 2C are diagrams illustrating examples of information codes.

  FIG. 3 is a block diagram illustrating a configuration example of an imaging apparatus applicable to the information code reading apparatus in FIG.

  Here, an information code reader is illustrated as an apparatus to which the imaging apparatus of the present embodiment is applicable.

  As shown in FIG. 1, the information code reader 100 according to the present embodiment has a main body 110 connected to a processing device such as an electronic register (not shown) via a cable 111, for example, a reflectance printed on a reading object 120. It is a device that can read the information code 121 such as a different symbol or code.

  As an information code to be read, for example, a one-dimensional bar code 122 such as a JAN code as shown in FIG. 2A, a stack-type CODE 49 as shown in FIGS. 2B and 2C, Alternatively, a two-dimensional barcode 123 such as a matrix type QR code can be used.

  In the information code reading apparatus 100 according to the present embodiment, an illumination light source (not shown) and an imaging apparatus 200 as shown in FIG.

  As will be described in detail later, the imaging apparatus 200 applies an aberration control unit (aberration control surface or aberration control element) to the optical system, and intentionally applies aberration (spherical aberration in the present embodiment) by the aberration control unit. The system uses an aberration control optical system that has a depth expansion function and maintains the depth expansion function even if the aperture of the variable aperture is changed. An information code such as a two-dimensional bar code such as a QR code can be accurately read with high accuracy.

  In addition to the above configuration, the imaging apparatus 200 has two or more peaks instead of one in the main image plane shift region of an arbitrary frequency in a modulation transfer function (MTF) for defocus. By adopting an aberration control optical system that enables depth expansion while suppressing a decrease in the MTF peak value, a one-dimensional barcode such as a JAN code and a two-dimensional barcode such as a QR code are used. A simple information code can be accurately read with high accuracy.

  As shown in FIG. 3, the imaging apparatus 200 of the information code reading apparatus 100 includes an aberration control optical system 210, an imaging element 220, an analog front end unit (AFE) 230, an image processing device 240, a camera signal processing unit 250, and an image display. A memory 260, an image monitoring device 270, an operation unit 280, and a control device 290 are provided.

  FIG. 4 is a diagram showing a basic configuration of an imaging lens unit forming the aberration control optical system according to the present embodiment.

  The aberration control optical system 210 </ b> A supplies an image obtained by photographing the subject object OBJ to the image sensor 220. In the aberration control optical system 210A, a first lens 211, a second lens 212, a third lens 213, a variable aperture 214, a fourth lens 215, and a fifth lens 216 are arranged in order from the object side.

  In the aberration control optical system 210A of this embodiment, a fourth lens 215 and a fifth lens 216 are connected. That is, the lens unit of the aberration control optical system 210A of the present embodiment is configured to include a cemented lens.

  The aberration control optical system 210A of the present embodiment is configured as an optical system to which an aberration control surface having an aberration control function for intentionally generating aberration is applied.

  In this embodiment, it is necessary to insert an aberration control surface in order to generate only spherical aberration. As an aberration control effect, an aberration control element as a separate element may be inserted.

  An example of this is shown in FIG. 4 and includes a normal optical system including an aberration control surface (third lens R2 surface).

  The aberration control surface here refers to a lens surface that includes the aberration control effect of the aberration control element. The aberration control surface 213a is preferably adjacent to the variable stop 214.

  The aberration characteristics of the aberration control optical system 210A of the present embodiment have a depth expansion effect (function) even if the aperture of the variable diaphragm 214 changes.

  Here, the aberration control optical system 210A can select a plurality of F values by changing the aperture of the variable stop 214, and any of the selectable F values depends on the effect of the aberration control element or the aberration control surface. It is possible to perform depth extension.

  The aberration characteristic of the aberration control optical system 210 </ b> A of the present embodiment has a plurality (two or more) inflection points within the effective diameter of the variable stop 214.

  Furthermore, the aberration characteristics of the aberration control optical system 210A of the present embodiment are such that when the variable stop 214 has an open aperture, the light beam is transmitted from the region where the light beam passes to the minimum aperture diameter that has a depth expansion effect by the aberration control function. It has one or more inflection points in the area excluding the passing area.

  In other words, the aberration characteristics of the aberration control optical system 210A of this embodiment are the F value expected to have a depth expansion effect, the region of the aberration control surface through which the light beam passes at the brightest F value, and the darkest F value. And having one or more inflection points between the regions of the aberration control surface through which the light beam passes.

  In the aberration control optical system 210A of the present embodiment, the main image that is not pseudo-resolved at a predetermined frequency is set such that the PSF spans two or more pixels by using an aberration control optical system including an aberration control surface having an aberration control function. This is configured as a depth extension optical system having two or more peaks with respect to defocusing in the surface shift region.

  In a depth extension optical system using a general optical wavefront modulation function, the base of one peak is expanded in the MTF characteristics to expand the depth. In exchange for this, the peak value of the MTF characteristics decreases.

  In the present embodiment, by having a plurality of peaks using the aberration control function, depth extension can be realized while suppressing a decrease in peak value.

  By appropriately controlling the spherical aberration, it is possible to extend the depth without performing image restoration processing.

  Specifically, the aberration control optical system 210A of the present embodiment divides the MTF peak for defocus into a plurality of parts (here, divided into two) by an aberration control element that mainly generates spherical aberration or an aberration control surface. Can control the change of OTF in the out-of-focus state and can extend the depth. In order to divide the peak, an inflection point is given to the spherical aberration.

  As described above, it is possible to realize depth expansion with respect to selection of a plurality of aperture diameters by appropriately giving two or more inflection points to the spherical aberration.

  As described above, among the F values expected to have a depth expansion effect, the region of the aberration control surface through which the light beam passes at the brightest F value and the aberration control surface through which the light beam passes at the darkest F value. It is desirable to have one or more inflection points between regions.

  By adopting this configuration, even when the F value is changed, it is possible to efficiently obtain the depth extending action.

  Hereinafter, the characteristic configuration and function of the aberration control optical system 210A will be described in more detail.

  FIGS. 5A and 5B and FIGS. 6A and 6B are diagrams for explaining the spherical aberration generation amount of the aberration control optical system according to the present embodiment. FIG. 5 shows the relationship between the sensor and the PSF when the imaging element (sensor) is fixed, and FIG. 6 shows the relationship between the sensor and the PSF when the aberration control optical system is fixed.

  For example, it is assumed that the image sensor 220 is a sensor having a certain pixel pitch. In this case, in the present embodiment, it is necessary to generate spherical aberration and make the PSF larger than one pixel PXL.

  As shown in FIGS. 5 (A) and 6 (A), even if spherical aberration is generated with a size that allows the PSF to be accommodated in one pixel PXL, it is the same as a normal optical system. In the normal optical system, the size of the center PSF at the focus position is generally minimum.

  On the other hand, in the aberration control optical system 210A according to the present embodiment, as shown in FIG. 5B, the PSF is controlled to a size that does not fit in one pixel PXL not only in the out-of-focus state but also in the focus position.

  In other words, the aberration control optical system 210A according to the present embodiment extends the depth of field by having two or more peaks in the MTF characteristics with respect to defocus.

  Next, selection of an image sensor (sensor) suitable for the aberration control optical system will be described.

  For example, if there is an aberration control optical system having a certain PSF size, it is preferable to select a sensor whose pixel pitch is smaller than the size of the PSF, as shown in FIG.

  If a pixel pitch larger than the PSF is selected, it becomes the same as the normal optical system, which is in focus. Therefore, in this case, the effect of spherical aberration of the aberration control optical system cannot be obtained effectively.

  FIGS. 7A to 7C are diagrams illustrating the MTF state with respect to the defocus of the normal optical system and the aberration control optical system according to the present embodiment.

FIG. 7A shows the MTF state with respect to the defocus of the normal optical system, and FIG. 7B shows the MTF state with respect to the defocus of the aberration control optical system according to the present embodiment.
C) shows the state of the MTF with respect to defocus in which one peak is enlarged.

In a normal optical system, as shown in FIG. 7A, there is one focus position at the center. The second mountain on both sides falls and flips, resulting in false resolution.

  Therefore, the area to be resolved is a main image plane shift area MSAR indicated by shading. When the depth of one peak of the normal optical system is extended, the MTF is greatly degraded as shown in FIG.

  Therefore, in the MTF for the defocus of the aberration control optical system according to the present embodiment, as shown in FIG. 7B, the single peak PK1 in the normal optical system is divided into two peaks PK11 and PK12. ing.

  It can be seen that although the MTF is slightly degraded, the depth is increased by about 2 times due to the division into two, and the degradation is suppressed more than the depth extension of one peak.

  FIGS. 8A to 8C and FIGS. 9A to 9C show that the MTF for defocus can be divided into two at an arbitrary frequency by the spherical aberration curve (curve) in the aberration control optical system of the present embodiment. Will be explained.

  8A to 8C show that the MTF for defocus can be divided into two at an arbitrary frequency in the aberration control optical system in which the high-frequency OTF fluctuation is suppressed, and FIG. 8A shows the spherical aberration curve. 8B shows the state of the MTF peak in the main image plane shift area area MSAR at a low frequency, and FIG. 8C shows the state of the MTF peak in the main image plane shift area area MSAR at a high frequency. Is shown.

  FIGS. 9A to 9C show that the MTF for defocus can be divided into two at an arbitrary frequency in the aberration control optical system in which the low-frequency OTF fluctuation is suppressed, and FIG. 9A shows the spherical aberration curve. 9B shows the state of the MTF peak in the main image plane shift area area MSAR at a low frequency, and FIG. 9C shows the MTF peak state in the main image plane shift area area MSAR at a high frequency. Indicates the state.

  As can be seen from FIGS. 9A to 9C, in order to extend the depth of the low frequency, the amplitude of the spherical aberration may be increased.

  A defocus MTF having an arbitrary frequency can be divided into two by controlling the amplitude. That is, the depth of an arbitrary frequency can be expanded.

  In the present embodiment, the low frequency and high frequency for defocus are defined as follows.

  A frequency that is half or more of the Nyquist frequency determined from the pixel pitch of the solid-state imaging device (imaging device 220) to be used is a high frequency, and a frequency lower than half is a low frequency.

  However, the Nyquist frequency is defined as follows.

Nyquist frequency = 1 / (pixel pitch of solid-state image sensor × 2)
FIGS. 10A to 10C are diagrams showing a comparison of spherical aberration and defocus MTF due to a difference in aperture diameter depending on the photographing mode, and the depths of the present optical system and the normal optical system.

  10A shows a state in which the aperture is opened, FIG. 10B shows a state in which the aperture is stopped in the middle according to, for example, a distant shooting mode, and FIG. 10C shows a shooting mode that requires close-up shooting, for example. The state in which the aperture is reduced to the minimum is shown.

  In a distant view shooting mode or a shooting mode that requires close-up shooting (information code reading shooting mode or macro shooting mode), the aperture diameter is made smaller than in other shooting modes in order to further increase the depth.

  If the range of subject distance is wide but can be expected to be within a certain depth of focus range, as in the far-field shooting mode, the aperture diameter must be large so that the depth of field matches that range. It is possible to set the degree.

  If the focus position on the image plane varies greatly depending on the subject distance, such as in a shooting mode that requires close-up shooting, set the aperture diameter to the minimum to maximize the depth expansion effect. It is also possible.

  In the state where the diaphragm is opened most, as shown in FIG. 10A, since light rays pass through the aberration control surface near the diaphragm having a plurality of inflection points, a plurality of inflection points are also formed in the spherical aberration curve. Have.

  Even if the aperture is narrowed from there, as shown in FIGS. 10B and 10C, the depth expansion action can be continued until at least one inflection point remains.

  In the above description, the case where the spherical aberration curve (curve) has two inflection points has been mainly described. However, the spherical aberration curve may have three or more inflection points, and three or more inflection points may be provided. In the case of having a point, there are the following advantages.

  At two or less inflection points, the allocation of the inflection point area with respect to the image height is biased, so that when the depth is expanded, a phenomenon occurs in which the peak position is shifted for each frequency.

  In such a case, since the ratio of the frequency component included in the PSF is different for each object distance, there is a possibility that image processing combined with the characteristics of the lens corresponding to the object distance may be required.

  Therefore, by setting the inflection point of the spherical aberration curve to three or more, a plurality of peaks in the defocus MTF are provided, and the amplitude of the spherical aberration curve is gradually increased from the central portion to the peripheral portion, Depth expansion that balances frequency control can be realized.

  FIGS. 11A and 11B are diagrams showing a comparison of spherical aberration and defocus MTF due to a difference in the number of inflection points in the spherical aberration curve.

  FIG. 11A shows a case where the number of inflection points is two, and FIG. 11B shows a case where the number of inflection points is four.

  As shown in FIG. 11A, at two inflection points, the peak positions are different between the high frequency and the low frequency.

  On the other hand, as shown in FIG. 11B, when the four inflection points are arranged with an appropriate amplitude amount, the peak position is the same regardless of the frequency.

  That is, when there are four inflection points, it is possible to realize depth extension that balances frequency control.

  The characteristic configuration, function, and effect of the optical system according to the present embodiment have been described above.

  Hereinafter, the configuration and functions of other components such as the image sensor and the image processing unit will be described.

  For example, as shown in FIG. 4, the imaging element 220 includes a glass parallel plane plate (cover glass) 221 and an imaging surface 222 of an imaging element made up of a CCD or a CMOS sensor, in order from the fifth lens 216 side. ing.

  Light from the subject OBJ via the aberration control optical system 210A is imaged on the imaging surface 222 of the imaging element 220.

  Note that the subject dispersion image captured by the image sensor 220 is an image in which a deep light beam and a blurred portion are formed without being focused on the image sensor 220 by the aberration control surface 213a.

  As shown in FIG. 3, the image sensor 220 forms an image captured by the aberration control optical system 210, and uses the analog front-end unit 230 as the primary image signal FIM of the electrical primary image information. Via a CCD or a CMOS sensor that is output to the image processing device 240.

  In FIG. 3, the imaging element 220 is described as a CCD as an example.

  The analog front end unit 230 includes a timing generator 231 and an analog / digital (A / D) converter 232.

  The timing generator 231 generates the drive timing of the CCD of the image sensor 220, and the A / D converter 232 converts an analog signal input from the CCD into a digital signal and outputs it to the image processing device 240.

  The image processing device 240 constituting a part of the signal processing unit inputs a digital signal of a captured image coming from the AFE 230 in the previous stage, performs image processing such as edge enhancement, and reduces the contrast reduced by the aberration of the aberration control optical system 201A. The signal is improved and passed to the camera signal processing unit (DSP) 250 in the subsequent stage.

  The camera signal processing unit (DSP) 250 performs processing such as color interpolation, white balance, YCbCr conversion processing, compression, and filing, and stores the data in the memory 260 and displays the image on the image monitoring device 270.

  The control device 290 performs exposure control and has operation inputs such as the operation unit 280. The control device 290 determines the operation of the entire system according to those inputs, and includes the AFE 230, the image processing device 240, the DSP 250, the variable aperture 214, and the like. It controls the mediation control of the entire system.

  The operation unit 280 includes mode selection means. When the mode selection means is operated, the opening diameter of the variable diaphragm 214 is set. In particular, when a shooting mode that requires close-up shooting is selected by the mode selection unit, control is performed so that the aperture diameter of the variable diaphragm 214 is narrowed from the open position. The shooting mode that requires close-up shooting refers to a shooting mode such as a macro shooting mode or an information code reading shooting mode. In these shooting modes that require close-up shooting, the focus position on the image plane varies greatly depending on the subject distance. Therefore, a further depth expansion effect can be expected by reducing the aperture diameter in addition to the depth expansion by the aberration control element.

  Hereinafter, the configuration and functions of the optical system and the image processing apparatus according to the present embodiment will be described in detail.

  In the present embodiment, an aberration control optical system is employed to obtain high-definition image quality, and the optical system can be simplified and the cost can be reduced.

  As described above, the image processing apparatus 240 receives the primary image FIM from the image sensor 220, performs image processing such as edge enhancement, and performs processing to improve the contrast reduced by the aberration of the aberration control optical system 201A. To form a high-definition final image FNLIM.

  The MTF correction processing of the image processing device 240 is performed after edge enhancement, chroma enhancement, etc., using the MTF of the primary image, which is essentially a low value, as shown by a curve A in FIG. In the process, correction is performed so as to approach (reach) the characteristics indicated by the curve B in FIG.

  A characteristic indicated by a curve B in FIG. 12 is a characteristic obtained when the wavefront is not deformed without using the aberration control surface or the aberration control optical element as in the present embodiment.

  It should be noted that all corrections in the present embodiment are based on spatial frequency parameters.

  In this embodiment, as shown in FIG. 12, in order to achieve the MTF characteristic curve B to be finally realized with respect to the MTF characteristic curve A with respect to the optically obtained spatial frequency, each spatial frequency is changed to each spatial frequency. On the other hand, as shown in FIG. 13, strength such as edge enhancement is added, and the original image (primary image) is corrected.

  For example, in the case of the MTF characteristic of FIG. 12, the curve of edge enhancement with respect to the spatial frequency is as shown in FIG.

  That is, a desired MTF characteristic curve B is virtually realized by performing correction by weakening edge enhancement on the low frequency side and high frequency side within a predetermined spatial frequency band and strengthening edge enhancement in the intermediate frequency region. To do.

  As described above, the imaging apparatus 200 according to the embodiment basically includes the aberration control optical system 210 and the imaging element 220 that form the primary image, and the image processing apparatus 140 that forms the primary image into a high-definition final image. In this optical system, spherical aberration is intentionally achieved by providing a new aberration control element or by shaping the surface of the optical element such as glass or plastic for aberration control. The generated wavefront is deformed (modulated), and such a wavefront is imaged on the imaging surface (light receiving surface) of the imaging element 220 including a CCD or a CMOS sensor, and the primary image is subjected to image processing. The image forming system obtains a high-definition image through the device 240.

  In the present embodiment, the primary image from the image sensor 220 has a light flux condition with a very deep depth. For this reason, the MTF of the primary image is essentially a low value, and the MTF is corrected by the image processing device 240.

  Next, the response of the MTF of this embodiment and the normal optical system will be considered.

  FIG. 14 is a diagram showing MTF responses when the object is at the focal position and when the object is out of the focal position in the case of a normal optical system.

  FIG. 15 is a diagram showing the MTF response when the object is at the focal position and when the object is out of the focal position in the optical system of the present embodiment having the aberration control element.

  FIG. 16 is a diagram illustrating a response of the MTF after image processing of the imaging apparatus according to the present embodiment.

  As can be seen from the figure, in the case of an optical system having an aberration control surface or an aberration control element, even if the object deviates from the focal position, the change in the response of the MTF does not insert the aberration control surface or the aberration control element. Less than.

  The image formed by the optical system is subjected to image processing by the subsequent image processing device 240, whereby the MTF response can be improved.

  However, if noise increases when image processing is performed, it is preferable not to perform image processing that preferably improves the response of the MTF.

  As described above, an optical system that intentionally generates aberration according to the purpose is referred to as an aberration control optical system.

  The absolute value (MTF) of the OTF of the aberration control optical system shown in FIG. 15 is preferably 0.1 or more at the Nyquist frequency.

  This is because, in order to achieve the OTF after restoration shown in FIG. 16, the gain is increased by image processing, but the noise of the sensor is also increased at the same time. Therefore, it is preferable to perform image processing without increasing the gain as much as possible at high frequencies near the Nyquist frequency.

  In the case of a normal optical system, resolution is achieved if the MTF at the Nyquist frequency is 0.1 or more.

  Therefore, if the MTF before image processing is 0.1 or more, it is not necessary to increase the gain at the Nyquist frequency in image processing. If the MTF before image processing is less than 0.1, the image after image processing becomes an image greatly affected by noise, which is not preferable.

  As described above, according to the present embodiment, the variable aperture 214, the aberration control optical system 210 having an aberration control function for intentionally generating aberration, the image sensor 220, and the primary image are converted into a high-definition final image. The aberration characteristics of the aberration control optical system 210A including the image processing device 240 to be formed have a depth expansion effect (function) even if the aperture of the variable stop 214 changes.

  The aberration control optical system 210A can select a plurality of F values by changing the aperture of the variable stop 214.

  Further, the aberration characteristic of the aberration control optical system 210A of the present embodiment has a plurality (two or more) inflection points within the effective diameter of the variable stop 214.

  The aberration characteristics of the aberration control optical system 210A of the present embodiment are such that the light beam passes from the region where the light beam passes when the variable stop 214 has an open aperture to the minimum aperture diameter having a depth expansion effect by the aberration control function. It has one or more inflection points in the area excluding the area.

  That is, the aberration characteristic of the aberration control optical system 210A of the present embodiment is that the aberration control surface region through which the light beam passes and the darkest F value among the F values expected to have a depth expansion effect. Sometimes there is one or more inflection points between the areas of the aberration control surface through which the light passes.

  Therefore, according to the present embodiment, a plurality of F values can be selected by changing the aperture of the variable diaphragm 214, and any of the selectable F values has a depth due to the effect of the aberration control element or the aberration control surface. Extensions can be made.

  Further, by appropriately providing two or more inflection points in the spherical aberration, it is possible to realize depth extension for selection of a plurality of aperture diameters.

  In addition, even when the F value is changed, it is possible to obtain a depth extending action efficiently.

  That is, according to the present embodiment, depth expansion can be performed without performing image restoration processing, and deterioration of the depth expansion function can be prevented even if the aperture diameter is changed.

  Further, according to the present embodiment, the aberration control optical system 210A includes an aberration control element having an aberration control function for intentionally generating an aberration, or includes an aberration control surface having an aberration control function. Is used to extend the PSF over two or more pixels, and is formed as a depth expansion optical system having two or more peaks with MTF characteristics for defocus in a main image plane shift region that is not falsely resolved at a predetermined frequency. Therefore, the following effects can be obtained.

  In this embodiment, by using the aberration control function to have a plurality of two or more peaks in the MTF characteristic for defocus, a general optical without an aberration control element while suppressing a decrease in peak value. Can extend the depth more than the system.

  That is, according to the present embodiment, by appropriately controlling the spherical aberration, the depth can be expanded without performing the image restoration process, and a good image with appropriate image quality and less influence of noise is obtained. It becomes possible.

  In addition, according to the present embodiment, by providing three or more inflection points of the spherical aberration curve, a plurality of peaks in the defocus MTF are provided, and the amplitude of the spherical aberration curve is increased from the central portion to the peripheral portion. By gradually increasing the depth, it is possible to achieve depth expansion that balances frequency control.

  Further, there is an advantage that a natural image can be obtained without requiring an optical lens that is difficult, expensive, and large in size, and without driving the lens.

  The imaging apparatus 200 according to the present embodiment can be used in an optical system that requires consideration for the small size, light weight, and cost of consumer devices such as digital cameras and camcorders.

  In addition, the configuration of the aberration control optical system 210 can be simplified, manufacturing becomes easy, and cost reduction can be achieved.

  As an electronic apparatus to which the imaging apparatus 100 according to the present embodiment can be applied, in addition to an information reading apparatus, in addition to a digital still camera, a video camera, a digital video unit, a personal computer, a mobile phone, a PDA, and an image inspection apparatus It can be applied to industrial cameras for automatic control.

200 ... Imaging device 210 ... Aberration control optical system 211 ... First lens 212 ... Second lens 213 ... Third lens 213a ... Aberration control surface 214 ... Variable aperture 215- .... Fourth lens 220 ... Image sensor 230 ... Analog front end (AFE)
240 ... Image processing device 250 ... Camera signal processing unit 280 ... Operation unit 290 ... Control device MSAR ... Main image plane shift area.

Claims (11)

An aberration control optical system including an aberration control unit having an aberration control function for generating aberration;
A diaphragm that limits the luminous flux passing through the aberration control optical system and can change the size of the aperture diameter;
An image sensor that captures a subject image that has passed through the aberration control optical system;
A shooting mode selection unit capable of selecting a plurality of shooting modes;
The aperture sets an aperture diameter according to the selection of the shooting mode, and the aberration characteristics of the aberration control optical system are:
An imaging apparatus having a plurality of inflection points within an effective diameter of the diaphragm, and at least one inflection point remains even in a state in which the diaphragm is further narrowed from an open position, and exhibits a depth expansion effect. The shooting mode includes a shooting mode that requires close-up shooting,
The imaging apparatus according to claim 1, wherein when the photographing mode that requires the close-up photographing is selected by the photographing mode selection unit, the diaphragm is in a state of being narrowed from an open position. The imaging device according to claim 1, wherein the aberration control optical system has a plurality of peaks in a main image plane shift region having an arbitrary frequency in the MTF characteristic with respect to defocusing. The aberration control unit is
The imaging apparatus according to claim 1, further comprising a function of expanding a depth by generating spherical aberration. The aberration control optical system is
The imaging apparatus according to claim 1, wherein an aberration control unit having the aberration control function is disposed adjacent to the diaphragm. The aberration control optical system is
The imaging apparatus according to claim 1, which has a depth expansion effect regardless of the aperture diameter of the diaphragm. The aberration characteristics of the aberration control optical system are:
One or more inflection points in the region excluding the region where the light beam passes from the region where the light beam passes when the variable aperture is an open aperture to the minimum aperture diameter having the depth extension effect by the aberration control function. The imaging device according to any one of claims 1 to 6. The aberration characteristics of the aberration control optical system are:
The imaging apparatus according to claim 1, wherein the spherical aberration curve generated within the aperture diameter of the stop has three or more inflection points. The imaging apparatus according to claim 8, wherein an amplitude amount of the spherical aberration curve has a characteristic of gradually increasing from a central part to a peripheral part. The imaging according to any one of claims 1 to 9, further comprising an image processing unit that performs image processing on an image signal obtained by the imaging element and improves an image characteristic that is deteriorated due to an aberration of the aberration control optical system. apparatus. Having an imaging device,
The imaging device
An aberration control optical system including an aberration control unit having an aberration control function for generating aberration;
A diaphragm that limits the luminous flux passing through the aberration control optical system and can change the size of the aperture diameter;
An image sensor that captures a subject image that has passed through the aberration control optical system;
A shooting mode selection unit capable of selecting a plurality of shooting modes;
The aperture sets an aperture diameter according to the selection of the shooting mode, and the aberration characteristic of the aberration control optical system is:
An electronic device having a plurality of inflection points within an effective diameter of the diaphragm, and at least one inflection point remains even in a state where the diaphragm is further narrowed from an open state, thereby exhibiting a depth expansion effect.