JP5843599B2 - Image processing apparatus, imaging apparatus, and method thereof - Google Patents

Description

  The present invention relates to an image processing apparatus, an imaging apparatus, and a method thereof, and more specifically to an image processing apparatus, an imaging apparatus, and a method thereof for generating an image with a wide dynamic range using a plurality of images.

  When shooting outdoors using a digital camera, the dynamic range of the shooting scene may be wider than the dynamic range that can be shot. At this time, gradation information cannot be recorded for a subject that exceeds the dynamic range that can be photographed, and thus whiteout and blackout occur in the photographed image. As a result, the impression of the shooting scene and the impression of the shot image may be different.

  Conventionally, a high dynamic range image generation technique (hereinafter, HDR image generation technique) is known as one of the techniques for solving such a problem. The HDR image generation technology generates a plurality of captured images with different exposures and combines them to generate an image with a wider dynamic range. Here, as a method of changing the exposure of a photographed image, a method of photographing the same scene a plurality of times by changing the exposure time of the digital camera is widely known. As another method, a method of acquiring a plurality of images with different exposures by changing the aperture is also known (see, for example, Patent Document 1).

Japanese Patent No. 4530149

  However, in the above-described method of shooting a plurality of times while changing the exposure time, if there is a movement in the shooting scene, the position of the subject appears slightly different for each exposure between shot images, and blurring occurs. Also, in the method of shooting with changing the aperture, the depth of field also changes according to the amount of the aperture, so when shooting a scene with depth, the focus range changes for each exposure, resulting in different blurring. . Therefore, the conventional technique has a problem that when a scene with motion and depth is photographed, an HDR image obtained by synthesizing the photographed images becomes an unnatural image.

  Therefore, in the present invention, a plurality of images with different exposures shot with different apertures are combined after performing correction so that the depth of field is equal to each other, thereby generating a more natural HDR image. For the purpose.

  The image processing apparatus according to the present invention provides a first image obtained by capturing an image of a subject from a first viewpoint through an aperture having a first aperture value, and the subject is different from the first viewpoint. Acquiring from a second viewpoint, a second image having a different exposure from the first image, obtained by imaging through a second aperture value different from the first aperture value. And a pixel value of at least one of the first image and the second image such that a difference between the blur condition of the first image and the blur condition of the second image is reduced. By combining the first image and the second image in which at least one pixel value has been corrected, and a correction means for correcting the image, the dynamic range is greater than that of the first image and the second image. A synthesis means for generating a wide composite image And features.

  According to the image processing method of the present invention, a first image obtained by capturing an image of a subject from a first viewpoint through a first aperture value, and the subject different from the first viewpoint. Acquiring from a second viewpoint, a second image having a different exposure from the first image, obtained by imaging through a second aperture value different from the first aperture value. And a pixel value of at least one of the first image and the second image so that a difference between a blur condition of the first image and the blur condition of the second image is reduced. By combining the first image in which at least one pixel value is corrected and the second image, the dynamic range is greater than that of the first image and the second image. A synthesis process for generating a wide composite image And features.

  The present invention makes it possible to generate a bokeh natural HDR image with less subject blur even in a scene where the subject is moving and deep.

It is a figure which shows an example of the imaging device of this invention. It is a figure which shows an example of the imaging device of this invention. It is a block diagram which shows the system configuration | structure of the image processing apparatus in a present Example. It is a flowchart which shows the flow of the image processing in a present Example. It is a flowchart which shows the flow of the picked-up image acquisition process of a present Example. 3 is a flowchart showing a flow of image correction processing in Embodiment 1. 10 is a flowchart illustrating a flow of image correction processing according to the second exemplary embodiment. It is a figure which shows the example of the picked-up image of each imaging part. It is a figure for demonstrating the relationship with the to-be-photographed object of a scene of a present Example, a focus position, and depth of field. It is a figure which shows the example of the correction | amendment image which adjusted the blur of the present Example to the same extent. It is a figure which shows the example of the correction | amendment image which adjusted the blur of the present Example to the same extent. It is a figure which shows the example of the correction | amendment image which adjusted the blur of the present Example to the same extent. It is a figure which shows the example of the HDR image which correct | amended the extent of the blur of a present Example. It is a figure which shows the example of the HDR image synthesize | combined without correcting the grade of a blur. 10 is a flowchart illustrating a flow of a smoothing process in the second embodiment.

[Example 1]
In this embodiment, the same scene is photographed from a plurality of viewpoint positions using a plurality of imaging units having different apertures, and a plurality of photographed images having different exposures are acquired. Based on the shooting parameters of the imaging unit that captured the image with the shallowest depth of field at the time of shooting using the multiple images obtained, each subject image was defocused by refocusing. A plurality of corrected images having different exposures with reduced blur differences are generated. Finally, these corrected images are combined to generate an HDR image. As a result, it is possible to generate a natural HDR image in which the difference in blur between captured images is corrected.

  First, a system configuration example of the image processing apparatus according to the present embodiment will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of a multi-lens imaging apparatus including a plurality of imaging units. In the figure, the housing of the imaging apparatus 100 includes a camera array including nine imaging units 101 to 109 that acquire images, and a shooting button 110. When the shooting button 110 is pressed, the imaging units 101 to 109 receive light information of the subject with a sensor (imaging device), the received signal is A / D converted, and a plurality of captured images (digital data) are simultaneously displayed. To be acquired. With such a multi-lens imaging device, it is possible to obtain an image group obtained by photographing the same subject from a plurality of positions. Although the number of image pickup units is nine here, the number of image pickup units is not limited to nine, and may be three as shown in FIG. 2, for example. Therefore, the present invention can be applied to any imaging apparatus having a plurality of imaging units. Moreover, the arrangement of the plurality of imaging units is arbitrary, and may be arranged radially or linearly, or may be arranged at random.

  FIG. 3 is a block diagram illustrating an internal configuration of the imaging apparatus 100. A central processing unit (CPU) 201 generally controls each unit described below. The RAM 202 functions as a main memory, work area, and the like for the CPU 201. The ROM 203 stores a control program executed by the CPU 201 and the like. The bus 213 serves as a transfer path for various data. For example, digital data acquired by the imaging units 101 to 109 is sent to a predetermined processing unit via the bus 213. The operation unit 204 that receives a user instruction includes a button, a mode dial, and the like, but is not limited thereto.

  The display unit 206 displays captured images and characters, and for example, a liquid crystal display is used. Further, the display unit 206 may have a touch screen function, and in that case, a user instruction using the touch screen can be handled as an input of the operation unit 204. A display control unit 205 performs display control of a captured image and characters displayed on the display unit 206.

  The imaging unit control unit 207 controls the imaging system based on instructions from the CPU 201 such as focusing, opening and closing the shutter, and adjusting the aperture. The digital signal processing unit 208 performs various processes such as white balance processing, gamma processing, and noise reduction processing on the digital data received via the bus 213. The encoder unit 209 performs processing for converting digital data into a file format such as JPEG or MPEG. The external memory control unit 210 is an interface for connecting to a PC or other media 211 (for example, hard disk, memory card, CF card, SD card, USB memory). The image processing unit 212 performs image processing using the color image group acquired by the imaging units 101 to 109 or the digital image group output from the color image group output from the digital signal processing unit 208.

  Next, an operation procedure of a series of processes in the image processing apparatus of the present embodiment will be described with reference to a flowchart shown in FIG. First, in step S301, a plurality of captured images with different exposures are acquired by capturing a subject with different aperture settings of the imaging units 101 to 109 (captured image acquisition processing). In step S302, based on the imaging parameters of the imaging unit with the shallowest depth of field at the time of imaging, each captured image is refocused to generate a plurality of corrected images (image correction processing). In step S303, the pixel values of the corrected image are combined to generate one HDR image (image combining process). Details of each process will be described below. This process is performed by reading a computer-executable program described to execute the procedure shown in the flowchart of FIG. 4 from the ROM 203 onto the RAM 202 and then executing the read program by the CPU 201.

<Detailed processing for acquiring captured images>
In an ordinary digital camera, one set of shooting parameter sets including a lens type, a focal length, a focus distance, an exposure time, an aperture value, and the like is set in a shooting preparation state. On the other hand, in the multi-lens imaging device used in the present embodiment, each imaging unit sets a shooting parameter for each set. Here, a plurality of shooting parameter sets with different aperture values are set so that exposure is different. create. The created shooting parameter set is assigned to each of the plurality of imaging units 101 to 109, and exposure is performed according to the assigned parameter set, thereby obtaining a plurality of shot images with different exposures. Hereinafter, detailed processing will be described with reference to the flowchart shown in FIG.

  First, when the shooting button 110 is half-pressed, the imaging apparatus 100 according to the present embodiment is in a shooting preparation state. One set of shooting parameter set P0 is determined. Hereinafter, this shooting parameter set is referred to as a reference shooting parameter set. Further, the position of the imaging unit 105 is referred to as a reference viewpoint position O.

  In step S <b> 402, information stored in the reference imaging parameter set and the lens characteristic value database on the ROM 203 is acquired. Based on the acquired information, photographing parameter sets P-1 and P + 1 are generated by changing the aperture value to obtain exposures of −1 (EV = −1) and +1 (EV = + 1). Hereinafter, P-1 and P + 1 are referred to as a variable imaging parameter set. Here, it is assumed that the lens characteristic value database stores in advance the correspondence between the shooting parameter set, the exposure, the depth of field, and the virtual aperture filter used in the image correction process described later.

  When the shooting button 110 is fully pressed, the shooting parameter sets P0, P-1, and P + 1 are assigned to the imaging units 101 to 109 in step S403, and the imaging unit starts shooting operations according to the shooting parameter sets. Obtain multiple shot images. It is desirable to assign the shooting parameter set so that, for example, a shooting parameter set with a deeper depth of field (that is, with the aperture closed) is assigned to a larger number of imaging units that are farther away. For example, imaging parameter sets P-1, P0, and P + 1 are assigned to the imaging units indicated by white circles, shaded areas, and black circles shown in FIG. That is, the imaging parameter set P-1 is assigned to the imaging units 101, 103, 107, and 109. Similarly, the imaging parameter set P0 is assigned to the imaging units 102, 104, 106, and 108, and the imaging parameter set P + 1 is assigned to the imaging unit 105. Such an assignment makes it possible to generate a higher-quality refocus image in the subsequent image correction processing. However, the present invention is not limited to this, and the effect of the present embodiment can be achieved by any combination of the imaging unit and the parameter. I can play.

  An example of a captured image obtained by the above processing is shown in FIG. In FIG. 8, images (a) to (i) are captured images obtained from the imaging units 101 to 109, respectively. Further, FIG. 9 shows the state of the scene photographed at this time. A subject 701 illustrated in FIG. 9 is disposed at a predetermined distance in a direction in which the subject 703 moves away from the imaging apparatus 100, and the focus is on the subject 703. Here, the distance from the imaging device 100 to the subject 703 is L0, and the depths of field of the shooting parameter sets P0, P-1, and P + 1 are D0, D-1, and D + 1, respectively. With this setting, as shown in FIG. 8, the subject 701 is in focus because it is within the depth of field D0 and D-1 in the imaging unit to which the imaging parameter sets P0 and P-1 are assigned. However, it does not fall within the depth of field D + 1 of the imaging unit of the shooting parameter set P + 1. Therefore, the subject 701 looks in focus on the captured image of EV = −1 and EV = ± 0, that is, the image obtained by the imaging unit other than the imaging unit 105, but the image of EV = + 1, that is, the imaging The subject 701 is blurred on the image captured by the unit 105.

<Details of image correction processing>
An image correction process in this embodiment will be described. In this embodiment, a plurality of shot images obtained using the same shooting parameter set are converted and weighted and added to refocus the shot image, and the shooting position, the focus distance, and the depth of field are set. A plurality of corrected images that are the same and have different exposures are generated. Also, the weighting coefficient for weighted addition of captured images is determined based on the imaging parameter set of the imaging unit with the shallowest depth of field at the time of imaging. Hereinafter, detailed processing will be described with reference to the flowchart shown in FIG.

  First, in step S501, a target aperture filter used in step S502 to be described later is acquired based on the reference shooting parameter set P0 and the variable shooting parameter sets P-1 and P + 1. Specifically, first, the corresponding depth of field D0, D-1, and D + 1 is acquired from the lens characteristic value database using the imaging parameter sets P0, P-1, and P + 1. The shallowest depth of field Dmin (D + 1 in this example) is obtained from the obtained depth of field, and the virtual diaphragm filter corresponding to this is obtained from the lens characteristic value database as the target diaphragm filter. Note that the virtual aperture filter represents the size and shape of blur determined according to the aperture, and is a filter in which a weighting factor used for weighting addition in step S502 described later is described.

  Next, in step S502, refocus processing is performed using the focus distance L0 in the reference imaging parameter set P0 and the target aperture filter acquired in step S501, and the captured image of EV = ± 0, −1, +1 is handled. A corrected image is generated. Hereinafter, the refocus processing will be specifically described by taking a captured image of EV = ± 0 as an example. However, various methods are known for the refocus processing, and the implementation method is limited to the processing described in the present embodiment as long as the focus position and the depth of field can be unified between images with different exposures. It is not a thing.

  First, for each of a plurality of captured images obtained using the reference capturing parameter set P0, a shift deformation amount that matches the position of the subject on the focus surface on the image is calculated. A captured image obtained from an imaging unit whose relative position coordinates with respect to the reference viewpoint position O on the camera array plane is (i, j) is I0, (i, j). Then, the horizontal shift amount Shiftu (i, j) and the vertical shift amount Shiftv (i, j) of the captured image I0, (i, j) when the focus distance is L0 can be obtained by the following equations.

  Here, W and H are the horizontal and vertical image sizes of the captured image, respectively, and θw and θh are the horizontal viewing angle and the vertical viewing angle of the imaging unit, respectively.

  Next, using the calculated shift amounts Shiftu (i, j) and Shiftv (i, j) and the weighting coefficient α (i, j) of the target aperture filter acquired in step S501, the captured images I0, ( The corrected image H0 is generated by weighted addition of the pixel values i, j). Where (u, v) is the horizontal and vertical coordinates on the image plane, and I0, (i, j) (u, v) and H0 (u, v) are the captured images I0, (i, j) and It is a pixel value at the coordinates (u, v) of the corrected image H0.

  Through the processing described above, a corrected image H0 is obtained in which the shooting position is O, the focus distance is L0, and the depth of field is Dmin with respect to EV = ± 0. Similarly, by applying a refocus process to the plurality of captured images obtained in step S301 for each variable shooting parameter set used at the time of shooting, a corrected image H-1 for EV = -1, + 1, H + 1 is also generated.

  Examples of corrected images obtained by the above processing are shown in FIGS. These corrected images are images with different exposures but the same degree of blurring of the subject. In step S403, when the imaging parameter set with the shallowest depth of field is assigned to the imaging unit existing at the reference viewpoint position, the refocus processing may be omitted for the captured image obtained from the imaging unit. For example, the shallowest depth of field Dmin may be the depth of field D + 1 corresponding to the variable shooting parameter set P + 1, and the shooting parameter set of the imaging unit 105 may be P + 1. In this case, the EV = + 1 captured image I + 1, (0,0) obtained from the imaging unit 105 may be used as the corrected image H + 1 as it is. In that case, the processing time can be shortened.

  In general, refocus processing is a relatively simple process of generating a high-quality image by generating a blurred subject image from a focused subject image rather than generating a focused subject image from a blurred subject image. Can be generated. Further, when the degree of blur to be generated with respect to the subject image on the captured image is large, the quality of the generated blurred subject image is improved as the images captured from various viewpoint positions are used. Therefore, in the present embodiment, the depth of field of the other photographed image is aligned with the shallowest depth of field of the photographed image, and the photographing parameter set is assigned as described in step S403. This makes it possible to generate a higher quality corrected image.

<Detailed processing of image composition>
When synthesizing an HDR image from a corrected image, a known HDR image generation technique can be used. For example, one HDR image G is generated by multiplying the pixel values of the corrected images H-1, H0, and H + 1 by the composite gain and adding them according to the following equation. Note that the value of the composite gain may be a value corresponding to the exposure of each corrected image (for example, γ−1 = 2.0, γ0 = 1.0, γ + 1 = 0.5). An example of the obtained HDR image G is shown in FIG. Further, FIG. 14 shows an example of an HDR image obtained by synthesizing the image captured by the imaging unit 105 using the imaging parameter sets P0, P-1, and P + 1 without correction. In the HDR image of FIG. 14, blur mismatch occurs between the subject 702 and its periphery. In contrast, in the present embodiment, the correction image used for HDR synthesis is an image obtained by correcting the difference in blur between captured images, so that the HDR image obtained by synthesis is a natural image that does not cause blur mismatching. It becomes.

  As described above, by using a multi-lens camera to simultaneously acquire a plurality of images with different exposures and adjusting the depth, the subject is moving and the subject blurs and blurs even in a deep scene. It is possible to obtain a natural HDR image. In this embodiment, the example of shooting with the exposure changed to EV = −1, ± 0, +1 is described. However, if there are a plurality of exposure levels, shooting is performed with other exposure settings. The same effect can be obtained.

[Example 2]
In the first embodiment, an example has been described in which a corrected image is generated by refocusing a captured image for each exposure so that the degree of blur is matched. In the present embodiment, an example will be described in which a corrected image is generated by smoothing another captured image based on the spectrum of the spatial frequency in the captured image with the shallowest depth of field. Note that the captured image acquisition process and the image composition process are the same as those in the first embodiment, and thus description thereof is omitted. However, in this embodiment, it is assumed that three images are acquired by each imaging unit for each exposure using the imaging device shown in FIG. 2 and are combined to obtain a single captured image. In the present embodiment, an imaging apparatus as shown in FIG. 2 will be described as an example. However, for the number and form of imaging sections, any imaging apparatus known in the art can be used. The following processing can be appropriately changed according to specific device characteristics. Furthermore, the distance between the imaging units is sufficiently short with respect to the focus distance, and an image captured by any imaging unit can be regarded as an image captured from the reference viewpoint position O. Hereinafter, detailed processing will be described with reference to the flowchart shown in FIG.

  First, in step S601, a reference depth image is selected from the captured images based on the reference shooting parameter set P0 and the variable shooting parameter sets P-1 and P + 1. Specifically, the corresponding depth of field D0, D-1, and D + 1 is acquired from the lens characteristic value database using the imaging parameter sets P0, P-1, and P + 1. Then, the obtained shooting parameter set with the shallowest depth of field is specified, and a shot image shot using the set is selected as a reference depth image ID.

  In step S602, the reference depth image ID and other captured images (hereinafter referred to as correction target images) are divided into block regions of N × N pixels. In step S603, the correction is performed by performing smoothing so that the spatial frequency spectrum is equal to the reference depth image ID for each region of each correction target image. Hereinafter, the details will be described using the flowchart shown in FIG. 15 as an example of smoothing the region R of one correction target image In. First, in step S1001, a spatial frequency spectrum is calculated for the region R on the reference depth image ID using Fourier transform or the like. Further, the obtained spectrum is normalized with each DC component, and a normalized spectrum fD (kx, ky) (kx, ky is an index representing a spatial frequency) is obtained.

  Next, in step S1002, a spatial frequency normalized spectrum fn (kx, ky) is obtained for the region R on the correction target image In as in step S1001. In step S1003, the difference Sn between the reference depth image ID and the correction target image In in the region R is obtained using the normalized spectra fD (kx, ky) and fn (kx, ky). Here, the degree of difference Sn is an evaluation value representing the degree of difference between the two normalized spatial frequency spectra, and is calculated according to the following equation, for example. At this time, the difference Sn becomes larger as the degree of blur differs between the reference depth image and the correction target image.

  In step S1004, it is determined whether or not the difference Sn is smaller than a predetermined threshold value Th. When Sn ≦ Th, the reference depth image and the correction target image are determined to have the same degree of blur with respect to the region R, and the pixel value of the region R in the correction target image is stored as the pixel value of the region R in the correction image. After that, the process ends. If Sn> Th, it is determined that the degree of blur is different, and the process proceeds to step S1005. In step S1005, smoothing processing is performed on the region R of the correction target image In using a Gaussian filter or the like, and the process returns to step S1002 with the smoothed correction target image as a new correction target image.

  By repeatedly performing the processes in steps S1002 to S1005, the pixel value of the region R in the corrected image is obtained. In the above-described example, the process is repeated until the dissimilarity is equal to or smaller than the threshold value in step S1004. However, the process may be terminated when the dissimilarity converges to a minimum value.

  With the above processing, it is possible to generate a corrected image in which the difference in blur between captured images is corrected even when the number of imaging units is small. In this embodiment, the captured image including the reference depth image is divided into block areas in step S602. However, the division method is not limited to this. For example, region division may be performed based on the edge of the reference depth image. In this case, there is an effect of avoiding that the contour line of the subject is excessively smoothed or block noise is generated in the corrected image due to a difference in the smoothing level between the block areas.

[Other Embodiments]
The present invention can also be realized by executing the following processing. That is, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed. The present invention can also be realized by a plurality of processors cooperating to perform processing.

Claims (14)

  The first image obtained by imaging the subject from the first viewpoint through the aperture with the first aperture value, and the subject from the second viewpoint different from the first viewpoint, the first Obtaining means for obtaining a second image having a different exposure from the first image, obtained by imaging through a second aperture value different from the first aperture value;
  The pixel value of at least one of the first image and the second image is corrected so that the difference between the blur condition of the first image and the blur condition of the second image is reduced. Correction means;
  Combining the first image with at least one pixel value corrected with the second image to generate a composite image having a wider dynamic range than the first image and the second image Means
  An image processing apparatus.   The correction means corrects at least one pixel value of the first image and the second image, and is an image when the same subject is viewed from the same viewpoint, and images with different exposures. Get multiple images that are
  The synthesizing unit generates the synthesized image by synthesizing the plurality of images acquired by the correcting unit.
  The image processing apparatus according to claim 1.   The first image is an image having a shallower depth of field than the second image,
  The acquisition means further acquires a third image different from the second image, obtained by imaging the subject with the second aperture value,
  The correction means corrects the pixel value of the second image so that the depth of field of the second image becomes shallow by combining the second image and the third image,
  The synthesizing unit generates the synthesized image by synthesizing the first image and the second image whose pixel value is corrected.
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The correction means corrects the pixel value of the second image by weighting and adding the second image and the third image,
  A weighting factor used for the weighted addition is determined based on the first aperture value.
The image processing apparatus according to claim 3.   The first image is an image having a shallower depth of field than the second image,
  The correction unit corrects the pixel value of the second image so that the depth of field of the second image becomes shallow by performing a smoothing process on the second image. The image processing apparatus according to claim 1.   The correction unit performs the smoothing process based on a spatial frequency spectrum of the first image.
  The image processing apparatus according to claim 5.   The correcting means includes a first spatial frequency spectrum in a first region of the first image and a second spatial frequency spectrum in a second region corresponding to the first region of the second image. And when the difference between the first spatial frequency spectrum and the second spatial frequency spectrum is greater than a predetermined threshold, smoothing processing is performed on the second region
  The image processing apparatus according to claim 6.   The correction means compares the third spatial frequency spectrum, which is the spatial frequency spectrum of the second region after the smoothing process, with the first spatial frequency spectrum, and the third spatial frequency spectrum. When the difference between the spatial frequency spectrum and the first spatial frequency spectrum is greater than a predetermined threshold, the second region is further smoothed.
  The image processing apparatus according to claim 7.   The first region and the second region are determined based on edges of the first image and the second image.
  The image processing apparatus according to claim 7, wherein the image processing apparatus is an image processing apparatus.   An image processing apparatus according to any one of claims 1 to 9,
  A first imaging unit that captures the first image;
  A second imaging unit that captures the second image.
  An imaging apparatus characterized by that.   A plurality of second imaging units that include the second imaging unit and that images through the aperture of the second aperture value;
  A plurality of third imaging units for imaging through an aperture having a third aperture value larger than the second aperture value;
  The distance between the plurality of third imaging units is larger than the distance between the plurality of second imaging units.
  The imaging apparatus according to claim 10.   The first image obtained by imaging the subject from the first viewpoint through the aperture with the first aperture value, and the subject from the second viewpoint different from the first viewpoint, the first An acquisition step of acquiring a second image having a different exposure from the first image, obtained by imaging through an aperture having a second aperture value different from the aperture value;
  The pixel value of at least one of the first image and the second image is corrected so that the difference between the blur condition of the first image and the blur condition of the second image is reduced. A correction process;
  Combining the first image with at least one pixel value corrected with the second image to generate a composite image having a wider dynamic range than the first image and the second image Process
  An image processing method.   A program that causes a computer to function as the image processing apparatus according to any one of claims 1 to 9.   The program which functions a computer as an imaging device of Claim 10 or 11.

Images