JP5417920B2 - Image processing apparatus, image processing method, electronic camera, and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, an electronic camera, and an image processing program that perform image processing on a captured image.

  2. Description of the Related Art Conventionally, a technique for performing deformation processing such as fisheye processing on a target image in a captured image is known.

Japanese Patent No. 4063306 JP 2005-25703 A

  However, in the conventional technique, since deformation processing such as fisheye processing is performed with the center of the captured image as a reference, if the target image does not exist at the center of the captured image, the image is unnaturally deformed. There was a problem. Therefore, there is a technique for designating a reference point for deformation processing and performing deformation processing around the reference point. However, in this case, there is a problem that it is necessary to designate a reference point for each captured image, and the operation is troublesome. .

  The present invention has been made to solve such a conventional problem. An image processing apparatus, an image processing method, an electronic camera, and an electronic camera that can reliably process a captured image without designating a reference point for image processing. An object is to provide an image processing program.

An image processing apparatus according to a first aspect of the present invention is an acquisition unit that acquires in-focus position information of a captured image from image data of the captured image, and the in- focus position information includes a plurality of adjacent in-focus areas. And a processing means for performing a deformation process of the photographed image centered on the reference point with a centroid position of a figure formed of the plurality of adjacent in-focus areas as a reference point.

An image processing apparatus according to a second invention is the image processing apparatus according to the first invention, wherein the processing means determines the reference point when the focus position information includes a plurality of spaced focus areas. The focus area to be positioned is selected, and the captured image is deformed .

The image processing apparatus of the third invention is an image processing apparatus of the first aspect of the invention, the processing means, when the focus position information has a plurality of spaced-focus area, all focusing The reference point is provided in a region, and the captured image is deformed .
An image processing apparatus according to a fourth aspect of the present invention is the image processing apparatus according to any one of the first to third aspects, wherein the deformation process of the photographed image is a fish-eye process or a swirl process.

The image processing method according to a fifth aspect of the present invention obtains in-focus position information of the photographed image from image data of the photographed image, and the focus position information has a plurality of adjacent in-focus areas. Using the centroid position of a figure composed of a plurality of adjacent in-focus areas as a reference point, the captured image is deformed around the reference point .

According to a sixth aspect of the present invention, there is provided an electronic camera including the image processing apparatus according to any one of the first to fourth aspects.

According to a seventh aspect of the present invention, there is provided an electronic camera that captures an image of a subject and acquires image data, a focusing control unit that forms an image of the subject on the imaging unit, and focus position information from the focusing control unit. obtaining means for obtaining, when the focus position information has a plurality of adjacent focus area, and the reference point centroid position of the figure composed of the plurality of adjacent focus area, the reference The image processing apparatus includes a processing unit that performs deformation processing of the image data centered on a point, and a recording unit that records image data processed by the processing unit.

The image processing program of the eighth invention is characterized in that to realize to first free the image processing of the image processing apparatus of the fourth one aspect of the present invention on a computer.

  In the present invention, it is possible to reliably perform image processing on a captured image without designating a reference point for image processing.

It is explanatory drawing which shows one Embodiment of the electronic camera of this invention. It is explanatory drawing which shows operation | movement of the electronic camera of FIG. It is explanatory drawing which shows the image displayed on a monitor. It is explanatory drawing which shows image data. It is explanatory drawing which shows the focusing area | region of a finder. It is explanatory drawing which shows the image which fish-eye-processed the image of FIG. It is explanatory drawing which shows the setting method of the reference point in case the some focus area | region is selected adjacently. It is explanatory drawing which shows the setting method of the reference point in case the some focus area | region is selected adjacently. It is explanatory drawing which shows the setting method of the reference point in case the some focus area | region is selected separately.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an embodiment of an electronic camera of the present invention.

  The electronic camera includes an imaging optical system 11, a lens driving unit 13, an AF sensor 15, an AE sensor 17, an image sensor 19, an analog signal processing unit 21, a timing generator (TG) 23, a digital signal processing unit 25, an image processing unit 27, It has a buffer memory 29, a recording I / F 31, a CPU 33, a flash memory 35, a monitor drive unit 37, a monitor 39, an operation unit 41, and a bus 43. The digital signal processing unit 25, the image processing unit 27, the buffer memory 29, the recording I / F 31, the CPU 33, the flash memory 35, and the monitor driving unit 37 are connected via a bus 43. Further, the AF sensor 15, the AE sensor 17, the TG 23, and the operation unit 41 are each connected to the CPU 33.

  The photographing optical system 11 includes a plurality of lens groups including a zoom lens 11a and a focusing lens 11b for adjusting a focus position. Each lens constituting the photographing optical system 11 is driven and adjusted in the optical axis direction by the lens driving unit 13.

  The AF sensor 15 detects the focus detection state of the photographing optical system 11 and outputs it to the CPU 33. The AE sensor 17 measures the luminance of the subject and outputs it to the CPU 33.

  The image sensor 19 photoelectrically converts the light beam that has passed through the photographing optical system 11 to generate an analog image signal of the subject image. The image sensor 19 captures the main image at the time of release. The image sensor 19 exposes the subject at predetermined intervals even when it is not released (during shooting standby), and outputs an analog image signal (through image signal) by thinning readout. The through image data is used for image display on the monitor 39 and the like.

  The analog signal processing unit 21 is an analog front end circuit (AFE) that performs analog signal processing on the output of the image sensor 19. The analog signal processing unit 21 performs correlated double sampling, image signal gain adjustment, and A / D conversion of the image signal. The output of the analog signal processing unit 21 is connected to the digital signal processing unit 25.

  The TG 23 supplies timing pulses to the image sensor 19 and the analog signal processing unit 21 based on instructions from the CPU 33. The drive timing of the image sensor 19 and the analog signal processing unit 21 is controlled by the timing pulse of the TG 23.

  The digital signal processing unit 25 is a digital front end circuit (DFE) that performs signal processing such as defective pixel correction and black level offset correction on the digital image signals sequentially input from the analog signal processing unit 21.

  The image processing unit 27 performs various types of image processing (color interpolation processing, gradation conversion processing, contour enhancement processing, white balance adjustment, etc.) on the digital image signal for one frame. Further, the image processing unit 27 generates a display image (view image) of the monitor 39 from the data of the through image according to an instruction from the CPU 33. Furthermore, the image processing unit 27 also performs processing for compressing the data of the main image in the JPEG format and processing for decompressing and restoring the compressed captured image data.

  The buffer memory 29 temporarily records the data of the main image in the pre-process and post-process of various image processes.

  A connector for connecting the recording medium 45 is formed in the recording I / F 31. The recording I / F 31 executes data writing / reading with respect to the recording medium 45 connected to the connector. The recording medium 45 is composed of a hard disk, a memory card incorporating a semiconductor memory, or the like. In FIG. 1, a memory card is illustrated as an example of the recording medium 45.

  The CPU 33 is a processor that performs overall control of the electronic camera. The CPU 33 controls the operation of each part of the electronic camera according to a predetermined sequence program. Also, various calculations necessary for shooting (defocus amount calculation during AF, AE calculation, etc.) are executed.

  The flash memory 35 stores image data after image processing by the image processing unit 27. The flash memory 35 stores a known program for performing fisheye processing.

  The monitor drive unit 37 controls the display on the monitor 39 by outputting a drive signal based on an instruction from the CPU 33. The monitor 39 is composed of a liquid crystal monitor, for example. On the monitor 39, a view image based on the through image can be displayed. The monitor 39 can display a menu screen on which various setting items can be input in a GUI (Graphical User Interface) format.

  On the menu screen of the monitor 39, the user can select a playback mode. By selecting the reproduction mode, a plurality of image data stored in the flash memory 35 is displayed on the monitor 39 in a reduced state. When the user selects one image data, only that image data is displayed on the monitor 39. In this selected state, the post-processing menu can be selected. In the post-processing menu, items such as “resizing”, “trimming”, “tone correction”, and “special effect processing” are set. In the “special effect processing”, items of filter processing such as “fish eye” and “swirl” are set.

  The operation unit 41 includes a release button 47 and an operation button 49. The release button 47 receives an instruction input such as AF by a half-press operation and an input of a release instruction (exposure start instruction) by a full-press operation. The operation button 49 includes, for example, a command dial, a cross-shaped cursor key, a determination button, and the like. The operation button 49 accepts an electronic camera mode switching operation, an input operation on a menu screen, and the like from the user.

  FIG. 2 is a flowchart for explaining the operation when “fisheye” of “special effect processing” is selected in the post-processing menu of the electronic camera described above.

  Step S1: In this state, an image G as shown in FIG. A square indicated by a two-dot chain line virtually indicates an area corresponding to a focus area of a finder described later, and is not actually displayed on the image G. First, the CPU 33 determines whether or not the image G displayed on the monitor 39 has in-focus position information. This in-focus position information is recorded as tag information TG in the image data GD of the image G.

  FIG. 4 shows the configuration of the image data GD of the image G according to the Exif standard. The image data GD has a header portion, a thumbnail, and a main image area. An area for tag information TG is formed in the header portion. In the area of the tag information TG, areas such as the number of pixels, the type of compression,. Information such as the manufacturer name and the in-focus position is recorded in the manufacturer note area.

  Information on the in-focus position is recorded with symbols such as R1,..., Rn, for example. For example, as shown in FIG. 5, this symbol corresponds to a focus area (focus area) displayed on the finder F of the camera that captured the image G. In FIG. 5, there are five in-focus areas, and the symbols given corresponding to the five in-focus areas are R1, R2, R3, R4, and R5. Therefore, when the information on the focus position is R2, for example, the position of the focus area R2 in FIG. 5 is the focus area when the image G is captured. Note that the selection of the focus area is performed by operating the operation button 49 before the image G is captured, for example.

  Step S2: When there is in-focus position information, the CPU 33 sets a reference point P from the in-focus position information. In this embodiment, as indicated by a two-dot chain line in FIG. 3, the position of the focusing region R2 is the focusing position. The CPU 33 sets the center point of the focusing area R2 as the reference point P. The reference point P is an intersection of diagonal lines of the quadrangular focusing region R2.

  Step S3: The CPU 33 performs the fisheye process selected in the special effect process. FIG. 6 shows an image G ′ after the fish-eye processing of the image G shown in FIG. The fish-eye process is performed using the reference point P shown in FIG. 3 as the process reference coordinates. Then, the image G is deformed based on a known program stored in advance with the reference coordinates as the center.

  Step S4: The CPU 33 displays the image G ′ subjected to the fish-eye process on the monitor 39.

  Step S5: The CPU 33 displays a question on the monitor 39 as to whether or not to record the fisheye processed image G ′. The user can select whether or not to record by operating the operation button 49.

  Step S6: The CPU 33 records the fish-eye processed image G ′ in the flash memory 35 when there is an input from the user for recording in the display of step S5. On the other hand, if there is an input from the user not to record in step S5, the process ends without recording.

  In step S1 described above, if there is no in-focus position information due to, for example, the image G being photographed with manual focus, the processing ends without performing special effect processing.

In the above-described electronic camera, the focus position information is acquired from the image data GD of the photographed image G, the reference point P is obtained from the focus position information, and image processing is performed. Therefore, the reference point P for image processing is designated. Thus, it is possible to reliably perform image processing on the photographed image without doing so. Accordingly, it is possible to easily and reliably perform deformation processing such as fish-eye processing.
(Supplementary items of the embodiment)
As mentioned above, although this invention was demonstrated by embodiment mentioned above, the technical scope of this invention is not limited to embodiment mentioned above, For example, the following forms may be sufficient.

  (1) In the above-described embodiment, the example in which the image data GD stored in the flash memory 35 is read and the special effect processing is performed has been described. For example, a captured image is stored in the flash memory 35 as image data. Before, the reference point P is obtained from the focus position information at the time of shooting, special effect processing is performed, and the image processed image may be stored in the flash memory 35 as image data.

  (2) In the above-described embodiment, the example in which the present invention is applied to the phase difference type focusing method using the AF sensor 15 has been described. However, for example, the present invention is also applied to a contrast type focusing method using the image sensor 19. can do.

  (3) In the above-described embodiment, an example in which only one in-focus area is selected has been described. For example, a plurality of in-focus areas R1 to R10 are arranged adjacent to each other as shown in FIG. When a plurality of adjacent focusing areas R3, R6, and R7 are selected, the centroid position of the figure composed of the plurality of selected focusing areas R3, R6, and R7 is set as the reference point P. May be. Further, for example, as shown in FIG. 8, a line segment a connecting the left side position of the upper side of the focusing area R3 and the right side position of the lower side of the focusing area R7, and the right side position of the upper side of the focusing area R3 and the focusing area R6. The position of the intersection with the line segment b connecting the left side position of the lower side may be the reference point P.

  (4) In the above-described embodiment, an example in which only one in-focus area is selected has been described. However, for example, a plurality of in-focus areas R1 and R4 that are spaced apart as illustrated in FIG. 9 are selected. In such a case, the user may be allowed to select a focusing area in which the reference point P for special effect processing is provided. Further, a reference point P for special effect processing may be provided in each of the plurality of in-focus areas, and the special effect processing may be performed around each reference point P.

  (5) In the above-described embodiment, the example in which the reference point P is provided at the center of the focus area has been described. However, for example, the reference point P may be provided at a position such as a corner of the focus area.

  (6) In the above-described embodiment, an example in which the present invention is applied to an electronic camera has been described. However, for example, the present invention can be widely applied to an image processing apparatus using a personal computer (PC) or the like, an image processing program for a personal computer, and the like. it can.

  (7) In the above-described embodiment, an example in which fisheye processing is performed as the special effect processing has been described. However, the present invention can be widely applied to correction processing such as filter processing such as vortex and tilt correction.

  (8) In the above-described embodiment, an example in which the present invention is applied to a still image that has already been photographed has been described. However, the present invention can also be applied to a through image, a moving image, and the like.

  (9) In the above-described embodiment, the example in which the fisheye process is performed around the reference point P and the reference point P is not moved is described. For example, trimming is performed by moving the center of the reference point P to the center of the image. Also good.

DESCRIPTION OF SYMBOLS 11 ... Shooting optical system, 13 ... Lens drive part, 15 ... AF sensor, 19 ... Image sensor, 33 ... CPU, G, G '... Image, GD ... Image data, TD ... Tag information, P ... Reference point.

Claims (8)

Acquisition means for acquiring in-focus position information of the captured image from image data of the captured image;
When the in-focus position information includes a plurality of adjacent in-focus areas, the centroid position of the figure composed of the plurality of adjacent in-focus areas is used as a reference point, and the reference point is the center. Processing means for performing deformation processing of the captured image;
An image processing apparatus comprising: The image processing apparatus according to claim 1.
The processing means, when the focus position information has a plurality of spaced focus areas, selects a focus area where the reference point is to be located, and performs deformation processing of the captured image. A featured image processing apparatus. The image processing apparatus according to claim 1 .
The processing means is characterized in that when the in-focus position information has a plurality of in-focus areas, the reference points are provided in all in-focus areas and the captured image is deformed. An image processing apparatus. The image processing apparatus according to any one of claims 1 to 3 ,
The image processing apparatus according to claim 1, wherein the deformation process of the captured image is a fish-eye process or a spiral process . When the in-focus position information of the captured image is acquired from the image data of the captured image, and the in-focus position information has a plurality of adjacent in-focus areas, the figure including the plurality of adjacent in-focus areas An image processing method comprising: performing deformation processing of the captured image centered on the reference point with the position of the centroid as a reference point. An electronic camera comprising the image processing apparatus according to any one of claims 1 to 4. Imaging means for capturing an image of a subject and acquiring image data;
  Focusing control means for forming an image of the subject on the imaging means;
  Acquisition means for acquiring focus position information from the focus control means;
  When the in-focus position information includes a plurality of adjacent in-focus areas, the centroid position of the figure composed of the plurality of adjacent in-focus areas is used as a reference point, and the reference point is the center. Processing means for performing image data transformation processing;
  Recording means for recording image data processed by the processing means;
  An electronic camera comprising: An image processing program for realizing image processing of the image processing apparatus according to claim 1 by a computer.

Images