JP5083116B2 - Imaging apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to a photographing apparatus, an image processing method, and a program.

Conventionally, imaging devices such as digital cameras and video cameras are known.
In such an image pickup apparatus, the number of pixels has been increasing in recent years, and a phenomenon that women dislike taking pictures with the image pickup apparatus has occurred. This is because the resolution of the imaging device becomes too high and details are recorded with high definition, so that when the face is photographed with a close-up, even slight facial roughness and rough skin are recorded.

Therefore, the above imaging device detects the subject's face when shooting a person, and if it detects that the detected face is a woman's face, exposure correction, soft focus correction, skin softening correction, correction that makes a person look slim, etc. An imaging apparatus that performs the above-described processing has been proposed (see Patent Document 1).
JP 2007-280291 A

  However, since the above processing is corrected with a uniform intensity when it is determined that the face is a woman's face, the correction process cannot be performed with the intensity desired by the photographer or the subject. In order to perform correction processing with the intensity desired by the subject, it was necessary to manually set the correction intensity for each correction process and shoot.

  An object of the present invention is to enable a photographer to easily set correction strengths for a plurality of types of correction processing.

  The imaging apparatus according to the first aspect of the present invention divides the correction intensity into a plurality of stages for each of a plurality of types of correction processing contents for correcting a specific image region, and sets the correction intensity at each stage as a correction level. Correction level storage means for storing in association, setting means for setting a correction level, image acquisition means for acquiring an image by photographing processing, and the specific image area detected from the image acquired by the image acquisition means A determination means for determining whether or not the specific image area has been detected by the determination means, a set of correction intensities of a plurality of correction contents corresponding to the correction levels set by the setting means is stored in the memory. And correction means for correcting the acquired image with the correction content of the read correction intensity.

  The imaging apparatus according to the second aspect of the present invention corrects the plurality of types of correction contents stored in the correction level storage unit when the correction level set by the setting unit is a predetermined level or less. The correction content which is not performed is included.

  The image pickup apparatus according to a third aspect of the invention is characterized in that the correction level storage means stores the correction intensity change rate different for each of the plurality of types of correction contents according to the correction level. And

  In the imaging apparatus according to the fourth aspect of the invention, the correction level storage unit associates a first correction intensity with a correction level that is different from the first correction intensity set in association with one correction level. And a display unit for displaying the image acquired by the image acquisition unit, and an instruction unit for instructing recording of the image acquired by the image acquisition unit, The correction means reads the first set corresponding to the set correction level until it is instructed by the instruction means, corrects the acquired image, and after being instructed by the instruction means, The second set corresponding to the set correction level is read to correct the acquired image.

  The imaging apparatus according to the fifth aspect of the present invention includes a shooting mode storage unit that stores a plurality of types of shooting modes and the correction level in association with each other, and a plurality of types of shooting modes stored by the shooting mode storage unit. Selecting means for selecting one from the above, wherein the setting means sets a correction level corresponding to the photographing mode selected by the selecting means.

  In the image pickup apparatus according to the sixth aspect of the invention, the photographing mode storage means performs explanation information explaining the content of the sample image or the photographing mode corresponding to the photographing mode, and whether or not the correction by the correcting means is performed. Is further stored in association with the information indicating whether the correction is performed by the correction unit in the shooting mode corresponding to the displayed sample image or description information together with the sample image or description information stored in the storage unit. Information display means for displaying whether or not to execute the processing, and the selection means selects the sample image displayed by the information display means or the description information, thereby selecting the sample image or the description information. The shooting mode corresponding to is selected.

  In the imaging device according to the seventh aspect, the information display unit displays a sample image or explanation information stored in the storage unit, and a shooting mode corresponding to the displayed sample image or explanation information. A value indicating the correction strength stored in the correction level storage means is displayed corresponding to the above.

  The imaging apparatus according to an eighth aspect of the invention is characterized in that the determination unit determines whether or not a human face image is detected as the specific image region.

  The image processing method according to the invention of claim 9 divides the correction intensity into a plurality of stages for each of a plurality of types of correction processing contents for correcting a specific image region, and sets the correction intensity at each stage as a set to a correction level. An image processing method for an apparatus including a memory that stores the information in association with each other, a setting step for setting a correction level, an image acquisition step for acquiring an image, and the specific image from the image acquired in the image acquisition step A determination step for determining whether or not an image region has been detected, and if it is determined that the specific image region has been detected in this determination step, a plurality of correction contents corresponding to the correction level set in the setting step A correction step of reading a set of correction intensities from the memory and correcting the acquired image.

  The program according to the invention of claim 10 divides the correction intensity into a plurality of stages for each of a plurality of types of correction processing contents for correcting a specific image region, and corresponds to the correction level with the correction intensity at each stage as a set. A computer provided in an image processing apparatus having a memory to be stored, a setting means for setting a correction level, an image acquisition means for acquiring an image, whether the specific image area is detected from the image acquired by the image acquisition means If it is determined that the specific image area has been detected by the determination means, a plurality of correction intensity sets corresponding to the correction levels set by the setting means are read from the memory. , Functioning as correction means for correcting the acquired image.

  According to the present invention, since the parameter value indicating the image processing intensity is set as described above, and the intensity of the plurality of image processing is controlled according to the set parameter value, the image processing intensity corresponding to the parameter value is set. It can be set for a plurality of image processes.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a block diagram showing an electrical configuration of a digital camera as an imaging apparatus according to an embodiment of the present invention.
This digital camera has a recording mode for shooting as a basic operation mode and a playback mode for playing back the captured image, and a beauty mode is provided as a lower mode of the recording mode. .

  The digital camera of this embodiment includes a photographing lens 1, a shutter 2, a CMOS sensor 3, an A / D converter 4, a DRAM 5, a liquid crystal display controller 6, a liquid crystal display 7, a shutter control unit 8, a CPU 9, and a light reception control unit 10. A demosaic unit 11, an external storage memory 12, a key input block 13, a program memory 14, and an SRAM 15.

  When shooting, the CMOS sensor 3 receives shooting light converged by the shooting lens 1 via the shutter 2, and photoelectrically converts the optical image of the subject formed on the light receiving surface and outputs it as an image signal. . Next, the A / D converter 4 converts the output signal of the CMOS sensor 3 into digital image data. Then, the image data converted by the A / D converter 4 is sequentially stored in the DRAM 5. The DRAM 5 stores a plurality of pieces of image data at the time of shooting in the continuous shooting mode.

The operation of the shutter 2 is controlled by the shutter control unit 8 according to a command from the CPU 9, and the operations of the CMOS sensor 3 and the A / D converter 4 are controlled by the light reception control unit 10 according to a command from the CPU 9.
The image data for one sheet stored in the DRAM 5, that is, the RAW data is converted into YUV data by interpolating color information for each pixel by the demosaic unit 11, and then transmitted to the liquid crystal display 7 via the liquid crystal display controller 6. Displayed as a through image.

When shooting in the recording mode, the image data converted into YUV data by the demosaic unit 11 is compressed by the CPU 9 according to a predetermined compression method such as JPEG, and then recorded as a still image file in the external storage memory 12.
The image data stored as a still image file in the external storage memory 12 is read and expanded by the CPU 9 as necessary in the playback mode, and then displayed on the liquid crystal display 7 via the liquid crystal display controller 6. Is done.
The external storage memory 12 is configured by, for example, a memory card that is detachable from the digital camera body, a flash memory built in the digital camera body, or the like.

The CPU 9 includes a face processing unit 91 and is connected to a key input block 13, a program memory 14, and an SRAM 15.
The key input block 13 includes a plurality of switches including a power key, a shutter key, a mode switching key, a selection key, and the like that are used for the operation of the digital camera by the user.

  The program memory 14 is a memory in which various programs necessary for the operation of the CPU 9 and the face processing unit 91 included in the CPU 9 and various data used in executing the programs are stored.

  The CPU 9 controls the operation of each part of the digital camera in accordance with the operation of any key in the key input block 13 according to the program stored in the program memory 14, and performs the above-described image data compression / decompression processing.

When photographing in the beautiful face mode, the face processing unit 91 uses the SRAM 15 as a work memory in accordance with an instruction from the CPU 9 and executes face detection processing for detecting a face image area included in the image captured by the CMOS sensor 3. It is a detection means of the present invention. Since this face detection process is a known technique, a detailed description thereof is omitted here.
Further, the face processing unit 91 is a correction unit according to the present invention that performs a beautiful face process on the detected face according to an instruction from the CPU 9.

Here, the facial beauty process is a redness reduction process for correcting a human face image to reduce the redness in the eyes of the person, a beautiful skin process for correcting the skin color, and a blood color. Multiple treatments including improvement processing, tooth whitening processing that corrects whitening of yellowed teeth, eye opening processing that corrects eye widening, and cheek lift-up processing that corrects chubby cheeks and gut cheeks Consists of various correction contents.
In addition to the above correction processing, the facial beauty processing includes flash red-eye removal processing that removes the red-eye state during flash emission.
The redness reduction processing, flash red-eye removal processing, skin beautification processing, blood color improvement processing, tooth whitening processing, eye opening processing, and cheek lift-up processing are well-known techniques in the technical field of image processing. Description is omitted.

FIG. 2 is a flowchart showing the operation of the digital camera in this embodiment.
When the beautiful face mode is set by the CPU 9 according to the operation of the mode switching key of the key input block 13, first, the CMOS sensor 3 starts shooting at a predetermined frame rate, and the CPU 9 Is acquired (step S1).
Next, the CPU 9 reads the setting value of the current face level from the program memory 14 (step S2). Note that the setting value of the face level to be read first may be a default value or may be a setting value obtained when the previous face image mode was taken.

  Next, it is determined whether or not a human face image is detected from the image acquired by the face processing unit 91 (step S3). If YES is determined, the process proceeds to step S4. If NO is determined, the process proceeds to step S7. Move on.

  If YES is determined in step S3, the face processing unit 91 refers to the display image table 20 in FIG. 3 and performs each correction process in the face processing based on the setting value of the face level read in step S2. Is calculated (step S4).

  FIG. 3 is a diagram showing the display image table 20. This display image table 20 is a table showing the relationship between the setting value of the beautiful face level and the set of correction intensity of each correction process, and is stored in the program memory 14.

Next, the face processing unit 91 performs the above-described redness reduction processing, flash red-eye removal processing, skin beautification processing, blood color improvement processing, tooth whitening processing, eye opening processing, and cheek lift-up processing with the correction strength obtained in step S4. Then, a new image is generated (step S5).
Next, the CPU 9 displays the generated image on the liquid crystal display 7 as a through image (step S6).

  FIG. 4 is a diagram showing a through image displayed on the liquid crystal display 7. A broken line 30 on the image is a frame indicating the detected face image of the person. Then, the setting value of the face level read in step S2 is displayed on the lower part 40 of the liquid crystal display 7.

  Thereafter, the CPU 9 monitors the operation of the shutter key and determines whether or not the shutter key provided in the key input block 13 has been operated (step S7). If this determination is YES, the process proceeds to step S10, and if NO, the process proceeds to step S8.

If the determination in step S7 is YES, a recording image is taken by the CMOS sensor 3 according to an instruction from the CPU 9, and the taken image data is acquired (step S10).
Then, the face processing unit 91 detects a face image from the image acquired in step S10. If it is detected, the process proceeds to step S12. If not detected, the process proceeds to step S15 (step S11).

  The CPU 9 reads the current setting value of the beautiful face level from the program memory 14 (step S12), and the face processing unit 91 refers to the recorded image table 50 in FIG. 5 and reads the current beautiful face level in step S12. Based on the set value, the correction intensity for the facial beauty processing is obtained (step S13).

  FIG. 5 is a diagram showing the recorded image table 50. The recorded image table 50 is a table showing the relationship between the setting value of the beauty face level and the correction intensity group in each correction process in numerical form, and is stored in the program memory 14.

Next, the face processing unit 91 executes a redness reduction process, a skin beautification process, a blood color improvement process, a tooth whitening process, an eye opening process, and a cheek lift-up process with the correction strength obtained in step S13, and generates a new image. (Step S14).
Next, the CPU 9 sequentially compresses and encodes the image data of the generated image, stores the compressed / encoded image data in the DRAM 5, and records it in the external storage memory 12 (step S15).

Here, the display image table 20 and the recorded image table 50 are compared.
In the display image table 20, the correction intensity is zero for the tooth whitening process, the eye opening process, the cheek lift-up process, and the flash red-eye removal process regardless of the face level.

  On the other hand, in the recorded image table 50, with regard to the tooth whitening process, the eye opening process, and the cheek lift-up process, the correction strength is zero and the correction process is not substantially performed until the face level reaches a certain level. In the flash red-eye removal process, when the face level setting value is 1 or more, that is, when the face process is executed, the correction strength is constant at 100%.

Further, the correction strengths of the other skin beautifying processes, the redness reduction process, and the blood color improvement process are generally lower in the display image table 20.
Since the display image is displayed on the liquid crystal display 7, the processing speed is given priority, and the resolution of the display image is not so high. This is to set a lower value.

  If no photographing instruction is detected in step S7, the CPU 9 determines whether or not the face level has been changed by operating a key provided in the key input block 13 (step S8). If this determination is NO, the process returns to step S1, and if YES, the CPU 9 stores the changed face level in the program memory 14 as the current face level setting value (step S9), and the process returns to step S1. Return.

According to this embodiment, there are the following effects.
(1) Since the face level can be set by the user's key operation, and the correction strengths of a plurality of types of correction processing are set according to the set level, a plurality of types of corrections are performed corresponding to the set face level. The correction intensity of processing can be set.

  (2) The correction strength of the display image table 20 is different from the correction strength of the recording image table 50. As described above, since the correction strength is set before and after the shooting instruction and according to the resolution of the image, unnecessary calculation load can be reduced.

[Second Embodiment]
A digital camera according to the second embodiment will be described. In this embodiment, like the digital camera of the first embodiment, a beautiful face mode is provided as a lower mode of the recording mode. The configuration is the same as that shown in FIG. 1, but a best shot mode is further provided as a lower mode of the recording mode. Since the best shot mode is a well-known technique, a detailed description is omitted here, but depending on the subject to be photographed and the scene similar to the photographing scene including the photographing environment at that time or the preference. This mode allows the user to select a scene of a desired atmosphere via a sample image that is a sample of the shooting result, and automatically sets shooting conditions such as shutter speed and aperture value according to the selected scene. . In the present embodiment, the setting value of the beautiful face level is stored in the program memory 14 corresponding to each scene, and is read out by the CPU 9.

FIG. 6 is a flowchart showing the operation of the digital camera in this embodiment.
When the best shot mode is set by the CPU 9 according to the operation of the mode switching key of the key input block 13, the CPU 9 refers to each best shot scene and the setting value of the beauty level in each best shot scene with reference to FIG. Read-out and display on the liquid crystal display 7 (step S16).

  Here, FIG. 7 is a diagram showing the best shot table 60. The best shot table 60 is a table showing the relationship between each scene and the face level, and is stored in the program memory 14. For example, in the case of “photographing a landscape and a person”, it is highly likely that the subject is in the daylight, so facial processing (especially, correction using a skin filter and a blood color improvement filter) is required, while the resolution of the background landscape is also somewhat In order to give priority, the face level is set to 4. Also, in “self-portrait (1 person)”, since a digital camera is taken with one's hand, it is assumed that the face is very up and the face image occupies most of the photographed image. The correction intensity of processing is strong. Furthermore, in all the other best shot scenes, a face level that provides an appropriate correction strength when shooting in that scene is assumed is associated and stored. The best shot table 60 records shooting conditions in addition to the beautiful face level, but is omitted for the sake of simplicity.

  Next, according to the operation of the selection key of the key input block 13, the CPU 9 determines whether or not one scene is selected from the sample images of each scene displayed on the liquid crystal display 7 (step S17). If YES, the process moves to step S18. If NO, the process returns to step S16.

  If it is determined YES in step S17, the CPU 9 reads the beautiful face level stored in the program memory 14 corresponding to the selected scene, and stores it in the program memory 14 as the current beautiful face level setting value. 2 to step S2 (step S18). Since the subsequent processing is the same as that of the first embodiment, description thereof is omitted.

According to this embodiment, there are the following effects.
When a face level is stored in association with each best shot scene and a scene is selected, the face level stored in association with that scene is set, so the user only has to select the desired scene. It is possible to set a face level that is optimal for shooting the scene.

It should be noted that the present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within the scope that can achieve the object of the present invention are included in the present invention.
For example, in this embodiment, the display image table 20 and the recording image table 50 are provided. However, the present invention is not limited to this, and only the recording image table is provided, and the values of the display image table are recorded. Alternatively, a predetermined value may be subtracted from the value in the image table.
In the second embodiment, when the best shot mode is set, the setting value of the face level in each scene is displayed on the liquid crystal display 7 together with the sample image or description information of each scene. Instead, a display indicating whether or not to perform the facial beauty processing may be performed. For example, when an icon indicating that the face processing is executed is prepared and the face processing is executed in the scene corresponding to the displayed sample image or description information, the icon indicating the execution of the face processing is displayed. Also good.
Further, in the present embodiment, only the image that has been subjected to the facial processing is recorded, but the image before the facial processing is performed and the image after the facial processing are recorded in association with each other in the playback mode. An image having a different face level from the image that has undergone the face processing may be generated from the image before the face processing is executed.
Alternatively, the face level set by the user may be stored, and the stored face level may be used as a setting value for the face level at the time of shooting in the next face mode.
The present invention is not limited to a digital camera, and can be applied to other imaging devices having a still image shooting function such as a mobile phone terminal with a camera.
In addition, the image processing method or program according to the present invention can be applied not only to an imaging apparatus but also to an arbitrary image processing apparatus. The image processing apparatus includes a personal computer that realizes the function by operating based on a predetermined program.

1 is a block diagram illustrating an electrical configuration of a digital camera as an imaging apparatus according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the digital camera which concerns on 1st Embodiment. It is a figure which shows the table for display images of the digital camera which concerns on 1st Embodiment. It is a figure which shows the through image display example of the digital camera which concerns on 1st Embodiment. It is a figure which shows the table for recorded images of the digital camera which concerns on 1st Embodiment. It is a flowchart which shows operation | movement of the digital camera which concerns on 2nd Embodiment. It is a figure which shows the best shot table which concerns on 2nd Embodiment.

Explanation of symbols

1 Lens 2 Shutter 3 CMOS sensor 4 A / D converter 5 DRAM
6 Liquid Crystal Display Controller 7 Liquid Crystal Display 8 Shutter Control Unit 9 CPU
DESCRIPTION OF SYMBOLS 10 Light reception control part 11 Demosaic part 12 External storage memory 13 Key input block 14 Program memory 15 SRAM
91 Face processing part

Claims (10)

Correction level storage means for dividing the correction intensity into a plurality of stages for each of a plurality of types of correction processing contents for correcting a specific image region, and storing the correction intensity of each stage in association with a correction level;
Setting means for setting the correction level;
Image acquisition means for acquiring an image by photographing processing;
Determination means for determining whether or not the specific image area is detected from the image acquired by the image acquisition means;
When it is determined that the specific image area has been detected by the determination unit, a set of correction strengths of a plurality of correction contents corresponding to the correction level set by the setting unit is read from the storage unit, and the read correction strength And a correction unit that corrects the acquired image with the correction content.   The plurality of types of correction contents stored in the correction level storage means include correction contents that are not corrected when the correction level set by the setting means is equal to or lower than a predetermined level. Item 1. The photographing apparatus according to Item 1.   The photographing apparatus according to claim 1, wherein the correction level storage unit stores the change rate of the correction intensity different for each of the plurality of types of correction contents according to the correction level. The correction level storage means stores a first set of correction strengths and a second set of correction strengths different from the first set in association with one correction level;
Display means for displaying the image acquired by the image acquisition means;
Instruction means for instructing recording of the image acquired by the image acquisition means;
Further comprising
The correction unit reads out the first set corresponding to the set correction level until instructed by the instruction unit, corrects the acquired image, and after being instructed by the instruction unit, The photographing apparatus according to claim 1, wherein the second set corresponding to the set correction level is read to correct the acquired image. Shooting mode storage means for storing a plurality of types of shooting modes and the correction level in association with each other;
Selection means for selecting one of a plurality of types of shooting modes stored by the shooting mode storage means;
Further comprising
The imaging apparatus according to claim 1, wherein the setting unit sets a correction level corresponding to the imaging mode selected by the selection unit. The shooting mode storage means further stores in association with explanation information explaining the content of the sample image or shooting mode corresponding to the shooting mode, and information indicating whether or not correction by the correction means is performed,
Along with the sample image or the explanation information stored in the storage means, an information display for displaying whether or not the correction by the correction means is executed in the photographing mode corresponding to the displayed sample image or the explanation information. Further comprising means,
The said selection means selects the imaging | photography mode corresponding to the sample image or description information by selecting the sample image currently displayed by the said information display means, or description information, The said Claim 5 characterized by the above-mentioned. Shooting device.   The information display means is stored in the correction level storage means corresponding to the photographing mode corresponding to the displayed sample image or explanation information, together with the display of the sample image or explanation information stored in the storage means. The photographing apparatus according to claim 6, wherein a value indicating the correction intensity is displayed.   The photographing apparatus according to claim 1, wherein the determination unit determines whether a human face image is detected as the specific image region. An image processing method for an apparatus including a memory that stores correction intensities for each of a plurality of types of correction processing contents for correcting a specific image region in a plurality of stages and stores the correction intensities at each stage in association with correction levels. Because
A setting process for setting a correction level;
An image acquisition process for acquiring images;
A determination step of determining whether or not the specific image region is detected from the image acquired in the image acquisition step;
If it is determined that the specific image area has been detected in this determination step, a set of correction strengths of a plurality of correction contents corresponding to the correction level set in the setting step is read from the memory, and the acquired image An image processing method comprising: a correction step of correcting An image processing apparatus having a memory that stores correction intensities for each of a plurality of types of correction processing contents for correcting a specific image region in a plurality of stages and stores the correction intensities at the respective levels in association with correction levels. Computer
Setting means for setting the correction level;
Image acquisition means for acquiring images;
Determining means for determining whether or not the specific image region has been detected from the image acquired by the image acquiring means;
When it is determined that the specific image area has been detected by the determining means, a set of correction strengths of a plurality of correction contents corresponding to the correction level set by the setting means is read from the memory, and the acquired image is corrected. Correction means,
Program to function as.

Images