JP5316070B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus including an imaging unit that captures a subject image.

  (Provisional text) In recent years, there is an imaging apparatus that includes a scene mode setting that predicts a user's request according to a subject and generates an image based on a setting according to an imaging scene (see Patent Document 1).

JP 2002-010135 A

  However, in the conventional scene mode, imaging conditions and image processing conditions corresponding to the scene mode are preset in the imaging apparatus, and the subject in this setting may not correspond to the actual subject. For example, when the scene mode is set to “Landscape”, there is a problem that the optimum image according to the scene mode cannot be obtained because the subject is “forest” and “building street” because the atmosphere and scene are different. .

  The present invention has been made to solve the above-mentioned problems in consideration of such circumstances, and an object of the present invention is to provide an imaging apparatus that generates an optimal image according to a scene mode.

To solve the above problems, an imaging apparatus according to the present invention, when generating the number of sheets of images double based on the scene mode selected arbitrarily, said bracket shooting setting as the imaging condition of the scene mode is set If there is, the imaging unit is instructed to perform imaging a plurality of times in accordance with the imaging conditions corresponding to the scene mode to generate the plurality of images, and the bracket imaging setting is not set as the scene mode imaging conditions A single image is generated by instructing the imaging unit to perform one imaging according to the imaging condition according to the scene mode, and the single image is generated based on the image processing condition according to the scene mode. wherein an imaging generating unit for generating a plurality of images, based on the feature amount included in each of the plurality of images which the capturing generating unit has generated, depending on the scene mode from Satisfying the condition image are determined order, and an image selecting section for selecting the best shot image.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which produces | generates the optimal image according to scene mode can be provided.

It is a block diagram which shows an example of a structure of the imaging device concerning one embodiment of this invention. 3 is a flowchart illustrating an example of a processing flow of the imaging apparatus illustrated in FIG. 1.

Hereinafter, an embodiment of an imaging apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram illustrating a configuration of an imaging apparatus 1 according to an embodiment of the present invention.
As shown in FIG. 1, the imaging apparatus 1 according to the present embodiment includes an imaging unit 10, a CPU 15, an operation unit 16, a display unit 17, a buffer memory unit 18, a memory unit 19, and an I / F ( Interface) unit 20 and bus 21.

The imaging unit 10 includes an optical system 11, an imaging device 12, a TG (timing generator) 13, and an A / D conversion unit 14. The imaging unit 10 is controlled by the CPU 15 based on the set imaging conditions and is based on light incident from the optical system 11. Then, image information which is a digital signal is generated.
In other words, the optical system 11 includes a lens 111 and a lens drive motor 112, and drives the lens drive motor 112 based on imaging conditions such as a set aperture value and focus value to control the position of the lens 111. The optical system 11 controls the amount of light incident from the lens 111 and the focal position, and forms an image on the light receiving surface of the image sensor 12. The imaging device 12 controls the exposure time of the imaging device 12 based on imaging conditions such as a set exposure value, and photoelectrically converts an image formed on the light receiving surface.
The TG 13 supplies a timing pulse to the image sensor 12 based on an instruction from the CPU 15 and controls the imaging sensitivity such as ISO sensitivity. The A / D converter 14 converts the image information of the analog signal output from the image sensor 13 into a digital signal.
As described above, when the imaging unit 10 receives an imaging instruction from the user via the shutter button (operation unit 16) or the like, the image information (hereinafter referred to as a captured image) is obtained from light incident on the lens 111 based on the set imaging conditions. Information) and is stored in the memory unit 19. In addition, the imaging unit 10 outputs image information acquired by the imaging element 12 (hereinafter referred to as through image information) to the memory unit 19 or the CPU 15 even when there is no imaging instruction from the user.

The CPU 15 includes an imaging control unit 151, an image processing unit 152, a scene determination unit 153, and a best shot image selection unit (image selection unit) 154, and comprehensively controls the imaging device 1.
The imaging control unit 151 controls the imaging unit 10 based on imaging conditions (for example, aperture value, exposure value, focus value, shutter speed, imaging sensitivity, information on the flash emission state, etc.). The image processing unit 152 is output from the imaging unit 10 based on image processing conditions (soft effect, contour enhancement, contrast adjustment, white balance adjustment, saturation adjustment, noise reduction function, picture control system, D lighting function, etc.). The image processing is performed on the image information, the through image information stored in the buffer memory unit 17, or the image information recorded in the memory unit 19.
Here, the picture control system is, for example, based on four basic settings of “standard”, “neutral”, “vivid”, and “monochrome”, and the components of the captured image information (contour emphasis) , Contrast, brightness, color density, color tone) and the like. For example, “standard” is a setting in which the captured image signal includes a person and a landscape, and appropriate correction is applied to the entire image. The D-lighting function is a function that corrects the brightness of a subject that has become dark due to backlight or insufficient light intensity. By changing the correction value in steps, the brightness of the image to be corrected is increased in steps. Can be changed.

The imaging control unit 151 and the image processing unit 152 together with the imaging unit 10 constitute an imaging generation unit 300, and generate a plurality of pieces of image information by imaging a subject based on an arbitrarily selected scene mode. To do.
That is, when the scene mode is selected, the imaging control unit 151 instructs the imaging unit 10 to perform imaging multiple times by a single imaging instruction from the user (pressing the shutter button once). To do. Thereby, the imaging unit 10 generates a plurality of pieces of image information and stores them in the memory unit 19. The setting for generating a plurality of pieces of image information by the imaging unit 10 imaging a plurality of times in this way is hereinafter referred to as a bracket imaging setting.
On the other hand, when the scene mode is selected, the image processing unit 152 generates a plurality of pieces of image information from one piece of image information. The setting in which the image processing unit 152 generates a plurality of pieces of image information in this manner is hereinafter referred to as a bracket image processing setting.

Furthermore, when the imaging control unit 151 instructs the imaging unit 10 to perform multiple imaging depending on the selected scene mode, the imaging control unit 151 performs different imaging depending on the selected scene mode and for each multiple imaging. Conditions can be set.
The image processing unit 152 is applied with a program for image processing based on facial expression recognition, calculation of a histogram evaluation value, and calculation of an evaluation value of a camera shake amount with respect to image information.
For example, the image processing unit 152 has a facial expression recognition function, performs image processing for face recognition on image information, and extracts an image region corresponding to “face” from the image information. The image processing unit 152 further extracts areas corresponding to “eyes” and “mouth” from the extracted image area corresponding to “face”, determines whether there is a claw, and the mouth angle is Recognize the most uplifted as a smile.

The scene mode is a setting including imaging conditions and image processing conditions according to the imaging scene. For example, “portrait mode”, “landscape mode”, “night scene mode”, “backlight mode”, “closed” Up mode ".
In these scene modes, imaging conditions or image processing conditions set to optimum parameters are set. In the scene mode, at least one of bracket imaging setting and bracket image processing setting is set according to each mode. That is, when the scene mode is selected, the imaging generation unit 300 generates a plurality of pieces of image information according to at least one of the bracket imaging setting and the bracket image processing setting. The selection of the scene mode refers to a case where an arbitrary scene mode is set by the user via the operation unit 16 or a scene mode is determined by the scene determination unit 153.

In each scene mode, the following items are set in addition to the imaging conditions or image processing conditions set to the optimum parameters.
For example, in the “portrait mode”, the bracket imaging setting for performing imaging a plurality of times at different timings is set as the imaging condition.
In the “landscape mode”, as a shooting condition, a bracket shooting setting for shooting with a stepwise different exposure value for each of a plurality of times of shooting is set.
In the “night view mode”, bracketing imaging settings for imaging with different imaging sensitivities (ISO sensitivities) for each of a plurality of times of imaging are set as imaging conditions.
In the “backlight mode”, as image processing conditions, bracket image processing settings for generating a plurality of pieces of image information with different D lighting function corrections are set.
In the “close-up mode”, bracketing imaging settings for imaging with different focus values in stages for each of a plurality of times of imaging are set as imaging conditions.
As described above, the imaging generation unit 300 can perform imaging under different imaging conditions in multiple times of imaging.

  The scene determination unit 153 determines the scene mode of the imaging scene based on the image information acquired by the imaging unit 10. For example, the scene determination unit 153 can determine the scene mode when the image processing unit 152 performs image processing on the through image information acquired by the imaging unit 10. In this case, for example, when the “face” of a person is recognized by image processing, the scene determination unit 153 can determine that the mode is “portrait mode”.

The best shot image selection unit 154 selects at least one piece of image information from a plurality of pieces of image information generated by the imaging generation unit 300 based on the selected scene mode, based on a determination criterion corresponding to the scene mode. Here, the determination criterion is a criterion for selecting optimal image information (best shot image) for each scene mode.
For example, in the “portrait mode”, the image processing unit 152 detects a smile degree determination value, presence / absence of blinking, and the like from image information subjected to image processing for recognizing a human subject's facial expression. Based on the detection result of the image processing unit 152, the best shot image selection unit 154 follows the determination criteria for determining image information with a high smile degree or image information in which no blinking is detected as the best shot image. Select.
In the “landscape mode”, the image processing unit 152 converts the image information into frequency components, and generates a histogram evaluation value indicating the luminance distribution. Based on this histogram evaluation value, the best shot image selection unit 154 has image information in which the histogram evaluation value is scattered throughout the image information, that is, an image in which light and dark tone balance is achieved from a bright place to a dark place. The best shot image is selected according to the criteria for determining as the best shot image.
In the “night scene mode”, the image processing unit 152 calculates an evaluation value of the amount of camera shake from the image information, and the best shot image selection unit 154 determines an image with a small amount of camera shake based on the evaluation value of the amount of camera shake. Of these, the best shot image is selected according to the criteria for determining an image with a lower imaging sensitivity setting as the best shot image.
In the “backlight mode”, based on the histogram evaluation value generated by the image processing unit 152, the best shot image selection unit 154 corresponds to an image area corresponding to a human face detected from the image information by the face recognition function of the image processing unit 152. When the image has a certain brightness or higher, the best shot image is selected in accordance with a criterion for determining this image information as the best shot.
In the “close-up mode”, the image processing unit 152 detects an image area corresponding to the subject portion from the image information subjected to image processing for recognizing the subject, and the best shot image selection unit 154 detects the image of the subject portion. The best shot image is selected according to a criterion for determining an image corresponding to the region and the in-focus position as the best shot image.

In addition, the image processing unit 152 performs image correction on a plurality of pieces of image information generated by the imaging generation unit 300 based on image processing conditions according to the selected scene mode.
For example, when “landscape mode” is selected as the scene mode, the image processing unit 152 performs correction using the D writing function on the image information selected by the best shot image selection unit 154.
When the “night scene mode” is set as the scene mode, the image processing unit 152 performs each of the image information selected by the best shot image selecting unit 154 according to the number of selected image information. Perform different white balance correction.
In the present embodiment, as described above, the example in which the image processing unit 152 corrects the image information selected by the best shot image selection unit 154 has been described. However, the present invention is not limited to this. Alternatively, correction may be performed before the selection of the best shot image selection unit 154 is made.

  The operation unit 16 is an operation button such as a shutter button, and is an input unit to which an imaging instruction or setting information from the user is input when operated by the user. When the user's imaging instruction is input, the CPU 15 instructs the imaging unit 10 to perform imaging and generates image information. Further, when the user setting information is input, the CPU 15 changes each parameter of the imaging condition, the image processing condition, or the scene mode stored in the memory unit 19.

The display unit 17 is a liquid crystal display device, for example, and displays a captured image captured by the imaging unit 10 and a through image at the time of imaging. In addition, a setting screen when the user sets the imaging condition, the image processing condition, or the scene mode is displayed.
The buffer memory unit 18 is a memory that temporarily stores image information acquired by the imaging unit 10, and temporarily stores through image information, for example.

The memory unit 19 is set with captured image information captured by the imaging unit 10, setting values related to the operation of the imaging apparatus 1, imaging conditions of the imaging unit 10, image processing conditions referenced by the image processing unit 152, and the like. The scene mode etc. which have been stored are memorized.
The I / F unit 20 is connected to an external storage medium 2 such as a card memory, and performs writing, reading, or erasing of information on the storage medium 2.
The bus 21 is connected to the imaging unit 10, the CPU 15, the operation unit 16, the display unit 17, the buffer memory unit 18, the memory unit 19, and the I / F unit 20, and transfers data and the like.

Next, an example of a processing method of the imaging device 1 according to the present embodiment will be described. FIG. 2 is a flowchart illustrating an example of a processing method of the imaging apparatus 1 according to the present embodiment.
As shown in FIG. 2, when an arbitrary scene mode is set by the user via the operation unit 16 or the scene mode is selected by the scene determination unit 153 (step ST1), when the shutter button is pressed, the CPU 15 Determines whether bracket imaging setting is set as the imaging condition of the selected scene mode (step ST2).

When the bracket imaging setting is set (step ST2-YES), the imaging control unit 151 instructs the imaging unit 10 to perform imaging a plurality of times according to the imaging conditions according to the scene mode. Thereby, the imaging generation unit 300 generates a plurality of pieces of image information and stores them in the memory unit 19 (step ST3).
When the plurality of pieces of image information are generated, the best shot image selection unit 154 determines the best shot image based on the determination criterion corresponding to the scene mode, and at least one best shot is selected from the plurality of pieces of image information. An image is selected (step ST4).
Next, the image processing unit 152 determines whether or not image processing conditions for correction according to the scene mode are stored in the memory unit 19 (step ST5), and image processing for correction according to the scene mode is performed. If the condition is stored (step ST5-YES), this image processing condition is read out. The image processing unit 152 corrects the image information selected by the best shot image selection unit 154 based on the read image processing conditions (step ST6). In step ST5, when the image processing conditions for correction according to the scene mode are not stored (step ST5-NO), no correction is performed.

  On the other hand, when the bracket imaging setting is not set in step ST2 (step ST2-NO), the imaging control unit 151 instructs the imaging unit 10 to perform one imaging according to the imaging condition according to the scene mode. Then, the generated image information of one sheet is stored in the memory 19. The image processing unit 152 reads one piece of stored image information and image processing conditions corresponding to the scene mode from the memory 19, and based on the image processing conditions, reads a plurality of pieces from the read one piece of image information. Is generated (step ST7), and the process proceeds to step ST4.

  As described above, the imaging apparatus 1 according to the present embodiment captures a plurality of images (m: m ≧ n) by imaging n times (n is a natural number of 1 or more) based on any selected scene mode. An imaging generation unit 300 that generates image information, and a best shot image selection unit 154 that selects at least one piece of image information from a plurality of pieces of image information generated by the imaging generation unit 300 based on a criterion according to a scene mode. With. With this configuration, the imaging apparatus 1 can select the best shot image based on the determination criterion according to the scene mode from the plurality of pieces of image information generated according to the selected scene mode. As a result, it is possible to eliminate failure images and the like that may occur according to the scene mode, and generate optimal image information according to the scene mode. In addition, in bracket imaging that generates multiple pieces of image information, all image information is stored, or the user is required to select any desired image information, so that the storage unit can be used effectively However, since the imaging apparatus 1 can select at least one piece of image information as the best shot image, the above problem can be solved and the storage area is effective. It can be used for. Furthermore, since the imaging apparatus 1 can select at least one piece of image information as a best shot image and provide it to the user, the user can adjust a plurality of pieces of image information without adjusting each parameter such as imaging conditions. A desired image can be selected from among them.

  In addition, in the conventional scene mode, although image information can be generated with the imaging conditions and image processing conditions according to the scene mode, for example, the timing when the shutter button is pressed by the user does not match, so An image such as blurring was captured, and the imaging had to be performed again. However, the imaging apparatus 1 according to the present embodiment, for example, in the “portrait mode”, has taken a plurality of times in response to a single imaging instruction, and has failed due to blinking or the like from the generated plurality of pieces of image information. The best shot image can be selected by eliminating the image information and determining the image information in which the smile is photographed. Thereby, the imaging device 1 can solve the above-described problems and can generate an optimal image corresponding to the scene mode.

  Furthermore, setting of each parameter value as an imaging condition or an image processing condition is difficult for a novice user or the like, and it is difficult for the user to adjust these settings and capture a desired image. However, in the “landscape mode”, for example, the imaging apparatus 1 according to the present embodiment generates an image with good brightness gradation balance from a plurality of pieces of image information generated by a plurality of times of imaging with different exposure values. At least one best shot image can be selected. This makes it possible to generate image information suitable for the actual subject shape and shooting environment. In addition, since the imaging apparatus 1 can provide the user with a plurality of pieces of image information with different imaging conditions according to the landscape mode and different atmospheres and scenes, the user can perform imaging conditions, etc. A desired image can be selected without adjusting each of the parameters.

  Also, depending on the scene mode, the imaging conditions set in the scene mode may involve the skill of the user, the imaging situation (for example, imaging with the imaging device fixed using a tripod), and the like. For example, in the “night view mode”, image information is generated by increasing the imaging sensitivity as an imaging condition in order to improve the image quality of the image information. However, there is a problem that noise is generated when the sensitivity is increased, and camera shake is also caused. Some problems are likely to occur. Therefore, it is difficult for a novice user or the like to capture a desired image in such a situation, and in order to capture the desired image, there is a risk that the image must be captured while adjusting the imaging conditions many times. is there. However, the imaging apparatus 1 according to the present embodiment captures a plurality of times with different imaging sensitivities, thereby reducing the amount of camera shake from the generated plurality of pieces of image information. Can be selected. Thereby, the imaging device 1 can solve the above-described problem and can generate an optimal image corresponding to the scene mode.

Note that the imaging apparatus 1 according to the present embodiment is not limited to the above configuration, and the following configuration requirements can be changed, replaced, or added.
For example, when selecting a plurality of pieces of image information as the best shot image, the best shot image selection unit 154 determines the priority order as an image suitable for the scene mode, and adds “recommended flag” to one image information determined to be optimal. "Or the like" or may be stored in the "recommended folder" separately from other image information. This makes it easier for the user to use the best shot image.

Further, the bracket imaging setting stored in the memory unit 19 allows the user to set the number of times of imaging by the imaging unit 10 via the operation unit 16. For example, in the “landscape mode”, when the number of imaging is set to 2 and the appropriate exposure value at the time of imaging is determined by the image processing unit 152, the imaging unit 10 determines that the appropriate exposure and the appropriate exposure minus Images can be taken with an exposure of 0.3 EV. When the number of times of imaging is set to 5, the imaging unit 10 captures images with exposures of minus 0.7 EV, minus 0.3 EV, plus 0.3 EV, and plus 0.7 EV with respect to appropriate exposure. be able to.
Furthermore, the present invention can be applied to scene modes other than the above-described example by combining the above-described plurality of scene modes. For example, when “portrait (night view) mode” is set as the scene mode, the imaging apparatus 1 applies the imaging conditions, image conditions, and determination criteria of the “portrait mode” and “night view mode” described above together. Can do.

Further, as described above, the image generation unit 300 may be configured to use bracket imaging settings when generating a plurality of pieces of image information, or may be configured to use bracket image processing settings.
Furthermore, in the above description, the “portrait mode” has been described using an example in which bracket imaging settings with different timings are set. For example, the “portrait mode” is a setting for imaging with different exposure values for each of a plurality of imaging operations. Also good. In this case, the best shot image selection unit 154 selects, based on the skin color image region determined by the image processing performed by the image processing unit 152, an image with a good gradation balance of brightness in the image region as the best shot image. Can do.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 10 ... Imaging part, 151 ... Imaging control part, 152 ... Image processing part, 153 ... Scene discrimination | determination part, 154 ... Best shot image selection part, 300. ..Image generation unit

Claims (7)

When generating the number of sheets of images double based on the scene mode selected arbitrarily, if the bracket shooting setting as the imaging condition of the scene mode is set, the imaging unit according to the imaging conditions corresponding to the scene mode In contrast, when a plurality of times of imaging are instructed to generate the plurality of images, and the bracket imaging setting is not set as the imaging condition of the scene mode, imaging according to the scene mode is performed on the imaging unit An imaging generation unit for instructing one imaging according to a condition to generate a single image, and generating the plurality of images from the single image based on an image processing condition according to the scene mode ;
An image selection unit that selects, as a best shot image, an image that satisfies a predetermined condition according to the scene mode based on a feature amount included in each of the plurality of images generated by the imaging generation unit; An imaging apparatus comprising: Among the plurality of images generated by the imaging generation unit or the best shot image selected by the image selection unit, either one determined in advance according to the scene mode, The imaging apparatus according to claim 1, further comprising an image processing unit that performs image correction according to a scene mode. The image selection unit
A histogram evaluation value indicating the luminance distribution of each of the plurality of images is generated, and based on the generated histogram evaluation value, an image in which light and dark gradations are balanced from a bright place to a dark place, or a human face The image pickup apparatus according to claim 1, wherein an image in which an image region corresponding to 1 has a certain brightness or more is selected as the best shot image. The image selection unit
The best shot image is selected from the plurality of images based on whether or not a detection target that is predetermined according to the scene mode is detected from the image. Imaging device. The image selection unit
As the detection target, a smile of a person or a blink of a person is detected, and an image with a high degree of smile of the detected person or an image in which the blink of the person is not detected is selected as the best shot image The imaging apparatus according to claim 4, wherein: The image selection unit
5. The image region corresponding to a subject is detected as the detection target, and an image having a focus position in the image region corresponding to the subject is selected as the best shot image. Imaging device. The image selection unit
An evaluation value of each amount of camera shake of the plurality of images is calculated, and an image with the lowest imaging sensitivity setting is selected as the best shot image among the calculated images with a small amount of camera shake. The imaging apparatus according to claim 1 or 2.

Images