JP4799366B2 - Imaging apparatus and image reproduction apparatus - Google Patents

Description

  The present invention relates to an imaging apparatus such as a digital still camera or a digital video camera, and more particularly to a technique for automatically setting shooting conditions such as focus and exposure. The present invention also relates to an image reproduction apparatus that reproduces and displays an image captured by the imaging apparatus.

  In a conventional imaging apparatus having an autofocus function (autofocus function), it is common to perform autofocus using one or a plurality of areas at the center of the screen as a distance measurement area. However, in this distance measurement method, when a person is photographed, it is necessary to perform autofocusing with a composition in which the person and the distance measurement area overlap, and after focusing, change to the desired composition and perform photographing.

  In order to save such trouble, a technique for detecting a human face included in a shooting area and performing automatic focusing control using the area including the detected face as a distance measurement area is disclosed (for example, , See Patent Document 1 below).

  However, since the shooting environment and the photographer's intention are not always constant, it is not always preferable to set the area including the face as the distance measurement area.

  In addition, when a plurality of faces are included in the shooting area, there are a plurality of shooting conditions focusing on the face (for example, the shooting conditions including the first face in the distance measurement area and the second face. Shooting conditions included in the distance measurement area). In such a case, one shooting condition is selected from among a plurality of shooting conditions (shooting parameters) by automatic setting in the imaging apparatus, presetting by the photographer or manual setting immediately before shooting, and the selected one Actual shooting was performed by applying shooting conditions.

  However, as described above, since the photographing environment and the photographer's intention are not always constant, it is difficult to accurately reflect such a difference in the situation with the automatic setting or the prior setting. In addition, when the photographer manually sets immediately before shooting, there is a problem that a desired shooting timing is missed because a time lag occurs due to manual operation.

JP 2003-107335 A

  The problem of the conventional method has been described by taking the case of taking a picture focusing on a person's face as an example, but the same problem may occur when taking a picture focusing on an object other than the person's face.

  Therefore, an object of the present invention is to provide an imaging apparatus that contributes to an improvement in the possibility of acquiring an image close to the photographer's intention without causing a time lag or the like due to manual operation. Another object of the present invention is to provide an image reproducing apparatus that contributes to facilitating the confirmation of an image photographed by the imaging apparatus.

  In order to achieve the above object, an imaging apparatus according to the present invention includes an object detection unit that detects a predetermined type of object from a captured image obtained by imaging by an imaging unit, and information about the object on the captured image. And a parameter generating means for generating a plurality of shooting parameters representing shooting conditions, and when a predetermined shooting instruction for performing special shooting is given, each shooting parameter generated in advance is sequentially applied. A plurality of captured images based on the plurality of imaging parameters are obtained as a plurality of bracket images by performing imaging.

  Thereby, a plurality of bracket images according to a plurality of shooting parameters are shot in accordance with a predetermined shooting instruction (for example, pressing the shutter button once). For this reason, the possibility that an image intended by the photographer is obtained by this photographing instruction is increased.

  Specifically, for example, the information specifies the position of the object on the captured image.

  More specifically, for example, the information specifies at least one of the size and the number of the objects on the captured image.

  Further, for example, the imaging apparatus includes an instruction receiving unit that receives an ordering instruction for ordering the plurality of bracket images, a storage unit that stores each bracket image with a file name, and the plurality of the ordering instructions. File name changing means for changing the file name associated with each bracket image based on the order between the bracket images;

  This facilitates file management.

  In addition, for example, the imaging apparatus further includes an instruction receiving unit that receives an ordering instruction for ordering the plurality of bracket images, and the order of application of the plurality of shooting parameters to the special shooting after the next time includes the ordering instruction. Set in consideration.

  Thereby, it is expected that the shooting parameters are applied in the order that matches the intention of the photographer in the next and subsequent special shooting.

  Further, for example, each shooting parameter specifies a position of a focus lens for forming an optical image of a subject including the object on an imaging element of the imaging unit, and the order of application of the plurality of shooting parameters is It is set in consideration of the same change direction of the focus lens position during shooting of a plurality of bracket images.

  Further, for example, each shooting parameter specifies the aperture of the diaphragm that controls the amount of light incident on the image sensor of the imaging means, and the application order of the plurality of shooting parameters is the same as that during the shooting of the plurality of bracket images. It is set in consideration of the identity of the change direction of the opening.

  These contribute to shortening the photographing time of a plurality of bracket images. As a result, it is possible to perform shooting at a timing more desirable for the subject or the photographer.

  More specifically, for example, the object includes a human face.

  In order to achieve the above object, an image reproduction apparatus according to the present invention includes a display unit capable of displaying a captured image obtained by the imaging device, a display control unit for controlling display contents of the display unit, The display control means selectively displays a representative image from the plurality of bracket images when the display means displays an image corresponding to the special shooting by the imaging device. The representative image is displayed in a corresponding display area.

  Although the number of shot images increases due to the special shooting, it is possible to easily check the shot images by forming the image generation device as described above.

  Further, for example, in the image reproduction device, the representative image displayed in the display area is switched automatically in accordance with time or in response to an external switching instruction in the plurality of bracket images.

  According to the imaging apparatus of the present invention, there is an increased possibility that an image close to the photographer's intention can be acquired without causing a time lag due to manual operation. In addition, according to the image reproducing apparatus of the present invention, it is possible to easily confirm a captured image.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings. In each of the drawings to be referred to, the same part is denoted by the same reference numeral, and redundant description regarding the same part is omitted in principle. The first to third embodiments will be described later. First, matters common to each embodiment or items referred to in each embodiment will be described.

  FIG. 1 is an overall block diagram of an imaging apparatus 1 according to an embodiment of the present invention. The imaging device 1 is a digital still camera that can capture still images, or a digital video camera that can capture still images and moving images.

  The imaging device 1 includes an imaging unit 11, an AFE (Analog Front End) 12, a control unit 13, a face detection unit 14, a display unit 15, a recording medium 16, and an operation unit 17.

  FIG. 2 shows an internal configuration diagram of the imaging unit 11. By using a color filter or the like for the imaging unit 11, the imaging device 1 is configured to generate a color image by shooting. The imaging unit 11 includes an optical system 35 including a plurality of lenses including a zoom lens 30 and a focus lens 31, an aperture 32, an imaging element 33, and a driver 34. The zoom lens 30 and the focus lens 31 are movable in the optical axis direction.

  A driver 34 composed of a motor or the like controls the movement of the zoom lens 30 and the focus lens 31 based on a control signal from the control unit 13 and controls the zoom magnification and focal length of the optical system 35. The driver 34 controls the opening degree (size of the opening) of the diaphragm 32 based on a control signal from the control unit 13.

  Incident light from the subject enters the image sensor 33 through the lenses and the diaphragm 32 constituting the optical system 35. Each lens constituting the optical system 35 forms an optical image of the subject on the image sensor 33.

  The image sensor 33 is composed of, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) image sensor. The image sensor 33 photoelectrically converts an optical image incident through the optical system 35 and the diaphragm 32 and outputs an electrical signal obtained by the photoelectric conversion to the AFE 12. More specifically, the imaging device 33 includes a plurality of pixels (light receiving pixels; not shown) that are two-dimensionally arranged in a matrix, and in each photographing, each pixel receives a signal charge having a charge amount corresponding to the exposure time. store. The electrical signal from each pixel having a magnitude proportional to the amount of stored signal charge is sequentially output to the subsequent AFE 12 in accordance with a drive pulse from a timing generator (not shown).

  The AFE 12 amplifies the analog signal output from the imaging unit 11 (image sensor 33), and converts the amplified analog signal into a digital signal. The AFE 12 sequentially outputs this digital signal to the control unit 13.

  The control unit 13 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and also functions as a video signal processing unit. Based on the output signal of the AFE 12, the control unit 13 generates a video signal representing an image captured by the imaging unit 11 (hereinafter also referred to as “captured image”).

  The control unit 13 includes an AF evaluation value detection unit 21 that detects an AF evaluation value corresponding to the contrast amount in the focus detection region in the captured image. FIG. 3 is an internal block diagram of the AF evaluation value detection unit 21. The AF evaluation value detection unit 21 includes an extraction unit 41, an HPF (high pass filter) 42, and an integration unit 43.

  The extraction unit 41 extracts a luminance signal from a video signal representing a captured image. At this time, only the luminance signal in the focus detection area of the captured image is extracted. The HPF 42 extracts only a predetermined high frequency component from the luminance signal extracted by the extraction unit 41.

  The accumulating unit 43 obtains an AF evaluation value corresponding to the contrast amount of the image in the focus detection area by accumulating the high frequency components extracted by the HPF 42. The AF evaluation value is calculated for each captured image. The AF evaluation value is approximately proportional to the contrast amount, and increases as the contrast amount increases. As the position of the focus lens 31 changes in the optical axis direction, the contrast amount of the image changes and the AF evaluation value also changes.

  Normally, the control unit 13 controls the position of the focus lens 31 via the driver 34 using a so-called hill climbing operation so that the AF evaluation value is maintained at the maximum value (near). As a result, the contrast amount of the image in the focus detection region with respect to the same optical image is kept at the maximum value (near). That is, the position of the focus lens 31 is controlled so that the optical image of the subject that falls within the focus detection area is formed on the image sensor 33 (the subject that falls within the focus detection area is focused).

  The control unit 13 further includes an AE evaluation value detection unit 22 that detects an AE evaluation value corresponding to the brightness of the captured image.

  The AE evaluation value detection unit 22 extracts a luminance signal from a video signal representing a captured image. At this time, only the luminance signal in the brightness evaluation area of each captured image is extracted. The AE evaluation value detection unit 23 obtains an AE evaluation value proportional to the brightness of the image in the brightness evaluation area by integrating the luminance signals in the extracted brightness evaluation area. The AE evaluation value is calculated for each captured image.

  Normally, the control unit 13 controls the opening degree of the diaphragm 32 via the driver 34 so that the sequentially calculated AE evaluation value is maintained at a constant value. When the optical images incident on the optical system 35 are the same, the amount of incident light per unit time on the image sensor 33 increases and the value of the luminance signal increases as the aperture of the diaphragm 32 increases.

  The face detection unit 14 in FIG. 1 detects a person's face from each captured image, and extracts a face area including the face. Receiving the detection result of the face detection unit 14, the control unit 13 recognizes the size and position of the face on the image. Various methods are known as methods for detecting a face included in an image, and the face detection unit 14 can employ any method. For example, a face (face area) may be detected by extracting a skin color area from a photographed image as in the technique described in Japanese Patent Application Laid-Open No. 2000-105819, or Japanese Patent Application Laid-Open No. 2006-21139 and Japanese Patent Application Laid-Open No. 2006. A face (face area) may be detected using the technique described in Japanese Patent No. -72770 or the above-mentioned Patent Document 1.

  Typically, for example, the similarity between both images is determined by comparing the image of the region of interest set in the input image (that is, the captured image) with a reference face image having a predetermined image size. Based on this, it is detected whether or not a face is included in the region of interest (whether or not the region of interest is a face region). The similarity determination is performed by extracting a feature amount effective for identifying whether the face is a face. The feature amount is a horizontal edge, a vertical edge, a right diagonal edge, a left diagonal edge, or the like.

  In the input image, the region of interest is shifted in the horizontal direction or the vertical direction pixel by pixel. Then, the image of the region of interest after the shift is compared with the reference face image, the similarity between both images is determined again, and the same detection is performed. In this way, the region of interest is updated and set, for example, while being shifted pixel by pixel from the upper left to the lower right of the input image.

  Further, the input image (that is, the photographed image) is reduced at a certain rate, and the same face detection process is performed on the reduced image. By repeating such processing, a face of any size can be detected from the input image.

  The display unit 15 in FIG. 1 is a display device including a liquid crystal display panel and the like, and displays an image taken in the immediately preceding frame, an image recorded on the recording medium 16, and the like. The control unit 13 controls the display content of the display unit 15. The recording medium 16 is a non-volatile memory such as an SD (Secure Digital) memory card, and stores captured images and the like under the control of the control unit 13. The operation unit 17 includes a shutter button 17a, a so-called cross key (not shown), and the like, and accepts an operation from the outside. The operation content for the operation unit 17 is transmitted to the control unit 13.

  The operation modes of the imaging apparatus 1 include a shooting mode in which still images (and moving images) can be shot, and a playback mode in which still images (and moving images) recorded on the recording medium 16 are played back and displayed on the display unit 15. included. Transition between the modes is performed according to the operation on the operation unit 17. In the shooting mode, regardless of whether the shutter button 17a is pressed or not, the shooting is sequentially performed at a predetermined frame period (for example, 1/60 seconds), and the sequentially obtained captured images are updated and displayed on the display unit 15. (So-called preview display is performed).

  Then, by performing a predetermined operation on the operation unit 17, bracket shooting (special shooting) can be performed in the shooting mode. For convenience of explanation, the photographing mode for executing the bracket photographing is referred to as a bracket photographing mode. The bracket shooting mode is one operation mode included in the shooting mode.

  Hereinafter, first to third examples will be illustrated as examples focusing on the bracket photographing mode. The matters described in one embodiment can be applied to other embodiments as long as no contradiction arises.

<< First Example >>
First, the first embodiment will be described. In the bracket shooting mode, the face detection function by the face detection unit 14 is used. As a specific example, in the first embodiment, an operation in the case where three faces are included in the imaging region will be described. FIG. 4 shows a photographed image including these three faces as subjects. These three faces will be referred to as faces F1, F2, and F3, respectively. In FIG. 4 and each of the drawings described later including the illustration of the face, the components of the human body other than the face (such as the torso and limbs) are not shown in order to prevent the illustration from becoming complicated.

When a captured image as shown in FIG. 4 is input to the face detection unit 14, the face detection unit 14 detects faces F1, F2, and F3 from the captured image, and a face region R _F1 including the face _F1. The face area R _F2 including the face _F2 and the face area R _F3 including the face _F3 are extracted. The outer shape of each face area matches the outer shape of the detected face. Each face area may be defined as the smallest rectangular area surrounding the face.

The control unit 13 (or the face detection unit 14) calculates the sizes of the face regions R _F1 , R _F2 and R _F3 on the image (that is, the sizes of the faces F1, F2 and F3 on the image). The size of the face area on the image is represented by the area of the face area or the number of pixels constituting the face area. In the case of the present example, it is assumed that the size of the face region R _F1 is the largest among the face regions R _F1 , R _F2 and R _F3 (in other words, the size of the face F3 among the faces F1, F2 and F3) Is the largest).

Then, the control unit 13 evaluates the positional relationship of the face region R _F1, R _F2 and R _F3, on the image, middle-most face region R _F1, identifies the R _F2 and R _F3. For example, as shown in FIG. 5, and calculates the center position C _F1, C _F2 and C _F3 of the face area R _F1, R _F2 and R _F3. In FIG. 5, C _O represents the center point of the entire captured image. On the image, each center position is represented by a horizontal coordinate and a vertical coordinate based on the origin X of the image. The control unit 13 calculates the distances between the center positions C _F1 , C _F2 and C _F3 and the center point C _O , compares the distances, and determines the face region corresponding to the center position with the shortest distance as the most. The face area near the center is specified. In the present example, since the center position C _F2 for the face _F2 is closest to the center point C _O , the face area R _F2 is specified as the face area closest to the center.

[Shooting parameter generation]
When the captured images shown in FIGS. 4 and 5 are obtained, the control unit 13 that also functions as a parameter generation unit generates four imaging parameters. Each shooting parameter represents a shooting condition in bracket shooting. Specifically, the position of the focus lens 31 and the opening of the diaphragm 32 in FIG. These four shooting parameters are referred to as first, second, third, and fourth shooting parameters.

The first shooting parameter is a shooting parameter (center priority parameter) suitable for shooting the face F2 located at the center of the faces F1 to F3. When creating the first shooting parameter, as shown in FIG. 6A, an area 102 focused on the face F2 is defined on the image. The area 102 is, for example, the face area R _F2 itself, a rectangular area including the face area R _F2 , or a rectangular area included in the face area R _F2 (a rectangular area including a part of the face F2). FIG. _6A illustrates a case where the region 102 is a rectangular region including the face region R _F2 (the same applies to regions 101 and 103 described later).

Based on the AF evaluation value calculated by treating the area 102 as the focus detection area, the control unit 13 generates an optical image on the image sensor 33 such that the AF evaluation value is maximized, that is, the subject that falls within the area 102. The position of the focus lens 31 that forms an image is calculated. The position of the focus lens 31 calculated by paying attention to the region 102 is referred to as a position P ₁ . The position P ₁ is included in the first imaging parameter.

Further, the control unit 13 sets the AE evaluation value to a predetermined value based on the AE evaluation value calculated by treating the area 102 as the brightness evaluation area, that is, the brightness of the image in the area 102 is predetermined. The aperture of the diaphragm 32 is calculated so that the brightness becomes. The opening degree of the diaphragm 32 calculated by paying attention to the region 102 is referred to as an opening degree O ₁ . The opening degree O ₁ is included in the first imaging parameter.

The second shooting parameter is a shooting parameter (size priority parameter) suitable for shooting the face F1 having the largest size among the faces F1 to F3. When creating the second imaging parameter, as shown in FIG. 6B, an area 101 focusing on the face F1 is defined on the image. The area 101 is, for example, the face area R _F1 itself, a rectangular area including the face area R _F1 , or a rectangular area included in the face area R _F1 (a rectangular area including a part of the face F1).

Based on the AF evaluation value calculated by treating the area 101 as the focus detection area, the control unit 13 generates an optical image on the image sensor 33 such that the AF evaluation value is maximized, that is, the subject that falls within the area 101. The position of the focus lens 31 (this is referred to as the position P ₂ ) that forms an image at is calculated.

Further, the control unit 13 sets the AE evaluation value to a predetermined value based on the AE evaluation value calculated by treating the area 101 as the brightness evaluation area, that is, the brightness of the image in the area 101 is predetermined. The aperture of the diaphragm 32 (this is referred to as the aperture O ₂ ) is calculated so that the brightness of The position P ₂ and the opening degree O ₂ are included in the second imaging parameter.

The third shooting parameter is a shooting parameter (all face average parameter) in which the faces F1 to F3 are handled equally. When creating the third imaging parameter, as shown in FIG. 6C, in addition to the areas 101 and 102, an area 103 focused on the face F3 is defined on the image. The area 103 is, for example, the face area R _F3 itself, a rectangular area including the face area R _F3 , or a rectangular area included in the face area R _F3 (a rectangular area including a part of the face F3).

Based on the AF evaluation value calculated by treating the total area of the areas 101, 102, and 103 as the focus detection area, the control unit 13 maximizes the AF evaluation value, that is, in the areas 101, 102, and 103. The position of the focus lens 31 (this is referred to as position P ₃ ) is calculated such that an optical image of the subject that falls within the image is averaged on the image sensor 33. Since the total area of the areas 101, 102, and 103 is the focus detection area, the image formation points for the faces F 1, F 2, and F 3 may not be on the image sensor 33.

Further, the control unit 13 sets the AE evaluation value to a predetermined value based on the AE evaluation value calculated by treating the total area of the areas 101, 102, and 103 as the brightness evaluation area, that is, the area 101, The opening degree of the diaphragm 32 (this is called the opening degree O ₃ ) is calculated so that the brightness (average brightness) of the images in the total area of 102 and 103 becomes a predetermined brightness. The position P ₃ and the opening degree O ₃ are included in the third imaging parameter.

  The fourth imaging parameter is an imaging parameter (overall average parameter) that focuses on the entire imaging area on average. When creating the fourth imaging parameter, an area 104 is defined as shown in FIG. The area 104 is, for example, an entire area of the captured image or a rectangular area slightly smaller than the entire area of the captured image. In defining the area 104, the result of face detection is not used.

Based on the AF evaluation value calculated by treating the area 104 as the focus detection area, the control unit 13 takes an average optical image of the subject that maximizes the AF evaluation value, that is, the subject that falls within the area 104. The position of the focus lens 31 that forms an image on the element 33 (this is called the position P ₄ ) is calculated.

Further, the control unit 13 determines that the AE evaluation value becomes a predetermined value based on the AE evaluation value calculated by treating the area 104 as the brightness evaluation area, that is, the brightness (average) of the image in the area 104. The opening of the diaphragm 32 (this is referred to as the opening O ₄ ) is calculated such that the target brightness becomes a predetermined brightness. The position P ₄ and the opening degree O ₄ are included in the fourth imaging parameter.

[Bracket shooting based on shooting parameters]
In the bracket shooting mode, by pressing the shutter button 17a, the control unit 13 applies the first, second, third, and fourth shooting parameters to control the position of the focus lens 31 and the opening of the diaphragm 32. However, bracket shooting is performed, and thereby four captured images (still images) are obtained from the imaging unit 11. These four captured images are referred to as first, second, third, and fourth bracket images. The first to fourth bracket images are continuously photographed (that is, continuously photographed). The first, second, third, and fourth bracket images correspond to the first, second, third, and fourth imaging parameters, respectively.

That is, the first bracket image is an image that is taken after setting the position of the focus lens 31 to the position P ₁ and the opening degree of the aperture 32 to the opening degree O _1, and the second bracket image is the focus lens. The third bracket image is an image taken with the position 31 as the position P ₂ and the opening degree of the diaphragm 32 as the opening degree O _2. The third bracket image has the position of the focus lens 31 as the position P ₃ and the diaphragm 32. opening a a captured image on which the opening O _3, fourth bracket image, on the opening position P ₄ and to and aperture 32 the position of the focus lens 31 and the opening O ₄ This is an image taken in

  A method for determining the application order of the first to fourth imaging parameters (in other words, the imaging order of the first to fourth bracket images) will be described later, and the first, second, third, and fourth are now described. It is assumed that shooting is performed in the order of the first, second, third, and fourth bracket images by applying the shooting parameters in the order of the shooting parameters.

  FIG. 7 shows a display screen of the display unit 15 after the first to fourth bracket images are taken. The entire display area of the display screen includes display areas 111, 112, 113, and 114 that are different from each other, and the display areas 111, 112, 113, and 114 include first, second, third, and fourth brackets, respectively. An image is displayed. As shown in FIG. 7, the first to fourth bracket images are arranged on the same display screen and simultaneously displayed (that is, displayed as a list). The photographer can easily confirm each bracket image by viewing the list display.

  In each image of FIG. 7 (and FIG. 8 to be described later), a square frame representing the outer shape of the areas 101 to 104 in FIG. 6 is shown, but whether or not these square frames are displayed on the display screen. Is optional. In addition, the first, second, third, and fourth bracket images may be displayed on the display screen side by side in the order that the appearance of the face is good. For example, a human eye region is extracted from each bracket image, and the eye open / closed state is detected by image analysis. Then, it is determined that the bracket image corresponding to the face with closed eyes has a relatively poor face appearance, and the bracket image corresponding to the face with open eyes has a relatively good face appearance.

  The user uses the operation unit 17 to select the first to fourth bracket images in the order of preference (that is, by ordering the first to fourth bracket images), thereby displaying The display position of each bracket image on the screen can be changed. For example, suppose that each bracket image is selected in the order of the second, third, first, and fourth bracket images by performing a predetermined operation on the operation unit 17. By this selection, as shown in FIG. 8, the second, third, first, and fourth bracket images are displayed in the display areas 111, 112, 113, and 114, respectively.

  In addition, the first to fourth bracket images are stored with file names attached to the recording medium 16 at the same time as shooting, but the file names can be changed by the above selection. That is, for example, the first, second, third, and fourth bracket images are initially recorded on the recording medium 16 with the file names image001_01, image001_02, image001_03, and image001_04, respectively. By selecting each bracket image in the order of the second, third, first, and fourth bracket images, the file name corresponding to the first bracket image is image001_03 and the file name corresponding to the second bracket image. Is changed to image001_01, and the file name corresponding to the third bracket image is changed to image001_02.

  In this way, the operation unit 17 receives an ordering instruction for ordering the four bracket images, and the control unit 13 follows the ordering instruction to display the display position (display order) of each bracket image in the list display and each bracket. Change the file name corresponding to the image. File management is facilitated by assigning file names according to user preference order. As described above, the ordering instruction is realized by, for example, an operation on the operation unit 17 that sequentially selects the first to fourth bracket images.

  Further, it is possible to execute the ordering between the shooting parameters by the ordering instruction. For example, when the order is made in the order of the second, third, first, and fourth bracket images by selecting the bracket images in the order of the second, third, first, and fourth bracket images. think of. In this case, the respective shooting parameters are ordered in accordance with this, and the ordering between the respective shooting parameters is used in the next bracket shooting.

For example, when there are three faces in the shooting area in the bracket shooting from the next time, as in FIG.
First, taking a picture using “shooting parameters suitable for shooting the largest face among the three faces (corresponding to the second shooting parameter above)”,
Secondly, taking a picture using the "shooting parameters that handle three faces equally (corresponding to the third shooting parameter above)"
The third shooting is performed by applying the “shooting parameters suitable for shooting the face located at the center of the three faces (corresponding to the first shooting parameter described above)”.
Shooting is performed last by applying “shooting parameters focusing on the entire shooting area on average (corresponding to the fourth shooting parameter)”.

  In this manner, the order of application of the respective shooting parameters (in other words, the shooting order of the bracket images) is determined in the subsequent bracket shooting in accordance with the ordering instruction for the current bracket shooting. The ordering instruction is presumed to represent the user's preferred order of shooting parameters (shooting conditions). For this reason, by determining the shooting order of the bracket images as described above, the bracket image based on the shooting parameters that the user prefers is shot at a timing closer to the time immediately after the shutter button 17a is pressed in the next bracket shooting. That is, shooting is performed in an order that matches the user's intention. Information necessary for determining the shooting order (such as the contents of the ordering instruction) is appropriately recorded on the recording medium 16.

  In addition, the application order of the shooting parameters is not based on the above-described ordering instruction, but the change direction of the focus lens 31 and / or the change direction of the aperture of the diaphragm 32 during the bracket shooting period. It may be determined based on the above.

For example, after generating the first to fourth shooting parameters, the focus lens during continuous shooting of the first to fourth bracket images with reference to the positions P _{1 to} P ₄ representing the position of the focus lens 31. The application order of the first to fourth imaging parameters is determined so that the change direction of the position 31 is the same. For example, when the position of the focus lens 31 is close to the image sensor 33 in the order of the positions P ₁ , P ₂ , P ₃ and P ₄ , the first, second, third and fourth imaging parameters are applied in this order. Then, each bracket image is photographed (the first, second, third and fourth bracket images are photographed in this order). Of course, it is possible to shoot in the reverse order.

Further, for example, after the first to fourth imaging parameters are generated, the opening O _{1 to} O ₄ representing the opening of the diaphragm 32 is referred to and the first to fourth bracket images are continuously captured. The application order of the first to fourth imaging parameters is determined so that the direction of change in the opening of the diaphragm 32 is the same. For example, when the aperture of the diaphragm 32 decreases in the order of the apertures O ₁ , O ₂ , O ₃ and O ₄ , the first, second, third and fourth imaging parameters are applied in this order to A bracket image is photographed (the first, second, third and fourth bracket images are photographed in this order). Of course, it is possible to shoot in the reverse order.

  Since the movement of the focus lens 31 and the diaphragm 32 becomes continuous by determining the application order of each shooting parameter in this way, the continuous shooting time for obtaining each bracket image is shortened, and a more desirable timing for the subject or the photographer. It becomes possible to shoot with.

[Bracketing operation procedure]
Next, an operation procedure of bracket shooting will be described with reference to FIG. FIG. 9 is a flowchart showing an operation procedure of bracket shooting. In the description of this operation procedure, the above-described example contents (example contents including three faces F1 to F3 included in the imaging region) are appropriately cited for the purpose of concrete description.

  First, in step S1, a photographed image is given to the face detection unit 14, and in step S2, the face detection unit 14 detects a face from the photographed image and extracts a face region. In step S3, the control unit 13 calculates a plurality of shooting parameters based on the face detection result in step S2. Specifically, for example, the first to fourth imaging parameters described above are calculated. In the subsequent step S4, the application order of each shooting parameter is set based on the ordering instruction for the past bracket shooting as described above with reference to the processing results of steps S2 and S3. When the process of step S4 is completed, the process proceeds to step S5.

  Steps S1 to S4 are performed after the shutter button 17a is half-pressed, for example. The shutter button 17a is pressed in two steps according to the external force. The shutter button 17a is half-pressed by a relatively small external force and is fully pressed by a relatively large external force.

  In step S5, the control unit 13 confirms whether or not the shutter button 17a has been pressed. More specifically, it is confirmed whether or not the shutter button 17a is fully pressed. Here, full pressing of the shutter button 17a instructs execution of one bracket shooting. If the shutter button 17a is fully pressed, the process proceeds to step S6. If not, the process of step S5 is repeated.

  In step S6, each bracket image is sequentially photographed according to each photographing parameter calculated in step S3 and the application order set in step S4. In the example shown in FIG. 4, four bracket images are sequentially captured. Each captured bracket image is recorded on the recording medium 16 with a file name.

  When the shooting of each bracket image is completed, in step S7, the control unit 13 causes the display unit 15 to display a list of each bracket image. Thereby, the display screen of the display unit 15 becomes a display screen as shown in FIG.

  In step S8 following step S7, the imaging device 1 shifts to a state in which the ordering instruction from the user is received. At this time, the user orders each bracket image by selecting each bracket image displayed on the display screen in the order of his / her preference. When the ordering instruction is received, the process proceeds to step S9.

  In step S9, according to the contents of the ordering instruction given in step S8, the bracket images on the display screen are rearranged and the file names given to the bracket images are changed as necessary.

  In subsequent step S10, the control unit 13 records the contents of the ordering instruction given in step S8 on the recording medium 16. This recorded content is used to set the application order of each shooting parameter in the next and subsequent bracket shooting. When the process of step S10 is completed, the current bracket shooting is completed, and the process proceeds to a state of accepting an instruction for the next bracket shooting.

[Display image]
Next, a characteristic operation in the playback mode will be described. The playback mode includes a thumbnail image playback mode in which a plurality of images are displayed in a list and a normal playback mode in which only one image is displayed. Transition between the modes is performed in accordance with an operation on the operation unit 17. Display control in the thumbnail image playback mode will be described.

  In the thumbnail image reproduction mode, a plurality of images recorded on the recording medium 16 are displayed as a list on the display unit 15. Each image displayed in a list is a so-called thumbnail image corresponding to a reduced image of each image (that is, each captured image) recorded on the recording medium 16. However, with respect to a certain target image, the target image and the thumbnail image of the target image are essentially the same image except for the image size. Therefore, for simplification of description, in this specification, even when “display a reduced image (thumbnail image) of a target image” is expressed as “display a target image”.

  In the thumbnail image reproduction mode, the entire display area on the display screen of the display unit 15 is divided into, for example, six divided display areas. FIG. 10 shows a state in which the entire display area is divided into six divided display areas 121 to 126.

  When an image corresponding to bracket shooting is included in the images displayed as a list in the thumbnail image playback mode, the control unit 13 selects one bracket image as a representative image from a plurality of bracket images, The representative image is displayed in a divided display area corresponding to the bracket photographing.

  For example, consider a case where five images based on five normal shootings and four bracket images (first to fourth bracket images) based on one bracket shooting are recorded on the recording medium 16. Here, normal shooting refers to shooting in which one shot image is recorded on the recording medium 16 in response to a single press on the shutter button 17a. In this case, for example, as shown in FIG. 11, a captured image for normal shooting (more specifically, a reduced image of the captured image) is displayed in each of the divided display areas 121 and 123 to 126, and the representative display is displayed in the divided display area 122. An image (more specifically, a reduced image of the representative image) is displayed. As a result, it is possible to facilitate confirmation of a captured image while storing a series of bracket images.

  The representative image is determined, for example, according to the contents of the ordering instruction. That is, for example, when the second, third, first, and fourth bracket images are ordered in step S8 of FIG. 9, the second bracket image is set as the representative image.

  Further, the representative image may be automatically changed in the first to fourth bracket images at regular time intervals. That is, for example, when the second, third, first, and fourth bracket images are ordered in step S8 of FIG. 9, first, the second bracket image is used as a representative image in the divided display area 122. After the fixed time has elapsed, the third bracket image is updated and displayed in the divided display area 122 as a representative image. Thereafter, every time a certain time elapses, the representative image to be updated and displayed in the divided display area 122 is changed to the first bracket image and the fourth bracket image, and the second bracket image is followed by the second bracket image. Return to the bracket image.

  Also, instead of automatically changing the representative image according to the time, the representative image to be displayed in the divided display area 122 in accordance with an operation (switching instruction) for instructing the operation unit 17 to switch the representative image. May be switched sequentially.

  In the normal playback mode in which only one image is played back and displayed in the entire display area on the display screen, the same processing as in the thumbnail image playback mode can be performed. That is, for example, if the second, third, first, and fourth bracket images are ordered in step S8 of FIG. 9, the second bracket image is displayed as a representative image in the normal playback mode. Thereafter, as in the thumbnail image playback mode, the images to be played back and displayed are changed in the order of the third, first, and fourth bracket images as time elapses or in response to an operation on the operation unit 17.

  Further, which of the four bracket images is used as the representative image may be determined in advance (this is common in the thumbnail image playback mode and the normal playback mode). For example, among the four bracket images, the first bracket image taken may be determined as the representative image.

<< Second Example >>
Although the first embodiment has been described on the assumption that three faces are included in the shooting area, the present invention functions effectively regardless of the number of faces included in the shooting area. For example, a case where the number of faces included in the shooting area is 1 will be described as a second embodiment. Assume that the face included in the imaging region is a face F1 as shown in FIG.

In this case, as in the first embodiment, the face detection unit 14 detects the face F1 from the captured image, and extracts the face region R _F1 including the face _F1 . And the control part 13 produces | generates two imaging | photography parameters with respect to this picked-up image. These two shooting parameters are called shooting parameters PR _A1 and PR _A2 .

The shooting parameter PR _A1 is a shooting parameter (face priority parameter) suitable for shooting the face F1. When the shooting parameter PR _A1 is created, as shown in FIG. 13A, an area 101 focusing on the face F1 is defined on the image.

Based on the AF evaluation value calculated by treating the area 101 as the focus detection area, the control unit 13 generates an optical image on the image sensor 33 such that the AF evaluation value is maximized, that is, the subject that falls within the area 101. The position of the focus lens 31 (this is referred to as a position P _A1 ) such that the image is formed at is calculated. Further, the control unit 13 sets the AE evaluation value to a predetermined value based on the AE evaluation value calculated by treating the area 101 as the brightness evaluation area, that is, the brightness of the image in the area 101 is predetermined. The opening of the diaphragm 32 (this is referred to as the opening O _A1 ) is calculated so that The position P _A1 and the opening degree O _A1 are included in the imaging parameter PR _A1 .

The shooting parameter PR _A2 is calculated by the same process as the fourth shooting parameter in the first embodiment. The imaging parameter PR _A2 is an imaging parameter (overall average parameter) that focuses on the entire imaging area on average. When the shooting parameter PR _A2 is created, a region 104 is defined as shown in FIG.

Based on the AF evaluation value calculated by treating the area 104 as the focus detection area, the control unit 13 takes an average optical image of the subject that maximizes the AF evaluation value, that is, the subject that falls within the area 104. The position of the focus lens 31 that forms an image on the element 33 (this is referred to as a position P _A2 ) is calculated. Further, the control unit 13 determines that the AE evaluation value becomes a predetermined value based on the AE evaluation value calculated by treating the area 104 as the brightness evaluation area, that is, the brightness (average) of the image in the area 104. The aperture of the diaphragm 32 (this is referred to as the aperture O _A2 ) is calculated such that the target brightness is a predetermined brightness. The position P _A2 and the opening degree O _A2 are included in the imaging parameter PR _A2 .

When an instruction for bracket shooting is given, a bracket image according to the shooting parameter PR _A1 and a bracket image according to the shooting parameter PR _A2 are continuously shot.

<< Third Example >>
Further, for example, a case where the number of faces included in the imaging region is 2 will be described as a third embodiment. Assume that the faces included in the imaging region are a face F1 and a face F2, as shown in FIG.

In this case, as in the first embodiment, the face detection unit 14 detects the faces F1 and F2 from the captured image, and extracts the face area R _F1 including the face _F1 and the face area R _F2 including the face _F2 . To do. And the control part 13 produces | generates four imaging | photography parameters with respect to this picked-up image. These four shooting parameters are referred to as shooting parameters PR _B1 , PR _B2 , PR _B3, and PR _B4 .

  In the comparison between the imaging target assumed in the first embodiment shown in FIG. 4 and the imaging target assumed in the third embodiment shown in FIG. 14, the face F3 in the former is shown for simplicity of explanation. It is assumed that what is simply deleted corresponds to the latter, and the other points coincide with each other.

Then, when calculating the shooting parameter PR _B1 , as in FIG. 6A, a region 102 focused on the face F2 is defined on the image as shown in FIG. 15A, and the shooting parameter PR _B1 is set in the first implementation. This is the same as the first imaging parameter according to the example. When calculating the shooting parameter PR _B2 , as in FIG. 6B, a region 101 focused on the face F1 is defined on the image as shown in FIG. 15B, and the shooting parameter PR _B2 is set in the first embodiment. This is the same as the second imaging parameter.

When the shooting parameter PR _B3 is calculated, areas 101 and 102 are defined as shown in FIG. The shooting parameter PR _B3 is calculated by the same method as the third shooting parameter according to the first embodiment, but unlike the third shooting parameter, the region 103 is not defined (see FIG. 6C). The total area of the areas 101 and 102 is handled as a focus detection area and a brightness evaluation area for calculating the shooting parameters.

When calculating the shooting parameter PR _B4, the area 104 is defined as shown in FIG. 15D as in FIG. 6D, and the shooting parameter PR _B4 is the same as the fourth shooting parameter according to the first embodiment. It is calculated by the method.

When the bracket shooting instruction is given, each bracket image (a total of four bracket images) according to the shooting parameters PR _B1 , PR _B2 , PR _B3, and PR _B4 is continuously shot.

As understood from the description with reference to FIGS. 6 and 15, when there are a plurality of faces included in the captured image,
Shooting parameters (PR _B1 etc.) focusing on the face located at the center of a plurality of faces,
Shooting parameters (PR _B2 etc.) focusing on the largest face,
Shooting parameters (PR _B3 etc.) focusing on all of the faces,
Shooting parameters (PR _B4, etc.) focusing on the entire predetermined area including the background,
Is generated. Even if there are four or more faces included in the photographed image, a plurality of photographing parameters are generated by the same method as described above, and a plurality of bracket images with a plurality of photographing parameters are continuously photographed in accordance with a bracket photographing execution instruction.

<< Deformation, etc. >>
As modifications or annotations of the above-described embodiment, notes 1 to 5 are described below. The contents described in each comment can be arbitrarily combined as long as there is no contradiction.

[Note 1]
In the above-described embodiment, the position of the focus lens 31 is controlled based on the video signal of the captured image. However, the distance measuring sensor (for measuring the distance between the subject in the focus detection area and the imaging device 1). (Not shown) may be mounted on the imaging apparatus 1 and the position of the focus lens 31 may be controlled based on the measurement result of the distance measuring sensor.

In this case, each imaging parameter is calculated with reference to the measurement result of the distance measuring sensor. For example, when the position P ₁ corresponding to FIG. 6A of the first embodiment is calculated, an optical image of the subject that falls within the region 102 is formed on the image sensor 33 based on the measurement result of the distance measuring sensor. The position of the focus lens 31 to be imaged is calculated, and this position may be set as the position P ₁ .

[Note 2]
In the above-described embodiment, a face is detected from a captured image and each shooting parameter is calculated based on information about the face. However, an object detected from the captured image is other than a face. May be. For example, the detected object may be the upper body of a person including the face or the whole body of the person.

  Various methods are known as a method for detecting the upper body of a person or the whole body of a person from a photographed image, and any method can be employed in the present invention. The upper body of the person and the whole body of the person may be detected using the face detection and based on the face, or may be detected from the contour of the object (person's silhouette) in the captured image.

[Note 3]
In addition, the specific numerical values shown in the above description are merely examples, and can naturally be changed to various numerical values.

[Note 4]
In addition, the imaging apparatus 1 in FIG. 1 can be realized by hardware or a combination of hardware and software. In particular, the arithmetic processing necessary for performing the bracket photographing can be realized by software or a combination of hardware and software.

  When the imaging apparatus 1 is configured using software, a block diagram of a part realized by software represents a functional block diagram of the part. In addition, all or part of the arithmetic processing necessary for performing the bracket shooting is described as a program, and the program is executed on a program execution device (for example, a computer), whereby all or part of the arithmetic processing is performed. May be realized.

[Note 5]
The face detection unit 14 in FIG. 1 functions as an object detection unit that detects a predetermined type of object from a captured image. The face detection unit 14 detects a human face as a predetermined type of object. As described above, the predetermined type of object detected by the object detection unit may be other than the face, or the upper body of the person or the whole body of the person.

  In the above-described embodiment, the parameter generating means for generating each shooting parameter and the file name changing means for changing the file name assigned to each bracket image are realized by the control unit 13 in FIG. In the embodiment described above, the instruction receiving means for receiving the ordering instruction described above is realized by the operation unit 17 in FIG.

  In the above-described embodiment, the part composed of the control unit 13 and the display unit 15 also functions as an image reproduction device. It can be considered that the image reproducing apparatus includes the recording medium 16 and / or the operation unit 17.

  In addition, the function of the image reproducing device formed by the components of the imaging device 1 can be realized by another device (for example, a computer) having an equivalent function. In this case, the other device functions as an image reproducing device.

1 is an overall block diagram of an imaging apparatus according to an embodiment of the present invention. It is an internal block diagram of the imaging part of FIG. FIG. 2 is an internal block diagram of an AF evaluation value detection unit provided in the control unit of FIG. 1. FIG. 6 is a diagram illustrating a captured image including three faces as subjects according to the first embodiment of the present invention. It is a figure which shows the center position of each face area | region contained in the picked-up image of FIG. FIG. 5 is a diagram for explaining a method of calculating four shooting parameters for the shot image of FIG. 4. It is a figure which shows the display state of four bracket images image | photographed corresponding to the captured image of FIG. It is a figure which shows a mode that the display position of four bracket images shown in FIG. 7 is changed by operation with respect to the operation part 17 of FIG. It is a flowchart showing the operation | movement procedure of bracket imaging | photography implement | achieved with the imaging device of FIG. It is a figure which shows the mode of a division | segmentation of all the display areas in the case of displaying a some thumbnail image on the display part of FIG. It is a figure which shows the mode of the display screen which displayed the some thumbnail image on the display part of FIG. It is a figure concerning the 2nd Example of the present invention and represents the picked-up image containing one face as a to-be-photographed object. It is a figure for demonstrating the calculation method of two imaging | photography parameters with respect to the imaging | photography image of FIG. It is a figure concerning the 3rd Example of the present invention and represents the picked-up image containing two faces as a photographic subject. It is a figure for demonstrating the calculation method of four imaging | photography parameters with respect to the imaging | photography image of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 11 Imaging part 12 AFE
DESCRIPTION OF SYMBOLS 13 Control part 14 Face detection part 15 Display part 16 Recording medium 17 Operation part 17a Shutter button 21 AF evaluation value detection part 22 AE evaluation value detection part 30 Zoom lens 31 Focus lens 32 Diaphragm 33 Image sensor

Claims (9)

An object detection means for detecting a predetermined type of object from a photographed image obtained by photographing by the imaging means;
Parameter generating means for generating a plurality of shooting parameters representing shooting conditions based on information about the object on the shot image;
When a predetermined shooting instruction for performing special shooting is given, a plurality of shooting images based on the plurality of shooting parameters are converted into a plurality of bracket images by sequentially performing shooting by applying each shooting parameter generated in advance. An imaging device ,
An instruction receiving means for receiving an ordering instruction for ordering the plurality of bracket images;
The application order of the plurality of shooting parameters for the special shooting after the next time is set in consideration of the ordering instruction.
An imaging apparatus characterized by that. The imaging apparatus according to claim 1, wherein the information specifies a position of the object on the captured image. The imaging apparatus according to claim 2, wherein the information specifies at least one of a size and a number of the objects on the captured image. Storage means for storing each bracket image with a file name;
The file name changing means for changing the file name associated with each bracket image based on the order between the plurality of bracket images in accordance with the ordering instruction. Item 4. The imaging device according to any one of Items 3 to 3. Each shooting parameter specifies a position of a focus lens for forming an optical image of a subject including the object on an imaging element of the imaging unit,
The application order of the plurality of shooting parameters is set in consideration of the same change direction of the focus lens position during shooting of the plurality of bracket images.
The imaging apparatus according to any one of claims 1 to 4 , wherein the imaging apparatus is characterized in that Each shooting parameter specifies the aperture of the diaphragm that controls the amount of light incident on the imaging device of the imaging means,
The application order of the plurality of shooting parameters is set in consideration of the same change direction of the opening during the shooting of the plurality of bracket images.
The imaging device according to any one of claims 1 to 5 , wherein The object includes a human face
The imaging apparatus according to any one of claims 1 to 6 , wherein Display means capable of displaying a captured image obtained by the imaging device according to any one of claims 1 to 7;
Display control means for controlling the display content of the display means,
The display control unit selectively displays a representative image from the plurality of bracket images when displaying an image corresponding to the special shooting by the imaging device on the display unit, and displays corresponding to the special shooting. Display the representative image in the area
An image reproducing apparatus characterized by that. The representative image displayed in the display area is switched automatically among the plurality of bracket images according to time or according to a switching instruction from the outside.
The image reproducing apparatus according to claim 8, wherein:

Images