JP2009212804A - Imaging apparats with composition assisting function, and composition assisting method of the same imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus with a composition assisting function that estimates an angle of field of photography for a suitable composition taking into consideration not only a subject within a range of a current angle of field of photography, but also a peripheral subject to estimate the suitable composition with high precision, and to provide a composition assisting method of the same imaging apparatus. <P>SOLUTION: When a photograph is taken by a digital camera and a user selects a composition assist mode, a zoom of a taking lens is driven toward a wide-angle side (wide side) to move to a wide end (step S100). Then an imaging element and an image shake correcting lens are shifted in a plane orthogonal to an optical axis to photograph a preview image, and image information of a field angle range larger than when the zoom is set to the wide end is captured (step S102). Then a reference composition is determined based upon the image information (step S108), and a process of assisting in changing the angle of field of photography so as to obtain a suitable composition is performed based upon the reference composition (step S110). <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image pickup apparatus with a composition assist function and a composition assist method in the image pickup apparatus, and in particular, an image pickup apparatus with a composition assist function that allows a user to more easily take an image with an optimal composition, and composition assist in the image pickup apparatus. Regarding the method.

  When shooting with an imaging device such as a digital camera, it is not easy for a general user to determine a stable and good composition. For this reason, various methods for assisting the determination of the composition have been proposed as disclosed in Patent Documents 1 to 10, for example.

  In Patent Document 1, an image of a reference composition is captured in advance, and the image is superimposed on a preview image (a real-time image that is currently captured) to easily display an image having the same composition as the reference composition. It has been proposed to be able to shoot. This method is useful, for example, when requesting photographing with a composition desired by oneself.

  Japanese Patent Application Laid-Open No. 2004-228561 proposes detecting a photographer's line of sight and automatically changing the shooting angle of view so that the line of sight becomes the center of the shooting angle of view.

  Japanese Patent Application Laid-Open No. 2004-133830 proposes detecting voice information of a subject and guiding the change of the camera direction (angle of view) by voice guidance so that the detected face position is a predetermined position.

  In Patent Document 4, the camera is placed on a pan head with a pan / tilt drive mechanism, and the shooting angle of view (camera shooting direction) is automatically changed so that the composition of the image shot by the camera is good. It has been proposed to do.

  In Patent Document 5, it is proposed to indicate and display the position where the main subject should be present so as to obtain a predetermined composition.

  In Patent Document 6, it is automatically determined that the subject's face is in a specific direction, or the framing is automatically performed so that the subject has a desired composition, and an image with a suitable composition is automatically captured. It has been proposed to do.

  In Patent Document 7, it is proposed that when a moving subject is photographed, the subject motion is predicted and the subject is photographed under a desired photographing condition.

  In Patent Document 8, it is proposed to determine whether or not a composition of a captured image matches an inappropriate composition pattern, and to display advice information for making an optimal composition if they match. .

  Patent Document 9 proposes that face detection is performed from a captured image, and an image in a range having an optimal composition is cut out according to the result to change the image size.

Patent Document 10 proposes to cut out and record an image in a range designated by a user or a range determined as an ideal composition in a captured image.
JP-A-8-294025 JP-A-8-262519 JP-A-9-261526 JP 2006-191524 A JP 2006-186413 A JP 2001-148843 A JP 2007-6325 A Japanese Patent Laid-Open No. 2006-1000093 JP 2007-27971 A JP 2007-6165 A

  In the past, when determining the optimal composition, only the subject within the current field of view was considered, but if the field of view is changed, the area around the current field of view or outside the field of view is out of range. Since the subject may greatly affect the quality determination of the composition, the optimal composition may not be obtained at the changed shooting angle of view. In order to determine the optimum composition, in Patent Documents 1, 4, and 8, a recorded image that has been taken and recorded once is referred to. There was a problem such as having to take a picture and missing a photo opportunity.

  Further, in the case of extracting an image in a range having an optimum composition from a recorded image taken as in Patent Documents 9 and 10, as a result, a subject outside the range of the angle of view is also taken into account. This is undesirable because the number of pixels decreases and the image quality deteriorates.

  The present invention has been made in view of such circumstances, and can estimate a shooting angle of view with an optimal composition in consideration of not only a subject within the range of the current shooting angle of view but also surrounding subjects. An object of the present invention is to provide an imaging apparatus with a composition assist function capable of estimating an optimal composition with accuracy, and a composition assist method in the imaging apparatus.

  In order to achieve the above object, an imaging apparatus with a composition assist function according to a first aspect of the present invention includes an imaging unit that captures an image of a subject formed by an optical system, and one frame for recording and storing the image on a recording medium. A recording processing unit that captures a recorded image from the imaging unit and records the recorded image on the recording medium; a preview image capturing unit that captures a preview image that is not recorded and stored in the recording medium from the imaging unit; An angle-of-view changing unit that changes the angle of view of the image capturing apparatus without changing the attitude of the apparatus body, and an image that is captured by the angle-of-view changing unit before the recording processing unit captures the recorded image from the imaging unit and records it on the recording medium By changing the angle of view and capturing the preview image by the preview image capturing means, at least the shooting angle of view is determined by the angle of view changing means. An optimal composition detection means for acquiring an image of a subject having a wider angle of view than the initial shooting angle of view before the update, and detecting an optimal composition based on the acquired image of the subject having a wide angle of view; Before the recorded image is captured from the imaging unit by the recording processing unit and recorded on the recording medium, the preview image captured by the preview image capturing unit becomes the optimal composition detected by the optimal composition detecting unit. And a composition assisting means for assisting the user in changing the shooting angle of view.

  According to the present invention, it is possible to estimate a shooting angle of view with an optimum composition considering not only a subject within the range of the current shooting angle of view but also surrounding subjects, and it is possible to estimate an optimum composition with high accuracy. It becomes.

  An imaging apparatus with a composition assist function according to a second aspect is the invention according to the first aspect, wherein the field angle changing means changes a position of a predetermined movable lens arranged in the optical system, or A shooting direction is changed by changing a position of a region where an image is effectively captured by the imaging unit with respect to a subject image formed by the optical system, and a shooting angle of view is changed by changing the shooting direction. It is said.

  The present invention clearly shows that an angle-of-view changing unit that changes the shooting direction without changing the posture of the imaging apparatus main body is provided.

  An imaging apparatus with a composition assist function according to a third aspect is the invention according to the second aspect, wherein the angle-of-view changing unit changes the imaging angle of view so as to cancel image blur caused by vibration applied to the imaging apparatus main body. The image blur correction function is also used as an angle of view changing means for canceling image blur.

  The present invention shows an aspect in which a composition assist function is realized by using an angle-of-view changing unit used in an image blur correction function.

  An imaging apparatus with a composition assist function according to a fourth aspect is the invention according to the first, second, or third aspect, wherein the angle-of-view changing unit changes a position of a predetermined movable lens arranged in the optical system. Or by changing the size of the area that is effectively imaged by the imaging unit with respect to the subject image formed by the optical system. It is characterized by changing the shooting angle of view according to the size of the image.

  The present invention shows a mode in which the shooting angle of view is changed by changing the size of the shooting angle of view.

  According to a fifth aspect of the present invention, there is provided a composition assist method in an imaging apparatus with a composition assist function, the image pickup means for picking up an image of a subject imaged by an optical system, and a recorded image for one frame for recording and saving on a recording medium. Recording processing means for performing processing for capturing from the imaging means and recording the recorded image on the recording medium, preview image capturing means for capturing a preview image that is not recorded and stored in the recording medium from the imaging means, and attitude of the imaging apparatus main body A composition assist method in an imaging apparatus with a composition assist function, which includes a field angle change unit that changes a shooting field angle without changing the image, and the recording medium captures a recorded image from the imaging unit and the recording medium Before recording, the image angle of view is changed by the angle of view changing means, and the preview image is taken in by the preview image capturing means. Is acquired, at least, an image of a subject having a field angle range wider than the initial shooting field angle before changing the field angle of view by the field angle changing unit is acquired, and the acquired subject having a wide field angle range is acquired. An optimum composition detecting step for detecting an optimum composition based on an image; and the preview captured by the preview image capturing means before the recording processing means captures a recorded image from the imaging means and records it on the recording medium. A composition assisting step for changing the shooting angle of view so that the image has the optimum composition detected by the optimum composition detection step or assisting the user to change the shooting angle of view. .

  According to a sixth aspect of the present invention, in the composition assisting method in the imaging device with a composition assisting function according to the fifth aspect, the angle of view changing means changes a position of a predetermined movable lens arranged in the optical system. Or by changing the shooting direction by changing the position of the area effectively imaged by the imaging means with respect to the subject image formed by the optical system, and changing the shooting angle of view by changing the shooting direction. It is characterized by doing.

  According to a seventh aspect of the present invention, there is provided a composition assist method for an imaging apparatus with a composition assist function according to the sixth aspect, wherein the angle-of-view changing unit is configured to cancel image blur caused by vibration applied to the imaging apparatus main body. The image blur correction function for changing the angle of view also serves as an angle of view changing means for canceling out the image blur.

  The composition assisting method in the imaging apparatus with a composition assisting function according to claim 8 is the invention according to claim 5, 6 or 7, wherein the angle of view changing means is a predetermined movable lens disposed in the optical system. Or changing the size of the field angle of view by changing the size of the area that is effectively imaged by the imaging means for the subject image formed by the optical system, It is characterized in that the shooting angle of view is changed according to the size of the shooting angle of view.

  Each of the inventions according to claims 5 to 8 is a method invention corresponding to the photographing apparatus according to claims 1 to 4.

  According to the present invention, it is possible to estimate a shooting angle of view with an optimum composition considering not only a subject within the range of the current shooting angle of view but also surrounding subjects, and it is possible to estimate an optimum composition with high accuracy. It becomes.

  DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an imaging apparatus with a composition assist function according to the present invention and a best mode for carrying out a composition assist method in the imaging apparatus will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing a configuration of a first embodiment of a digital camera to which the present invention is applied.

  First, the basic components of a digital camera will be described. In FIG. 1, when light from a subject enters a photographing lens 1 provided on the front side of the camera body, the photographing surface of the image sensor 2 ( A subject image is formed on the light receiving surface. Although not shown in the figure, the photographing lens 1 is composed of a plurality of optical components such as a movable focus lens group for focus adjustment, a movable zoom lens group for zoom adjustment, and a diaphragm for brightness adjustment. Components of the control system that drives and controls them are also omitted.

  When the camera is turned on and ready for photographing (photographing standby state), a preview image (not recorded and saved) is displayed on a liquid crystal monitor (a component included in the display means 8 in the figure) provided on the back side of the camera body. The real-time image currently being captured) is displayed. At this time, the subject image formed by the photographing lens 1 is sequentially photoelectrically converted by the image pickup device 2, and an electric signal that has been sequentially photoelectrically converted is output from the image pickup device 2 as an image pickup signal.

  The imaging signal output from the imaging device 2 is taken into the AFE circuit 3 and subjected to necessary analog processing such as CDS processing and AGC processing by the AFE circuit 3, and then converted into image data of a digital signal.

  The image data output from the AFE circuit 3 is subsequently taken into the signal processing unit 4 and subjected to necessary image processing such as white balance correction, gamma correction, and contour correction.

  The image data subjected to the image processing by the signal processing means 4 in this way is given to the display means 8, and a preview image (moving image) is displayed on the liquid crystal monitor provided on the back side of the camera body by the processing in the display means 8. Is displayed.

  Also, when a shooting instruction is given by the user fully pressing the shooting button (shutter button) or the like, one frame of recorded image to be recorded and saved in a memory (non-volatile memory such as a memory card) (not shown) is captured. In the same manner as the preview image, the photographing lens 1, the image sensor 2, the AFE circuit 3, and the signal processing means 4 perform the processing, and the image data is recorded in the memory.

  On the other hand, the digital camera of the present embodiment is equipped with a composition assist function, and composition estimation means 6, composition comparison means 7, face information detection means 10, motion detection means are provided as components for the composition assist function. 11, automatic photographing means 12 and warning report means 13 are provided. The composition assist function based on these components will be described with reference to the flowchart of FIG.

  When the camera is turned on (step S10), a preview image is displayed on the liquid crystal monitor by the display means 8 as described above (step S12).

  Subsequently, the current composition of the preview image is estimated (step S14). The composition estimation will be described. Image data captured as a preview image as described above is provided from the signal processing means 4 to the face information detection means 10, and the face information detection means 10 detects the person from the image data. The face image (face image) is detected. Then, together with the image data of the preview image, face image data indicating the position and size (contour) of the detected face image is given to the composition estimation means 6.

  The composition estimation means 6 estimates the current composition indicating the arrangement of the human face and other materials (components of the subject) included in the image based on the image data and the face image data of the preview image. It should be noted that any means and method may be used for composition estimation, and any conventionally known method may be used.

  When the composition estimation unit 6 estimates the current composition of the preview image, the composition comparison unit 7 compares the composition data indicating the composition with the composition example data registered in advance as the composition example data 5. Is called. That is, the composition example data (database) 5 stores composition example data indicating composition examples of various forms in advance, and the current composition and each composition example are compared. Then, it is determined whether or not there is a composition example to be referred to similar to the current composition in the composition example data 5 (step S16).

  If NO in step S16, that is, if it is determined that there is no composition example to be referred to, the user presses the shooting button pressing operation (shooting instruction) without performing composition assist, and if there is a pressing operation ( In step S18), one frame of recorded image is captured (photographed) and the recorded image is recorded in the memory (step S20).

  On the other hand, if YES in step S16, that is, if it is determined that there is a composition example to be referred to, image data for drawing the reference composition is displayed as a reference composition that is most similar to the current composition. Provided to means 8. Then, the display unit 8 displays the reference composition image superimposed on the preview image on the liquid crystal monitor (step S22).

  Here, FIG. 3 shows a state in which the image of the reference composition is superimposed on the preview image on the liquid crystal monitor. According to this, if a preview image as shown in FIG. 5A is taken, an image of a reference composition indicated by a dotted line is superimposed on a preview image indicated by a solid line as shown in FIG. Displayed. With this display, the user can change the shooting angle of view so that the composition of the preview image matches the reference composition.

  In the present specification, the change of at least one of the size and the shooting direction of the shooting angle of view itself is referred to as a change of the shooting angle of view. When the user changes the shooting angle of view, for example, a zoom operation can be performed to change the focal length of the taking lens 1 (or the zoom magnification by electronic zoom) and the camera body can be moved to change the shooting direction. Thus, the composition of the preview image can be matched with the reference composition by changing the shooting angle of view.

  When the process of step S22 is completed, the composition comparison means 7 calculates a difference between the reference composition and the preview image (the current composition of the preview image) (step S24). The difference obtained by the difference calculation means a deviation amount between the reference composition and the current composition of the preview image, and the calculation is not limited to a specific method.

  When the difference calculation is performed, subsequently, the composition comparison unit 7 determines whether or not the difference is equal to or less than a predetermined threshold value determined in advance (step S26). If NO is determined in step S26, the warning reporting unit 13 reports a warning to the user that the current composition is not appropriate (step S28), and then returns to step S24. This warning prompts the user to change the shooting angle of view in order to obtain an optimal composition. The warning may be any method such as warning display on a liquid crystal monitor, warning sound, or lighting of a predetermined warning lamp.

  If it is determined as YES in step S26, it is determined that the current composition is appropriate. Then, it is determined by the motion detection means 11 whether or not the amount of motion of the camera body (the amount of motion per predetermined time) is less than or equal to a predetermined threshold value determined in advance (step S30).

  Here, in the case of a digital camera equipped with an image blur correction function for preventing image blur due to camera shake or the like, the means (sensor) used in the image blur correction function is also used as the motion detection means 11. Is possible. The image blur correction function is installed in many digital cameras that are currently on the market, and the digital camera with such an image blur correction function has a vibration (change in the posture of the camera body). Direction and size), or a shake detection unit that detects the direction and size of image blur caused by the vibration, and a field angle change unit that changes the shooting field angle in order to cancel the image blur. As the shake detection means, for example, there are known ones that detect the change direction and size of the posture of the camera body using a gyro sensor, and those that detect the direction and size of the image shake by comparing preview images taken sequentially. Yes. As the angle of view changing means, for example, a movable image blur correction lens arranged in the optical system is moved in a direction perpendicular to the optical axis to change the photographing direction, or the image sensor is moved in a direction perpendicular to the optical axis. Or changing the shooting direction by changing the effective image capturing area on the imaging surface of the image sensor and changing the effective imaging area for the subject image formed by the optical system. It has been. Since the amount of motion of the camera body can be detected directly or indirectly by the shake detection means in such an image shake correction function, it can also be used as the motion detection means 11. Even when the shake detection unit of the image shake correction function is not used, any method adopted by the shake detection unit can be adopted by the motion detection unit 11 of the present embodiment.

  If NO in the determination process of step S30, that is, if it is determined that the amount of movement of the camera body is greater than the predetermined threshold, the process returns to step S26. On the other hand, if YES in step S30, that is, if it is determined that the amount of movement of the camera body is equal to or less than a predetermined threshold, the automatic photographing means 12 captures (shoots) a recorded image for one frame and the recorded image. Recording in the memory is executed (step S32). That is, in the case of a general digital camera, when the user depresses the shooting button (full pressing operation), the captured image for one frame and the recording process are performed by the instruction and control of the automatic shooting unit 12.

  In the determination process in step S30, for example, when the user moves the camera body so as to match the shooting angle of view with the reference composition, if shooting is automatically performed by the process in step S32, the recorded image is captured. Since blurring occurs, shooting is performed when the movement of the camera body becomes small in order to prevent such blurring. Therefore, the threshold value in the determination process in step S30 is set to a value that does not cause blurring in the captured image if the amount of movement of the camera body per predetermined time is equal to or less than the threshold value. That is, the threshold is set to a value that allows the camera body to be regarded as stationary. In addition, since the ease of image blurring varies depending on the focal length and shutter speed of the photographing lens 1, the threshold value may be changed depending on the focal length and shutter speed.

  When the process in step S32 or the process in step S20 is completed, it is subsequently determined whether or not the photographing is completed (step S34). Whether or not the photographing is finished is determined by whether or not a power-off operation is performed by the power switch. If it is determined NO, the process returns to step S12. If it is determined YES, the power is turned off and the shooting is finished (step S36).

  According to the composition assist function of the first embodiment described above, the current composition of the preview image substantially matches the reference composition (the current composition is the optimum composition), and the camera body is stationary. Since the recorded image is shot (captured and recorded) in a state that can be regarded as a photographic image, even if the preview image has the optimal composition, the shooting angle of view moves or is recorded by pressing the shooting button of the user. There is no problem such as blurring in the image, and it is possible to reliably shoot an image with an optimum composition and without blurring.

  In the above embodiment, the user does not need a special operation regarding the instruction to shoot the recorded image. However, unless the user performs an instruction to shoot by pressing the shoot button, no shooting is performed. You can also For example, in the flowchart described above, the process proceeds to step S26 or step S30 when a shooting instruction is issued by the user, and if the shooting instruction is not issued by the user, the automatic shooting of step S32 is performed. There is a possible mode that prevents this. Alternatively, it is also conceivable to execute the entire process of the flowchart when the user gives a shooting instruction. In such a mode, the preview image matches the reference composition (the preview image has the optimum composition) as a condition for taking (recording and recording) the recorded image, and the camera body is stationary. And that the user has performed a shooting instruction operation.

  Further, an element of focal length may be included in the amount of movement of the camera body in step S30 of the flowchart. That is, not only when the camera body itself moves and the shooting angle of view is changed, but also when the zoom operation is performed and the size of the shooting angle of view is changed, the recorded image is shot. You may make it not break.

  In the above-described embodiment, the aspect in which the composition of the preview image is matched with the reference composition (optimal composition) by the user changing the shooting angle of view is described. May be automatically changed to match the composition of the preview image with the reference composition.

  FIG. 4 is a block diagram showing the configuration of the second embodiment of the digital camera to which the present invention is applied. Components that perform the same or similar processing as in FIG. 1 are assigned the same reference numerals as those in FIG. 1, and descriptions thereof are omitted. FIG. 5 is a flowchart showing a processing procedure of the composition assist function of the second embodiment implemented by the digital camera of the second embodiment. Hereinafter, according to this flowchart, the process of the second embodiment will be described. The composition assist function will be described.

  When the camera is turned on (step S50), a preview image is displayed on the liquid crystal monitor by the display means 8 (step S52).

  Subsequently, it is determined whether or not the user has selected the composition assist mode (step S54). If it is determined NO, composition assistance is not performed, and the user presses the shooting button pressing operation (shooting instruction). If there is a pressing operation (step 56), one frame of recording is synchronized with this. Image capture (photographing) and recording of the recorded image in the memory are executed (step S58).

  If YES is determined in step S54, the composition to be referred to (reference composition) is determined by the reference composition determining means 20 (step S60). For the determination of the reference composition, a method similar to the composition assist function of the first embodiment shown in FIGS. 1 to 3 may be adopted (determined with reference to the composition example data 5) or in advance. A method of taking a photograph of the composition to be referred to and making it a reference composition may be adopted, and any method may be adopted.

  If the reference composition is determined in step S60, then the composition comparison means 7 performs a difference comparison (difference calculation) between the reference composition and the preview image (step S62). Then, it is determined whether or not the difference is equal to or less than a predetermined threshold value determined in advance (step S64).

  That is, it is determined whether or not the current composition of the preview image matches the reference composition.

  If NO is determined in step S64, the angle of view changing unit 9 changes the shooting angle of view from the initial shooting angle of view so that the difference between the reference composition and the current composition of the preview image is reduced (step S64). S66).

  Here, the change of the shooting angle of view by the angle of view changing means 9 indicates that the shooting direction and the size of the shooting angle of view are automatically changed without changing the posture of the camera body, and in the first embodiment. As described above, in the case of a digital camera equipped with an image blur correction function, the angle of view changing means used in the image blur correction function can also be used. That is, a digital camera equipped with an image blur correction function includes a field angle changing unit that changes a shooting field angle (shooting direction) without changing the posture of the camera body in order to cancel the image blur. For example, as the field angle changing means, an image blur correction lens arranged in the optical system is moved in a direction perpendicular to the optical axis to change the shooting direction, or an object image formed by the optical system is changed. Shooting by changing the position of the area that is effectively imaged by the image sensor, that is, moving the image sensor in the direction orthogonal to the optical axis, or moving the range for effectively capturing the subject image on the imaging surface of the image sensor Something that changes direction is known. As the angle-of-view changing means 9 in the present embodiment, the angle-of-view changing means of such an image blur correction function can also be used. In addition, an arbitrary method for changing the photographing direction employed in the field angle changing unit of the image blur correction function even when the field angle changing unit of the image blur correction function is not used is also used in the present embodiment. 9 can be applied to change of the shooting direction.

  Further, when it is necessary to change the size of the shooting angle of view in order to make the reference composition match the current composition of the preview image, the focal length of the shooting lens 1 is changed by the angle-of-view changing means 9. However, as a means for changing the size of the shooting angle of view, an electronic zoom that changes the size of the imaging range in which an image is effectively captured from the imaging surface of the imaging device 2 may be used.

  FIG. 6 shows a preview image displayed on the liquid crystal monitor at this time. First, it is assumed that an image as shown in FIG. 5A is taken and displayed on the liquid crystal monitor as a preview image. At this time, for example, the image sensor 2 is shifted from a predetermined reference position in a direction perpendicular to the optical axis by the angle-of-view changing means 9 so that the difference between the reference composition and the composition of the preview image becomes small. Is changed, and the shooting angle of view is sequentially changed by a predetermined angle of view as shown in FIGS.

  Subsequently, when a certain period of time has elapsed after the processing of step S66 is started, or when a predetermined time (including time 0) has elapsed since the composition of the preview image matches the reference composition by the processing of step S66. Angle of view. The initial state before the change is returned (step S68), and the process returns to step S62. When the shooting direction is changed in step S66, the camera is returned to the reference shooting direction determined in advance in principle (when the image pickup device 2 is shifted, the image pickup device 2 is returned to the reference position). . When the size of the shooting angle of view is changed in step S66, the size of the shooting angle of view set by the final zoom operation performed by the user is the size of the initial shooting angle of view before the change, The shooting angle of view is returned to that size.

  Through the processing in steps S66 and S68, the user can know the direction of change of the shooting angle of view for obtaining the optimum composition, and the user moves the camera body or zooms with reference to this. The angle of view can be changed so that an optimal composition can be obtained by performing the operation.

  Note that when the shooting angle of view is changed by the process of step S66, the user may be notified that the shooting angle of view has been temporarily changed by the composition assist function. For example, any method may be used, such as a display (characters, graphics, etc.) for notifying that effect on the liquid crystal monitor, or a change in the display form of the preview image itself (flashing display, etc.).

  On the other hand, if YES in step S64, that is, if the current composition of the preview image at the shooting angle of view set by the user matches the reference composition, the user presses the shooting button (shooting instruction). If there is a pressing operation in step S70), the recording image for one frame is captured (photographed) and the recording of the recorded image in the memory is executed in synchronization with this (step S58).

  When step S58 is finished, it is determined whether or not the photographing is finished (step S72). Whether or not the photographing is finished is determined by whether or not a power-off operation has been performed by the power switch. If it is determined NO, the process returns to step S52. If it is determined as YES, the power is turned off to end the shooting (step S74).

  According to the composition assist function of the second embodiment described above, the change direction of the shooting angle of view for achieving the optimum composition is indicated without displaying the reference composition superimposed on the preview image. There is no problem that the performance decreases. In addition, since the preview image at the shooting angle of view set by the user and the preview image at the target shooting angle of view that gives the optimum composition are displayed on the liquid crystal monitor, the shooting angle of view that gives the optimum composition for the user is displayed. Setting is easy. Furthermore, since the recorded image can be taken only when the optimum composition is obtained at the photographing angle of view set by the user, the recorded image with the optimum composition can be reliably taken.

  In the above-described embodiment, the composition at the shooting angle of view set by the user is the optimum composition, and when a determination is made as YES in the determination process in step S64, and the user issues a shooting instruction, the captured image is captured. The recording process (step S58) is performed. However, if the determination process in step S64 determines YES, the recorded image is automatically captured and recorded without waiting for a shooting instruction from the user. Also good. Similarly to the composition assist function of the first embodiment, the fact that the amount of movement of the camera body is equal to or less than a predetermined threshold may be added as a condition for capturing and recording a recorded image.

  In the above embodiment, in step S66, the angle of view changing means 9 gradually changes the shooting angle of view by a predetermined angle of view so that the reference composition matches the composition of the preview image. The reference composition and the composition of the preview image may be made to coincide with each other by changing the shooting angle of view by the angle of view changing means 9 once.

  FIG. 7 is a block diagram showing a configuration of a third embodiment of a digital camera to which the present invention is applied, and FIG. 8 shows a third embodiment implemented in the digital camera of the third embodiment. It is the flowchart which showed the process sequence of the composition assistance function of embodiment. 7, components that perform the same or similar processing as in FIG. 1 or FIG. 4 are assigned the same reference numerals as in FIG. 1 or FIG. 4, and descriptions of those components are omitted. In FIG. 8, steps having the same or similar processing contents as those in the flowchart of FIG. 5 showing the processing procedure of the composition assist function of the second embodiment are denoted by the same reference numerals as in FIG. The composition assist function of the third embodiment will be described below with reference to the flowchart of FIG.

  In the composition assist function according to the second embodiment, since the recorded image cannot be taken unless the composition at the shooting angle of view set by the user matches the reference composition, the reference composition is different from the composition desired by the user. If you have a problem.

  One way to solve this is to turn off the composition assist mode. However, since the mode change generally involves a predetermined operation, it may be time-consuming and miss a photo opportunity.

  Therefore, in the composition assist function of the third embodiment, the composition assist function is disabled (the composition assist function is stopped) without requiring such a mode change operation, and a photographed image having a composition different from the reference composition is obtained. It enables shooting at the corner.

  In the flowchart of FIG. 8 showing the processing procedure of the composition assist function of the third embodiment, step S66 and step are compared with the flowchart of FIG. 5 showing the processing procedure of the composition assistance function of the second embodiment. Steps S80 and S82 are added during S68. The processing in steps S80 and S82 will be described. First, in step S66, the view angle changing unit 9 changes the shooting angle of view so that the difference between the reference composition and the preview image (composition of the preview image) is reduced. In step S80, the composition rejection determination unit 22 determines whether the user has changed the shooting angle of view to increase the difference between the reference composition and the preview image. That is, it is determined whether or not the user has changed the shooting direction of the camera body or performed a zoom operation (change of the size of the shooting angle of view) so that the difference from the reference composition becomes large. For example, if the difference between the reference composition and the composition of the current preview image is sequentially calculated by the composition comparison means 7 together with the change of the photographing angle of view by the angle of view changing means 9, and the difference becomes larger than the previous time (or the previous difference) If it is larger than a predetermined value), it is determined that the user has changed the shooting angle of view to increase the difference between the reference composition and the preview image, and YES is determined in the determination process of step S80.

  If NO is determined in the determination process in step S80, the composition assist function is not disabled, and the process proceeds to step S68 in order to perform the same process as in the second embodiment.

  On the other hand, if YES is determined in the determination process of step S80, the shooting angle of view changed by the view angle changing unit 9 is returned to the initial shooting angle of view before the change (step S82). Then, the composition assist function is disabled by proceeding to the process of step S70.

  FIG. 9 shows a preview image displayed on the liquid crystal monitor. First, it is assumed that an image as shown in FIG. 5A is taken and displayed on the liquid crystal monitor as a preview image. At this time, when, for example, the shooting direction is changed by the angle-of-view changing means 9 so that the difference between the reference composition and the preview image becomes small, the composition of the preview image is changed as shown in FIG. On the other hand, if the user moves the camera body and performs an operation such as returning to the initial preview image composition (FIG. 3A), for example, the composition assist function becomes invalid. .

  After the process of step S82, when the process proceeds to step S70, the user presses the shooting button pressing operation (shooting instruction), and if there is a pressing operation, the recording image for one frame is captured (shooting) in synchronization therewith. Then, the recorded image is recorded in the memory (step S58). At this time, if the user sets the shooting angle of view so as to obtain the composition desired by the user and then presses the photographing button, the recorded image of the composition desired by the user can be photographed.

  According to the composition assist function of the third embodiment described above, the user can intuitively and easily stop the composition assist function when the optimum composition suggested by the composition assist function is not the composition that the user wants to shoot. Can do.

  Note that other applicable embodiments described in the composition assist function of the second embodiment can also be applied to the third embodiment.

  Further, in the above embodiment, when it is determined that the user has performed an operation for changing the shooting angle of view so as to increase the difference between the reference composition and the composition of the preview image during the change of the shooting angle of view by the composition assist function. In step S80, the composition assist function is stopped. However, the determination conditions in step S80 are more limited, for example, in a direction opposite to the direction in which the difference between the reference composition and the composition of the preview image becomes smaller. When the user changes the shooting angle of view, that is, with respect to the shooting direction, the user changes the shooting direction in a direction opposite to the direction matching the reference composition (opposite in the horizontal direction and / or vertical direction). Concerning the size of the corner (zoom), if the zoom is operated in the opposite direction to the zoom direction (wide or tele direction) that matches the reference composition, the composition assist The ability may be stopped.

  FIG. 10 is a block diagram showing a configuration of a fourth embodiment of a digital camera to which the present invention is applied, and FIG. 11 shows a fourth embodiment implemented by the digital camera of the fourth embodiment. It is the flowchart which showed the process sequence of the composition assistance function of embodiment. 10, components that perform the same or similar processing as in FIG. 1, FIG. 4, or FIG. 7 are assigned the same reference numerals as in FIG. 1, FIG. 4, or FIG. Is omitted. In FIG. 11, processes having the same or similar processing contents as those in the flowchart of FIG. 5 showing the processing procedure of the composition assist function of the second embodiment are denoted by the same reference numerals as in FIG. 5. The composition assist function of the fourth embodiment will be described below with reference to the flowchart of FIG.

  In the composition assist function of the second embodiment, the automatic change of the shooting angle of view by the angle of view changing means 9 is temporarily performed for the user to change the shooting angle of view so as to obtain an optimum composition. Thus, when shooting a recorded image, the user needs to change the shooting angle of view so as to obtain an optimal composition.

  In the fourth embodiment, when the composition of the preview image at the photographing field angle (including the photographing field angle being changed) changed by the field angle changing unit 9 is the composition desired by the user, The recorded image can be taken as it is without changing the angle of view by itself.

  Therefore, in the flowchart of FIG. 11 showing the processing procedure of the composition assistance function of the fourth embodiment, step S66 is different from the flowchart of FIG. 5 showing the processing procedure of the composition assistance function of the second embodiment. Between step S68 and step S68, steps S90 and S92 are added. The processing in step S90 and step S92 will be described. First, in step S66, the field angle changing unit 9 changes the shooting angle of view so that the difference between the reference composition and the preview image (composition of the preview image) is reduced. In step S90, it is determined whether there is an instruction to hold the current composition by the user. For example, when the photographing button is pressed, it may be determined that an instruction to hold the composition has been performed, or any other operation button may be operated.

  If it is determined NO in step S90, the process proceeds to step S68 in order to perform the same processing as in the second embodiment.

  On the other hand, if it is determined as YES in step S90, the composition holding unit 23 performs processing for holding the current shooting angle of view changed by the view angle changing unit 9 (step S92). For example, when the imaging element 2 is shifted from the reference position by the angle-of-view changing unit 9 and the shooting direction is changed, the imaging element 2 is held at the current position. Then, the process proceeds to step S70.

  FIG. 12 shows a preview image displayed on the liquid crystal monitor. First, it is assumed that an image as shown in FIG. 5A is taken and displayed on the liquid crystal monitor as a preview image. At this time, when, for example, the shooting direction is changed by the angle-of-view changing means 9 so that the difference between the reference composition and the preview image becomes small, the composition of the preview image is changed as shown in FIG. On the other hand, when the user wants to shoot with the composition of the preview image with the shooting angle of view changed as shown in FIG. 5B, an instruction to hold the current shooting angle of view (composition) is given by a predetermined operation. If so, the change of the shooting angle of view by the angle of view changing means 9 is stopped, and a preview image having the same composition as the preview image of FIG. It is held as displayed on the monitor.

  After the processing of step S92, when the process proceeds to step S70, the user presses the shooting button pressing operation (shooting instruction), and if there is a pressing operation, the recording image for one frame is captured (shooting) in synchronization therewith. Then, the recorded image is recorded in the memory (step S58). At this time, shooting is performed with the shooting angle of view held in step S92, and the recorded image of the composition when the user instructs to hold the shooting angle of view (composition) is captured and recorded.

  According to the composition assist function of the fourth embodiment described above, the change in the shooting angle of view by the angle-of-view changing means 9 originally performed to assist the user in changing the shooting angle of view is being changed. When the composition of the shooting angle of view or the composition of the changed shooting angle of view is the composition that the user wants to shoot, the user can shoot a recorded image of the composition without changing the shooting angle of view by himself / herself.

  Note that other applicable embodiments described in the composition assist function of the second embodiment can also be applied to the fourth embodiment. Also, the function of holding the composition of the fourth embodiment can be incorporated into the third embodiment.

  Further, in the above embodiment, after the user performs an operation for instructing the holding of the shooting angle of view (composition), the recording image is captured and recorded by performing the operation for the shooting instruction. When an operation for instructing the holding of the corner is performed, the recorded image may be captured and recorded at the shooting angle of view. That is, when a predetermined instruction operation (operation of shooting instruction) is performed when a composition desired by the user is obtained while the shooting angle of view is changed by the angle of view changing means 9, a recorded image at the shooting angle of view at that time is obtained. Capture and recording may be performed.

  FIG. 13 is a block diagram showing a configuration of a fifth embodiment of a digital camera to which the present invention is applied, and FIG. 14 shows a fifth embodiment implemented by the digital camera of the fifth embodiment. It is the flowchart which showed the process sequence of the composition assistance function of embodiment. In FIG. 13, the same reference numerals as those in FIG. 1, FIG. 4, FIG. 7, or FIG. 10 are assigned to components that perform the same or similar processing as in FIG. 1, FIG. 4, FIG. . Further, in FIG. 14, the same reference numerals as those in FIG. 5 are attached to the steps having the same or similar processing contents as those in the flowchart of FIG. 5 showing the processing procedure of the composition assist function of the second embodiment. The composition assist function of the fifth embodiment will be described below with reference to the flowchart of FIG. The fifth embodiment shows an embodiment of processing performed when determining the reference composition as in the first to fourth embodiments, and is described below in step S100. ˜S106 has a feature.

  When the camera is turned on (step S50), a preview image is displayed on the liquid crystal monitor by the display means 8 (step S52).

  Subsequently, it is determined whether or not the user has selected the composition assist mode (step S54). If it is determined NO, composition assistance is not performed, and a user presses a shooting button pressing operation (shooting instruction). If there is a pressing operation, a recorded image for one frame is captured in synchronization ( Shooting) and recording of the recorded image in the memory is executed (step S59).

  If YES is determined in step S54, first, the angle of view angle is changed by the angle-of-view changing means 9 so that the maximum angle of view is set. Specifically, the zoom (zoom lens group) of the photographing lens 1 is driven to the wide angle side (wide side) and moves to the wide end (step S100). Thereby, when the zoom set by the user is not at the wide end, the shooting angle of view is enlarged more than the shooting angle of view set by the user.

  Next, a preview image is photographed while changing the photographing direction with respect to the reference photographing direction by the angle-of-view changing means 9, and image information in a larger angle of view range is taken than when zoom is set to the wide end. (Step S102). As a result, image information in the field angle range (current shooting field angle) when the zoom is set to the wide end and peripheral image information (peripheral information) are obtained. Here, when the change of the photographing direction by the angle-of-view changing means 9 is due to a mode in which the image pickup device 2 is shifted in a plane orthogonal to the optical axis, the image pickup device 2 is moved in each direction within the plane. The image of the maximum field angle range can be acquired by shifting the image to the maximum amount, but there is no need to shoot images of the same subject range in duplicate. Can be limited to several directions, and the shift amount for capturing an image in each limited direction can also be limited to several points.

  Further, as described in the second embodiment, the change of the photographing direction by the angle-of-view changing unit 9 can be performed by using the angle-of-view changing unit provided in the image blur correction function, Even if the angle-of-view changing function of the image shake correction function is not used, any method for changing the shooting direction employed in the angle-of-view changing means of the image shake correction function can be used. It can be employed in the means 9.

  When the image information in the current shooting angle of view and its peripheral information are acquired in step S102, the singular point is extracted from the information by the singular point detecting means 24 (step S104). For example, human face information and singular points such as boundaries of buildings and sky are detected.

  Next, based on the positional relationship between the extracted singular points, the reference composition determining means 20 searches the composition example data 5 for a composition example that matches the positional relationship (step S106). Then, it is determined whether or not there is a composition example (reference composition) corresponding to the search (step S108). If NO is determined, the process proceeds to step S59, and the recording image capturing (photographing) and recording processing according to the user's photographing instruction is performed as described above.

  On the other hand, if the determination is YES, composition assist processing using the reference composition as shown in the first to fourth embodiments is performed (step S110). Although the description of the composition assist process in step S110 is omitted, the present invention is not limited to the composition assist process described in the first to fourth embodiments, and an arbitrary aspect can be applied.

  When the process of step S59 or step S110 is completed, it is determined whether or not the photographing is finished (step S72). Whether or not the photographing is finished is determined by whether or not a power-off operation has been performed by the power switch. If it is determined NO, the process returns to step S52. If it is determined as YES, the power is turned off to end the shooting (step S74).

  FIG. 15 shows the flow of the above-described processing by the composition assist function of the fifth embodiment in the form of acquired image information. First, it is assumed that a preview image at a shooting angle of view set by the user is obtained as shown in FIG. On the other hand, when the processing of step S100 and step S102 is performed, image information in a range wider than the shooting angle of view set by the user is obtained as shown in FIG. A reference composition (optimal composition) is determined based on the image information in FIG. 10B by the processing in steps S104 and S106, and the corresponding shooting angle of view is a rectangular frame with a dotted line in FIG. Is set as shown in. Accordingly, when the user changes the shooting angle of view, or when the shooting angle of view is automatically changed, the shooting angle of view is set to an optimum composition as shown in FIG.

  According to the composition assist function of the fifth embodiment described above, the optimal composition is determined based on the image information in a wider field angle range than the shooting field angle set by the user, so the optimal composition with higher accuracy. Can assist and assist.

  Further, since the recorded image having the optimum composition is not generated by trimming the recorded image already recorded in the memory, useless memory is not used, and image quality deterioration due to trimming does not occur.

  In the above-described embodiment, image information in a wider field angle range than the shooting field angle set by the user is obtained by both changing the size of the shooting field angle and changing the shooting direction. If the zoom set at is not at or near the wide end, image information in a wider field of view than the shooting angle set by the user may be obtained only by changing the size of the shooting angle of view. Regardless of the position of the image, the image information in the range of field of view wider than the field of view set by the user may be obtained only by changing the shooting direction.

The block diagram which showed the structure of 1st Embodiment of the digital camera to which this invention is applied. The flowchart which showed the process sequence of the composition assistance function of 1st Embodiment implemented with the digital camera of 1st Embodiment. Explanatory drawing used to explain the composition assist function of the first embodiment The block diagram which showed the structure of 2nd Embodiment of the digital camera to which this invention is applied. The flowchart which showed the process sequence of the composition assistance function of 2nd Embodiment implemented with the digital camera of 2nd Embodiment. Explanatory drawing used to explain the composition assist function of the second embodiment The block diagram which showed the structure of 3rd Embodiment of the digital camera to which this invention is applied. The flowchart which showed the process sequence of the composition assistance function of 3rd Embodiment implemented with the digital camera of 3rd Embodiment. Explanatory drawing used to explain the composition assist function of the third embodiment The block diagram which showed the structure of 4th Embodiment of the digital camera to which this invention is applied. The flowchart which showed the process sequence of the composition assistance function of 4th Embodiment implemented with the digital camera of 4th Embodiment. Explanatory drawing used to explain the composition assist function of the fourth embodiment The block diagram which showed the structure of 5th Embodiment of the digital camera to which this invention is applied. The flowchart which showed the process sequence of the composition assistance function of 5th Embodiment implemented with the digital camera of 5th Embodiment. Explanatory drawing used to explain the composition assist function of the fifth embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Shooting lens, 2 ... Imaging device, 3 ... AFE circuit, 4 ... Signal processing means, 5 ... Composition example data, 6 ... Structure estimation means, 7 ... Composition comparison means, 8 ... Display means, 10 ... Information detection means, DESCRIPTION OF SYMBOLS 11 ... Motion detection means, 12 ... Automatic imaging | photography means, 13 ... Warning report means, 20 ... Reference composition determination means, 22 ... Composition rejection determination means, 23 ... Composition holding means,

Claims (8)

Imaging means for capturing an image of a subject imaged by the optical system;
A recording processing unit for performing processing for capturing a recorded image for one frame for recording and storing in a recording medium from the imaging unit and recording the recorded image on the recording medium;
A preview image capturing unit that captures a preview image that is not recorded and stored in the recording medium from the imaging unit;
An angle-of-view changing means for changing the angle of view without changing the orientation of the imaging apparatus body;
Before capturing the recorded image from the imaging unit by the recording processing unit and recording it on the recording medium, by changing the shooting angle of view by the angle of view changing unit and capturing the preview image by the preview image capturing unit, At least an image of a subject having a wider angle of view than the initial shooting angle of view before changing the shooting angle of view by the angle of view changing means is acquired, and the optimum is based on the acquired image of the subject having a wide angle of view Optimal composition detection means for detecting a correct composition;
Before the recording image is captured from the imaging unit by the recording processing unit and recorded on the recording medium, the preview image captured by the preview image capturing unit becomes an optimal composition detected by the optimal composition detection unit. Composition assisting means for changing the shooting angle of view or assisting the user to change the shooting angle of view,
An imaging apparatus with a composition assist function, comprising:   The angle-of-view changing unit changes the position of a predetermined movable lens arranged in the optical system, or effectively captures an object image formed by the optical system by the imaging unit. The imaging apparatus with a composition assist function according to claim 1, wherein the imaging direction is changed by changing the position of the imaging direction, and the imaging angle of view is changed by changing the imaging direction.   The angle-of-view changing unit also serves as an angle-of-view changing unit for canceling image blur in an image blur correction function that changes a shooting angle of view so as to cancel image blur caused by vibration applied to the imaging apparatus main body. The imaging apparatus with a composition assist function according to claim 2.   The angle-of-view changing unit changes the position of a predetermined movable lens arranged in the optical system, or effectively captures an object image formed by the optical system by the imaging unit. 4. The composition assist function according to claim 1, wherein the size of the photographic field angle is changed by changing the size of the photographic field, and the photographic field angle is changed by the size of the photographic field angle. An image pickup device. An image pickup means for picking up an image of a subject imaged by the optical system, and a process of taking a record image for one frame for recording and saving on the recording medium from the image pickup means and recording the recorded image on the recording medium. A recording processing unit that performs, a preview image capturing unit that captures a preview image that is not recorded and stored in the recording medium from the imaging unit, an angle-of-view changing unit that changes a shooting angle of view without changing the attitude of the imaging device body, A composition assist method in an imaging apparatus with a composition assist function comprising:
Before capturing the recorded image from the imaging unit by the recording processing unit and recording it on the recording medium, by changing the shooting angle of view by the angle of view changing unit and capturing the preview image by the preview image capturing unit, At least an image of a subject having a wider angle of view than the initial shooting angle of view before changing the shooting angle of view by the angle of view changing means is acquired, and the optimum is based on the acquired image of the subject having a wide angle of view An optimal composition detection process for detecting a correct composition;
Before the recording image is captured from the imaging unit by the recording processing unit and recorded on the recording medium, the preview image captured by the preview image capturing unit becomes an optimal composition detected by the optimal composition detection step. A composition assist step for changing the shooting angle of view or assisting the user to change the shooting angle of view,
A composition assist method in an imaging apparatus with a composition assist function, comprising:   The angle-of-view changing unit changes the position of a predetermined movable lens arranged in the optical system, or effectively captures an object image formed by the optical system by the imaging unit. 6. The composition assisting method in an imaging apparatus with a composition assisting function according to claim 5, wherein the photographing direction is changed by changing the position of the camera, and the photographing angle of view is changed by changing the photographing direction.   The angle-of-view changing unit also serves as an angle-of-view changing unit for canceling image blur in an image blur correction function that changes a shooting angle of view so as to cancel image blur caused by vibration applied to the imaging apparatus main body. A composition assist method in an imaging apparatus with a composition assist function according to claim 6.   The angle-of-view changing unit changes the position of a predetermined movable lens arranged in the optical system, or effectively captures an object image formed by the optical system by the imaging unit. 8. The composition assist function according to claim 5, wherein the size of the shooting angle of view is changed to change the size of the shooting angle of view, and the shooting angle of view is changed according to the size of the shooting angle of view. Composition assist method for attached image pickup apparatus.

Images