JP2009049646A - Imaging device, display method of through-image, and recording method for photographed image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device which can simply specifies an imaging object, and simply acquires an image with high amusement, a display method of through-image and a recording method for the image photographed. <P>SOLUTION: The imaging device detects a face from a photographed image for through display. When the face is detected, the device identifies an individual person, and if the individual person is identified, it reads out a template corresponding to the person from a database, composites it with the image photographed for the through display and generates a composite image. The composite image generated is then displayed on a monitor as the through-image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, a method for displaying a through image thereof, and a method for recording a captured image, and in particular, has a function of recognizing an individual from an image and a function of generating a composite image by combining a template with an image. The present invention relates to an imaging apparatus provided, a through image display method thereof, and a captured image recording method.

  In a digital camera that captures an image with an image sensor such as a CCD, a method of detecting a human face from an image captured by the image sensor and performing AE / AF so that the detected face is exposed and focused is known. ing.

  Incidentally, a digital camera is usually provided with a monitor, and an image captured by an image sensor before the actual photographing is displayed on the monitor as a through display. Therefore, the photographer can confirm the angle of view and the focus of the image to be photographed by looking at the image (through image) displayed through on the monitor.

  In some digital cameras having a face detection function, a face detection frame is displayed over the through image, and the detected face is displayed surrounded by the detection frame (for example, Patent Document 1). Therefore, in a digital camera having such a function, the presence or absence of a face can be confirmed by looking at a through image displayed on a monitor.

In addition, in a digital camera that records an image obtained by shooting as digital data, it is also possible to process and record the image obtained by shooting, and synthesize a template prepared in advance with the image obtained by shooting. A digital camera that performs recording is also proposed (for example, Patent Document 2). In addition, a digital camera that discriminates the emotion of a photographed person and combines and records a template that matches the emotion has been proposed (for example, Patent Document 3).
JP 2006-25238 A Japanese Patent Application Laid-Open No. 11-168689 JP 2002-77592 A

  By the way, in the case of a digital camera having a face detection function, when a face is detected within the shooting range as described above, the detected face is displayed surrounded by a detection frame. If the face is included, the face is surrounded by the same detection frame and displayed, so that there is a disadvantage that an individual cannot be specified. As a result, there is a disadvantage that it cannot be instantaneously determined whether or not the subject to be photographed is included.

  Also, in the case of a digital camera that has the function of combining and recording a template that matches the emotion of the photographed person with the photographed image, the template switches according to the emotion of the photographed person, so just looking at the template , Has the disadvantage of not being able to identify the individual. As a result, there is a drawback in that it cannot be instantaneously determined from the image whether the subject to be photographed is captured.

  The present invention has been made in view of such circumstances, and an imaging device that can easily identify a subject and can easily obtain a highly entertaining image, a through image display method thereof, and An object of the present invention is to provide a method for recording a captured image.

  In order to achieve the above object, the invention according to claim 1 captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image in a storage medium, and performs the operation in accordance with an instruction for reproduction. In an imaging apparatus for reproducing and displaying an image recorded in a storage medium on a display means, a person registration means for registering a person and a template registration means for individually registering a template to be used for the person registered by the person registration means A registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means, and detecting a person recorded in the registration information recording means from the input image Detecting means for searching, a searching means for searching for a template corresponding to the person detected by the detecting means, and the input template for the input image An image compositing means for generating a composite image and acquiring a through image from the imaging means before the actual photographing, inputting the obtained through image to the detecting means, and recording it in the registration information recording means The search means is searched for a template corresponding to the person detected by the detection means, and the template searched by the search means and the through image are input to the image synthesis means. And a through display control means for displaying the generated composite image on the display means.

  According to the first aspect of the present invention, if a person and a template to be used for the person are registered in advance, an individual is identified from an image captured for through display, and a template corresponding to the person is obtained. The synthesized image is displayed through on the display means. As a result, when the template is viewed, an individual can be identified immediately, and it is possible to instantaneously determine whether or not the person to be photographed is included in the photographing range.

  In order to achieve the above object, the invention according to claim 2 detects a person recorded in the registered information recording means by inputting a photographed image obtained by actual photographing to the detecting means at the time of recording. And a recording control unit that causes the search unit to search for a template corresponding to the person detected by the detection unit, adds information on the template searched by the search unit, and records the captured image on the storage medium. And at the time of reproduction, the information of the template added to the image to be reproduced is obtained, the corresponding template is obtained from the registered information recording means, and the obtained template and the image to be reproduced are obtained by the image synthesizing means. 2. A reproduction display control unit configured to generate a composite image by inputting to the display unit, and to reproduce and display the generated composite image on the display unit. To provide an image device.

  According to the second aspect of the present invention, at the time of recording, an individual is identified from a captured image obtained by actual photographing, information on a template corresponding to the individual is added, and the captured image is recorded on a storage medium. . At the time of reproduction, the corresponding template is specified from the information of the template added to the image to be reproduced, and the identified template is synthesized with the image to be reproduced and reproduced and displayed on the display means. As a result, when the template is viewed, an individual can be identified immediately, and it is possible to instantaneously determine whether the person who wants to take a picture is taken. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  In order to achieve the above object, the invention according to claim 3 inputs a photographed image obtained by actual photographing to the detection means, detects a person recorded in the registration information recording means, The search means searches for a template corresponding to the person detected by the detection means, the template searched by the search means and the photographed image are input to the image synthesis means, and a composite image is generated. The imaging apparatus according to claim 1, further comprising recording control means for recording a composite image on the storage medium.

  According to the third aspect of the present invention, an individual is identified from a captured image obtained by actual photographing, and a template corresponding to the individual is combined with the captured image. Then, the composite image is recorded on the storage medium. Thereby, since the composite image is displayed when the image is reproduced, it is possible to immediately identify an individual by looking at the template displayed on the composite image. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  In order to achieve the above object, the invention according to claim 4 inputs a photographed image obtained by actual photographing to the detection means, detects a person recorded in the registration information recording means, The search means searches for a template corresponding to the person detected by the detection means, the template searched by the search means and the photographed image are input to the image synthesis means, and a composite image is generated. Pre-display control means for pre-displaying a composite image on the display means, and any one of the captured image, the composite image, or both the captured image and the composite image as an image to be recorded on the storage medium 2. The imaging apparatus according to claim 1, further comprising selection means for selecting, and recording control means for recording an image selected by the selection means on the storage medium.

  According to the fourth aspect of the present invention, an individual is identified from a captured image obtained by actual photographing, and a template corresponding to the individual is combined with the captured image. Then, the composite image is displayed on the display means. The photographer confirms the composite image displayed on the display means and selects whether to record the composite image, to record the photographed image (original image before composition), or to record both. . Then, according to the selection, an image is recorded on the storage medium. Thereby, only the photographer's favorite image can be left. Also, since the composite image is pre-displayed before recording, an individual can be identified immediately by looking at the template displayed on the composite image.

  In order to achieve the above object, the invention according to claim 5 captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image in a storage medium, and performs the operation in accordance with an instruction for reproduction. In an imaging apparatus for reproducing and displaying an image recorded in a storage medium on a display means, a person registration means for registering a person and a template registration means for individually registering a template to be used for the person registered by the person registration means A registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means, and detecting a person recorded in the registration information recording means from the input image Detecting means for searching, a searching means for searching for a template corresponding to the person detected by the detecting means, and the input template for the input image An image synthesizing unit to be configured, and at the time of recording, a photographed image obtained by actual photographing is input to the detecting unit to detect a person recorded in the registered information recording unit and to be detected by the detecting unit; A search control unit that causes the search unit to search for a template corresponding to the person who has been selected, adds information on the template searched by the search unit, and records the captured image on the storage medium; The template information added to the image to be acquired is acquired, the corresponding template is acquired from the registered information recording means, and the obtained template and the image to be reproduced are input to the image synthesizing means to generate the synthesized image. And a reproduction display control means for reproducing and displaying the generated composite image on the display means.

  According to the fifth aspect of the present invention, at the time of recording, an individual is identified from a captured image obtained by actual photographing, information on a template corresponding to the individual is added, and the captured image is recorded on a storage medium. . At the time of reproduction, the corresponding template is specified from the information of the template added to the image to be reproduced, and the identified template is synthesized with the image to be reproduced and reproduced and displayed on the display means. As a result, when the template is viewed, an individual can be identified immediately, and it is possible to instantaneously determine whether the person who wants to take a picture is taken. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  In order to achieve the above object, the invention according to claim 6 captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and performs the operation in accordance with an instruction for reproduction. In an imaging apparatus for reproducing and displaying an image recorded in a storage medium on a display means, a person registration means for registering a person and a template registration means for individually registering a template to be used for the person registered by the person registration means A registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means, and detecting a person recorded in the registration information recording means from the input image Detecting means for searching, a searching means for searching for a template corresponding to the person detected by the detecting means, and the input template for the input image The image synthesizing means to be formed and the photographed image obtained by actual photographing are input to the detecting means to detect the person recorded in the registered information recording means, and the person detected by the detecting means The search means searches for the corresponding template, the template searched by the search means and the photographed image are input to the image composition means to generate a composite image, and the generated composite image is recorded in the storage medium. An image pickup apparatus comprising: a recording control unit.

  According to the sixth aspect of the present invention, an individual is identified from a captured image obtained by actual photographing, and a template corresponding to the individual is combined with the captured image. Then, the composite image is recorded on the storage medium. Thereby, since the composite image is displayed when the image is reproduced, it is possible to immediately identify an individual by looking at the template displayed on the composite image. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  In order to achieve the above object, the invention according to claim 7 captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and performs the operation in accordance with an instruction for reproduction. In an imaging apparatus for reproducing and displaying an image recorded in a storage medium on a display means, a person registration means for registering a person and a template registration means for individually registering a template to be used for the person registered by the person registration means A registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means, and detecting a person recorded in the registration information recording means from the input image Detecting means for searching, a searching means for searching for a template corresponding to the person detected by the detecting means, and the input template for the input image The image synthesizing means to be formed and the photographed image obtained by actual photographing are input to the detecting means to detect the person recorded in the registered information recording means, and the person detected by the detecting means The search means searches for the corresponding template, the template searched by the search means and the photographed image are input to the image synthesis means to generate a composite image, and the generated composite image is pre-displayed on the display means Pre-display control means for selecting, selecting means for selecting any one of the photographed image, the composite image, or both the photographed image and the composite image as an image to be recorded in the storage medium, and the selection means And an image recording apparatus comprising: a recording control unit that records the image selected in (1) on the storage medium.

  According to the seventh aspect of the present invention, an individual is identified from a captured image obtained by actual photographing, and a template corresponding to the individual is combined with the captured image. Then, the composite image is displayed on the display means. The photographer confirms the composite image displayed on the display means and selects whether to record the composite image, to record the photographed image (original image before composition), or to record both. . Then, according to the selection, an image is recorded on the storage medium. Thereby, only the photographer's favorite image can be left. Also, since the composite image is pre-displayed before recording, an individual can be identified immediately by looking at the template displayed on the composite image.

  In order to achieve the above object, the invention according to claim 8 has facial expression determination means for determining the facial expression of the person detected by the detection means, and the template registration means is registered by the person registration means. A template to be used for each specific facial expression is registered for a person, and the registration information recording unit records the template for each facial expression registered by the template registration unit in association with the person registered by the person registration unit. The search means searches the registration information recording means for a template of a person detected by the detection means and corresponding to the facial expression determined by the facial expression determination means. The imaging device as described in any one of -7 is provided.

  According to the eighth aspect of the present invention, a template used for each specific facial expression is registered for a registered person. When searching for a template to be used, an individual facial expression identified from the image is determined, and a template corresponding to the facial expression is searched. As a result, in addition to each individual, the template is switched according to the facial expression, so that the individual and the facial expression can be identified only by looking at the template.

  The invention according to claim 9 includes a discrimination level setting unit that sets a discrimination level of each facial expression discriminated by the facial expression discriminating unit for each person registered by the person registration unit in order to achieve the object, The registration information recording means records the template for each facial expression registered by the template registration means in association with the person registered by the person registration means, and sets the discrimination level for each facial expression set by the discrimination level setting means. Recording in association with the person registered by the person registration means, and the facial expression discrimination means discriminates the facial expression of the person detected by the detection means according to the discrimination level for each person recorded in the registration information recording means. An imaging device according to claim 8 is provided.

  According to the invention of claim 9, the expression discrimination level can be individually adjusted. Thereby, the discrimination accuracy can be improved.

  In the invention according to claim 10, in order to achieve the object, the template is formed in a frame shape, and the image synthesizing unit surrounds the face of the person detected by the detecting unit, It combines with an image, The imaging device as described in any one of Claims 1-9 provided.

  According to the invention of claim 10, the template is formed in a frame shape and is synthesized so as to surround the identified individual's face. Thereby, it becomes possible to identify an individual more clearly.

  According to an eleventh aspect of the present invention, in order to achieve the above object, in the through image display method for displaying the image obtained from the imaging means before the actual photographing on the display means, the step of acquiring the image from the imaging means Identifying a person registered in advance from the image acquired from the imaging means, and specifying a template corresponding to the identified person with reference to a table in which the person and a template used for the person are defined. A step of acquiring, a step of acquiring the identified template, a step of combining the acquired template with the image acquired from the imaging unit to generate a combined image, and displaying the generated combined image on the display unit And providing a through image display method characterized by comprising the steps of:

  According to the invention of claim 11, if a person and a template to be used for the person are registered in advance, an individual is identified from an image captured for through display, and a template corresponding to the person is obtained. The synthesized image is displayed through on the display means. As a result, when the template is viewed, an individual can be identified immediately, and it is possible to instantaneously determine whether or not the person to be photographed is included in the photographing range.

  The invention according to claim 12 is a method of recording a photographed image obtained by actual photographing in order to achieve the object, and at the time of recording, identifying a person registered in advance from the photographed image; , Referring to a table in which a person and a template used for the person are defined, specifying a template corresponding to the identified person, adding information of the specified template, and storing the photographed image as a storage medium And, at the time of reproduction, obtaining a template information added to an image to be reproduced, obtaining a corresponding template based on the obtained template information, and obtaining Generating a synthesized image by synthesizing the template with an image to be reproduced, and reproducing the generated synthesized image on the display means; The method comprising, to provide a method of recording captured images, characterized in consisting of.

  According to the twelfth aspect of the present invention, at the time of recording, an individual is identified from a photographed image obtained by actual photographing, template information corresponding to the individual is added, and the photographed image is recorded on the storage medium. . At the time of reproduction, the corresponding template is specified from the information of the template added to the image to be reproduced, and the identified template is synthesized with the image to be reproduced and reproduced and displayed on the display means. As a result, when the template is viewed, an individual can be identified immediately, and it is possible to instantaneously determine whether the person who wants to take a picture is taken. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  The invention according to claim 13 is a method of recording a photographed image obtained by actual photographing to achieve the object, the step of identifying a person registered in advance from the photographed image, Referring to a table in which templates used for the person are defined, a step of specifying a template corresponding to the identified person, a step of acquiring the specified template, and combining the acquired template with the photographed image Provided is a method for recording a captured image, comprising: a step of generating a composite image; and a step of recording the generated composite image on a storage medium.

  According to the thirteenth aspect of the present invention, an individual is identified from the photographed image obtained by the actual photographing, and a template corresponding to the individual is synthesized with the photographed image. Then, the composite image is recorded on the storage medium. Thereby, since the composite image is displayed when the image is reproduced, it is possible to immediately identify an individual by looking at the template displayed on the composite image. Moreover, since the templates are individually synthesized, it is possible to enhance the entertainment of the obtained image.

  The invention according to claim 14 is a method of recording a photographed image obtained by actual photographing to achieve the object, the step of identifying a person registered in advance from the photographed image, Referring to a table in which templates used for the person are defined, a step of specifying a template corresponding to the identified person, a step of acquiring the specified template, and combining the acquired template with the photographed image Generating a composite image, displaying the generated composite image on a display unit, and recording the image on a storage medium as the captured image, the composite image, or both the captured image and the composite image A step of selecting any one of the above and a step of recording the selected image on the storage medium. To provide a recording method for image.

  According to the fourteenth aspect of the present invention, an individual is identified from a photographed image obtained by actual photographing, and a template corresponding to the individual is combined with the photographed image. Then, the composite image is displayed on the display means. The photographer confirms the composite image displayed on the display means and selects whether to record the composite image, to record the photographed image (original image before composition), or to record both. . Then, according to the selection, an image is recorded on the storage medium. Thereby, only the photographer's favorite image can be left. Also, since the composite image is pre-displayed before recording, an individual can be identified immediately by looking at the template displayed on the composite image.

  According to the present invention, a subject can be easily specified, and an image with high entertainment can be easily obtained.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS The best mode for carrying out an imaging apparatus, a through image display method thereof, and a captured image recording method according to the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an electrical configuration of a digital camera 1 to which the present invention is applied.

  As shown in the figure, the digital camera 1 includes a CPU 10, an operation unit 12, a ROM 14, a RAM 16, an EEPROM 18, a VRAM 20, a photographing optical system 24, an image sensor 30, a timing generator 32, an analog signal processing unit 34, and an A / D converter. 36, image input controller 38, image signal processing unit 40, compression / decompression processing unit 42, media controller 44, memory card 46, display control unit 48, monitor 50, AE detection unit 52, AF detection unit 54, face detection unit 56 , A personal identification unit 58, a template selection unit 60, an image composition unit 62, a strobe control unit 64, a strobe 66, a power source control unit 68, a battery 70, and the like.

  The CPU 10 is a control unit that controls the overall operation of the camera, and controls each unit of the digital camera 1 according to a predetermined control program based on an input from the operation unit 12.

  The ROM 14 stores a control program executed by the CPU 10 and various data necessary for the control, and is connected to the CPU 10 via the bus 22.

  In addition, various setting information unique to the user is stored in the EEPROM 18 which is a nonvolatile memory.

  The RAM 16 is used as a work area for the CPU 10 and as a temporary storage area for image data.

  The VRAM 20 is used as a temporary storage area dedicated to display image data.

  The operation unit 12 includes a power switch for turning on / off the power, a release button for inputting an instruction for main photographing, a zoom button for instructing tele / wide zoom, and a mode changeover switch for switching a camera mode between a photographing mode and a playback mode. In addition, various operation means such as a menu button, a cross button, an OK button, and a cancel button are included, and a signal corresponding to the operation of these operation means is output to the CPU 10.

  The photographing optical system 24 is composed of an AF zoom lens, and includes a zoom lens 24z that performs zooming, a focus lens 24f that performs focusing, and a diaphragm 24i that performs light amount adjustment.

  The zoom lens 24z is driven by the zoom motor 26z to move back and forth on the optical axis, whereby the subject image formed on the light receiving surface of the image sensor 30 is optically scaled. The CPU 10 controls the movement of the zoom lens 24z and the zoom by controlling the driving of the zoom motor 26z via the zoom motor driver 28z.

  The focus lens 24f is driven by the focus motor 26f to move back and forth on the optical axis, thereby performing focusing. The CPU 10 controls the movement of the focus lens 24f by controlling the drive of the focus motor 26f via the focus motor driver 28f, and performs focusing.

  The diaphragm 24i is constituted by, for example, an iris diaphragm, and is driven by an iris motor 26i to change the opening amount thereof. The CPU 10 controls the opening amount of the diaphragm 14i by controlling the driving of the iris motor 26i via the iris motor driver 28i, and controls the amount of light incident on the light receiving surface of the image sensor 30.

  The image sensor 30 is composed of a CCD image sensor having a predetermined RGB color filter array, and is driven by a timing generator (TG) 32 to operate. That is, the signal charge accumulated in each pixel (photosensor) is read out by the drive pulse supplied from the timing generator 32 and output as an image signal. The CPU 10 controls the driving of the timing generator 32 to control the charge accumulation time (shutter speed) of the image sensor 30 and the reading of the image signal.

  The analog signal processing unit 34 performs correlated double sampling processing on the analog image signal output from the image sensor 30, and amplifies and outputs it.

  The A / D converter 36 converts the analog image signal output from the analog signal processing unit 34 into a digital image signal and outputs the digital image signal.

  The image input controller 38 has a built-in line buffer of a predetermined capacity, accumulates one frame of image signal output from the A / D converter 36 under the control of the CPU 10, and stores it in the RAM 16.

  The image signal processing unit 40 includes a synchronization circuit (a processing circuit that converts a color signal into a simultaneous expression by interpolating a spatial shift of the color signal associated with a color filter array of a single CCD), a white balance correction circuit, and a gamma correction. A circuit, a contour correction circuit, a luminance / color difference signal generation circuit, and the like. In accordance with a command from the CPU 10, an image signal stored in the RAM 16 is fetched via the image input controller 38, and a required signal processing is performed to obtain a luminance signal (Y ) And color difference signals (Cr, Cb). The generated image signal is stored in the RAM 16 and the VRAM 20.

  The compression / decompression processing unit 42 takes in the Y / C signal generated by the image signal processing unit 40 from the RAM 16 in accordance with a command from the CPU 10, performs a predetermined compression process, and compresses the compressed image in a predetermined format (for example, JPEG). Generate data. Further, the compressed image data is fetched in accordance with a command from the CPU 10 and subjected to a predetermined expansion process to generate an uncompressed Y / C signal.

  The media controller 44 reads / writes data from / to the memory card 46 in accordance with a command from the CPU 10. For example, in response to a recording instruction from the CPU 10, image data obtained by photographing is recorded on the memory card 46. Further, the image data recorded in the memory card 46 is read in response to the read instruction.

  A memory card (storage medium) 46 is detachably loaded in a card slot provided in the camera body. In addition, a storage medium built in the camera body may be used as the storage medium for image recording. In this case, the camera body is provided with a communication interface such as USB, and the data recorded on the storage medium is read using the communication interface.

  The display control unit 48 controls the display on the monitor 50 in accordance with a command from the CPU 10. The monitor 50 is composed of a color LCD, for example. The display control unit 48 takes in the Y / C signal from the VRAM 20 in accordance with a command from the CPU 110, converts it into a predetermined signal format, and outputs it to the monitor 50. The display control unit 48 includes a character generator, and superimposes and outputs information such as predetermined characters, figures, symbols, and the like on the image signal in accordance with a command from the CPU 10.

  In the camera of the present embodiment, the monitor 50 is not only used for reproducing and displaying captured images, but various settings are performed using the display of the monitor 50. Further, during photographing, an image captured by the image sensor 30 is displayed on the monitor 50 as a through display. Therefore, the photographer can adjust the angle of view and check the focus state by viewing the image (through image) displayed through on the monitor 50.

  The AE detection unit 52 takes in an image signal stored in the RAM 16 via the image input controller 38 in accordance with a command from the CPU 10 and calculates an integrated value necessary for AE control. That is, one screen is divided into a plurality of areas (for example, 8 × 8), and an integrated value of image signals for each of R, G, and B is calculated for each divided area. During AE control, the CPU 10 obtains the brightness of the subject based on the integrated value obtained from the AE detection unit 52, and calculates an exposure value (EV value) suitable for shooting. Then, an aperture value and a shutter speed are determined from the calculated EV value according to a predetermined program diagram.

  The AF detection unit 54 takes in R, G, and B image signals stored in the RAM 16 via the image input controller 38 in accordance with a command from the CPU 10, and calculates a focus evaluation value necessary for AF control. The AF detection unit 54 includes a high-pass filter that passes only a high-frequency component of the G signal, an absolute value processing unit, a focus region extraction unit that extracts a signal within a predetermined focus region set on the screen, and a focus region An integration unit for integrating the absolute value data is included, and the absolute value data in the focus area integrated by the integration unit is output to the CPU 10 as a focus evaluation value. During the AF control, the CPU 10 searches for a position where the focus evaluation value output from the AF detection unit 54 is maximized, and moves the focus lens 24f to that position, thereby focusing on the main subject.

  The face detection unit 56 takes in the Y / C signal generated by the image signal processing unit 40 in accordance with a command from the CPU 10 and detects a human face region from an image obtained by photographing.

  Since there are various known techniques for detecting a face from an image, these known face detection techniques can be employed to perform face detection. For example, a method using pattern matching with a face template, a method that extracts skin color data from an original image, a cluster of photometric points determined to be a skin color range, and converts photometric data into hue and saturation Create and analyze a two-dimensional histogram of hue / saturation to determine the face area, extract face candidate areas corresponding to the shape of the human face, and determine the face area from the features in that area And a method of extracting the outline of a human face from an image and determining a face region can be used.

  The personal identification unit 58 identifies an individual from an image in which a face is detected by the face detection unit 56 in accordance with a command from the CPU 10. That is, when a face is detected by the face detection unit 56, under the instruction of the CPU 10, the Y / C signal generated by the image signal processing unit 40 is taken in, and necessary image analysis is performed to identify an individual. More specifically, it is determined whether or not the face person detected by the face detection unit 56 is a person registered in advance, and personal authentication is performed.

  Note that there are various known techniques for performing personal authentication from two-dimensional image data, and therefore individual identification can be performed using these known personal authentication techniques. For example, it is possible to use a method of extracting feature points from two-dimensional face image data, performing alignment and normalization using the extracted feature points, and then collating with a pattern matching method or the like.

  The template selection unit 60 selects a template to be used as a face detection frame based on the identification result by the personal identification unit 58 in accordance with an instruction from the CPU 10. That is, a template of a person identified by the personal identification unit 58 is searched from the database and specified.

  As shown in FIG. 2, this database includes an individual (registrant name), information (personal identification data) for identifying the individual by the personal identification unit 58, and template information used for the individual. They are recorded in association with each other and stored in the EEPROM 18.

  Here, as shown in the figure, each template is formed in a frame shape, and is synthesized so as to surround a person's face with this template. The “frame shape” referred to in the present application is not necessarily limited to the one in which the frame is closed in a ring shape, and includes all those designed to surround the object (face). Therefore, what is formed in a square bracket shape is also included in the frame in the present application.

  The template selection unit 60 searches the database for a template corresponding to the person identified by the personal identification unit 58 and outputs the result to the CPU 10.

  The personal identification unit 58 identifies (authenticates) an individual from the image using the personal identification data recorded in the database.

  As will be described later, this database is generated when the user performs a required registration operation.

  Under the instruction of the CPU 10, the image composition unit 62 captures image data and template data, combines the captured template with the image, and generates a predetermined composite image. FIG. 3 is a diagram showing an example of image composition by the image composition unit 62. As shown in the figure, the image composition unit 62 synthesizes the template with the original image so as to surround the face of the person shown in the original image with the template. The CPU 10 adds the template data selected by the template selection unit 60 and the original image data for synthesizing the template to the image synthesis unit 62. Further, the size and position of the template to be combined are calculated based on the detection result by the face detection unit 56, and the image combination unit 62 is instructed. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the template with the original image.

  The strobe controller 64 controls the light emission of the strobe 66 in accordance with a command from the CPU 10.

  The power control unit 68 controls the supply of power from the battery 70 loaded in the camera body to each unit in accordance with a command from the CPU 10.

  The digital camera 1 according to the present embodiment is configured as described above.

  Next, the operation of the digital camera 1 of the present embodiment will be described.

  As described above, in the digital camera 1 of the present embodiment, a through image is displayed on the monitor 50 at the time of shooting. At this time, if the camera mode is set to the personal identification mode, personal authentication is performed with the through image, and the face portion in the image is surrounded by a frame (template) corresponding to the authenticated person, and the through image is displayed. Is displayed. That is, when a person's face is shown in the image, the person's face is surrounded by a frame that is different for each individual, and a through image is displayed.

  First, basic photographing and recording processing operations and recorded image reproduction processing operations in the digital camera 1 of the present embodiment will be described.

  When the camera is turned on by the operation unit 12 and set to the photographing mode, the digital camera 1 can photograph and record an image.

  When the shooting mode is set, first, a through image is displayed on the monitor 50. That is, images are continuously picked up by the image pickup device 30, and Y / C signals are continuously generated from the image signals. The generated Y / C signals are sequentially applied to the display control unit 48 via the VRAM 20, converted into a display signal format, and output to the monitor 50. As a result, the image captured by the image sensor 30 is displayed on the monitor 50 as a through display.

  The photographer determines the composition by looking at the through image displayed on the monitor 50, and presses the release button halfway.

  When the release button is pressed halfway, an S1 ON signal is input to the CPU 10. In response to the S1 ON signal, the CPU 10 executes shooting preparation, that is, each process of AE and AF.

  First, the image signal output from the image sensor 30 is taken into the RAM 16 via the analog signal processing unit 34, the A / D converter 36, and the image input controller 38, and added to the AE detection unit 52 and the AF detection unit 54.

  The AE detection unit 52 calculates an integrated value necessary for AE control from the input image signal and outputs it to the CPU 10. The CPU 10 obtains the brightness of the subject from the integrated value obtained from the AE detection unit 52, and calculates the imaging EV. Then, an aperture value and a shutter speed at the time of actual photographing are determined from the imaging EV value according to a predetermined program diagram.

  The AF detection unit 54 calculates a focus evaluation value from the input image signal and outputs the focus evaluation value to the CPU 10. The CPU 10 controls the driving of the focus lens motor 26f based on the output from the AF detection unit 154, controls the movement of the focus lens 24f, and focuses on the main subject.

  The photographer confirms the focus state and the like by confirming the through image displayed on the monitor 50. In addition, the zoom button is operated as necessary to determine the composition. When the subject to be photographed is in focus and the composition is determined, execution of the actual photographing is instructed. That is, the release button is fully pressed.

  When the release button is fully pressed, an S2 ON signal is input to the CPU 10. In response to the S2 ON signal, the CPU 10 executes photographing and recording processing.

  First, the image sensor 30 is exposed at the aperture value and shutter speed obtained in the above AE process, and an image signal for recording is captured.

  The image signal for one frame output from the image sensor 30 is taken into the image input controller 38 via the analog signal processing unit 34 and the A / D converter 36 and stored in the RAM 16. The image signal stored in the RAM 16 is added to the image signal processing unit 40 under the control of the CPU 10. The image signal processing unit 40 performs predetermined signal processing on the input image signal to generate an image signal (Y / C signal) composed of a luminance signal (Y) and color difference signals (Cr, Cb).

  The Y / C signal generated by the image signal processing unit 40 is temporarily stored in the RAM 16 and then added to the compression / decompression processing unit 42. The compression / decompression processing unit 42 performs a predetermined compression process on the Y / C signal to generate compressed image data in a predetermined format.

  The compressed image data generated by the compression / decompression processing unit 42 is stored in the RAM 16. The CPU 10 has a predetermined format still image file (a variety of information related to shooting such as shooting conditions such as aperture value, shutter speed, sensitivity, and shooting date and time) added to the compressed image data stored in the RAM 16 (with a predetermined format). For example, Exif) is generated and recorded in the memory card 46 via the media controller 44.

  Note that the compression process is not necessarily a necessary process, and is recorded in an uncompressed state by the user's selection. Further, it is recorded as so-called RAW data according to the user's selection.

  The above is the basic photographing and recording processing operations in the digital camera 1 of the present embodiment. The image recorded on the memory card 46 as described above can be reproduced and displayed on the monitor 50 by setting the mode of the digital camera 1 to the reproduction mode.

  When the camera mode is set to the playback mode by the operation unit 12, the CPU 10 reads the compressed image data of the image file last recorded on the memory card 46 via the media controller 44.

  The compressed image data read from the memory card 46 is added to the compression / decompression processing unit 42, converted into uncompressed image data, and then added to the VRAM 20. Then, it is output from the VRAM 20 to the monitor 50 via the display control unit 48. As a result, the image recorded on the memory card 46 is reproduced and displayed on the monitor 50.

  The frame advance of the image is performed, for example, by the left / right key operation of the cross button provided in the operation unit 12. When the right key is operated, the compressed image data of the next image file is read from the memory card 46. And displayed on the monitor 50. When the left key of the cross button is operated, the compressed image data of the previous image file is read from the memory card 46 and reproduced and displayed on the monitor 50.

  As described above, the reproduction process of the image recorded on the memory card 46 is performed.

  As described above, in the digital camera 1 according to the present embodiment, when the personal identification mode is set, a face is surrounded by a frame different for each individual and a through image is displayed on the monitor 50.

  Hereinafter, the procedure of the through image display process of the digital camera 1 of the present embodiment in the personal identification mode will be described.

  The personal authentication is performed by specifying an individual from previously registered persons. Therefore, it is necessary to register a person to be authenticated (identified). First, a procedure for registering a person who performs the personal authentication will be described.

  FIG. 4 is a flowchart showing a procedure for registering a person who performs personal authentication.

  First, the camera mode is set to the registration mode (step S10). This process is performed on the menu screen. That is, when a menu button provided on the operation unit 12 is pressed, a menu screen is displayed on the monitor 50, and the “registration” item is selected from the menu items displayed on the menu screen. Note that the method of switching to the registration mode is not limited to this, and a dedicated switch or the like may be provided to switch to the registration mode.

  When the registration item is selected on the menu screen, the CPU 10 shifts the camera mode to the registration mode.

  When the registration mode is set, first, a face photograph of a person to be registered is taken (step S11). At this time, a message prompting the user to shoot the face of the person to be registered is displayed on the monitor 50. The user takes a face image of a person to be registered according to the display on the monitor 50. Note that the shooting process itself is the same as the normal shooting process. That is, shooting preparation is performed by half-pressing the release button, and shooting is performed by fully pressing the release button.

  When the release button is fully pressed and the face of the person to be registered is photographed, data for personal identification is generated based on the photographed image (step S12). That is, data such as feature quantities used for personal identification by the personal identification unit 58 is generated.

  Prior to the generation of the personal identification data, a face is detected from an image obtained by photographing. If no face is detected from the captured image, a message prompting the user to retake is displayed on the monitor 50.

  When data for personal identification is generated, personal information of a person to be registered is input (step S13). Here, the name of the registrant is entered. The input is performed using the operation unit 12 according to the display on the monitor 50. Note that the registrant's name can be automatically assigned. For example, numbers may be automatically assigned in the order of registration. Alternatively, the user may select and register a number required in advance.

  When personal information is input, a template to be used for the person is selected (step S14). A plurality of types of templates are prepared in advance and stored in the EEPROM 18. The user selects a template to be used for the person to be registered from the plurality of templates prepared in advance.

  In this template selection process, for example, a list of templates prepared in advance is displayed on the monitor 50 or sequentially switched (for example, display switching is instructed by the left and right key operations of the cross button). This is done by letting the user select one.

  As described above, when photographing of a person to be registered, input of personal information, and selection of a template are performed, such information is recorded in the database, and the database is updated (step S15). That is, identification data and template information used for image composition are associated with a registered person and recorded in the database.

  The registration work of the person to be authenticated is completed in the series of steps.

  Next, a procedure of through image display processing in the personal identification mode will be described.

  Here, the setting of the personal identification mode is performed in the shooting menu. That is, when the menu button is pressed on the operation unit 12 under the photographing mode, the photographing menu is displayed on the monitor 50, and when the item for turning on / off the personal identification mode is selected from the photographing menu, the personal identification mode is turned on. / OFF can be set. The user can set the validity / invalidity of the personal identification mode by reading the shooting menu as necessary and turning the personal identification mode on / off. The method for setting the validity / invalidity of the personal identification mode is not limited to this, and a dedicated switching button may be provided on the camera body to switch the setting.

  FIG. 5 is a flowchart showing the procedure of through image display processing in the personal identification mode.

  First, an image for through display on the monitor 50 is captured (step S20).

  The image data for through display captured from the image pickup device 30 is converted into Y / C data by the image signal processing unit 40, temporarily stored in the RAM 16, and then added to the face detection unit 56 under the control of the CPU 10. It is done. The face detection unit 56 detects a human face from the image (step S21). That is, the face area of a person present in the image is detected. This detection result is output to the CPU 10.

  The CPU 10 determines the presence or absence of a face based on the result of face detection by the face detection unit 56 (step S22). If it is determined that a face is detected, an image (Y / C data) captured for through display is added to the personal identification unit 58 to perform personal authentication (step S23). The personal identification unit 58 performs personal authentication of the registered person using the personal identification data recorded in the database. That is, a registered person is detected from the image. As a result of this personal authentication (the presence / absence of the person concerned and, if there is a person concerned, the registrant information (registrant name) of the person) is output to the CPU 10.

  The CPU 10 determines whether or not there is a corresponding person based on the result of personal authentication in the personal identification unit 58 (step S24). That is, it is determined whether or not a registered person is included in the image.

  If the CPU 10 determines that the registered person is included in the image as a result of this determination, the CPU 10 sends the information on the result of identification by the personal identification unit 58 (registrant information of the identified person) to the template selection unit 60. Add. Based on the input registrant information, the template selection unit 60 searches the database for information on the template of the corresponding person, and outputs the result to the CPU 10 (step S25).

  The CPU 10 specifies a template to be used based on the obtained template information, and inputs it to the image composition unit 62 together with the image data captured for through display. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the image captured for through display (step S27).

  When it is determined in step S24 that there is no corresponding person (when it is determined that no person registered in the image is included), the CPU 10 selects a standard template prepared in advance (step S26), The image data taken in for display is input to the image composition unit 62. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the image captured for through display (step S27).

  The synthesized image is added to the VRAM 20, and is output from the VRAM 20 to the monitor 50 via the display control unit 48 (step S28). Thereby, a through image in which the detected face portion is surrounded by a frame is displayed on the monitor 50 (only when a face is detected).

  At this time, if the registered person is included in the image, the face part is surrounded and displayed by a frame (template) unique to the person. As a result, the photographer can immediately recognize that a specific person is photographed by merely confirming the display on the monitor 50.

  If it is determined in step S22 that a face has not been detected from the image, the template combining process is not performed, and the image directly captured from the image sensor 30 is displayed on the monitor 50.

  FIG. 6 shows a display example of the through image on the monitor. As shown in FIGS. 4A and 4B, when a person registered in advance is included in the image (see FIG. 3), the face is surrounded by a frame (template) corresponding to the person and displayed. Is done. On the other hand, in the case of a person who is not registered, the face is surrounded and displayed by a standard frame (here, a frame of only a line without decoration). FIG. 4D shows a display example when a plurality of human faces are detected from the image. As shown in FIG. 4, when a plurality of human faces are detected from the image, A face is surrounded and displayed by a frame corresponding to each.

  Thereafter, the CPU 10 determines whether or not the main photographing has been instructed based on the input from the operation unit 12 (step S29). That is, it is determined whether or not the release button is fully pressed and the S2ON signal is input.

  If it is determined that the actual shooting is instructed, the actual shooting process is performed (step S30), and the image obtained by shooting is recorded in the memory card 46 (step S31).

  On the other hand, if it is determined that the instruction for the main photographing has not been given, the process returns to step S20, the image data for through display is taken in again, and the processes of steps S20 to S29 are executed.

  As described above, in the digital camera 1 of the present embodiment, when the personal identification mode is set, a person registered in advance is detected from the through image, and when a person registered in advance is detected, the face of the person is detected. Is surrounded by a frame (template) unique to the person. As a result, the photographer can confirm that a specific person has been captured immediately by simply confirming the display on the monitor 50. As a result, a specific person can be efficiently photographed. In addition, entertainment for photographing can be improved.

  In the above embodiment, when a face is detected, a frame (standard template) is displayed even for a person who is not registered, but a frame is displayed only for a registered person. You may make it display.

  Moreover, in the said embodiment, although the template used with respect to each person is selected from the templates prepared beforehand, you may make it possible for a user to design arbitrarily. For example, a plurality of parts may be prepared and a desired template may be created by combining the parts. In addition, template information may be downloaded from other devices so that it can be added as appropriate (for example, a digital camera can be connected to a personal computer, and template data can be downloaded from a personal computer in a timely manner for use. You may be able to increase or decrease the number of templates.)

  Next, a second embodiment of a digital camera to which the present invention is applied will be described.

  In the digital camera 1 of the above embodiment (first embodiment), a frame (template) surrounding the face is switched for each person registered in advance. In the digital camera of this embodiment, the frame surrounding the face is further switched according to the facial expression of the person.

  FIG. 7 is a block diagram showing an electrical configuration of the digital camera according to the second embodiment.

  As shown in the figure, the digital camera 1a of the present embodiment is different from the digital camera 1 of the first embodiment described above in that it further includes a facial expression discrimination unit 72. Therefore, only the configuration of the facial expression determination unit 72 will be described here.

  The facial expression discriminating unit 72 takes an image in which a face is detected by the face detecting unit 56 and an individual is identified by the personal identifying unit 58 under the control of the CPU 10, performs a required image analysis, and is copied there. A person's facial expression (for example, anger, disgust, fear, joy, sadness, surprise, expressionlessness, etc.) is determined.

  There are various known techniques for discriminating (recognizing) facial expressions (emotions) of a person shown in an image, and facial expressions can be discriminated using these known techniques. For example, a feature quantity indicating the positional relationship between feature points set in facial organs such as eyes and mouth is calculated, and a facial expression is estimated from the feature quantity.

  In the digital camera 1a of the present embodiment, since the frame (template) is switched according to the facial expression, the template used for each person is also registered for each facial expression as shown in FIG. That is, a template to be used for each facial expression is set for each registered person. In this example, it is assumed that templates are registered for each expression of anger, joy, sadness, and surprise. FIG. 8 shows an example of a database when templates are registered for these four facial expressions. The user selects and sets a template to be used for each facial expression when a person is registered.

  FIG. 9 is a flowchart showing the procedure of through image display processing in the digital camera 1a of the present embodiment.

  As with the digital camera 1 of the first embodiment, the digital camera 1a of the present embodiment displays a frame corresponding to the personal expression on the face portion only when the personal identification mode is set. The

  First, an image for through display on the monitor 50 is captured (step S40) and added to the face detection unit 56. Then, the face detection unit 56 detects a human face from the image (step S41).

  The CPU 10 determines the presence or absence of a face based on the result of face detection by the face detection unit 56 (step S42). If it is determined that a face has been detected, an image (Y / C data) captured for through display is added to the personal identification unit 58 to perform personal authentication (step S43).

  The CPU 10 determines whether or not there is a corresponding person based on the result of personal authentication in the personal identification unit 58 (step S44). As a result of this determination, if it is determined that the registered person is included in the image, the CPU 10 adds the image (Y / C data) captured for through display to the expression determination unit 72 to determine the expression. (Step S45). The facial expression discrimination result by the facial expression discrimination unit 72 is output to the CPU 10.

  The CPU 10 adds information on the facial expression discrimination result (expression information) by the facial expression discrimination unit 72 and information on the discrimination result by the personal identification unit 58 (registrant information of the person identified as the identification result) to the template selection unit 60. Based on the input registrant information and facial expression information, the template selection unit 60 searches the database for template information corresponding to the facial expression of the person, and outputs the result to the CPU 10 (step S46).

  The CPU 10 specifies a template to be used based on the obtained template information, and inputs it to the image composition unit 62 together with the image data captured for through display. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the image captured for through display (step S48).

  When it is determined in step S44 that there is no corresponding person (when it is determined that no person registered in the image is included), the CPU 10 selects a standard template prepared in advance (step S47), The image data taken in for display is input to the image composition unit 62. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the image captured for through display (step S48).

  The synthesized image is added to the VRAM 20 and is output from the VRAM 20 to the monitor 50 via the display control unit 48 (step S49). Thereby, a through image in which the detected face portion is surrounded by a frame is displayed on the monitor 50 (only when a face is detected).

  At this time, if the registered person is included in the image, the face portion is surrounded and displayed by a frame (template) unique to the person and corresponding to the facial expression. As a result, the photographer can recognize that a specific person is photographed immediately by only confirming the display on the monitor 50, and can also confirm the expression.

  If it is determined in step S <b> 42 that no face has been detected from the image, the template composition process is not performed, and the image directly captured from the image sensor 50 is displayed on the monitor 50.

  FIG. 10 shows a display example of a through image on the monitor 50.

  FIG. 5A shows a display example when a registered person (001) is recognized from an image and a joyful expression is recognized. In this case, a template (templet002) corresponding to the joyful expression of the person (001) is selected and synthesized so that the face portion is surrounded by the template (templet002).

  FIG. 5B shows a display example when a registered person (002) is recognized from the image and an angry facial expression is recognized. In this case, a template (templet031) corresponding to the angry expression of the person (002) is selected from the database, and the template (templet031) is synthesized so that the face portion is surrounded.

  FIG. 5C shows a display example when a registered person (003) is recognized from the image and a sad expression is recognized. In this case, a template (templet078) corresponding to the sad expression of the person (004) is selected from the database and synthesized so that the face portion is surrounded by the template (templet078).

  FIG. 4D shows a display example when a registered person (004) is recognized from the image and a surprised expression is recognized. In this case, a template (templet049) corresponding to the surprised facial expression of the person (004) is selected from the database and synthesized so that the face portion is surrounded by this template (templet049).

  In the case of a person who is not registered, the face is surrounded and displayed by a standard frame (see FIG. 6C).

  Further, when a plurality of human faces are detected in the image, as shown in FIG. 11, each of the faces is displayed surrounded by a corresponding frame. In the example shown in the figure, two persons (001) and (004) registered from the image and one unregistered person are recognized, and the registered person (001) has a joyful expression, a person (004). ) Shows an example when a surprising expression is recognized. In this case, a template (templet002) corresponding to a joyful expression is selected from the database for the registered person (001), and the face is surrounded by the template (templet002). For the person (004), a template (templet049) corresponding to a surprised expression is selected from the database, and the face is surrounded by the template (templet049). The unregistered person is synthesized so that the face portion is surrounded by a standard template.

  In this way, for a person registered in advance, a face is surrounded by a frame (template) corresponding to a facial expression, and a through image is displayed.

  Thereafter, the CPU 10 determines whether or not the main photographing has been instructed based on the input from the operation unit 12 (step S50). If it is determined that the main shooting is instructed, the main shooting process is performed (step S51), and the image obtained by the shooting is recorded in the memory card 46 (step S52).

  On the other hand, if it is determined that the main shooting instruction has not been issued, the process returns to step S40, the image data for through display is taken in again, and the processes of steps S40 to S50 are executed.

  As described above, in the digital camera 1 according to the present embodiment, when the personal identification mode is set, a pre-registered person is detected from the through image, and when a pre-registered person is detected, the expression further increases. The face portion is surrounded and displayed by a frame (template) corresponding to the facial expression of the person. As a result, the photographer can confirm that a specific person is captured immediately by only confirming the display on the monitor 50, and can also confirm the facial expression. As a result, a specific person can be efficiently photographed. In addition, entertainment for photographing can be improved. For example, the enjoyment can be further increased by providing the print service.

  In the digital camera of the present embodiment, the facial expression of a registered person is discriminated. However, when the facial expression is discriminated in this way, by setting the discrimination level of each facial expression for each person, it is more accurate. This makes it possible to discriminate high facial expressions. That is, in the case of a person who is often photographed with a joyful expression, the determination level of the joyful expression is set to be lower than the level of the normal joyful expression so that it can be easily identified as a joyful expression. Similarly, a person who is often photographed with an angry facial expression is set so that the judgment level of the angry facial expression is lowered so that it can be easily discriminated as an angry facial expression. As a result, facial expression discrimination accuracy can be improved, and a template can be appropriately selected.

  Therefore, it is preferable that the discrimination level of each facial expression for each person can be set individually.

  The facial expression discrimination level setting operation can be performed on the monitor by preparing an facial expression discrimination level item on the menu screen and selecting the item, for example.

  FIG. 12 shows a display example of a facial expression discrimination level setting screen. In this example, the discrimination level for each facial expression is set by moving the volume lever provided for each facial expression of joy, anger, sadness, and surprise. In this case, the center of the bar is the normal discrimination level, and the facial expression discrimination level is set to decrease as the volume lever is shifted upward (set so that the facial expression is easily discriminated. ). For example, when the volume lever of the expression of joy is shifted upward from the center, the determination level is lowered from the level of determination of the expression of joy expression according to the shift amount (it becomes easier to be determined as a expression of joy). Conversely, when the volume lever is shifted downward from the center, the discrimination level is raised from the discrimination level of the normal joy expression according to the shift amount (it is difficult to discriminate from the joy expression). In this way, for each registered person, the expression discrimination level is individually set for each expression.

  When setting the facial expression discrimination level, first, a person to be set is selected, and then the facial expression discrimination level of the person is set.

  The person to be set is switched using, for example, the left and right keys of the cross button, and is confirmed when the OK button is pressed. The volume lever is moved with the up and down keys of the cross button, for example, and the facial expression to be set is switched with the left and right keys of the cross button. The setting is completed by pressing an OK button, and the set information is recorded in the EEPROM 18.

  Note that this setting example is an example, and the discrimination level of each facial expression can be set by other methods.

  In the above example, it is possible to set the discrimination levels for the four facial expressions of joy, anger, sadness, and surprise, but the facial expression discrimination level that can be set is the facial expression discriminated by the facial expression discrimination unit 72. Adapted.

  Next, a third embodiment of a digital camera to which the present invention is applied will be described.

  The digital camera according to the present embodiment performs personal authentication on the actually captured image, and if a pre-registered person is included, a template unique to that person is combined with the captured image to create a combined image. And the composite image is recorded on the memory card.

  Since the configuration of the camera and the method for registering the person to be recognized are the same as those of the digital camera 1 of the first embodiment described above, only the method for recording the image after shooting will be described here.

  This process is performed only when the camera is set to a dedicated mode (template synthesis mode). That is, only when the template composition mode is set, a template composition process is performed on the captured image.

  Here, the setting of the template composition mode is performed in the shooting menu. That is, when the menu button is pressed on the operation unit 12 under the shooting mode, the shooting menu is displayed on the monitor 50, and when the template composition mode ON / OFF item is selected from the shooting menu, the template composition mode is turned on. It can be turned off. The user can set validity / invalidity of the template composition mode by reading the shooting menu as necessary and turning ON / OFF the setting of the template composition mode. The method for setting the validity / invalidity of the template compositing mode is not limited to this, and the setting may be switched by providing a dedicated switching button on the camera body.

  FIG. 13 is a flowchart showing the procedure of the photographing and recording processing operations of the digital camera in the template composition mode.

  When the user performs actual photographing (step S60), first, a face image is detected from an image (captured image) obtained by the actual photographing (step S61).

  In this case, first, the Y / C signal is generated by the image signal processing unit 40 from the image signal obtained by the actual photographing, and the generated Y / C signal is temporarily stored in the RAM 16 and added to the face detection unit 56 from the RAM 16. It is done. The face detection unit 56 detects a face area from the input Y / C signal and outputs the result to the CPU 10.

  The CPU 10 determines whether or not a face has been detected from the image based on the result of face detection by the face detection unit 56 (step S62).

  If it is determined that no face has been detected, the CPU 10 records an image (original image) obtained by shooting on the memory card 46 in the same manner as in normal shooting (step S69). That is, after a required compression process is performed on an image obtained by shooting (uncompressed as necessary), it is recorded in the memory card 46 as an image file of a predetermined format (step S69).

  On the other hand, when determining that a face is detected, the CPU 10 performs a personal authentication process (step S63). That is, the image data of the photographed image is added to the personal identification unit 58 to identify the individual. Then, the presence / absence of the person is determined based on the result of personal authentication in the personal identification unit 58 (step S64).

  If the CPU 10 determines that the registered person is included in the image as a result of this determination, the CPU 10 sends the information on the result of identification by the personal identification unit 58 (registrant information of the identified person) to the template selection unit 60. Add. Based on the input registrant information, the template selection unit 60 searches the database for information on the template of the corresponding person, and outputs the result to the CPU 10 (step S65).

  The CPU 10 specifies a template to be used based on the obtained template information, and inputs it to the image composition unit 62 together with the image data of the captured image. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the captured image (step S68).

  If it is determined in step S64 that there is no corresponding person (if it is determined that the person registered in the image is not included), the CPU 10 selects a standard template prepared in advance (step S67), and shoots. The image data is input to the image composition unit 62 together with image data. Also, based on the face detection result by the face detection unit 56, the size of the template to be combined (frame size) and the position to be combined are calculated. Then, the information is input to the image composition unit 62. In response to the instruction from the CPU 10, the image composition unit 62 performs a required deformation process on the template and composes the captured image (step S68).

  The image data of the image generated by the synthesis (synthesized image) is temporarily stored in the RAM 16 and then subjected to a required compression process by the compression / decompression processing unit 42 (uncompressed as necessary), and then in a predetermined format. Are recorded on the memory card 46.

  As described above, in the digital camera of the present embodiment, personal authentication is performed on the actually captured image. Then, if a person registered in advance is included in the actual captured image, a template unique to that person is combined with the captured image (in this example, the face is surrounded by a frame-shaped template). ), The generated composite image is recorded in the memory card 46. As a result, when the image is reproduced, an image in which a template unique to the photographed person is synthesized is reproduced (see FIG. 6). As a result, it is possible to easily identify the person photographed during the reproduction of the image. In addition, the entertainment of the image can be enhanced.

  In the above example, a template (standard template) is synthesized even when a person other than a person registered in advance is detected. However, for a person other than a person registered in advance, a template is synthesized. The template corresponding to only the person registered in advance may be synthesized.

  Further, in the above example, a template formed in a frame shape is used as a template to be synthesized and is synthesized so as to surround the detected human face, but the template to be synthesized is not limited to this. Absent. For example, predetermined characters, figures, symbols, etc. may be used as templates (see FIG. 20). In this case, the template may be synthesized at a specific position or may be synthesized around the face as in the above example.

  Further, as in the digital camera of the second embodiment, in addition to individual identification, the facial expression of the identified person may be determined, and the template to be combined may be switched according to the facial expression.

  In the digital camera of the present embodiment as well, as in the digital camera of the first embodiment, when the personal identification mode is set, a person registered in advance is detected from the through image, and the person registered in advance is detected. When the image is detected, the face of the person may be surrounded by a frame (template) unique to the person and a through image may be displayed.

  Similarly, as in the second embodiment, when the personal identification mode is set, a person registered in advance is detected from the through image, and when a person registered in advance is detected, the facial expression of the person is determined. The face may be surrounded by a frame (template) corresponding to the facial expression, and the through image may be displayed.

  In the above embodiment, when the template composition mode is set, only the composite image is recorded on the memory card 46. However, both the original image and the composite image may be recorded on the memory card 46. The photographer may be able to select an image to be recorded.

  FIG. 14 is a flowchart showing a procedure of shooting and recording processing when an image is selected and recorded.

  As shown in the figure, the processing from step S60 to step S68 is the same as the procedure of the photographing and recording processing shown in FIG. 13, and therefore, here, the processing after generation of the composite image in step S68 will be described. To do.

  In this example, since the original image is also recorded according to the selection, the image data of the original image is held in the RAM 16 even after the images are combined.

  When the composite image is generated (step S68), the generated composite image is pre-displayed on the monitor 50 (step S70). That is, the CPU 10 adds the composite image generated by the image composition unit 62 to the VRAM 20 and causes the monitor 50 to display the display image from the VRAM 20 via the display control unit 48.

  Thereafter, the CPU 10 records the image according to the image recording method set by the user.

  Here, it is assumed that the image recording method is set in advance, and the CPU 10 records an image according to this setting.

  The image recording method is set on the menu screen. That is, when a menu button provided on the operation unit 12 is pressed, a menu screen is displayed on the monitor 50. When an item “setting of image recording method” is selected from the menu items displayed on the menu screen, An image recording method setting screen is displayed, and an image recording method is set on the image recording method setting screen.

  FIG. 15 shows an example of an image recording method setting screen. In this example, three selection items of “Record original image only”, “Record composite image only” and “Record both original image and composite image” are listed on the screen, and one of them is selected. The image recording method is set. The selection is performed, for example, by moving the cursor onto the item to be selected with the cross button and pressing the OK button. The set information is recorded in the EEPROM 18.

  The CPU 10 records the image according to the setting information of the image recording method recorded in the EEPROM 18.

  In this case, first, based on the setting information of the image recording method recorded in the EEPROM 18, it is determined whether or not to record only the original image (step S71).

  If it is determined in this determination that only the original image is recorded, the CPU 10 records only the original image on the memory card 46 (step S75). That is, the image data of the original image is subjected to a required compression process (uncompressed as necessary) and then recorded in the memory card 46 as an image file of a predetermined format.

  On the other hand, if it is determined not to record only the original image, the CPU 10 next determines whether or not to record only the composite image (step S72).

  If it is determined that only the composite image is recorded in this determination, the CPU 10 records only the composite image on the memory card 46 (step S74). That is, the image data of the composite image is subjected to a required compression process (uncompressed as necessary) and then recorded in the memory card 46 as an image file of a predetermined format.

  On the other hand, when determining that only the composite image is not recorded, the CPU 10 records both the composite image and the original image on the memory card 46 (step S73). That is, after the required compression processing is performed on the image data of the composite image (uncompressed as necessary), it is recorded in the memory card 46 as an image file of a predetermined format, and the image data of the original image is also recorded. After performing the required compression processing (uncompressed as necessary), it is recorded in the memory card 46 as an image file of a predetermined format.

  Thereby, an image can be recorded by a user's favorite method.

  In the above example, the user sets the image recording method in advance. However, the image recording method may be selected every time shooting is performed. That is, after pre-displaying the composite image, the user may be inquired about the image recording method, and the image may be recorded on the memory card 46 in accordance with an instruction from the user.

  In this case, for example, as shown in FIG. 16, both the original image and the composite image may be pre-displayed on the monitor 50, and the image recording method may be selected. Further, it may be possible to select not to record any image.

  In the above example, the composite image is pre-displayed, but the captured image (original image) may be pre-displayed. In this case, image composition processing is executed according to the image recording method set after the pre-display of the original image, and the image is recorded.

  FIG. 17 is a flowchart illustrating a processing procedure in a case where an image composition process is performed after an original image is pre-displayed to record an image.

  As shown in the figure, the process from step S60 to step S67 is the same as the procedure of the photographing and recording process shown in FIG. 13, and here, the process after selection of the template in step S66 or step S67. It explains from.

  When the template is selected, the CPU 10 pre-displays the original image on the monitor 50 (step S80).

  Thereafter, the CPU 10 records the image according to the image recording method set by the user.

  First, it is determined whether or not only the original image is to be recorded based on the setting information of the image recording method recorded in the EEPROM 18 (step S81).

  If it is determined that only the original image is recorded in this determination, the CPU 10 records only the original image on the memory card 46 (step S85).

  On the other hand, if it is determined not to record only the original image, the CPU 10 next determines whether or not to record only the composite image (step S82).

  If it is determined that only the composite image is recorded in this determination, the CPU 10 performs image composition processing (step S86), and records only the generated composite image on the memory card 46 (step S74).

  On the other hand, when determining that only the composite image is not recorded, the CPU 10 first records the original image on the memory card 46 (step S83). Next, the CPU 10 performs image composition processing (step S84), and records the generated composite image on the memory card 46 (step S75).

  As described above, after the original image is pre-displayed, the image can be recorded by performing the image composition process. In this case, when the recording of only the original image is selected, the image synthesizing process becomes unnecessary, so that the recording process can be speeded up.

  Also in this example, as in the digital camera of the first embodiment, personal authentication is performed at the through image display stage, a template corresponding to the individual is synthesized, and the through image is displayed. Also good.

  In the above example, the process is performed only when the camera is set to a dedicated mode (template compositing mode). However, the compositing process of the template is always performed on the photographed image for recording. Good.

  Next, a fourth embodiment of a digital camera to which the present invention is applied will be described.

  The digital camera according to the present embodiment performs personal authentication on the actually captured image. If a pre-registered person is included, the digital camera selects a template unique to the person and stores information on the template. Attached to the photographed image, the photographed image is recorded on the memory card. Then, at the time of image reproduction, the information of the template is read out, required composition processing is performed, and reproduced and displayed on the monitor.

  Since the configuration of the camera and the method for registering the person to be recognized are the same as those of the digital camera 1 of the first embodiment described above, only the method for recording and reproducing images after shooting will be described here. To do.

  Similar to the digital camera of the third embodiment, this processing is performed only when the camera is set to a dedicated mode (template synthesis mode). The setting method for the template composition mode is the same as that of the digital camera of the third embodiment described above.

  FIG. 18 is a flowchart showing the procedure of the photographing and recording processing operations in the template composition mode by the digital camera of the present embodiment.

  When the user performs actual shooting (step S90), first, a face image is detected from an image (captured image) obtained by the actual shooting (step S91). That is, a Y / C signal is generated from the image signal obtained by the actual photographing, and the face area is detected by the face detection unit 56 from the generated Y / C signal.

  The CPU 10 determines whether or not a face has been detected from the image based on the result of face detection by the face detection unit 56 (step S92).

  If it is determined that no face has been detected, the CPU 10 records an image (original image) obtained by photographing on the memory card 46 as in the case of normal photographing (step S99). That is, after a predetermined compression process is performed on an image (original image) obtained by shooting (uncompressed as necessary), it is recorded in the memory card 46 as an image file of a predetermined format (step S99).

  On the other hand, when determining that a face is detected, the CPU 10 performs a personal authentication process (step S93). That is, the image data of the photographed image is added to the personal identification unit 58 to identify the individual. Then, the presence / absence of the corresponding person is determined based on the result of personal authentication in the personal identification unit 58 (step S94).

  If the CPU 10 determines that the registered person is included in the image as a result of this determination, the CPU 10 sends the information on the result of identification by the personal identification unit 58 (registrant information of the identified person) to the template selection unit 60. Add. Based on the input registrant information, the template selection unit 60 searches the database for information on the template of the corresponding person, and outputs the result to the CPU 10 (step S65).

  The CPU 10 adds the obtained template information to the image data of the photographed image (step S66). That is, in the digital camera according to the present embodiment, a predetermined compression process is performed on an image (original image) obtained by shooting (uncompressed as necessary), and then an image file in a predetermined format is generated. However, when generating the image file, template information is added to the image file. For example, in the case of an Exif format image file, template information is stored in a predetermined tag area. Even in the case of other file formats, for example, template information is stored in the header. Then, the image file generated in this way is recorded on the memory card 46 (step S99).

  If it is determined in step S94 that there is no corresponding person (if it is determined that a person registered in the image is not included), the CPU 10 selects a standard template prepared in advance (step S97), and shoots. The image is added to the image (step S98), and the captured image is recorded on the memory card 46 (step S99).

  As described above, in the digital camera of the present embodiment, personal authentication is performed on the actually captured image. If a person registered in advance is included in the captured image, a template unique to the person is selected, information on the template is added to the captured image, and the captured image is recorded in the memory card 46. Is done.

  When the image is reproduced, the template information added to the image file is read out, the corresponding template is combined with the image, and reproduced and displayed on the monitor 50. Hereinafter, the processing at the time of reproducing the image will be described.

  FIG. 19 is a flowchart showing a procedure of image reproduction processing in the digital camera of the present embodiment.

  Note that the image can be reproduced by setting the camera mode to the reproduction mode. Setting to the playback mode is performed by a mode switch.

  When the camera mode is set to the playback mode, the CPU 10 reads the image file of the last image recorded on the memory card 46 (step S110). Then, it is determined whether or not template information is added to the image file (step S111).

  If it is determined that the template information is not added to the image file, the CPU 10 reproduces and displays the image on the monitor 50 in the same manner as in the normal reproduction processing method (step S114). That is, after the required decompression processing is performed on the compressed image data (only when the image data is compressed), the compressed image data is output to the monitor 50 via the display control unit 48. As a result, the image is reproduced and displayed on the monitor 50.

  On the other hand, when determining that the template information is added to the image file, the CPU 10 selects a template according to the template information (step S112). Then, the selected template is combined with the image data to be reproduced to generate a combined image (step S113).

  That is, first, a required decompression process is performed on the image data to be reproduced (only when the image data to be reproduced is compressed) to generate uncompressed image data. Then, the generated image data is added to the image composition unit 62. Further, the selected template is added to the image composition unit 62. The image composition unit 62 composes the input template with the image to be reproduced, and generates a composite image (step S113).

  The generated composite image is stored in the VRAM 20 and is output from the VRAM 20 to the monitor 50 via the display control unit 48.

  As a result, the combined image of the template is reproduced and displayed on the monitor 50.

  Thereafter, the CPU 10 determines whether or not an instruction for frame advance or frame return is given based on an input from the operation unit 12 (step S115). If it is determined that a frame advance or frame return instruction has been issued, the process returns to step S110, the next or previous image file is read, and the reproduction process is executed.

  On the other hand, if it is determined that an instruction for frame advance or frame return is not given, it is determined whether or not an instruction to end the playback process is given (step S116). If it is determined that an instruction is given, the playback process is ended.

  As described above, in the digital camera according to the present embodiment, the template is not combined with the image and recorded, but the template information is added to record the image (original image), and a necessary combination process is performed during reproduction. The composite image is reproduced and displayed on the monitor 50. Thereby, an image can be recorded without damaging the original image.

  In the above example, the above process is performed as a normal playback mode process. However, the above process is performed only when a dedicated mode (for example, a template composition display mode) is set. It may be. In this case, when the normal reproduction mode is set, even if the template information is added to the image, the template synthesis process is not performed, and only the original image reproduction process is executed. Further, for example, when the template composition display mode is set, the reproduction process may be performed only on the image to which the template information is added.

  In the above example, a template (standard template) is determined for a person who is not registered, and the information is added to the captured image, and the captured image is recorded. Even if a face is detected, if the person is not a registered person, the template selection process is not performed, and the image may be recorded in the same manner as a normal captured image (without adding template information). You may make it record.)

  In the above example, the method for synthesizing the template is not particularly described. However, as in the first embodiment described above, the face of the person who is personally authenticated is surrounded by the template formed in a frame shape. You may make it synthesize | combine. In this case, information on the template to be combined, the position of the face to be combined, the size of the template to be combined, and the like are also added to the template information.

  Further, the present invention is not limited to the case of combining templates formed in a frame shape, and for example, as shown in FIG. 20, predetermined characters, figures, symbols, and the like may be used as templates. In this case, the template may be synthesized at a specific position or may be synthesized around the face as in the above example.

  Further, as in the digital camera of the second embodiment, in addition to individual identification, the facial expression of the identified person may be determined, and the template to be combined may be switched according to the facial expression.

  Furthermore, in the digital camera of the present embodiment as well, as in the digital cameras of the first and second embodiments, personal authentication and facial expression discrimination are performed at the through image stage, and the detected person and facial expression are handled. The through templates may be displayed by combining the templates.

  Further, as an image recording method, the user may be able to select whether or not to record template information. In this case, the selection of necessity of recording may be performed every time an image is taken, or may be set in advance.

  In the digital camera of the above embodiment, the face detection unit, the personal identification unit, the template selection unit, the image synthesis unit, and the like are configured by hardware circuits, but the same function may be realized by software. . In this case, only a part of the functions may be realized by software.

  In the series of embodiments described above, the case where the present invention is applied to a digital camera has been described as an example. However, the application of the present invention is not limited to this, and a photographing function such as a camera-equipped mobile phone is provided. It can be applied to general equipment.

1 is a block diagram showing an electrical configuration of a digital camera to which the present invention is applied. Conceptual diagram of database configuration Diagram showing an example of image composition The flowchart which shows the procedure of the registration process of the person who performs personal authentication The flowchart which shows the procedure of the display process of the through image at the time of personal identification mode Diagram showing a display example of a through image The block diagram which shows the electric constitution of the digital camera of 2nd Embodiment Conceptual diagram of database configuration The flowchart which shows the procedure of the display process of the through image in the digital camera of 2nd Embodiment Diagram showing a display example of a through image The figure which shows the example of a through image display when a several person is identified Figure showing a display example of the facial expression discrimination level setting screen 10 is a flowchart showing a procedure of photographing and recording processing operations in the template composition mode in the digital camera of the third embodiment. Flow chart showing the procedure of shooting and recording processing when an image is selected and recorded The figure which shows the example of a display of the setting screen of the recording method of an image The figure which shows the example of a display of the selection screen of an image recording method A flowchart showing a processing procedure in the case of performing image composition processing after pre-displaying an original image and recording an image A flowchart showing a procedure of processing operations for photographing and recording in the template composition mode by the digital camera of the fourth embodiment. A flowchart showing a procedure of image reproduction processing in the digital camera of the fourth embodiment. The figure which shows another example of image composition

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1, 1a ... Digital camera, 10 ... CPU, 12 ... Operation part, 14 ... ROM, 16 ... RAM, 18 ... EEPROM, 20 ... VRAM, 24 ... Shooting optical system, 30 ... Image sensor, 32 ... Timing generator, 34 ... Analog signal processing unit 36 ... A / D converter 38 ... Image input controller 40 ... Image signal processing unit 42 ... Compression / decompression processing unit 44 ... Media controller 46 ... Memory card 48 ... Display control unit 50 ... monitor, 52 ... AE detection unit, 54 ... AF detection unit, 56 ... face detection unit, 58 ... personal identification unit, 60 ... template selection unit, 62 ... image composition unit, 64 ... strobe control unit, 66 ... strobe, 68 ... Power supply control unit, 70 ... Battery, 72 ... Expression discrimination unit

Claims (14)

An imaging device that captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and reproduces and displays the image recorded on the storage medium on a display unit in accordance with an instruction for reproduction In
A person registration means for registering a person;
Template registration means for individually registering a template to be used for the person registered by the person registration means;
Registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means;
Detecting means for detecting a person recorded in the registered information recording means from the input image;
Search means for searching for a template corresponding to the person detected by the detection means;
Image combining means for combining the input template with the input image to generate a combined image;
Before the actual photographing, a through image is acquired from the imaging unit, and the obtained through image is input to the detecting unit to detect a person recorded in the registered information recording unit and detected by the detecting unit. The search means searches for a template corresponding to a person who has been searched, the template searched by the search means and the through image are input to the image synthesis means to generate a composite image, and the generated composite image is generated by the display means. Through display control means for displaying through,
An imaging apparatus comprising: At the time of recording, a photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registered information recording means, and a template corresponding to the person detected by the detection means Recording control means for causing the search means to search, adding the information of the template searched by the search means and recording the captured image in the storage medium;
At the time of reproduction, information on the template added to the image to be reproduced is obtained, the corresponding template is obtained from the registered information recording means, and the obtained template and the image to be reproduced are input to the image composition means Reproduction display control means for generating a composite image and reproducing and displaying the generated composite image on the display means;
The imaging apparatus according to claim 1, further comprising:   A photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registration information recording means, and a template corresponding to the person detected by the detection means is detected by the search means. And a recording control unit that inputs the template searched by the searching unit and the captured image to the image combining unit to generate a combined image, and records the generated combined image in the storage medium. The imaging apparatus according to claim 1. A photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registration information recording means, and a template corresponding to the person detected by the detection means is detected by the search means. Pre-display control means for causing the image to be searched, inputting the template searched by the search means and the captured image to the image combining means to generate a combined image, and pre-displaying the generated combined image on the display means;
Selection means for selecting any one of the photographed image, the composite image, or both the photographed image and the composite image as an image to be recorded in the storage medium;
Recording control means for recording the image selected by the selection means on the storage medium;
The imaging apparatus according to claim 1, further comprising: An imaging device that captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and reproduces and displays the image recorded on the storage medium on a display unit in accordance with an instruction for reproduction In
A person registration means for registering a person;
Template registration means for individually registering a template to be used for the person registered by the person registration means;
Registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means;
Detecting means for detecting a person recorded in the registered information recording means from the input image;
Search means for searching for a template corresponding to the person detected by the detection means;
Image synthesizing means for synthesizing the input template with the input image;
At the time of recording, a photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registered information recording means, and a template corresponding to the person detected by the detection means Recording control means for causing the search means to search, adding information of the template searched by the search means, and recording the photographed image on the storage medium;
At the time of reproduction, information on the template added to the image to be reproduced is obtained, the corresponding template is obtained from the registered information recording means, and the obtained template and the image to be reproduced are input to the image composition means Reproduction display control means for generating a composite image and reproducing and displaying the generated composite image on the display means;
An imaging apparatus comprising: An imaging device that captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and reproduces and displays the image recorded on the storage medium on a display unit in accordance with an instruction for reproduction In
A person registration means for registering a person;
Template registration means for individually registering a template to be used for the person registered by the person registration means;
Registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means;
Detecting means for detecting a person recorded in the registered information recording means from the input image;
Search means for searching for a template corresponding to the person detected by the detection means;
Image synthesizing means for synthesizing the input template with the input image;
A photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registration information recording means, and a template corresponding to the person detected by the detection means is detected by the search means. Recording control means for causing the image to be searched, inputting the template searched by the search means and the captured image to the image combining means to generate a combined image, and recording the generated combined image in the storage medium;
An imaging apparatus comprising: An imaging device that captures an image with an imaging unit in accordance with an instruction for actual photographing, records the obtained image on a storage medium, and reproduces and displays the image recorded on the storage medium on a display unit in accordance with an instruction for reproduction In
A person registration means for registering a person;
Template registration means for individually registering a template to be used for the person registered by the person registration means;
Registration information recording means for recording the template registered by the template registration means in association with the person registered by the person registration means;
Detecting means for detecting a person recorded in the registered information recording means from the input image;
Search means for searching for a template corresponding to the person detected by the detection means;
Image synthesizing means for synthesizing the input template with the input image;
A photographed image obtained by actual photographing is input to the detection means to detect a person recorded in the registration information recording means, and a template corresponding to the person detected by the detection means is detected by the search means. Pre-display control means for causing the image to be searched, inputting the template searched by the search means and the captured image to the image combining means to generate a combined image, and pre-displaying the generated combined image on the display means;
Selection means for selecting any one of the photographed image, the composite image, or both the photographed image and the composite image as an image to be recorded in the storage medium;
Recording control means for recording the image selected by the selection means on the storage medium;
An imaging apparatus comprising: Facial expression determination means for determining the facial expression of the person detected by the detection means;
The template registration means registers a template to be used for each specific facial expression for the person registered by the person registration means,
The registration information recording means records the template for each facial expression registered by the template registration means in association with the person registered by the person registration means,
The search means searches the registered information recording means for a template of a person detected by the detection means and corresponding to the facial expression determined by the facial expression determination means. 8. The imaging device according to any one of 7. A discrimination level setting unit that sets a discrimination level of each facial expression discriminated by the facial expression discrimination unit for each person registered by the person registration unit;
The registration information recording unit records the template for each facial expression registered by the template registration unit in association with the person registered by the person registration unit, and also determines the discrimination level for each facial expression set by the discrimination level setting unit. Is recorded in association with the person registered by the person registration means,
9. The imaging apparatus according to claim 8, wherein the facial expression determination unit determines the facial expression of the person detected by the detection unit according to a determination level for each person recorded in the registered information recording unit.   10. The template according to claim 1, wherein the template is formed in a frame shape, and the image synthesizing unit synthesizes the template with an image so as to surround a human face detected by the detecting unit. The imaging device according to claim 1. In a display method of a through image in which an image obtained from an image pickup means is displayed on the display means before the main photographing,
Obtaining an image from the imaging means;
Identifying a pre-registered person from the image acquired from the imaging means;
Identifying a template corresponding to the identified person by referring to a table that defines the person and the template used for the person;
Obtaining the identified template;
Combining the acquired template with the image acquired from the imaging means to generate a combined image;
Through-displaying the generated composite image on the display means;
A method for displaying a through image, comprising: A method of recording a photographed image obtained by actual photographing,
During recording,
Identifying a pre-registered person from the captured image;
Identifying a template corresponding to the identified person by referring to a table that defines the person and the template used for the person;
Adding the specified template information and recording the captured image on a storage medium;
Consists of
During playback,
Obtaining information of a template added to an image to be reproduced;
Acquiring a corresponding template based on the acquired template information;
Combining the acquired template with an image to be reproduced to generate a composite image;
Replaying and displaying the generated composite image on the display means;
A method of recording a photographed image, comprising: A method of recording a photographed image obtained by actual photographing,
Identifying a pre-registered person from the captured image;
Identifying a template corresponding to the identified person by referring to a table that defines the person and the template used for the person;
Obtaining the identified template;
Combining the acquired template with the captured image to generate a composite image;
Recording the generated composite image on a storage medium;
A method of recording a photographed image, comprising: A method of recording a photographed image obtained by actual photographing,
Identifying a pre-registered person from the captured image;
Identifying a template corresponding to the identified person by referring to a table that defines the person and the template used for the person;
Obtaining the identified template;
Combining the acquired template with the captured image to generate a composite image;
Displaying the generated composite image on a display means;
Selecting one of the captured image, the composite image, or both the captured image and the composite image as an image to be recorded in a storage medium;
Recording the selected image on the storage medium;
A method of recording a photographed image, comprising:

Images