JP2015122741A - Photo sticker generation apparatus, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image in which the eyes are emphasized more naturally.SOLUTION: A photographic processing part photographs a user as a subject to obtain a photographic image, and a work processing part performs works on the eyelashes of the user in the photographic image obtained by the photographic processing part. A display control part receives a user's selection of the degree of work on the eyelash portion in the photographic image, that is to be applied by the work processing part. The invention can be applied to a photo sticker generation apparatus.

Description

  The present invention relates to a photographic sticker creating apparatus, an image processing method, and a program, and more particularly, to a photographic sticker creating apparatus, an image processing method, and a program that can provide an image that provides an image with an eye enhanced. .

  There is known a photo sticker that takes a picture of a user, causes the user to edit the shot image, and prints and provides the edited image on sticker paper. Such a photo sticker is installed in an entertainment facility.

  The flow of one game provided by the photo-seal machine usually shoots a user in the shooting space as a subject, moves the user to the editing space, edits the image according to operations performed in the editing space, The edited image, which is the edited image, is printed on sticker paper.

  Among such photo sticker machines, there is one that performs image processing according to the user's attributes on the captured image taken by the user according to the course selected by the user. is there. (For example, refer to Patent Document 1).

  However, in the photo sticker of Patent Document 1, the user does not select the content of the image processing only by selecting the course, so that the user can play the game without grasping what image processing is performed. Will proceed. Therefore, no matter how particular the content of the image processing performed on the photographed image is, the user is not particularly aware of the content of the image processing for the finally obtained image.

JP 2012-37735 A

  In recent years, in a photo sticker, the size of a user's eyes is changed as image processing for emphasizing the eyes of the user (subject) in a captured image.

  However, in the captured image, if only the eyes become extremely large, an unnatural impression may be given as if processing has been performed.

  The present invention has been made in view of such a situation, and makes it possible to provide an image in which eyes are emphasized more naturally.

  According to another aspect of the present invention, there is provided a photographic sticker creating apparatus that shoots a user as a subject and acquires a captured image, a processing unit that processes the user's eyelash portion in the captured image, and the use Display means for displaying a selection screen for accepting selection of the degree of processing of the eyelash part in the photographed image by the person.

  The display means can display a selection screen for accepting selection of whether or not the eyelash part is processed.

  The display means can display a selection screen for accepting selection of any of a plurality of levels of processing for the eyelash portion.

  The display means can display the photographed image in which the eyelash part is processed to the degree selected by the user on the selection screen in a predetermined area on the selection screen.

  The display means can accept selection of the degree of processing for the eyelash portion in a state where the photographed image in which the eyelash portion is not processed is displayed in the predetermined region.

  The processing means is caused to perform other processing on the region other than the eyelash portion of the user in the photographed image, and the display means is used to select another processing degree for the region other than the eyelash portion. The selection screen to be accepted can be displayed.

  The display means can display a selection screen for accepting selection of the degree of processing for the eyelash portion and a selection screen for accepting selection of another degree of processing for the region other than the eyelash portion at different timings.

  The display means can display a selection screen that accepts both the selection of the degree of processing for the eyelash portion and the selection of the degree of other processing for the region other than the eyelash portion.

  The display means may display a selection screen for accepting selection of a processing pattern in which a predetermined degree of processing for the eyelash part and another predetermined degree of processing for an area other than the eyelash part are combined in advance. it can.

  The photographing unit causes the user to photograph a plurality of times and obtains a plurality of the photographed images, and the processing processing unit performs processing of the degree selected by the user in any of the plurality of photographed images. Or all.

  The photographing means acquires the photographed images of each of the plurality of users by one photographing, and the display means selects a degree of processing for each of the photographed images by the plurality of users. A selection screen to accept each can be displayed.

  The processing means can be processed to increase the amount of the user's eyelashes in the captured image.

  The processing means can be processed to change the color of the user's eyelashes in the captured image.

  According to another aspect of the present invention, there is provided a photo sticker creation method of photographing a user as a subject, obtaining a photographed image, processing the eyelash portion of the user in the photographed image, and performing a process on the photographed image by the user. Including a step of displaying a selection screen for accepting selection of the degree of processing for the eyelash portion.

  The program according to one aspect of the present invention is to shoot a user as a subject, acquire a captured image, process the eyelash portion of the user in the captured image, and perform the processing on the eyelash portion of the user in the captured image. The computer is caused to execute a process including a step of displaying a selection screen for accepting selection of the degree of processing for.

  In one aspect of the present invention, a user is photographed as a subject, a photographed image is acquired, the user's eyelash part in the photographed image is processed, and the degree of processing by the user on the eyelash part in the photographed image is determined. A selection screen for accepting the selection is displayed.

  According to the present invention, it is possible to provide an image in which eyes are emphasized more naturally.

It is a perspective view which shows the structural example of the external appearance of the photograph sticker production apparatus which concerns on one embodiment of this invention. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a block diagram which shows the function structural example of a control part. It is a block diagram which shows the function structural example of an edit process part. It is a flowchart explaining the example of the flow of photograph sticker creation game processing. It is a flowchart explaining an edit process. It is a flowchart explaining a retouch process. It is a figure which shows the example of the retouch screen of eyes and faces. It is a flowchart explaining an eyelash processing process. It is a figure which shows the example of a retouch screen of eyelashes. It is a figure explaining the difference between expansion of the size of eyes, and processing of eyelashes. It is a flowchart explaining a retouch process. It is a figure which shows the example of the retouch screen of eyes, a face, and eyelashes. It is a figure which shows the other example of a retouch screen of eyes, a face, and eyelashes. It is a figure which shows the example of the live view display screen of identification imaging | photography. It is a figure which shows the example of an edit screen. It is a figure which shows the example of the palette for edit. It is a flowchart explaining a lip color change process. It is a figure which shows the other example of the palette for edit. It is a figure which shows the further another example of the palette for edit.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

[External structure of photo sticker creation device]
FIG. 1 is a perspective view showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user, but there are mainly two or three users.

  A user who plays in the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and selects an image to be edited selected from the shot images obtained by shooting. Editing is performed using an editing function for synthesizing a background image or foreground image, a handwritten line drawing, or a stamp image, thereby making the photographed image rich and colorful. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that allows a user to perform photographing processing. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. The front panel 41 of the photographing unit 21 that constitutes a surface facing the photographing space in front is provided with a touch panel monitor used by the user during photographing processing. When the right side when viewed from the user in the imaging space is the right side and the left side is the left side, the right side of the imaging unit 21 is constituted by a side panel 42A, and the left side is a side panel 42B (not shown). Consists of.

  The background unit 22 is attached to the right end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and has a narrower width than the side panel 42A. The side panel 52A (not shown) is a plate-like member that is attached to the left end of the rear panel 51 and is narrower than the side panel 42B.

  The side panel 42A constituting the right side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided in substantially the same plane, and the respective upper portions are connected to each other by, for example, a connecting portion 23A having a plate-like member. It is connected by a connecting portion 23A ′, which is a metal substantially U-shaped member. Further, the side panel 42B constituting the left side surface of the photographing unit 21 and the side panel 52B of the background unit 22 are provided in substantially the same plane, and the lower portions thereof are connected by the connecting portions 23B, each of which is a plate-like member. For example, they are connected by a connecting portion 23B ′ (not shown) which is a substantially U-shaped member made of metal.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. Although not shown, an opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance G2 of the photographing space. A flooring 27 is installed inside the photographing space. The user enters the shooting space and stands on the flooring 27 to perform shooting.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a plurality of winding-type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  In addition, as a background curtain accommodated in the background curtain unit 25, an elevating curtain that uses a plurality of curtains as one chroma key curtain may be prepared. In addition, a curtain for the chroma key is pasted on the rear panel 51 which is the back of the shooting space in advance, and a plurality of types of background images for synthesis are prepared, and a background image desired by the user is captured in the shooting process and editing process. It may be possible to synthesize it into parts.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light in the shooting space as a flash. In addition to the strobe, a fluorescent lamp is provided inside the ceiling strobe unit 24, and also functions as illumination for the photographing space.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front-side configuration, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the right side of the slope 72, a support portion 73A having a columnar shape and supporting one end of the lighting device 74 is provided. A support portion 73 </ b> B (FIG. 2) that supports the other end of the lighting device 74 is also provided on the left side of the slope 72. Further, on the right side of the support portion 73A, there is provided a support portion 73C having a plate-like shape and provided by connecting the subsequent customer service portion 13. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the support portion 73C.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 2, the post-service unit 13 has a plate-shaped housing having a predetermined thickness, and is provided by being joined to the right side surface of the editing unit 12. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing part 21 and the background part 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The photographing space A1 is entered, and photographing processing is performed using a camera or a touch panel monitor provided in the photographing unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

[Configuration of shooting section]
FIG. 4 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively.

  A photographing / display unit 81 is provided slightly above the center of the front panel 41. The photographing / display unit 81 includes a camera 91, a touch panel monitor 92, and a front strobe 93.

  The camera 91 is configured by an imaging element such as a lens or a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 92 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  The touch panel monitor 92 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 92, a still image as a photographing result and a moving image after an image such as a background is combined are displayed as appropriate.

  The front strobe 93 provided with a semicircular light emitting surface (milky acrylic board) so as to surround the upper and left and right sides of the camera 91 emits light in accordance with the photographing by the camera 91, so that it can be used as a subject. Irradiate the vicinity of the user's face from the front.

  On the front panel 41, an upper right strobe 82 and an upper left strobe 83 are installed above the photographing / display unit 81. The upper right strobe 82 emits light from the built-in strobe to illuminate the user from the front right top, and the upper left strobe 83 uses the built-in strobe to light the user. Irradiate from the upper left front as seen from the person.

  The base unit 43 is also provided with a foot strobe 84 that irradiates the user's foot. In addition to the strobe, a fluorescent lamp is provided in the upper right strobe 82, the upper left strobe 83, the foot strobe 84, and the front strobe 93. You may make it use as illumination of this. The light emitted to the user is adjusted by adjusting the light emission amount of each strobe or by adjusting the number of strobes to emit light.

  On the right side of the foot strobe 84, a coin insertion / return port 85 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 are used as a luggage storage place for a user who performs a photographing process to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for shooting processing, BGM (Back Ground Music), and sound effects is also provided.

[Configuration of the background]
FIG. 5 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear right strobe 102 for irradiating a user who is performing a photographing process in the photographing space A1 from the right rear is attached to a position of the rear panel 51 on the doorway G1 side. Further, a rear left strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the left rear is attached to the rear panel 51 on the doorway G2 side.

[Configuration of editorial department]
FIG. 6 is a diagram illustrating a configuration example of the editing unit 12 on the back side (editing space A2-2 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

[Composition of the customer service department]
FIG. 7 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. The tablet built-in monitor 161 is configured by superimposing a tablet capable of operating input using a user's finger or the like on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for the subsequent customer service process is displayed.

  A speaker 162 is provided below the tablet built-in monitor 161, and a sticker paper discharge port 163 is provided below the speaker 162.

  The speaker 162 outputs sound such as guidance voice, background music, and sound effects for the post-service processing.

  In the sticker paper outlet 163, sticker paper on which an image created by the user of the editing space A2-1 is edited or printed by the user of the editing space A2-2 is edited. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

[Internal configuration of photo sticker creation device]
Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 8 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with each configuration of the photographing unit 208, the editing unit 209, and the post-service unit 210.

  The storage unit 202 includes a nonvolatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, a background control unit 222, a lighting device 223, a camera 91, a touch panel monitor 92, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 85. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

  The illumination device 223 is a strobe (flash) provided inside each strobe in the photographing space A1, and emits light according to an illumination control signal supplied from the control unit 201. As described above, in the shooting space A 1, in addition to the strobe of the ceiling strobe unit 24, the upper right strobe 82, the upper left strobe 83, the foot strobe 84, the front strobe 93, and the back provided on the background unit 22 are provided. A central strobe 101, a back right strobe 102, and a back left strobe 103 are provided.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161 that is configured to perform the subsequent customer service in the subsequent customer service space A3, a speaker 162, a printer 241 that is configured to perform the printing process, and a sticker sheet unit 242.

  The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241 and discharges it to the sticker paper discharge port 163.

[Configuration of control unit]
Next, the control unit 201 will be described. FIG. 9 shows a configuration example of functional blocks realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 performs a process related to a charge input when starting the photo sticker creation game and a process related to a photographing work process of the photo sticker creation game such as photographing a user group. An editing processing unit 302 that performs processing related to the editing process of the photo sticker creation game such as graffiti editing, a printing processing unit 303 that performs processing related to the printing process of the photo sticker creation game such as printing of sticker paper, A post-service processing unit 304 is provided for performing processing related to the post-service process of the photo sticker creation game that serves the finished user group.

In this manner, the control unit 201 controls processing related to each process of the photo sticker creation game.
[Configuration example of edit processing section]

  FIG. 10 is a block diagram illustrating a detailed functional configuration example of the editing processing unit 302.

  The edit processing unit 302 includes a captured image acquisition unit 321, a display control unit 322, an input reception unit 323, a processing processing unit 324, a graffiti editing unit 325, and a division number setting unit 326.

  The captured image acquisition unit 321 acquires a captured image obtained by a capturing process in the capturing space A1.

  The display control unit 322 controls display on the touch panel monitor 92.

  The input receiving unit 323 receives operation inputs performed by the user for various GUIs displayed on the touch panel monitor 92.

  The processing unit 324 performs processing for performing predetermined processing on the captured image.

  The graffiti editing unit 325 performs processing related to the graffiti editing work on the photographed image by the user, which is performed in the editing space A2-1 and the editing space A2-2.

  The division number setting unit 326 performs processing relating to setting of the number of divisions of the sticker paper that determines the sticker layout. The sticker layout indicates an arrangement of images (edited images) on sticker paper that is finally output in a series of processes of the photo sticker creation game.

[Operation of photo sticker creation device]
Here, with reference to the flowchart of FIG. 11, operation | movement of the photo sticker production apparatus 1 which provides a photo sticker production game is demonstrated.

  In step S1, the imaging processing unit 301 of the photo sticker creating apparatus 1 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221 until it is determined that the coins have been inserted. stand by.

  If it is determined in step S1 that a coin has been inserted, in step S2, the imaging processing unit 301 controls the imaging unit 208 to display a moving image of the subject captured by the camera 91 on the touch panel monitor 92 in a live view. Then, a photographing process is performed in which a user in the photographing space A1 is photographed as a subject and a photographed image is output. A photographed image obtained by this photographing process is stored in the storage unit 202.

  In the photographing process, for example, six photographings are performed, and six photographed images are obtained as photographing results. Of course, the number of times of shooting is not limited to six.

  In step S3, the imaging processing unit 301 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 92 of the photographing unit 208 or by outputting sound from the speaker 224.

  In step S4, the editing processing unit 302 controls the editing unit 209 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process, The user performs a graffiti editing input on the photographed image obtained by the photographing process, and performs an editing process for outputting an edited image on which the graffiti editing has been performed.

  In step S5, the editing processing unit 302 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 6, the print processing unit 303 performs a printing process in which the photographed image obtained by the photographing process or the edited image obtained by the editing process is output as a print image to the printer 241 and printed on the sticker paper ( Start).

  Further, when the post-service processing start button displayed on the tablet built-in monitor 161 is selected, in step S7, the post-service processing unit 304 performs post-service processing for a user who is waiting for completion of printing. Specifically, the post-service processing unit 304 performs a mobile transmission game process in which a captured image or an edited image is transmitted to the mobile terminal as a mobile transmission image as the post-service processing.

  When the printing is completed, in step S8, the post-service processing unit 304 displays that the printing has been completed on the tablet built-in monitor 161, and the printer 241 discharges the sticker paper on which the image is printed to the sticker paper discharge port 163. The process is terminated.

[Editing process flow]
Next, the flow of the editing process in step S4 in the series of processes of the photo sticker creation game described above will be described with reference to the flowchart of FIG.

  When the editing process is started, the captured image acquisition unit 321 acquires, for example, six captured images obtained by the imaging processing unit 301 from the storage unit 202 in step S31.

  In step S32, the edit processing unit 302 performs a retouch process. The retouch process is a process for processing a predetermined portion of a subject (user) in a captured image based on a user operation.

  In step S33, the display control unit 322 displays a GUI on the tablet built-in monitor 131, and the input reception unit 323 receives an instruction from the user and inputs the name (name) of each user.

  In step S34, the display control unit 322 displays a GUI on the tablet built-in monitor 131, and the input reception unit 323 receives an instruction from the user and selects a background image.

  In step S <b> 35, the graffiti editing unit 325 controls the tablet built-in monitor 131, the speaker 231, and the like, and outputs images and voices that guide the flow of the graffiti work, thereby giving the user a graffiti work guidance. .

  In step S <b> 36, the display control unit 322 displays an editing screen on the tablet built-in monitor 131.

  In step S <b> 37, the graffiti editing unit 325 controls each unit of the editing unit 209 </ b> A or the editing unit 209 </ b> B (one in which the user performs editing work), and performs graffiti editing processing that accepts the graffiti work on the photographed image by the user. That is, the graffiti editing unit 325 synthesizes the image for synthesis with the image to be edited by the user's editing input.

  When the graffiti work ends, in step S38, the display control unit 322 displays a GUI on the tablet built-in monitor 131, and the input reception unit 323 receives an instruction from the user and selects the number of divisions of the sticker paper. Then, the division number setting unit 326 sets the number of divisions of the sticker paper and determines the sticker layout in accordance with an instruction from the user.

  Thereafter, when the editing processing unit 302 saves (stores) the edited image obtained as a result of the graffiti editing processing in the storage unit 202, the process returns to step S4 in FIG. 11 and the subsequent processing is performed.

[Details of retouch processing]
Here, the details of the retouching process in step S32 of FIG. 12 will be described with reference to the flowchart of FIG.

  In step S51, the processing unit 324 processes the user's eyes and face in each of the plurality of captured images. Specifically, the processing unit 324 extracts a user's eye area and a face area in each of a plurality of captured images, and processes the extracted images in each area. For example, when an eye region is extracted from one photographed image, the processing unit 324 enlarges the size of the eye included in the region in, for example, three levels, and the eye is enlarged to each size. Three captured images are generated. In addition, when a face area is extracted from one captured image, the processing unit 324 reduces the size of the face included in the area in, for example, three stages, and the face is reduced to each size. Three captured images are generated.

  Here, one of the eyes enlarged in three stages may be an unenlarged eye, and one of the faces reduced in three stages may be an unreduced face.

  In the face processing described above, only the size of the face is reduced. However, the face may be partially enlarged or reduced if the face appears to be in order.

  In the present embodiment, when there are a plurality of users, the photographing processing unit 301 can acquire a photographed image for each user by one photographing. Therefore, in this case, the processing of the eyes and face is performed on the captured image for each user.

  In step S52, the display control unit 322 displays an eye and face retouch screen, which is a selection screen for accepting selection of the degree of processing of the user's eyes and face in the captured image by the user.

  FIG. 14 is a diagram illustrating an example of an eye and face retouch screen.

  As shown in FIG. 14, the retouch screen 510 is provided with two main configurations on the left and right. Thereby, two users of basically the same set can simultaneously select the degree of processing of the user's eyes and face in the captured image.

  In the processing target image display area 511-1, a predetermined one of the captured images of the left user is displayed on the tablet built-in monitor 131, and in the processing target image display area 511-2, the tablet built-in monitor is displayed. A predetermined one of the captured images of the user on the right side with respect to 131 is displayed.

  Below the processing target image display area 511-1 are selection buttons 521-1 to 523-1 for selecting the size of the user's eyes in the captured image, and a selection button for selecting the size of the face. 531-1 to 533-1 and an OK button 541-1 for confirming the size of the selected eye and the size of the face are provided.

  The selection buttons 521-1 to 523-1 display images of eye regions having different sizes. Specifically, the selection button 521-1 displays an image of the eye region that is not enlarged, and the selection button 522-1 displays an image of the eye region that is slightly enlarged. Further, the selection button 523-1 displays an image of the eye region that is enlarged from the image of the eye region displayed on the selection button 521-2.

  Here, the images displayed on the selection buttons 521-1 to 523-1 are the eye region portions of the three photographed images generated in step S51 and enlarged in three stages. Alternatively, the model image prepared in advance may be an eye region portion of an image in which the eye size is enlarged in three stages.

  When any one of the selection buttons 521-1 to 523-1 is selected, the area of the user's eye in the captured image displayed in the processing target image display area 511-1 is generated in step S51. Replaces any eye area portion of the image.

  Specifically, when the selection button 521-1 is selected, the user's eyes in the captured image displayed in the processing target image display area 511-1 become an unmagnified eye (natural eye). When the selection button 522-1 is selected, the eyes of the user in the captured image displayed in the processing target image display area 511-1 become eyes with a slightly enlarged size (recommended eye), and the selection button 523 is selected. When −1 is selected, the user's eyes in the captured image displayed in the processing target image display area 511-1 become an enlarged eye (volume eye).

  In addition, the selection buttons 531-1 to 533-1 display images of face regions having different sizes. Specifically, the selection button 531-1 displays an image of a face area that has not been reduced, and the selection button 532-1 displays an image of a face area that has been somewhat reduced. Further, on the selection button 533-1, an image of the face area reduced from the image of the face area displayed on the selection button 531-2 is displayed.

  Here, the images displayed on the selection buttons 531-1 to 533-1 are the face area portions of the three photographed images generated in step S51 and reduced in size in three steps. Alternatively, the model image prepared in advance may be a face region portion of an image whose face size is reduced in three stages.

  When any one of the selection buttons 531-1 to 533-1 is selected, the area of the user's face in the captured image displayed in the processing target image display area 511-1 is generated in step S51. It replaces one of the facial regions of the image.

  Specifically, when the selection button 531-1 is selected, the user's face in the captured image displayed in the processing target image display area 511-1 becomes a face (natural face) having a size that is not reduced. When the selection button 532-1 is selected, the user's face in the captured image displayed in the processing target image display area 511-1 becomes a slightly reduced face (recommended face), and the selection button 533 is selected. When −1 is selected, the user's face in the captured image displayed in the processing target image display area 511-1 becomes a face having a reduced size (ultra-small face).

  The user on the left side of the tablet built-in monitor 131 selects any one of the selection buttons 521-1 to 523-1, selects any one of the selection buttons 531-1 to 533-1, and then clicks an OK button 541. By pressing -1, it is possible to change the size of the user's eyes and the size of the face in the captured image displayed in the processing target image display area 511-1.

  On the other hand, below the processing target image display area 511-2, selection buttons 521-2 to 523-2 for selecting the size of the eyes in the captured image, and a selection button 531 for selecting the size of the face. -1 to 533-2 and an OK button 541-2 for confirming the size of the selected eye and the size of the face are provided. This is the same as 521-1 to 523-1, selection buttons 531-1 to 533-1 and OK button 541-1.

  That is, the user on the right side of the tablet built-in monitor 131 selects any one of the selection buttons 521-2 to 523-2, selects any one of the selection buttons 531-2 to 533-2, and then clicks an OK button 541. By pressing -2, the user's eye size and face size in the captured image can be changed.

  In this way, a captured image in which the size of the user's eyes and the size of the face are changed is generated.

  When a predetermined time elapses without pressing either the OK button 541-1 or the OK button 541-2, that is, when a time-out occurs, the size of the eyes and the size of the face in the corresponding user's captured image. Each is changed to a predetermined size (for example, recommended eye and recommended face).

  Then, after the OK button 541-1 and the OK button 541-2 are pressed, or a predetermined time elapses without pressing any of the OK button 541-1 and the OK button 541-2, the step is performed. In S53, the processing unit 324 processes the user's eyelashes in each of the plurality of captured images. Specifically, the processing unit 324 extracts a region near the user's eyes in the captured image in which the size of the user's eyes and the size of the face are changed, and the amount of eyelashes included in the extracted region Is increased in two stages, for example, and two photographed images with the eyelashes increased in each amount are generated.

  The eyelashes are body hairs that have developed along the contours of the eyes substantially perpendicular to the contours of the eyes.

[Details of eyelash processing]
Here, the details of the eyelash processing will be described with reference to the flowchart of FIG.

  In step S71, the processing unit 324 performs face recognition on the captured image.

  In step S72, the processing unit 324 extracts a region in the vicinity of the eyes from the face region whose face is recognized in the captured image. For example, the processing unit 324 extracts a rectangular region including the eyes by specifying the outline points of the eyes.

  In step S <b> 73, the processing unit 324 performs an edge detection process or the like in the extracted region to estimate an eyelash portion, and generates a mask image of eyelashes (eyelash mask image). When estimating the eyelash part, for example, an area (line segment area) in which a plurality of line segments from which black color information is extracted in the vicinity of the outline of the eye is used as the eyelash part.

  In step S74, the processing unit 324 processes the user's eyelash portion in the captured image using the generated eyelash mask image. Specifically, the processing unit 324 performs predetermined image processing (contrast, brightness, tone change, tone curve correction, etc.) on the region corresponding to the eyelash mask image in the captured image, Emphasize the eyelashes in the captured image (make the color darker).

  According to the above-described processing, each line segment of the line segment region that is the eyelash portion is enlarged, and processing for thickening each eyelash is performed.

  In the region corresponding to the eyelash mask image of the photographed image, the eyelash mask image is shifted by a predetermined number of times in the direction in which the line segments of the line segment region that is the eyelash part are arranged, thereby performing processing to increase the number of eyelashes. You may make it do.

  Furthermore, both the process of thickening each eyelash and the process of increasing the number of eyelashes may be performed.

  By such a process, the process which increases the amount of eyelashes in a picked-up image can be performed.

  Returning to the flowchart of FIG. 13, in step S <b> 54, the display control unit 322 displays a retouch screen for eyelashes, which is a selection screen for accepting selection of the degree of processing of the user's eyelashes in the captured image.

  FIG. 16 is a diagram illustrating an example of a retouch screen for eyelashes.

  As shown in FIG. 16, the retouch screen 550 is provided with two main components on the left and right, like the retouch screen 510. Thereby, two users of basically the same set can simultaneously select the degree of processing of the user's eyelashes in the captured image.

  In addition, on the retouch screen 550, as with the retouch screen 510, a processing target image display area 511-1 and a processing target image display area 511-2 are displayed.

  Below the processing target image display area 511-1, buttons 551-1 and 552-1 for selecting the amount of the user's eyelashes in the photographed image, and the eyelashes before processing and the eyelashes after processing. A sample display area 561-1 is provided in which a sample image serving as a sample is displayed.

  The button 551-1 that fills up is a button that is selected when the user's eyelash part in the photographed image is processed (increases the amount of eyelashes), and the button 552-1 that fills up is the button of the user in the photographed image. This button is selected when the eyelash part is not processed.

  Then, when any of the buttons 551-1 and 551-2 that are filled is selected, an area of the user's eyes in the captured image displayed in the processing target image display area 511-1 is generated in step S53. It replaces any eye area of the captured image.

  Specifically, when the fill button 551-1 is selected, the user's eyelashes in the captured image displayed in the processing target image display area 511-1 are increased (ON), and the selection button 552 is selected. When 1 is selected, the user's eyelashes in the captured image displayed in the processing target image display area 511-1 are not increased (OFF).

  The user on the left side with respect to the tablet built-in monitor 131 selects one of the buttons 551-1 and 552-1 that is swelled, whereby the user in the captured image displayed in the processing target image display area 511-1 is displayed. The amount of eyelashes can be changed (one eyelash is made thicker or the number of eyelashes is increased).

  In addition, the display control part 322 receives selection of the process degree with respect to an eyelash part in the state which displayed the picked-up image which is not processed to the eyelash part in the process target image display area 511-1. That is, when the retouch screen 550 is displayed for the first time, the photographed image displayed in the processing target image display area 511-1 is in a state in which the eyelash portion is not processed (the selection button 552-1 is selected). ) Is displayed.

  Thereby, when the button 551-1 heaped up by the user is selected, the captured image displayed in the processing target image display area 511-1 is processed from the state where the eyelash portion is not processed to the eyelash portion. It will be changed to the state to which it was given, and a change of the eyelash part by processing can be impressed strongly to a user.

  On the other hand, on the lower side of the processing target image display area 511-2, buttons 551-2 and 552-2 for selecting the amount of eyelashes in the photographed image, and eyelashes before processing and eyelashes after processing are displayed. A sample display area 561-2 for displaying a sample image as a sample is provided, but these functions are basically based on buttons 551-1 and 552-1 that are prominent and a sample display area 561-1. It is the same.

  The user on the right side of the tablet built-in monitor 131 can change the amount of the user's eyelashes in the photographed image by pressing one of the buttons 551-2 and 552-2 that are filled.

  In this way, a captured image in which the amount of the user's eyelashes is changed is generated.

  Then, after a predetermined time elapses after the button 551-2 or 552-2 that has been pressed is pressed, the process returns to step S32 in FIG. 12, and the subsequent processes are performed.

  Conventionally, in order to emphasize the eyes in the captured image, the eye-enhanced image 572 is generated by enlarging the size of the eyes included in the eye region image 571 shown in FIG. In the user's face in the photographed image, if only the eyes become extremely large, an unnatural impression may be given as if processing has been performed.

  On the other hand, according to the above processing, the eye emphasis image 573 in which the eyelash part of the eye region image 571 is processed is generated, so that it does not give an unnatural impression as if it had been processed. Thus, it is possible to provide an image in which eyes are emphasized more naturally.

  In the above processing, the eyelashes are processed after the eyes and face are processed, so the user must know what image processing is performed in each processing. Can do. Therefore, it is possible to be aware of the contents of the image processing in the finally obtained image, and as a result, it is possible to provide a good-looking image that has been subjected to processing that will leave an impression on the user. .

  In the above description, the eyelash retouch screen is displayed after the eye and face retouch screen is displayed, but this order may be reversed.

  In the above, in the retouching process, the processing of the eyes and face and the processing of the eyelashes are performed by displaying different retouching screens, but these processings are displayed on the same retouching screen. You may make it carry out.

[Other examples of retouch processing]
Here, with reference to the flowchart of FIG. 18, an example of the retouching process in which the processing of the eyes and face and the processing of the eyelash part are performed by displaying the same retouching screen will be described.

  In step S91, the processing unit 324 processes the user's eyes, face, and eyelash portions in the captured image. Thus, for example, three photographed images in which the eye area is enlarged in three stages, three photographed images in which the face area is reduced in three stages, and two photographed images in which the eyelashes are increased in two stages. Is generated.

  In step S92, the display control unit 322 displays an eye, face, and eyelash retouch screen that is a selection screen for accepting selection of the degree of processing of the user's eyes, face, and eyelashes in the captured image by the user. .

  FIG. 19 is a diagram illustrating an example of a retouch screen for eyes, a face, and eyelashes.

  In the retouch screen 580 in FIG. 19, the description of the same configuration as that provided in the retouch screen 510 in FIG. 14 is omitted. That is, the retouch screen 580 in FIG. 19 is different from the retouch screen 510 in FIG. 14 in that buttons 581-1 and 582-1 and a guidance display region 583 are arranged on the left side of the processing target image display area 511-1. 1 is newly provided, and buttons 581-2 and 582-2 and a guidance display area 583-2 that are prominent are newly provided on the right side of the processing target image display area 511-2.

  Note that the buttons 581-1, 582-1, 581-2, and 582-2 that have the same functions as the buttons 551-1, 552-1, 551-2, and 552-2 that have increased. Furthermore, in the guidance display areas 583-1 and 583-2, a word “Guide” is provided to guide that the user's eyelashes in the captured image are emphasized by selecting the buttons 581-1 and 581-2 that are filled. “More buttons are available!” Is displayed.

  The user on the left side of the tablet built-in monitor 131 selects any one of the selection buttons 521-1 to 523-1, selects any one of the selection buttons 531-1 to 533-1, and further displays a button. By selecting one of 581-1 and 582-1, the size of the user's eyes, the size of the face, and the amount of eyelashes in the captured image displayed in the processing target image display area 511-1 are changed. can do.

  Similarly, the user on the right side of the tablet built-in monitor 131 selects one of the selection buttons 521-2 to 523-2, selects one of the selection buttons 531-2 to 533-2, By selecting one of the buttons 581-2 and 582-2 that can be filled, the size of the user's eyes and face in the captured image displayed in the processing target image display area 511-2, and the eyelashes The amount can be changed.

  In this way, a captured image is generated in which the size of the user's eyes, the size of the face, and the amount of eyelashes are changed.

  Then, after the OK buttons 541-2 and 541-2 are pressed or a predetermined time elapses, the process returns to step S32 in FIG. 12, and the subsequent processes are performed.

  According to the above processing, since the eye, face, and eyelash part are processed on one retouch screen, the user can check the captured image displayed in the processing target image display area while checking the captured image. Thus, the face and the eyelashes can be changed in a balanced manner, and as a result, it is possible to provide an image of the appearance desired by the user.

  In addition, as shown in FIG. 20, sample images that serve as sample eyelashes before and after processing may be displayed in the guidance display areas 583-1 and 583-2 on the retouch screen 580. .

  In the above-described processing, a six-stage process is performed on the user's eyes in the photographed image by combining the three-stage change in eye size and the two-stage change in the amount of eyelashes. Thus, a photographed image desired by the user can be provided.

  Furthermore, the degree of eyelash processing may be three or more, instead of two. As a result, it is possible to apply more stages of processing to the user's eyes in the captured image, and to provide a captured image desired by the user.

  Further, in the above-described processing, the user is allowed to select the degree of processing for the eyes, face, and eyelash portions, but the processing in which the degrees of processing for the eyes, face, and eyelash portions are combined in advance. A pattern may be prepared and the user may select it.

  For example, a selection button for selecting a genre such as “cool” or “cute” is provided on the retouch screen 580 of FIG. 19 as a processing pattern. For example, when the “cool” button is selected, the eyes of the user in the captured image are set so that the eye size is “natural eye”, the face size is “natural face”, and the eyelash is “OFF”. When the “cute” button is selected, the face size is “recommended eye”, the face size is “very small face”, and the eyelash is “ON”. In addition, the user's eyes, face, and eyelashes in the captured image are processed.

  As a result, it is possible to process the captured image according to the image represented by a genre such as “cool” or “cute” as the processing pattern, reduce the user's selection effort, and shorten the operation time. Can be planned.

  At this time, on the retouch screen 580, a selection button corresponding to the degree of processing selected by the processing pattern (for example, when a “Cool” button is selected, the selection buttons 521-1, 531-1, etc.). 582-1) is activated. Thereby, the user can grasp what kind of processing is performed on the captured image.

  In the above, the eye, face, and eyelashes are processed before the selection button for selecting the size of the eye, the size of the face, and the presence or absence of eyelashes is selected. After the selection button for selecting the size of the face and the presence or absence of eyelashes is selected, the processing corresponding to the selection button may be processed for the eyes, face, and eyelashes.

  Further, in the above, the retouch screen accepts the degree of processing for eyes, face, and eyelashes, but is not limited to this, the size and color of teak, the texture of skin, the color and shape of nose and lips The degree of processing for changing the size, the color of the hair, and the like may be received.

  Furthermore, in the above, processing for increasing the amount of eyelashes is performed as processing for eyelashes, but processing for changing the color of the eyelashes to, for example, black, gray, brown, blue, etc. Also good.

[About retouch processing to process lips]
In the above, the processing for processing the eyes and face of the user in the captured image based on the user's operation has been described as the retouch processing, but other portions may be processed.

  For example, a retouch process for processing the user's lips is performed. In this retouching process, users appearing in the captured image are individually identified, and the lips are processed for each identified user.

[Identification shooting]
First, in the photographing process, the photographing processing unit 301 performs identification photographing for identifying a user as at least one photographing among a plurality of photographings with the user as a subject. Here, the identification shooting is performed as the first shooting of the plurality of shootings, but the identification shooting may be performed as any shooting of the plurality of shootings. .

  Identification photography is photography performed in order to identify each user's face and to recognize each part (eyes, mouth, etc.) of a user's face, when there are a plurality of users who are subjects. A photographed image (hereinafter referred to as an identification image) obtained by this photographing is not subject to editing in the editing process or printed on sticker paper in the printing process, so that the face is identified and each part of the face is recognized. Used only for.

  For this purpose, in the above-described identification shooting guidance, a screen is displayed to prompt the user to take a picture and a sound is output.

  When the guidance is finished, shooting of the moving image by the camera 91 is started by the shooting control unit 301, and a moving image showing the user obtained by shooting is displayed on the live view display screen on the touch panel monitor 92.

  FIG. 21 is a diagram illustrating an example of a live view display screen for identification photography.

  At the top of the live view display screen, the message “Register each face first! Take a picture in the frame and look forward!” Is displayed. In the image display areas 511 and 512 provided under the message, moving images showing the two users are displayed in real time. Also, a message “Registered image will not be printed on the sticker!” Is displayed below the image display areas 511 and 512.

  A predetermined range is cut out from the moving image photographed by the camera 91 and used to display the image display areas 511 and 512. The two users adjust the positions of the faces so that the respective faces fit in the image display areas 511 and 512 while confirming the display of the image display areas 511 and 512.

  After such a live view image is displayed for a predetermined time, a countdown before shooting starts, and when the shooting timing comes, the shooting control unit 301 performs shooting to acquire a still image as an identification image. Then, the photographing result of the identification photographing is displayed on the touch panel monitor 92.

  As described above, after identification photography is performed, normal photography is performed a predetermined number of times.

  The identification image obtained by the identification photographing is used in a retouch process for processing the user's lips in the editing process. Note that this retouching process is performed by operating the editing screen, unlike the above-described retouching process.

[Example of edit screen]
FIG. 22 shows an example of an edit screen on which a retouch process for processing the user's lips is executed.

  The edit screen is basically configured by providing the main configuration for the left and right objects. The left half area is an area used by a user on the left side toward the tablet built-in monitor 131, and the right half area is an area used by a user on the right side toward the tablet built-in monitor 131. With such a configuration, two users can perform editing work simultaneously.

  In the following, the left half area of the editing screen will be described. In the right half area of the editing screen, the same arrangement as that arranged in the left half area described later is arranged symmetrically.

  A thumbnail image display area 711 is provided above the center of the left half area of the editing screen.

  The thumbnail image display area 711 is a display area for thumbnail images representing captured images. A user (a user on the left side of the tablet built-in monitor 131) can select a captured image to be edited by selecting a thumbnail image displayed in the thumbnail image display area 711.

  An edit area 712 is formed at substantially the center of the left half area of the edit screen.

  The edit area 712 is a display area for a captured image (edit target image) selected as an edit target. The user can select an editing tool using the touch pen 132 </ b> A and edit the captured image displayed in the editing area 712.

  A pen palette display area 713 is provided on the left side of the editing area 712.

  The pen pallet display area 713 is a display area of a pen pallet used for selecting a pen image that is a composition image used for handwriting input. In the pen palette display area 713, a plurality of buttons used to select the line type, thickness, and color of the pen image are displayed. The pen palette in the pen palette display area 713 is always displayed while the editing screen is displayed.

  An editing palette display area 714 is provided below the editing area 712.

  The editing pallet display area 714 is an editing pallet display area used for selecting a composite image mainly including a stamp image. The composition image displayed on the editing palette is divided into categories, and the composition image displayed in the editing palette display area 714 can be switched by selecting a tab with each category name. It is made like that.

  Specifically, in the example of FIG. 22, the stamp image is divided into five categories of “RECOMMEND”, “STAMP”, “MESSAGE”, “MAKE”, and “PATTERN”, of which “RECOMMEND” The tab with the category name is selected.

  Further, in the example of FIG. 22, the stamp images classified into the category “RECOMMEND” are further divided into four small categories “stamp 1”, “stamp 2”, “name”, and “date”. Among them, the button with the small category name “stamp 1” is selected.

  By the way, in the example of FIG. 22, a retouch process for processing the user's lips is performed by selecting a tab with the category name “MAKE” in the editing palette.

[Example of editing palette]
FIG. 23 shows an example of an editing palette when a retouch process for processing the user's lips is performed.

  In the example of FIG. 23, the stamp images classified into the “MAKE” category are further divided into four sub-categories of “lip”, “teak & tsukema”, “narikiri”, and “transformation”. The button with the small category name “Lip” is selected.

  In the editing palette shown in FIG. 23, the face images 721-1 and 721-2 of the respective users identified in the identification image obtained by the identification photography described above are arranged side by side with a space between each other. Is displayed.

  Below the face images 721-1 and 721-2, selection areas 722-1 and 722-2 for selecting the color of the user's lips corresponding to the face images 721-1 and 721-2 are provided. It is done.

  In the selection areas 722-1 and 722-2, a plurality of icons for individually selecting the lip colors of the identified users are displayed. Specifically, icons indicating various lip colors (lip colors) are displayed in the selection areas 722-1 and 722-2.

  For example, when an icon having a pink lip color is selected in the selection area 722-1, the color of the user's lips corresponding to the face image 721-1 in the editing target image displayed in the editing area 712 is displayed. The color is changed to pink. In addition, when an icon with a red lip color is selected in the selection area 722-2, the color of the user's lips corresponding to the face image 721-2 in the editing target image displayed in the editing area 712 is It is changed to red.

  In this way, each time a lip color icon is selected in the selected area, the color of the user's lips corresponding to the selected area where the icon is selected in the image to be edited is the color indicated by the selected icon. Changed to

  Note that the face image displayed in the editing palette is smaller than the editing target image displayed in the editing area 712. Therefore, the user sees a larger image to be edited when performing the editing work. Therefore, even if a lip color icon is selected in the selection area, the lip color of the face image corresponding to the selection area is not changed.

  Note that the lip color of the face image corresponding to the selected area may be changed by selecting the lip color icon in the selected area. In this case, the user can confirm the color of the lip after the change only by moving the line of sight within the editing palette.

  Further, the face image displayed on the editing palette is not the face image of each user identified in the identification image, but the face image of each user extracted from the image to be edited displayed in the editing area 712. Also good. As a result, the user can check the color of the lips after the change in both the editing target image displayed in the editing area 712 and the face image displayed in the editing palette.

  When the lip OFF button 723-1 is operated, the color of the user's lips corresponding to the face image 721-1 in the editing target image displayed in the editing area 712 is in the initial state (the color is changed). Return to the previous state. Similarly, when the lip OFF button 723-2 is operated, in the editing target image displayed in the editing area 712, the color of the user's lips corresponding to the face image 721-2 is in the initial state (the color is changed). Return to the state before

  Further, when the lip eraser 724 is operated and the lip portion whose color is changed in the image to be edited is traced with the touch pen, the color of the portion is changed to the initial state (before the color is changed) without distinguishing the user. Return to the state.

[About lip color change processing]
Here, with reference to the flowchart of FIG. 24, the detail of the process which changes the lip color mentioned above is demonstrated.

  In this process, the captured image selected as the image to be edited is displayed in the editing area 712 under the control of the display control unit 322, and the editing palette shown in FIG. 23 is displayed in the editing palette display area 714. Executed.

  First, in step S111, the editing processing unit 302 identifies each user who appears in the editing target image based on the identification image obtained by identification photographing.

  Next, in step S112, the input receiving unit 323 determines whether any of the lip color icons displayed in the selection area corresponding to the identified user is selected in the editing palette (FIG. 23). judge.

  The process of step S112 is repeated until one of the lip color icons is selected. If it is determined that one of the lip color icons is selected, the process proceeds to step S113.

  In step S113, the processing unit 324 changes the color of the user's lips corresponding to the selected icon to the color indicated by the selected icon in the editing target image.

  Specifically, the processing unit 324 recognizes the shape and position of the corresponding user's lips in the editing target image. Then, the processing unit 324 changes the color of the lips by synthesizing the synthesis image of the color indicated by the selected icon with the recognized shape at the position recognized in the editing target image. Note that the color of the lips may be changed simply by changing the color information of the lip area recognized in the image to be edited.

  According to the above processing, the lip color can be changed to the selected color for each user who appears in the image to be edited.

  In the above description, the lip color of each user is individually selected in the editing palette. However, the lip color of each user may be selected collectively.

[Other examples of editing palette]
FIG. 25 shows an example of an editing palette in which the lip colors of the users are selected at once.

  The editing palette shown in FIG. 25 is provided with a selection area 731 for selecting the color of the user's lips.

  The selection area 731 displays a plurality of icons for collectively selecting the lip colors of the identified users. Specifically, in the selection area 731, an icon is displayed that is formed by arranging two squares indicating the combination of lip colors of the two users identified in the identification image.

  For example, in the selection area 731, when the left square is pink and the right square is a red icon, two people identified in the identification image in the editing target image displayed in the editing area 712 are selected. Among the users, the lip color of the left user is changed to pink, and the lip color of the right user is changed to red.

  At this time, the color of the lips is changed to each color indicated by the icon for each user identified in the identification image, regardless of the user arrangement (left and right positions) in the editing target image.

  In this way, each time an icon indicating a combination of lip colors is selected in the selection area, the lip color of each user in the image to be edited is collectively changed to the respective color indicated by the selected icon. Is done.

  When the color of each user's lips is selected individually, the user may select only the color of his / her lips, and may not select the color of the lips of other users who appear together. Therefore, by selecting the color of each user's lips in a lump, the user can select the color of the lips of other users that appear together with the color of his / her lips.

  Note that more icons can be displayed in the editing palette shown in FIG. 25 because the facial images of the users identified in the identification image are not displayed. Thereby, the color of the lips can be changed to various colors.

  Now, when the replacement button 732 is operated, the lip color combinations in all the icons displayed in the selection area 731 are switched on the left and right.

  Further, when the lip OFF button 733 is operated, the color of each user's lips returns to the initial state (the state before the color is changed) in the editing target image displayed in the editing area 712.

  Further, when the lip eraser 734 is operated and the lip part whose color is changed in the image to be edited is traced with the touch pen, the color of the part is changed to the initial state (before the color is changed) without distinguishing the user. Return to the state.

  In the above description, it is assumed that there are two users. However, the form of the icon displayed in the selection area 731 may be changed depending on the number of users.

  For example, when there are three users, an icon is displayed in which three squares indicating combinations of lip colors of the three users identified in the identification image are arranged side by side.

  Usually, since there are two touch pens used for the editing work, when there are three users, one of them cannot participate in the editing work and only looks at the editing work of the other two persons. Therefore, as described above, by preparing an icon indicating the combination of the lip colors of each of the three users, the user who does not operate the touch pen is given an impression of participating in the editing work. The editing work can be enjoyed together with other users who are doing the editing work.

  When there are three or more users, it is assumed that an icon is formed in which squares indicating combinations of lip colors of the users identified in the identification image are arranged for the number of people.

  Furthermore, although not shown, a random button may be provided on the editing palette described above. When the random button is pressed, one of the icons displayed in the selection area is randomly selected, and the color of each user's lips in the image to be edited is shown in the randomly selected icon. The color is changed. As a result, an unexpected and interesting image can be provided to the user.

  In the above, only the icon indicating the lip color is displayed in the selection area of the editing palette. However, a lip gloss icon for selecting the glossiness of the lips may be further displayed. For example, as a lip gloss icon, an icon (matte icon) for making a lip glossy impression and an icon (matte icon) for reducing a lip gloss and making a matte impression are displayed. To do. In this case, after the icon indicating the lip color is selected, the glossy icon or the mat icon is selected.

  In addition, a color palette may be displayed in the selection area of the editing palette instead of the icon indicating the lip color. The color palette may be circular or matrix. In this case, the color of the user's lips in the image to be edited is changed to the color designated by the user in the color palette.

  Also, in the above, as a retouching process for processing the user's lips, the process of changing the color of the lips is performed. ), A process of changing the position may be performed.

  Further, in the above description, the lip color of each user identified by identification shooting is changed to the color selected for each user. However, each part of the face other than the lips (eyes, cheeks, The composition image synthesized on the nose or the like may be changed to the color, size, shape, or the like selected for each user.

  For example, as an image for synthesis, false eyelashes, mascara, blusher, and a stamp image simulating highlights, shading, and nose shadows on the face, the color, size, shape, etc. selected for each user To be changed to

[Another example of editing palette]
By the way, in the above, the example of the editing palette when the retouching process for processing the user's lips has been described, but here, another example of the editing palette will be described with reference to FIG. To do.

  In the example of FIG. 26, a tab with a category name “MAKE” is selected, and a button with a small category name “Narikiri” is selected.

  A captured image 741 of the user is displayed at the left end of the editing palette shown in FIG. The captured image 741 is, for example, an image that shows the user who operates the editing palette displayed on the left and right of the editing screen among the two identified users.

  A selection area 742 is provided on the right side of the captured image 741. In the selection area 742, three types of set stamp images are displayed. The set stamp image is a set of stamp images corresponding to each part of the user's face.

  A selection area 743 is provided on the right side of the selection area 742. In the selection area 743, stamp images having designs corresponding to three types of set stamp images are displayed.

  Here, when one of the three types of set stamp images is selected in the selection area 742, the user corresponding to the captured image 741 (that is, the set image) in the editing target image displayed in the editing area 712. The selected set stamp image is synthesized with each part (specifically, the nose, cheek, and head) of the face of the user who has selected the stamp image. Each stamp image corresponding to each part of the face constituting the set stamp image is synthesized with each part of the face by performing the face recognition process of the user on the editing target image.

  At this time, in the editing target image displayed in the editing area 712, the set stamp image is not combined with the face of the user that does not correspond to the captured image 741.

  In this way, the selected set stamp image is synthesized for each identified user.

  The series of processes described above can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 205 made of semiconductor memory, etc., but also pre-installed in the main unit The ROM 206 that stores the program and the hard disk included in the storage unit 202 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 11 Shooting unit 12 Editing part 13 Subsequent customer service part 201 Control part 208 Imaging | photography part 209 Editing part 210 Subsequent customer service part 301 Imaging | photography process part 302 Editing process part 303 Print process part 304 Post-service customer process part 321 322 Display control unit 323 Input reception unit 324 Processing processing unit 325 Graffiti editing unit 326 Division number setting unit

Claims (15)

Photographing means for photographing a user as a subject and obtaining a photographed image;
Processing means for processing the user's eyelash part in the captured image;
A photo sticker creating apparatus comprising: a display unit configured to display a selection screen for accepting selection of a degree of processing for the eyelash portion in the photographed image by the user. The photo sticker creating apparatus according to claim 1, wherein the display unit displays a selection screen for accepting selection of whether or not the eyelash portion is processed. The photo sticker creating apparatus according to claim 1, wherein the display unit displays a selection screen for accepting selection of any of a plurality of levels of processing for the eyelash portion. 4. The display unit displays the captured image obtained by processing the eyelash part with the degree of processing selected by the user on the selection screen in a predetermined area on the selection screen. 5. The photo sticker making apparatus according to the above 5. The photo sticker creation according to claim 4, wherein the display unit receives selection of a degree of processing for the eyelash portion in a state where the photographed image in which the eyelash portion is not processed is displayed in the predetermined region. apparatus. The processing means performs other processing on a region other than the user's eyelash portion in the captured image,
The photo sticker creating apparatus according to any one of claims 1 to 5, wherein the display unit displays a selection screen for accepting selection of another processing degree for a region other than the eyelash portion. The said display means displays the selection screen which receives selection of the process degree with respect to the said eyelash part, and the selection screen which receives selection of the other process degree with respect to area | regions other than the said eyelash part at a different timing. Photo sticker creation device. The photographic sticker creating apparatus according to claim 6, wherein the display unit displays a selection screen that accepts both a selection of a degree of processing for the eyelash part and a selection of another degree of processing for an area other than the eyelash part. The display means displays a selection screen for accepting selection of a processing pattern in which a predetermined degree of processing for the eyelash part and another predetermined degree of processing for a region other than the eyelash part are combined in advance. The photo sticker making apparatus described in 1. The photographing means photographs the user a plurality of times, acquires a plurality of the photographed images,
The photographic sticker creating apparatus according to any one of claims 1 to 9, wherein the processing unit performs processing of a degree selected by the user on any or all of the plurality of photographed images. The photographing means acquires the photographed images of the plurality of users by one photographing,
The photo sticker creating apparatus according to any one of claims 1 to 10, wherein the display unit displays a selection screen that receives selection of a degree of processing for each of the captured images by a plurality of users. The photographic sticker creating apparatus according to any one of claims 1 to 11, wherein the processing unit performs processing to increase an amount of the user's eyelashes in the captured image. The photographic sticker creating apparatus according to any one of claims 1 to 11, wherein the processing means performs processing to change a color of the user's eyelashes in the photographed image. Take a picture of a user as a subject, get a shot image,
Apply processing to the user's eyelashes in the captured image,
An image processing method including a step of displaying a selection screen for accepting selection of a degree of processing for the eyelash part in the photographed image by the user. Take a picture of a user as a subject, get a shot image,
Apply processing to the user's eyelashes in the captured image,
A program for causing a computer to execute a process including a step of displaying a selection screen for accepting selection of a degree of processing for the eyelash part in the photographed image by the user.

Images