JP6136769B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present disclosure relates to an image processing device, an image processing method, and a program, and more particularly, to an image processing device, an image processing method, and a program that can improve user satisfaction.

  2. Description of the Related Art Conventionally, an image providing apparatus is installed in an entertainment (game) facility or the like, images a subject in an imaging space, moves a user to an editing space, and acquires an image obtained by imaging according to an operation performed in the editing space. One game is completed with a flow of editing (doodle) and printing the edited image or photographed image on photo sticker paper.

  In recent years, with the spread of the Internet, an edited image or a captured image is transmitted from an image providing apparatus to a mobile terminal (such as a mobile phone or a smartphone) for use. For example, a user operates a personal diary or a group of several people and updates the daily diary-like web pages (= professional blogs / SNS (Social Networking Service)). , Which is published with daily notes or commentary. Also, for the purpose of use like a business card, a user posts an edited image or a photographed image as a profile image on a personal web page (= prof blog / blog / SNS) and makes it available to friends and the like.

  As such an image providing apparatus, there is an apparatus that identifies a face detected in each photographed image and performs special photographing other than normal photographing when the number of photographers is three or less. In special shooting, individual images are generated for each user from shot images obtained by shooting two people at the same time. An image generated by such special shooting is transmitted via a mobile terminal and posted as a user's own profile image on a web page or the like.

  In addition, for the purpose of saving the image transmitted to the mobile terminal as a recording image for recording the user's state at the time of shooting, specifically, the user's appearance at the time of shooting, Thus, a compositing image used for compositing is generated. When a composite image for one person is selected as the composite image, a plurality of users (for example, two people) transmit each of them to the mobile terminal in one shooting, and then there are two different users. Images can be obtained.

  For example, Patent Literature 1 discloses a technique for displaying a frame on which a user can be individually accommodated on a live view screen, and performing shooting after guiding the user's face to enter the frame.

  Further, Patent Document 2 discloses an image (region) to be transmitted to a mobile terminal from an edited image selected as an image for creating a mobile transmission-dedicated image when the mobile phone bonus button is pressed on the mobile phone bonus creation screen. A technique for displaying an image cropping designation screen for trimming (cutting) a. Then, on the designation screen, the portable transmission-dedicated image is configured using a partial area of the edited image designated as an image for creating the portable transmission-dedicated image.

  Further, in Patent Document 3, for example, a sample synthesis image is selected, and the range in which the user's face is recognized in the captured moving image as the sample synthesis image is shown as the target range of image processing. A technique for changing the size of the frame line and the region and controlling the display so as to display in real time is disclosed. Then, at least one of a frame line and a region indicating the position of the model is superimposed on the image and displayed on the display unit in real time, and photographing is performed so as to enter the frame line displayed on the display unit.

Patent registration 5003852 JP 2013-77946 A Patent Registration No. 5115528

  By the way, in the techniques disclosed in the prior art documents 1 and 2, an image obtained by special photographing is optimal for use as a profile image because only one user is captured in the image. However, in the configuration in which a frame is displayed on the live view screen for shooting, when users are too close to each other, a part of another user's body may enter the frame.

  On the other hand, for example, it is considered that part of the body of another user can be avoided by reducing the frame displayed on the live view screen. However, if the frame displayed on the live view screen is made smaller, the user falls down to enter the frame, and the user cannot be taken up. It is difficult to photograph clearly. Furthermore, when the frame displayed on the live view screen is reduced, the user has to move the face up and down and left and right to enter the frame, which increases the time and effort. User satisfaction is reduced.

  Further, as disclosed in Prior Art Document 3, by providing a frame or the like indicating the position of the model in the image, the user can be guided to enter the frame, but as described above When the frame line is displayed in a small size, it is difficult to clearly photograph the user's face, and the user has to move the face. Therefore, user satisfaction is reduced.

  As described above, in the conventional image providing apparatus, when users are photographed too close to each other, a part of another user's body is included in an image obtained by special photographing in which only one user is photographed. It may be reflected. Since such an image is not suitable for use as a profile image, user satisfaction is reduced. In addition, when a user goes down to shoot a part of another user's body in an image obtained by special shooting, the user's face is not clearly shot. Satisfaction will be reduced.

  Therefore, even if the users do not get too close to each other, and even if the users do not fall, the users can take a special shot and take a picture without other people appearing. It is required to improve user satisfaction by providing an image that clearly captures the person's face.

  The present disclosure has been made in view of such a situation, and is intended to provide an image with higher user satisfaction.

An image processing apparatus according to an aspect of the present disclosure includes a photographing unit that shoots a plurality of users as subjects and generates a photographed image, and each of the plurality of users photographed in the photographed image. A decoration image addition processing unit that performs a process of adding a decoration image that decorates the user only on the side where another user is present with respect to the user, and the captured image with the decoration image added thereto as a live view image As a display unit.

An image processing method or program according to an aspect of the present disclosure generates a photographed image by photographing a plurality of users as subjects, and uses each of the plurality of users captured in the photographed image. A process of adding a decoration image that decorates the user only to the side where the other user is present to the user, and displaying the captured image with the decoration image added as a live view image .

In one aspect of the present disclosure, a plurality of users are photographed and a photographed image is generated, and each of the plurality of users photographed in the photographed image has a different image for each user. Only on the side where the user is present, a process of adding a decoration image for decorating the user is performed, and the captured image with the decoration image added is displayed as a live view image .

  According to one aspect of the present disclosure, it is possible to provide an image with higher user satisfaction.

It is a perspective view which shows the structural example of the external appearance of the photograph sticker production apparatus which concerns on one embodiment of this invention. It is the perspective view which looked at the external appearance of the photograph sticker production apparatus from another angle. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging | photography part. It is a figure which shows the structural example of a background part. It is a figure which shows the structural example of an edit part. It is a figure which shows the structural example of a customer service part after the fact. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of a control part. It is a functional block diagram which shows the detailed structural example of the imaging | photography process part of FIG. It is a flowchart explaining the outline of a process of the photograph sticker creation apparatus which provides a photograph sticker creation game. It is a flowchart explaining an imaging | photography process. It is a figure which shows the example of a display of a guidance screen. It is a figure explaining the special image which added the aura image. It is a flowchart explaining the process of special imaging | photography. It is a figure which shows the example of a display of a pause sample screen. It is a figure which shows the example of a display of a live view screen. It is a figure which shows the example of a display of a camera gaze screen. It is a figure which shows the example of a display of an imaging | photography result screen. It is a figure which shows the left half of an edit screen. It is a figure which shows the right half of an edit screen. It is a figure explaining the image processing which produces | generates the special image which added the aura image. It is a figure which shows the variation of an aura image. It is a figure which shows the modification of an aura image.

  Hereinafter, embodiments of the present invention will be described.

[External structure of photo sticker creation device]
FIG. 1 is a perspective view showing a configuration example of the appearance of the photographic sticker creating apparatus 1.

  The photo sticker creating apparatus 1 is a game machine that allows a user to perform operations such as shooting and editing as a game and receives a price from the user instead of providing a shot image or an edited image. The photo sticker creating apparatus 1 is installed in a store such as a game center. There may be one user, but there are mainly two or three users.

  A user who plays in the game provided by the photo sticker creating apparatus 1 pays the price, takes a picture of himself as a subject, and selects an image to be edited selected from the shot images obtained by shooting. A photographed image is edited into a rich image by using an editing function that combines a composition image that becomes a background or foreground image, a handwritten line drawing, or a stamp image. The user receives the sticker sheet on which the edited image is printed and ends the series of games.

  As shown in FIG. 1, the photo sticker creating apparatus 1 mainly includes a photographing unit 11, an editing unit 12, and a subsequent customer service unit 13. The photographing unit 11 and the editing unit 12 are installed in contact with each other, and the editing unit 12 and the subsequent customer service unit 13 are installed in contact with each other.

  The photographing unit 11 includes a photographing unit 21 and a background unit 22. The photographing unit 21 and the background unit 22 are installed with a predetermined distance apart, and photographing processing is performed in a photographing space that is a space formed between the photographing unit 21 and the background unit 22.

  The photographing unit 21 is a device that performs photographing processing for photographing a user. The photographing unit 21 enters the photographing space and is located in front of the user who is performing the photographing process. A front panel 41 of the photographing unit 21 that constitutes a surface facing the photographing space in front is provided with a touch panel monitor or the like used by the user during photographing processing. When the left side as viewed from the user in the imaging space is the left side and the right side is the right side, the left side of the imaging unit 21 is constituted by a side panel 42A, and the right side is a side panel 42B (not shown). Consists of.

  The side panel 42A is provided with an LED light emitting unit 42L in which a plurality of LEDs (Light Emitting Diodes) are embedded. The surface of the side panel 42A is composed of an acrylic plate or the like on which advertisements of products or services of a manufacturer of the photo sticker creating apparatus 1 or a company affiliated with the manufacturer are printed so as to cover the entire surface of the side panel 42A. The POP advertisement to be attached is attached. Information particularly appealing as an advertisement is printed on a portion corresponding to the LED light emitting portion 42L of the POP advertisement, and the information is emphasized by light emission of the LED light emitting portion 42L. The LED light emitting unit 42L may be provided also on the side panel 42B (not shown), or may be provided only on one of the side panel 42A and the side panel 42B.

  The background unit 22 is attached to the left end of the rear panel 51 and the rear panel 51, which are plate-like members positioned on the rear side of the user who is performing the photographing process facing the front, and is a plate having a narrower width than the side panel 42A. The side panel 52A (not shown) is a plate-like member that is attached to the right end of the rear panel 51 and is narrower than the side panel 42B.

  The side panel 42A constituting the left side surface of the photographing unit 21 and the side panel 52A of the background unit 22 are provided on substantially the same plane, and each lower part is formed by, for example, a connecting part 23A having a plate-like member. It is connected by a connecting portion 23A ′, which is a metal substantially U-shaped member. Although not shown, the side panel 42B that constitutes the right side surface of the photographing unit 21 and the side panel 52B of the background unit 22 are provided on substantially the same plane, and each upper part is connected by a connecting unit 23B that is a plate-like member. Each lower part is connected by connection part 23B 'which is a substantially U-shaped member made of metal, for example.

  An opening formed by being surrounded by the side panel 42 </ b> A of the photographing unit 21, the connecting part 23 </ b> A, and the side panel 52 </ b> A of the background part 22 becomes an entrance G <b> 1 of the photographing space. Although not shown, an opening formed by being surrounded by the side panel 42B of the photographing unit 21, the connecting part 23B, and the side panel 52B of the background 22 is also an entrance G2 of the photographing space.

  The background curtain unit 25 is provided above the background portion 22 so as to be supported by the back panel 51, the side panel 52A, and the side panel 52B. The background curtain unit 25 stores a plurality of winding-type background curtains having different colors or patterns and used for the background. The background curtain unit 25 operates in conjunction with photographing by a camera or the like provided in the photographing unit 21. At the time of photographing, for example, the curtain of the color selected by the user is lowered and the other curtains are wound up.

  In addition, as a background curtain accommodated in the background curtain unit 25, an elevating curtain that uses a plurality of curtains as one chroma key curtain may be prepared. In addition, a curtain for the chroma key is pasted on the rear panel 51 which is the back of the shooting space in advance, and a plurality of types of background images for synthesis are prepared, and a background image desired by the user is captured in the shooting process and editing process. It may be possible to synthesize it into parts.

  An opening surrounded by the front panel 41 of the photographing unit 21, the connecting part 23A, the connecting part 23B, and the background curtain unit 25 is formed above the photographing space, and the ceiling strobe unit 24 covers the part of the opening. Provided. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that emits light toward the photographing space in accordance with photographing. A fluorescent lamp is provided inside the strobe constituting the ceiling strobe unit 24, and also functions as illumination of the photographing space.

  The editing unit 12 is a device that allows a user to perform editing processing, which is processing for editing an image obtained by shooting processing. The editing unit 12 is provided so as to be connected to the photographing unit 11 so that one side surface thereof is in contact with the back surface of the front panel 41 of the photographing unit 21. The editing unit 12 is provided with a configuration such as a tablet built-in monitor used by the user during editing processing.

  If the configuration of the editing unit 12 shown in FIG. 1 is a front-side configuration, the editing unit 12 is used for editing processing on the front side and the back side so that two sets of users can perform editing processing simultaneously. Each configuration is provided.

  The front side of the editing unit 12 is a surface perpendicular to the floor surface, and is composed of a surface 71 that is substantially parallel to the side panel 42A, and a slope 72 formed above the surface 71. The configuration used is provided on the slope 72. On the left side of the slope 72, a support portion 73A that has a columnar shape and supports one end of the lighting device 74 is provided. A support portion 73 </ b> B (FIG. 2) that supports the other end of the lighting device 74 is also provided on the right side of the slope 72. A plate-like panel 73C constituting the side surface of the editing unit 12 is provided on the right side of the support unit 73A. A support portion 75 that supports the curtain rail 26 is provided on the upper surface of the panel 73C.

  A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is configured by combining three rails 26A to 26C so that the shape when viewed from above is a U-shape. One end of the rails 26A and 26B provided in parallel is fixed to the connecting portion 23A and the connecting portion 23B, respectively, and both ends of the remaining one rail 26C are joined to the other end.

  A curtain is attached to the curtain rail 26 so that the inside of the space in front of the editing unit 12 and the space in front of the back cannot be seen from the outside. The space in front of the editing unit 12 and the space in front of the back of the editing unit 12 surrounded by the curtain attached to the curtain rail 26 are editing spaces in which the user performs editing processing.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 as seen from another angle.

  The subsequent customer service unit 13 is a device that allows the user to perform the subsequent customer service process. Subsequent customer service processing includes processing for transmitting a photographed image or edited image to a mobile terminal such as a mobile phone, processing for allowing a user to play a mini game, processing for answering a questionnaire, and the like.

  As shown in FIG. 2, the post-service unit 13 has a plate-shaped housing having a predetermined thickness as a part thereof, and the remaining part is provided integrally with the left side surface of the editing unit 12. On the front side of the post-service unit 13, there are provided a tablet built-in monitor used by the user at the time of post-service processing, a discharge port through which sticker paper on which a photographed image or an edited image is printed is discharged. The space in front of the front-end customer service unit 13 becomes a rear-end customer service space where a user waiting for printing on the sticker paper to perform post-service processing.

  Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described with reference to FIG. FIG. 3 is a plan view of the photo sticker creating apparatus 1 as viewed from above.

  The user of the photo sticker creating apparatus 1 is formed between the photographing part 21 and the background part 22 from the entrance G1 as indicated by the white arrow # 1 or from the entrance G2 as indicated by the white arrow # 2. The camera enters the shooting space A1 and performs a shooting process using a camera, a touch panel monitor, or the like provided in the shooting unit 21.

  The user who has finished the shooting process exits the shooting space A1 and moves to the editing space A2-1 using the doorway G1 as indicated by the white arrow # 3, or moves to the editing space A2-1 as indicated by the white arrow # 4. To leave the shooting space A1 and move to the editing space A2-2.

  The editing space A2-1 is an editing space on the front side of the editing unit 12, and the editing space A2-2 is an editing space on the back side of the editing unit 12. Which of the editing space A2-1 and the editing space A2-2 is moved is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty space of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing processing. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing processing at the same time.

  After the editing process is finished, printing of an image selected from the photographed image and the edited image is started. During printing of the image, the user who has finished the editing process moves from the editing space A2-1 to the subsequent customer service space A3 as indicated by the white arrow # 5 if the editing process has been performed in the editing space A2-1. Then, the customer service is processed after the fact. In addition, when the editing process is completed in the editing space A2-2, the user who has finished the editing process moves from the editing space A2-2 to the post-service area A3 as indicated by the white arrow # 6. Post service processing is performed in the customer service space A3.

  When the printing of the image is finished, the user receives the sticker paper from the outlet provided in the post-service section 13 and finishes a series of photo sticker creation games.

  Next, the configuration of each device will be described.

[Configuration of shooting section]
FIG. 4 is a diagram illustrating a configuration example of the front of the photographing unit 21. The photographing unit 21 is configured by attaching a front panel 41, a side panel 42A, and a side panel 42B to a base unit 43 having a box shape.

  The front panel 41 is positioned in front of the user who performs the shooting process in the shooting space A1, and the side panel 42A and the side panel 42B are positioned on the left side and the right side of the user who performs the shooting process in the shooting space A1, respectively.

  An imaging / display unit 81 is provided in the approximate center of the front panel 41. The photographing / display unit 81 includes a camera 91, a touch panel monitor 92, and a front strobe 93.

  The camera 91 is configured by an imaging element such as a lens or a CCD (Charge Coupled Device), and photographs a user in the photographing space A1. The moving image captured by the camera 91 is displayed on the touch panel monitor 92 in real time. An image captured by the camera 91 at a predetermined timing such as when a user gives an instruction to shoot is saved as a photographic image (still image).

  The touch panel monitor 92 provided on the lower side of the camera 91 includes a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91 and a function that displays various GUI (Graphical User Interface) images and accepts a user's selection operation through the touch panel. ing. On the touch panel monitor 92, a still image as a photographing result and a moving image after an image such as a background is combined are displayed as appropriate.

  A plurality of front strobes 93 provided so as to surround the upper and left and right sides of the camera 91 have a plurality of light emitting surfaces made of a milky white acrylic plate. The front strobe 93 illuminates the vicinity of the user's face as a subject from the front by emitting light in accordance with shooting by the camera 91. In addition, as a milky white acrylic board provided as a light emission surface of the front flash 93, a highly transparent thing is used. Thereby, the diffusion degree of the light by light emission of the front strobe 93 can be suppressed as compared with the case of using a milky acrylic board with low transparency, and more light can be irradiated to the user. .

  On the front panel 41, an upper strobe 82 is installed above the photographing / display unit 81, and the upper strobe 82 irradiates the user from the upper front.

  The base unit 43 is also provided with a foot strobe 83 that irradiates the user's foot. A fluorescent lamp is provided inside the upper strobe 82 and the foot strobe 83, and is used as illumination in the photographing space A1 together with the fluorescent lamp inside the strobe constituting the ceiling strobe unit 24. By adjusting the light emission amount of each fluorescent lamp, or by adjusting the number of fluorescent lamps to emit light, the brightness in the shooting space A1 depends on the content of the shooting process performed by the user. Adjust as appropriate.

  On the right side of the foot strobe 83, a coin insertion / return port 84 through which a user inserts money is provided.

  Spaces 43A and 43B formed on the left and right sides of the upper surface of the base portion 43 are used as a luggage storage place for a user who performs a photographing process to place baggage and the like. For example, near the ceiling of the front panel 41, a speaker for outputting sound such as guidance sound for photographing processing, BGM (Back Ground Music), and sound effects is also provided.

[Configuration of the background]
FIG. 5 is a diagram illustrating a configuration example of the background portion 22 on the photographing space A1 side.

  As described above, the background curtain unit 25 is provided above the back panel 51. Near the center of the background curtain unit 25, a back center strobe 101 that irradiates a user who is performing a photographing process in the photographing space A1 from the rear center is attached.

  A rear left strobe 102 for irradiating a user who is performing a photographing process in the photographing space A1 from the left rear is attached to the rear panel 51 on the doorway G1 side. Further, a rear right strobe 103 that irradiates a user who is performing a photographing process in the photographing space A1 from the right rear is attached to a position of the rear panel 51 on the doorway G2 side.

[Configuration of editorial department]
FIG. 6 is a diagram illustrating a configuration example of the editing unit 12 on the front side (editing space A2-1 side).

  A tablet built-in monitor 131 is provided at substantially the center of the slope 72. A touch pen 132A is provided on the left side of the tablet built-in monitor 131, and a touch pen 132B is provided on the right side.

  The tablet built-in monitor 131 is configured by superimposing a tablet capable of operation input using the touch pen 132A or 132B on a monitor such as an LCD. On the tablet built-in monitor 131, for example, an editing screen that is a screen used for editing a captured image selected as an image to be edited is displayed. When two people perform editing work simultaneously, the touch pen 132A is used by one user, and the touch pen 132B is used by the other user.

  On the left side of the editing unit 12, a post-service unit 13 is provided.

[Composition of the customer service department]
FIG. 7 is a diagram illustrating a configuration example of the front side of the post-service unit 13.

  A monitor 161 with a built-in tablet is provided at the upper center of the post-service section 13. A touch pen 162A is provided on the left side of the tablet built-in monitor 161, and a touch pen 162B is provided on the right side. Similarly to the tablet built-in monitor 131, the tablet built-in monitor 161 is configured by superimposing a tablet capable of operating input using the touch pen 162 </ b> A or 162 </ b> B on a monitor such as an LCD. On the tablet built-in monitor 161, a screen used for post-service processing such as a mini game is displayed.

  A photo sticker outlet 163 is provided below the tablet built-in monitor 161, and a speaker 164 is provided above the tablet built-in monitor 161.

  In the photo sticker discharge port 163, a sticker sheet on which an image created by the user of the editing space A2-1 is edited, or a user of the editing space A2-2 performs the editing process. The sticker paper on which the created image is printed is discharged. A printer is provided inside the editing unit 12, and printing of images is performed by the printer.

  The speaker 164 outputs sounds such as guidance voice, BGM, and sound effects for post-service processing.

[Internal configuration of photo sticker creation device]
Next, the internal configuration of the photo sticker creating apparatus 1 will be described. FIG. 8 is a block diagram illustrating an internal configuration example of the photo sticker creating apparatus 1. The same code | symbol is attached | subjected to the same structure as the structure mentioned above. The overlapping description will be omitted as appropriate.

  The control unit 201 includes a CPU (Central Processing Unit) and the like, executes a program stored in a ROM (Read Only Memory) 206 and a storage unit 202, and controls the overall operation of the photo sticker creating apparatus 1. A storage unit 202, a communication unit 203, a drive 204, a ROM 206, and a RAM (Random Access Memory) 207 are connected to the control unit 201. The control unit 201 is also connected with each configuration of the photographing unit 208, the editing unit 209, and the post-service unit 210.

  The storage unit 202 includes a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 201. Information stored in the storage unit 202 is appropriately read out by the control unit 201.

  A communication unit 203 is an interface of a network such as the Internet, and communicates with an external device according to control by the control unit 201.

  A removable medium 205 made of an optical disk, a semiconductor memory, or the like is appropriately attached to the drive 204. Computer programs and data read from the removable medium 205 by the drive 204 are supplied to the control unit 201 and stored in the storage unit 202 or installed.

  The ROM 206 stores programs and data executed by the control unit 201. The RAM 207 temporarily stores data and programs processed by the control unit 201.

  The imaging unit 208 includes a coin processing unit 221, a background control unit 222, a lighting device 223, a camera 91, a touch panel monitor 92, and a speaker 224 that are configured to perform imaging processing in the imaging space A1.

  The coin processing unit 221 detects the insertion of coins into the coin insertion / return port 84. When the coin processing unit 221 detects that a predetermined amount of coins such as 400 yen has been inserted, the coin processing unit 221 outputs an activation signal indicating that to the control unit 201.

  The background control unit 222 raises and lowers the background curtain stored in the background curtain unit 25 according to the background control signal supplied from the control unit 201. The background curtain may be manually selected by the user.

The illumination device 223 is each strobe in the imaging space A1, and emits light according to an illumination control signal supplied from the control unit 201. In the photographing space A1, in addition to the strobe of the ceiling strobe unit 24, the front strobe 93, the upper strobe 82, and the foot strobe 83 of the photographing unit 21, the back center strobe 101, the back left strobe 102 of the background unit 22, and A rear right strobe 103 is provided.

  Further, the lighting device 223 adjusts the brightness in the shooting space A1 according to the stage of the shooting work performed by the user by adjusting the light emission amount according to the control by the control unit 201.

  The camera 91 shoots according to the control by the control unit 201 and outputs an image obtained by the shooting to the control unit 201.

  The editing unit 209A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 231 provided on the front side of the editing unit 12 as a configuration for performing editing processing in the editing space A2-1. The editing unit 209B has the same configuration as the editing unit 209A, and performs editing processing in the editing space A2-2.

  The tablet built-in monitor 131 displays an editing screen according to control by the control unit 201, and detects a user operation on the editing screen. A signal representing the content of the user's operation is supplied to the control unit 201, and the captured image to be edited is edited.

  The subsequent customer service unit 210 includes a tablet built-in monitor 161 that is configured to perform subsequent customer service in the subsequent customer service space A3, touch pens 162A and 162B, a speaker 164, a printer 241 that performs print processing, and a sticker unit 242. The

  The printer 241 prints the photographed image or the edited image obtained by the editing process on the sticker paper stored in the sticker paper unit 242 attached to the printer 241, and discharges it to the photo sticker discharge port 163. .

[Configuration of control unit]
Next, the control unit 201 will be described. FIG. 9 shows an example of the functional block configuration realized by the control unit 201 executing a program stored in the ROM 206 or the like.

  The control unit 201 controls processing related to each process of the photo sticker creation game, and includes a photographing processing unit 301, an editing processing unit 302, a print processing unit 303, and a post-service processing unit 304 as shown in FIG. .

  The photographing processing unit 301 performs processing related to a process of photographing work of the photo sticker creation game, such as processing relating to a charge input when starting the photo sticker creation game and photographing a user group.

  The editing processing unit 302 performs processing related to the editing work process of the photo sticker creation game such as graffiti editing for a photographed image.

  The print processing unit 303 performs processing related to the printing process of the photo sticker creation game such as printing of sticker paper.

  The subsequent customer service processing unit 304 performs a process related to the subsequent customer service process of the photo sticker creating game for serving the user group that has finished the editing work.

[Details of shooting processing section]
FIG. 10 shows a detailed configuration example of the imaging processing unit 301 in FIG.

  As illustrated in FIG. 10, the photographing processing unit 301 includes a photographing control unit 321, an image processing unit 322, a display control unit 323, an operation reception unit 324, and a face authentication processing unit 325.

  The shooting control unit 321 controls the camera 91 and performs shooting a plurality of times using the user as a subject to obtain a plurality of shot images.

  The image processing unit 322 performs various types of image processing on the captured image captured by the camera 91.

  The display control unit 323 controls display on the touch panel monitor 92.

  The operation receiving unit 324 detects a user's touch on the touch panel monitor 92 and receives an operation corresponding to the touch.

  The face authentication processing unit 325 performs face authentication processing for authenticating the face of the subject captured in the captured image taken by the camera 91, and determines the number of users.

[Operation of photo sticker creation device]
Next, an outline of the processing of the photo sticker creating apparatus 1 that provides a photo sticker creating game will be described with reference to the flowchart of FIG. The photo sticker creating apparatus 1 takes a user as a subject and finally provides the image to the user. As a providing method, as described below, it is provided by printing on a sticker sheet or by sending it to a portable terminal (not shown) so that it can be viewed on the portable terminal.

  In step S1, the imaging processing unit 301 determines whether or not a predetermined amount of coins has been inserted based on a signal supplied from the coin processing unit 221, and waits until it is determined that the coin has been inserted.

  If it is determined in step S1 that a coin has been inserted, in step S2, the imaging processing unit 301 controls the imaging unit 21 and executes imaging processing. At this time, for example, a shooting process is performed in which a moving image of a subject captured by the camera 91 is displayed in a live view on the touch panel monitor 92 and a user in the shooting space A1 is taken as a subject. Further, in the photographing process, an up-photographing for photographing the user's face or upper body is performed, but a whole-body photographing for photographing the whole body of the user may be performed.

  In step S3, the imaging processing unit 301 guides the user in the imaging space A1 to move to the editing space A2-1 or the editing space A2-2. The guidance for movement to the editing space A2-1 or the editing space A2-2 is performed by displaying a screen on the touch panel monitor 92 of the photographing unit 21 or by outputting sound from the speaker 224.

  In step S4, the editing processing unit 302 controls the editing unit 209 corresponding to the editing space of the editing space A2-1 and the editing space A2-2 that is the destination of the user who has finished the shooting process, Edit processing. Specifically, the editing processing unit 302 causes the user to select a synthesis image to be synthesized with the captured image selected as the editing target image, synthesizes the selected synthesis image with the captured image, and obtains the obtained synthesis. The image is edited according to the editing operation by the user.

  In step S5, the editing processing unit 302 guides the user who has finished the editing process in the editing space A2-1 or the editing space A2-2 to move to the post-service space A3. The guidance of the movement to the post-service space A3 is performed by displaying a screen on the tablet built-in monitor 131 or by outputting sound from the speaker 231.

  In step S <b> 6, for example, the print processing unit 303 performs a printing process in which an image selected by the user among the captured image and the edited image is output to the printer 241 and printed on a sticker sheet.

  Further, when the post-service processing start button displayed on the tablet built-in monitor 161 is selected, in step S7, the post-service processing unit 304 performs post-service processing for a user who is waiting for completion of printing. Specifically, the post-service processing unit 304 performs mobile transmission processing for transmitting a photographed image or an edited image to the mobile terminal as post-service processing, and directly inputs the e-mail address of the mobile terminal so that the image is transmitted to the mobile terminal. Or display a selection screen for a transmission method that allows a user to select whether to transmit an image to a mobile terminal by communicating with a non-contact type IC or a selection screen for an image to be transmitted on the tablet built-in monitor 161. An image is transmitted in response to a user operation.

  When printing is completed, in step S8, the customer service processing unit 304 displays on the tablet built-in monitor 161 that printing has been completed, and the printer 241 discharges the sticker paper on which the image has been printed to the photo sticker discharge port 163. The process is terminated.

  Here, the photo sticker creating apparatus 1 generates a plurality of images from the normal shooting in which one image is generated in one shooting and the images acquired in one shooting in the shooting processing in step S2. Special shooting can be performed. For example, in normal shooting, one shot image is generated by shooting a plurality of users in the shooting space A1 as they are, and in special shooting, shooting is performed at once by a plurality of users in the shooting space A1. However, a photographed image for each user cut out so that each user is photographed alone is generated. In the special shooting, a shot image (a so-called bust-up image) in which the upper side of the chest of the user is taken or a shot image in which the whole body of the user is shot is shot. Hereinafter, as appropriate, a captured image captured by normal shooting is referred to as a normal image (for example, an image in which a plurality of subjects are captured), and a captured image of each user captured by special shooting is referred to as a special image.

  In addition, the photo sticker creating apparatus 1 can provide images having different atmospheres by selecting one of two types of courses, a natural course and a perfect course, in the photographing process. The natural course provides images with a soft atmosphere, and the perfect course provides images with a clear atmosphere.

  Next, FIG. 12 is a flowchart for explaining the photographing process in step S2 of FIG.

  In step S <b> 11, the photographing processing unit 301 performs trial photographing for photographing a sample image that serves as a reference when the user selects either the natural course or the perfect course. For example, the imaging control unit 321 controls the imaging unit 21 to perform imaging with the user as a subject and output a single captured image. Then, the image processing unit 322 outputs two sample images obtained by performing image processing corresponding to the natural course and the perfect course on the captured image on which the user is copied.

  In step S12, the imaging processing unit 301 performs course selection that allows the user to select either the natural course or the perfect course. For example, the display control unit 323 performs a perfect course image process on a sample image obtained by performing natural course image processing on a photographed image in which a user is photographed, and a photograph image on which a user is photographed. The selected sample image is displayed, and a course selection screen for selecting either course is displayed on the touch panel monitor 92. When the user performs an operation of selecting a course by touching the touch panel monitor 92, the operation reception unit 324 receives a user operation and notifies the image processing unit 322 of the course selected by the user. Thereby, the image processing unit 322 performs image processing according to the course selected by the user in the subsequent processing.

  In step S13, the imaging processing unit 301 performs normal imaging. In normal shooting, the image for synthesis and the image captured by the camera 91 are first synthesized and displayed on the touch panel monitor 92 (live view display). In addition, a countdown indicator is displayed on the touch panel monitor 92, and the camera 91 is controlled to perform shooting to obtain a shot image. Then, the composite image is combined with the photographed image to generate a composite image. Further, the generated composite image is displayed on the touch panel monitor 92, and the composite image (photographing result) is presented to the user. Alternatively, when the image for synthesis and the image captured by the camera 91 are not combined, the captured image captured by the camera 91 is displayed on the touch panel monitor 92, and the captured image (photographing result) is presented to the user. In the following, a composite image as a photographing result is also simply referred to as a photographed image. This is repeated until it is determined whether or not such shooting has been performed a predetermined number of times. For example, in normal shooting, a total of six shootings are performed, and six shot images are acquired. If a predetermined time has elapsed since the first coin was inserted, the process is changed so that five captured images are acquired.

  In step S <b> 14, the imaging processing unit 301 performs face authentication processing for authenticating the face of the subject captured in the captured image captured in the normal imaging in step S <b> 13. Then, the face authentication processing unit 325 grasps the number of users who are using the photo sticker creating apparatus 1 based on the number of faces of the subject captured in the captured image. For example, the face authentication processing unit 325, when 6 shootings are performed in the normal shooting, out of 6 shot images, when there are 4 or more shot images whose number of subject faces is 2 or less. It is determined that the number of users is two or less.

  In step S15, the imaging processing unit 301 determines whether the number of users is two or less according to the result of the face authentication process in step S14. If it is determined in step S15 that the number of users is not two or less (three or more), the photographing process ends, and the process returns to step S3 in FIG. On the other hand, if it is determined in step S15 that the number of users is two or less, the process proceeds to step S16.

  In step S <b> 16, the display control unit 323 displays a guidance screen for explaining the special shooting on the touch panel monitor 92.

  FIG. 13 shows a display example of the guidance screen 401. The guidance screen 401 displays a plurality of images that are images of special images provided by special shooting. Also, on the upper side of the guidance screen 401, a message about a special image generated by special shooting “can be used for SNS and blog icons / BEAUTY ICON SHOT” is displayed. That is, in special shooting, a special image suitable for use as an image (icon) registered in the user's profile in an SNS, a blog, or the like is generated. Further, on the lower left side of the guidance screen 401, a button 402 that is touched when the user selects not to perform special shooting is displayed.

  In step S17, the imaging processing unit 301 determines whether or not to perform special imaging. For example, when the user touches a button 402 displayed on the guidance screen 401 in FIG. 13, the operation reception unit 324 detects the touch and receives a user operation not to perform special shooting. In this case, the imaging processing unit 301 determines not to perform special imaging, the imaging process ends, and the process returns to step S3 in FIG.

  On the other hand, when a predetermined time elapses without the user touching the button 402, the photographing processing unit 301 determines that the special photographing is performed, and the process proceeds to step S18, and the photographing processing is performed after the special photographing is performed. When finished, the process returns to step S3 of FIG.

  Here, with reference to FIG. 14, image processing that the image processing unit 322 performs on the captured image in the special imaging in step S <b> 18 will be described.

  FIG. 14 shows a photographed image 501 in which two users are photographed, and trimming frames 502 and 503 for cutting out two special images from one photographed image 501 in special photographing. . That is, in the photo sticker creating apparatus 1, two users take a picture so as to enter the trimming frames 502 and 503 to obtain the shot image 501, and cut out an area surrounded by the trimming frames 502 and 503. Two special images can be provided.

  In general, when two users use the photo sticker creating apparatus 1, it is often seen that photographing is performed in a state of approaching each other. However, even in special shooting, if the users approach each other and perform shooting, a part of the user's body (shoulder, hair, etc.) that should be captured on the other side may enter one of the trimming frames 502 and 503. is assumed. Therefore, in the photo sticker creating apparatus 1, image processing for adding an aura image (decorative image for decorating the user) to each user on the side where another user is present is performed.

  That is, as illustrated in FIG. 14, when there are two users, the image processing unit 322 adds the aura image 504 to the right of the subject displayed on the left side of the captured image 501, and the right side of the captured image 501. Image processing for adding an aura image 505 to the left of the subject displayed on the screen is performed. Aura images 504 and 505 are images that add a color like a shadow of a subject to a region having a predetermined width outward from the contour of the subject along the contour of the subject. In addition, the aura images 504 and 505 are displayed so that the color becomes lighter as the distance from the contour of the subject increases.

  As described above, in the photo sticker creating apparatus 1, by adding the aura images 504 and 505 between the users, the users do not enter the other trimming frames 502 and 503 of the other aura images 504 and 505. Naturally, each user is outside (that is, the edge side of the captured image, for example, the left edge side of the captured image for the left user and the right edge side of the captured image for the right user). The special position is adjusted by adjusting the standing position so as to move to. As a result, special shooting can be performed so as not to enter into the other party's special image.

  Next, FIG. 15 is a flowchart for explaining the special photographing process in step S18 of FIG. 16 to 19 show screens displayed on the touch panel monitor 92 in special shooting.

  In step S <b> 21, the display control unit 323 displays a pose sample screen on the touch panel monitor 92 that displays a sample image that is a sample pose in special shooting.

  FIG. 16 shows a display example of the pause sample screen 511. On the pose sample screen 511, sample images 512 and 513 having a square angle of view are displayed side by side at the center thereof. By displaying such sample images 512 and 513, the user can easily take a picture with reference to the pose.

  In addition, a message “I will shoot” is displayed above the sample images 512 and 513 to suggest that special shooting is to be performed, and a user is copied alone under the special images 512 and 513 in the special shooting. A message “Take a picture one by one in the frame” is displayed, which suggests that an image will be taken. Further, below that, reduced sample images 514 and 515 in which the same images as the sample images 512 and 513 are reduced and displayed are displayed.

  On the pose sample screen 511, a guide image 516 for guiding the user to move outward is displayed side by side on the left side of the sample image 512. Similarly, on the pose sample screen 511, a guide image 517 for guiding the user to move outward is displayed side by side on the right side of the sample image 513. That is, the guide images 516 and 517 are displayed outside the sample images 512 and 513, respectively. In the guidance images 516 and 517, a comment for guiding the two users to move away from each other, that is, to guide them to move outward from each other is displayed, and an arrow pointing outward (guidance image) In 516, an arrow pointing to the left side is displayed, and in the guide image 517, an arrow pointing to the right side is displayed. By displaying such guide images 516 and 517, the user can easily notice the guide images 516 and 517, and can guide the user to the optimum standing position.

  In step S22, as described above with reference to FIG. 14, the image processing unit 322 applies the aura image to the captured image output from the camera 91 that captures a user as a subject in accordance with control by the capturing control unit 321. The image processing to add is performed.

  In step S23, the display control unit 323 displays on the touch panel monitor 92 a live view screen for live view display of the captured image that has been subjected to image processing by the image processing unit 322 in step S22.

  FIG. 17 shows a display example of the live view screen 521. On the live view screen 521, live view images 522 and 523 having a square angle of view are displayed side by side at the center thereof. That is, on the live view screen 521, the live view images 522 and 523 are displayed in place of the portions where the sample images 512 and 513 were displayed on the pose sample screen 511 of FIG. In the live view images 522 and 523, for example, a portion to be cut out as a special image in the captured image 501 in FIG. 14 is displayed. An aura image is added to the inside of the subjects photographed in each of the live view images 522 and 523. On the live view screen 521, similarly to the pause sample screen 511, reduced sample images 524 and 525 and guide images 526 and 527 are displayed.

  In this way, by displaying the live view images 522 and 523, the user not only shoots the images so as to enter the live view images 522 and 523, respectively, but also shoots by the outside so that the aura images do not overlap. Do. That is, when the image processing unit 322 adds the aura image inside the users, the images are moved to standing positions where the users naturally leave each other. In addition, background images are displayed in the live view images 522 and 523. If there is a foreground image, the foreground image may be combined with the live view images 522 and 523 and displayed.

  In step S24, the imaging control unit 321 determines whether it is time to capture a special image. For example, the time from when the special shooting process is started until the special image is shot is set in advance, and the shooting control unit 321 does not have a timing for shooting the special image until the time elapses. judge.

  In step S24, if the shooting control unit 321 determines that it is not time to capture a special image, the process returns to step S22, and steps S22 and S22 are performed until it is determined that it is time to capture a special image. The process of S23 is repeated. At this time, for example, the display control unit 323 displays a countdown indicator on the touch panel monitor 92 until the timing for capturing a special image.

  In step S24, when the shooting control unit 321 determines that it is time to take a special image, the process proceeds to step S25, and the display control unit 323 prompts the user to point the camera 91 at the camera. A screen is displayed on the touch panel monitor 92.

  FIG. 18 shows a display example of the camera gaze screen 531. On the camera gaze screen 531, message images 532 and 533 indicating messages prompting the camera to look at the live view images 522 and 523 on the live view screen 521 of FIG. 17 are displayed. In the message images 532 and 533, a message “Look at the camera” is displayed together with an upward arrow. On the camera gaze screen 531, similar to the live view screen 521, reduced sample images 534 and 535 are displayed. Further, on the camera gaze screen 531, shot images 536 and 537 suggesting that it is time to perform shooting are displayed outside the message images 532 and 533, respectively.

  In step S26, a special image is shot by the camera 91 according to the control of the shooting control unit 321. In step S27, the aura image is added to the special image by the image processing unit 322 as described with reference to FIG. Image processing is performed.

  In step S <b> 28, the display control unit 323 displays a shooting result screen on the touch panel monitor 92 for showing the shooting result of the special shooting to the user.

  FIG. 19 shows a display example of the shooting result screen 541. On the photographing result screen 541, special images 542 and 543 having a square angle of view are displayed side by side at the center thereof. Also, above the special images 542 and 543, a message “I can take a picture like this” is displayed, which suggests that the photographing result of the special photographing is displayed. Also, below the special images 542 and 543, a message “You can select your favorite shadow color on the graffiti screen!” Is displayed, which suggests that the color of the aura image should be selected in the editing process. Further, on the photographing result screen 541, similar to the live view screen 521, reduced sample images 544 and 545 and guide images 546 and 547 are displayed.

  In the special images 542 and 543, for example, by performing chroma key processing using a green or blue background curtain stored in the background curtain unit 25, the aura image is made more prominent by synthesizing a white background. Can be made. Further, a white background curtain housed in the background curtain unit 25 may be used without performing the chroma key process. In this case, it is possible to avoid discoloration or the like of the user's clothes or the like due to the chroma key process, and a realistic captured image can be generated. The color of the background curtain is not particularly limited. Further, in the special images 542 and 543, images obtained by inverting the live view images 522 and 523 on the live view screen 521 in FIG. 17 are displayed, and the aura image is displayed outside the users.

  Then, after the process of step S28, the special photographing process ends, and the process returns to step S3 of FIG.

  As described above, in the photo sticker creating apparatus 1, it is possible to avoid overlapping of users by adding an aura image inside the users in the live view images 522 and 523. In other words, special shooting can be performed so that a part of the other user's body does not appear in the special image of one user.

  As described above, when the frame displayed on the live view screen is reduced, it is difficult to clearly photograph the user's face. On the other hand, in the photo sticker creating apparatus 1, it is not necessary to display the frame in such a small size, and the live view images 522 and 523 can be displayed in a large size. Therefore, the user's face can be clearly photographed without taking down and photographing.

  As described above, the photo sticker creating apparatus 1 is suitable for use as a profile image (icon) and can provide a special image in which the user's face is clearly photographed. Can be improved.

  Conventionally, an aura image (for example, an image in which characters, figures, colors, etc. are arranged in a region having a predetermined width along the contour of the subject) is added to the subject to provide an image that makes the subject stand out. There is an image providing device to do. However, the aura image added by such an image providing device does not guide the user's standing position so that the users are separated from each other by an appropriate distance.

  On the other hand, in the photo sticker creating apparatus 1, an aura image is added for the purpose of guiding the users to be separated from each other at an appropriate distance, so that only one user can be shown in the special image more reliably. Special shooting can be performed. In this way, since a special image can be generated in which a user is photographed one by one, the photo sticker creating apparatus 1 is a more suitable image as a profile image (icon) used for SNS that can be used by individuals. Can be provided.

  In the photo sticker creating apparatus 1, when a part of another user is captured, a part of the other user is deleted on the editing screen 601 (FIGS. 20 and 21) described later. be able to. In addition, the photo sticker creating apparatus 1 can select the color of the aura image displayed on the live view images 522 and 523 in the photographing process or before performing the photographing process.

  Further, in the photo sticker creating apparatus 1, when the user edits the photographed image in the editing unit 12, the aura image added to the special image can be edited.

  20 and 21 show display examples of the edit screen displayed on the tablet built-in monitor 131 in the editing process in step S4 of FIG.

  In the editing screen 601, GUIs for editing images are displayed in the same way on the left and right so that two users can edit the image at the same time. In FIG. 20, the left half of the editing screen 601 is displayed. In FIG. 21, the right half of the edit screen 601 is shown.

  As shown in FIG. 20, an editing target image display unit 602L that is large and is selected at the approximate center on the left side of the editing screen 601 is displayed. In the example of FIG. 20, a special image is selected as an editing target. The state is shown. A subject in the same direction as the special image 542 in FIG. 19 is displayed on the edit target image display unit 602L. Further, in the edit target image display unit 602L, the background of the subject in the special image is limited to white, and the pattern used for the background of normal shooting is not displayed.

  When a special image is displayed on the edit target image display unit 602L, a special image converted into a so-called rounded image in which the four corners are chamfered in a circular arc shape is displayed as illustrated. For example, in an SNS, a blog, or the like, an image used as an icon is automatically converted from a cornered image to a rounded corner image. Therefore, in the editing screen 601, in order to make it easy to imagine the state (designability) when used as an icon, a process of converting to a rounded corner image is performed when a special image is displayed on the editing target image display unit 602L. Is done. Note that the special image is simply a rounded image when displayed on the edit target image display unit 602L, and the special image provided (transmitted) to the user is a cornered image.

  An image selection unit 603L for selecting an image to be edited by the user is displayed above the editing target image display unit 602L. In the image selection unit 603L, thumbnails of a plurality of images shot in normal shooting and special shooting are displayed in a line in the shooting order, and the user touches one of the images to select an image to be edited. Can be selected. In the display example of FIG. 20, a state in which the special image at the right end is selected is shown, and characters “selected” are displayed on the special image.

  A button display unit 604L on which various buttons are displayed is displayed on the right side of the edit target image display unit 602L. In the example of FIG. 20, an end button that is operated when editing of a photographed image is finished, an eraser button that is used when a part of an image input to the edit target image display unit 602L is partially erased, and editing is restarted from the beginning. A button that is operated when the button is operated, a button that is operated when returning to the previous set, a button that is operated when the editing content is returned to the state before one operation, and a step when the returned editing content is advanced by one operation. The button to be operated is displayed on the button display unit 604L.

  An edit palette 605L is displayed below the edit screen 601. In the display example of FIG. 20, editing tools that can be used when a special image is displayed in the editing target image display unit 602L are displayed, and only editing for the special image can be performed. For example, the editing palette 605L is operated to select a plurality of color selection buttons 606L that are operated when selecting the color of the aura image of the special image from among a plurality of colors, and to hide the aura image. A non-display button 607L is displayed.

  In the plurality of color selection buttons 606L, images each having an aura image of a different color are displayed, and a color different from the color of the aura image added to the special image at the time of shooting can be selected. For example, when the user touches one of the color selection buttons 606L, the color displayed on the color selection button 606L is reflected on the aura image of the special image on the editing target image display unit 602L. In the example of FIG. 20, ten color selection buttons 606L are displayed, and eight different colors, a gradation in which a plurality of colors are combined, or a gray shadow can be selected. The plurality of color selection buttons 606L display images obtained by adding an aura image to the subject displayed on the editing target image display unit 602L. In the image displayed on the color selection button 606L, the aura image is added to the same side as the aura image added to the subject in the editing target image display unit 602L (the left side of the subject in the example of FIG. 20). ing.

  When the non-display button 607L is touched, the aura image added to the special image displayed on the editing target image display unit 602L is hidden. For example, since a composite image is generated in the special image by adding the aura image, the operation is performed on the non-display button 607L so that the aura image is hidden and the special image without such a composite image is displayed. Can be provided.

  Further, in the display example of FIG. 20, an edit palette 605L in which a color change tab for displaying an edit tool for changing the color of the aura image is selected is shown, but in addition, in the edit palette 605L, By selecting each tab, you can display an editing tool for editing your name, stamp, message, or makeup. The editing tools displayed on the editing palette 605L are limited to those that can edit special images with a simple handwritten design. In addition, in order to produce a fashionable special image, it is possible to perform filter processing that provides various effects such as sepia, black-and-white photographic, cross development, and instant camera.

  Similar to the left half of the edit screen 601 in FIG. 20, the edit target image display unit 602R, the image selection unit 603R, the button display unit 604R, the edit palette 605R, and the right half of the edit screen 601 shown in FIG. A plurality of color selection buttons 606R and a non-display button 607R are displayed. In the images displayed on the plurality of color selection buttons 606R, the aura image is on the same side as the aura image added to the subject in the editing target image display unit 602R (in the example of FIG. 21, the right side of the subject). It has been added.

  Here, the edit target image display unit 602L in FIG. 20 displays a special image in which the natural course is selected in step S11 in FIG. 12 and the natural course image processing is performed. On the other hand, the editing target image display unit 602R in FIG. 21 displays a special image in which the perfect course is selected in step S11 in FIG. 12 and the image processing of the perfect course is performed.

  That is, in the special image displayed on the edit target image display unit 602L, an aura image with a soft atmosphere is added by color and gradation. On the other hand, in the special image displayed on the edit target image display unit 602R, an aura image with a clear atmosphere is added by color and gradation. In this way, by adding the aura image corresponding to the course selected by the user, the overall image of the special image can be unified.

  20 and 21, special images obtained by converting a rectangular image with corners into a rounded corner image that has been chamfered at four corners in an arc shape are displayed on the edit target image display units 602L and 602R. Although an example is shown, for example, a button for selecting the corner of the special image may be displayed so that the user can select it. For example, when the corner of the special image is selected, the corner portion of the special image is displayed in grayout or a dotted line. Further, for example, an image inversion button (not shown) for inverting the special image displayed on the editing target image display units 602L and 602R may be provided on the editing palettes 605L and 605R. For example, when an image inversion button provided in the editing palette 605L is touched, a special image in which an aura image is added to the left side of the user on the right side as illustrated in the editing target image display unit 602L is inverted. A special image to which an aura image is added is displayed on the right side of the user on the left side.

  When the editing process using the editing screen 601 is completed, a post-service service process (step S7 in FIG. 11) is performed, and the post-service service unit 304 transmits a special image to the user's mobile terminal. Note that the special image is adjusted so that it looks beautiful when used as an icon such as an SNS or a blog. Therefore, the special image is not printed on a sticker sheet but is used exclusively for transmission to a portable terminal. As the special image, both a cornered image and a rounded corner image are stored in the server, and the user can select which image is displayed by accessing the server. Alternatively, when the user designates a specific SNS, an image with corners or a rounded corner image can be automatically selected according to the display form of the icon on the SNS. As described above, the photo sticker creating apparatus 1 can provide a special image having a shape suitable for use as a user profile published on the Internet (for example, a square angle of view and a rounded shape). .

  Next, image processing in which the image processing unit 322 generates a special image with the aura image added will be described with reference to FIG.

  For example, the image processing unit 322 can generate an aura image to be added to the user shown in the special image by moving the coordinate axis using an affine transformation process.

  First, the image processing unit 322 uses the special image 701 shown in FIG. 22A as an object of image processing, extracts a person area along the outline of the subject captured in the special image 701, and extracts the person area. One mask image M1 (FIG. 22B) is generated.

  Next, the image processing unit 322 performs the process of moving the first mask image M1 in the direction in which the aura image is added to the subject twice, and as shown in FIG. 22C, the second mask image M2 and the second mask image M2 are moved. 3 mask image M3 is generated. The moving distance of the first mask image M1 when generating the second mask image M2 and the third mask image M3 can be arbitrary, but the user can recognize that an aura image is added. It is desirable to set the distance.

  The image processing unit 322 performs a process of combining the second mask image M2 and the gradation image 702 illustrated in FIG. 22D. Further, the image processing unit 322 performs blurring processing using the third mask image M3, and blends the gradation image synthesized with the second mask image M2 with the background.

  By performing such image processing, the image processing unit 322 can generate a special image 703 obtained by combining the aura image 704 as illustrated in FIG. 22E. The aura image 704 is formed with a gradation like a gradation image 702 along the contour of the subject imaged in the special image 703. Further, the aura image 704 can be made to become familiar with the background by performing the blurring process so that the gradation becomes lighter toward the outside.

  In addition, although the example using the gradation image 702 whose color changes in the vertical direction has been described with reference to FIG. 22, for example, a monochrome image or a gradation image whose color changes in the horizontal direction may be used. Alternatively, an aura image having a gradation may be generated by generating a number of mask images according to the gradation of the gradation to be generated, and performing a synthesis process for combining images having different shades of color for each mask image. Alternatively, for one mask image, an aura image whose color changes depending on the distance from the subject is generated so that a certain distance from the subject is a predetermined color and another distance is another color. Also good. That is, the image processing unit 322 can generate various variations of aura images.

  A variation of the aura image will be described with reference to FIG.

  A special image 711 shown in FIG. 23A is added with an aura image 712 that is monochromatic and has an outer edge blurred. A special image 713 shown in FIG. 23B is added with an aura image 714 having a gradation whose color changes in the horizontal direction. In the special image 715 shown in FIG. 23C, an aura image 716 having a gradation whose color changes in the vertical direction is added. As shown in the figure, not only the color shading changes, but also, for example, a gradation image in which the color components are changed may be used. In this case, the R value, G value, and B value, which are color components, are adjusted in the range from 0 to 255, and a gradation image in which the color changes is generated. Alternatively, the transparency may be changed, and a gradation image may be generated based on the transparency.

  Furthermore, the aura image can be further enhanced by performing image processing such that the aura image overlaps the subject.

  FIG. 24 shows a modification of the aura image.

  FIG. 24A shows a reduced mask image M4 obtained by extracting a region where the subject is captured in the special image 721 and reducing the region. That is, after the first mask image M1 is generated as shown in FIG. 22B, the aura image is added to the subject (the direction in which the second mask image M2 and the third mask image M3 are moved). The reduced mask image M4 is generated by moving the first mask image M1 to the opposite side and applying a reduction process to the first mask image M1.

  Then, the difference between the first mask image M1 and the reduced mask image M4 is obtained, and, for example, the gradation image 702 (FIG. 22D) is combined with this difference area, whereby an aura image 723 as shown in FIG. 24B is obtained. Generated. By generating the aura image 723 that overlaps with the subject in this way, the subject can be seen more beautifully because it appears that the aura is reflected in the area of the person. Alternatively, the person area (the area where the subject is captured) may be reduced and combined with the reduced mask image M4, and the aura image may be combined with the difference area between the first mask image M1 and the reduced mask image M4.

  Note that the reduced mask image M4 becomes very small depending on the reduction ratio when generating the reduced mask image M4 from the mask image M1, and as a result, the aura image 723 may become larger, and the aura image 723 may enter the subject too much. Similarly, when the movement amount when moving the mask image M1 is large, the aura image 723 may enter the subject too much. For this reason, for example, a skin color mask image obtained by extracting the skin color component of the subject may be separately generated, and the skin color mask image may be synthesized with the aura image 723 that has entered too much. Thus, for example, a special image that includes a lot of aura images for portions other than skin color (for example, hair and clothes) and a small amount of aura images for skin-colored portions (for example, face and shoulder). Can be generated. Thereby, for example, it is possible to provide an image having a high degree of satisfaction for a user who does not like to synthesize an image with a face, a shoulder or the like that is a skin color part.

  Further, the image processing unit 322 performs processing for adding an aura image to the whole body of the subject imaged in the captured image 501 as illustrated in FIG. 14, and then cuts off the special image according to the trimming frames 502 and 503. be able to. Alternatively, the image processing unit 322 can perform processing of adding an aura image only to a subject (that is, near the face) captured in the special image after cutting out the special image according to the trimming frames 502 and 503. In this case, the process of adding the aura image is not performed outside the trimming frames 502 and 503, and the load on the image processing can be reduced.

  Note that, on the editing screen 601, a lip color change for changing the lip color of the subject can be performed, a mask image may be acquired for the lip portion, and the color may be changed for this portion.

  Further, in the trial photographing performed in step S11 of FIG. 12, the live view images 522 and 523 (FIG. 17) may be displayed for photographing. In this case, two special images can be generated from the captured image acquired by the trial shooting. Thereby, the time required for the photo sticker creation game can be shortened, and the rotation rate of the photo sticker creation device 1 can be improved.

  Note that the photo sticker creating apparatus 1 may perform image processing for adding an aura image when shooting a plurality of users even in normal shooting. In this case, the direction in which the aura image is added is not limited to one direction. For example, when shooting three users, an aura image can be added on the right side for the left user, on both sides for the central user, and on the left side for the right user. As a result, it is possible to perform shooting in a state where the interval between the three users is appropriately separated. Then, when editing the captured image captured in this state, the user performs trimming at an arbitrary position, thereby generating an image that is optimal for the profile image (icon), in which each user is captured one by one. The

  Further, in the photo sticker creating apparatus 1, for example, an aura image may be added to a captured image by a user touching the live view screen 521 (FIG. 17). That is, the user can select whether to add an aura image on the live view screen 521. Further, in the photo sticker creating apparatus 1, the direction in which the aura image is added to the photographed image may be selected by the user, and the direction may be changed.

  Furthermore, in the photo sticker creating apparatus 1, for example, a region where an aura image is not added in a special image is clarified, and a range where an aura image is added is designated in advance. For example, as described above, the aura image is added to the inside of two users, and also, for each of the two users, a captured image from each user (for example, the captured image 501 in FIG. 14). It can be added to the side toward the center of the. In addition, the aura image is obtained from each user by a center point between the two users, a center point between the face areas of the two users, and two live view images (for example, the live view in FIG. 17). The center point between the images 522 and 523) or the side toward the center point between the edges inside the two live view images can be added.

  In the photo sticker creating apparatus 1, an aura image is added like a shadow of a subject imaged in a special image. However, if the users can be guided away from each other, a decorative image other than the aura image is provided. May be added to the subject. As the decoration image, for example, an image in which various figures, characters, and the like are arranged so as to be scattered in a region having a predetermined width along the contour of the user can be adopted.

  Note that the processes described with reference to the flowcharts described above do not necessarily have to be processed in chronological order in the order described in the flowcharts, but are performed in parallel or individually (for example, parallel processes or objects). Processing). The program may be processed by one CPU, or may be distributedly processed by a plurality of CPUs.

  Note that the present embodiment is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the present disclosure.

  DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus, 11 Image pick-up unit, 12 Editing part, 201 Control part, 202 Storage part, 301 Image pick-up processing part, 302 Edit processing part, 303 Print processing part, 304 Subsequent customer service part

Claims (11)

A shooting unit for shooting a plurality of users as subjects and generating a shot image;
For each of the plurality of users shown in the photographed image, a decoration for performing a process of adding a decoration image for decorating the user only on the side where the other user is present for each of the users An image addition processing unit;
An image processing apparatus comprising: a display unit that displays the photographed image to which the decoration image is added as a live view image . The image processing apparatus according to claim 1, wherein the decoration image addition processing unit adds the decoration image to a region having a predetermined width at least outward from the contour of the user along the contour of the user. The image processing apparatus according to claim 1, wherein the decoration image addition processing unit adds the decoration image in which the color density becomes lighter as the user moves away from the contour of the user. A portion corresponding to the plurality of special images of the photographed images when special photographing is performed to generate a plurality of images as special images from photographed images acquired by one photographing by the photographing unit. A display unit for displaying a live view screen for displaying the image as a live view image on the display unit,
The image processing apparatus according to claim 1, wherein the decoration image addition processing unit adds the decoration image to the user displayed on each of the plurality of live view screens. The image processing apparatus according to claim 4, wherein the display control unit displays a guide image that guides the plurality of users in a direction away from each other outside the live view image displayed on the live view screen. An editing unit that edits the special image to generate an edited image;
The image processing apparatus according to claim 4, wherein the editing unit changes a color of the decoration image added to the special image according to a selection by the user. If there are two users,
The image processing apparatus according to claim 1, wherein the decoration image addition processing unit adds the decoration image to the inside of the two users. The image processing apparatus according to claim 7, wherein the decoration image addition processing unit adds the decoration image to each of the two users from a side toward the center of the captured image from each of the users. If there are two users,
The decoration image addition processing unit is inside the two users, and from each of the users, a central point between the two users, the faces of the two users The decoration image is added to a center point between regions, a center point between two live view images, or a side toward a center point between two inner edges of the live view images. The image processing apparatus according to 4 or 5. Shooting multiple users as subjects to generate a shot image,
For each of the plurality of users shown in the photographed image, a process of adding a decoration image that decorates the user only to the side where the other user exists for each of the users,
An image processing method including a step of displaying the photographed image to which the decoration image is added as a live view image . Shooting multiple users as subjects to generate a shot image,
For each of the plurality of users shown in the photographed image, a process of adding a decoration image that decorates the user only to the side where the other user exists for each of the users,
A program including a step of displaying the photographed image to which the decoration image is added as a live view image .

Images