JP5009864B2 - Candidate image display method, apparatus, and program - Google Patents

Description

  The present invention relates to a candidate image display method, apparatus, and program for easily replacing an image inserted in a mount with another desired image.

  Image data obtained by an imaging device such as a digital camera or digital video, or image data obtained by reading an image recorded on a photographic film with a scanner is reproduced using a display device such as a printer or a monitor. The system is known. Also, an album is created by arranging images represented by image data so as to have a desired layout.

  In Patent Document 1, in order to facilitate processing such as deletion of unnecessary images and extraction of necessary images for a large number of image data stored in an image server or the like, a plurality of similar images are used. There has been proposed an image display method in which similar images are arranged and displayed in the order of evaluation values representing image preference.

  Also, in Patent Document 2, in order to facilitate selection by the user of an image to be inserted into each insertion area when the album is created, conditions for images to be inserted in each insertion area are set in advance and stored in the image server. An image editing method has been proposed in which suitable images that meet the conditions are selected from a large number of images and a list of the selected compatible images is presented to the user.

However, the method proposed in Patent Document 2 requires a complicated operation of manually selecting an image to be inserted from a list of matching images presented for each insertion region. On the other hand, for each candidate image, an evaluation value representing the preference of the image is obtained by an evaluation scale such as the degree of blur and the presence of red eyes, and the candidate image automatically selected based on the obtained evaluation value is obtained. It is conceivable to improve convenience by automating album creation by inserting into the insertion area.
JP 2007-97090 A Japanese Patent Laying-Open No. 2005-210689

  However, in the above-described conventional automatic album creating method, candidate images are mechanically evaluated by a predetermined evaluation scale, and an image to be inserted into the image insertion area is automatically selected according to the evaluation result. In some cases, an individual's intention cannot be sufficiently reflected in the selection of an image to be inserted into the screen.

  For example, in the above conventional method, among the plurality of candidate images, the one with the highest evaluation value obtained by quantitatively evaluating the image quality, the state of the subject, etc. is automatically selected as the image to be inserted into the image insertion region. A user who edits an album sometimes wants to select an image to be inserted into the image insertion area by placing importance on the interest and meaning of the scene captured in the image based on the quality of the image.

  In view of the above circumstances, an object of the present invention is to provide a candidate image display method, apparatus, and program that can easily replace an image inserted on a mount with another desired image.

  In the candidate image display method of the present invention, a mount on which a selected candidate image selected from a candidate image group consisting of a plurality of candidate images is inserted is displayed on the display screen, and the candidate image group is displayed on the display screen. Other candidate images other than the selected candidate image are displayed so as to be interchangeable with the selected candidate image.

  In the above method, a plurality of input images may be received, and a plurality of images selected based on a predetermined criterion from the received plurality of input images may be determined as a candidate image group. For example, a plurality of similar images selected from a plurality of input images can be determined as the candidate image group.

  In the above method, when designation of any candidate image among other displayed candidate images is received, the designated designation candidate image received is inserted into the image insertion area instead of the selected candidate image. You may do it.

  The candidate image display device of the present invention displays on a display screen of a display means a display means for performing various displays and a mount on which a selection candidate image selected from a candidate image group consisting of a plurality of candidate images is inserted. The display screen further includes candidate image display control means for displaying other candidate images other than the selected candidate image in the candidate image group so as to be interchangeable with the selected candidate image.

  The apparatus includes an input unit for inputting a plurality of input images, and a candidate image for determining a plurality of images selected based on a predetermined criterion from the plurality of input images input by the input unit as a candidate image group A determination means can be provided.

  The candidate image determination means may determine, for example, a plurality of similar images selected from a plurality of input images as the candidate image group.

  In addition, when receiving the designation of any candidate image among the other displayed candidate images, the above apparatus inserts the designated designated candidate image into the image insertion area instead of the selected candidate image. Means may be provided.

  In the above apparatus, at least one of the other candidate images has been subjected to image processing, and the candidate image display control unit has previously adopted the display mode of the other candidate images by a predetermined operator. Alternatively, it may be determined based on the history of image processing.

  The selection candidate image is automatically selected according to a predetermined selection criterion, and the candidate image display control unit automatically selects the candidate image as the selection candidate image for at least one of the other candidate images. A function for causing the display means to display the reason for not being displayed together with the candidate image, and a function for causing the display means to display the reason for selecting the selection candidate image as the selection candidate image together with the selection candidate image. Good.

  The candidate image display program of the present invention is for causing a computer to execute the above method.

  According to the candidate image display method, apparatus, and program of the present invention, a mount on which a selected candidate image selected from a candidate image group consisting of a plurality of candidate images is inserted is displayed on the display screen. In addition, by displaying other candidate images other than the selected candidate image in the candidate image group so as to be interchangeable with the selected candidate image, the image inserted in the image insertion area and the other desired image can be easily replaced. Can be.

  Hereinafter, an embodiment in which a candidate image display device of the present invention is applied to an album editing device will be described with reference to the drawings. The configuration of the album editing apparatus 1 shown in FIG. 1 is realized by executing an album editing program read into the auxiliary storage device on a computer (for example, a personal computer). At this time, the album editing program is stored in an information storage medium such as a CD-ROM, or distributed via a network such as the Internet and installed in a computer.

  The album editing apparatus 1 edits an album having a plurality of image insertion areas, and creates an album in which photo images are inserted in each image insertion area, and a display screen of the display section 40. In addition, a display control unit 20 that performs various displays for editing the album, an editing unit 30 that edits the album in accordance with various instructions from the user, and the like are provided.

  As shown in FIG. 2, the album creating unit 10 includes a candidate image group generating unit 11, an image selecting unit 12, an image inserting unit 13, and the like.

  The candidate image group generation unit 11 is a storage device such as a hard disk provided in the album editing apparatus 1 or a file server connected via a network, and a plurality of photo images Pm (m = 1, 2,...), The same number of candidate image groups as the number of image insertion regions each consisting of a plurality of candidate images are generated.

  Specifically, for each of a plurality of photographic images Pm, for example, the color of the image is analyzed by a histogram of hue, saturation, brightness, etc., or a face is detected by a conventional face detection method, and the face is photographed. Analyzing the position, size, face orientation, number of faces, extracting line segment information by edge detection and Hough transform, and analyzing the composition of the image spread, depth, screen division, etc. There is one set of similar photographic images in which incidental information such as shooting date / time information described in the information is analyzed and the difference in output value representing the result of the analysis between images does not exceed a predetermined threshold. A candidate image group is generated so as to belong to one candidate image group.

  Also, processed images generated by performing various image processing processes such as red-eye correction, color conversion to monochrome or sepia, trimming, framing, etc. on photographic images belonging to one candidate image group by the above analysis, Candidate images belonging to the same candidate image group as the photographic image can be obtained.

  FIG. 3 is a diagram illustrating an example of a candidate area group generated by the candidate image group generation unit 11. The candidate area group 14 shown in FIG. 3 includes candidate images 15a, 16a, and 17a representing photographic images P15, P16, and P17 selected as images similar to each other by image analysis or the like from a plurality of photographic images Pm, and their photographs. The images P15, P16, and P17 are composed of candidate images 15b, 16b, and 17b formed by rounded corner trimming, and candidate images 15c, 16c, and 17c formed by round trimming and monochrome color conversion. Note that since red eyes are detected in the photo image P15, the candidate images 15b and 15c are further subjected to red-eye correction.

  Here, the candidate region group including both the photographic image and the processed image obtained by performing the image processing on the photographic image has been described as an example. However, the candidate image group may be one or both of the photographic image and the processed image. As long as the image includes two or more candidate images.

  The image selection unit 12 automatically selects one candidate image from each of the candidate image groups generated by the candidate image group generation unit 21. For example, for each candidate image group, for each of the candidate images constituting the candidate image group, the preference as an image to be inserted into the image insertion area is adapted to the state of the main subject, the image quality, and the user's preference. Evaluation is performed using an evaluation scale such as degree, and a candidate image having the highest evaluation value is selected.

  Specifically, in the case of color preferences such as color reproducibility and white balance, image brightness, contrast, blurring, camera shake, and human images, whether the face size is appropriate, Whether the orientation is frontal, whether it is a specific expression such as a smile, eyes open / closed, red eyes, and landscape images, the horizon / horizon is parallel to the lower part of the image, etc. The output value representing the image quality is obtained by the image quality evaluation method, and the output value representing the state of the object detected by the object detection method such as the face or the eye is obtained. It is defined so that the value of the evaluation value becomes larger as the difference from the reference value that is preferable in the evaluation scale is smaller.

  In addition, by analyzing the tendency of the image selected as an image to be inserted into the image area by the user (predetermined operator) in editing of the past album, the type of image processing used for the image, and the like in advance An index for calculating the degree to which the candidate image matches the user's preference is acquired, and the evaluation value is defined so as to increase as the degree of matching calculated based on the acquired index increases.

  Here, an example of a process for acquiring information representing user preferences will be described with reference to the flowchart of FIG.

First, for an edited album, it is monitored whether or not a printing instruction (including a request for printing from a supplier providing the album printing service via the network) has been made (step ST41). When printing is instructed, the frequency of use of each image processing such as image processing, trimming, framing, etc. used for the album for which the instruction is given is acquired (step ST42). Here, when the original photographic image is used for an album without any additional processing, it is counted that a kind of image processing processing of “no processing” is used. Next, using the acquired use frequency of each image processing process, for example, as shown in Table 1, a ranking of the use frequency of the image processing process by the user is created, and a database not shown as information representing user preferences (Step ST43).

  From the ranking of the usage frequency of image processing by the user in Table 1, the image processing is no processing, red-eye correction, monochrome color conversion, and sepia color conversion, and trimming is rounded corner trimming and no trimming. It can be seen that the framing is favorably used by the user in the order of no frame, frame B, and frame C in the order of round trimming.

  As a result, the image selection unit 12 has, for example, no red-eye or blurring among all the candidate images 15a to 15c, 16a to 16c, and 17a to 17c in the candidate image group 14, and the usage frequency by the user is the highest in Table 1. The candidate image 16b that has been subjected to the image processing, that is, the image processing and the framing that are trimmed without processing is automatically selected as a selection candidate image.

  The image insertion unit 13 automatically assigns each candidate image (selected candidate image) automatically selected by the image selection unit 12 to each image insertion region using a layout method described in, for example, Japanese Patent Laid-Open No. 2008-052326. Place / insert into.

  The display control unit 20 performs various displays for album editing on the display screen of the display unit 40, and the details thereof will be described below.

  The display control unit 20 has a function of displaying an album editing screen 21 as illustrated in FIG. The editing screen 21 includes a folder display area 22 for displaying a folder in which photo images are stored, a list display area 23 for displaying a list of photo images stored in a folder desired by the user, and a currently edited image. An album page display area 24 for displaying an album page is included.

  As shown in the figure, the list display area 23 displays a list of a plurality of photo images Pm stored in the folder “New Year” desired by the user as thumbnails, and the album page display area 24 displays an album creation. The pages T1 and T2 of the album “New Year” created by inserting the selection candidate images selected from each of the candidate image groups in the part 10 into the image insertion regions R1, R2, and R3 are displayed. In particular, the selection candidate image 16b selected from the candidate image group 14 described above is inserted into the image insertion region R3.

  In addition, the display control unit 20 corresponds to each image insertion area on the display screen, and other than the selection candidate images in the candidate image group including the selection candidate images inserted in the image insertion area. It has a function of displaying a candidate image so that it can be replaced with an image insertion area instead of the selected candidate image.

  For example, as shown in FIG. 6, in response to the cursor M being positioned on the insertion region R3, other candidate images in the candidate image group 14 including the selection candidate image 16b inserted in the insertion region R3. A list of 15a to 15c, 16a, 16c, and 17a to 17c is displayed on the balloon region 25A from the image insertion region R3. Note that the selection candidate image 16b can also be displayed on the balloon region 25A surrounded by a broken line so as to be distinguishable from the other candidate images, so that the selection candidate image can be easily compared with the other candidate images.

  Note that the display of the candidate image by the display control unit 20 is not limited to the list display by the balloon region 25A, but can be various other types for easily specifying other candidate images to be inserted into the image insertion region instead of the selection candidate image. It may be based on the display mode. Hereinafter, some preferred display modes will be described by way of example.

  For example, as shown in FIG. 7, in response to the cursor M being positioned on the insertion region R3, the candidate image 15a is displayed on the band-like region 25B extending from the insertion region R3 in the horizontal direction (or vertical direction) of the display screen. ~ 15c, 16a, 16c, and 17a to 17c are displayed side by side. If the candidate images to be displayed cannot be displayed on one screen, some candidate images are displayed on the region 25B, and the candidate image group is shifted on the region 25B by a user's mouse operation or the like, Other candidate images that are not displayed may be displayed.

  In addition to the above-described display mode in which two or more candidate images are simultaneously displayed on the screen, the candidate images 15a to 15c, 16a, 16c, and 17a to 17c are set in the insertion region R3 according to the mouse operation by the user. You may make it change and display one sheet at a time. According to this display mode, it is possible to provide an album page close to the finish when each other candidate image is inserted into the image insertion area R3 instead of the selected candidate image. When the candidate images are sequentially replaced and displayed, the selection candidate images can be separately displayed in the vicinity of the insertion region R3 to facilitate comparison between the selection candidate image and other candidate images.

  In addition, when displaying the candidate image according to each aspect, the display may be performed based on the history of the image processing process adopted by the user (predetermined operator) in editing the past album. Good. For example, when the ranking of the frequency of use of image processing processing by the user as shown in Table 1 is acquired in advance and two or more candidate images are displayed on the screen at the same time, higher-order image processing processing is performed in the ranking. It is possible to set the display position of each candidate image, for example, such that a candidate image is displayed on the upper left side of the display areas 25A and 25B. In addition, when replacing candidate images one by one and displaying them, each candidate face image is displayed such that the candidate image that has been subjected to higher-level image processing in the ranking is displayed first. The order can be set.

  Further, the display control unit 20 displays the reason why the candidate image was not selected as the selection candidate image for at least one of the other candidate images at the time of the above display, The reason why an image is selected as the selection candidate image is displayed together with the selection candidate image, and information on the status of each candidate image can be referred to when selecting an image to be inserted into the image insertion area. Can be provided. For example, as shown in FIGS. 6 and 7, a red-eye mark 71 is displayed on a candidate image in which red-eye is detected, and a blur mark 72 is displayed on the candidate image in which blur is detected together with the candidate image.

  Further, the display control unit 20 determines whether or not the cursor M is positioned on the insertion region R3 before the candidate images 15a to 15c, 16a, 16c, and 17a to 17c are directly displayed on the display screen. Regardless of the position of M, for example, as shown in FIG. 8, the fact that there are other candidate images that can be inserted into the image insertion region R3 instead of the selection candidate image 16b is that a plurality of images are displayed in the image insertion region R3. The user can be prompted to perform an operation of displaying the candidate image by displaying the decoration 73 such that the images overlap, or by displaying the number of other candidate images in the vicinity 74 of the insertion region R3. Whether or not to use a function for performing such a display is determined by displaying a setting screen on the display screen of the display unit 40 that enables the setting of the function for performing such a display in advance. The setting can be made according to the input of the instruction.

  When the editing unit 30 accepts designation by the user of one of the other candidate images displayed on the display screen by the display control unit 20, the editing unit 30 selects the designated candidate image that has received the designation. Instead of the candidate image, it is inserted into the image insertion area. In conjunction with the editing by the editing unit 30, the display control unit 20 displays the edited album page on the display screen.

  As described above in detail, when editing an album, an album page in which one selected candidate image selected from a group of candidate images is inserted is displayed on the display screen. Further, by displaying other candidate images other than the selected candidate image in the candidate image group so as to be interchangeable with the selected candidate image, the image inserted in the image insertion area and the other desired image can be easily obtained. Can be replaced.

  In the above-described embodiment, the case where the selection candidate image to be inserted into the insertion region is automatically selected has been described. However, the selection candidate image may be manually performed.

  In addition, the candidate image display device of the present invention is not limited to an album editing device, and for example, an image representing an object such as a postcard, a mug, a calendar, or clothing is used as a mount, and any other image is inserted into the mount. The present invention can be applied to an image processing apparatus that creates a preview of a product. Specifically, as in the case of the album editing apparatus described above, a preview in which a selected candidate image selected from a candidate image group made up of a plurality of candidate images is inserted is displayed on the display screen. In addition, other candidate images other than the selected candidate image in the candidate image group are displayed so as to be interchangeable with the selected candidate image. In addition, the various correspondences described above when editing an album can also be applied when creating a preview of a product.

The block diagram which shows the structure of the album editing apparatus which is one embodiment of this invention The block diagram which shows the structure of the album creation part of FIG. The figure which shows an example of the candidate area group produced | generated by the candidate image group production | generation part of FIG. The flowchart which shows the process which acquires the information showing a user's liking The figure which shows an example of the edit screen displayed by the display control part of FIG. The figure for demonstrating the display process of the candidate image by the display control part of FIG. The figure for demonstrating the display process of the candidate image by the display control part of FIG. The figure for demonstrating the display process of the candidate image by the display control part of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Album editing apparatus 10 Album creation part 11 Candidate image group production | generation part 12 Image selection part 13 Image insertion part 20 Display control part 30 Editing part 40 Display part

Claims (11)

A candidate image display method executed by a candidate image display device provided with candidate image display control means,
The candidate image display control means displays on the display screen of the display means a mount on which a selected candidate image selected from a candidate image group consisting of a plurality of candidate images is inserted , and on the display screen, Other candidate images other than the selected candidate image in the candidate image group are displayed so as to be interchangeable with the selected candidate image ,
At least one of the other candidate images has been subjected to image processing,
When the candidate image display control means displays the other candidate image on the display screen, the operator uses the image processing processing history used by the operator in the past. A candidate characterized in that a frequency ranking is acquired in advance, and the other candidate images are displayed in a display order that is preferentially displayed as a candidate image that has been subjected to higher-order image processing in the ranking. Image display method. The candidate image display device includes candidate image determination means;
The candidate image determining means determines the candidate image group such that a set of a plurality of images selected based on a predetermined criterion from a plurality of input images stored in a storage device belongs to one candidate image group. The candidate image display method according to claim 1, wherein: The candidate image determination unit determines the candidate image group so that a set of a plurality of similar images selected from the plurality of input images belongs to one candidate image group. Candidate image display method. Operator said candidate image display control means, with respect to other candidate image displayed on the display screen by the input means for designating any one of the candidate images therein, specifying the one of the candidate image 4. The mount in which the designated designation candidate image is inserted in place of the selection candidate image is displayed on the display screen in response to an input by the method. Candidate image display method. Display means for performing various displays;
A mount on which a selection candidate image selected from a candidate image group consisting of a plurality of candidate images is inserted is displayed on the display screen of the display means, and the selection candidate in the candidate image group is displayed on the display screen. Candidate image display control means for displaying other candidate images other than the image so as to be interchangeable with the selected candidate image ,
At least one of the other candidate images has been subjected to image processing,
When the candidate image display control means displays the other candidate image on the display screen, the operator uses the image processing processing history used by the operator in the past. A frequency ranking is acquired in advance, and the other candidate images are displayed in a display order that is preferentially displayed as a candidate image that has been subjected to higher-level image processing in the ranking. A candidate image display device. There is provided candidate image determining means for determining the candidate image group so that a set of a plurality of images selected from a plurality of input images stored in the storage device based on a predetermined criterion belongs to one candidate image group . The candidate image display device according to claim 5, wherein: The candidate image determining means determines the candidate image group so that a set of a plurality of similar images selected from the plurality of input images belongs to one candidate image group. Item 7. The candidate image display device according to Item 6. For other candidate image displayed on the display screen by the candidate image display control means, the input means for designating any one of the candidate image image therein, operation of specifying the one of the candidate image 8. The candidate according to claim 5, further comprising an editing unit that inserts the designated designation candidate image into the mount instead of the selection candidate image in response to an input by a person. Image display device. The selection candidate image is automatically selected according to a predetermined selection criterion,
The candidate image display control means further has a function of causing the display means to display the reason why the candidate image was not automatically selected as the selection candidate image for the at least one of the other candidate images together with the candidate image. The candidate image display device according to claim 5 , wherein the candidate image display device comprises a candidate image display device. Claim 9, wherein the candidate image display control means, the selection candidate image is characterized by the reason that is automatically selected as the selected candidate image in which further has a function of displaying on the display means with the selected candidate image The candidate image display device described. Computer
A mount on which a selected candidate image selected from a group of candidate images is inserted is displayed on the display screen of the display means , and the selection in the candidate image group is displayed on the display screen. A candidate image display program for causing a candidate image other than the candidate image to function as candidate image display control means for displaying the candidate image in a replaceable manner,
At least one of the other candidate images has been subjected to image processing,
When the candidate image display control means displays the other candidate image on the display screen, the operator uses the image processing processing history used by the operator in the past. A frequency ranking is acquired in advance, and the other candidate images are displayed in a display order that is preferentially displayed as a candidate image that has been subjected to higher-level image processing in the ranking. Candidate image display program.

Images