JP6028130B1 - Color classification apparatus, color classification method, program, and non-transitory computer-readable information recording medium - Google Patents

Abstract

The storage unit (220) stores region information (region information associating a region range with a representative color indicating the region) for a plurality of regions that divide the color space. The classification unit (231) classifies to which region the pixel color (product color) of the product image belongs. The acquisition unit (232) acquires the first area and the second area in descending order of the number of classified pixels. The determination unit (233) determines whether or not the acquired first region and second region satisfy the intermediate color condition. The search unit (234) can search for a product in any of the first representative color associated with the first region and the second representative color associated with the second region if the intermediate color condition is satisfied by the determination. And The correction unit (235) is based on the first response to the product after the product is searched for with the first representative color and the second response to the product after the product is searched with the second representative color. The range of the region in the region information is corrected so that the boundary between the first region and the second region is changed.

Description

  The present invention relates to a color classification device, a color classification method, a program, and a non-transitory computer-readable information recording medium.

In recent years, sales sites for electronic commerce have become popular on the Internet. For example, in a sales site (shopping mall site) composed of many stores (virtual stores), not only handles products of a wide category (genre) as a whole, but also price competition between stores is held. Sometimes it has gained many users.
In such a sales site, a user searches for a target product by searching for a target product by narrowing down a category or by setting a product name, a model number, or the like as a search condition.

  By the way, among the products handled at the sales site, there are many products (different color products) in which various color variations are prepared. For example, in products such as bags and clothing, on the product page (product sales page), what kind of color the product has, the number of products in each color, etc. are displayed. .

  In addition, sales sites that can search for products by specifying colors as search conditions are also known. For example, Patent Literature 1 discloses the prior art of a sales site (Internet shopping system) that searches for products by color beyond the types of sellers and products.

Japanese Patent Laid-Open No. 2002-92020

In the prior art disclosed in Patent Document 1, it is possible to select a color visually confirmed by the user from a predetermined number of color samples displayed on the color menu and instruct a search for a product. ing. In consideration of a simpler user interface, it may be possible to search for a product by designating an arbitrary color name from among a predetermined number of color names.
In any case, one of the roughly classified representative colors (for example, “white”, “yellow”, “orange”, “pink”, “red”, “beige”,...) Designation (selection) is performed to search for products.

Nevertheless, in actual products, there are many cases in which it is not possible to clearly determine which color the product corresponds to. For example, the product color corresponds to an intermediate color that can be said to be “red” or “orange”. In this case, if the color of a product is registered as one color (for example, “red”), even if the other color (for example, “orange”) is designated and searched, the product is included in the search results. There will be no.
For this reason, simply, if it corresponds to an intermediate color, it may be included in the search result regardless of which color is specified.

However, in that case, even if the product is narrowed down by specifying the color, even if a large number of products are searched or the user changes the color specification and searches, the same product (intermediate color product) ) May be searched again.
For this reason, there has been a demand for a technique that can appropriately classify a product such as an intermediate color into one of representative colors.

  The present invention has been made in view of the above circumstances, and provides a color classification device, a color classification method, a program, and a non-transitory computer-readable information recording medium that can appropriately classify the color of a product. The purpose is to do.

A color classification device according to a first aspect of the present invention provides:
A storage unit that stores region information about a plurality of regions that divide the color space and associates the range of the region with a representative color indicating the region;
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
It is characterized by providing.

In the color classification apparatus according to the above aspect,
The correction unit corrects the range of the region in the region information so that the first region is narrowed and the second region is widened when the second reaction is greater in degree than the first reaction. ,
It is characterized by that.

In the color classification apparatus according to the above aspect,
The correction unit is configured to return the boundary between the first region and the second region to the initial boundary when the first reaction is larger than the second reaction. Modify the range,
It is characterized by that.

In the color classification apparatus according to the above aspect,
A registration unit that registers both the first representative color and the second representative color in the product information of the product when the intermediate color condition is satisfied;
The search unit includes a first probability that the search is hit when the specified color specified during the search matches the first representative color in the product information, and the specified color is the second representative in the product information. Search for products according to the second probability of hitting the search when it matches the color,
It is characterized by that.

In the color classification apparatus according to the above aspect,
The search unit calculates the first probability and the second probability based on the number of pixels classified into the first region and the number of pixels classified into the second region.
It is characterized by that.

The color classification method according to the second aspect of the present invention is:
A color classification method in a color classification apparatus having a storage unit that stores area information for associating a range of the area with a representative color indicating the area, which is area information about a plurality of areas that divide the color space,
A classification step in which the color classification device classifies pixels of products included in a product image according to which of the plurality of regions a color of the pixels belongs;
An acquisition step in which the color classification device acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
In the color classification device, the first area and the second area are in contact with each other in the color space, and the number of pixels classified into the first area and the number of pixels classified into the second area A determination step of determining whether or not the intermediate color condition is satisfied, wherein the ratio exceeds a predetermined ratio;
If the color classification device satisfies the intermediate color condition, the product is searched for in either the first representative color associated with the first region or the second representative color associated with the second region. Search step to enable,
The color classification device includes a first response to the product of the searcher after the product is searched with the first representative color and a searcher after the product is searched with the second representative color. A correction step of correcting a range of the region in the region information so as to change a boundary between the first region and the second region based on a second response to the product;
It is characterized by providing.

The program according to the third aspect of the present invention is:
A computer having a storage unit that stores area information about a plurality of areas that divide the color space and that associates the range of the area with a representative color indicating the area,
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
It is made to function as.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed.

A computer-readable recording medium according to a fourth aspect of the present invention is provided.
A computer having a storage unit that stores area information about a plurality of areas that divide the color space and that associates the range of the area with a representative color indicating the area,
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
A program characterized by functioning as a program is recorded.

  The recording medium may be a non-transitory recording medium and can be distributed and sold independently of the computer. Here, the non-temporary recording medium refers to a tangible recording medium. Non-temporary recording media are, for example, compact disks, flexible disks, hard disks, magneto-optical disks, digital video disks, magnetic tapes, semiconductor memories, and the like. The transitory recording medium refers to the transmission medium (propagation signal) itself. The temporary recording medium is, for example, an electric signal, an optical signal, an electromagnetic wave, or the like. The temporary storage area is an area for temporarily storing data and programs, and is, for example, a volatile memory such as a RAM (Random Access Memory).

  According to the present invention, it is possible to appropriately classify product colors.

It is a block diagram which shows an example of the whole structure of the sales system which concerns on this embodiment. It is a block diagram which shows an example of schematic structure of the typical information processing apparatus with which a color classification device and a user terminal are implement | achieved. It is a block diagram which shows an example of schematic structure of the color classification apparatus which concerns on this embodiment. It is a schematic diagram for demonstrating a color space being divided into each area | region. FIG. 6 is a schematic diagram for explaining a “white” region. It is a schematic diagram for demonstrating the area | region of "red". It is a schematic diagram for demonstrating a mode that a merchandise image is made into a grid. It is a schematic diagram which shows an example of the product image containing the pop image. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating the method of discriminating a background. It is a schematic diagram for demonstrating a mode that the boundary of the area | regions in area | region information is fluctuate | varied. It is a flowchart for demonstrating the color classification process which concerns on this embodiment.

Embodiments of the present invention will be described below. In the embodiment of the present invention, a sales site (shopping mall site) composed of many shops (virtual stores) will be described as an example. However, the present invention can be appropriately applied to a sales site by one shop (trader). .
In addition, the following embodiment is for description and does not limit the scope of the present invention. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

(overall structure)
A sales system 100 according to an embodiment of the present invention is configured by connecting a color classification device 200 and each user terminal 300 via the Internet 900 as shown in FIG. Although simplified in the figure, it is assumed that there are a large number of user terminals 300 according to the users to be used.

The color classification device 200 includes, for example, a sales server (server computer) or the like, and presents information related to products to the user terminal 300 and sells products desired by the user.
As an example, the color classification device 200 presents a product list page or the like to the accessing user terminal 300. As will be described later, the product information about the product is provided with a color tag indicating the color of the product. When the user (searcher) selects an arbitrary color tag, the color classification device 200 displays the color tag. The product list page narrowed down is presented to the user terminal 300.

  The user terminal 300 includes, for example, a personal computer, a smartphone, and the like, accesses the color classification device 200 via the Internet 900, acquires information about the product, accepts a user operation, and receives a user operation from the color classification device 200. Make a purchase.

(Outline configuration of information processing device)
A typical information processing apparatus 400 in which the color classification apparatus 200 and the user terminal 300 according to the embodiment of the present invention are realized will be described.

  As shown in FIG. 2, the information processing apparatus 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, a NIC (Network Interface Card) 404, an image A processing unit 405, an audio processing unit 406, a DVD-ROM (Digital Versatile Disc ROM) drive 407, an interface 408, an external memory 409, a controller 410, a monitor 411, and a speaker 412 are provided.

  The CPU 401 controls the overall operation of the information processing apparatus 400 and is connected to each component to exchange control signals and data.

  The ROM 402 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and when this is executed, a predetermined program is read into the RAM 403 and execution of the program by the CPU 401 is started. The ROM 402 stores an operating system program and various data necessary for operation control of the entire information processing apparatus 400.

  The RAM 403 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for communication.

  The NIC 404 is for connecting the information processing apparatus 400 to a computer communication network such as the Internet, and conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). An analog modem for connecting to the Internet using a telephone line, an ISDN (Integrated Services Digital Network) modem, an ADSL (Asymmetric Digital Subscriber Line) modem, a cable modem for connecting to the Internet using a cable television line, etc. These are configured by an interface (not shown) or the like that mediates between these and the CPU 401.

   The image processing unit 405 processes the data read from the DVD-ROM or the like by a CPU 401 or an image arithmetic processor (not shown) included in the image processing unit 405, and then processes the processed data in a frame memory included in the image processing unit 405. (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to the monitor 411. Thereby, various page displays are possible.

  The audio processing unit 406 converts audio data read from a DVD-ROM or the like into an analog audio signal and outputs the analog audio signal from a speaker 412 connected thereto. Further, under the control of the CPU 401, a sound to be generated during the progress of the process performed by the information processing apparatus 400 is generated, and a sound corresponding to the sound is output from the speaker 412.

  A DVD-ROM mounted on the DVD-ROM drive 407 stores, for example, a program for realizing the color classification device 200 according to the embodiment. Under the control of the CPU 401, the DVD-ROM drive 407 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 403 or the like.

  An external memory 409, a controller 410, a monitor 411, and a speaker 412 are detachably connected to the interface 408.

  The external memory 409 stores data related to the user's personal information and the like so as to be rewritable.

  The controller 410 accepts operation inputs performed at various settings of the information processing apparatus 400. The user of the information processing apparatus 400 can record these data in the external memory 409 as appropriate by inputting instructions through the controller 410.

  The monitor 411 presents the data output by the image processing unit 405 to the user of the information processing apparatus 400.

  The speaker 412 presents the audio data output by the audio processing unit 406 to the user of the information processing apparatus 400.

  In addition, the information processing apparatus 400 uses a large-capacity external storage device such as a hard disk so as to perform the same function as a ROM 402, a RAM 403, an external memory 409, a DVD-ROM mounted on the DVD-ROM drive 407, and the like. You may comprise.

Hereinafter, the configuration and the like of the color classification device 200 realized in the information processing apparatus 400 will be described with reference to FIGS. When the information processing apparatus 400 is turned on, for example, when an access from the user terminal 300 is received, each program causing the information classification apparatus 200 to function as the color classification apparatus 200 according to the present embodiment is executed, and the color classification apparatus 200 according to the present embodiment. Is realized.
Each user terminal 300 is also realized in the information processing apparatus 400 in the same manner, but these configurations are omitted, and the most characteristic color classification apparatus 200 in the present embodiment will be described below.

(Outline configuration of color classification device)
FIG. 3 is a block diagram illustrating an example of a schematic configuration of the color classification device 200 according to the present embodiment. As illustrated, the color classification device 200 includes a receiving unit 210, a storage unit 220, a control unit 230, and a presentation unit 240.

The accepting unit 210 accepts various information sent from each user terminal 300 via the Internet 900.
For example, the accepting unit 210 accepts from the user terminal 300 an instruction to transition to a list page of products and various operation instructions in the list page (for example, a mouse click operation by the user).
The above-described NIC 404 or the like can function as such a reception unit 210.

The storage unit 220 stores area information about a plurality of areas that divide the color space, in addition to various information related to products and various information related to users.
For example, as illustrated in FIG. 4A, the storage unit 220 associates, with respect to a plurality of regions (each region divided by a broken line) dividing the color space CS, the range of the region and a representative color indicating the region. Remember.
Hereinafter, as an example, the case where the representative colors of each region are white, yellow, orange, pink, red, beige, silver, gold, gray, purple, brown, green, blue, and black will be described. The representative color is an example and can be changed as appropriate. In addition, multi-colors may be included in the representative colors so as to be able to deal with striped patterns of different colors.

  Specifically, in the area information, when the representative color is “white”, as shown in FIG. 4B, all the values of R, G, B (8 bits each) in the RGB value define a range of 230 to 255. ing. If it is pure “white”, the RGB value is R: 255, G: 255, B: 255, but it is off-white (R: 255, G: 255, B: 230) or slightly grayish. White (R: 230, G: 230, B: 230) and the like can be broadly included in “white”. Therefore, in order to provide a certain amount of width, the range of “white” is defined as all values of R, G, and B being 230 or more in the region information.

  When the representative color is “red”, as shown in FIG. 4C, the range of R: 196 to 255, G: 0 to 50, and B: 0 to 50 in the RGB value is defined. In the case of pure “red”, the RGB values are R: 255, G: 0, and B: 0. ≦ R ≦ 255, 0 ≦ G ≦ 50, and 0 ≦ B ≦ 50 are all satisfied.

Similarly, the range of area information is defined for other representative colors. That is, a range having a certain width is also defined for the area information of other representative colors.
Such area information is used for classifying the color of the product from the image (image data) of the product, as will be described later. Many images are not monochromatic. Also, it may appear white due to reflection of illumination. These color differences are classified into the same color by giving a certain width in the region information.
Further, as described later, the area information may define a range of intermediate colors.
The above-described RAM 403, external memory 409, and the like can function as such a storage unit 220.

  Returning to FIG. 3, the control unit 230 controls the entire color classification apparatus 200. The control unit 230 includes a classification unit 231, an acquisition unit 232, a determination unit 233, a search unit 234, and a correction unit 235, and supports purchase of products by the user.

  The classification unit 231 classifies which region the pixel color of the product image belongs to. In the following, a case will be described in which product images are divided into grids (griding) to classify which region each cell belongs to. However, one dod (1 pixel) pixel without gridding is described. The region to which each pixel belongs may be classified.

  As an example, the classification unit 231 forms a grid on the product image PI including the product P (suitcase) as illustrated in FIG. 5 so that the number of cells is 100 × 100 (vertical × horizontal). After color abstraction is performed for each square, the area to which each square belongs is classified. Since such a product image PI usually includes a background, the classification unit 231 classifies which region each cell for the product image PI excluding the background belongs to.

  In many cases, a single color is used for the background. As shown in FIG. 6, in addition to the product P, there is a product image PI including a pop (POP) image G, and a single color is often used for such a pop image G. When these single colors are used, there is a feature that the RGB values of adjacent cells are exactly the same. For this reason, the classification unit 231 determines that the adjacent squares have the same RGB value as a background or a pop image G, and excludes it from the classification target.

In some cases, a background reflecting the use scene is used instead of a single color background. In this case, the classification unit 231 excludes the background using the feature that the product P does not hang over 25% or more around the product image PI (upper, lower, left, and right sides).
For example, the product image PI illustrated in FIG. 7A shows a case where the lower part of the product P is hooked on one side of the product image PI. In FIG. 7A, although the lower part of the product P is hung on the lower side of the product image PI by about 30%, the ratio based on the entire four sides is about 12%.
Moreover, in the product image PI illustrated in FIG. 7B, a case where a part of the product P is hung on two sides of the product image PI is shown. In FIG. 7B, the lower part of the product P is about 30% on the lower side of the product image PI, and the right part of the product P is about 10% on the right side of the product image PI. About 16%.

Note that FIG. 7C and FIG. 7D are examples of the case where the product P takes 25% or more on the four sides of the product image PI, but it is extremely unnatural and is not considered to be actually used. In fact, as long as about 1,000 product images were randomly extracted and verified at the sales site managed by the applicant, they did not exist.
Further, even when a plurality of products P are included in the image as in the product image PI illustrated in FIG. 7E, it is also conceivable that each product P takes 25% or more on four sides of the product image PI. Even so, if each product P of different colors is included in one product image PI, it is difficult to know which color product is which product P, so it is considered that it is not actually used.
From these things, the classification | category part 231 discriminate | determines that it is a background (background which imaged the utilization scene), and excludes it from a classification | category object, when it covers 25% or more on 4 sides of the product image PI.

Furthermore, since it is necessary to enhance the product in the product image PI, the color of the product P and the background color are usually characterized by a color balance having a relatively large contrast.
From these characteristics, when a color with a width of about 1 to 3 pixels is extracted along the periphery of the product image PI, a color that occupies 75% or more of the color can be estimated as a background color and exists in the product image PI. It can be determined that there is a high possibility that all the same color parts are the background.
For example, in the case of the product image PI shown in FIG. 7F, if a color having a width of about 1 to 3 pixels is extracted along the periphery of the product image PI, the color portion indicated by L1 becomes 88% of the entire four sides. Assume that the color portion indicated by L2 is 12% of the entire four sides. In this case, the classification unit 231 determines that all the same color portions as the color indicated by L1 occupying 88% of the entire four sides are the background, and excludes them from the classification target.

  In addition, some product images PI may have a single color border around the product image PI. For this reason, even if the color is extracted along the periphery of the product image PI and occupies 75% or more, if the proportion of the same color in the product image PI is low, the case of bordering is also considered. The background may be determined by another method.

In this way, the classification unit 231 classifies which region the pixel (mass) for the product image PI excluding the background belongs to.
Specifically, when the product P shown in FIG. 5 is a red suitcase, the classification unit 231 classifies 2500 cells as “red” and 900 cells as “gray” as an example. Then, the 200 cells are classified as “pink”. Other squares are also classified but omitted.
Further, when the product P shown in FIG. 5 described above is a suitcase having an intermediate color between red and orange with different colors, the classification unit 231 classifies 1400 cells as “red” as an example. Are classified as “orange” and 900 are classified as “gray”. Other squares are also classified but omitted.

Returning to FIG. 3, the acquisition unit 232 acquires the first region and the second region in descending order of the number of pixels (mass) classified by the classification unit 231.
For example, when the classification unit 231 classifies “red”: 2500, “gray”: 900, “pink”: 200,..., The acquisition unit 232 acquires “red” as the first region. Then, “gray” is acquired as the second region.
When the classification unit 231 classifies “red”: 1400, “orange”: 1100, “gray”: 900,..., The acquisition unit 232 acquires “red” as the first region. Then, “orange” is acquired as the second area.

The determination unit 233 determines whether or not the first region and the second region acquired by the acquisition unit 232 satisfy the intermediate color condition.
For example, the determination unit 233 includes a first area and a second area that are in contact with each other in the color space, and the number of pixels (mass) classified into the first area and the pixels (mass cells) classified into the second area. ) Is greater than a predetermined ratio (for example, 5: 3), it is determined that the intermediate color condition is satisfied.
Specifically, when “red” is acquired as the first area and “gray” is acquired as the second area by the acquisition unit 232, “red” and “gray” are not in contact with each other in the color space. Therefore, the determination unit 233 determines that the intermediate color condition is not satisfied.
On the other hand, when the acquisition unit 232 acquires “red” (the number of squares 1400) as the first region and “orange” (the number of squares 1100) as the second region, “red” and “ Since “orange” is in contact with the color space and exceeds the predetermined ratio, the determination unit 233 determines that the intermediate color condition is satisfied.
The intermediate color condition is an example, and may be determined based on other conditions. For example, as described later, a range for determining the intermediate color is further determined, and it is determined whether the intermediate color condition is satisfied based on the result of classification by the classification unit 231 according to the two types of ranges. May be.

When the determining unit 233 determines that the intermediate color condition is satisfied, the search unit 234 selects the first representative color associated with the first region and the second representative color associated with the second region. Search is possible in any case.
For example, the search unit 234 searches for a first probability of hitting the search when the specified color specified during the search matches the first representative color, and when the specified color matches the second representative color. The product is searched according to the second probability to be hit.
Here, the first probability is calculated by, for example, “f (number classified into the first region) / f (number classified into the first region + number classified into the second region)”. On the other hand, the second probability is calculated by, for example, “f (the number classified into the second region) / f (the number classified into the first region + the number classified into the second region)”.
Note that the function f () has one or more arguments x such as f (x) = x, f (x) = x ² , f (x) = log ₂ (x), f (x) = 2 ^x, etc. Any function that monotonically increases and returns a non-negative value can be used as appropriate.
In addition, the present invention is not limited to the case where the first probability + the second probability = 1, and the case where the first probability + the second probability> 1 or in the extreme example, the case where the first probability = the second probability = 1. Can be employed as appropriate.

  As described above, when it is determined that the intermediate color condition is satisfied, the search unit 234 makes the product hit based on the first probability when the specified color specified at the time of the search matches the first representative color, or When the designated color matches the second representative color, the product is hit based on the second probability. For this reason, when the designated color matches the first representative color, it is probabilistically advantageous and the product is easily searched. However, when the designated color matches the second representative color, the product is appropriately searched. Will be.

  When the determination unit 233 determines that the intermediate color condition is not satisfied, the search unit 234 searches for the product only when the first representative color associated with the first region is designated. To do.

The correcting unit 235 performs a first reaction on a product by the user (searcher) after the product is searched for with the first representative color, and a second response for the product by the user after the product is searched for with the second representative color. Based on the reaction, the range of the region in the region information is modified so that the boundary between the first region and the second region is changed.
For example, when the product P shown in FIG. 5 is a suitcase having an intermediate color between red and orange, the user is instructed to search for a “red” suitcase, and the search unit 234 searches for this suitcase. After presenting it in the results (list of search results), the user is instructed to search for the suitcase of “orange” and the number of cases where this suitcase was selected by the user (instructed to transition to the product page) The search unit 234 changes the boundary between “red” and “orange” based on the number of the suitcases selected by the user after presenting the suitcases in the search results. The range of the area in the area information is corrected.

Specifically, when the second representative color “orange” is included in the search results, the suitcase is received from the user rather than when the first representative color “red” is included in the search results. When more selections are made, the correction unit 235 reduces the range of the region in the region information so that the “red” region RA is narrowed and the “orange” region OA is expanded accordingly, as shown in FIG. Correct it. As a result, products in the middle color between red and orange will be more classified into “orange” than “red” in the future, and it will be easier to search when “orange” is designated as the designated color.
On the other hand, when the first representative color “red” is included in the search results, this suitcase is selected more by the user than when the second representative color “orange” is included in the search results. In this case, the correction unit 235 corrects the range of the region in the region information so that the boundary between the “red” region and the “orange” region is returned to the initial boundary. That is, as shown in FIG. 8, if the “red” area RA becomes narrower and the “orange” area OA expands by that amount, the areas are returned to the original. If the “red” area RA and the “orange” area OA remain the initial areas, the correction unit 235 does not perform any correction.

The control unit 230 having such a configuration appropriately performs a so-called A / B test on the intermediate color product, and changes the boundary between corresponding regions according to the result (user reaction). As a result, the intermediate color products are classified into the representative colors that are more responsive to nature, and are easily presented to the user.
The above-described CPU 401 and the like can function as the control unit 230 having such a configuration.

The presentation unit 240 presents various information to the user terminal 300 via the Internet 900.
For example, the presentation unit 240 presents the search results (search result list) that the search unit 234 of the control unit 230 has searched for products to the user terminal 300. That is, when the user designates a designated color and instructs to search for a product, a search result list narrowed down by the designated color is presented to the user terminal 300.

  Note that the above-described CPU 401, NIC 404, and the like can function as such a presentation unit 240.

(Operation of color classification device)
Hereinafter, the operation of the color classification apparatus 200 having such a configuration will be described with reference to FIG. FIG. 9 is a flowchart showing the flow of color classification processing executed by the color classification device 200. This color classification process is started, for example, when the user designates a designated color and instructs to search for a product.

First, the color classification device 200 classifies which region the color of the pixel (mass) of the product image belongs to (step S11).
For example, the control unit 230 (classification unit 231) determines that the number of cells is 100 × 100 (vertical × horizontal) for the product image PI including the product P (suitcase) as shown in FIG. After the grid is formed and color abstraction is performed for each cell, the region to which each cell belongs is classified.
As described above, since the product image PI includes a background, the classification unit 231 classifies which area each cell for the product image PI excluding the background belongs to.

Specifically, when the product P shown in FIG. 5 is a red suitcase, the classification unit 231 classifies 2500 cells as “red” and 900 cells as “gray” as an example. Then, the 200 cells are classified as “pink”. Other squares are also classified but omitted.
Further, when the product P shown in FIG. 5 described above is a suitcase having an intermediate color between red and orange with different colors, the classification unit 231 classifies 1400 cells as “red” as an example. Are classified as “orange” and 900 are classified as “gray”. Other squares are also classified but omitted.

The color classification device 200 acquires the first area and the second area in descending order of the number of classified pixels (mass) (step S12).
Specifically, in step S11, when the classification is “red”: 2500, “gray”: 900, “pink”: 200,..., The control unit 230 (acquisition unit 232) “Red” is acquired as the area, and “gray” is acquired as the second area.
In Step S11, when it is classified as “red”: 1400, “orange”: 1100, “gray”: 900,..., The acquisition unit 232 acquires “red” as the first area. Then, “orange” is acquired as the second area.

The color classification device 200 determines whether or not the first area and the second area satisfy the intermediate color condition (step S13).
For example, the control unit 230 (determination unit 233) has the first area and the second area in contact with each other in the color space, and the number of pixels (mass) classified in the first area and the second area are classified. When the ratio with the number of pixels (mass) that has been exceeded exceeds a predetermined ratio (for example, 5: 3), it is determined that the intermediate color condition is satisfied.
Specifically, when “red” is acquired as the first area and “gray” is acquired as the second area in step S12, “red” and “gray” are not in contact with each other in the color space. Therefore, the determination unit 233 determines that the intermediate color condition is not satisfied.
On the other hand, when “red” (number of squares 1400) is acquired as the first area and “orange” (number of squares 1100) is acquired as the second area in step S12, “red” and “ Since “orange” is in contact with the color space and exceeds the predetermined ratio, the determination unit 233 determines that the intermediate color condition is satisfied.

If the color classification device 200 determines that the first region and the second region satisfy the intermediate color condition (step S13; Yes), the first probability of hitting the search when the designated color matches the first representative color The product is searched according to the second probability of hitting the search when the designated color matches the second representative color (step S14).
That is, the control unit 230 (search unit 234) causes the product to be hit based on the first probability when the designated color designated at the time of retrieval matches the first representative color, or the designated color is the second color. If it matches the representative color, the product is hit based on the second probability.

On the other hand, when it is determined that the first area and the second area do not satisfy the intermediate color condition (step S13; No), the color classification device 200 performs a search when the designated color matches the first representative color. A search for hit is performed (step S15).
That is, the control unit 230 (search unit 234) includes the product in the search result only when the first representative color associated with the first region is designated.

The color classification device 200 presents the search result to the user terminal 300 (step S16).
That is, the presentation unit 240 presents the search results (search result list) searched in step S14 or step S15 described above to the user terminal 300.

The color classification device 200 collects user responses when the intermediate color condition is satisfied (step S17).
That is, the control unit 230 collects user reactions when the search results searched in step S14 described above are presented to the user terminal 300. That is, the first response to the product by the user after the product is searched with the first representative color and the second response to the product after the product is searched with the second representative color are collected.
For example, when the product P shown in FIG. 5 is a suitcase of an intermediate color between red and orange, the user is instructed to search for a “red” suitcase, and the suitcase is searched in step S14. After the presentation is included in the results, the user is instructed to search for the number of suitcases selected by the user (first reaction) and the suitcase of “orange”. In step S14, the suitcases are searched. After the presentation is included in the result, the number of the suitcases selected by the user (second reaction) is totaled.

The color classification device 200 determines whether or not the second reaction has a greater degree of reaction than the first reaction (step S18).
If the color classification device 200 determines that the second reaction has a greater degree of reaction than the first reaction (step S18; Yes), the region information is corrected so that the first region is narrowed and the second region is widened. (Step S19).
For example, when the search result includes the second representative color “orange”, the suitcase is selected more by the user than when the first representative color “red” is included in the search result. In this case, as shown in FIG. 8 described above, the control unit 230 (correction unit 235) makes the “red” region RA narrow and the “orange” region OA widens accordingly. Correct the range of the area. As a result, products in the middle color between red and orange will be more classified into “orange” than “red” in the future, and it will be easier to search when “orange” is designated as the designated color.

On the other hand, when it is determined that the degree of reaction is not greater in the second reaction than in the first reaction (step S18; No), the region information is corrected so that the boundary between the first region and the second region is restored. (Step S20).
For example, when the first representative color “red” is included in the search results, more suitcases are selected from the user than when the second representative color “orange” is included in the search results. In this case, the correction unit 235 corrects the range of the region in the region information so that the boundary between the “red” region and the “orange” region is returned to the initial boundary. That is, in step S19, if the “red” area RA is narrowed and the “orange” area OA is expanded by that amount, the areas are returned to the original. If the “red” area RA and the “orange” area OA remain the initial areas, the correction unit 235 does not perform any correction.

By such color classification processing, even if the color of the product is an intermediate color, it can be appropriately classified into any of the representative colors. Further, since the boundary between adjacent regions is changed according to the reaction of the user, the intermediate color can be classified into representative colors that are easily supported by many users.
As a result, the product colors can be appropriately classified.

(Other embodiments)
In the above embodiment, the case has been described in which the color of the product is classified for each search. However, the classification result may be registered in the product information, and may be classified again at a predetermined review timing. .
For example, in the color classification apparatus 200 shown in FIG. 3 described above, the control unit 230 further includes a registration unit, and the registration unit registers the first representative color and the second representative color in the product information of the product. You may do it.
In this case, the search unit 234 has a first probability that the search is hit when the specified color specified at the time of the search matches the first representative color in the product information, and the specified color is the second representative in the product information. The product is searched according to the second probability of hitting the search when it matches the color.

In the above-described embodiment, the case where only the range of the representative color region is defined in the region information has been described, but the range of the intermediate color region may be defined in the region information.
In this case, the classification unit 231 further classifies the product image pixel including the color of the pixel (mass) belonging to the intermediate force region. Then, the determination unit 233 determines whether or not the intermediate color condition is satisfied based on the result of the classification by the classification unit 231 according to the two types of ranges.
Thereby, it can be determined in more detail whether the color of the product satisfies the intermediate color condition.

  As described above, according to the present invention, it is possible to provide a color classification device, a color classification method, a program, and a non-transitory computer-readable information recording medium that can appropriately classify the color of a product. Can do.

DESCRIPTION OF SYMBOLS 100 Sales system 200 Color classification apparatus 210 Reception part 220 Storage part 230 Control part 231 Classification part 232 Acquisition part 233 Determination part 234 Search part 235 Correction part 240 Presentation part 300 User terminal 400 Information processing apparatus 401 CPU
402 ROM
403 RAM
404 NIC
405 Image processing unit 406 Audio processing unit 407 DVD-ROM drive 408 Interface 409 External memory 410 Controller 411 Monitor 412 Speaker 900 Internet

Claims (8)

A storage unit that stores region information about a plurality of regions that divide the color space and associates the range of the region with a representative color indicating the region;
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
A color classification apparatus comprising: The color classification device according to claim 1,
The correction unit corrects the range of the region in the region information so that the first region is narrowed and the second region is widened when the second reaction is greater in degree than the first reaction. ,
A color classification device characterized by that. The color classification device according to claim 1,
The correction unit is configured to return the boundary between the first region and the second region to the initial boundary when the first reaction is larger than the second reaction. Modify the range,
A color classification device characterized by that. The color classification device according to claim 1,
A registration unit that registers both the first representative color and the second representative color in the product information of the product when the intermediate color condition is satisfied;
The search unit includes a first probability that the search is hit when the specified color specified during the search matches the first representative color in the product information, and the specified color is the second representative in the product information. Search for products according to the second probability of hitting the search when it matches the color,
A color classification device characterized by that. The color classification device according to claim 4,
The search unit calculates the first probability and the second probability based on the number of pixels classified into the first region and the number of pixels classified into the second region.
A color classification device characterized by that. A color classification method in a color classification apparatus having a storage unit that stores area information for associating a range of the area with a representative color indicating the area, which is area information about a plurality of areas that divide the color space,
A classification step in which the color classification device classifies pixels of products included in a product image according to which of the plurality of regions a color of the pixels belongs;
An acquisition step in which the color classification device acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
In the color classification device, the first area and the second area are in contact with each other in the color space, and the number of pixels classified into the first area and the number of pixels classified into the second area A determination step of determining whether or not the intermediate color condition is satisfied, wherein the ratio exceeds a predetermined ratio;
If the color classification device satisfies the intermediate color condition, the product is searched for in either the first representative color associated with the first region or the second representative color associated with the second region. Search step to enable,
The color classification device includes a first response to the product of the searcher after the product is searched with the first representative color and a searcher after the product is searched with the second representative color. A correction step of correcting a range of the region in the region information so as to change a boundary between the first region and the second region based on a second response to the product;
A color classification method comprising: A computer having a storage unit that stores area information about a plurality of areas that divide the color space and that associates the range of the area with a representative color indicating the area,
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
A program characterized by functioning as A computer having a storage unit that stores area information about a plurality of areas that divide the color space and that associates the range of the area with a representative color indicating the area,
A classifying unit that classifies pixels for products included in the product image according to which of the plurality of regions the color of the pixels belongs;
An acquisition unit that acquires the first region and the second region in descending order of the number of pixels classified into each of the plurality of regions;
The first area and the second area are in contact with each other in the color space, and a ratio between the number of pixels classified into the first area and the number of pixels classified into the second area is a predetermined ratio. A determination unit that determines whether or not the intermediate color condition is satisfied,
A search unit capable of searching for the product in any of the first representative color associated with the first region and the second representative color associated with the second region, if the intermediate color condition is satisfied;
A first response to the product of the searcher after the product is searched with the first representative color and a second response to the product of the searcher after the product is searched with the second representative color And a correction unit that corrects a range of the region in the region information so as to change a boundary between the first region and the second region,
A computer-readable recording medium having recorded thereon a program that is caused to function as:

Images