JP6401214B2 - Information processing apparatus and program - Google Patents

Description

  Embodiments described herein relate generally to an information processing apparatus and a program.

  Conventionally, a technology has been proposed in which an image sensor such as a CCD (Charge Coupled Device) image sensor is used to image a barcode and a service label attached to a product and read a product code, discount information, and the like from the captured image. ing. In order to prevent the service label from being overwritten, a flag label (flag information) indicating that the service label is added is attached to the vicinity of the barcode for the product to which the service label is added. Then, when this flag label is read, notification that the service label is added is made to prevent reading over.

  By the way, the flag label generally uses a simple pattern that is easy to detect in order to increase the detection speed. However, since the pattern included in the product package may be similar to the pattern of the flag label, the pattern of the product may be erroneously detected as a flag label.

  The problem to be solved by the embodiment of the present invention is to provide an information processing apparatus and program capable of reducing erroneous detection of flag information.

The information processing apparatus according to the embodiment includes: a specifying unit that specifies the product from information included in a captured image obtained by capturing the product; a first detection unit that detects flag information from the captured image; and the first detection unit includes: Second detection means for detecting service information from the captured image on the condition that flag information has been detected, wherein the first detection means corresponds to a case where the product specified by the specification means corresponds to a predetermined product The flag information is detected using a stricter detection condition compared to the detection condition for detecting the flag information from the non-applicable product.

FIG. 1 is a diagram schematically illustrating an external configuration of a checkout system according to an embodiment. FIG. 2 is a diagram illustrating a configuration of the code reading apparatus according to the embodiment. FIG. 3 is a diagram illustrating an example of the relationship between the product and the imaging area of the camera. FIG. 4 is a diagram illustrating an example of a product package. FIG. 5 is a flowchart illustrating a procedure of information reading processing executed by the code reading device according to the embodiment.

  Hereinafter, embodiments of an information processing apparatus and a program will be described in detail with reference to the accompanying drawings. The embodiment described below is an embodiment of the information processing apparatus and program, and does not limit the configuration, specifications, or the like. This embodiment is an application example to a product code reading device that reads information about a product.

  FIG. 1 is a diagram schematically illustrating an external configuration of a checkout lane system 4 including a code reading device 2 according to the present embodiment. As shown in FIG. 1, a checkout lane system 4 includes a soccer stand 1 for placing a shopping basket containing merchandise, a code reading device 2 erected substantially at the center of the soccer stand 1, and a code reading The apparatus 2 and the POS terminal 3 connected so as to be able to communicate with each other by a transmission path (not shown) are provided.

  The POS terminal 3 performs sales registration of products purchased by customers. As shown in FIG. 1, the POS terminal 3 includes a keyboard 31, an operator display 32, a customer display 33, a printer 34 for printing receipts, a drawer 35 for storing cash, and the like. The keyboard 31 is provided with a fastening key or the like necessary for settlement of the commodity price. The POS terminal 3 has the same configuration and functions as the POS terminal that is used as standard in this type of checkout lane system.

  The code reading device 2 is a device for reading a barcode attached to a product and outputting product information (product code) included in the barcode to the POS terminal 3. Here, the product code is a product identifier that can identify the product to which the barcode is attached.

  As shown in FIG. 1, the code reading device 2 includes a reading window 21, a keyboard 22, a customer display 23, a store clerk display 24, a buzzer 25, and an LED 26.

  The keyboard 22 accepts input from various keys when registering a product that cannot be registered with a barcode. The customer display 23 displays the registered product name, price, etc. to the shopper or store clerk. The store clerk display 24 displays the registered product name, price, and other error messages to the operator store clerk.

  The code reader 2 provided with the reading window 21 includes a camera 20 (imaging means) therein. The camera 20 may be an imaging device using, for example, a CCD (Charge Coupled Device), or may be an imaging device using another imaging element such as a CMOS (Complementary Metal Oxide Semiconductor). The camera 20 captures an image of a product held over an imaging area facing the reading window 21.

  FIG. 2 is a diagram illustrating a configuration of the code reading device 2 according to the first embodiment. The code reader 2 includes a CPU 50, a ROM 42, a RAM 43, a communication I / F 44, an output port 45, a keyboard controller 46, a display controller 47, a display controller 47, which are connected by a bus line 41 such as an address bus or a data bus. 48, a camera controller 49, and a memory 27.

  The CPU 50 functions as a control unit that controls the entire operation of the code reading device 2. The ROM 42 stores a program according to the present embodiment, other programs that control the operation of the CPU 50, various target product lists, and the like.

  The RAM 43 functions as a work area when the CPU 50 develops various programs stored in the ROM 42. The RAM 43 stores various data such as image data captured by the camera 20.

  The communication I / F 44 controls data communication with the POS terminal 3 (see FIG. 1) connected via the bus. The output port 45 outputs a drive signal to the buzzer 25 and the LED 26. The keyboard controller 46 takes in key signals from the keyboard 22. The display controller 47 controls data display on the customer display 23. The display controller 48 controls data display on the store clerk display 24. The camera controller 49 controls the imaging operation of the camera 20.

  The camera 20 images a code symbol (first symbol) such as a barcode or a two-dimensional code attached to a product, a label (service label) displaying a service such as discount or point addition.

The memory 27 is a non-volatile memory such as a flash memory. The memory 27 stores various programs executed by the CPU 50 and various setting information such as an identification pattern storage file 27a and a target product list 27b. The identification pattern storage file 27a stores flag information representing flag labels , service information representing service labels, identification patterns for pattern identification, information for character recognition, and the like. The target product list 27b stores product codes of products having a pattern similar to the design of flag information such as a flag label described later.

  Next, a service label affixed to a product for discount sales of the product and a flag label affixed to prevent the service label from being overwritten will be described with reference to FIG. It should be noted that existing technology can be used for a preferred embodiment of a flag label, a flag label detection method, and the like, and detailed description thereof is omitted here.

  FIG. 3 is a diagram illustrating an example of the relationship between the product 60 and the imaging area of the camera 20. Imaging areas 70a and 70b surrounded by a two-dot chain line in the figure are areas in which the camera 20 can capture images in one frame. In addition to the barcode label 61, a discount label L, which is an example of a service label, is attached to the product 60 shown in FIG.

  The barcode label 61 includes the product name “product A1” of the product 60, the product price “200 yen”, the barcode 62, and the like. In the barcode 62, information such as a product code is incorporated as product information necessary for registering the sales data of the product 60 at the POS terminal 3. The product code “2101234567890” incorporated in the barcode 62 is displayed below the barcode 62. The discount label L displays character information “half price of display price” indicating the discount amount related to the product 60.

  In addition, as a service label, what is attached | subjected to the goods 60 and displays the service provided at the time of sale registration of the goods 60 should just be displayed. In other words, the service label is a display indicating a predetermined service to be given to the product 60 specified by the barcode 62 with characters or symbols. Other examples of service labels include a discount label that displays the discount rate of the product 60, and a point surcharge that displays the number of points that are given to the customer who purchased the product 60 in addition to the normal number of points granted. There are labels.

  Further, a flag label F indicating that the discount label L is attached to the product 60 is attached in the vicinity of the barcode 62. When the code reader 2 detects the flag label F, the code reader 2 recognizes that the discount label L is affixed to the product 60 and repeats imaging by the camera 20 until the discount label L is read.

  That is, as shown in FIG. 3, when the barcode 62 and the discount label L are pasted apart on the product 60, the barcode 62 and the discount label L are not captured by the same imaging area. However, when the code reading device 2 detects the flag label F, the code reading device 2 notifies the operator that the discount label L is affixed, and repeats imaging by the camera 20 until the discount label L is read. When the operator changes the position of the product 60 held over the reading window 21, the code reader 2 divides the frame of the imaging area 70a including the barcode 62 and the imaging area 70b including the discount label L into a plurality of times. Then, the discount label L is read.

  As a result, even if the discount label L is pasted away from the barcode 62 and the barcode 62 and the discount label L cannot be captured in one shot, the product 60 is still a discount target product. Therefore, it is possible to prevent the discount label L from being read out and registering sales without performing the discount process.

  FIG. 4 is a diagram illustrating an example of a product package. The flag label F generally uses a simple pattern that is easy to detect in order to increase the detection speed. Therefore, there may be a product 60 having a pattern similar to the flag label F among the many products 60. For example, as shown in FIG. 4, the eyeball C1 portion of the character C included in the package of the product 60 is similar to the flag label F shown in FIG. In this case, the centerpiece C1 may be erroneously detected as the flag label F.

  Therefore, in the present embodiment, the product code of the product 60 having a pattern similar to the flag label F is registered in advance in the target product list 27b. When the code reading device 2 reads the product code registered in the target product list 27b, the code reading device 2 switches the detection method of the flag label F to another detection method, so that the design of the product 60 is mistaken for the flag label F. Prevents detection. Detailed operation will be described later.

  Next, a functional configuration of the code reading device 2 that is realized by the CPU 50 executing the program will be described. The CPU 50 operates according to a program stored in the ROM 42 expanded in the RAM 43, so that as shown in FIG. 2, the image capture unit 51, the barcode detection unit 52 (identification means), and the target product determination unit 53 ( Functions as a determination unit), a flag information detection unit 54 (first detection unit), a service information detection unit 55 (second detection unit), a notification unit 56 (notification unit), and an information output unit 57.

  The image capturing unit 51 outputs an imaging on signal to the camera controller 49 to cause the camera 20 to start an imaging operation. Further, when receiving an instruction from the service information detection unit 55, the image capture unit 51 captures an image in the imaging area 70 a or 70 b captured by the camera 20 and stores it in the image work area of the RAM 43.

  The barcode detection unit 52 detects the code symbol attached to the product from the image captured by the image capture unit 51. In addition, the barcode detection unit 52 reads the product code from the detected code symbol, thereby specifying the product to which the code symbol is attached.

  Specifically, the barcode detection unit 52 detects a barcode by a pattern matching technique from a captured image, detects a two-dimensional code from a predetermined finder pattern, and the like. The barcode detection unit 52 converts the code symbol detected according to a predetermined decoding method into code information, and reads the code information corresponding to the code symbol. For example, in the example of FIG. 3, the barcode detection unit 52 detects the barcode 62 and reads the product code “2101234567890” included in the barcode 62 to identify the product.

  The target product determination unit 53 searches the target product list 27b for the product code read by the barcode detection unit 52, and determines whether or not the product code is registered in the target product list 27b.

  The flag information detection unit 54 detects an image of flag information from the image captured by the image capture unit 51. The flag information detection unit 54 switches the flag information detection method according to the determination result of the target product determination unit 53. Specifically, the flag information detection unit 54 detects flag information using the first detection method when the target product determination unit 53 determines that it is not registered in the target product list 27b. The flag information detection unit 54 detects flag information using a second detection method different from the first detection method when the target product determination unit 53 determines that the target product list 27b is not registered. .

  In the second detection method, in order to avoid erroneously detecting the design of the product 60 as flag information, the detection conditions relating to detection of the flag label F are more strict than in the first detection method. The flag label detection conditions that are flag information include, for example, the aspect ratio of the flag label, the thickness of the line (circle) constituting the flag label, the size of each circle, the color of the flag label, and the size of the margin around the flag label. The relative positional relationship between the flag label and the barcode. In the second detection method, these detection conditions are stricter than those in the first detection method. The second detection method is not limited to the above example, and a detection method that is not performed in the first detection method may be used. For example, by using a conventional technique for recognizing a face or eyes, a region corresponding to the face or eyes may be detected from the design of the product 60, and a flag label may be detected from other regions other than the detected region.

  Moreover, the flag information detection part 54 determines with the service information having been attached | subjected to the goods 60, when the image of flag information is detected. In addition, the existing technology can be used for detection of flag information.

  When it is determined by the flag information detection unit 54 that the service information is attached, the service information detection unit 55 executes detection of service information images from images sequentially captured by the image capture unit 51 for a predetermined time. . Further, when the service information detecting unit 55 detects an image of the service information, the service information detecting unit 55 reads service content information representing the content of the service indicated in the service information.

  Specifically, the service information detection unit 55 uses information representing graphic features such as a frame line and a shape of the service label set in advance in the identification pattern storage file 27a, so that the service label of the service information is displayed. Detect the image area. Then, the service information detection unit 55 performs character recognition processing such as OCR (Optical Character Reader) or pattern recognition processing on the image area of the detected service label, thereby reducing the discount indicated by the service label, Read service content information such as discount rate. For example, in the example of FIG. 3, the service information detection unit 55 recognizes characters such as “half price” written on the discount label L, and reads the service content information for 50% discount.

  When the flag information detection unit 54 determines that the service label that is service information is attached to the product 60, the notification unit 56 reads that the product 60 has a service label or reads the service label. A first message to the effect is displayed on the clerk display 24.

  For example, when it is determined that the service label is added to the product 60, the notification unit 56 sounds the buzzer 25 and controls the display controller 48 to “scan the service label” or the like. Is displayed on the salesclerk display 24. Accordingly, since it is possible to notify the operator that the service label is attached to the product 60, it is possible to prevent the service label from being overwritten.

  In addition, when the service information detection unit 55 does not detect the service label as the service information for a predetermined time, the notification unit 56 displays a second message such as “Is there a service label?” On the clerk display 24. Is displayed. Thereby, it is possible to confirm again with the operator whether the service label is affixed. In addition, the alerting | reporting method is not limited to the said example, You may perform the said alerting | reporting by audio | voice output. Moreover, the alerting | reporting part 56 may blink LED26.

  The information output unit 57 outputs the code information read by the barcode detection unit 52 to the POS terminal 3 via the communication I / F 44. Further, when the service information detecting unit 55 reads the service content information, the information output unit 57 outputs the read service content information to the POS terminal 3 together with the code information.

  The POS terminal 3 receives the code information output from the information output unit 57 of the code reading device 2 and registers the sale of the product 60 using the received code information. Further, when the service content information is received together with the code information, the POS terminal 3 gives a service corresponding to the service content information to the product 60 and registers the product 60 for sale.

  Next, a procedure of information reading processing executed by the code reading device 2 of the present embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing a procedure of information reading processing executed by the code reading device 2.

  When receiving an instruction to start scanning from the POS terminal 3, the image capturing unit 51 of the code reading device 2 outputs an imaging on signal to the camera controller 49, and starts imaging by the camera 20 (step S11). The image capturing unit 51 captures image data of an image captured by the camera 20 into the image work area of the RAM 43 (step S12).

  The barcode detection unit 52 determines whether a barcode image is detected in the captured image (step S13). When the barcode image is not detected (step S13: No), the image capturing unit 51 continues the imaging with the camera 20 (step S12). When a barcode image is detected (step S13: Yes), the barcode detection unit 52 reads code information corresponding to the detected barcode.

  Next, the target product determination unit 53 determines whether or not the product code read in step S13 is registered in the target product list 27b (step S14). Here, when it is determined that it is not registered in the target product list 27b (step S14; No), the flag information detection unit 54 uses the first detection method to detect the flag information image from the captured image. Detection is performed (step S15). When it is determined that the product is registered in the target product list 27b (step S14; Yes), the flag information detection unit 54 uses the second detection method to detect an image of flag information from the captured image. Is performed (step S16).

  The flag information detection unit 54 determines whether or not an image of flag information has been detected in step S15 or step S16 (step S17). If it is determined that the flag information image is not detected (step S17; No), the process proceeds to step S23.

  On the other hand, in step S17, when the flag information detection unit 54 detects the flag information image, the flag information detection unit 54 determines that the service information is attached to the product 60 (step S17; Yes). Subsequently, the notification unit 56 causes the clerk display 24 to display a first message indicating that the service information is attached to the product 60 or that the service information is read (step S18).

  Subsequently, the service information detection unit 55 detects service information images from sequentially captured images, and determines whether or not the service information has been detected within a predetermined time (step S19). Here, when the service information is detected within the predetermined time (step S19: Yes), the information output unit 57 includes the product code read in step S13, the service content information read from the service information by OCR or the like. Is output to the POS terminal 3 (step S20).

  On the other hand, when the service label which is the service information is not detected within the predetermined time in step S19 (step S19: No), the notification unit 56 displays a message such as “Is there a discount label?” The second message is displayed and the operator is again confirmed whether the service label is affixed (step S21).

  On the other hand, when the operator confirms that the service label is not attached to the product 60 and presses the enter key of the keyboard 22 (step S22: Yes), the information output unit 57 is read in step S13. The product code is output to the POS terminal 3 (step S23). On the other hand, when the enter key is not pressed in step S22 (step S22: No), the process returns to step S17.

  After step S20 or step S23, the code reading device 2 determines whether or not the sales registration process has been completed from the POS terminal 3 and the end of the barcode reading process has been instructed (step S24). If the end of the barcode reading process is not instructed (step S24: No), the process returns to step S12 and the subsequent processes are continued. When the end of the barcode reading process is instructed (step S24: Yes), the code reading device 2 outputs an imaging off signal to the camera controller 49 (step S25), and the imaging by the camera 20 is terminated.

  As described above, according to the present embodiment, the product code of the product 60 having a pattern similar to the flag information is registered in the target product list 27b, and the product code registered in the target product list 27b is read. The flag information is detected by switching the detection method. Thereby, in the case of the product 60 having a mark similar to the flag information, the flag information can be detected by using a detection method different from that of the normal product not having the mark or a stricter detection condition. Therefore, erroneous detection of flag information can be reduced.

  As mentioned above, although embodiment of this invention was described, the said embodiment was shown as an example and is not intending limiting the range of invention. The above embodiment can be implemented in various other forms, and various omissions, replacements, changes, additions, combinations, and the like can be made without departing from the scope of the invention. Moreover, the said embodiment and its deformation | transformation are included in the range of the invention, the summary, and the invention described in the claim, and its equal range.

  For example, in the above-described embodiment, an example in which one service label is attached to the product 60 has been described. However, a plurality of service labels may be attached to the product 60. In this case, the information output unit 57 outputs a plurality of service information read from each service label to the POS terminal 3 together with the code information.

  Service information such as discounts and discounts and bar codes are not limited to the form printed on the label. As another example, service information or a barcode may be directly written or printed on the product 60. Moreover, flag information is not limited to the form printed on a label. As another example, service information or a barcode may be directly written or printed on the product 60. In the above embodiment, the flag label F is described as a double circle, but the present invention is not limited to this. For example, the mark may be a triangle, a rectangle, a check mark, a pattern, a character, or the like.

  Moreover, in the said embodiment, although it was set as the form which identifies the said goods by reading the code symbol (barcode) attached | subjected to the goods, the identification method of goods shall not be restricted to this. For example, the product may be identified using a known object recognition technique in which the product is identified (recognized) from the feature amount obtained from the appearance of the product. When this form is adopted, the specifying unit of the information processing apparatus extracts features on the appearance (shape, color, surface irregularities, etc.) of the product that is the subject from the captured image captured by the camera 20 as a feature amount. . Then, the specifying unit of the information processing device specifies (recognizes) the product that is the subject by comparing the extracted feature value with the feature value (collation data) of the reference product prepared in advance. The product identifier registered in the target product list 27b is not limited to the product code, and other product identifiers such as a product name may be used.

  The program executed by the code reading device 2 of the above embodiment is provided by being incorporated in advance in a ROM or the like. The program executed by the code reader 2 of the above embodiment is a file in an installable format or an executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), or the like. It may be configured to be recorded on a computer-readable recording medium.

  Furthermore, the program executed by the code reading device 2 of the above embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program executed by the code reading device 2 of the above embodiment may be configured to be provided or distributed via a network such as the Internet.

  The program executed by the code reading device 2 of the above embodiment includes the above-described units (image capturing unit 51, barcode detection unit 52, target product determination unit 53, flag information detection unit 54, service information detection unit 55, notification Unit 56 and information output unit 57), and as actual hardware, the CPU (processor) reads out the program from the ROM and executes the program, so that each unit is loaded on the main storage device, An image capture unit 51, a barcode detection unit 52, a target product determination unit 53, a flag information detection unit 54, a service information detection unit 55, a notification unit 56, and an information output unit 57 are generated on the main storage device. ing.

2 Code reader 20 Camera 27 Memory 27a Identification pattern storage file 27b Target product list 49 Camera controller 50 CPU
51 Image Capture Unit 52 Barcode Detection Unit 53 Target Product Determination Unit 54 Flag Information Detection Unit 55 Service Information Detection Unit 56 Notification Unit 57 Information Output Unit

JP 2008-33640 A

Claims (4)

A specifying means for specifying the product from information included in a captured image obtained by imaging the product;
First detection means for detecting flag information from the captured image;
Second detection means for detecting service information from the captured image on condition that the first detection means has detected the flag information;
With
When the product specified by the specifying unit corresponds to a predetermined product, the first detection unit is compared with a detection condition for detecting the flag information from a non-applicable product, and uses a stricter detection condition. An information processing apparatus that detects the flag information. 2. The information processing apparatus according to claim 1 , further comprising first notification means for notifying that the service information is attached to the product on condition that the first detection means detects the flag information. Information described on condition that the second detecting means can not detect the service information during a predetermined period of time, to claim 1 or 2 further comprising a second notification means for performing notification to urge the confirmation of the service information Processing equipment. The computer of the information processing device
A specifying means for specifying the product from information included in a captured image obtained by imaging the product;
First detection means for detecting flag information from the captured image;
Second detection means for detecting service information from the captured image on condition that the first detection means has detected the flag information;
To function,
When the product specified by the specifying unit corresponds to a predetermined product, the first detection unit is compared with a detection condition for detecting the flag information from a non-applicable product, and uses a stricter detection condition. A program for detecting the flag information.

Images