JP2010122770A - Method and device for reading optical automatic-recognition code - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display method for displaying the result of reading/recognizing 1D color bit codes in an improved manner when the plurality of 1D color bit codes are read and recognized at a time. <P>SOLUTION: Image data are captured by picking up an image including one or more code symbols of an optical automatic-recognition code. The initial image data are set as a "reference capture screen", and in order to overwrite the decode result of each image data captured afterwards on the "reference capture screen", the position etc. of a frame is stored. In this case, correction coefficients are obtained and stored in the position on the reference capture screen. After a plurality of capturing operations, the position of the frame of a code symbol is corrected, and inserted and displayed on the reference capture image. It is therefore possible to improve operability by intuitively showing whether a code has been recognized or not to an operator. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for optically reading a plurality of optical recognition codes (also referred to as automatic recognition code tags), collectively recognizing them, searching for target code symbols (also referred to as tags), and displaying them in an easy-to-understand manner for an operator. That is, the present invention relates to a technique for optically reading and decoding an optical recognition code.

  The inventor of the present application has proposed an optical recognition code representing information by color transition and change in Japanese Patent Application No. 2006-196705. This optical recognition code is called a “1D color bit code”. According to this 1D color bit code, since the restrictions on the size and shape of the area occupied by each color are relaxed, the tag can be formed in a free shape. In addition, it is possible to mark a tag on an uneven surface or a flexible material, which is impossible with a conventional barcode.

  The inventor of the present application has proposed a method for recognizing the 1D color bit code in Japanese Patent Application No. 2007-130504. That is, the recognition of the 1D color bit code is performed by reading an image of a certain area and performing image processing. Therefore, it can be recognized regardless of the position and orientation of the code.

  At this time, a plurality of 1D color bit codes may be included in the area. In this case, recognition / decoding is performed for each of the plurality of 1D color bit codes. Therefore, the 1D color bit code has a feature that a plurality of codes can be easily and simultaneously recognized.

  Also, when trying to recognize a plurality of 1D color bit codes, it is very important from the viewpoint of operability to distinguish and display what can be recognized and what cannot be recognized. In this regard, the inventor of the present application has proposed a method in which the recognized 1D color bit code can be clearly distinguished by surrounding it with a frame line on the image, according to Japanese Patent Application No. 2007-142145.

  Thus, the 1D color bit code developed by the inventors of the present application is a code that is inherently easy to read and recognize a plurality.

Conventional prior arts, for example, Patent Document 1 below discloses a technique for improving the decoding speed by devising the order when decoding a plurality of types of barcodes.

  Patent Document 2 listed below discloses an identification code batch reading device that collectively reads identification codes assigned to a large amount of workpieces.

  Patent Document 3 below discloses a method of cutting out a barcode from image data including characters and patterns.

  Furthermore, Patent Document 4 below discloses a barcode cutout method that can read a plurality of barcodes. According to the technique disclosed here, it is described that a plurality of barcodes can be cut out because the left margin and the right margin can be continuously recognized even outside the standard.

JP-A-11-316796 JP 2005-157440 A JP 2004-0774516 A JP-A-8-185463

  Thus, the 1D color bit code is suitable for recognizing a plurality of tags included in one screen at a time.

  An image used for recognition of the 1D color bit code is a still image input from a CCD camera or the like. Usually, an input image from a moving image capture camera is intermittently regarded as a frame image (still image), and a tag (code symbol) is recognized and decoded for each still image. In addition, the still image group continuously acquired at about 30 fps of a general moving image is literally a “continuous” frame image, but if it is taken at a wider time interval, it is taken “in pieces”. The still image group (image data group) is often referred to as an “intermittent” frame image. In the case of an automatic recognition code, it is not necessary to acquire images literally continuously like a general moving image, and imaging is often performed in accordance with an operator's instruction.

  For example, when there is one tag to be read and recognition is performed using only one still image, the target tag may not be recognized due to imaging conditions such as a light source and blurring during imaging. Therefore, by continuously recognizing using a plurality of still images, the burden of the recognition operation is reduced even when the imaging conditions are bad. However, when recognizing using a plurality of still images in this way, the recognition result for each still image may differ depending on the imaging conditions. As a result, it is difficult to intuitively determine whether or not the target tag has been recognized.

  Also, when recognizing a plurality of tags, similarly, a still image is intermittently captured from the moving image capture camera, and recognition processing is performed. However, as in the case of recognizing one code, it is assumed that the recognizable code is different for each still image due to a difference in imaging conditions. As a result, in order to distinguish between the recognized tag and the unrecognized tag, it is necessary to compare and confirm the recognition result for each still image, and there is a problem in terms of operability.

  In this way, when performing recognition using a plurality of still images, a method for clearly and clearly distinguishing recognized tags and unrecognized tags has not been known yet.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and its object is to propose an improved display method for reading and recognizing a plurality of 1D color bit codes collectively. That is.

  In order to solve the above problems, the present invention sets a “reference capture screen” from the input still images, and overwrites the code recognition result for each still image on the “reference capture screen”. Stores the position of the explicit frame that clearly indicates the symbol. The explicit frame is displayed on each captured image data for each capture. At this time, a correction coefficient for conversion to a position or the like on the reference capture image is also obtained and stored in the same manner. After the capture is repeated a predetermined number of times, the code frame that has been recognized is converted into a position on the reference capture screen after converting its explicit frame, inserted into the reference capture image, and displayed to the user. As a result, all the recognized codes are clarified, and the operability is improved by intuitively indicating to the operator which code has been recognized (or which has not been recognized).

  Also, instead of displaying them together at the end, when decoding is successful, an explicit frame is displayed on the image data, and it is also inserted on the reference capture image every time it is captured. It is also suitable to adopt.

  Therefore, once a tag can be recognized, it will be clearly recognized that it has already been recognized even if it cannot be recognized by the captured image data, and all codes that have been decoded so far will be clarified. It is intended to improve operability by intuitively showing the operator whether it was recognized (or not recognized).

  Specifically, the following means are adopted.

  (1) In order to solve the above-described problem, the present invention provides a method of reading an optical automatic recognition code, and a capture step of capturing image data including one or more code symbols of the optical automatic recognition code; A step of cutting out an area occupied by the code symbol from the captured image data, a data storing step of decoding the code symbol of the cut out area and storing the obtained data in a predetermined storage means, and the decoding succeeded The position of the explicit frame indicating the area of the code symbol is calculated and stored in a predetermined storage means, and the explicit frame is superimposed and inserted at the obtained position of the captured image data. A first insertion step, the captured image data, and the first captured image data; And a step of calculating the positional relationship between the two and storing them in the storage means, a first display step of displaying the image data in which the explicit frame is inserted to the user, and the capture step From the repetitive step of repeating the process up to the display step at least once, and after the repetitive processing in the repetitive step, the position of the explicit frame is extracted from the storage means, and the position is corrected based on the positional relationship, and the reference A position conversion step for converting to a position on the captured image; a second insertion step for inserting the explicit frame into the converted position of the reference capture image; and a code symbol that has been successfully decoded in the second insertion step A second display step for displaying the reference capture image in which the explicit frame is inserted. , After the repeating process is finished, the reference capture image, an optically automatic recognition code reading method, wherein a decoded until it is inserted explicit frame the code symbol success.

  (2) Further, in order to solve the above-described problem, the present invention provides a capture step of capturing image data including one or more code symbols of the optical automatic recognition code in a method of reading an optical automatic recognition code. Cutting out the area occupied by the code symbol from the captured image data; decoding the code symbol in the cut out area; and storing the obtained data in a predetermined storage means; and the decoding Calculates a position of an explicit frame indicating the region of the code symbol that has succeeded, and stores the position in a predetermined storage unit, and the explicit frame is superimposed on the obtained position of the captured image data. A first insertion step of inserting, and a first of displaying image data in which the explicit frame is inserted to a user Comparing the captured image data with the reference captured image that is the first captured image data, calculating a positional relationship between the captured image data and storing it in the storage means; and from the storage means to the explicit frame The position is converted based on the positional relationship and converted into a position on the reference capture image, and the explicit frame is inserted at the converted position of the reference capture image. A second insertion step; a second display step for displaying the reference capture image in which the explicit frame of the code symbol that has been successfully decoded in the second insertion step is inserted; and from the capture step to the display step. A repetition step that is repeated one or more times, and the reference capture image includes Each time the capture of tea step is performed, an optical automatic recognition code reading method characterized by explicit frame of code symbol decoding is successful is added.

  (3) In the optical automatic recognition code reading method according to (1), the present invention is characterized in that the reference capture image starts to be displayed when the repetition process in the repetition step is started. This is an optical automatic recognition code reading method.

  (4) In the optical automatic recognition code reading method according to (1), the present invention is characterized in that the reference capture image is displayed for the first time after the repetition process in the repetition step is completed. This is an optical automatic recognition code reading method.

  (5) Further, the present invention is the optical automatic recognition code reading method according to (1) or (2), wherein the optical automatic recognition code arranges color cells and arranges the colors of the color cells. An optical automatic recognition code reading method, which is an “automatic recognition code by color arrangement” that represents data by any one of color transition and color combination.

  (6) Further, in the optical automatic recognition code reading method according to any one of (1) to (5), the present invention provides the coordinates of the explicit frame in the “position” of the explicit frame. The optical automatic recognition code reading method includes one or more parameters of the size of the explicit frame, the orientation of the explicit frame, and the vertical and horizontal lengths of the explicit frame.

  (7) Further, in the optical automatic recognition code reading method according to any one of (1) to (7), the present invention provides a “positional relationship” between the images, the amount of translation, The optical automatic recognition code reading method includes one or more parameters of rotation direction, rotation amount, and scaling (enlargement / reduction).

  (8) Further, in the optical automatic recognition code reading method according to (1) or (2), the second display step further includes the storage unit storing the data of the code symbol that has been successfully decoded. The optical automatic recognition code reading method is characterized in that it is displayed in association with the explicit frame of the corresponding code symbol.

  (9) Further, the present invention is the optical automatic recognition code reading method according to (8), wherein the association is performed by displaying the data in the vicinity of the corresponding explicit frame of the data. This is an optical automatic recognition code reading method.

  (10) Further, the present invention provides the optical automatic recognition code reading method according to (8), wherein the association is performed by connecting the data and the explicit frame corresponding to the data with a curve. This is an optical automatic recognition code reading method.

  (11) Further, in the optical automatic recognition code reading method according to any one of (1), (3), (4), and (5), the present invention provides the same code in the position conversion step. In the case where a plurality of the explicit frames corresponding to the symbols are stored in the storage means, the position is converted only for one of the explicit frames, and in the second insertion step, the converted 1 An optical automatic recognition code reading method, wherein an explicit frame is inserted into the reference capture image.

  (12) Further, in the optical automatic recognition code reading method according to any one of (1) to (5), the present invention displays the image data on a first screen in the first display step. In the second display step, the reference capture image is displayed on a second screen different from the large screen, and both the first screen and the second screen are simultaneously displayed to the user. An optical automatic recognition code reading method.

  (13) Moreover, in the optical automatic recognition code reading method according to any one of (1) to (5), the present invention provides the captured image after the capture is performed in the capture step. Data is displayed to the user, and in the first display step, the image data in which the explicit frame is inserted is displayed to the user instead of the image data displayed in the capture step. This is an optical automatic recognition code reading method.

  (14) Moreover, the present invention provides the optical automatic recognition code reading method according to any one of (1) to (5), wherein the repetition step is repeated until a predetermined time elapses. An optical automatic recognition code reading method characterized in that the process is repeatedly executed.

  (15) Further, the present invention provides the optical automatic recognition code reading method according to any one of (1) to (5), wherein the repetition step includes the number of code symbols that have been decoded so far. The optical automatic recognition code reading method is characterized in that the repetitive processing is repeatedly executed until a predetermined number is reached.

  (16) Further, in the optical automatic recognition code reading method according to any one of (1) to (5), the present invention is such that in the repetition step, the decoding of all the code symbols to be read is completed. In this case, the optical automatic recognition code reading method is characterized in that the repetitive processing is terminated.

  (17) In the optical automatic recognition code reading method according to any one of (1) to (5), the present invention provides a reading target based on the number of code symbols decoded so far. An optical automatic recognition code reading method characterized in that when the same data as that obtained when all of the code symbols can be decoded is obtained, the number of the repetition processes is terminated.

  (18) In the optical automatic recognition code reading method according to (16), the present invention can decode all the code symbols to be read based on the number of code symbols that can be decoded so far. If the same data is obtained, error correction is performed based on the number of code symbols that have been decoded so far, the code symbol data that has not been decoded is compensated, and all the read target data are obtained. An optical automatic recognition code reading method, characterized in that the same data as when a code symbol is decoded can be reproduced.

  (19) Further, in the optical automatic recognition code reading method according to any one of (1) to (5), the present invention can read a code symbol representing a predetermined end code. In this case, the optical automatic recognition code reading method is characterized in that the repetitive processing is terminated.

  (20) Moreover, this invention is an optical automatic recognition code reader which performs the optical automatic recognition code reading method of any one of (1)-(19).

  As described above, according to the present invention, decoding of code symbols is attempted for each captured image data, and an explicit frame is obtained and displayed for the decoded code symbols. Further, the position of the explicit frame and the like are displayed together on the reference capture screen.

  Therefore, it is possible to easily know which code symbol has been read, and a highly convenient optical automatic recognition code reading method and apparatus can be obtained.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

Configuration of the First System First, the configuration of the code symbol reading result multiplex display device 10 and the like used in the present embodiment and the configuration of the automatic recognition code based on the color arrangement read by this system will be described.

(1) Configuration of Code Symbol Reading Result Multiple Display Device FIG. 1 shows a code symbol reading result multiple display device 10, a capture means 12, and an article 14 according to the present invention.

  As shown in FIG. 1, the code symbol reading result multiple display device 10 is composed of a computer. Details thereof will be described later.

  A code symbol 20 is attached to the side surface of the article 14. The capture unit 12 is a CCD camera and sequentially captures the code symbols 20. The capture unit 12 is connected to the code symbol reading result multiplex display device 10 and sends the image data of the code symbol 20 to the code symbol reading result multiplex display device 10.

Terminology Here, a code symbol is composed of a plurality of color cells. A color cell is given a certain color, and each code symbol is configured by arranging the color cells. A code symbol is an individual symbol constructed to represent predetermined data by a certain code system.

  The code has various meanings. In general, this means a “code system” consisting of code generation rules, decoding rules, colors to be used and a color space that is an allowable range of the colors, etc., but one symbol ( The code symbol) may also be referred to as XX code for convenience.

  The code symbol is configured by arranging a plurality of color cells based on a code rule. In the present embodiment, the color cell refers to a two-dimensional predetermined region to which a certain color is added.

More specifically, the color cell means a predetermined color area (color area) on the article in the captured image in this embodiment. A code symbol is sometimes simply referred to as a symbol. In this embodiment, the code symbol functions as an automatic recognition code based on the color arrangement, and represents data such as numerical values.

  With such a configuration, the code symbol reading result multiplex display device 10 decodes the code symbol 20 attached to the article 14 as an automatic recognition code based on the color arrangement, and displays the obtained data on the display (as will be described later). Display operation) (corresponding to the display means 18).

Configuration of Second Code and Code Symbol The following configuration is adopted for the code and code symbol used in the present embodiment.

  The following configuration is employed with the goal of improving the readability of code symbols.

  In general, a long code symbol is necessary to represent a large amount of data. However, the longer the code symbol is, the higher the possibility that it will become unreadable due to the influence of optical effects and dirt.

  Therefore, originally, one code symbol is divided into a plurality of pieces, and the divided code is read individually and synthesized later to reconstruct the original code symbol.

  A group of code symbols divided into a plurality of groups is referred to as a “symbol group”, and individual code symbols after the division are specifically referred to as “division code symbols” or “division symbols”. If this divided symbol is individually read-tried, the possibility of being read is much greater than if the code symbol remains long even if it is subjected to optical influences (such as lighting and camera settings). Become. Here, the reading try means repeating the retry when reading of the divided symbols fails.

2-1 . By applying an error correction code to a divided code symbol that has been subjected to error correction division, and performing error correction, it is possible to allow a partial divided code symbol to be lost. That is, even if some of the divided code symbols are dirty and cannot be read, the original code symbols can be reconstructed from the remaining divided code symbols belonging to the same symbol group. Since such error correction techniques are well known in the art, the conventional techniques may be used as they are.

  Therefore, for example, even if there is a code symbol that could not be read due to dirt or fading, the original code symbol can be reconstructed based on the remaining divided code symbols.

2-2 Code Symbol Identification Operation In this section, a method for identifying a symbol group and individual code symbols will be described with reference to FIGS.

  In the present embodiment, one symbol group is composed of four divided code symbols. As described above, each divided code symbol includes an error correction code such as CRC, and even if one divided code symbol is lost among the four divided code symbols, the original code is generated from the remaining three code symbols. Code symbols can be reconstructed.

  In the present embodiment, one symbol group represents one original code symbol, which naturally represents one data.

  FIG. 2 shows an example in which two data are represented by two symbol groups (including a total of eight code symbols 22a, 22b, 22c, 22d, 24a, 24b, 24c, and 24d).

  Here, as shown in FIG. 2, even when a plurality of groups of code symbols are mixed, it is possible to visually grasp individual code symbols read from the plurality of groups of symbols. Is important in performing the operation.

  First, in this embodiment, a 2-digit symbol group identification number for identifying each symbol group is attached to the first part of the data represented by each code symbol. In the present embodiment, the symbol identification number uses “01” and “02” to represent two symbols “group”.

  FIG. 3 shows an example in which data represented by each code symbol 22a, 22b, 22c, 22d, 24a, 24b, 24c, and 24d in FIG. 2 is read. As shown in FIG. 3, the first two digits of the data of each code symbol 22a, 22b, 22c, 22d, 24a, 24b, 24c, 24d are “01” or “02” as described above.

  The symbol group identification number is followed by an in-symbol number of “01” or “02”, “03”, or “04”. These intra-symbol numbers represent the order of each code symbol in the group.

Details of Operation of Third Code Symbol Reading Result Multiple Display Device Hereinafter, an example of the operation when reading one of the two symbol groups will be described.

3-1 First Capture Operation An operation for visually grasping the code symbol of the group to be read will be specifically described based on the flowchart shown in FIG. For example, an operation in the case of reading a code symbol of “01” group out of two groups will be described.

  In FIG. 4, the display operation is indicated by a dotted line.

  First, in S4-1 in FIG. 4, the capture unit 12 captures an image including the code symbol 20 attached to the article 14.

  Next, the automatic recognition means 16 receives the image signal and displays it on the display means 18. The image captured in S4-1 is hereinafter referred to as image 1. In the present embodiment, the automatic recognition means 16 displays two screens of screen A and screen B on the display means 18. In S4-1, image 1 is displayed on both screens A and B.

  That is, in S4-1, the image 1 is displayed on both the screen A and the screen B only for the first time, and from the second capture, only the captured image data screen A is displayed. Is displayed.

  As described above, the image data is displayed on the screen A immediately after the capture, and this is exchanged with image data on which an explicit frame representing a code symbol that has been successfully decoded is displayed, as will be described later.

  Further, as will be described later, the screen A is a screen on which the captured image is shown every time it is captured, and the screen B that is captured first is continuously displayed. This “first captured image” (that is, the image 1 described above) is referred to as a reference capture screen.

  Next, in S4-2 in FIG. 4, the automatic recognition unit 16 stores the image 1 as a reference capture image in a predetermined storage unit.

  What is characteristic in the present embodiment is that this reference capture image is a reference for calculating the amount of change in the coordinate position of the code symbol 20 in the captured image (1) in the subsequent operations after S4-4. It is used as an image. Note that this reference capture image corresponds to a preferred example of the image data captured first, as described in the claims.

  Next, in S <b> 4-3 in FIG. 4, the automatic recognition unit 16 performs a cut-out operation of the code symbol 20 in the image 1. This cutout is extraction of an area determined to be a code symbol. Here, the region is a two-dimensional region in the image 1 that is image data.

  The image 1 is divided into predetermined color areas, and the arrangement of the color areas determined to be code symbols is detected by tracking the arrangement of the color areas. That is, the term “cutout” refers to cutting out this “sequence of a plurality of color areas”. The plurality of color areas are regarded as color cells of the code symbol and are decoded.

  Next, in S4-4 in FIG. 4, the automatic recognition means 16 calculates the position of the code symbol 20 cut out in S4-3. The cut code symbol is expressed as a set of pixels, and various parameters can be used as the position. Typically, it is common to use the coordinate position of the code symbol 20 as the position.

  For example, it is calculated by obtaining the barycentric position of the area occupied by the code symbol 20. Here, although expressed as “position”, it is preferable that the “position” includes a rectangular area surrounding the area. Desirably, it is also preferable to obtain a rectangular region having a minimum area. These rectangles can be used for the position, orientation, size, etc., of displaying an explicit frame described later. The position of the code symbol here refers to such data / information.

  Further, the automatic recognition means 16 stores the “position” information of the code symbol 20 in the storage means.

  Next, in S4-5 in FIG. 4, the automatic recognition means 16 compares the image captured in S4-1 with the reference capture image stored in S4-2, and detects the positional relationship between them.

  Here, in the first capture, both are naturally the same image, so the positional relationship is zero.

Regarding the positional relationship, this positional relationship is information representing a movement amount on the three-dimensional coordinate (movement amount in the x-axis direction, movement amount in the y-axis direction, movement amount in the z-axis direction), rotation angle, and enlargement (reduction). is there. Methods for comparing the two images to determine the amount of movement, rotation angle, and scale (enlargement / reduction) between the two have been known so far, and these parameters can be determined using conventional image processing techniques. Is possible.

  For example, US Pat. No. 7006706 discloses these techniques.

  Now, in the present embodiment, the user holds the capture unit 12 by hand and performs imaging toward the object. Therefore, in the second and subsequent captures, an image different from the reference capture screen is obtained. However, since the same object is basically photographed, the difference between these images is limited. By comparing the two, the amount of movement, rotation, and scale (enlargement) between the two images are compared.・ Reduction is possible. In the present embodiment, these are referred to as “positional relationships” as described above.

  Therefore, as will be described later, a non-zero positional relationship is required in the second capture. The positional relationship is 0 (there is no enlargement / reduction, so the scale (enlargement / reduction ratio) is “1”) only in the first capture, and after the second time, a non-zero positional relationship is obtained. Will.

  Next, based on the positional relationship thus determined, the position of the code symbol in the reference capture image is determined from the position of the code symbol 20 calculated in S4-4. The so-called correction amount for obtaining this position is obtained from the “positional relationship” between the images and the “position” of the code symbol 20.

  Simply considering only movement in the x direction, for example, when the image is translated by x1 in the x direction, it is preferable to use −x1 as the correction amount. A coordinate obtained by adding −x1 to the x coordinate of the position (coordinate) of the code symbol 20 becomes the position of the code symbol on the reference capture image.

  Here, in order to simplify the explanation, only the movement of the x coordinate has been explained, but of course there are also rotation and enlargement / reduction.

  The so-called correction amount for calculating the position of the code symbol on the reference capture image is referred to as a “position correction coefficient” in the present embodiment. As described above, this position correction coefficient includes not only the parallel movement but also the rotation and enlargement / reduction correction amounts.

  In S4-5, since the code symbol 20 detected in S4-4 and the code symbol 20 in the reference capture image are at the same position, the position correction coefficient is zero. Of course, this is only the first capture, and the second and subsequent times are significant (actually position correction) position correction coefficients.

  Next, in S4-6 in FIG. 4, the automatic recognition means 16 decodes the code symbol 20 cut out in S4-3 based on the rule of the automatic recognition code based on the color arrangement, and the symbol group identification number and the symbol Read the internal number and data.

  Next, in S4-7 in FIG. 4, the automatic recognition means 16 obtains only the code symbol data of the symbol group to be read from the data obtained in S4-6 based on the symbol group identification number and the intra-symbol number. Extracted and stored separately in storage means for storing the read result.

  In the present embodiment, the case where the reading target is the “01” group is described. Accordingly, when the symbol group identification number of the read code symbol is “01”, the read result is separately stored in the storage means for storing the result as the read result. On the other hand, when the symbol group identification number of the read code symbol is “02”, it is determined that the code symbol is not a group to be read and is not stored in the storage means for storing the result.

  The result of reading in the storage means storing the result is finally presented to the user via the display means or the like.

  In S4-7, the automatic recognition means 16 further calculates a rectangular figure (rectangular frame) surrounding the code symbol based on the position of the code symbol from which the data has been read. This rectangular frame is called an “explicit frame” and represents that a code symbol has been read.

This rectangular figure is a rectangle surrounding the code symbol, and it is preferable to obtain the smallest one. The inventor of the present application has separately applied for Japanese Patent Application No. 2007-142145 regarding such a frame display technique.

  For simplicity, the minor axis and major axis of the code symbol area may be obtained, and a rectangle having the minor axis and the major axis in the vertical and horizontal directions may be calculated.

  Further, as described above, not only the center of gravity as the position of the code symbol, but also a rectangle surrounding the code symbol around the center may be calculated. In this case, the rectangle that is the “position” is traced as it is. It is also preferable to form

  Next, the automatic recognition means 16 arranges and inserts this rectangular figure corresponding to the code symbol to be read in the image 1 so that the center position thereof overlaps the position of the code symbol. At this time, it is preferable to insert the explicit frame (rectangular figure) by drawing a line having a predetermined thickness in a color that does not appear in the image. This explicit frame can explicitly indicate to the operator that the code symbol has been read.

  In this way, an explicit frame for pointing to the code symbol is inserted into the image 1.

  Next, the automatic recognition means 16 sends the image 1 with the explicit frame inserted to the display means 18. The display means 18 displays the image 1 with the explicit frame attached to the code symbol on the screen A side. On the other hand, the initial capture screen is continuously displayed on the screen B side.

  Therefore, in the first capture, the same captured image is displayed on screen A and screen B. However, the screen A side is different from the screen B side in that an explicit frame is inserted around the read code symbol.

  As a matter of course, the image 1 in which the explicit frame is attached to the code symbol is displayed instead of the image 1 to which the explicit frame that has been displayed is not attached.

  FIGS. 6B and 7B described later show examples of images in which two explicit frames 40a and 40c are attached to the code symbols 38a and 38c, respectively. In FIG. 6B and FIG. 7B described later, two explicit frames 40a and 40c are inserted so as to surround the code symbols 38a and 38c.

  As a result, according to the present embodiment, the explicit frame is inserted and displayed in the image so as to surround the code symbol. Therefore, the operator can easily know which code symbol has been read.

  Next, in S4-8 in FIG. 4, the automatic recognition unit 16 stores the data extracted in S4-7 and the position correction coefficient calculated in S4-5 in the storage unit.

  As described above, the operations from S4-1 to S4-8 are mainly performed on the image 1.

Configuration of Automatic Recognition Unit Here, the configuration of the automatic recognition unit 16 according to the present embodiment will be described with reference to FIG. The automatic recognition means 16 is composed of a computer and functionally composed of the following means.

  As shown in FIG. 5, the automatic recognition unit 16 includes a CPU 26, a capture unit interface 28, a display unit interface 30, a reference capture image storage unit 32, and a storage unit 34.

  The capture unit interface 28 connects the CPU 26 and the capture unit 12. The image captured by the capture unit 12 is sent to the CPU 26 via the capture unit interface 28.

  The display means interface 30 connects the CPU 26 and the display means 18. The signal transmitted by the CPU 26 is stored in a buffer provided in the CPU 26 and is transmitted to the screen A or the screen B of the display unit 18 through the display unit interface 30. Note that the buffer included in the CPU 26 is not shown in FIG.

  The display means 18 is, for example, a liquid crystal display, and a window for displaying a captured image is provided in the display screen. As described above, the screen A and the screen B are called respectively. Screen A is a screen that displays captured images each time, and is displayed with appropriate explicit frames inserted as described above. On the other hand, the screen B displays the reference capture screen.

  The reference capture image storage unit 32 has a function of storing a reference capture image. In S4-2 described above, the CPU 26 stores the image 1 in the reference capture image storage unit 32 as a reference capture image. Further, the storage unit 34 has a function of storing the captured image, the position correction coefficient, the data, the position of the code symbol, and the coordinate position of the explicit frame each time.

  As shown in FIG. 5, the storage area forms a table in the storage unit 34. The CPU 26 stores the captured image, the position correction coefficient, the data, the position of the code symbol, and the coordinates of the explicit frame in the storage area of the first row corresponding to the first capture operation in the storage area of this table. Each position is stored.

  Although the reference capture image storage unit 32 and the storage unit 34 are shown in the figure as being separate, two storage units may be provided in one storage unit.

3-2 Following the second and subsequent capture operations , the automatic recognition means repeatedly executes the operations from S4-9 to S4-15 described below, and continuously executes the capture operation and the accompanying decoding process.

  First, in S <b> 4-9 in FIG. 4, the capture unit 12 performs a second capture operation and sends the captured image to the automatic recognition unit 16. The automatic recognition means 16 sends the received image to the display means 18 and displays the captured image on the screen A. Hereinafter, the image acquired by the second capture operation is referred to as an image 2. Note that the reference capture image (image 1) is displayed on the screen B as it is.

  Next, in S4-10 in FIG. 4, the automatic recognition unit 16 performs a cut-out operation of the code symbol 20 in the image 2.

  Next, in S4-11 in FIG. 4, the automatic recognition means 16 calculates the position of the code symbol 20 cut out in S4-10. This position is the coordinate position of the code symbol 20 and other information as described above. For example, it is also preferable to obtain the center of gravity of the area occupied by the code symbol 20.

  Next, the automatic recognition unit 16 stores the information on the position of the code symbol 20 in the storage area of the second row from above the predetermined storage unit 34 (see FIG. 5).

  Next, in S4-12 in FIG. 4, the automatic recognition means 16 calculates the position correction coefficient by comparing the image 2 captured this time with the reference capture image.

  This position correction coefficient is a coefficient indicating how the image has moved between the first capture time and the second capture time, and is based on parameters such as translation, rotation, and scale (enlargement / reduction). As described above, it is configured.

  Next, in S4-13 in FIG. 4, the automatic recognition means 16 decodes the code symbol 20 cut out in S4-10 based on the automatic recognition code based on the color arrangement, and the symbol group identification number and the intra-symbol number And read data.

  What is characteristic in this embodiment is that the position of the read code symbol on the reference capture image is calculated. As a result, it is possible to display the explicit frame of the code symbol that has been successfully decoded on the reference capture image.

  As will be described later, this calculation operation is performed collectively after a predetermined number of captures have been completed, but may be obtained for each capture. When obtaining each time an image is captured, the following calculation is performed each time, and a new item “Coordinates of an explicit frame after correction” is added to the storage means 34, and the obtained new coordinate values and the like are added thereto. Preferably stored.

  The automatic recognition unit 16 calculates which position in the first captured image (reference capture image) the code symbol read during the second capture operation corresponds to based on the position correction coefficient described above. .

  The position correction coefficient is basically a parameter that indicates the positional relationship between images, but it is applied to the explicit frame to calculate the position (direction, size, etc.) of the explicit frame on the reference capture image. To do. Here, the “position” of the explicit frame is called “position”. This “position” is a so-called coordinate (for example, the coordinates of the center point, the coordinates of the four corners in the case of a rectangular explicit frame, the coordinates of the barycentric point, etc.). In addition to the values, you may include the orientation, size, and lengths of the vertical and horizontal sides of the rectangular explicit frame.

  For example, it is a typical preferable example to treat the center coordinates and the coordinates of the four corners as “positions”. It is also preferable to treat the center coordinates, vertical and horizontal lengths, and orientations (azimuths) as “positions”. In short, any parameters may be used as long as the position, direction, and size of the rectangular frame are clarified.

Although the explicit frame is calculated here, the explicit frame may be calculated for the newly obtained code symbol by obtaining the position (orientation and size) on the reference capture image for the code symbol. For example, if parameters such as the movement amount of the center of gravity of the code symbol in the vertical and horizontal directions, the rotation angle, the coordinates of the center point of rotation, and the magnification ratio are applied to each pixel of the code symbol on the image 2, The position of each pixel on the reference capture image is obtained. A set of these new pixels is a code symbol obtained on the reference capture image.

  In the present embodiment, parameters indicating the relationship between these images are collectively referred to as a position correction coefficient.

  As described above, the positional relationship parameters between images include parallel movement (x coordinate direction and y coordinate direction), rotation (center coordinate, rotation direction and rotation amount), scaling (so-called magnification, scale, etc.) A parameter such as “1” when the magnification, that is, the size does not change, is “1”, but when it becomes larger, it becomes less than 1 when it is reduced.

  Here, no consideration is given to a case where the image is distorted (including a case where the image is twisted and deformed like a diamond). This is because it is generally difficult to imagine distortion that cannot be ignored in imaging. However, depending on the application, distortion may be introduced as a parameter.

  Further, instead of scaling (enlargement / reduction), this may be regarded as a translation in the depth direction (so-called z direction) and handled as a kind of translation parameter. This is because, depending on the application, it may be easier to understand when considering the x-axis, y-axis, and z-axis.

  In addition, various parameters can be adopted depending on the application, and any parameters and operators indicating the relationship between images may be used.

  In this way, in the present embodiment, the position of the explicit frame of the code symbol read for each capture is converted to the position on the reference capture image, so that the read code symbol (based on the explicit frame) is converted. It is possible to easily view and confirm on the reference capture image.

  Next, in S4-14 in FIG. 4, the automatic recognition means 16 reads the symbol group identification number and the intra-symbol number, and extracts the data of the code symbol to be read from the data obtained in S4-13.

  Next, the automatic recognizing means 16 arranges the rectangular figure on the code symbol from which the data has been read in the same manner as described in S4-7 above, and displays the image on which the rectangular figure is arranged as the display means. Send to 18. Therefore, the display means 18 displays the image A in which an explicit frame is added to the code symbol read in the second capture operation.

  As a result, according to the present embodiment, every time the capture operation is performed, the explicit frame is attached to the read code symbol, and the image is displayed on the screen A. Therefore, the operator performs the capture operation every time the capture operation is performed. In addition, it is easy to know which code symbol has been read.

  Next, in S4-15 in FIG. 4, the automatic recognition unit 16 stores the data read in S4-14 and the position correction coefficient calculated in S4-12 in the storage unit.

  The steps from S4-9 to S4-15 described above correspond to the second capture operation. When the second capture operation is finished, the five regions in the second row from the top of the storage region 34 in FIG. 5 include the image 2, the position correction coefficient calculated in S4-12, and S4-14. In step S4-11, the data extracted in step S4-11, the code symbol position calculated in step S4-11, and the coordinate position of the explicit frame calculated in step S4-14 are newly stored.

  In this embodiment, the automatic recognition means 16 uses the explicit frame position information as long side and short side lengths, explicit frame vertex coordinates, explicit frame long side angle with respect to the coordinate axis, etc. The information is memorized. In the present embodiment, for simplicity, these pieces of information are collectively referred to as the coordinate position of the explicit frame.

  Further, as the third capture operation, the above-described operations from S4-9 to S4-15 are performed, and the image 3 and the image 3 and the third region in the third row from the top of the storage unit 34 in FIG. The position correction coefficient, the data, the position of the code symbol, and the position of the explicit frame are stored, and thereafter the same operation is performed as the n-th (n is an integer of 4 or more) capture operation.

3-3 Display of Result After End of Capture Operation As described above, in this embodiment, capture is performed a plurality of times, and the code symbol is decoded each time. Then, when a predetermined termination condition is satisfied, the capture is terminated, and the following processing regarding the correction of the position of the explicit frame and the display thereof is started.

  As described above, in the present embodiment, in principle, this correction is performed after completion of all the capture operations. However, it is also preferable to execute the correction every capture operation and store the result. In particular, when the number of code symbols is large, there is a possibility that a result obtained by performing each capture is faster in terms of calculation speed.

  First, when the condition for ending the reading operation is satisfied, the automatic recognition means 16 performs the operations from S4-16 to S4-18 described below.

  First, in S4-16 in FIG. 4, the automatic recognition means 16 reads out the information stored in the storage means 34 by the first to m-th capture operations. m is the number of captures performed so far.

3-3-1 Correction of Explicit Frame and Insertion into Reference Capture Image This read operation and the like will be described in more detail with reference to FIG.

  FIG. 6A shows a reference capture image 36 read by the automatic recognition unit 16 from the reference capture image storage unit 32. As shown in FIG. 6A, the reference capture image 36 includes code symbols 38a, 38b, 38c, 38d, 38e, and 38f.

  Next, the automatic recognition means 16 has five pieces of information (image 1, position correction coefficient, data, code symbol position, and explicit frame coordinate position) stored in the first line from the top of the storage means 34 in FIG. Is read.

  Next, the automatic recognition unit 16 corrects the position of the explicit frame based on the read position correction coefficient and the coordinate position of the explicit frame, and inserts the explicit frame into the reference capture image 36.

  This correction / insertion is as described in detail above. In this embodiment, correction is performed in order to display the explicit frame on the reference capture image as described above, but the correction operation is performed after all the capture operations are completed. Of course, depending on the application, it is also preferable to perform this correction / insertion every time the image is captured.

  6 (2) shows an image 42 created by the automatic recognition means 16 by inserting explicit frames 40a and 40c into the reference capture image 36. FIG.

  Subsequently, the automatic recognition means 16 stores information groups (image 2, position correction coefficient, data, code symbol position, explicit frame coordinates) stored in the area group in the second row from the top of the storage means 34 in FIG. Position).

  Similarly, the position (including direction, size, etc.) of the explicit frame is corrected and converted into a position on the reference capture image, and the converted explicit frame is inserted into the reference capture image. In this way, an image 44 in which the explicit frames (40b and 40e) (after correction) are newly inserted into the image 42 is created.

  Similarly, the automatic recognizing means 16 uses the information group (image, position correction coefficient, data, code symbol position, explicit frame coordinates) stored in the area group from the top to the third line of the storage means 34 in FIG. Position), the explicit frame is corrected, and an explicit frame is newly inserted into the image 44.

  Hereinafter, similarly, the same processing is repeated from the 3rd to m-th lines, and an explicit frame is inserted into the reference capture image for a code symbol that has been read even once.

  In this way, the automatic recognition unit 16 corrects the explicit frame based on the information stored in the storage unit 34 of FIG. 5 and inserts it into the reference capture image. As a result, as shown in FIG. 6 (4), an image 46 in which the read code symbols are provided with explicit frames 40a, 40b, 40c, 40d, and 40e is obtained.

3-3-2 Display of Reference Capture Image with Explicit Frame Inserted Next, in S4-17 in FIG. 4, the automatic recognition means 16 displays the image 46 on the screen B of the display means 18.

Furthermore, in S4-18 in FIG. 4, the automatic recognition means 16 displays the “data” read in S4-16 on the display means 18. The data is obtained by combining data represented by each code symbol in a certain symbol group. For example,
The data of the “01” code symbol in the symbol group “01” is “1234”.
The data of the “02” code symbol in the symbol group “01” is “5678”.
The data of the “03” code symbol in the symbol group “01” is “9012”.
When the data of the “04” code symbol in the symbol group “01” is “3456”, the “data” after synthesis is “1213567890123456”. The final synthesized data is displayed.

  The method of synthesizing data is essentially the same technology as the “division” method. It is of course possible to use various conventionally known data division methods, and synthesis is also performed according to the method. For example, when data is divided using an error correction technique, there are cases where data can be reproduced and synthesized even if all the divided code symbols cannot be read.

  Further, when displaying data, the data is preferably displayed in association with each explicit frame in the reference capture image 36. Thus, the operator can easily know which code symbol becomes which data.

  There may be a plurality of pieces of information for the same code symbol. That is, a plurality of rows may be created in the storage unit 34 for one (divided) code symbol.

  Naturally, this is a matter that generally occurs from the viewpoint that if a divided code symbol that is easy to read and easy to decode is decoded at each capture, a row is created in the storage means 34 each time. . The fact that these are information generated from the same code symbol is compared because (1) the decoded data is the same, (2) the position of the explicit frame (after correction) is the same or almost the same, etc. It turns out easily.

  In this case, narrowing down such as selecting information having the smallest position correction coefficient from the information of the plurality of rows may be performed. Moreover, there is not much problem in displaying all the explicit frames based on the information of a plurality of lines. All of these explicit frames will likely have almost the same position, orientation, and size, so even if all of the explicit frames are displayed, the visibility will not deteriorate and a special problem will arise. There will be no.

Regarding the timing to end the fourth reading operation, there are various methods for determining the timing to end the reading operation, that is, the timing to end the image capture.

  In the present embodiment, as described above, a series of processes starting from image capture and displaying image data with an explicit frame are repeatedly executed.

  This repetitive process ends when a predetermined condition is satisfied, and the end timing is preferably as follows. When such a condition is satisfied, after the image data display process is completed, new image data is not captured, and the above-described process of “3-3 Displaying Results After End of Capture Operation” is performed. move on. Hereinafter, various conditions (timing) for ending the repetitive processing will be described.

4-1 Manual instruction The first possibility is that the operator gives an instruction. That is, when it is determined that all the desired code symbols have been read while viewing screen A and screen B, the user presses a predetermined button or clicks a predetermined part of the screen, It is preferable to be configured so that the end can be instructed.

  Typically, a button with a name such as “Cancel” is provided on the screen, and an operation such as clicking this button is known as a general “Suspend” or “Cancel” operation. It is preferable that the configuration is configured so that the user can instruct to stop reading by such an operation.

4-2 Elapse of a Predetermined Time First, there is a method in which the time until completion is divided based on the start time of the reading operation. Specifically, for example, the reading operation is performed for one minute from the start of the reading operation, and the reading operation is ended when one minute has elapsed.

4-3 When all desired groups have been read In addition, the reading operation can be terminated using the symbol group identification number described above. For example, when the two symbol groups in FIG. 2 are read, the reading operation ends when all the data whose first two digits are “01” and “02” are read. As a result, the data of both the “01” group and the “02” group can be reliably read.

  Further, the reading operation can be ended using the intra-symbol number described above. For example, the reading operation is terminated when all the data in the “01” group whose symbol numbers are “01”, “02”, “03”, and “04” are read. As a result, all the data in the “01” group can be reliably read, and the data can be reliably obtained.

4-4 When Decoding of Data is Successful Also, the reading operation can be completed by combining the in-symbol number and the error correction function. For example, when only the data with the in-symbol number “01”, “03”, “04” in the “01” group can be read, the in-symbol number is “02” by error correction calculation from the read data. The reading operation is terminated when certain data is restored. That is, three code symbols in the “01” group can be read and data can be restored without reading the remaining one code symbol, so that an efficient reading operation can be realized.

4-5 When a code symbol representing an end code is read It is also preferable to determine a predetermined end code. When a certain code symbol is read and the data is an end code, the repetitive processing is ended and no new capture is performed. This is a suitable method when it is desired to control the end from the automatic recognition code side, such as when the end timing is changed by data.

Display Example of Fifth Display Screen FIG. 7 shows a display screen at each operation step when reading a code symbol. The following describes how the screen A and the screen B are displayed. Each shows the state of the screen in time series. Screen A changes to screens A1, A2, A3, A4, and A5 over time, and screen B changes to screens B1, B2, B3, B4, and B5 over time.

  First, screens A1 and B1 shown in FIG. 7A are screens at the start of the decoding process. These screens A1 and B1 are screens displayed during the operations from S4-1 to S4-6 described above. As shown in FIG. 7A, at the start of the decoding process, the first captured image (reference capture image) is displayed on both screens A1 and B1.

  Next, screens A2 and B2 shown in FIG. 7B are screens displayed during the operations from S4-7 to S4-8 described above. In the present embodiment, since the photographer captures the code symbol by holding the capture means by hand, the screen A2 is also moved, rotated, and enlarged (reduced). This appears on screen A2.

  As shown in FIG. 7B, the code symbols 38a and 38c in the screen A2 are provided with explicit frames 40a and 40c indicating that the data has been read. This means that the code symbols 38a and 38c are successfully decoded in the screen A2.

  On the other hand, since the screen B2 shows the reference capture image (the image of the screen B1) as it is, there is no change such as movement, rotation, enlargement (reduction), etc. between the screens B1 and B2.

  Next, screens A3 and B3 shown in FIG. 7 (3) are screens displayed in S4-14 described above in the second capture operation. As shown in FIG. 7 (3), the code symbols 38b and 38e in the screen A3 are provided with explicit frames 40b and 40e indicating that the data has been read. In general, the code symbol that can be read may be different for each capture due to the influence of light illumination or the like during the capture operation.

  On the other hand, the screen B3 is the reference capture image (image of the screen B1) as it is, and there is no change.

  Similarly, FIG. 7 (4) shows screens A4 and B4 displayed in S4-14 described above in the third capture operation. In the screen A4 in FIG. 7, explicit frames 40a, 40d, and 40e indicating that the data has been read are attached to the code symbols 38a, 38d, and 38e. On the other hand, the screen B4 is the same as B1 to B3.

  FIG. 7 (5) shows screens A5 and B5 displayed in S4-17 described above. As shown in the screen B5 in FIG. 7 (5), the automatic recognition means 16 performs the first to m-th capture operations on the screen B5 (reference capture image) in S4-17 described above. All the code symbols 38a to 38e read in are displayed with an explicit frame. This is called a stack display.

  On the other hand, the automatic recognition means 16 inserts and displays explicit frames 40b and 40d indicating that the image has been read on the captured image on the screen A5.

  As described above, the screen A1 is continuously changed to the screens A2, A3, A4, and A5 as time passes.

  As described above, in the present embodiment, the photographer captures each code symbol by holding the capture means by hand, so that the code symbol is moved, rotated, or enlarged (reduced). Screens A2, A3, A4, and A5 are shown. On the other hand, each of the screens B2, B3, B4, and B5 shows the “reference capture image” (screen B1) as it is. Accordingly, changes such as image movement, rotation, and enlargement (reduction) do not occur in each of the screens B1, B2, B3, B4, and B5.

  In each of the screens A1, A2, A3, A4, and A5, an explicit frame is shown for the read code symbol. As described above, the code symbol may not be decoded depending on the lighting and other conditions when capturing. When the decoding process cannot be performed in this way, an explicit frame is not added to the code symbol that cannot be decoded.

  FIG. 8 shows a read result multiple display screen 48 displayed on the display unit 18 during the operation of S4-18 described above. The upper screen 50 of the read result multiple display screen 48 corresponds to an example of the screen A5. Further, the lower screen 52 corresponds to an example of the screen B5. As shown in the screen 52 in FIG. 8, an explicit frame is attached to the code symbol from which the data has been read.

  Further, the column 54 in FIG. 8 shows four data read from the code symbol to be read. In the column 54 in FIG. 8, it is shown that a numerical value composed of “255”, “3727”, “8888888”, and “9999999” is read from four code symbols constituting one symbol group to be read. ing. As a result, it is possible to read data consisting of “2553727888888899999999” from one symbol group to be read. The read data may be displayed outside the read result multiple display screen 48, for example.

Association Note that “255”, “3727”, “8888888”, and “9999999” read from the four code symbols are preferably displayed in association with the corresponding code symbol explicit frames. In FIG. 8, it is displayed outside the screen A and the screen B, but even in such a case, it is possible to display by “associating” by connecting the explicit frame and the data display with a curve or the like. is there. More simply, it is also preferable to simply display the data display in the vicinity of each explicit frame.

6. Relationship between Screen A Group and Screen B Group and Modifications and Application Examples Next, the relationship between the screen A group and the “reference capture image” displayed on the screen B group will be described.

  In the present embodiment, the automatic recognition means 16 detects the movement of the image in each screen A1, A2, A3, A4, A5, and the parallel movement of each screen A2, A3, A4, A5 with reference to the screen A1. Always know the size of rotation and scaling.

  As a result, the automatic recognition means 16 can calculate the coordinate position of the explicit frame in the screen B group (reference capture image) based on the coordinate position of the explicit frame in the screens A1, A2, A3, A4, and A5. it can.

6-1 Modification 1
In the present embodiment, the code symbol explicit frame that can be decoded after all captures are completed is displayed on the screen B in a lump (B5 screen in FIG. 7 (5)), but can be decoded. It is also preferable that the code symbol explicit frames are sequentially inserted on the reference capture image. Depending on the application, it may be more convenient to show how the number of explicit frames increases.

  When such a configuration is adopted, the automatic recognition means 16 sequentially corrects the explicit frame in the screen A group based on the position correction coefficient and inserts it into the screen B group. Then, the screen B in which the explicit frame is inserted is created, and the screen B including the explicit frame is sent to the display unit 18. In this case, it is preferable to rewrite the reference capture image stored in the reference capture image storage unit 32 to an image in which an explicit frame is inserted in order.

  For example, US7006706 describes a method for detecting the positional relationship of a decoded image (sequentially captured image, image 2, image 3...) With respect to the “reference captured image” and a method for quantifying the positional relationship. Thus, a feasible technology has already been developed, and this technology can also be applied to this embodiment.

6-2 Modification 2
Further, when the capture unit is fixed or when the amount of movement of the capture unit is negligibly small with respect to the angle of view, the above-described correction based on the movement detection of the image is not performed and the display is performed on the screen A group. It is also possible to display the explicit frame superimposed on the screen B group (reference capture image) without correction.

6-3 Modification 3
In the present embodiment, the case where the “reference capture image” is always displayed on one of the two screens A and B has been described. However, the “reference capture image” does not always need to be displayed and is being read. It is also preferable to display the reference capture image, the explicit frame, and the read data after the reading operation is completed without displaying the reference capture image.

6-4 Modification 4
It is also preferable that the “reference capture image” is always displayed on the screen B side, and the code symbols on which the data reading has been completed are sequentially displayed with an explicit frame on the screen A side. This can be regarded as an application example of the first modification.

  That is, in the first modification, the explicit frames are sequentially increased on the image B side, but in the fourth modification, the explicit frame is increased on the screen A side. In this case, since the operator can cope with reading a code symbol that is not particularly provided with an explicit frame, the reading efficiency is greatly improved.

  However, when this configuration is adopted, it is necessary to correct the explicit frame on the image A2 to the explicit frame on the image A3. Therefore, in order to display an explicit frame on the image Ak, it is necessary to obtain a conversion coefficient from the immediately preceding image Ak-1 to the image Ak. Here, k is a positive integer.

  The present embodiment can be implemented in the same manner as in the above-described embodiment, except that the conversion coefficient is obtained only in a different object.

6-5 Modification 5
In this embodiment, the “automatic recognition code by color arrangement” is described as an example of the optical automatic recognition code to be used. However, of course, a so-called classic bar code or other optical automatic recognition code can be used. Is preferred. For example, it is preferable to configure a device that reads a plurality of code symbols using a QR code (registered trademark) as in the present embodiment.

  According to such a method / apparatus, it is possible to display to the user a state in which the sequential decoding proceeds, so that it is possible to realize an easy-to-use code reading method and code reading apparatus.

It is a figure which shows the structure of a code symbol reading result multiple display apparatus. It is a figure which shows two symbol groups showing two data. It is the table | surface which showed the data which two symbol groups represent. It is a flowchart explaining operation | movement of a code symbol reading result multiple display apparatus. It is a figure which shows the structure of an automatic recognition means. It is a figure explaining the read-out operation | movement of information. It is a figure which shows the example of reading of a code symbol. It is a figure which shows a reading result multiple display screen.

Explanation of symbols

1 and 2 Images 10 Code symbol reading result multiple display device 12 Capture means 14 Article 16 Automatic recognition means 18 Display means 20 Code symbols 22a to 22d, 24a to 24d Code symbols 26 CPU
28 capture means interface 30 display means interface 32 reference capture image storage means 34 storage means 36 reference capture images 38a to 38f code symbols 40a to 40e explicit frames 42, 44, 46 images 48 read result multiple display screens 50, 52 screen 54 column A , B screen A1, A2, A3, A4, A5 screen B1, B2, B3, B4, B5 screen

Claims (20)

In the method of reading the optical automatic recognition code,
A capture step of capturing image data including one or more code symbols of the optical automatic recognition code;
Cutting out the area occupied by the code symbol from the captured image data;
A data storage step of decoding the code symbol of the cut-out area and storing the obtained data in a predetermined storage means;
A position storage step of calculating a position of an explicit frame indicating the region of the code symbol that has been successfully decoded, and storing the position in a predetermined storage unit;
A first insertion step of superimposing and inserting the explicit frame at the obtained position of the captured image data;
Comparing the captured image data with a reference captured image that is the first captured image data, calculating a positional relationship between the two, and storing in the storage means;
A first display step of displaying image data with the explicit frame inserted to a user;
A repetition step of repeating the capture step to the display step one or more times;
After the repetitive processing in the repetitive step, a position conversion step of taking out the position of the explicit frame from the storage means, correcting the position based on the positional relationship, and converting it to a position on the reference capture image;
A second insertion step of inserting the explicit frame at the converted position of the reference capture image;
A second display step of displaying the reference capture image in which the explicit frame of the code symbol that has been successfully decoded is inserted in the second insertion step;
And an explicit frame of code symbols that have been successfully decoded so far is inserted into the reference capture image after completion of the repetitive processing. In the method of reading the optical automatic recognition code,
A capture step of capturing image data including one or more code symbols of the optical automatic recognition code;
Cutting out the area occupied by the code symbol from the captured image data;
A data storage step of decoding the code symbol of the cut-out area and storing the obtained data in a predetermined storage means;
A position storage step of calculating a position of an explicit frame indicating the region of the code symbol that has been successfully decoded, and storing the position in a predetermined storage unit;
A first insertion step of superimposing and inserting the explicit frame at the obtained position of the captured image data;
A first display step of displaying image data with the explicit frame inserted to a user;
Comparing the captured image data with a reference captured image that is the first captured image data, calculating a positional relationship between the two, and storing in the storage means;
A position conversion step of taking out the position of the explicit frame from the storage means, correcting the position based on the positional relationship, and converting the position into a position on the reference capture image;
A second insertion step of inserting the explicit frame at the converted position of the reference capture image;
A second display step of displaying the reference capture image in which the explicit frame of the code symbol that has been successfully decoded is inserted in the second insertion step;
A repetition step of repeating from the capture step to the display step one or more times;
And an explicit frame of a code symbol that has been successfully decoded is added to the reference capture image every time capture is performed in the capture step. In the optical automatic recognition code reading method according to claim 1,
An optical automatic recognition code reading method, wherein display of the reference capture image is started when the repetition process in the repetition step is started. In the optical automatic recognition code reading method according to claim 1,
An optical automatic recognition code reading method, wherein the reference capture image is displayed for the first time after the repetition process in the repetition step is completed. In the optical automatic recognition code reading method according to claim 1 or 2,
The optical automatic recognition code is an "automatic recognition code based on color arrangement" in which color cells are arranged and data is represented by any of color arrangement, color transition, and color combination of the color cells. A method for reading an optical automatic recognition code. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
The “position” of the explicit frame includes one or more parameters of the coordinates of the explicit frame, the size of the explicit frame, the orientation of the explicit frame, and the vertical and horizontal lengths of the explicit frame. A method for reading an optical automatic recognition code. In the optical automatic recognition code reading method according to any one of claims 1 to 6,
The “positional relationship” between the images includes any one or more parameters of a parallel movement amount, a rotation direction and a rotation amount, and scaling (enlargement / reduction). Recognition code reading method. In the optical automatic recognition code reading method according to claim 1 or 2,
The second display step further includes
An optical automatic recognition code reading method, wherein the data of a code symbol that has been successfully decoded is read from the storage means and displayed in association with the explicit frame of the corresponding code symbol. The optical automatic recognition code reading method according to claim 8,
The association is performed by displaying the data in the vicinity of the explicit frame corresponding to the data. The optical automatic recognition code reading method according to claim 8,
The association is performed by connecting the data and the explicit frame corresponding to the data by a curved line and displaying them. In the optical automatic recognition code reading method according to any one of claims 1, 3, 4, and 5,
In the position conversion step, when a plurality of the explicit frames corresponding to the same code symbol are stored in the storage means, the position is converted with respect to only one of the explicit frames,
In the second inserting step, the converted one explicit frame is inserted into the reference capture image. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
In the first display step, the image data is displayed on a first screen,
In the second display step, the reference capture image is displayed on a second screen different from the large screen,
An optical automatic recognition code reading method, wherein the first screen and the second screen are displayed in parallel. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
In the capture step, after the capture is performed, the captured image data is displayed to the user,
In the first display step, instead of the image data displayed in the capture step, the image data in which the explicit frame is inserted is displayed to the user. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
The optical repeater code reading method according to claim 1, wherein the repeat step repeatedly executes the repeat process until a predetermined time elapses. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
The optical repeater code reading method according to claim 1, wherein the iterative step repeatedly executes the iterative process until the number of code symbols that have been decoded so far reaches a predetermined number. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
In the repeating step, when the decoding of all the code symbols to be read is completed, the repetition process is ended. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
Based on the number of code symbols that can be decoded so far, when the same data as when all the code symbols to be read can be decoded is obtained, the repetition process is terminated Optical automatic recognition code reading method. The optical automatic recognition code reading method according to claim 16,
Based on the number of code symbols that have been decoded so far, if the same data as when all the code symbols to be read could be decoded,
Based on the number of code symbols that have been decoded so far, error correction is performed, the code symbol data that has not been decoded is compensated, and the same data as when all the code symbols to be read are decoded is reproduced. An optical automatic recognition code reading method characterized by including a case where it is made. In the optical automatic recognition code reading method according to any one of claims 1 to 5,
The method of reading an optical automatic recognition code, wherein the repetition step ends the repetition process when a code symbol representing a predetermined end code is read.   The optical automatic recognition code reader which performs the optical automatic recognition code reading method of any one of Claims 1-19.

Images