JP6150675B2 - Position information display system and method - Google Patents

Description

  The present invention relates to a position information display system and method.

  Conventionally, an identification code such as a one-dimensional code (for example, a barcode) or a two-dimensional code (for example, a QR code (registered trademark)) that can be read as an image is photographed, and information corresponding to the identification code in the photographed image ( That is, a position information display system has been proposed in which overlay information is acquired and the acquired information (for example, an article name to which an identification code is attached) is superimposed on a captured image and displayed on the screen of the display unit ( For example, Patent Documents 1 to 3). Since the information acquired in this way can be superimposed on the captured image and displayed on the screen of the display unit, information about the article with the identification code in the captured image (for example, the article name) is displayed on the display unit. Can be grasped on the screen.

  The identification code is also used in an article management system that manages the storage position of the article (for example, Patent Documents 4 to 7), and a management system that uses an RFID tag to manage the storage position of the article (for example, Patent Documents 8 to 8). 10) and a management system using color bits (registered trademark) for managing articles (for example, Patent Document 11) have also been proposed.

JP 2012-215989 A JP 2012-181705 A JP 2011-55250 A Japanese Patent Laid-Open No. 10-35827 JP 2005-96956 A JP 2000-259717 A JP 2012-16883 A JP 2004-186057 A JP 2006-8301 A JP 2011-37571 A JP 2011-24663 A

  However, in the conventional position information display system and the article management system, it is impossible to grasp the predetermined reference positional relationship between the plurality of articles and the current positional relationship between the plurality of articles on the display screen. For example, when a plurality of articles are book 1, book 2, and book 3, and book 1, book 2, and book 3 are to be placed on the bookshelf in order from the left, book 1, book 2, and book 3 are placed on the bookshelf in order from the left. It is impossible to grasp on the screen whether or not it is correctly arranged.

  An object of the present invention is to provide a position information display system and method capable of easily grasping the positional relationship of a plurality of articles with identification codes readable as images on the screen of a display unit.

  A position information display system according to the present invention includes a database that stores reference position relationship information indicating predetermined reference position relationships of a plurality of articles with identification codes readable as images, and a plurality of identification codes. Photographing article position relation information indicating the positional relation among a plurality of articles attached with the identification code in the photographed image, photographing means for photographing the article, identification code recognition means for recognizing the identification code in the photographed image , Information generating means for generating based on the position coordinates obtained by analyzing the identification code recognized by the identification code recognizing means, and verification means for verifying the reference positional relationship information and the photographed article positional relationship information and generating a verification result And display means for displaying the collation result superimposed on the image photographed by the photographing means.

  The position coordinates obtained by analyzing the identification code include the center coordinates of the identification code, which is the coordinates located at the center of the identification code, and any position of the position detection pattern included in the identification code (for example, the corner of the position detection pattern). ), Coordinates at a position away from the identification code by a predetermined distance, and the like. The number of position coordinates obtained by analyzing the identification code may be singular or plural.

  Preferably, the photographing article positional relationship information includes at least one of a distance and an angle determined based on a position coordinate obtained by analyzing the identification code recognized by the identification code recognition means.

  Preferably, the reference position relationship information is a position obtained by analyzing a list indicating the reference position relationship or an identification code included in an image obtained by photographing a plurality of articles with an identification code in the reference position relationship. At least one of a distance and an angle determined based on the coordinates.

  Preferably, the collation means generates a collation result including positional relationship change information regarding a change from the reference positional relationship to the positional relationship of a plurality of articles when the photographed article positional relationship information does not correspond to the reference positional relationship information. To do.

  Preferably, the photographing unit photographs a plurality of articles with identification codes having a reference positional relationship, and the information generation unit uses the position coordinates obtained by analyzing the identification code recognized by the identification code recognition unit. An information registration unit is further provided for generating the reference positional relationship information based on the information and registering the reference positional relationship information generated by the information generation unit in the database.

  A position information display method according to the present invention includes a photographing step of photographing a plurality of articles with identification codes readable as images by a camera, and an identification code recognition step of recognizing the identification codes in the photographed images by a computer. And, based on the position coordinates obtained by analyzing the identification code recognized in the identification code recognition step, the photographed article positional relationship information indicating the positional relationship of a plurality of articles attached with the identification code in the photographed image, An information generation step generated by a computer, and reference position relationship information indicating a predetermined reference position relationship of a plurality of articles with identification codes are read from the database, and the reference position relationship information and the shooting article position relationship information are read by the computer. The collation step of collating and generating the collation result by a computer, and the collation result with the camera Superimposed on the shadow image comprises a display step of displaying on the display, the.

  According to the present invention, both a predetermined reference positional relationship of a plurality of articles with identification codes and a photographed article positional relationship of a plurality of articles with identification codes in a photographed image are grasped. Therefore, it is possible to easily grasp the positional relationship between a plurality of articles with identification codes that can be read as images on the screen of the display unit.

It is a block diagram of an embodiment of a position information display system according to the present invention. It is a figure which shows an example of the identification code used with the identification code reading system shown in FIG. It is a flowchart of registration of the reference positional relationship information in the positional information display system of FIG. It is a figure which shows the example of a display of the picked-up image used in order to produce | generate reference positional relationship information. It is a figure for demonstrating calculation of the center coordinate of an identification code. It is a figure which shows an example of a part of reference | standard positional relationship information. It is a figure for demonstrating the distance determined based on the center coordinate of the identification code of the articles | goods in reference | standard positional relationship. It is a figure for demonstrating the angle determined based on the center coordinate of the identification code of the articles | goods in reference | standard positional relationship. It is a flowchart of operation | movement of the positional infomation display system of FIG. It is a flowchart of operation | movement of the positional infomation display system of FIG. It is a figure which shows the example of a display of the picked-up image used in order to produce | generate imaging | photography article positional relationship information. It is a figure which shows an example of a part of imaging | photography article positional relationship information. It is a figure for demonstrating the distance determined based on the center coordinate of the identification code of the articles | goods in imaging | photography article positional relationship. It is a figure for demonstrating the angle determined based on the center coordinate of the identification code of the articles | goods in imaging | photography article positional relationship. It is a figure which shows the example of a display of the picked-up image which superimposed overlay information after collating reference positional relationship information and imaging | photography article positional relationship information. It is a figure which shows the other example of a display of the picked-up image on which overlay information was superimposed after collating reference positional relationship information and photographing article positional relationship information. It is a figure which shows the other example of a display of the picked-up image on which overlay information was superimposed after collating reference positional relationship information and photographing article positional relationship information. It is a figure which shows an example of the reference | standard positional relationship information of a list format. It is a figure which shows the example of a display of the picked-up image used in order to produce | generate photographing article positional relationship information in relation to the reference | standard positional relationship information of a list format. It is a figure which shows the example of a display of the picked-up image which superimposed overlay information after collating the reference | standard positional relationship information of list format, and imaging | photography article positional relationship information. It is a figure which shows the other example of a display of the picked-up image which superimposed the overlay information after collating the reference | standard positional relationship information of a list format, and imaging | photography article positional relationship information. It is a figure which shows the other example of a display of the picked-up image used in order to produce | generate reference positional relationship information. It is a figure which shows the example of a display of the picked-up image used in order to produce | generate photographing article positional relationship information in relation to the reference | standard positional relationship information produced | generated using the picked-up image shown in FIG. It is a figure which shows the example of a display of the picked-up image which superimposed overlay information after collating the reference positional relationship information based on distance, and imaging | photography article positional relationship information. It is a figure which shows the other example of a display of the picked-up image which superimposed the overlay information after collating the reference positional relationship information based on distance, and imaging | photography article positional relationship information.

Embodiments of a position information display system and method according to the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram of an embodiment of a position information display system according to the present invention. The position information display system shown in FIG. 1 is a system that reads an identification code that is a two-dimensional code having a position detection pattern and displays position information of the identification code. This is useful for document folder management, chemical management, factory material management, etc. For this purpose, the position information display system shown in FIG. 1 includes a terminal 1, a network (communication path) 2, and a server 3.

  In this embodiment, a case where a two-dimensional code having four position detection patterns is used as an identification code will be described. The coordinates of the position detection pattern can be detected, for example, by analyzing a captured image.

  The terminal 1 is realized as a smart phone with a camera function, a personal computer (PC) to which a camera is connected, and the like. A camera (photographing unit) 1A as a photographing unit and a computer (identification code recognizing unit) as an identification code recognizing unit. 1B, a display 1C as display means, and a communication interface 1D.

  The camera 1A takes an image of an article with an identification code that can be read as an image. For this purpose, the camera 1A includes a lens 1a, an image sensor 1b, and an analog / digital converter (AD) 1c, and outputs digital image data of a photographed identification code to the computer 1B.

  The computer 1B controls the operation of the terminal 1. In the present embodiment, the computer 1B recognizes the identification code in the image captured by the camera 1A, converts the recognized identification code into identification code information, and converts the converted identification code information to the communication interface 1D and the network 2. To the server 3.

  As will be described later, the display 1C displays overlay information as a collation result provided from the server 3 via the network 2 and the communication interface 1D on the display screen of the display 1C.

  The server 3 includes a database 3A, a computer (information generation unit, verification unit, and information registration unit) 3B as an information generation unit, a verification unit, and an information registration unit, and a communication interface 3C. The database 3A stores reference positional relationship information indicating predetermined reference positional relationships of a plurality of articles with identification codes that can be read as images. Hereinafter, a case where the identification code included in the image is different for each article will be mainly described, but the present invention can also be applied to a case where a part of the identification code included in the image is the same.

  The computer 3B controls the operation of the server 3. In the present embodiment, the computer 3B receives the identification code information from the computer 1B via the communication interface 1D, the network 2, and the communication interface 3C. Then, the computer 3B uses the photographed article positional relationship information indicating the positional relation of the plurality of articles to which the identification code in the photographed image is attached as the position coordinates obtained by analyzing the identification code recognized by the computer 1B. Generated based on the center coordinates of the identification code.

  In the present embodiment, the computer 1B determines the number of identification codes extracted from the photographed image when raster scanning the photographed image in the screen of the display 1C. Recognize multiple identification codes.

  In the present embodiment, the computer 3B collates the reference positional relationship information and the photographed article positional relationship information, and generates overlay information representing the collation result. More specifically, when the photographed article positional relationship information corresponds to the reference positional relationship information, the computer 3B generates overlay information representing articles corresponding to the plurality of identification codes extracted by the computer 1B as a comparison result. . The generated overlay information is displayed in association with a plurality of identification codes in the screen of the display 1C. On the other hand, when the photographed article position relation information does not correspond to the reference position relation information, the computer 3B uses the overlay information representing the articles corresponding to the plurality of identification codes extracted by the computer 1B and the reference position relation as the comparison result. Other overlay information is generated as positional relationship change information regarding the change to the photographing article positional relationship. The generated overlay information is displayed in association with a plurality of identification codes in the screen of the display 1C, and the other generated overlay information is displayed in a portion other than the range where the article is displayed in the screen of the display 1C. Is done.

  Furthermore, in the present embodiment, the camera 1A photographs a plurality of articles with identification codes that are in the reference position relationship, and the computer 3B is based on the center coordinates of the identification code recognized by the computer 1B. Information is generated, and the generated reference position relationship information is registered in the database 3A.

  FIG. 2 is a diagram showing an example of an identification code used in the position information display system shown in FIG. The identification code 11 shown in FIG. 2 is a two-dimensional code having a size of 35 × 35 cells, divided into 9 × 9 blocks, and having a bright separation space 23 of 1 cell between adjacent blocks. Therefore, the separation space is a lattice-like pattern with 8 × 8 columns and a cell interval of 1 cell width. The first position detection pattern 12A is in the lower right 3 × 3 block and the 3 × 3 separation space, and the second position detection pattern 12D is in the upper right 2 × 2 block and the 2 × 2 separation space. The third position detection pattern 12B is located in the 3 (horizontal) × 2 (vertical) block and the 3 × 2 separation space portion, and the lower left 2 (horizontal) × 3 (vertical) block and the 2 × 3 separation space portion. Are provided with fourth position detection patterns 12C, respectively. Therefore, a pattern larger than the first to fourth position detection patterns does not appear in blocks other than the first to fourth position detection patterns of the identification code 11.

  The minimum unit of the code portion of the identification code 11 is a cell. The identification code 11 usually takes a square or rectangular shape. Although other shapes are possible, most of the two-dimensional codes are quadrangular, and the two-dimensional code of the first embodiment is also square. However, the shape is not limited to this, and may be rectangular or other shapes.

  In general, the two-dimensional code represents data in light and dark cells, and the identification code 11 also represents data in light and dark cells. Furthermore, although the identification code 11 is a 35 × 35 cell square, it can be formed into a code having a larger size or a shape such as a rectangle whose vertical and horizontal sizes are changed. A square two-dimensional code of 35 × 35 cells is referred to as version 2 × 2. Here, the minimum version is 1 × 1, and the cell size at this time is 27 × 27. The embedding of the pattern is possible when both the vertical and horizontal versions are 2 or more. The reason for not embedding a picture when the version is 1 × 1 is that even though the amount of data is small, if the pattern is embedded, the amount of data is further reduced, and even if it is recognized, almost no data can be obtained. The above restrictions were added. The identification code 11 can be extended in the vertical direction and the horizontal direction, respectively. When the horizontal version is 2 and the vertical version is 3, it is written as version 2 × 3. As the version increases by 1, the cell size increases by 8 and the number of blocks increases by 2. Therefore, in version 3 × 4, the cell size is 43 × 51. The version can be selected from 1 to 20, but is not limited to this.

  In the first position detection pattern 12A, the dark cell portion includes a square frame having a width of 1 cell of 8 × 8 cells and a 2 × 2 square at the center of the square frame. In the second position detection pattern 12D, the dark cell portion has a square frame of 1 × 4 cells of 4 × 4 cells. The third position detection pattern 12B is a horizontally long rectangular frame in which the dark cell portion has a rectangular cell with a width of 1 cell of 8 × 4 cells. The fourth position detection pattern 12C is a vertically long rectangular frame in which a dark cell portion has a rectangular cell with a width of 1 × 4 × 8 cells.

  In the identification code 11, four different position detection patterns are arranged at the four corners of the square two-dimensional code. Note that the position detection patterns are different when the shape, the size, and the arrangement direction on the two-dimensional code are different, and also include the case where the line width ratios are different. However, since it is affected by shooting conditions and the like, the difference in color is not targeted, but a light and dark binary image is targeted.

  In the identification code 11, the position detection pattern is arranged near each vertex of a square or a rectangle. This is because the influence of dirt can be dispersed by arranging them as far as possible rather than arranging them at one place. However, the position of the position detection pattern is not limited to the four corners. Like the identification code 11, not only a square but also a rectangular shape is used as a position detection pattern, so that the shape, the inclination, and the size can be easily distinguished, so that it can be recognized at high speed. In addition, the hollowed rectangle is easy to distinguish from other reflections, and there is little waste of data.

  The reason for arranging the four position detection patterns is that in the two-dimensional projective transformation used to calculate the mapping of the data coordinates with high accuracy in the analysis, the code cell and the coordinates of the captured image corresponding to the cell are calculated. This is because it is necessary to give four sets of coordinates as parameters. Even if there are only two or three position detection patterns, it is possible to perform projective transformation after calculating four points by interpolating the coordinates, but shooting from the lick, distortion, blurring, etc. In the identification code 11, four position detection patterns are arranged because it is difficult to obtain accurate coordinates and greatly affects the accuracy of data extraction.

  The reason why the position detection pattern is different is that even if there is a missing position detection pattern, the missing position detection pattern can be reliably identified, and the coordinates of the missing position detection pattern can be predicted. Pattern correction is possible. When all the same position detection patterns are used, it is not easy to identify the position detection patterns that have not been found as much as when different position detection patterns are used, and it is difficult to correct the position detection patterns.

  56 blocks other than the four position detection patterns of the identification code 11 are data portions, and include an actual data block, an error correction code block, a version information block, a format information block, and a design embedding information block.

  As described above, the data portion includes 3 × 3 cells as one block and embeds data in units of blocks. The data section includes version information blocks 15 and 16, a format information block 17, and pattern embedding information blocks 18A, 18B, 19A and 19B, and the remaining blocks are actual data blocks 22. In the identification code 11, a part of the actual data block 22 is used as an error correction code and a position correction pattern.

  Therefore, the remaining blocks 22 excluding the position detection pattern, version information block, format information block, picture embedding information block, block provided with the position correction pattern, and error correction code block are actual data blocks. If the pattern is embedded, the pattern embedded block indicated by the pattern embedded information block is also excluded from the actual data block. The actual data is recorded in order such that the blocks belonging to the actual data block are laid out in order from the upper left to the right, and laid from the left one block below when the laying is completed.

  A block has 3 × 3 cells, and each cell represents one bit of light and dark, so one block has a maximum of 9-bit information (9-bit representation), but here is resistant to blurring and blurring of the image Therefore, the data amount per block can be set smaller than the 9-bit data amount. In the identification code 11, the block size is 3 × 3 cells, but the block size is not limited to this, and the minimum 1 × 1 cell size and the vertical and horizontal cell sizes are different. Block sizes such as are also possible.

  The version information block records information related to the size of the identification code 11, and there are two types of versions, the vertical version information block 15 and the horizontal version information block 16, and corresponding version information is recorded. The vertical version information block 15 and the horizontal version information block 16 disperse the risk of missing due to dirt or the like by disposing two blocks each storing the same information at two locations apart from each other. As version information, a block representing a numerical value of the version number (vertical and horizontal 1 to 20) is arranged.

  The format information block 17 records format information composed of a pattern embedding flag (1 bit) and data block type data (2 bits), and arranges three blocks storing the same information at three positions apart. The pattern embedding flag indicates whether or not a pattern is embedded, that is, whether or not a pattern embedding area is provided. When the pattern embedding is present, a pattern embedding information block is provided. The data block type data indicates the type of the data block. The data block type is the data capacity per block, and any of 6, 7, and 9 bits / block is selected. The amount of data decreases in the order of 9 bits> 7 bits> 6 bits, but the readability of the data is in the order of 6 bits> 7 bits> 9 bits. Take into account and choose. This will be described later.

  The design to be embedded is embedded in units of blocks, and when a plurality of adjacent blocks are design embedding regions, a separation space between them is also included in the design embedding region. The external shape of the pattern to be embedded is a rectangle, and the image of the pattern is not limited to a binary image in cell units, and any image may be used. Also, there may be a plurality of rectangular blocks in which the pattern is embedded. For example, the pattern may be a multi-value image having a higher resolution than the cell, a color image, or, of course, a binary image in units of cells. In the first embodiment, as a limitation of embedding the pattern, it is assumed that the pattern is not embedded in the upper code block 2 rows, the left block 2 columns, the lower block 3 rows, and the right block 3 columns. In this range, according to the specification of the two-dimensional code, a pattern embedding information block having image information is arranged in a portion outside the pattern embedding range.

  The pattern embedding information block records information on the size and block position of the area in which the pattern is embedded in the vertical and horizontal directions, and there are two types of vertical embedding information blocks 18A and 18B and horizontal embedding information blocks 19A and 19B. Corresponding version information is recorded. The vertical embedding information blocks 18A and 18B record the design embedding height (3 bits or 6 bits) and the design embedding offset height (3 bits or 6 bits). The horizontal embedding information blocks 19A and 19B designate a picture embedding width (3 bits or 6 bits) and a picture embedding offset width (3 bits or 6 bits). Whether to use 3 bits or 6 bits is related to version information as will be described later. If the version is 2 to 4, 3 bits are required, and if the version is 5 to 20, 6 bits are required. In the case of 2 to 4, the vertical embedding information block 18B and the horizontal embedding information block 19B are unnecessary.

  The pattern embedding information block exists only when the pattern embedding flag is set in the format information block. The identification code 11 assumes that the number of embedding patterns is only one, and if it is assumed that a plurality of embedding patterns are embedded in a plurality of areas, the bit of the pattern embedding flag in the format information block The number is increased to indicate the number of pattern embedding areas, and the above-mentioned pattern embedding information blocks are provided for the number of patterns. The design size and design embedding start position are specified in units of blocks. The block coordinates are expressed as (n, m) with the block at the upper left corner as the origin, the number of horizontal blocks is blW, and the number of vertical blocks is blH. In the first embodiment, the pattern embedding area is limited to a rectangular area consisting of upper left (2, 2) and lower right ((blW-4, blH-4). The maximum number of horizontal blocks of the pattern is blW-. Five and the maximum number of vertical blocks is blH-5.

  The position of the picture is embedded in the code as block embedding information blocks with the block coordinates that are the starting point (upper left) and the block size so that the position of the picture can be recognized during code analysis. . Similar to the version information block, it is handled separately in the horizontal and vertical directions. In the horizontal direction, the amount of data is divided when blW-5 is less than 8 (horizontal version 2 to 4) and in other cases (horizontal version 5 to 20), and the vertical length is the same. The values of blW and blH can be obtained by analyzing the horizontal and vertical versions.

  When blW is less than 13, the horizontal block size is a minimum of 1 and a maximum of 8 blocks, 8 can be represented by 3 bits, and similarly there are 7 horizontal offset blocks, 2 to 8, Since it can be represented by 3 bits, the total is 6 bits. Therefore, a block is represented by 6 bits, and these can be represented by one block. The same applies to the vertical. When blW is 13 or more, the horizontal block size is represented by 6 bits, and similarly, the number of horizontal offset blocks is represented by 6 bits. Therefore, it is expressed using 2 blocks. The same applies to the vertical.

  The horizontal embedding information blocks 19A and 19B are outside the upper left and lower right horizontal version information blocks (upper and lower sides), and the vertical embedding information blocks 18A and 18B are outside the lower left and lower right vertical version information blocks. (Left side and right side)

  When the pattern is not embedded, that is, when the pattern embedding flag of the format information block indicates “None”, the code embedding information block and the pattern embedding area become unnecessary, and the code becomes efficient.

  The position correction pattern is a target pattern used for the coordinate correction of the actual data block, the error correction code block, and the pattern embedding information block when the pattern is embedded. Although the approximate coordinates in the identification code 11 can be acquired from the position detection pattern, an error occurs in the coordinates of the data portion due to paper warping, bending, lens distortion, and displacement at the time of position detection pattern acquisition. Provide. Unlike the position detection pattern, the position correction pattern does not need to be distinguished from other noises. If the position detection pattern can be calculated, the position of the position correction pattern can be easily determined. Therefore, it is desirable that the position correction pattern has a shape that facilitates fine coordinate correction.

  In the identification code 11, the position correction pattern arranges blocks (position correction blocks) composed of predetermined cell combinations at regular intervals instead of actual data. A block in which the center cell of the block is dark and the surrounding area is bright is arranged if the block coordinates (7n, 7m) (n and m are integers of 0 or more) are data portions. However, when the position detection block, the version information block, the format information block, the design embedding information block and the design should exist at the coordinates, they are not arranged. Here, with respect to the block coordinates, the upper left coordinate reference coordinate of the block is (0, 0), and the block on the right is expressed as (1, 0). The block for providing the position correction pattern is not limited to the above.

  In the actual data, a message and a segment combining the header (message type (message encoding) and message size) that qualifies the message are arranged by the number of messages. As a special segment, a segment that does not include a message and contains only a termination flag is prepared. When the capacity of actual data is excessive, a segment of the termination flag is arranged, and then padding is arranged. The actual data is divided into blocks according to the data capacity per block indicated by the data block type data. Similarly, the error correction code is also divided into blocks.

  When a Reed-Solomon code is used as the error correction code, error correction is performed in units of words, so it is desirable to make one word into one block. When one word spans a plurality of blocks, even when one block is contaminated, all words related to the block are subjected to error correction, and the correction efficiency is deteriorated. Dirt that causes corrections and color jumps due to spotlights are often concentrated in one place, but by making a block, the data to be corrected can be gathered in one place at the same time, enabling efficient correction. And increase the possibility of recognizing the code.

  FIG. 3 is a flowchart of registration of reference position relationship information in the position information display system of FIG. Here, the reference positional relationship information generated based on the photographed images obtained by photographing the four identification codes attached to the four storage boxes A, B, C, and D as the plurality of articles with the identification codes attached thereto, respectively. The case of registration will be described.

  First, the camera 1A photographs an article (step S1). An image including an article photographed by the camera 1A can be displayed on the screen of the display 1C. FIG. 4 is a diagram illustrating a display example of a captured image used for generating the reference positional relationship information. In FIG. 4, articles 31, 32, 33, and 34 included in one photographed image 30 ′ displayed on the screen 30 correspond to the storage boxes A, B, C, and D, respectively, and printed identification codes 31A and 31A, 32A, 33A, and 34A are attached to the articles 31, 32, 33, and 34, respectively.

  Each of the identification codes 31A, 32A, 33A, and 34A can be read by the computer 1B as information of each of the storage boxes A, B, C, and D as an image. In the example shown in FIG. 4, when the width and length of the screen 30 (the captured image 30 ′) are w and h, respectively, and the coordinates of the upper left corner are the origin O (that is, (0, 0)), the upper right corner. The coordinates of A, the coordinates of the lower right corner B, and the coordinates of the lower left corner C are represented by (w-1, 0), (w-1, h-1) and (0, h-1), respectively. .

  Next, the computer 1B recognizes the identification codes 31A, 32A, 33A, and 34A in the image taken by the camera 1A, and converts the recognized identification codes 31A, 32A, 33A, and 34A into identification code information, respectively. Then, based on the converted identification code information, the computer 1B determines the center coordinates CA1 (cxa1, cya1), CB1 (cxb1, cyb1), CC1 (cxc1, cyc1), CD1 (the identification codes 31A, 32A, 33A, 34A) cxd1, cyd1) are respectively calculated (step S2). FIG. 5 is a diagram for explaining the calculation of the center coordinates of the identification code. The identification code X shown in FIG. 5 has the same format as the identification code shown in FIG. 2, and corresponds to the identification codes 31A, 32A, 33A, and 34A, respectively.

  The computer 1B analyzes the captured image 30 ′ to detect the coordinates (px0, py0) of the corner P0 of the position detection pattern X0 of the identification code X, the coordinates (px1, py1) of the corner P1 of the position detection pattern X, and the position detection. The coordinates (px2, py2) of the corner P2 of the pattern X2 and the coordinates (px3, py3) of the corner P3 of the position detection pattern X3 can be acquired.

  The center coordinates C (cx, cy) of the position detection pattern X are on the coordinates of the corners P0, P1, P2, P3, the coordinates of the corners P0, P2 on the diagonal line of the identification code X, or the diagonal line of the identification code X. It can be obtained from the coordinates of the corners P1 and P3. When the center coordinate C (cx, cy) is obtained from the coordinates of the corners P0, P1, P2, and P3, the x coordinate cx of the center coordinate C is (px0 + px1 + px2 + px3) / 4, and the y coordinate cy of the center coordinate C is (py0 + py1 + py2 + py3). ) / 4. When the center coordinate C (cx, cy) is obtained from the coordinates of the corners P0 and P2 on the diagonal line of the identification code X, the x coordinate cx of the center coordinate C is (px0 + px2) / 2, and y of the center coordinate C The coordinate cy is (py0 + py2) / 2.

  Next, the computer 1B identifies the center coordinates CA1 (cxa1, cya1), CB1 (cxb1, cyb1), CC1 (cxc1, cyc1), and CD1 (cxd1, cyd1) of the identification codes 31A, 32A, 33A, 34A, respectively. The position information is converted into position coordinate information in the same format as the code information, and the identification code information and position coordinate information are transmitted to the server 3 (step S3).

  Next, the computer 3B receives the identification code information and the position coordinate information from the computer 1B (step S4). Next, the computer 3B is based on the center coordinates CA1 (cxa1, cya1), CB1 (cxb1, cyb1), CC1 (cxc1, cyc1), CD1 (cxd1, cyd1) of the identification codes 31A, 32A, 33A, 34A. The positional relationship information is generated (step S5), the generated reference positional relationship information is registered in the database 3A (step S6), and the processing flow ends.

  FIG. 6 is a diagram illustrating an example of a part of the reference position relationship information. As shown in FIG. 6, the reference position relationship information includes a table that represents the relationship between the identification code, the article name, and the center coordinates. The table shown in FIG. 6 is created based on the identification code information and the position coordinate information by the computer 3B.

  In the present embodiment, the reference positional relationship information includes, in addition to the table shown in FIG. 6, a plurality of articles 31, 32, 33, 34 to which identification codes 31A, 32A, 33A, 34A having a reference positional relationship are attached. It is determined based on the center coordinates CA1 (cxa1, cya1), CB1 (cxb1, cyb1), CC1 (cxc1, cyc1), CD1 (cxd1, cyd1) of the identification codes 31A, 32A, 33A, 34A included in the captured images. Distance and angle.

FIG. 7 is a diagram for explaining the distance determined based on the center coordinates of the identification codes of the articles in the reference position relationship. The computer 3B calculates a distance AB between the center coordinates CA1 (cxa1, cya1) of the identification code 31A and the center coordinates CB1 (cxb1, cyb1) of the identification code 32A based on the following expression.

Further, the computer 3B calculates a distance AC between the center coordinate CA1 (cxa1, cya1) of the identification code 31A and the center coordinate CC1 (cxc1, cyc1) of the identification code 33A based on the following expression.

Further, the computer 3B calculates a distance AD between the center coordinates CA1 (cxa1, cya1) of the identification code 31A and the center coordinates CD1 (cxd1, cyd1) of the identification code 34A based on the following expression.

  In the example shown in FIG. 7, a relationship of AC <AB <AD is established among the distance AB, the distance AC, and the distance AD.

FIG. 8 is a diagram for explaining angles determined based on the center coordinates of the identification codes of articles in a reference position relationship. The computer 3B calculates the angle θ _AB formed by the horizontal line H and the straight line connecting the center coordinates CA1 (cxa1, cya1) of the identification code 31A and the center coordinates CB1 (cxb1, cyb1) of the identification code 32A based on the following formula. To do.

Further, the computer 3B determines the angle θ _AC formed by the horizontal line H and the straight line connecting the center coordinates CA1 (cxa1, cya1) of the identification code 31A and the center coordinates CC1 (cxc1, cyc1) of the identification code 33A based on the following expression. To calculate.

Further, an angle θ _AD formed by the horizontal line H and the straight line connecting the center coordinates CA1 (cxa1, cya1) of the identification code 31A and the center coordinates CD1 (cxd1, cyd1) of the identification code 34A is calculated based on the following equation.

In the example shown in FIG. 8, the relationship θ _AB <θ _AD <θ _AC is established among the angle θ _AB , the angle θ _AC, and the angle θ _AD .

  9 and 10 are flowcharts of the operation of the position information display system of FIG. Here, the photographing article positional relationship information is generated based on the photographed images obtained by photographing the four identification codes attached to the four storage boxes A, B, C, and D as the plurality of articles to which the identification codes are attached. The case where it does is demonstrated.

  First, the camera 1A photographs an article (step S11). Next, an image including an article photographed by the camera 1A is displayed on the screen of the display 1C (step S12). FIG. 11 is a diagram illustrating a display example of a photographed image used for generating photographed article positional relationship information. In FIG. 11, one photographed image 30 a displayed on the screen 30 includes articles 31, 32, 33, and 34 to which printed identification codes 31 </ b> A, 32 </ b> A, 33 </ b> A, and 34 </ b> A are respectively attached.

  Next, the computer 1B recognizes the identification codes 31A, 32A, 33A, and 34A in the image taken by the camera 1A, and converts the recognized identification codes 31A, 32A, 33A, and 34A into identification code information, respectively. Then, based on the converted identification code information, the computer 1B determines the center coordinates CA1 ′ (cxa1 ′, cya1 ′), CB1 ′ (cxb1 ′, cyb1 ′), CC1 ′ () of the identification codes 31A, 32A, 33A, 34A. cxc1 ′, cyc1 ′) and CD1 ′ (cxd1 ′, cyd1 ′) are respectively calculated (step S13).

  Next, the computer 1B receives the center coordinates CA1 ′ (cxa1 ′, cya1 ′), CB1 ′ (cxb1 ′, cyb1 ′), CC1 ′ (cxc1 ′, cyc1 ′), CD1 of the identification codes 31A, 32A, 33A, 34A. '(Cxd1', cyd1 ') is converted into position coordinate information in the same format as the identification code information, and the identification code information and the position coordinate information are transmitted to the server 3 (step S14).

  Next, the computer 3B receives the identification code information and the position coordinate information from the computer 1B (step S15). Next, the computer 3B determines the center coordinates CA1 ′ (cxa1 ′, cya1 ′), CB1 ′ (cxb1 ′, cyb1 ′), CC1 ′ (cxc1 ′, cyc1 ′), CD1 of the identification codes 31A, 32A, 33A, 34A. Based on '(cxd1', cyd1 '), the photographing article positional relationship information is generated (step S16).

  FIG. 12 is a diagram illustrating an example of a part of the photographing article position relationship information. As illustrated in FIG. 12, the photographed article position relationship information includes a table that represents the relationship between an identification code, an article name, and center coordinates. The table shown in FIG. 12 is created based on the identification code information and the position coordinate information by the computer 3B.

  In the present embodiment, the photographed article position relationship information includes a plurality of articles 31, 32, 33, to which identification codes 31A, 32A, 33A, and 34A having a photographed article position relationship are attached in addition to the table shown in FIG. 34, center coordinates CA1 ′ (cxa1 ′, cya1 ′), CB1 ′ (cxb1 ′, cyb1 ′), CC1 ′ (cxc1 ′, cyc1 ′) of the identification codes 31A, 32A, 33A, 34A included in the image obtained by photographing 34 It has a distance and an angle determined based on CD1 ′ (cxd1 ′, cyd1 ′).

FIG. 13 is a diagram for explaining the distance determined based on the center coordinates of the identification codes of the articles in the photographing article position relationship. The computer 3B calculates a distance AB ′ between the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A and the center coordinates CB1 ′ (cxb1 ′, cyb1 ′) of the identification code 32A based on the following expression. .

Further, the computer 3B determines the distance AC ′ between the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A and the center coordinates CC1 ′ (cxc1 ′, cyc1 ′) of the identification code 33A based on the following expression. calculate.

Further, the computer 3B calculates the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A, the center coordinates CD1 ′ (cxd1 ′, cyd1 ′) of the identification code 34A, and the distance AD ′ based on the following equations. To do.

  In the example illustrated in FIG. 13, a relationship of AC ′ <AB ′ <AD ′ is established among the distance AB ′, the distance AC ′, and the distance AD.

FIG. 14 is a diagram for explaining an angle determined based on the center coordinates of the identification codes of the articles in the photographed article position relationship. The computer 3B determines the angle θ _AB ′ formed by the horizontal line H and the straight line connecting the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A and the center coordinates CB1 ′ (cxb1 ′, cyb1 ′) of the identification code 32A. Calculation is based on the following formula.

Further, the computer 3B determines that the angle θ _AC ′ formed by the horizontal line H and the straight line connecting the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A and the center coordinates CC1 ′ (cxc1 ′, cyc1 ′) of the identification code 33A. Is calculated based on the following equation.

Further, an angle θ _AD ′ formed by the horizontal line H and a straight line connecting the center coordinates CA1 ′ (cxa1 ′, cya1 ′) of the identification code 31A and the center coordinates CD1 ′ (cxd1 ′, cyd1 ′) of the identification code 34A is expressed as follows: Calculate based on the formula.

In the example shown in FIG. 14, the relationship θ _AB ′ <θ _AD ′ <θ _AC ′ is established among the angle θ _AB ′, the angle θ _AC ′, and the angle θ _AD ′.

Next, the computer 3B determines the distances AB ′, AC ′, and the distances AB ′, AC ′, and AD included in the reference position relationship information and the angles θ _AB , θ _AC , and θ _{AD and} the distances AB ′, AC ′, The relation of AD ′ and the relation of angles θ _AB ′, θ _AC ′, and θ _AD ′ are collated, and overlay information representing the collation result is generated (step S17). More specifically, when the relationship AC ′ <AB ′ <AD ′ and the relationship θ _AB ′ <θ _AD ′ <θ _AC ′ are established, the computer 3B identifies the identification extracted by the computer 1B as a verification result. The articles 31, 32, 33, and 34 corresponding to the codes 31A, 32A, 33A, and 34A generate overlay information representing the storage box A, the storage box B, the storage box C, and the storage box D, respectively. On the other hand, when the relationship of AC ′ <AB ′ <AD ′ or the relationship of θ _AB ′ <θ _AD ′ <θ _AC ”is not established, it corresponds to the identification codes 31A, 32A, 33A, 34A extracted by the computer 1B. The articles 31, 32, 33, and 34 to be generated generate overlay information representing the storage box A, the storage box B, the storage box C, and the storage box D, and overlay information that represents a change from the reference positional relationship to the photographing article positional relationship.

  Next, the computer 3B transmits overlay information to the computer 1B (step S18). Next, the computer 1B receives the overlay information of the article from the computer 3B (step S19). The computer 1B superimposes and displays the overlay information of the article on the captured image 30a (step S20), and ends the processing flow.

  FIG. 15 is a diagram illustrating a captured image display example in which overlay information is superimposed after reference positional relationship information and captured article positional relationship information are collated. In the display screen 30 shown in FIG. 15, overlay information 31B indicating that the article 31 is the storage box A, overlay information 32B indicating that the article 32 is the storage box B, and that the article 33 is the storage box C. The overlay information 33B and the overlay information 34B indicating that the article 34 is the storage box D are displayed in association with the identification codes 31A, 32A, 33A, and 34A, respectively.

  FIG. 16 is a diagram illustrating another display example of the captured image in which the overlay information is superimposed after the reference positional relationship information and the captured article positional relationship information are collated. The photographed image 30b displayed on the display screen 30 shown in FIG. 16 includes articles 31, 32, 33, and 34, and the arrangement of the article 31 and the article 32 included in the photographed image 30b is represented by the reference positional relationship information. The arrangement of the article 31 and the article 32 is different.

In this case, the computer 3B uses the relationship of AD '<AB'<AC'and the relationship of θ _AB '<θ _AC '<θ _AD ' based on the arrangement of the articles 31 and 32 included in the captured image 30b. It is determined that the arrangement of the article 31 and the article 32 represented by the positional relationship information is different, the overlay information 35 including an indication that the arrangement of the storage box A and the storage box B is different and an arrow is generated, and the generated overlay information 35 is displayed on the display screen 30.

  FIG. 17 is a diagram illustrating another display example of the captured image in which the overlay information is superimposed after the reference positional relationship information and the captured article positional relationship information are collated. The photographed image 30c displayed on the display screen 30 shown in FIG. 17 includes articles 31, 33, and 34.

In this case, the computer 3B determines that the article 32 is not included in the captured image 30c based on the relationship of AD ′ <AC ′ and the relationship of θ _AC ′ <θ _AD ′, and the storage box B is insufficient. Overlay information 36 composed of a display to the effect and an arrow is generated, and the generated overlay information 36 is displayed on the display screen 30.

  FIG. 18 is a diagram illustrating an example of the reference position relationship information in a list format. The reference position relationship information shown in FIG. 18 is a list in which the book 1, the book 2, the book 3, the book 4, and the book 5 are arranged on one shelf as a list indicating the reference position relationship, and is created by the computer 1B. The list thus registered is registered in the database 3A.

  FIG. 19 is a diagram illustrating a display example of a photographed image used for generating photographing article positional relationship information in association with the reference positional relationship information in a list format. In FIG. 19, one captured image 30d displayed on the screen 30 includes articles 41, 42, 43, 44, and 45 to which printed identification codes 41A, 42A, 43A, 44A, and 45A are respectively attached. Articles 41, 42, 43, 44, and 45 correspond to book 1, book 2, book 3, book 4, and book 5 in the list shown in FIG.

  The center coordinates of the identification codes 41A, 42A, 43A, 44A and 45A are respectively CA2 ′ (cxa2 ′, cya2 ′), CB2 ′ (cxb2 ′, cyb2 ′), CC2 ′ (cxc2 ′, cyc2 ′), CD2 ′ (cxd2) ', Cyd2'), CE2 '(cxe2', cye2 '), the distance between the center coordinate CA2' of the identification code 41A and the center coordinate CB2 'of the identification code 42A, and the center coordinate CA2' of the identification code 41A The distance between the center coordinate CC2 ′ of the code 43A, the distance between the center coordinate CA2 ′ of the identification code 41A and the center coordinate CD2 ′ of the identification code 44A, and the center coordinate CA2 ′ of the identification code 41A and the identification code 45A When the distances from the center coordinates CE2 ′ are A, B, C, and D, respectively, in the captured image 10d shown in FIG. Corresponding to the reference positional relationship information shown in 8 A <B <relation C <D is satisfied.

  FIG. 20 is a diagram illustrating a display example of a captured image in which overlay information is superimposed after collating the reference positional relationship information in the list format and the captured article positional relationship information. On the display screen 30 shown in FIG. 20, overlay information 41 </ b> B indicating that the article 41 is the book 1, overlay information 42 </ b> B indicating that the article 42 is the book 2, and overlay information indicating that the article 43 is the book 3. 43B, overlay information 44B indicating that the article 44 is the book 4 and overlay information 45B indicating that the article 45 is the book 5 are displayed in association with the identification codes 41A, 42A, 43A, 44A, and 45A, respectively. .

  FIG. 21 is a diagram illustrating a display example of a captured image in which overlay information is superimposed after collating the reference positional relationship information in the list format and the captured article positional relationship information. The photographed image 30e displayed on the display screen 30 shown in FIG. 21 includes articles 41, 42, 43, 44, and 45, and the arrangement of the articles 44 and articles 45 included in the photographed image 30b is shown in FIG. This is different from the arrangement of the article 44 and the article 45 represented by the reference positional relationship information.

  In this case, the computer 3B, based on the relationship of A <B <C <E <D, the article 44 in which the arrangement of the article 44 and the article 45 included in the captured image 30e is represented by the reference positional relationship information illustrated in FIG. The overlay information 46A, 46B, 46C is generated by generating overlay information 46B and 46C composed of arrows indicating that the placement of the book 4 and the book 5 is different, and determining that the placement of the article 45 is different. Is displayed on the display screen 10.

  FIG. 22 is a diagram illustrating another display example of the captured image used for generating the reference positional relationship information. In FIG. 22, articles 51, 52, and 53 included in one photographed image 30f displayed on the screen 30 correspond to gears A, B, and C, respectively, and printed identification codes 51A, 52A, and 53A are displayed. Attached to the articles 51, 52, and 53, respectively.

  In this case, the computer 3B, based on the center coordinates CA3 (cxa3, cya3), CB3 (cxb3, cyb3), CC3 (cxc3, cyc3) of the identification codes 51A, 52A, 53A included in the captured image 30f. Distance A ′ between the central coordinate CA3 of the identification code 52A and the central coordinate CB3 of the identification code 52A, the distance B ′ between the central coordinate CB3 of the identification code 52A and the central coordinate CC3 of the identification code 53A, and the central coordinate CC3 of the identification code 53A. And the distance C ′ between the center code CA3 of the identification code 51A and the calculated distances A ′, B ′, C ′ are included in the reference positional relationship information. Here, it is assumed that the distances A ′, B ′, and C ′ have different values.

  FIG. 23 is a diagram illustrating a display example of a photographed image used to generate photographing article positional relationship information related to the reference positional relationship information generated using the photographing image illustrated in FIG. In FIG. 23, articles 51, 52, and 53 included in one photographed image 30g displayed on the screen 30 correspond to the gear A, the gear B, and the gear C, respectively, and printed identification codes 51A, 52A, and 53A are provided. Attached to the articles 51, 52, and 53, respectively.

  In this case, the computer 3B determines the center coordinates CA3 ′ (cxa3 ′, cya3 ′), CB3 ′ (cxb3 ′, cyb3 ′), CC3 ′ (cxc3 ′, cyc3) of the identification codes 51A, 52A, 53A included in the captured image 30g. )), The distance A ″ between the center coordinate CA3 ′ of the identification code 51A and the center coordinate CB3 ′ of the identification code 52A, the center coordinate CB3 ′ of the identification code 52A and the center coordinate CC3 ′ of the identification code 53A. And the distance C ″ between the center coordinate CA3 ′ of the identification code 53A and the center coordinate CA3 ′ of the identification code 51A is calculated, and the calculated distances A ″, B ″, C ″ are calculated as the photographing article position. Include in related information.

  Then, the computer 3B determines whether or not the distances A ′, B ′, and C ′ match the distances A ″, B ″, and C ″. The distances A ′, B ′, and C ′ are the distances A ″, In the case of matching with B ″, C ″, as shown in FIG. 24, the display screen 30 has overlay information 51B indicating that the article 51 is the gear A and overlay information 52B indicating that the article 52 is the gear B. The overlay information 53B indicating that the article 53 is the gear C is displayed in association with the identification codes 51A, 52A, and 53A. In addition, overlay information 54 indicating that the gears A, B, and C match is also displayed on the display screen 30.

  When the distances A ′, B ′, and C ′ do not match the distances A ″, B ″, and C ″, for example, the distances A ′, B ′, and C ′ respectively match the distances A ″, C ″, and B ″. In this case, as shown in FIG. 25, the computer 3B determines that the arrangement of the article 51 and the article 52 included in the captured image 30h is different from the arrangement of the article 51 and the article 52 represented by the reference positional relationship information. Overlay information 54A indicating that A, B, and C do not match, overlay information 54B indicating that the arrangement of gears A and B is different, and overlay information 54C including arrows are generated, and the generated overlay information 54A, 54B, 54C is generated. Is displayed on the display screen 30.

  According to the present embodiment, the computer 3B determines the relationship between the predetermined reference position of the plurality of articles with the identification code and the shooting article position relationship of the plurality of articles with the identification code in the photographed image. I know both. Therefore, the computer 3B can easily grasp the positional relationship of a plurality of articles with identification codes that can be read as images on the screen of the display unit.

  In addition, since the positional relationship of the plurality of articles can be managed based on the reference positional relationship information indicating the predetermined reference positional relationship of the plurality of articles with identification codes that can be read as images, the plurality of articles A plurality of articles can be managed accurately even if the item cannot be placed at an accurate position such as a shelf.

  In addition, since it is not necessary to use a large-scale facility to use an RFID tag, an antenna, or the like as in a management system using an RFID tag, a position information display system can be configured at low cost.

  Further, the reference positional relationship information including the information included in the identification code and the positional information of the identification code can be registered at a time, and the correct arrangement of articles that are not correctly arranged can be displayed.

  Further, when the distance included in the reference positional relationship information and the distance included in the photographed article positional relationship information are collated, the collation can be performed even when the article with the identification code is rotated.

  The present invention is not limited to the above-described embodiment, and many changes and modifications can be made. For example, the database can be provided in the terminal instead of the server. Further, the reference positional relationship information may be a list of two or more columns or the captured image itself.

  Further, at the time of collation, at least one of a position coordinate obtained by analyzing the identification code, a distance determined based on the position coordinate, and an angle determined based on the position information may be used. . When position coordinates are used for collation, predetermined position coordinates (for example, coordinates of four corners of a position detection pattern included in one identification code) included in the reference position relationship information are used as the shooting article position relationship information. Coordinate conversion of the position coordinates included in the photographing article position relationship information is performed so as to completely match the corresponding position coordinates included. In this case, in addition to the case where the position coordinates included in the reference position relationship information completely match the corresponding position coordinates included in the shooting article position relationship information, the shooting article position relationship information with respect to the position coordinates included in the reference position relationship information It may be determined that the article is in the correct position when the error of the corresponding position coordinates included in the item is less than a predetermined value (for example, less than 5%).

  Further, in the case of using the distance in the collation, the distance included in the reference positional relationship information is included in the reference positional relationship information in addition to the case where the distance included in the photographing article positional relationship information completely matches the corresponding distance. It may be determined that the article is in the correct position when the corresponding distance error included in the photographed article position relation information with respect to the distance is less than a predetermined value (for example, less than 5%).

  In addition, in the case of using an angle for collation, the angle included in the reference position relationship information is included in the reference position relationship information in addition to the case where the angle included in the photographed article position relationship information completely matches the corresponding angle It may be determined that the article is in the correct position when the error of the corresponding angle included in the photographing article position relation information with respect to the angle is less than a predetermined value (for example, less than 5%).

  As the position coordinates obtained by analyzing the identification code, instead of the center coordinates of the identification code, the coordinates of an arbitrary position (for example, the corner of the position detection pattern) of the position detection pattern included in the identification code, the upper end of the identification code The coordinates of a position that is a predetermined distance (for example, 10 pixels) away from can be used. The number of position coordinates obtained by analyzing the identification code may be singular or plural.

1 Terminal 1A Camera (shooting unit)
1a lens 1B computer (identification code recognition part)
1b Image sensor 1C Display 1c Analog to digital converter (AD)
1D, 3C communication interface 2 network (communication path)
3 server 3A database 3B computer (information generation unit, verification unit and information registration unit)
11, 31A, 32A, 33A, 34A, 41A, 42A, 43A, 44A, 45A, 51A, 52A, 53A Identification code 12A First position detection pattern 12B Third position detection pattern 12C Fourth position detection pattern 12D Second position detection Pattern 15 Version information block (vertical)
16 Version information block (horizontal)
17 Format information block 18A, 18B Pattern embedding information block (vertical)
19A, 19B Pattern embedding information block (horizontal)
30 screens 30 ', 30a, 30b, 30c, 30d, 30e, 30f, 30g, 30h Captured images 31, 32, 33, 34, 41, 42, 43, 44, 45, 51, 52, 53 Articles 31B, 32B, 33B, 34B, 35, 36, 46A, 46B, 46C, 51B, 52B, 53B, 54, 54A, 54B, 54C Overlay information

Claims (6)

A database that stores reference positional relationship information indicating a predetermined reference positional relationship of a plurality of articles with identification codes that can be read as images;
Photographing means for photographing a plurality of articles with the identification code;
An identification code recognition means for recognizing an identification code in the photographed image;
Photographed article positional relationship information indicating the positional relation of a plurality of articles with the identification code in the photographed image is generated based on the position coordinates obtained by analyzing the identification code recognized by the identification code recognition means Information generating means for
Collating means for collating the reference positional relationship information and the photographing article positional relationship information and generating a collation result;
Display means for superimposing and displaying the collation result on an image photographed by the photographing means;
A position information display system comprising:   The position according to claim 1, wherein the photographing article positional relationship information includes at least one of a distance and an angle determined based on a position coordinate obtained by analyzing the identification code recognized by the identification code recognition unit. Information display system.   The reference positional relationship information is a list obtained by analyzing an identification code included in an image obtained by photographing a list indicating the reference positional relationship or a plurality of articles with the identification code having the reference positional relationship. The position information display system according to claim 1, comprising at least one of a distance and an angle determined based on the coordinates.   The collation means includes the collation result including positional relationship change information about a change from the reference positional relationship to the positional relationship of the plurality of articles when the photographing article positional relationship information does not correspond to the reference positional relationship information. The position information display system according to any one of claims 1 to 3, wherein:   The photographing means photographs a plurality of articles to which the identification code having the reference positional relationship is attached, and the information generating means is a position coordinate obtained by analyzing the identification code recognized by the identification code recognizing means. 5. The information processing unit according to claim 1, further comprising: an information registration unit configured to generate the reference positional relationship information based on the information and register the reference positional relationship information generated by the information generation unit in the database. Position information display system. A shooting step of shooting a plurality of articles with identification codes readable as images with a camera;
An identification code recognition step for recognizing the identification code in the captured image by a computer;
Based on the position coordinates obtained by analyzing the identification code recognized in the identification code recognition step, the photographed article positional relationship information indicating the positional relationship of the plurality of articles with the identification code in the photographed image, An information generation step generated by a computer;
Reference position relation information indicating a predetermined reference position relation of a plurality of articles with the identification code is read from a database, the reference position relation information and the photographed article position relation information are collated by a computer, and a collation result is obtained. A computer-generated matching step;
A display step of displaying the matching result on a display superimposed on an image captured by a camera;
A position information display method comprising: