JP2010128894A - Database generation device, method of generating database, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a database generation device, a method of generating a database, and a computer program capable of appropriately generating a new database even if a plurality of table data having different data formats are present by preparing a plurality of pieces of identification rule information and selecting identification rule information according to data. <P>SOLUTION: One or a plurality of electronic document files are acquired, and the designation of a prescribed area of one or a plurality of acquired electronic document files is accepted. A plurality of pieces of identification rule information, namely information on a rule for identifying an item part from a data part in an area having accepted the designation are stored and the selection of one piece of identification rule information is accepted. Based on the identification rule information having accepted the selection, the item part included in the area having accepted the designation is identified from the data part, and a new database is generated by aggregating the identified item and data parts. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a database generation device, a database generation method, and a computer program that can easily generate a new database even when a plurality of table data having different data formats exist.

  When generating a relational database, table data generated in advance is often used. When the database items of the table data match, a new database can be easily generated by merging a plurality of table data.

 However, if the data format of the table data is not standardized, the data format of the table data depends on the creator, and even in the same application, the database items differ depending on the software program used, the database item array There is a difference in order and the like, and it cannot be merged as it is. In order to solve such a problem, conventionally, an intermediate file format is used, and a new database composed of table data obtained by merging a plurality of table data having different database items or different database item arrangement orders. A nice database.

For example, Patent Literature 1 discloses a database management system that generates one database from a plurality of table data via a CSV file that is often used as an intermediate file format for table data.
JP 2006-059135 A

  However, as in Patent Document 1, when a plurality of table data are merged via a CSV file, information regarding which database items are different and which database items are arranged in different order is known in advance. There is a problem that the desired table data cannot be generated without setting an appropriate conversion procedure according to the information.

  When the items of the table data are hierarchized, the item portion and the data portion can be identified by analyzing the ruled line structure of the table data, for example. However, it is difficult to automatically recognize the item portion and the data portion when the item is a single item as in the questionnaire format data, or when the data column is composed of only the numerical value sequence.

  The present invention has been made in view of such circumstances, and a plurality of pieces of table data having different data formats exist by preparing a plurality of identification rule information and selecting them according to the data. Another object of the present invention is to provide a database generation device, a database generation method, and a computer program that can correctly generate a new database.

  In order to achieve the above object, a database generation apparatus according to the first invention is a database generation apparatus that generates a new database based on data extracted from one or a plurality of electronic document files including table data. An electronic document file acquisition means for acquiring a plurality of electronic document files; an area designation receiving means for receiving designation of a predetermined area of the obtained one or more electronic document files; and an item portion included in the area for which designation has been received; Identification rule information storage means for storing a plurality of identification rule information, which is information relating to a rule for identifying a data portion, identification rule information selection receiving means for receiving selection of one identification rule information, and identification rule information for which selection has been received Identification means for identifying an item part and a data part included in an area for which designation is accepted, and identification Characterized in that it comprises a database generation means for generating a new database entry portion and a data portion that a plurality aggregate.

  The database generating apparatus according to a second aspect of the present invention is the database generation device according to the first aspect, wherein the identification rule information recognizes a part having a hierarchy in the table data as an item part, and a part after the lowest hierarchy of the item part. Including at least first identification rule information that is information relating to a rule that is recognized as a data part, and second identification rule information that is information relating to a rule that recognizes a pair of set data in the table data To do.

  Next, in order to achieve the above object, a database generation method according to the third invention is a database generation device that generates a new database based on data extracted from one or a plurality of electronic document files including table data. In a database generation method that can be executed, an item included in an area for acquiring one or a plurality of electronic document files, receiving a specified area of the acquired one or more electronic document files, and receiving the specification A plurality of identification rule information, which is information relating to a rule for identifying a part and a data part, is stored, a selection of one identification rule information is accepted, and it is included in an area that has received a designation based on the identification rule information that has accepted the selection Identify item parts and data parts, and create a new database by aggregating multiple identified item parts and data parts. Characterized in that it.

  Further, the database generation method according to a fourth invention is the database generation method according to the third invention, wherein the identification rule information recognizes a part having a hierarchy as an item part in the table data, and a part after the lowest hierarchy of the item part Including at least first identification rule information that is information relating to a rule for recognizing a data portion and second identification rule information that is information relating to a rule for recognizing a pair of set data in the table data. And

  Next, in order to achieve the above object, a computer program according to the fifth aspect of the invention is executed by a database generation device that generates a new database based on data extracted from one or a plurality of electronic document files including table data. In the computer program that can be performed, the database generation device, the electronic document file acquisition means for acquiring one or a plurality of the electronic document files, a region for receiving designation of a predetermined region of the acquired one or a plurality of electronic document files A designation receiving means, an identification rule information storage means for storing a plurality of identification rule information, which is information relating to a rule for identifying an item part and a data part included in the area for which the designation is accepted, and an identification rule for accepting selection of one identification rule information Information selection accepting means, based on the identification rule information that accepted the selection An identification means for identifying an item part and a data part included in the pasted area, and a database generation means for generating a new database by aggregating a plurality of identified item parts and data parts .

  In the computer program according to a sixth aspect based on the fifth aspect, the identification rule information recognizes a part having a hierarchy as an item part in the table data, and a part after the lowest hierarchy of the item part. Including at least first identification rule information that is information relating to a rule that is recognized as a data part, and second identification rule information that is information relating to a rule that recognizes a pair of set data in the table data To do.

  In the first invention, the third invention, and the fifth invention, one or a plurality of electronic document files are acquired, and designation of a predetermined area of the acquired one or a plurality of electronic document files is accepted. A plurality of pieces of identification rule information, which is information related to rules for identifying item parts and data parts included in the designated area, are stored, and selection of one piece of identification rule information is accepted. Based on the identification rule information that received the selection, the item part and the data part included in the area that received the designation are identified, and a plurality of identified item parts and data parts are aggregated to generate a new database. Since it is possible to accept selection of identification rule information adapted to the area where the designation is accepted, even if the electronic document file has a data format in which it is difficult to identify the item part and the data part, The data portion can be identified, and a new database based on a plurality of table data can be easily generated.

  In the second invention, the fourth invention, and the sixth invention, the identification rule information recognizes a part having a hierarchy as an item part in table data, and recognizes a part after the lowest hierarchy of the item part as a data part. Including at least first identification rule information that is information relating to a rule to be performed and second identification rule information that is information relating to a rule for recognizing a pair of set data in the table data. Normal table data can be correctly identified by the first identification rule information, and questionnaire data can be correctly identified by the second identification rule information, respectively, as an item portion and a data portion.

  According to the present invention, it is possible to accept selection of identification rule information adapted to an area for which designation has been accepted, so even an electronic document file having a data format in which it is difficult to distinguish between an item part and a data part The item part and the data part can be reliably identified, and a new database based on a plurality of table data can be easily generated.

  Hereinafter, a database generation device according to an embodiment of the present invention will be specifically described with reference to the drawings. The following embodiments do not limit the invention described in the claims, and all combinations of characteristic items described in the embodiments are essential to the solution. It goes without saying that it is not limited.

  The present invention can be implemented in many different modes and should not be construed as being limited to the description of the embodiment. The same symbols are attached to the same elements throughout the embodiments.

  In the following embodiment, a database generation apparatus in which a computer program is introduced into a computer system will be described. However, as will be apparent to those skilled in the art, the present invention is a computer program that can be partially executed by a computer. Can be implemented. Therefore, the present invention can take an embodiment of hardware as a database generation device, an embodiment of software, or an embodiment of a combination of software and hardware. The computer program can be recorded on any computer-readable recording medium such as a hard disk, DVD, CD, optical storage device, magnetic storage device or the like.

  FIG. 1 is a block diagram illustrating a configuration example of a database generation device according to an embodiment of the present invention. The database generation device 1 according to the embodiment of the present invention includes at least a CPU (Central Processing Unit) 11, a memory 12, a storage device 13, an I / O interface 14, a video interface 15, a portable disk drive 16, a communication interface 17, and The internal bus 18 connects the hardware described above.

  The CPU 11 is connected to the above-described hardware units of the database generation device 1 via the internal bus 18, controls the operation of the above-described hardware units, and stores the computer program 100 stored in the storage device 13. Various software functions are executed according to the above. The memory 12 is composed of a volatile memory such as SRAM or SDRAM, and a load module is expanded when the computer program 100 is executed, and stores temporary data generated when the computer program 100 is executed.

  The storage device 13 includes a built-in fixed storage device (hard disk), a volatile memory such as SRAM, and a nonvolatile memory such as ROM. The computer program 100 stored in the storage device 13 is downloaded by a portable disk drive 16 from a portable recording medium 90 such as a DVD or CD-ROM in which information such as programs and data is recorded. To the memory 12 and executed. Of course, a computer program downloaded from an external computer connected to the network 2 via the communication interface 17 may be used.

  The storage device 13 includes an electronic document file storage unit 131, an identification rule information storage unit 132, and a database storage unit 133. The electronic document file storage unit 131 stores an electronic document file that includes table data and serves as a basis for generating a new database.

  The identification rule information storage unit 132 stores a plurality of pieces of identification rule information, which is information related to rules for identifying item parts and data parts of table data. For example, it may be identification rule information for identifying an item portion and a data portion based on a hierarchy obtained by analyzing a ruled line structure or the like, or a pair of set data such as questionnaire data (the item portion and the data portion may be It may be identification rule information identified as a pair of data. The identification rule information storage unit 132 can store various identification rule information according to the format of the table data.

  The database storage unit 133 stores a database newly generated by merging table data included in a plurality of electronic document files.

  The communication interface 17 is connected to an internal bus 18 and can transmit and receive data to and from an external computer or the like by connecting to an external network 2 such as the Internet, LAN, or WAN. The electronic document file storage unit 131 is not limited to be provided in the storage device 13 of the database generation device 1 and may be scattered on the network 2 by being stored in a storage device of an external computer. .

  The I / O interface 14 is connected to a data input medium such as a keyboard 21 and a mouse 22 and receives data input. The video interface 15 is connected to a display device 23 such as a CRT monitor or LCD, and displays a predetermined image.

  FIG. 2 is a functional block diagram of the database generation device 1 according to the embodiment of the present invention. The electronic document file acquisition unit 201 acquires an electronic document file including one or more table data. The electronic document file may be read from the electronic document file stored in the electronic document file storage unit 131 of the storage device 13 or may be read from an external computer via the network 2. Further, input may be received via an input device such as a keyboard 21 and a mouse 22.

  The area designation accepting unit 202 accepts designation of a predetermined area of the acquired one or more electronic document files. This is to clearly indicate in which area of the electronic document file the item part and the data part are to be identified. The designation of the area is accepted by a drag operation using the mouse 22 or the like.

  The identification rule information selection accepting unit 203 accepts selection of one identification rule information from among a plurality of identification rule information stored in the identification rule information storage unit 132. The selection of identification rule information is accepted by a click operation with the mouse 22, a key-in operation with the keyboard 21, or the like.

  The identification rule information to be selected may be, for example, information related to a rule that recognizes a part having a hierarchy as an item part in table data and recognizes a part after the lowest hierarchy of the item part as a data part. However, it may be information relating to rules for recognizing a pair of set data in the table data. Moreover, the information regarding the rule for recognizing only the data string as table data may be sufficient.

  The identification unit 204 identifies the item part and the data part included in the area for which the designation has been received based on the identification rule information for which the selection has been accepted. The database generation unit 205 identifies a plurality of items and a data string corresponding to the items based on the plurality of identified item portions and data portions, and aggregates the plurality of items to generate a new database.

  Note that a hierarchy determination unit 206 that determines whether or not the table data has a hierarchy may be provided so that the identification rule information can be selected depending on whether or not the table data has a hierarchy. In this way, most table data can automatically identify the item portion and the data portion.

  FIG. 3 is a flowchart showing a database generation process procedure of the CPU 11 of the database generation apparatus 1 according to the embodiment of the present invention. In FIG. 3, the CPU 11 of the database generation apparatus 1 acquires an electronic document file including one or more table data (step S301). The electronic document file may be read from the electronic document file stored in the electronic document file storage unit 131 of the storage device 13 or may be read from an external computer via the network 2. Further, input may be received via an input device such as a keyboard 21 and a mouse 22.

  The CPU 11 accepts designation of a predetermined area to be identified between the item portion and the data portion in the acquired one or more electronic document files (step S302). Thereby, it can be clarified which area of the electronic document file the item part and the data part are identified. The designation of the area is accepted by a drag operation using the mouse 22 or the like.

  The CPU 11 accepts selection of one piece of identification rule information from among a plurality of pieces of identification rule information stored in the identification rule information storage unit 132 (step S303). The selection of identification rule information is accepted by a click operation with the mouse 22, a key-in operation with the keyboard 21, or the like.

  The user can identify the identification rule information according to whether the table data having a plurality of items is included in the area in which the designation is received, whether the pair data is included, whether only the data string is included, and the like. Select. Since it is possible to easily select the identification rule information adapted to the area for which the designation has been received, the possibility of erroneous identification can be eliminated, and the item portion and the data portion can be correctly identified.

  The CPU 11 identifies the item portion and the data portion included in the area for which the designation has been received based on the identification rule information for which the selection has been accepted (step S304), and specifies a data string corresponding to each item. The CPU 11 determines whether a generation instruction for generating a new database has been received (step S305). The database generation instruction includes information for specifying items to be aggregated. When the CPU 11 determines that the generation instruction has not been received (step S305: NO), the CPU 11 returns the process to step S302 and repeats the above-described process.

  When the CPU 11 determines that the generation instruction has been received (step S305: YES), the CPU 11 aggregates a plurality of items based on the plurality of identified item portions and data portions to generate a new database (step S305). S306), and stored in the database storage unit 133. A method for generating a new database is not particularly limited, and any method may be used as long as a known method for aggregating a plurality of table data is used.

  FIG. 4 is an exemplary diagram of a process for identifying the table data according to predetermined identification rule information. FIG. 4A is a specific example of the table data, and designation is accepted with the hatched table area 41 as the range of identification processing. The designation is accepted by a drag operation with the mouse 22.

  As the identification rule information, for example, a “table data” button is placed at any position on the screen in order to select information (first identification rule information) regarding a rule that is identified by analyzing the hierarchical structure of items. When a click operation with the mouse 22 or the like is received, it can be determined that selection of information regarding a rule that is identified by analyzing the hierarchical structure of the item is received. In this case, the part having the hierarchy in the table data is identified as the item part 42, and the part after the lowest hierarchy of the item part 42 is identified as the data part 43.

  Therefore, as shown in FIG. 4B, the item portion 42 is extracted with the items “NO”, “unit”, and “measurement result” as the upper hierarchy, and “minimum”, as the items in the lower hierarchy of the item “measurement result”. “Maximum”, “average”, and “standard deviation” are extracted.

  FIG. 5 is an exemplary diagram of a process of identifying questionnaire data according to predetermined identification rule information. FIG. 5A is a specific example of questionnaire format data, and designation is accepted with the hatched area 51 as the range of identification processing. The designation is accepted by a drag operation with the mouse 22.

  As in FIG. 4, in order to select information relating to rules for analyzing and identifying the hierarchical structure of items as table data, for example, a “table data” button is placed at any position on the screen, and the mouse 22 or the like is used. When the click operation is received, the portion having the hierarchy in the table data is identified as the item portion 52, and the portion after the lowest hierarchy of the item portion 52 is identified as the data portion 53.

  Therefore, as shown in FIG. 5B, the item “current address” is extracted as the upper hierarchy in the item portion 52, and “zip code” and “533-0000” are extracted as the lower hierarchy items of the item “current address”. . In this case, in the case of questionnaire format data, the first set data is erroneously identified as an item, and a correct database cannot be generated.

  Therefore, in the case of questionnaire format data, identification rule information corresponding to the questionnaire format data can be selected. FIG. 6 is an exemplary diagram of a process of identifying according to identification rule information corresponding to questionnaire format data.

  As shown in FIG. 6A, as in the case of table data, designation is accepted as a range of identification processing in a hatched area 61 including a questionnaire-format data portion. The designation is accepted by a drag operation with the mouse 22.

  As the identification rule information, unlike FIG. 4, in order to select information (second identification rule information) related to a rule for adding a single item at once, for example, a “single item batch addition” button is selected on the screen. If a click operation with the mouse 22 or the like is accepted, it can be determined that selection of information regarding a rule for adding a single item at a time is accepted. In this case, only the items are extracted regardless of the presence or absence of the hierarchical structure, and as shown in FIG. 6B, the hierarchy “postal code”, “address”, and “phone number” are the item parts below the hierarchy “current address”. 62, each of which is a pair of set data, that is, a set of “zip code” and “533-0000”, a set of “address” and “Higashiyodogawa-ku, Osaka City”, and “phone number” A set such as “06-6379-0000” is identified as the data portion 63.

  In addition to the two pieces of identification rule information described above, for example, only a numerical data string can be identified as tabular data depending on the setting of the identification rule information. FIG. 7 is an exemplary diagram of a process of identifying according to identification rule information corresponding to a data string of only numerical values.

  As shown in FIG. 7 (a), when a data string of only a plurality of rows and a plurality of columns is included, the item portion cannot be specified. However, depending on the application, there may be a case where it is effective to give meaning to the arrangement order of the data string of only numerical values. For example, when measuring the luminance value for each pixel on the LCD screen, it is necessary to detect the presence of defects and then calculate the average luminance value, etc. There is a risk.

  Therefore, as shown in FIG. 7B, by applying identification rule information that applies an item frame according to an application, a data string having only a numerical value can be given a numerical value for each pixel. Therefore, a simple numeric data string can be identified as a data string corresponding to a newly added item.

  As described above, according to the present embodiment, since selection of identification rule information adapted to an area for which designation has been accepted can be accepted, an electronic device having a data format in which it is difficult to distinguish between an item part and a data part Even in the case of a document file, the item portion and the data portion can be reliably identified, and a new database based on a plurality of table data can be easily generated.

  The present invention is not limited to the above-described embodiments, and various changes and improvements can be made within the scope of the present invention. For example, the identification rule information is not limited to the above-described identification rule information, and can be flexibly changed according to the usage status, the application to be used, and the like. Further, the operation through the screen image is not limited to the operation using the mouse 22, and the screen configuration and arrangement are not particularly limited as long as the same function can be secured.

It is a block diagram which shows the structural example of the database production | generation apparatus which concerns on embodiment of this invention. It is a functional block diagram of the database production | generation apparatus which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the database production | generation process of CPU of the database production | generation apparatus which concerns on embodiment of this invention. It is an illustration figure of the process which identifies table data according to predetermined identification rule information. It is an illustration figure of the process which identifies the data of a questionnaire format according to predetermined | prescribed identification rule information. It is an illustration figure of the process identified according to the identification rule information corresponding to the data of a questionnaire format. It is an illustration figure of the process identified according to the identification rule information corresponding to the data string only of a numerical value.

Explanation of symbols

1 Database generator 2 Network 11 CPU
12 memory 13 storage device 14 I / O interface 15 video interface 16 portable disk drive 17 communication interface 18 internal bus 23 display device 90 portable recording medium 100 computer program 131 electronic document file storage unit 132 identification rule information storage unit 133 database storage Part

Claims (6)

In a database generation device that generates a new database based on data extracted from one or a plurality of electronic document files including table data,
Electronic document file acquisition means for acquiring one or more electronic document files;
Area designation accepting means for accepting designation of a predetermined area of the acquired one or more electronic document files;
An identification rule information storage means for storing a plurality of identification rule information, which is information relating to a rule for identifying an item part and a data part included in an area that has received a designation;
Identification rule information selection receiving means for receiving selection of one identification rule information;
Identification means for identifying an item part and a data part included in the area that has received the designation based on the identification rule information that has received the selection;
A database generation device comprising: database generation means for generating a new database by aggregating a plurality of identified item portions and data portions. The identification rule information is
In the table data, the first identification rule information that is information about a rule that recognizes a part having a hierarchy as an item part, and recognizes a part after the lowest hierarchy of the item part as a data part;
The database generation apparatus according to claim 1, further comprising: at least second identification rule information that is information relating to a rule for recognizing a pair of set data in the table data. In a database generation method that can be executed by a database generation device that generates a new database based on data extracted from one or a plurality of electronic document files including table data,
Obtaining one or more electronic document files;
Accepting designation of a predetermined area of one or more acquired electronic document files,
Storing a plurality of identification rule information, which is information related to a rule for identifying an item part and a data part included in an area for which designation is accepted,
Accept selection of one identification rule information,
Based on the identification rule information that accepted the selection, identify the item part and the data part included in the area that received the designation,
A database generation method characterized in that a plurality of identified item parts and data parts are aggregated to generate a new database. The identification rule information is
In the table data, the first identification rule information that is information about a rule that recognizes a part having a hierarchy as an item part, and recognizes a part after the lowest hierarchy of the item part as a data part;
The database generation method according to claim 3, further comprising: at least second identification rule information that is information relating to a rule for recognizing a pair of set data in the table data. In a computer program that can be executed by a database generation device that generates a new database based on data extracted from one or more electronic document files including table data,
The database generation device;
Electronic document file acquisition means for acquiring one or more electronic document files;
Area designation accepting means for accepting designation of a predetermined area of the obtained one or more electronic document files;
An identification rule information storage means for storing a plurality of identification rule information, which is information relating to a rule for identifying an item part and a data part included in an area for which designation has been received,
Identification rule information selection receiving means for receiving selection of one identification rule information;
Based on the identification rule information for which selection has been accepted, identification means for identifying item parts and data parts included in the area for which designation has been accepted, and a plurality of identified item parts and data parts are aggregated to generate a new database A computer program that functions as a database generation unit that performs the processing. The identification rule information is
In the table data, the first identification rule information that is information about a rule that recognizes a part having a hierarchy as an item part, and recognizes a part after the lowest hierarchy of the item part as a data part;
The computer program according to claim 5, further comprising: at least second identification rule information that is information relating to a rule for recognizing a pair of set data in the table data.

Images