CN106776704B - Statistical information collection method and device - Google Patents
Statistical information collection method and device Download PDFInfo
- Publication number
- CN106776704B CN106776704B CN201611003385.2A CN201611003385A CN106776704B CN 106776704 B CN106776704 B CN 106776704B CN 201611003385 A CN201611003385 A CN 201611003385A CN 106776704 B CN106776704 B CN 106776704B
- Authority
- CN
- China
- Prior art keywords
- statistical information
- change operation
- change
- new
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a statistical information collection method and a statistical information collection device. The method comprises the following steps: acquiring a change operation record; analyzing the change operation record to obtain an operation type corresponding to the change operation record; acquiring a preset change operation corresponding to the operation type; and when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template. The statistical information collecting method and the statistical information collecting device refine the collecting mode of the statistical information and can effectively improve the accuracy of the collected statistical information.
Description
Technical Field
The invention relates to the technical field of databases, in particular to a statistical information collection method and a statistical information collection device.
Background
In the database, the statistical information mainly refers to a type of information for describing sizes and scales of tables and indexes in the database, data distribution conditions, and the like, for example, the number of rows of the tables, the number of blocks of the tables, the average size of each row, the number of root blocks of the indexes, the number of rows of the index fields, the maximum value and the minimum value of the indexes, and the like all belong to the statistical information. The database can calculate the cost of each execution plan under different access paths and join modes according to the collected statistical information, so as to determine the execution plan with the minimum cost, which is used for executing SQL (Structured Query Language) statements. The traditional statistical information collection mode generally uses a statistical information collection tool carried by a database for collection, and the collection mode is simpler, so that the collected statistical information may have inaccurate condition.
Disclosure of Invention
Accordingly, there is a need for a statistical information collecting method that can effectively improve the accuracy of the collected statistical information.
In addition, it is necessary to provide a statistical information collecting device which can effectively improve the accuracy of the collected statistical information.
A statistical information collection method, comprising:
acquiring a change operation record;
analyzing the change operation record to obtain an operation type corresponding to the change operation record;
acquiring a preset change operation corresponding to the operation type;
and when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template.
In one embodiment, the operation type comprises a table operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
when the change operation record with the operation type of table operation contains new table building operation, judging whether data initialization is carried out in the change operation record containing the new table building operation, and if so, collecting new statistical information of a data table corresponding to the new table building operation;
and/or
When the change operation record of the operation type is table operation and contains all row operations of a deletion table or online redefinition operation of a table structure, the old statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is backed up, and the new statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is collected.
In one embodiment, the operation type comprises a table operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
if the operation type is that the change operation record of the table operation contains the table structure change operation, judging whether the table structure change operation is a field change operation;
if the table structure changing operation is a field changing operation, backing up old statistical information of the data table corresponding to the field changing operation, and collecting new statistical information of the data table corresponding to the field changing operation;
if the table structure changing operation is a table partitioning operation, when the table partitioning operation is a newly added partitioning operation, collecting new statistical information of a partition associated with the newly added partitioning operation, when the table partitioning operation is a merged partitioning operation or a split partitioning operation, backing up old statistical information of a partition associated with the merged partitioning operation or the split partitioning operation, and collecting new statistical information of a partition associated with the merged partitioning operation or the split partitioning operation.
In one embodiment, after the step of acquiring a collection template matched with the preset change operation when the change operation record includes the preset change operation, and collecting new statistical information according to the collection template, the method further includes:
determining a DML object according to the change operation contained in the change operation record with the operation type being the table operation;
judging whether the number of DMLs belonging to the DML object reaches a preset value or not according to the file for recording the DML execution condition;
if the statistical information is up, judging whether to start the new statistical information according to a preset configuration item, if so, starting the collected new statistical information, and if not, recovering the backup old statistical information.
In one embodiment, the operation type comprises an index operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
if the operation type is that the change operation record of the index operation contains a newly-built index operation, collecting new statistical information of an index corresponding to the newly-built index operation;
and/or
If the operation type is that the change operation record of the index operation contains the index rebuilding operation, the old statistical information of the index corresponding to the index rebuilding operation is backed up, and the old statistical information is recovered after the new statistical information of the index corresponding to the index rebuilding operation is collected.
A statistical information collection apparatus comprising:
the record acquisition module is used for acquiring the change operation record;
the analysis module is used for analyzing the change operation record to obtain an operation type corresponding to the change operation record;
the operation obtaining module is used for obtaining preset changing operation corresponding to the operation type;
and the collecting module is used for acquiring a collecting template matched with the contained change operation when the change operation record contains the preset change operation, and collecting new statistical information according to the collecting template.
In one embodiment, the operation type comprises a table operation;
the collection module includes:
a new table creation collection unit, configured to, when the change operation record whose operation type is a table operation includes a new table creation operation, determine whether to perform data initialization in the change operation record including the new table creation operation, and if so, collect new statistics information of the data table corresponding to the new table creation operation;
and/or
And a table structure redefinition collecting unit, configured to, when the change operation record of the operation type is a table operation includes a table delete all-row operation or a table structure online redefinition operation, backup old statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation, and collect new statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation.
In one embodiment, the operation type comprises a table operation;
the collection module includes:
a table structure change collection unit, configured to determine whether the table structure change operation is a field change operation if the change operation record of which the operation type is a table operation includes the table structure change operation; if the table structure changing operation is a field changing operation, backing up old statistical information of the data table corresponding to the field changing operation, and collecting new statistical information of the data table corresponding to the field changing operation; if the table structure changing operation is a table partitioning operation, when the table partitioning operation is a newly added partitioning operation, collecting new statistical information of a partition associated with the newly added partitioning operation, when the table partitioning operation is a merged partitioning operation or a split partitioning operation, backing up old statistical information of a partition associated with the merged partitioning operation or the split partitioning operation, and collecting new statistical information of a partition associated with the merged partitioning operation or the split partitioning operation.
In one embodiment, the apparatus further comprises:
the determining module is used for determining the DML object according to the change operation contained in the change operation record of which the operation type is the table operation;
the judging module is used for judging whether the number of the DML belonging to the DML object reaches a preset numerical value or not according to the file for recording the DML execution condition;
and the starting module is used for judging whether to start the new statistical information or not according to a preset configuration item if the number of the DML which belongs to the DML object in the database change operation data reaches the preset value, starting the collected new statistical information if the number of the DML reaches the preset value, and restoring the backup old statistical information if the number of the DML reaches the preset value.
In one embodiment, the operation type comprises an index operation;
the collection module includes:
a newly-built index collecting unit, configured to collect new statistics information of an index corresponding to a newly-built index operation if the operation type is that a change operation record of the index operation includes the newly-built index operation;
and/or
And if the operation type is that the change operation record of the index operation contains the rebuilt index operation, the rebuilt index collection unit is used for backing up old statistical information of the index corresponding to the rebuilt index operation, and recovering the old statistical information after collecting new statistical information of the index corresponding to the rebuilt index operation.
According to the statistical information collection method and device, the operation type corresponding to the change operation record is obtained by analyzing the obtained change operation record, when the change operation record contains the preset change operation corresponding to the operation type, the new statistical information is collected according to the collection template matched with the contained change operation, and for different change operations corresponding to different operation types, the new statistical information can be collected according to different matched collection templates, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved. In addition, a database administrator can make different collection templates for different change operations according to different business requirements for collection, and flexibility in making a statistical information collection mode is improved.
Drawings
FIG. 1 is a schematic diagram of an internal structure of a server according to an embodiment;
FIG. 2 is a flow diagram illustrating a method for statistical information collection in one embodiment;
FIG. 3 is a flowchart illustrating an embodiment of acquiring a collection template matching a change operation included in a change operation record when the change operation record includes a preset change operation, and collecting new statistics according to the collection template;
FIG. 4 is a flowchart illustrating another embodiment of acquiring a collection template matching a change operation when the change operation record includes a preset change operation, and collecting new statistical information according to the collection template;
FIG. 5 is a flow diagram that illustrates the determination of whether to enable new statistics, under an embodiment;
FIG. 6 is a flowchart illustrating a process of acquiring a collection template matching a change operation included in a record of the change operation and collecting new statistical information according to the collection template in another embodiment when the record of the change operation includes a preset change operation;
FIG. 7 is a schematic diagram of an embodiment of a statistical information collecting apparatus;
FIG. 8 is a schematic diagram of the internal structure of the collection module in one embodiment;
FIG. 9 is a schematic structural diagram of a statistical information collecting apparatus according to another embodiment;
fig. 10 is a schematic view of the internal structure of a collection module in another embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Fig. 1 is a schematic diagram of an internal structure of a server in one embodiment. As shown in fig. 1, the server includes a processor, a non-volatile storage medium, an internal memory, and a network interface connected through a system bus. The server comprises a nonvolatile storage medium, an operating system, a database and a statistical information collecting device, wherein the database stores database statistical information, and the statistical information collecting device is used for realizing a statistical information collecting method suitable for the server. The processor of the server is used for providing calculation and control capacity and supporting the operation of the whole server. The internal memory of the server provides an environment for the operation of the statistical information collecting device in the non-volatile storage medium, and the internal memory may store computer readable instructions, which when executed by the processor, may cause the processor to execute the statistical information collecting method. The network interface of the server is used for communicating with an external terminal through a network connection, such as receiving a data query request sent by the terminal. The server may be implemented as a stand-alone server or as a server cluster consisting of a plurality of servers. Those skilled in the art will appreciate that the architecture shown in fig. 1 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the servers to which the subject application applies, as a particular server may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
As shown in fig. 2, there is provided a statistical information collecting method including the steps of:
in step S210, a change operation record is acquired.
Specifically, the change operation record is used for recording each change operation in the database, and the change operation refers to an operation that can change the statistical information of the database, for example, a new table operation, a new index operation, a new partition operation, and the like all belong to the change operation in the database. The change operation record includes information such as an executed SQL statement, operation time, an operation data table, and a user.
Before the step S210 acquires the change operation record, the method further includes: and acquiring the database change operation data according to a preset acquisition mode.
Specifically, the server may collect database change operation data from a log file of the database according to a preset collection manner, where the database change operation data includes one or more change operation records. For example, the database change operation data may be collected from the log file at preset time intervals, or the database change operation data of the data table, index, etc. associated with the user identifier in the user list in the log file may be collected according to the user list, but is not limited thereto.
Step S220, analyzing the change operation record to obtain an operation type corresponding to the change operation record.
Specifically, the change operation record may be obtained from the collected database change operation data, the change operation record is analyzed, and the operation type corresponding to the change operation record is determined according to the preset character string, where the operation type may include table operation, index operation, and the like, for example, whether a "table" character string is included in the change operation record may be detected, if so, the table operation may be considered, whether an "index" character string is included in the change operation record may be detected, and if so, the index operation may be considered, and the like, but is not limited thereto.
In step S230, a preset change operation corresponding to the operation type is obtained.
Specifically, the modification operations corresponding to different operation types may be preset, for example, the operation type is a table operation, the preset modification operations corresponding to the operation type may include a table creation operation, a table deletion operation, a table structure online redefinition operation, a field modification operation, and the like, the operation type is an index operation, and the preset modification operations corresponding to the operation type may include an index creation operation, an index reconstruction operation, and the like.
Step S240, when the change operation record includes a preset change operation, acquiring a collection template matching the included change operation, and collecting new statistical information according to the collection template.
Specifically, the preset change operation corresponding to the operation type of the change operation record can be acquired, whether the change operation record contains the preset change operation corresponding to the operation type is detected, different change operations can correspond to different collection templates, each collection template sets a set of specific rule flow for collecting statistical information, and the related data table or the indexed new statistical information of the database after the change operation is executed can be collected according to the collection template matched with the change operation contained in the change operation record. The database administrator can preset statistical information collecting templates matched with different change operations, and can flexibly set different statistical information collecting modes after the database executes each change operation. In other embodiments, the server may further establish a plurality of collection threads, so that each collection thread collects new statistical information according to a collection template matched with the change operation included in the change operation record, and may collect statistical information in a parallel processing manner, thereby improving collection efficiency.
According to the statistical information collection method, the operation type corresponding to the change operation record is obtained by analyzing the obtained change operation record, when the change operation record contains the preset change operation corresponding to the operation type, the new statistical information is collected according to the collection template matched with the contained change operation, and for different change operations corresponding to different operation types, the new statistical information can be collected according to different matched collection templates, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved. In addition, a database administrator can make different collection templates for different change operations according to different business requirements for collection, and flexibility in making a statistical information collection mode is improved.
As shown in fig. 3, in an embodiment, when the change operation record includes a preset change operation, the step S240 obtains a collection template matching the included change operation, and collects new statistical information according to the collection template, and may include the following steps:
step S302, when the change operation record whose operation type is table operation includes new table creation operation, determining whether data initialization is performed in the change operation record including the new table creation operation, if so, performing step S304, and if not, performing step S306.
Specifically, the preset change operation corresponding to the operation type being the table operation may include a new table operation. The new table creating operation is to create a new data table in the database, and may detect whether the new table creating operation is included in the change operation record according to an SQL statement executed in the change operation record whose operation type is the table operation, and if so, further determine whether to perform data initialization after the new table creating operation is executed, where the data initialization is mainly used to initialize each parameter of the new table, and may include the size of the table, the user to which the table belongs, and the foreign key relationship.
Step S304, collecting new statistical information of the data table corresponding to the new table operation.
Specifically, if data initialization is performed after the new list creation operation is performed, it is described that various parameters of the new data list are set, and Cascade deletion (Cascade deletion) may be used to collect new statistical information of the new data list, specifically, the line number, the block number, the size of each average line, and the like of the new data list, and the Cascade deletion may be used to collect new statistical information, that is, statistical information of columns, lines, indexes, and the like in the data list is collected.
In step S306, no processing is performed.
In one embodiment, when the change operation record includes a preset change operation, the step S240 obtains a collection template matching the included change operation, and collects new statistical information according to the collection template, which may include: when the change operation record of the operation type is table operation, the old statistical information of the data table associated with the table all-row operation or the table structure online redefinition operation is backed up, and the new statistical information of the data table associated with the table all-row operation or the table structure online redefinition operation is collected.
Specifically, the predetermined change operation corresponding to the operation type being the table operation may include a delete all-row operation of the table and an online redefinition operation of the table structure. Deleting all rows of the table (truncate table) operation, that is, deleting all record data in the data table quickly, but keeping the structure of the data table. The table structure mainly refers to basic attributes such as fields, types, primary keys, foreign keys and the like in the data table, and the online redefinition of the table structure refers to that a database user is not influenced in the process of redefining the table structure, and the database user can still perform operations such as access, addition, modification, deletion and the like. The method can detect whether the change operation record contains all row operations of a deletion table or online redefinition operation of a table structure according to SQL sentences executed in the change operation record with the operation type being the table operation, if so, the old statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is backed up, namely the statistical information of the data table before all row operations of the deletion table or online redefinition operation of the table structure are backed up and stored, and when the old statistical information needs to be used, the old statistical information can be directly called. After the backup is completed, the Cascade can be used to collect new statistics of the associated database after performing delete table all row operations or list structure online redefinition operations.
In the embodiment, different statistical information collection modes are provided for different change operations corresponding to the table operation as the operation type, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved.
As shown in fig. 4, in an embodiment, when the change operation record includes a preset change operation, the step S240 obtains a collection template matching the included change operation, and collects new statistical information according to the collection template, and may include the following steps:
in step S402, if the operation type is that the change operation record of the table operation includes the table structure change operation, it is determined whether the table structure change operation is a field change operation, if so, step S404 is performed, and if not, step S406 is performed.
Specifically, the preset change operation corresponding to the operation type being the table operation may include a table structure change operation. The table structure change operation refers to operations such as adding, deleting and modifying a table structure, and can detect whether the table structure change operation is included in a change operation record according to an SQL statement executed in the change operation record of which the operation type is the table operation, and if the table structure change operation is included in the change operation record, can further detect whether the included table structure change operation is a field change operation, and the field change operation can include adding, deleting, modifying and the like a field.
Step S404, backups the old statistical information of the data table corresponding to the field change operation, and collects the new statistical information of the data table corresponding to the field change operation.
Specifically, if the table structure change operation included in the change operation record is a field change operation, the data table corresponding to the field change operation can be backed up, old statistical information before the field change operation is performed can be backed up, and new statistical information after the field change operation is performed can be collected using Cascade.
Step S406, if the table structure changing operation is a table partitioning operation, determining whether the table partitioning operation is a new partition operation, if so, performing step S408, and if not, performing step S410.
Specifically, if the table structure change operation included in the change operation record is not a field change operation, it may be further detected whether the included table structure change operation is a table partition operation, where the table partition operation may include operations of newly adding a partition, merging partitions, deleting partitions, converting a partition table into a general table, and converting the general table into a partition table.
Step S408, collecting new statistical information of the partition associated with the operation of the newly added partition.
Specifically, the data table may include a plurality of partitions, each partition may further include a plurality of data blocks, and when the table partition operation included in the change operation record is an additional partition operation, new statistics information of the newly added partition is collected, which may include information such as the number of rows, the number of blocks, and the average size of each row of the newly added partition.
Step S410, determining whether the table partitioning operation is a merge partitioning operation or a split partitioning operation, if yes, performing step S412, and if not, performing step S414.
Step S412, backups old statistical information of the partition associated with the merge partition operation or the split partition operation, and collects new statistical information of the partition associated with the merge partition operation or the split partition operation.
Specifically, if the table partitioning operation included in the change operation record is a merge partitioning operation or a split partitioning operation, the partition associated with the merge partitioning operation or the split partitioning operation may be backed up and stored, the old statistical information before the merge partitioning operation or the split partitioning operation is performed may be collected, and then the new statistical information after the merge partitioning operation or the split partitioning operation is performed may be collected.
In step S414, no processing is performed.
In the embodiment, different statistical information collection modes are provided for different table structure change operations, so that the statistical information collection mode of the partition table is optimized, the statistical information collection mode is greatly refined, and the accuracy of the collected statistical information can be effectively improved.
As shown in fig. 5, in an embodiment, when the change operation record includes a preset change operation in step S240, after acquiring a collection template matching the included change operation and collecting new statistical information according to the collection template, the method further includes the following steps:
step S502, determining the DML object according to the change operation contained in the change operation record with the operation type being the table operation.
Specifically, DML (Data management Language) is one of SQL categories, and mainly includes four syntaxes, i.e., select, update, insert, and delete. The server can acquire the execution amount of the DML according to the DML object corresponding to the change operation included in the change operation record with the operation type being the table operation, thereby determining the data change amount of the DML object. For example, if the change operation is a field change operation, the corresponding DML object is a field change DML in the data table corresponding to the field change operation, if the change operation is a shrink table operation, the corresponding DML object is all the executing DMLs of the database system file, and if the change operation does not belong to a new table operation or a table structure change operation, the corresponding DML object is all the executing DMLs of the database working file.
Step S504, determining whether the number of DMLs belonging to the DML object reaches a preset value according to the file recording the DML execution condition, if yes, performing step S508, and if no, performing step S506.
Specifically, after determining the DML object corresponding to the change operation included in the change operation record whose operation type is the table operation, the number of DMLs belonging to the DML object may be obtained from the file recording the DML execution condition, and when the number of DMLs belonging to the DML object reaches a preset value, it may be determined whether to enable the collected new statistical information. For example, the change operation record includes a field change operation, and the corresponding DML object is a field change DML in the data table corresponding to the field change operation, so that the number of field change DMLs in the data table corresponding to the field change operation within a preset time can be obtained from the file recording the DML execution condition, and whether the number reaches 10% is determined, where the preset time is consistent with the preset time for collecting the data of the database change operation.
In other embodiments, when the change operation record does not include the preset change operation corresponding to the operation type, whether to collect the statistical information may be determined according to the number of executed DMLs, and according to the recorded executed DMLs, the data change condition of the data table may be determined, so as to provide a useful data basis for collecting and updating the statistical information.
In step S506, no processing is performed.
Step S508, determining whether to enable new statistical information according to the preset configuration item, if yes, performing step S510, and if no, performing step S512.
Specifically, the preset configuration items may include a database version number, a memory parameter, a Central Processing Unit (CPU) parameter, an input/output (I/O) load condition, and the like, and influence analysis may be performed according to the preset configuration items to determine whether the new statistical information will affect the performance of the database, and if the influence analysis is performed, the new statistical information may be enabled, and if the influence analysis is performed, the new statistical information may be obtained, the new statistical information may not be enabled, and the backup old statistical information may be imported, so that the database still uses the old statistical information to calculate and determine the SQL execution plan.
Step S510, enabling the collected new statistical information.
And step S512, recovering the backup old statistical information.
In this embodiment, influence analysis may be performed according to a preset configuration item, and whether to enable new statistics information is determined, so that influence of the new statistics information on the performance of the entire database is reduced, and the stability of the database can be effectively ensured.
As shown in fig. 6, in an embodiment, when the change operation record includes a preset change operation, step S240 obtains a collection template matching the included change operation, and collects new statistical information according to the collection template, including step S602 and/or step S604.
In step S602, if the change operation record with the operation type of the index operation includes a new index operation, new statistics information of an index corresponding to the new index operation is collected.
Specifically, an index is a structure that sorts one or more columns of values in a database table, and specific information in the database table can be quickly accessed by using the index. The predetermined change operation corresponding to the operation type being the index operation may include a new index operation. The new index operation, that is, creating a new index in the data table, may detect whether the new index operation is included in the change operation record according to the SQL statement executed in the change operation record whose operation type is the index operation, and if so, may collect new statistics information of the new index, which may specifically include the number of root blocks of the new index, the number of rows of the index field, and the maximum and minimum values of the index.
In step S604, if the change operation record of the index operation includes the rebuilt index operation, the old statistical information of the index corresponding to the rebuilt index operation is backed up, and the old statistical information is recovered after the new statistical information of the index corresponding to the rebuilt index operation is collected.
Specifically, the preset change operation corresponding to the operation type being the index operation may include a rebuild index operation, and when a structure of one index is deviated and inclined, thereby causing a waste of space when performing data query, the rebuild index operation may be performed to rebuild the index. The difference between the rebuilt index operation and the newly create index operation is that the rebuilt index operation is rebuilt (rebuilt) based on the original index, and the newly create index operation is to directly create (create) a new index. The method can detect whether the change operation record contains the index rebuilding operation according to the SQL sentences executed in the change operation record with the operation type being the index operation, if so, the old statistical information of the index needing to be rebuilt before the index rebuilding operation is executed can be backed up, the new statistical information of the rebuilt index is collected, and after the new statistical information is backed up, the old statistical information backed up before can be imported, so that the stability of the index after rebuilding can be ensured.
In the embodiment, different statistical information collection modes are provided for different change operations corresponding to the index operation as the operation type, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved.
As shown in fig. 7, a statistical information collecting apparatus is provided, which includes a record obtaining module 710, an analyzing module 720, an operation obtaining module 730, and a collecting module 740.
And a record obtaining module 710, configured to obtain a change operation record.
Specifically, the change operation record is used for recording each change operation in the database, and the change operation refers to an operation that can change the statistical information of the database, for example, a new table operation, a new index operation, a new partition operation, and the like all belong to the change operation in the database. The change operation record includes information such as an executed SQL statement, operation time, an operation data table, and a user.
The record obtaining module 710 is further configured to collect database change operation data according to a preset collection manner.
Specifically, the server may collect database change operation data from a log file of the database according to a preset collection manner, where the database change operation data includes one or more change operation records. For example, the database change operation data may be collected from the log file at preset time intervals, or the database change operation data of the data table, index, etc. associated with the user identifier in the user list in the log file may be collected according to the user list, but is not limited thereto.
And the analysis module 720 is configured to analyze the change operation record to obtain an operation type corresponding to the change operation record.
Specifically, the change operation record may be obtained from the collected database change operation data, the change operation record is analyzed, and the operation type corresponding to the change operation record is determined according to the preset character string, where the operation type may include table operation, index operation, and the like, for example, whether a "table" character string is included in the change operation record may be detected, if so, the table operation may be considered, whether an "index" character string is included in the change operation record may be detected, and if so, the index operation may be considered, and the like, but is not limited thereto.
The operation obtaining module 730 is configured to obtain a preset change operation corresponding to the operation type.
Specifically, the modification operations corresponding to different operation types may be preset, for example, the operation type is a table operation, the preset modification operations corresponding to the operation type may include a table creation operation, a table deletion operation, a table structure online redefinition operation, a field modification operation, and the like, the operation type is an index operation, and the preset modification operations corresponding to the operation type may include an index creation operation, an index reconstruction operation, and the like.
And the collecting module 740 is configured to, when the change operation record includes the preset change operation, obtain a collecting template matched with the included change operation, and collect new statistical information according to the collecting template.
Specifically, the preset change operation corresponding to the operation type of the change operation record can be acquired, whether the change operation record contains the preset change operation corresponding to the operation type is detected, different change operations can correspond to different collection templates, each collection template sets a set of specific rule flow for collecting statistical information, and the related data table or the indexed new statistical information of the database after the change operation is executed can be collected according to the collection template matched with the change operation contained in the change operation record. The database administrator can preset statistical information collecting templates matched with different change operations, and can flexibly set different statistical information collecting modes after the database executes each change operation. In other embodiments, the server may further establish a plurality of collection threads, so that each collection thread collects new statistical information according to a collection template matched with the change operation included in the change operation record, and may collect statistical information in a parallel processing manner, thereby improving collection efficiency.
According to the statistical information collecting device, the operation type corresponding to the change operation record is obtained by analyzing the obtained change operation record, when the change operation record contains the preset change operation corresponding to the operation type, the new statistical information is collected according to the collection template matched with the contained change operation, and for different change operations corresponding to different operation types, the new statistical information can be collected according to different matched collection templates, so that the statistical information collecting mode is refined, and the accuracy of the collected statistical information can be effectively improved. In addition, a database administrator can make different collection templates for different change operations according to different business requirements for collection, and flexibility in making a statistical information collection mode is improved.
As shown in fig. 8, in one embodiment, the collection module 740 includes a newly created table collection unit 742 and/or an isomorphic redefinition collection unit 744 and/or a table structure change collection unit 746.
And a new table collection sheet 742 for, when the change operation record whose operation type is table operation includes a new table operation, determining whether data initialization is performed in the change operation record including the new table operation, and if so, collecting new statistics information of the data table corresponding to the new table operation.
Specifically, the preset change operation corresponding to the operation type being the table operation may include a new table operation. The new table creating operation is to create a new data table in the database, and may detect whether the new table creating operation is included in the change operation record according to an SQL statement executed in the change operation record whose operation type is the table operation, and if so, further determine whether to perform data initialization after the new table creating operation is executed, where the data initialization is mainly used to initialize each parameter of the new table, and may include the size of the table, the user to which the table belongs, and the foreign key relationship. If data initialization is performed after the new list creation operation is performed, it is described that various parameters of the new data list are set, new statistical information of the new data list can be collected by using the Cascade, specifically, the number of rows, the number of blocks, the size of each average row, and the like of the new data list can be included, and the statistical information of columns, rows, indexes, and the like in the data list can be collected by collecting the new statistical information by using the Cascade.
A table structure redefinition collecting unit 744 for backing up old statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation when the change operation record of which the operation type is the table operation contains the table delete all-row operation or the table structure online redefinition operation, and collecting new statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation.
Specifically, the predetermined change operation corresponding to the operation type being the table operation may include a delete all-row operation of the table and an online redefinition operation of the table structure. Deleting all rows of the table (truncate table) operation, that is, deleting all record data in the data table quickly, but keeping the structure of the data table. The table structure mainly refers to basic attributes such as fields, types, primary keys, foreign keys and the like in the data table, and the online redefinition of the table structure refers to that a database user is not influenced in the process of redefining the table structure, and the database user can still perform operations such as access, addition, modification, deletion and the like. The method can detect whether the change operation record contains all row operations of a deletion table or online redefinition operation of a table structure according to SQL sentences executed in the change operation record with the operation type being the table operation, if so, the old statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is backed up, namely the statistical information of the data table before all row operations of the deletion table or online redefinition operation of the table structure are backed up and stored, and when the old statistical information needs to be used, the old statistical information can be directly called. After the backup is completed, the Cascade can be used to collect new statistics of the associated database after performing delete table all row operations or list structure online redefinition operations.
A table structure change collection unit 746 configured to determine whether the table structure change operation is a field change operation if the change operation record whose operation type is the table operation includes the table structure change operation; if the table structure change operation is a field change operation, backing up old statistical information of the data table corresponding to the field change operation, and collecting new statistical information of the data table corresponding to the field change operation; if the table structure changing operation is a table partitioning operation, when the table partitioning operation is a newly added partitioning operation, collecting new statistical information of a partition associated with the newly added partitioning operation, when the table partitioning operation is a merged partitioning operation or a split partitioning operation, backing up old statistical information of a partition associated with the merged partitioning operation or the split partitioning operation, and collecting new statistical information of a partition associated with the merged partitioning operation or the split partitioning operation.
Specifically, the preset change operation corresponding to the operation type being the table operation may include a table structure change operation. The table structure change operation refers to operations such as adding, deleting and modifying a table structure, and can detect whether the table structure change operation is included in a change operation record according to an SQL statement executed in the change operation record of which the operation type is the table operation, and if the table structure change operation is included in the change operation record, can further detect whether the included table structure change operation is a field change operation, and the field change operation can include adding, deleting, modifying and the like a field.
If the table structure change operation included in the change operation record is a field change operation, the data table corresponding to the field change operation can be backed up, old statistical information before the field change operation is executed can be backed up, and new statistical information after the field change operation is executed can be collected by using the Cascade.
If the table structure change operation contained in the change operation record is not a field change operation, whether the contained table structure change operation is a table partition operation can be further detected, and the table partition operation can include operations of newly adding partitions, merging partitions, deleting partitions, converting a partition table into a common table, converting the common table into a partition table and the like. The data table may include a plurality of partitions, each partition may further include a plurality of data blocks, and when the table partition operation included in the change operation record is an additional partition operation, new statistics information of the newly added partition is collected, which may include information such as the number of rows, the number of blocks, and the average size of each row of the newly added partition. If the table partitioning operation included in the change operation record is a merge partitioning operation or a split partitioning operation, the partition associated with the merge partitioning operation or the split partitioning operation can be backed up and stored, the old statistical information before the merge partitioning operation or the split partitioning operation is executed is collected, and the new statistical information after the merge partitioning operation or the split partitioning operation is executed is collected, so that the statistical information collection mode of the partition table is optimized.
In the embodiment, different statistical information collection modes are provided for different change operations corresponding to the table operation as the operation type, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved.
As shown in fig. 9, in one embodiment, the statistical information collecting apparatus further includes a determining module 750, a determining module 760 and an enabling module 770 in addition to the record obtaining module 710, the analyzing module 720, the operation obtaining module 730 and the collecting module 740.
The determining module 750 is configured to determine the DML object according to the change operation included in the change operation record of the table operation, where the operation type is the table operation.
Specifically, DML is one of SQL classifications, which mainly includes four syntaxes, i.e., select, update, insert, and delete. The server can acquire the execution amount of the DML according to the DML object corresponding to the change operation included in the change operation record with the operation type being the table operation, thereby determining the data change amount of the DML object. For example, if the change operation is a field change operation, the corresponding DML object is a field change DML in the data table corresponding to the field change operation, if the change operation is a shrink table operation, the corresponding DML object is all the executing DMLs of the database system file, and if the change operation does not belong to a new table operation or a table structure change operation, the corresponding DML object is all the executing DMLs of the database working file.
The determining module 760 is configured to determine whether the number of DMLs belonging to the DML object reaches a preset value according to the file for recording the DML execution condition.
Specifically, after determining the DML object corresponding to the change operation included in the change operation record whose operation type is the table operation, the number of DMLs belonging to the DML object may be obtained from the file recording the DML execution condition, and when the number of DMLs belonging to the DML object reaches a preset value, it may be determined whether to enable the collected new statistical information. For example, the change operation record includes a field change operation, and the corresponding DML object is a field change DML in the data table corresponding to the field change operation, so that the number of field change DMLs in the data table corresponding to the field change operation within a preset time can be obtained from the file recording the DML execution condition, and whether the number reaches 10% is determined, where the preset time is consistent with the preset time for collecting the data of the database change operation.
In other embodiments, when the change operation record does not include the preset change operation corresponding to the operation type, whether to collect the statistical information may be determined according to the number of executed DMLs, and according to the recorded executed DMLs, the data change condition of the data table may be determined, so as to provide a useful data basis for collecting and updating the statistical information.
An enabling module 770, configured to determine whether to enable new statistical information according to a preset configuration item if the number of DMLs belonging to the DML object in the database change operation data reaches the preset value, enable the collected new statistical information if the new statistical information is enabled, and restore the backed-up old statistical information if the new statistical information is not enabled.
Specifically, the preset configuration items may include a database version number, a memory parameter, a CPU parameter, an I/O load condition, and the like, and influence analysis may be performed according to the preset configuration items to determine whether the new statistical information may affect the performance of the database, if the influence analysis is performed, the new statistical information may be enabled, if the influence of the new statistical information obtained after the influence analysis on the performance of the database is small, the new statistical information may not be enabled, and if the influence of the new statistical information obtained after the influence analysis on the performance of the database is large, the backup old statistical information may be imported, so that the database still uses the old statistical information to calculate and determine the SQL execution plan.
In this embodiment, influence analysis may be performed according to a preset configuration item, and whether to enable new statistics information is determined, so that influence of the new statistics information on the performance of the entire database is reduced, and the stability of the database can be effectively ensured.
As shown in FIG. 10, in one embodiment, the collection module 740 includes a new index collection unit 741 and/or a rebuilt index collection unit 743.
The new index collection unit 741 is configured to collect new statistics information of an index corresponding to a new index operation if the new index operation is included in the change operation record of which the operation type is the index operation.
Specifically, an index is a structure that sorts one or more columns of values in a database table, and specific information in the database table can be quickly accessed by using the index. The predetermined change operation corresponding to the operation type being the index operation may include a new index operation. The new index operation, that is, creating a new index in the data table, may detect whether the new index operation is included in the change operation record according to the SQL statement executed in the change operation record whose operation type is the index operation, and if so, may collect new statistics information of the new index, which may specifically include the number of root blocks of the new index, the number of rows of the index field, and the maximum and minimum values of the index.
The rebuilt index collecting unit 743 is configured to, if the operation type is that the change operation record of the index operation includes the rebuilt index operation, backup old statistical information of the index corresponding to the rebuilt index operation, and recover the old statistical information after collecting new statistical information of the index corresponding to the rebuilt index operation.
Specifically, the preset change operation corresponding to the operation type being the index operation may include a rebuild index operation, and when a structure of one index is deviated and inclined, thereby causing a waste of space when performing data query, the rebuild index operation may be performed to rebuild the index. The difference between the rebuilt index operation and the newly create index operation is that the rebuilt index operation is rebuilt (rebuilt) based on the original index, and the newly create index operation is to directly create (create) a new index. The method can detect whether the change operation record contains the index rebuilding operation according to the SQL sentences executed in the change operation record with the operation type being the index operation, if so, the old statistical information of the index needing to be rebuilt before the index rebuilding operation is executed can be backed up, the new statistical information of the rebuilt index is collected, and after the new statistical information is backed up, the old statistical information backed up before can be imported, so that the stability of the index after rebuilding can be ensured.
In the embodiment, different statistical information collection modes are provided for different change operations corresponding to the index operation as the operation type, so that the statistical information collection mode is refined, and the accuracy of the collected statistical information can be effectively improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), or the like.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A statistical information collection method, comprising:
acquiring a change operation record, wherein the change operation record is used for recording each change operation in a database;
analyzing the change operation record to obtain an operation type corresponding to the change operation record;
acquiring a preset change operation corresponding to the operation type;
and when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the collection template is a statistical information collection template which is preset and matched with different change operations, and each collection template sets a specific rule flow for collecting statistical information.
2. The statistical information collection method of claim 1, wherein the operation type comprises a table operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
when the change operation record with the operation type of table operation contains new table building operation, judging whether data initialization is carried out in the change operation record containing the new table building operation, and if so, collecting new statistical information of a data table corresponding to the new table building operation;
and/or
When the change operation record of the operation type is table operation and contains all row operations of a deletion table or online redefinition operation of a table structure, the old statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is backed up, and the new statistical information of the data table related to all row operations of the deletion table or online redefinition operation of the table structure is collected.
3. The statistical information collection method according to claim 1 or 2, wherein the operation type includes a table operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
if the operation type is that the change operation record of the table operation contains the table structure change operation, judging whether the table structure change operation is a field change operation;
if the table structure changing operation is a field changing operation, backing up old statistical information of the data table corresponding to the field changing operation, and collecting new statistical information of the data table corresponding to the field changing operation;
if the table structure changing operation is a table partitioning operation, when the table partitioning operation is a newly added partitioning operation, collecting new statistical information of a partition associated with the newly added partitioning operation, when the table partitioning operation is a merged partitioning operation or a split partitioning operation, backing up old statistical information of a partition associated with the merged partitioning operation or the split partitioning operation, and collecting new statistical information of a partition associated with the merged partitioning operation or the split partitioning operation.
4. The statistical information collecting method according to claim 3, wherein after the step of acquiring a collecting template matching the included change operation when the preset change operation is included in the change operation record, and collecting new statistical information according to the collecting template, the method further comprises:
determining a DML object according to the change operation contained in the change operation record with the operation type being the table operation;
judging whether the number of DMLs belonging to the DML object reaches a preset value or not according to the file for recording the DML execution condition;
if the statistical information is up, judging whether to start the new statistical information according to a preset configuration item, if so, starting the collected new statistical information, and if not, recovering the backup old statistical information.
5. The statistical information collection method according to claim 1, wherein the operation type includes an indexing operation;
when the change operation record contains the preset change operation, acquiring a collection template matched with the contained change operation, and collecting new statistical information according to the collection template, wherein the method comprises the following steps:
if the operation type is that the change operation record of the index operation contains a newly-built index operation, collecting new statistical information of an index corresponding to the newly-built index operation;
and/or
If the operation type is that the change operation record of the index operation contains the index rebuilding operation, the old statistical information of the index corresponding to the index rebuilding operation is backed up, and the old statistical information is recovered after the new statistical information of the index corresponding to the index rebuilding operation is collected.
6. A statistical information collection apparatus, comprising:
the record acquisition module is used for acquiring a change operation record, and the change operation record is used for recording each change operation in the database;
the analysis module is used for analyzing the change operation record to obtain an operation type corresponding to the change operation record;
the operation obtaining module is used for obtaining preset changing operation corresponding to the operation type;
and the collecting module is used for obtaining a collecting template matched with the contained change operation when the change operation record contains the preset change operation, and collecting new statistical information according to the collecting template, wherein the collecting template is a statistical information collecting template which is preset and matched with different change operations, and each set of the collecting template sets a set of specific rule flow for collecting the statistical information.
7. The statistical information collection device according to claim 6, wherein the operation type includes a table operation;
the collection module includes:
a new table creation collection unit, configured to, when the change operation record whose operation type is a table operation includes a new table creation operation, determine whether to perform data initialization in the change operation record including the new table creation operation, and if so, collect new statistics information of the data table corresponding to the new table creation operation;
and/or
And a table structure redefinition collecting unit, configured to, when the change operation record of the operation type is a table operation includes a table delete all-row operation or a table structure online redefinition operation, backup old statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation, and collect new statistical information of the data table associated with the table delete all-row operation or the table structure online redefinition operation.
8. The apparatus according to claim 6 or 7, wherein the operation type includes a table operation;
the collection module includes:
a table structure change collection unit, configured to determine whether the table structure change operation is a field change operation if the change operation record of which the operation type is a table operation includes the table structure change operation; if the table structure changing operation is a field changing operation, backing up old statistical information of the data table corresponding to the field changing operation, and collecting new statistical information of the data table corresponding to the field changing operation; if the table structure changing operation is a table partitioning operation, when the table partitioning operation is a newly added partitioning operation, collecting new statistical information of a partition associated with the newly added partitioning operation, when the table partitioning operation is a merged partitioning operation or a split partitioning operation, backing up old statistical information of a partition associated with the merged partitioning operation or the split partitioning operation, and collecting new statistical information of a partition associated with the merged partitioning operation or the split partitioning operation.
9. The statistical information collection device according to claim 8, further comprising:
the determining module is used for determining the DML object according to the change operation contained in the change operation record of which the operation type is the table operation;
the judging module is used for judging whether the number of the DML belonging to the DML object reaches a preset numerical value or not according to the file for recording the DML execution condition;
and the starting module is used for judging whether to start the new statistical information or not according to a preset configuration item if the number of the DML which belongs to the DML object in the database change operation data reaches the preset value, starting the collected new statistical information if the number of the DML reaches the preset value, and restoring the backup old statistical information if the number of the DML reaches the preset value.
10. The statistical information collection apparatus according to claim 6, wherein the operation type includes an index operation;
the collection module includes:
a newly-built index collecting unit, configured to collect new statistics information of an index corresponding to a newly-built index operation if the operation type is that a change operation record of the index operation includes the newly-built index operation;
and/or
And if the operation type is that the change operation record of the index operation contains the rebuilt index operation, the rebuilt index collection unit is used for backing up old statistical information of the index corresponding to the rebuilt index operation, and recovering the old statistical information after collecting new statistical information of the index corresponding to the rebuilt index operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611003385.2A CN106776704B (en) | 2016-11-14 | 2016-11-14 | Statistical information collection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611003385.2A CN106776704B (en) | 2016-11-14 | 2016-11-14 | Statistical information collection method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106776704A CN106776704A (en) | 2017-05-31 |
| CN106776704B true CN106776704B (en) | 2020-03-06 |
Family
ID=58968410
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611003385.2A Active CN106776704B (en) | 2016-11-14 | 2016-11-14 | Statistical information collection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106776704B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108255925B (en) * | 2017-11-10 | 2021-12-10 | 平安普惠企业管理有限公司 | Method and terminal for displaying data table structure change condition |
| US11468073B2 (en) * | 2018-08-06 | 2022-10-11 | Oracle International Corporation | Techniques for maintaining statistics in a database system |
| CN109614398A (en) * | 2018-11-02 | 2019-04-12 | 阿里巴巴集团控股有限公司 | The variation and device of table structure in database |
| CN112000657A (en) * | 2019-05-27 | 2020-11-27 | 北京京东尚科信息技术有限公司 | Data management method, device, server and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101739439A (en) * | 2009-11-30 | 2010-06-16 | 中兴通讯股份有限公司 | Method and system for dynamically customizing statistical object based on template |
| CN102346784A (en) * | 2011-11-14 | 2012-02-08 | 苏州阔地网络科技有限公司 | Database backup method and system |
| CN102480385A (en) * | 2010-11-26 | 2012-05-30 | 北京启明星辰信息技术股份有限公司 | Database security protection method and device |
| CN103345470A (en) * | 2013-05-31 | 2013-10-09 | 深圳市沃信科技有限公司 | Database disaster tolerance method, database disaster tolerance system and server |
| CN105069096A (en) * | 2015-08-06 | 2015-11-18 | 厦门二五八集团有限公司 | Architecture method and architecture system for user-defined worksheet |
| CN105069134A (en) * | 2015-08-18 | 2015-11-18 | 上海新炬网络信息技术有限公司 | Method for automatically collecting Oracle statistical information |
| CN105117457A (en) * | 2015-08-20 | 2015-12-02 | 中国人民解放军国防科学技术大学 | Index rebuilding method of fictitious asset preservation system |
-
2016
- 2016-11-14 CN CN201611003385.2A patent/CN106776704B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101739439A (en) * | 2009-11-30 | 2010-06-16 | 中兴通讯股份有限公司 | Method and system for dynamically customizing statistical object based on template |
| CN102480385A (en) * | 2010-11-26 | 2012-05-30 | 北京启明星辰信息技术股份有限公司 | Database security protection method and device |
| CN102346784A (en) * | 2011-11-14 | 2012-02-08 | 苏州阔地网络科技有限公司 | Database backup method and system |
| CN103345470A (en) * | 2013-05-31 | 2013-10-09 | 深圳市沃信科技有限公司 | Database disaster tolerance method, database disaster tolerance system and server |
| CN105069096A (en) * | 2015-08-06 | 2015-11-18 | 厦门二五八集团有限公司 | Architecture method and architecture system for user-defined worksheet |
| CN105069134A (en) * | 2015-08-18 | 2015-11-18 | 上海新炬网络信息技术有限公司 | Method for automatically collecting Oracle statistical information |
| CN105117457A (en) * | 2015-08-20 | 2015-12-02 | 中国人民解放军国防科学技术大学 | Index rebuilding method of fictitious asset preservation system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106776704A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11392582B2 (en) | Automatic partitioning | |
| CN111046034B (en) | Method and system for managing memory data and maintaining data in memory | |
| EP3117347B1 (en) | Systems and methods for rapid data analysis | |
| CN110569214B (en) | Index construction method and device for log file and electronic equipment | |
| US10664374B2 (en) | Event analysis device, event analysis system, event analysis method, and event analysis program | |
| CN106776704B (en) | Statistical information collection method and device | |
| CN110292775B (en) | Method and device for acquiring difference data | |
| CN109522290B (en) | HBase data block recovery and data record extraction method | |
| CN107301214B (en) | Data migration method and device in HIVE and terminal equipment | |
| CN113760891B (en) | Data table generation method, device, equipment and storage medium | |
| US9305076B1 (en) | Flattening a cluster hierarchy tree to filter documents | |
| CN110275889B (en) | Feature processing method and device suitable for machine learning | |
| CN105556474A (en) | Managing memory and storage space for a data operation | |
| CN112948504B (en) | Data acquisition method and device, computer equipment and storage medium | |
| CN110134663B (en) | Organization structure data processing method and device and electronic equipment | |
| CN109344163B (en) | Data verification method and device and computer readable medium | |
| CN113778996A (en) | Large data stream data processing method and device, electronic equipment and storage medium | |
| CN111984625B (en) | Database load characteristic processing method and device, medium and electronic equipment | |
| CN104199924B (en) | The method and device of network form of the selection with snapshot relation | |
| CN103530369A (en) | De-weight method and system | |
| CN107330031B (en) | Data storage method and device and electronic equipment | |
| CN110851437A (en) | Storage method, device and equipment | |
| WO2021047576A1 (en) | Log record processing method and apparatus, and device and machine-readable storage medium | |
| CN114707953A (en) | Main data full life cycle management method, system, engine and storage medium | |
| CN113868267A (en) | Method for injecting time sequence data, method for inquiring time sequence data and database system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |