CN112699032A - Method for analyzing performance test result of vdbench based on Excel - Google Patents
Method for analyzing performance test result of vdbench based on Excel Download PDFInfo
- Publication number
- CN112699032A CN112699032A CN202011610003.9A CN202011610003A CN112699032A CN 112699032 A CN112699032 A CN 112699032A CN 202011610003 A CN202011610003 A CN 202011610003A CN 112699032 A CN112699032 A CN 112699032A
- Authority
- CN
- China
- Prior art keywords
- data
- time
- resp
- excel
- vdbench
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/3017—Runtime instruction translation, e.g. macros
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of data extraction and analysis, in particular to a method for realizing analysis of a performance test result of vdbench based on Excel. According to the method for realizing analysis of the performance test result of the vdbench based on the Excel, the corresponding VBA code is generated according to the corresponding manual operation, and then the code is slightly modified to realize macro customization, so that the manual data processing is avoided, the operation is complex and time-consuming, the risk of error is easy, and the complexity of the manual operation is solved.
Description
Technical Field
The invention relates to the technical field of data extraction and analysis, in particular to a method for analyzing a performance test result of a vdbech based on Excel.
Background
The vdbecch is an I/O workload generator used for verifying data integrity and measuring the performance of direct attachment and network connection storage, and after each operation, the vdbecch generates an output folder containing related data files, wherein parmfile.
Excel possesses powerful data processing and diagram drawing function, can automated processing data, with the audio-visual demonstration of result drawing, Excel macro is that a series of Excel commands and instruction are put together, form a task, can carry out the task that contains a plurality of commands and instruction automatically, reduce repetitive operation, the efficiency of very big promotion Excel, through the program code of direct input operation process in VBA development environment, customize the macro of appointed function, realize the extraction analysis to data, there is not the instrument that special data analysis and drawing are carried out to the vdbench test result at present, current scheme generally has:
firstly, data can be extracted and analyzed through programming, and drawing is carried out;
secondly, manually extracting calculation data, and drawing through third-party drawing software (such as Excel);
therefore, a method for realizing analysis of the performance test result of the vdbench based on Excel is designed, and is urgently needed in the technical field of data extraction and analysis at present.
Disclosure of Invention
The invention provides a method for analyzing a performance test result of a vdbench based on Excel, which aims to solve the problems in the prior art.
In order to achieve the above object, the embodiments of the present invention provide the following technical solutions:
according to the embodiment of the invention, the method for realizing analysis of the performance test result of the vdbench based on the Excel comprises the following steps of screening and extracting test data for multiple times based on the data processing and graph drawing functions of the Excel, drawing according to the calculated data, visually displaying the result in the form of a graph, and separately displaying the performance result graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, wherein the functions of the Excel macro comprise the extraction and the use of the test data for drawing, the customization of the macro is completed through manual operation recording and VBA code coding, the extracted data are different according to different application scenes, the drawing is also changed correspondingly, and the processing flow is specifically as follows:
1) the method comprises the steps that a result folder data1 is output by the vdbench, flow models and test data configured by the vdbench are extracted from parmfile.html and summary.html files in the result folder data1, and the data are read and saved into worksheet data1_ configuration and worksheet data1_ original data of an Excel template file;
2) calling a macro of data extraction according to set parameters including the effective time range, time interval, data group number and group name of each group of data of each model value, analyzing and extracting the data to obtain core data, and putting the core data in a worksheet data1_ 1;
3) setting the name (time and block size) of the abscissa of the chart, marking data, drawing according to the core data, and storing the core data and the drawing result in the worksheet data1_ drawing result;
4) if a plurality of groups of data need to be analyzed and compared, the results of the plurality of groups of data are drawn on the same chart, so that the comparison and analysis are facilitated;
different configuration scenes are different in data processing and drawing:
A. for the case where there is only one flow model in the vdbech configuration, the flow of data processing and mapping is as follows:
1) setting various parameters including effective data time range and time interval, setting the number of data groups as 1, and setting group names, such as 4k full random full write;
2) reading data within a specified time range only, dividing the data into a small group of data according to time intervals, and reserving a plurality of rows of data of interval, io rate, mb/sec, resp time and resp max to obtain effective data;
3) calculating the average value of each group of data to obtain the average value data in each time interval, wherein the data are used for drawing;
4) sequentially drawing 4 graphs, namely graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, with Time as a horizontal axis and a unit as a Time interval;
B. for the case that there are multiple flow models in the vdbech configuration, the flow of data processing and drawing is as follows:
1) setting various parameters including effective data time range, time interval, data group number and group name, such as 4k full random full write;
2) reading only the data within the specified time range, and reserving the data of intervals, io rates, mb/sec, resp time and resp max to obtain the effective data of each flow model;
3) calculating the average value of the data of each flow model to obtain average value data;
4) performing combined classification on each flow model according to random/sequence and reading/writing, and reordering data according to classification to obtain drawing data;
5) the data block size is taken as the horizontal axis, the chart name is the flow model after combination, each combination is separately drawn, and the result charts of IOPS, MBPS, Avg Resp Time and Max Resp Time are drawn.
Further, the abscissa names of the graphs are time and block size.
The invention has the following advantages:
according to the method for realizing analysis of the performance test result of the vdbench based on the Excel, the corresponding VBA code is generated according to the corresponding manual operation, then the code is slightly modified to realize macro customization, manual data processing is avoided, the operation is complex and time-consuming, the risk of error is easy to occur, the complexity of the manual operation is solved, meanwhile, the problems that third-party software is used for drawing, the drawing function of a tool is required to be used skillfully, and the universality is poor are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that other embodiments can be derived from the drawings provided by those of ordinary skill in the art without inventive effort.
The structures, ratios, sizes, and the like shown in the present specification are only used for matching with the contents disclosed in the specification, so that those skilled in the art can understand and read the present invention, and do not limit the conditions for implementing the present invention, so that the present invention has no technical significance, and any structural modifications, changes in the ratio relationship, or adjustments of the sizes, without affecting the functions and purposes of the present invention, should still fall within the scope of the present invention.
FIG. 1 is a schematic flow chart of the present invention for processing a single raw datum;
FIG. 2 is a schematic view of a processing flow of a plurality of raw data according to the present invention;
FIG. 3 is a flow chart illustrating a process of a flow model according to the present invention;
FIG. 4 is a flow chart illustrating a process of multiple flow models according to the present invention.
Detailed Description
The present invention is described in terms of particular embodiments, other advantages and features of the invention will become apparent to those skilled in the art from the following disclosure, and it is to be understood that the described embodiments are merely exemplary of the invention and that it is not intended to limit the invention to the particular embodiments disclosed. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the present specification, the terms "upper", "lower", "left", "right", "middle", and the like are used for clarity of description, and are not intended to limit the scope of the present invention, and changes or modifications in the relative relationship may be made without substantial changes in the technical content.
The invention provides a technical scheme that:
a method for realizing analysis of performance test results of vdbench based on Excel includes screening and extracting test data for multiple times based on data processing and graph drawing functions of Excel, drawing according to calculated data, visually displaying results in a graph mode, and separately displaying performance result graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, enabling macro functions of Excel to include extraction of test data and drawing by using data, recording by manual operation and encoding VBA codes to complete macro customization, enabling extracted data to be different according to different application scenes and enabling drawing to be changed correspondingly, and enabling processing flow to be as follows:
1) the method comprises the steps that a result folder data1 is output by the vdbench, flow models and test data configured by the vdbench are extracted from parmfile.html and summary.html files in the result folder data1, and the data are read and saved into worksheet data1_ configuration and worksheet data1_ original data of an Excel template file;
2) calling a macro of data extraction according to set parameters including the effective time range, time interval, data group number and group name of each group of data of each model value, analyzing and extracting the data to obtain core data, and putting the core data in a worksheet data1_ 1;
3) setting the name (time and block size) of the abscissa of the chart, marking data, drawing according to the core data, and storing the core data and the drawing result in the worksheet data1_ drawing result;
4) if a plurality of groups of data need to be analyzed and compared, the results of the plurality of groups of data are drawn on the same chart, so that the comparison and analysis are facilitated;
different configuration scenes are different in data processing and drawing:
A. for the case where there is only one flow model in the vdbech configuration, the flow of data processing and mapping is as follows:
1) setting various parameters including effective data time range and time interval, setting the number of data groups as 1, and setting group names, such as 4k full random full write;
2) reading data within a specified time range only, dividing the data into a small group of data according to time intervals, and reserving a plurality of rows of data of interval, io rate, mb/sec, resp time and resp max to obtain effective data;
3) calculating the average value of each group of data to obtain the average value data in each time interval, wherein the data are used for drawing;
4) sequentially drawing 4 graphs, namely graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, with Time as a horizontal axis and a unit as a Time interval;
B. for the case that there are multiple flow models in the vdbech configuration, the flow of data processing and drawing is as follows:
1) setting various parameters including effective data time range, time interval, data group number and group name, such as 4k full random full write;
2) reading only the data within the specified time range, and reserving the data of intervals, io rates, mb/sec, resp time and resp max to obtain the effective data of each flow model;
3) calculating the average value of the data of each flow model to obtain average value data;
4) performing combined classification on each flow model according to random/sequence and reading/writing, and reordering data according to classification to obtain drawing data;
5) the data block size is taken as the horizontal axis, the chart name is the flow model after combination, each combination is separately drawn, and the result charts of IOPS, MBPS, Avg Resp Time and Max Resp Time are drawn.
In the invention: the abscissa names of the graphs are time and block size, and the independently set abscissa names are beneficial to data processing and convenient drawing of a user.
Although the invention has been described in detail above with reference to a general description and specific examples, it will be apparent to one skilled in the art that modifications or improvements may be made thereto based on the invention. Accordingly, such modifications and improvements are intended to be within the scope of the invention as claimed.
Claims (2)
1. A method for realizing analysis of performance test results of vdbench based on Excel includes steps of carrying out multiple screening extraction on test data based on Excel data processing and graph drawing functions, carrying out visual display on results in a graph form according to calculated data drawing, and separately displaying performance result graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, wherein Excel macro functions include extraction of test data and drawing of use data, and is characterized in that: the macro is customized by manual operation recording and VBA code encoding, extracted data are different according to different application scenes, drawing is changed correspondingly, and the processing flow is as follows:
1) the method comprises the steps that a result folder data1 is output by the vdbench, flow models and test data configured by the vdbench are extracted from parmfile.html and summary.html files in the result folder data1, and the data are read and saved into worksheet data1_ configuration and worksheet data1_ original data of an Excel template file;
2) calling a macro of data extraction according to set parameters including the effective time range, time interval, data group number and group name of each group of data of each model value, analyzing and extracting the data to obtain core data, and putting the core data in a worksheet data1_ 1;
3) setting the name (time and block size) of the abscissa of the chart, marking data, drawing according to the core data, and storing the core data and the drawing result in the worksheet data1_ drawing result;
4) if a plurality of groups of data need to be analyzed and compared, the results of the plurality of groups of data are drawn on the same chart, so that the comparison and analysis are facilitated;
different configuration scenes are different in data processing and drawing:
A. for the case where there is only one flow model in the vdbech configuration, the flow of data processing and mapping is as follows:
1) setting various parameters including effective data time range and time interval, setting the number of data groups as 1, and setting group names, such as 4k full random full write;
2) reading data within a specified time range only, dividing the data into a small group of data according to time intervals, and reserving a plurality of rows of data of interval, io rate, mb/sec, resp time and resp max to obtain effective data;
3) calculating the average value of each group of data to obtain the average value data in each time interval, wherein the data are used for drawing;
4) sequentially drawing 4 graphs, namely graphs of IOPS, MBPS, Avg Resp Time and Max Resp Time, with Time as a horizontal axis and a unit as a Time interval;
B. for the case that there are multiple flow models in the vdbech configuration, the flow of data processing and drawing is as follows:
1) setting various parameters including effective data time range, time interval, data group number and group name, such as 4k full random full write;
2) reading only the data within the specified time range, and reserving the data of intervals, io rates, mb/sec, resp time and resp max to obtain the effective data of each flow model;
3) calculating the average value of the data of each flow model to obtain average value data;
4) performing combined classification on each flow model according to random/sequence and reading/writing, and reordering data according to classification to obtain drawing data;
5) the data block size is taken as the horizontal axis, the chart name is the flow model after combination, each combination is separately drawn, and the result charts of IOPS, MBPS, Avg Resp Time and Max Resp Time are drawn.
2. The method for analyzing the result of the vdbench performance test based on Excel according to claim 1, characterized in that: the abscissa names of the graph are time and block size.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011610003.9A CN112699032B (en) | 2020-12-29 | 2020-12-29 | Method for realizing vddbench performance test result analysis based on Excel |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011610003.9A CN112699032B (en) | 2020-12-29 | 2020-12-29 | Method for realizing vddbench performance test result analysis based on Excel |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112699032A true CN112699032A (en) | 2021-04-23 |
| CN112699032B CN112699032B (en) | 2023-10-03 |
Family
ID=75512457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011610003.9A Active CN112699032B (en) | 2020-12-29 | 2020-12-29 | Method for realizing vddbench performance test result analysis based on Excel |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112699032B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116521465A (en) * | 2023-06-26 | 2023-08-01 | 深圳市晶存科技有限公司 | Hard disk test data processing method, device and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103577388A (en) * | 2013-11-21 | 2014-02-12 | 中国农业银行股份有限公司 | Excel template based data processing method and device |
| CN106685727A (en) * | 2017-01-11 | 2017-05-17 | 郑州云海信息技术有限公司 | Screening design scheme of performance test data |
| CN106989939A (en) * | 2017-03-29 | 2017-07-28 | 江铃汽车股份有限公司 | A kind of method and system of suspension K＆C test bed testing comparative analyses |
| CN107391372A (en) * | 2017-07-19 | 2017-11-24 | 中国银行股份有限公司 | A kind of data mart modeling function test method and system |
| US20180203628A1 (en) * | 2015-06-30 | 2018-07-19 | EMC IP Holding Company LLC | Method, apparatus and computer program product for evaluating data storage systems for energy efficiency |
| CN111338956A (en) * | 2020-02-27 | 2020-06-26 | 广州市百果园信息技术有限公司 | Automatic pressure measurement method, device, equipment and storage medium |
-
2020
- 2020-12-29 CN CN202011610003.9A patent/CN112699032B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103577388A (en) * | 2013-11-21 | 2014-02-12 | 中国农业银行股份有限公司 | Excel template based data processing method and device |
| US20180203628A1 (en) * | 2015-06-30 | 2018-07-19 | EMC IP Holding Company LLC | Method, apparatus and computer program product for evaluating data storage systems for energy efficiency |
| CN106685727A (en) * | 2017-01-11 | 2017-05-17 | 郑州云海信息技术有限公司 | Screening design scheme of performance test data |
| CN106989939A (en) * | 2017-03-29 | 2017-07-28 | 江铃汽车股份有限公司 | A kind of method and system of suspension K＆C test bed testing comparative analyses |
| CN107391372A (en) * | 2017-07-19 | 2017-11-24 | 中国银行股份有限公司 | A kind of data mart modeling function test method and system |
| CN111338956A (en) * | 2020-02-27 | 2020-06-26 | 广州市百果园信息技术有限公司 | Automatic pressure measurement method, device, equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 李登科;赵常要;: "探地雷达厚度曲线绘制技术研究", 铁道标准设计, no. 08 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116521465A (en) * | 2023-06-26 | 2023-08-01 | 深圳市晶存科技有限公司 | Hard disk test data processing method, device and medium |
| CN116521465B (en) * | 2023-06-26 | 2023-10-13 | 深圳市晶存科技有限公司 | Hard disk test data processing method, device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112699032B (en) | 2023-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107844424B (en) | Model-based testing system and method | |
| CN111027294B (en) | Method, device and system for summarizing table | |
| CN110292775B (en) | Method and device for acquiring difference data | |
| CN110399420A (en) | A kind of deriving method, electronic equipment and the medium of configurableization Excel format | |
| CN112199086B (en) | Automatic programming control system, method, device, electronic equipment and storage medium | |
| CN109448100A (en) | Threedimensional model format conversion method, system, computer equipment and storage medium | |
| CN108388515A (en) | Test data generating method, device, equipment and computer readable storage medium | |
| CN106776995B (en) | Structured data tree-form acquisition method based on model-driven architecture | |
| US9009175B2 (en) | System and method for database migration and validation | |
| CN109582796A (en) | Generation method, device, equipment and the storage medium of enterprise's public sentiment event network | |
| CN110597721A (en) | Automatic interface pressure testing method based on pressure testing script | |
| CN109254959A (en) | A kind of data evaluation method, apparatus, terminal device and readable storage medium storing program for executing | |
| CN109978495A (en) | A kind of nuclear power station debugging test Report workout method and system | |
| CN105279144A (en) | Method and device for typesetting wind tunnel test data text files | |
| CN111782117A (en) | Interface display method and device, storage medium and electronic device | |
| CN112527676A (en) | Model automation test method, device and storage medium | |
| CN112699032A (en) | Method for analyzing performance test result of vdbench based on Excel | |
| CN113948187A (en) | Method and device for calculating nutrient components of food formula, computer and storage medium | |
| CN117235527A (en) | End-to-end containerized big data model construction method, device, equipment and medium | |
| CN116579806A (en) | System and method for analyzing market research data based on AI model | |
| CN111708814A (en) | Data statistical method, device, equipment and medium | |
| CN115562979A (en) | Method for automatically generating test report based on artificial intelligence | |
| CN111626024B (en) | Method and system for batch processing of SWCC model parameter data based on RETC software | |
| CN114064784A (en) | Enterprise research and development expense intelligent collection method and system and electronic equipment | |
| CN111931017A (en) | Intelligent configuration method and system suitable for coal preparation plant |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |