CN116048978B - Software service performance self-adaptive test method, system, terminal and medium - Google Patents
Software service performance self-adaptive test method, system, terminal and medium Download PDFInfo
- Publication number
- CN116048978B CN116048978B CN202211736588.8A CN202211736588A CN116048978B CN 116048978 B CN116048978 B CN 116048978B CN 202211736588 A CN202211736588 A CN 202211736588A CN 116048978 B CN116048978 B CN 116048978B
- Authority
- CN
- China
- Prior art keywords
- test
- performance
- performance data
- dynamic
- fluctuation value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010998 test method Methods 0.000 title claims abstract description 14
- 238000012360 testing method Methods 0.000 claims abstract description 176
- 238000013507 mapping Methods 0.000 claims abstract description 25
- 230000006870 function Effects 0.000 claims description 36
- 238000004590 computer program Methods 0.000 claims description 13
- 238000000034 method Methods 0.000 claims description 12
- 230000003044 adaptive effect Effects 0.000 claims description 6
- 238000013142 basic testing Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 4
- 238000013101 initial test Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000006978 adaptation Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 2
- 238000011056 performance test Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a software service performance self-adaptive test method, a system, a terminal and a medium, relating to the technical field of software test, and the technical scheme is as follows: testing the service performance of the target software according to the test loading strategy to obtain a test performance data set; analyzing the fluctuation value of each test performance data set, and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter; randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function; inputting the performance scattered point sequence into a mapping function, and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition; and determining a new test loading strategy according to the dynamic test parameter sequence, and repeatedly updating the test loading strategy until no solved dynamic test parameter sequence exists. The application can carry out self-adaptive unfolding comprehensive test on different application software, and has the advantages of less required test resources and high test efficiency.
Description
Technical Field
The application relates to the technical field of software testing, in particular to a software service performance self-adaptive testing method, a system, a terminal and a medium.
Background
In general, the network application environment of an enterprise supports a large number of users, the network architecture comprises various application environments, and software and hardware products are provided by different suppliers. The problems of slow response speed of the user, system breakdown and the like of the application software are easily caused by unpredictable user loads and increasingly complex application environments, so that the service performance of the application software is very necessary to be tested.
At present, the service performance of application software generally builds a test loading strategy for representing different operation services of a user through preset test parameter simulation, and the performance data of the application software under various complex application environments is tested through running the test loading strategy concurrently. However, the architectures and application scenes of different application software have obvious differences, so that the performance indexes in the test process are large in reflected variability, if the comprehensive test of different application software under different performance indexes is covered, a sufficient number of test loading strategies need to be constructed, and the proper test loading strategies need to be screened out for different application software in a targeted manner, so that not only are the resources occupied in the test process excessive, but also the performance test efficiency of the application software is reduced to a certain extent.
Therefore, how to study and design a software service performance adaptive test method, system, terminal and medium capable of overcoming the above-mentioned defects is an urgent problem to be solved at present.
Disclosure of Invention
In order to solve the defects in the prior art, the application aims to provide a software service performance self-adaptive test method, a system, a terminal and a medium, which are characterized in that a target software is initially tested through a predetermined partial test loading strategy, a performance index with the smallest fluctuation expression in collected test performance data sets is selected, and a new test loading strategy which can enable the fluctuation of the performance index to be not smaller than the previous fluctuation is reversely reconstructed, so that the self-adaptive expansion comprehensive test of different application software can be performed in an iterative reconstruction mode, the required test resources are less, and the test efficiency is high.
The technical aim of the application is realized by the following technical scheme:
in a first aspect, a software service performance adaptive test method is provided, including the following steps:
testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes;
analyzing the fluctuation value of each test performance data set, and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter;
randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function;
inputting the performance scattered point sequence into a mapping function, and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition;
and determining a new test loading strategy according to the dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained.
Further, the performance indicators of the service performance include response time, running stability and resource utilization.
Further, the test parameters include a load operation number and a load operation resource.
Further, the mapping function is a multiple function representing the association relationship between a single performance index and all the test parameters.
Further, the calculation formula of the fluctuation value is specifically:
wherein α represents a fluctuation value; n represents the number of test performance data in the test performance data set; x is x i Representing the ith test performance data; x is x i-1 Representing the i-1 st test performance data; x is x i+1 Represents the i+1st test performance data;mean values of the test performance data are shown.
Further, the fluctuation threshold is a minimum fluctuation value.
Further, the trend constraint includes:
the variation trend of different dynamic test parameters in the solved dynamic test parameter sequence is consistent;
and, the variation of the different dynamic test parameters is minimal.
In a second aspect, a software service performance adaptive test system is provided, including:
the initial test module is used for testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes;
the function construction module is used for analyzing the fluctuation value of each test performance data set and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter;
the sequence generation module is used for randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function;
the parameter solving module is used for inputting the performance scattered point sequence into the mapping function and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition;
the dynamic test module is used for determining a new test loading strategy according to the dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained.
In a third aspect, a computer terminal is provided, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing a software service performance adaptive test method according to any one of the first aspects when executing the program.
In a fourth aspect, a computer readable medium is provided, on which a computer program is stored, the computer program being executable by a processor to implement a software service performance adaptive test method according to any one of the first aspects.
Compared with the prior art, the application has the following beneficial effects:
1. according to the software service performance self-adaptive test method, the target software is initially tested through the predetermined partial test loading strategy, the performance index with the smallest fluctuation in the collected test performance data set is selected, the new test loading strategy which can enable the fluctuation of the performance index to be not smaller than the previous fluctuation is reversely reconstructed, the self-adaptive unfolding comprehensive test of different application software can be performed in an iterative reconstruction mode, the required test resources are few, and the test efficiency is high;
2. when the fluctuation value of the test performance data set is analyzed, the method not only considers the overall fluctuation of each test performance data, but also considers the local fluctuation between adjacent test performance data, and has higher accuracy and reliability when the differential expansion test is carried out on the target software.
Drawings
The accompanying drawings, which are included to provide a further understanding of embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings:
FIG. 1 is a flow chart in an embodiment of the application;
fig. 2 is a system block diagram in an embodiment of the application.
Detailed Description
For the purpose of making apparent the objects, technical solutions and advantages of the present application, the present application will be further described in detail with reference to the following examples and the accompanying drawings, wherein the exemplary embodiments of the present application and the descriptions thereof are for illustrating the present application only and are not to be construed as limiting the present application.
Example 1: a software service performance self-adaptive test method, as shown in figure 1, comprises the following steps:
step S1: testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes;
step S2: analyzing the fluctuation value of each test performance data set, and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter;
step S3: randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function;
step S4: inputting the performance scattered point sequence into a mapping function, and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition;
step S5: and determining a new test loading strategy according to the dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained.
Performance metrics for service performance include, but are not limited to, response time, operational stability, and resource utilization.
The test parameters include load operation quantity and load operation resources, and the test loading strategy can be simulated by a script generator, a scene controller and a load generator. In addition, in the performance test process, each load generator is guaranteed to uniformly press the server.
In this embodiment, the mapping function is a multiple function, such as a binary primary function, a binary secondary function, etc., that represents the association between a single performance index and all the test parameters.
The fluctuation value can be analyzed in a standard deviation mode, so that the overall fluctuation condition is represented. The overall fluctuation condition and the local fluctuation condition can be considered at the same time, and the calculation formula of the fluctuation value is specifically as follows:
wherein α represents a fluctuation value; n represents the number of test performance data in the test performance data set; x is x i Representing the ith test performance data; x is x i-1 Representing the i-1 st test performance data; x is x i+1 Represents the i+1st test performance data;mean values of the test performance data are shown.
It should be noted that the fluctuation threshold may be a fixed value, or may be a minimum fluctuation value corresponding to the performance index selected in each iteration process.
Trend constraints include, but are not limited to, consistent trend of variation for different dynamic test parameters and minimal variance of variation for different dynamic test parameters in the solved sequence of dynamic test parameters.
Example 2: a software service performance self-adaptive test system is used for realizing a software service performance self-adaptive test method described in the embodiment 1, and comprises an initial test module, a function construction module, a sequence generation module, a parameter solving module and a dynamic test module as shown in figure 2.
The initial test module is used for testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes; the function construction module is used for analyzing the fluctuation value of each test performance data set and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter; the sequence generation module is used for randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function; the parameter solving module is used for inputting the performance scattered point sequence into the mapping function and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition; the dynamic test module is used for determining a new test loading strategy according to the dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained.
Working principle: according to the application, the target software is initially tested through a predetermined partial test loading strategy, the performance index with the smallest fluctuation expression in the collected test performance data set is selected, and the new test loading strategy which can enable the fluctuation of the performance index to be not smaller than the previous fluctuation is reversely reconstructed, so that the self-adaptive unfolding comprehensive test of different application software can be realized in an iterative reconstruction mode, the required test resources are less, and the test efficiency is high.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing detailed description of the application has been presented for purposes of illustration and description, and it should be understood that the application is not limited to the particular embodiments disclosed, but is intended to cover all modifications, equivalents, alternatives, and improvements within the spirit and principles of the application.
Claims (8)
1. The self-adaptive test method for the software service performance is characterized by comprising the following steps:
testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes;
analyzing the fluctuation value of each test performance data set, and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter;
randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function;
inputting the performance scattered point sequence into a mapping function, and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition;
determining a new test loading strategy according to the dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained;
the mapping function is a multiple function representing the association relation between a single performance index and all the test parameters;
the trend constraint includes:
the variation trend of different dynamic test parameters in the solved dynamic test parameter sequence is consistent;
and, the variation of the different dynamic test parameters is minimal;
the fluctuation value is analyzed in a standard deviation mode.
2. The method of claim 1, wherein the performance metrics of the service performance include response time, operational stability and resource utilization.
3. The method of claim 1, wherein the test parameters include a load operation number and a load operation resource.
4. The method for adaptively testing the performance of a software service according to claim 1, wherein the calculation formula of the fluctuation value is specifically:
wherein ,representing a fluctuation value; />Representing the number of test performance data in the test performance data set; />Representing the ith test performance data; />Representing the i-1 st test performance data; />Represents the i+1st test performance data; />Mean values of the test performance data are shown.
5. The method for adaptively testing the performance of a software service according to claim 1, wherein the fluctuation threshold is a minimum fluctuation value.
6. A software service performance adaptive test system, comprising:
the initial test module is used for testing the service performance of the target software according to the test loading strategy determined by the basic test parameters to obtain a test performance data set of the target software under different performance indexes;
the function construction module is used for analyzing the fluctuation value of each test performance data set and selecting the test performance data set corresponding to the minimum fluctuation value to construct a mapping function between the corresponding performance index and the test parameter;
the sequence generation module is used for randomly generating a performance scattered point sequence with a fluctuation value not smaller than a fluctuation threshold value for the performance index in the mapping function;
the parameter solving module is used for inputting the performance scattered point sequence into the mapping function and solving to obtain a dynamic test parameter sequence meeting the trend constraint condition;
the dynamic test module is used for determining a new test loading strategy according to dynamic test parameters in the dynamic test parameter sequence, testing according to the new test loading strategy, and repeatedly updating the test loading strategy until the dynamic test parameter sequence without solution is obtained;
the mapping function is a multiple function representing the association relation between a single performance index and all the test parameters;
the trend constraint includes:
the variation trend of different dynamic test parameters in the solved dynamic test parameter sequence is consistent;
and, the variation of the different dynamic test parameters is minimal;
the fluctuation value is analyzed in a standard deviation mode.
7. A computer terminal comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements a software service performance adaptation test method according to any one of claims 1-5 when executing the program.
8. A computer readable medium having stored thereon a computer program, wherein execution of the computer program by a processor implements a software service performance adaptation test method as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211736588.8A CN116048978B (en) | 2022-12-31 | 2022-12-31 | Software service performance self-adaptive test method, system, terminal and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211736588.8A CN116048978B (en) | 2022-12-31 | 2022-12-31 | Software service performance self-adaptive test method, system, terminal and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116048978A CN116048978A (en) | 2023-05-02 |
| CN116048978B true CN116048978B (en) | 2023-08-18 |
Family
ID=86133164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211736588.8A Active CN116048978B (en) | 2022-12-31 | 2022-12-31 | Software service performance self-adaptive test method, system, terminal and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116048978B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109587001A (en) * | 2018-11-15 | 2019-04-05 | 新华三信息安全技术有限公司 | A kind of performance indicator method for detecting abnormality and device |
| CN114416512A (en) * | 2022-01-25 | 2022-04-29 | 中国工商银行股份有限公司 | Test method, test device, electronic equipment and computer storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10198348B2 (en) * | 2015-08-13 | 2019-02-05 | Spirent Communications, Inc. | Method to configure monitoring thresholds using output of load or resource loadings |
-
2022
- 2022-12-31 CN CN202211736588.8A patent/CN116048978B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109587001A (en) * | 2018-11-15 | 2019-04-05 | 新华三信息安全技术有限公司 | A kind of performance indicator method for detecting abnormality and device |
| CN114416512A (en) * | 2022-01-25 | 2022-04-29 | 中国工商银行股份有限公司 | Test method, test device, electronic equipment and computer storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116048978A (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10635576B2 (en) | Branch coverage guided symbolic execution for hybrid fuzz testing of software binaries | |
| US20190324772A1 (en) | Method and device for processing smart contracts | |
| US10394694B2 (en) | Unexplored branch search in hybrid fuzz testing of software binaries | |
| US20120066667A1 (en) | Simulation environment for distributed programs | |
| US20090319829A1 (en) | Pattern extraction method and apparatus | |
| US20070185851A1 (en) | Generating Queries Using Cardinality Constraints | |
| WO2003100603A2 (en) | A device comprising a communications stack with a scheduler | |
| CN109697049A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN112748993A (en) | Task execution method and device, storage medium and electronic equipment | |
| CN111475402B (en) | Program function testing method and related device | |
| CN110334012B (en) | Risk assessment method and device | |
| EP3734460B1 (en) | Probabilistic software testing via dynamic graphs | |
| CN116048978B (en) | Software service performance self-adaptive test method, system, terminal and medium | |
| CN111079390B (en) | Method and device for determining selection state of check box list | |
| CN109426609B (en) | Method and device for testing application | |
| CN111352852B (en) | Regression test case selection method and device | |
| CN116629015A (en) | Digital twin task processing method, device, equipment and storage medium | |
| US20150026523A1 (en) | Debugging method and computer program product | |
| CN115203050A (en) | Method and device for determining dependency relationship of services | |
| CN115730305A (en) | Application program detection method and device, nonvolatile storage medium and processor | |
| CN111221551A (en) | Database upgrading method and device | |
| CN115048291A (en) | Software testing method and device and electronic equipment | |
| CN115250231B (en) | Application configuration method and device | |
| CN113626005B (en) | Block chain foundation contract development and deployment method, equipment and storage medium | |
| CN111209208B (en) | Test scheme generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |