CN1780236A - General test system and method for telecommunication intelligent service - Google Patents

Abstract

A universal test system for intelligent telecommunication service is composed of a development unit of graphic test example, an executing unit of test example and a test task managing unit. Its method is also disclosed.

Description

General test system and method for telecommunication intelligent service

technical field

The invention belongs to the field of telecommunication testing, and relates to testing technology and devices for telecommunication data services and equipment.

Background technique

With the increasingly intensified competition in the telecommunication industry, it poses severe challenges to the service content, service methods and service quality of domestic telecommunication operators, pushing telecommunication operators to continuously launch new telecommunication services to compete for customer resources and maintain corporate reputation Competitiveness. In recent years, the rapid development of intelligent network technology in the world has fundamentally changed the traditional way of providing services in the telecommunication network, making it possible to generate and realize various new telecommunication services quickly, flexibly and economically.

The operation of intelligent services is based on the mutual communication between various functional entities in the intelligent network. A complex intelligent service often needs to interact with various software and hardware systems to receive or send requests to obtain information. These interactions include not only the interaction within the intelligent network, but also the interaction with various systems or systems (such as voice systems, content providers, etc.), and even with different telecommunication networks (such as Telecom and China Mobile, China Unicom, etc.). communication. In this complex communication network, there are multiple communication protocols, and a large number of carrier-grade application software are running. These software and hardware devices need to be strictly tested in every link before they are developed by telecom equipment vendors and delivered to telecom operators for official use. In particular, when a large number of call losses occur in intelligent services, due to the large number of functional modules in the intelligent network, it is difficult to accurately locate the cause of the fault. Therefore, there is an urgent need for a test tool that can set detection points between test cases, perform functional tests and high-traffic tests on each module, locate the cause of the fault, and find out the performance bottleneck.

In contrast to the flexibility of intelligent business development, the development of test tools is difficult to meet the current needs. Both telecom equipment manufacturers and telecom operators have to develop special test tools for different communication protocols and application layer business logic during the development process and the process of equipment acceptance, and the development of these test tools, itself It requires a lot of human and material resources. Especially when the highly flexible intelligent business changes, the test tool has to be modified at the source code level to generate new test cases. The difficulty of testing directly affects the stability of intelligent network systems and services, and becomes one of the main reasons for the high failure rate of equipment in operation.

There is no general test system and method for telecommunication intelligent services in published articles and patent documents.

Contents of the invention

One of the technical problems to be solved by the present invention is to provide a test system with universal telecommunication intelligent service, so as to meet the flexibility requirement of the telecommunication intelligent service test tool.

Another technical problem solved by the present invention is to provide a test method for telecommunication intelligent services, so that telecommunication operators and telecommunication equipment manufacturers can flexibly create and execute test cases, statistical test data, so that test engineers can accurately and objectively understand and Evaluate the performance of the system under test, and its applicability is not limited by specific communication protocols and specific business processes under test.

The general test system for telecommunications intelligent services of the present invention includes: a graphical test case development device, which has a graphical interface library, and each graphic in the library corresponds to at least one basic functional unit in the test case execution process; there is also a graphical editing interface , to connect the graphical basic functional units into a flow chart; and many graphical interfaces for the data and attribute settings of each basic functional unit; to convert all the information of the test cases generated by editing into test case execution files;

A test case execution device, which parses and executes the test case execution file generated by the test case development device; creates a network connection and a database connection according to the definition in the test case execution file; executes login, authentication and link according to the protocol definition information Maintain the process; execute the database operations defined in the test case execution file; interact with the test task management device and accept the control of the test task management device;

A test task management device, which transmits the test case execution file to the test case execution device; edits the test task and orders the test case execution device to execute by specifying the test time or the number of times the test process is executed; provides an interface for modifying the data in the test case; receives The trace message sent by the test case execution device is displayed to the user; after the test task is executed, the statistical data generated by the test case is read and displayed to the user in the form of a chart.

The graphical test case development device also includes a communication protocol definition device, which is used to provide a data entry interface to define the key field information in the agreement; adopt the described graphical interface library and graphical editing interface to edit the specified Login, authentication, and link maintenance processes; the generated protocol definition information can be exported separately as a protocol definition file, which can be imported and reused in different test cases.

The graphical test case development device also includes a data definition device, which is used to define the data and storage units required in the execution of the test case, including: management data, which can be modified by the test task management device to control the test process; session sharing data, providing To exchange information between different instances of the same test case; session private data, for the instance of the test case to store session data and temporary data during runtime.

The graphical test case development device also includes a network connection definition device, which is used to set information such as IP address and port number required by the network connection, and specify the network protocol executed on the network connection.

The graphical test case development device also includes an error detection device, which detects whether the attribute setting of the basic functional unit and the process are correct before generating the test case.

The graphical test case development device also includes a test case execution file generation device, which converts the graphical test case flow and all description information into binary files and provides them to the test case execution device for execution.

The test case execution device also includes a file interface device to read and analyze the test case description information in the test case execution file; a multi-thread time-sharing processing mechanism and a task scheduling device, which unify each test case instance by the task scheduling device According to the principle of load sharing, it is allocated to each thread for execution; a protocol execution device executes the login, authentication, and link maintenance processes defined in the protocol, so as to realize the versatility of the present invention to different communication protocols; a process tracking device supports test tasks The management device sends tracking information, test information and the execution status of the test process, and these information will be displayed by the test task management device.

The test task management device also includes a test task editing device, and a test task at least includes: a test case identification, the time when the test starts and finishes or the execution times of the test flow; a test case management data editing device, which is used to display the test case in the execution file Defined management data, provide an editing interface to modify the value of the management data, communicate with the test case execution device, and use the modified value to refresh the management data value in the execution environment; a tracking device for test case execution, which displays to the user that it is executed by the test case tracking information sent by the device; and a test data statistics device.

The general test method for telecom intelligent service of the present invention comprises:

Define the data structures and corresponding graphical interfaces of the basic functional units used in many tests;

A flow chart is connected by many basic functional units;

Define the data, network protocol, network and database connection required in the process, and define the required statistical items;

Output flowcharts, data definitions, protocol definitions, network and database connections, and statistical project definitions as files;

An execution device reads the information in the file and executes the process therein; a test task management device provides the user with an interface for modifying data values according to the data definition information in the file;

The test task management device displays to the user the tracking information generated by the execution device during the process of executing the process.

It also includes the statistics of test data. By defining a data structure, the data structure contains enough spare data items, and these data items can be given meaning by the user and become statistical items; providing statistical function units, users can design the process through The statistical function unit updates the defined statistical items; by setting different test conditions, the test statistical data under different conditions are obtained, and the test task management device reads these statistical data and displays them to the user in an intuitive form such as charts Test Results.

The beneficial effects of the present invention are as follows: 1) can be directly applied to any application layer protocol based on TCP/IP; 2) can be applied to any communication protocol, including No.7 and No.1 signaling, through communication front-end processor technology etc., so that test engineers only need to focus on the writing of application layer test cases; 3) Provide graphical test case development tools to make the process of written test cases clear, easy to maintain and modify, and adapt to the flexibility of telecom intelligent services 4) Provide user-customizable test data statistics function, test engineers can freely count any data in the test process to obtain first-hand test data, which is convenient for evaluating the performance of the system under test and troubleshooting Perform classified statistics; 5) Have the ability to track the test process, so that test engineers can keep track of the running status of the test task; 6) By customizing the test task, the call volume, session number, call times, and test time can be flexibly configured and other parameters to realize the automation of the test. At the same time, combined with the statistical function, it can simulate different on-site environments for comparative testing.

Description of drawings

Fig. 1 is a schematic diagram of the internal module relationship and the overall process of the method of the present invention;

Figure 2 is a schematic diagram of the direct connection between the system and the system under test;

Figure 3 is a schematic diagram of the connection between the system and the system under test through a communication interface.

Detailed ways

For the convenience of description, the user-defined data is referred to as "CDD" (Custom Defined Data) hereinafter; the basic function unit is referred to as "BFU" (Basic Function Unit);

As shown in Figure 1, the three modules described below will be further elaborated respectively.

(1) Test case development environment

The test case development environment includes the following functional modules: 1. Graphic editing function; 2. Protocol definition function; 3. Data definition function; 4. Database and network connection definition function; 5. Test case execution file generation function.

Graphic editing function

Responsible for drawing BFU and the connection between BFU in the editing window, simple text description, saving and opening of graphics, UNDO, REDO, BFU moving, copying, cutting, pasting, and deleting operations, and the creation and maintenance of BFU objects. The storage and management of data related to BFU in memory. The connection between BFUs is a directed connection, a connection pointing to a BFU is called fan-in, and a connection pointing to other BFUs is called fan-out.

BFU creation operation: the user creates a new BFU in the editing interface, then creates a BFU object in the memory, and appends its pointer to a pointer array (called BFU list), and each BFU object stores the address of the pointer array. Each BFU object stores a "fan-out connection array" and a "fan-in connection array" as well as its own index in the BFU list.

BFU connection operation: for a BFU a, each time a connection to another BFU b is added, the BFU list index of b is recorded in the fan-out connection array of a, and the BFU list index of a is recorded in the fan-in connection array of b .

BFU deletion operation: To delete a BFU, it is necessary to modify the fan-in and fan-out information of all BFUs in the fan-out connection array and fan-in connection array of the BFU.

A number of BFUs connected together form a flow chart of a surveying and mapping use case.

data definition function

The invention provides an operation interface for users to define CDD data, and the CDD data is used to save session data required for a test session.

In the present invention, a CDD data is characterized by type and length. CDD provides three basic types: integer type, string type, and binary block, and each basic type has a corresponding array class. The test case generation environment does not actually create these CDDs in the memory, it just saves the CDD description information in a structure array, and when the user needs to edit the business, it will be available for the user to choose in the form of a drop-down list. The description information of CDD is defined by a class CDataInfo, and each CDD corresponds to a CDataInfo object, and its data members include: data type, number of data bytes, and data initial value.

CDD is divided into:

(1) Management data (MCDD): The test task management environment controls the execution process of the test by modifying the management data;

(2) Session Shared Data (SCDD): for the same test case to share data between different running instances (referred to as sessions) in the test execution environment, so that different sessions can cooperate to complete the test task;

(3) Session private data (PCDD): used for a test case instance to cache the data it needs.

The data definition function includes the setting of the BFU attribute, and the BFU attribute data is stored in the BFU object as a member variable of the BFU class.

protocol definition function

In the present invention, a protocol is represented by the following data:

(1) Basic protocol information, including the protocol name and whether session support is required;

(2) protocol feature fields, such as the length of each protocol message, the position and number of bytes of the message type field, etc.;

(3) The process of sending and receiving link detection packets stipulated in the protocol (called link maintenance process). The editing method of this flow is consistent with that of the test case flow.

The entry of the link detection process of the protocol is divided into the server entry and the client entry. When editing the test case, according to the role of the test end in the communication, specify different protocol entries. Generally speaking, the client entry includes the login (LOGIN IN) process to the server, and the server entry includes the authentication process for the client login request. User name and password information required for login can be designated as management data for online modification through the test task management environment.

The protocol definition module provides the message length field information to the test case execution environment for the test case execution environment to complete the interception of the received data packet in the communication with the system under test; the message type field information provided for the test case execution environment to extract from the data packet Extract the message type, and decide to distribute the data packet to the test case process or the link detection process of the protocol according to the message type. The test case execution environment completes the sending and receiving of link detection packets with the system under test according to the link detection process defined in the protocol to maintain the communication link.

Defined protocols can be exported individually as protocol definition files and loaded by other test cases.

Network connection and database definition functions

Provide an operation interface for users to define the database connection and network connection to be used in the business.

Through the operation interface, the user can save the following connection information:

本地IP地址

local IP address

Peer IP address

server port number

connection type (as server or client)

该连接上使用的网络协议

the network protocol used on this connection

Among them, the IP address and port number can be designated as management data, and can be modified through the test task management environment before starting the test task.

Users can define multiple network connections in a test case, and each network connection corresponds to a network protocol. When the test task management environment initiates a start command to the test case execution environment, the execution environment establishes a SOCKET connection with the network element under test according to the connection information , and execute the login process (or authentication process) and link maintenance process defined in the network protocol, so as to complete the establishment of the network connection.

Considering that some complex test cases may need to use the database to save information, the general test system of the present invention provides a database operation interface. In the WINDOWS system, the system is connected to various databases through ODBC drivers. Through the interface provided by the test case development environment, the user can save the following database connection information:

System data source name

数据库名

Database name

数据库服务器类型(如SYBASE、MS SQL SEVER等)

Database server type (such as SYBASE, MS SQL SEVER, etc.)

Similar to network connections, users can define multiple database connections in a business.

Test case execution file generation function

The test case execution file saves the test case information in the internal format of the system, and the test case execution file can be parsed by the test case execution environment and the test task management environment.

The test case execution file consists of the following parts of data:

管理数据区

Manage data area

协议定义区

protocol definition area

网络连接定义区

Network Connection Definition Area

数据库连接定义区

database connection definition area

测试用例流程定义区

Test case process definition area

The test case development environment first performs error detection on each part of the test case data, judges whether the message grouping and unpacking in the test case process conflicts with the protocol definition, and judges whether the attribute settings of each functional unit are correct. If the error detection is passed, the data of each part of the test case is written into the test case execution file in binary format.

(2) Test case execution environment

The test case execution environment of the present invention has designed a C++ class for each basic function unit (BFU), by reading information from the test case execution file, the BFU class is instantiated into a BFU object, and utilizes the stored in each BFU Connection information, connect BFU objects into a directed tree.

The test case execution environment reads the data definition information stored in the test case execution file, allocates storage units in the memory, and saves the description information and initial value of the data. Protocol definitions, network connections, and database connection information are also read from test case execution files and stored in memory.

The BFU class in the test case execution environment corresponds to the BFU class in the test case development environment, including network data receiving class, network data sending class, calculation operation class, timer class, process control class (including condition judgment, branch and jump Transfer), test process tracking class (send tracking and debugging information to the test task management environment), database operation class, encryption and decryption operation class, log class, and statistics class. The calculation operations include: addition, subtraction, multiplication, division, memory copy, string operation, etc. During the execution process, the execution environment executes in the order of directed connections, and determines the branch of the process according to the branch BFU and the condition judgment BFU condition.

The execution environment instantiates test cases into test case objects. One test case can correspond to multiple test case objects. Each test case object acts as a session instance to interact with the network element under test, thereby realizing the test of simulating large traffic. The test case object is composed of BFU directed tree, user-defined data, and buffer for caching messages. Its function is to call the operation interface functions of each BFU object in sequence according to the process designed in the test case, so as to complete the execution of the test case . In the test case execution environment, multiple service threads form a thread pool, and the service scheduling module assigns test case objects to service threads for time-sharing execution, realizing concurrent interaction between multiple test case objects and network elements under test. The execution environment corresponds the test case object with the identification field of a network session one by one, and saves it in a HASH table. When the execution environment receives the network message, it parses the session identification field from the data packet according to the protocol definition information, and uses the The field is used as the key value, and is searched from the lookup table in the HASH table and finally located to the test case object, and then the received network message is handed over to the test object for processing.

The statistical BFU in the test case writes the data to be counted into the statistical task table of the database. The table structure of the statistical task table is as follows:

Test task ID: the unique identifier of a test task, assigned by the test task management environment, usually for analyzing the system under test, different test conditions are set for each test task.

测试用例实例ID：一次测试任务可对应多个测试用例实例，其标识由测试用例执行环境分配，每个测试用例实例产生的统计数据对应统计任务表中的一条记录。

Test case instance ID: A test task can correspond to multiple test case instances, and its ID is assigned by the test case execution environment. The statistical data generated by each test case instance corresponds to a record in the statistical task table.

测试开始时间：该测试用例实例发起测试的时间。

Test start time: the time when the test case instance initiates the test.

测试结束时间：该测试用例实例完成一次测试的时间。

Test end time: the time when the test case instance completes a test.

Test process execution times: the number of times the test case instance executes the test case process.

统计数据项1：第一个用户自定义统计项；

Statistical data item 1: the first user-defined statistical item;

统计数据项2：第二个用户自定义统计项；……

Statistical data item 2: the second user-defined statistical item;  …

统计数据项n：第n个用户自定义统计项；

Statistical data item n: the nth user-defined statistical item;

User-defined statistical items are defined by the user. Users can customize statistical data items in the test case development environment. Each statistical item corresponds to a name, which is read by the test task management environment and displayed to the user when generating statistical results .

(3) Test task management environment

The test task management environment provides an operation interface for users to load test case files to the test case execution environment, modify test case management data, edit test tasks, start test case execution, track and display test case output information during the test process , to display the statistical results after the test is completed.

A test task can be defined to be executed by time and by number of times. When it is set to be executed by time, the user specifies the start and stop time of the test task through the management environment; Specifies the number of executions of the test case. A test task contains the following information:

Test case ID, which uniquely identifies a test case

执行测试任务的预定起止时间

Scheduled start and end times for executing test tasks

执行测试用例的预定次数

A predetermined number of times to execute a test case

Execution method of test cases: means execution by time or execution by number of times

测试任务ID，唯一标识一次测试任务

Test task ID, which uniquely identifies a test task

测试中启动的会话数(即测试用例对象数)

The number of sessions started in the test (i.e. the number of test case objects)

The test task management environment transmits the test case execution file to the test case execution environment through the SOCKET connection, reads the management data information and statistical task information in the execution file at the same time, and saves these information in the memory of the management environment, thereby completing the test case execution File loading.

The management environment can modify the value of the management data and request to refresh the value of the management data saved in the execution environment by sending a data update instruction to the execution environment. The data update instruction can be used before the execution of the test case or during the execution process.

After editing the test task in the test task management environment, the test task information is sent to the test task execution environment, and then the execution of the test task can be started at any time.

After the execution environment completes the execution of the test task, it sends a notification message to the management environment, and the management environment displays the statistical data generated during the test process to the user according to the statistical task information, and completes a test process.

(4) Implementation steps

The testing method based on the telecommunications intelligent service testing system of the present invention comprises the following steps:

(1) For the communication protocol used by the system under test, use the test case development environment in the present invention to customize the application layer protocol; if the bottom layer communication of the system under test adopts an agreement other than TCP/IP, then write the communication interface machine forwarding protocol package; if the protocol requires link detection, edit the link detection process in the test case development environment; the customized communication protocol can be exported as a protocol file separately, and can be directly reused when developing other test cases;

(2) Edit test cases in the test case development environment according to the test specifications of the system under test, and generate executable test cases;

(3) set up a physical connection between the physical test system and the system under test, such as local area network connection, relay E1/T1 connection, etc., and run the test case execution environment on the physical test system;

(4) Through the test task management environment, load the generated test cases. In the test task management module, set the test task for the test case, and modify the management data used to control the test process in the test case;

(5) As shown in accompanying drawings 2 and 3, the general test system of the present invention is directly connected with the system under test through TCP/IP, or connected with the system under test through a communication interface machine. This general test system will automatically execute the link detection process to maintain the communication link between the system and the system under test;

(6) Send a start test command through the test task management environment and the surveying and mapping use case execution environment, and start the test task;

(7) During the execution of the test task, the test case execution environment sends various instructions and requests to the system under test through the test physical system, initiates multi-channel conversations or calls, collects the responses of the system under test, and judges whether the responses meet the requirements of the test. According to the requirements of the specification, record the judgment results in the database according to the requirements of the test cases;

(8) During the execution of the test task, the test case execution environment sends the test information during the test process to the test task management environment according to the requirements of the test case, which is displayed in real time by the test task management environment to track the test process in real time.

(9) After the test task is executed, the test task management environment automatically counts the recorded test data. A test task can include multiple tests under different test conditions. The test data of these tests will be collected by the test task management environment after the test task is over, and statistics will be drawn and curves will be drawn to reflect the various aspects of the system under test. The correlation between the performance parameters and the test conditions is used to obtain the performance index of the system under test in the simulated real operating environment.

The method and the general testing system of the invention can fully simulate the input of the tested system and equipment during actual operation, and receive the output of the tested system. Therefore, adopting the method and system described in the present invention is objective and credible for the system under test. The general test system solves the problem of lack of flexible and objective test means for the current telecommunication intelligent business, and greatly reduces the test cost due to the flexibility and wide applicability of the present invention. The method and system described in the present invention can be completely used by equipment manufacturers and telecom operators as tools for functional testing, performance testing and interoperability testing.

Claims (10)

1, a kind of universal test system of telecommunication intelligent service is characterized in that, comprising:

One graphical test case development device has a graphical interfaces storehouse, the basic functional units in the storehouse in the corresponding at least test case implementation of each figure; Also have a graphical editing interface, patterned basic functional units is connected into flow chart; And many graphical interfaces, be used for the data and the attribute setting of each basic functional units; With all information translation of editing the test case that produces is the test case execute file;

The test case execute file that is generated by the test case development device is resolved and carried out to one test case final controlling element; According to the definition in the test case execute file, create the network connection and be connected with database; According to protocol definition information, carry out login, authentication and link maintenance flow process; The database manipulation that defines in the implementation of test cases execute file; Mutual with the test assignment management devices, accept the control of test assignment management devices;

One test assignment management devices transmits the test case execute file to the test case final controlling element; By the number of times of nominative testing time or execution testing process, editor's test assignment also orders the test case final controlling element to be carried out; The interface of revising the data in the test case is provided; The tracking message that acceptance test use-case final controlling element sends, and show to the user; After test assignment is complete, the statistics that the read test use-case produces, and be shown to the user with the form of chart.

2, the system as claimed in claim 1 is characterized in that, described graphical test case development device also comprises a communications protocol definition device, is used to provide a data input interface, with the critical field information in the definition agreement; Adopt described graphical interfaces storehouse and graphical editing interface, with login, authentication, the link maintenance flow process of editor's agreement regulation; The protocol definition information that generates can export as the protocol definition file separately, can import in different test cases and reuse.

3, the system as claimed in claim 1, it is characterized in that, described graphical test case development device also comprises a data definition device, be used for defining data and the memory cell that test case is carried out to be needed, comprise: management data, can revise by the test assignment management devices, with the control testing process; The session shared data offers exchange message between the different instances of same test case; The session private data is deposited session data and ephemeral data for the example of test case when moving.

4, the system as claimed in claim 1, it is characterized in that, described graphical test case development device comprises that also a network connects definition device, is used to be provided with information such as IP address that network connects needs, port numbers, and specifies this network to connect the procotol that goes up execution.

5, the system as claimed in claim 1 is characterized in that, described graphical test case development device also comprises an error detector element, and before generating test case, whether the attribute setting and the flow process that detect basic functional units be correct.

6, the system as claimed in claim 1, it is characterized in that, described graphical test case development device also comprises a test case execute file generating apparatus, and graphical test case flow process and all descriptors are converted to binary file, offers the test case final controlling element and carries out.

7, as the arbitrary described system of claim 1 to 6, it is characterized in that, described that the test case final controlling element also comprises a file interface device, to read and to resolve the test case descriptor in the test case execute file; A kind of multithreading time-division processing mechanism and task scheduling apparatus are assigned to each test case example in each thread and carry out according to the load principle of shared contribution by the task scheduling apparatus unification; One protocol execution means, login, authentication, the link maintenance flow process of definition in carrying on an agreement realize the versatility of the present invention to different communications protocol; One flow process tracking means, to the implementation status of test assignment management devices transmission trace information and detecting information and testing process, these information will be shown by the test assignment management devices.

8, as the arbitrary described system of claim 1 to 6, it is characterized in that, described test assignment management devices also comprises a test assignment editing device, and a test assignment comprises at least: the time that test case sign, test starting finish or the execution number of times of testing process; One test case management data editor, be used for the management data that shows that the test case execute file defines, the value that provides editing interface to revise management data with the communication of test case final controlling element, refreshes management data value in the execution environment with amended value; The tracking means that one test case is carried out shows the trace information that is sended over by the test case final controlling element to the user; An and test data statistic device.

9, a kind of universal testing method of telecommunication intelligent service is characterized in that, described method comprises the steps:

Define the data structure and the graph of a correspondence interface of the basic functional units of using in many tests;

Be connected to become flow chart by many basic functional units;

The data, procotol, network and the database that need in the definition flow process are connected, and define required statistical item;

Flow chart, data definition, protocol definition, network and database connection and statistical item definition are output as file;

Read information in the file by a final controlling element, and carry out flow process wherein; By a test assignment management devices,, provide the interface of revising data value to the user according to the data definition information in the file;

The test assignment management devices shows the trace information that final controlling element produces to the user in the process of execution flow process.

10, method of testing as claimed in claim 9 is characterized in that, also comprises the statistics of test data, and by defining a kind of data structure, this data structure comprises enough preliminary data items, and these data item can be given its meaning by the user, become statistical items; The statistical function unit is provided, and the user can upgrade defined statistical items by the statistical function unit when design cycle; By setting different test conditions, draw the test statistics data under the different condition, read these statisticss by the test assignment management devices, with chart etc. intuitively form show test results to the user.

Images