CN109831353B - Automatic testing device for multiple network services - Google Patents
Automatic testing device for multiple network services Download PDFInfo
- Publication number
- CN109831353B CN109831353B CN201910058165.7A CN201910058165A CN109831353B CN 109831353 B CN109831353 B CN 109831353B CN 201910058165 A CN201910058165 A CN 201910058165A CN 109831353 B CN109831353 B CN 109831353B
- Authority
- CN
- China
- Prior art keywords
- test
- computer
- network
- data
- application data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an automatic testing device for multiple network services, which comprises: the virtual computer host system is used for generating first network application data; the computer diskless system is used for generating second network application data; the control host is connected with the virtual computer host system, the computer diskless system and the outlet gateway to be tested through a second network to form an automatic control loop; the control host is used for sending a test instruction, identifying and instructing the virtual computer host system and the computer diskless system to respectively generate first network application data and second network application data, respectively transmitting the first network application data and the second network application data to the outlet gateway to be tested for testing, collecting test data generated in the test process, returning the collected data to the control host, and generating a test report.
Description
Technical Field
The invention relates to the field of automatic testing, in particular to an automatic testing device for multiple network services.
Background
The Gateway (Gateway) is also called an internetwork connector and a protocol converter. The gateway realizes network interconnection above a network layer, is the most complex network interconnection equipment and is used for interconnection of two networks with different high-level protocols.
The egress gateway is an egress device of a lan network, and carries network forwarding and network resource allocation tasks. Today's network technology is developed, and the services faced by the exit gateway are not only web pages, Email and videos, but also handle data forwarding of various network applications, such as games, various apps, voice calls and the like. In this case, the service requirements of different local area networks may require that the egress gateway intelligently allocate bandwidth resources for the service. Therefore, the egress gateway device is subjected to various network traffic tests during the development process. And the problem of the exit gateway equipment can be found out more quickly and conveniently by adopting a reasonable and comprehensive service test.
The general automatic testing method in the industry needs expensive professional testing instruments as a basic platform and adopts a mode of simulating service data to test. The network data packets simulated by the test method are simple, and have a great difference with the complexity of the application and data packets in the actual network of a client.
In summary, in the process of implementing the technical solution of the present invention, the inventors of the present application find that the above-mentioned technology has at least the following technical problems:
the existing test method has the technical problems of inaccurate test and low test efficiency because the simulated network data packets are simple, have a great difference with the complexity of the application and the data packets in the actual network of a client and need a large amount of manual work.
Disclosure of Invention
In order to be closer to the actual network service scene of a user, the automatic testing device for the multiple services of the network is designed, the virtual computer host and the computer diskless system are used for completing the construction of a hardware platform, the method and the developed tool can be used for generating multiple real network service data flows at the same time, the testing result is accurate, automatic control is used for realizing autonomous data acquisition and analysis and rapidly obtaining a testing conclusion, the testing efficiency is high, unattended operation in the middle process can be realized, and the manpower input and the equipment input are reduced.
In order to achieve the above object, the present application provides an automatic testing apparatus for multiple services of a network, the apparatus comprising:
the virtual computer host system is used for generating first network application data, and the first network application data is as follows: web application data such as a web access class, an instant chat class, an audio client class and the like;
the computer diskless system is used for generating second network application data, and the second network application data is as follows: network application data such as games, video clients, resource downloads and the like;
the virtual computer host system, the computer diskless system and the outlet gateway to be tested are connected through the test service switch, and the virtual computer host system and the computer diskless system establish a test topology of the outlet gateway according to test requirements;
the control host is connected with the virtual computer host system, the computer diskless system and the outlet gateway to be tested through the automatic control switch to form an automatic control loop; the control host is used for sending a test instruction, identifying and instructing the virtual computer host system and the computer diskless system to respectively generate first network application data and second network application data, respectively transmitting the first network application data and the second network application data to the outlet gateway to be tested for testing, collecting test data generated in the test process, returning the collected data to the control host, and generating a test report.
Further, the virtual computer host system and the computer diskless system build a test topology of the exit gateway according to the test requirements, which specifically includes:
step 1: referring to fig. 2, the virtual host system virtualizes a plurality of computer hosts and generates a first type of network application data. And the computer diskless system starts a plurality of diskless computer hosts to generate second-type network application data. And the test service switch is accessed to the test service switch through the network port and is connected to the LAN port of the exit gateway.
Step 2: the multiple WAN ports of the exit gateway are respectively connected with 1 Internet line provided by different operators.
Further, the step of respectively transmitting the first network application data and the second network application data to an outlet gateway to be tested for testing specifically includes: testing webpage opening delay, game delay, video blocking times, downloading speed, export gateway multi-WAN intelligent scheduling stability and the like.
Further, the test flow of the automatic test device is as follows:
step 1: building a test environment, and installing corresponding network software and a client corresponding to a control host in a virtual computer host system and a computer diskless system;
step 2: planning the number of the computer hosts to be tested, and starting up; the control host automatically scans the test computer in the network and returns the condition of the online test computer in the log display area;
and step 3: when all the test computer hosts are confirmed to be normally controlled and connected with the wireless network, scanning the test scripts into a warehouse;
and 4, step 4: selecting a script to be tested from a library, clicking to run, carrying out test tasks of different services by a control host based on the test script, and displaying a log generated in the current test running process in a log display area;
and 5: and after the test script is operated, displaying the test report of the test in the test report display area.
Furthermore, the test script defines the network service required by each test computer host, the content of each script can be checked by scanning the test script, and the test script can be customized.
Further, the log displayed in the log display area comprises abnormal information in the running process.
Furthermore, the automatic control software in the control host adopts an object-oriented programming mode, the control host sends a test instruction, a RemotePc object in Testbed is called corresponding to the test script, the RemotePc object corresponds to each virtual computer host system computer host or computer diskless system computer host, RemotePc shares the same API object and is used for operating the computer to open a webpage, watch videos, play games, listen sounds and the like, and collecting network delay, game delay and video morton number test data in the webpage opening.
The test comprises the following generation process: the control host collects various data generated on the virtual computer and the diskless computer, and displays brief data of each test item and whether the brief data passes or not in the test report display area; after a button for exporting the test report is clicked, a detailed test report in an HTML format is generated according to results, and the detailed test report comprises test time, test environment, the name of each test item, test steps, test data, judgment standards and information about whether the test items pass or not.
One or more technical solutions provided by the present application have at least the following technical effects or advantages:
the application provides an automatic testing device for various real network service data, which can effectively restore the internet surfing environment of a user and test the pressure, performance, function and stability of an outlet gateway.
Through the automatic control software in the device, the manpower and the test time required by the test are reduced, the script is customized, great convenience is brought to testers, and the script is flexibly used for carrying out various tests.
In addition, the virtual host technology and the computer diskless technology are adopted in the whole device aiming at light and heavy applications, so that the hardware cost is reduced, and the number of computer hosts capable of participating in the test is increased.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention;
FIG. 1 is a diagram of a control software framework in a control host;
FIG. 2 is a schematic diagram of a test logic topology;
FIG. 3 is a schematic diagram of a control software execution flow;
FIG. 4 is a control software interface schematic.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflicting with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described and thus the scope of the present invention is not limited by the specific embodiments disclosed below.
Referring to fig. 1 to 4, in order to implement generating actual data of a plurality of network services, an implementation manner in the present application includes:
(1) a set of virtual computer host system is established for generating network application data (hereinafter, collectively referred to as light application) with low requirements on computer hardware, for example: QQ chat, access to web pages, listening to network songs, etc.; in addition, a set of computer diskless system is set up for generating network application data (hereinafter, collectively referred to as heavy application) with high requirements on computer hardware, such as playing network games, watching live broadcasts, watching network videos, downloading BT resources and the like.
(2) And building a test topology of the outlet gateway according to the test requirements for all the virtual computer hosts and the diskless computer host in the system. Preparing a control host computer, and connecting all the devices by using another set of Ethernet to generate an automatic control loop; and realizing the separation of control data and service data participating in the test.
(3) Compiling automatic control software, sending a test instruction by the control host, identifying and instructing the virtual computer host and the diskless computer host to start and operate various network application software, generating real service data for testing, collecting test data generated in the test process, returning the test data to the control host through a control protocol, and generating a test report. The automation control software is written by Python, and a communication protocol can be customized during control, such as mainstream json and rpyc technologies.
(4) The automation control software adopts an object-oriented programming mode, such as the mode shown in figure 1.
A. The test script object is an object which can be directly run by the driving module after a user can operate on the interface.
B. And the control host sends a test instruction, and calls a RemotePc object in the Testbed corresponding to the test script.
C. The RemotePc object corresponds to each computer host (each virtual computer host or one diskless computer host is a computer host in the system). RemotePc shares the same API object, such as Pyweb, for operating a computer to open a web page, and collecting test data generated in the open web page, etc.
The specific implementation of the device is as follows.
Step 1: according to the figure 3, a test environment is set up, and the precondition of the computer diskless system and the virtual computer system is as follows: corresponding network software such as QQ, a browser, a thunder, various video clients, games and the like is installed; and simultaneously, a client of automation control software is installed.
Step 2: planning the number of the computer hosts to be tested, and starting up. The control computer host is controlled to open control software, such as the interface shown in fig. 4. The control software will automatically scan the hosts in the network and return the situation of online hosts in the log display area, at this time the user needs to check whether all hosts are online.
And step 3: when all the computer hosts are confirmed to be normally controlled and connected with the wireless network, the computer hosts can be controlled to carry out different service test tasks. Each script defines the network service required by each computer host, and after the script passes the scanning, a tester can check the content of each script. The tester can also define the script content, and is convenient and flexible.
And 4, step 4: and selecting the script to be tested according to the actual situation, and clicking to run. The generated log of the current test operation process is displayed in the log display area. Including exception information during operation.
And 5: after the operation is finished, a brief report and data of the test are displayed in the test report display area. If a detailed test report and a test report document are needed, the test report is exported by clicking, and detailed data and the test report document of the word version in the test process and a log file generated in the test process can be seen.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. An apparatus for automated testing of multiple services on a network, the apparatus comprising:
the virtual computer host system is used for generating first network application data, and the first network application data is as follows: webpage access data, instant chat data and audio client data;
the computer diskless system is used for generating second network application data, and the second network application data is as follows: game data, video client data and resource downloading data;
the virtual computer host system, the computer diskless system and the outlet gateway to be tested are connected through a first network, and the virtual computer host system and the computer diskless system establish a test topology of the outlet gateway according to test requirements;
the control host is connected with the virtual computer host system, the computer diskless system and the outlet gateway to be tested through a second network to form an automatic control loop;
the control host is internally provided with control software, the control software is used for sending a test instruction, identifying and instructing the virtual computer host system and the computer diskless system to respectively generate first network application data and second network application data, and respectively transmitting the first network application data and the second network application data to the outlet gateway to be tested for testing;
the control software collects the test data generated in the test process and returns the collected test data to the control host computer through the control protocol to generate a test report.
2. The apparatus according to claim 1, wherein the virtual computer host system and the computer diskless system build a test topology of the egress gateway according to a test requirement, and the apparatus specifically comprises:
step 1: the virtual computer host system virtualizes a plurality of computer hosts and generates first-class network application data; starting a plurality of diskless computer hosts by the diskless computer system to generate second-type network application data; the test service switch is accessed through the network port and is connected to the LAN port of the exit gateway;
step 2: the multiple WAN ports of the exit gateway are respectively connected with 1 Internet line provided by different operators.
3. The apparatus for automatically testing multiple services in a network according to claim 1, wherein the step of transmitting the first network application data and the second network application data to the egress gateway to be tested for testing comprises: and testing the webpage opening delay, the game delay, the video blocking times, the downloading speed and the multi-line intelligent dispatching stability of the exit gateway.
4. The automatic testing device for multiple services in a network according to claim 1, wherein the testing process of the automatic testing device is as follows:
step 1: building a test environment, and installing corresponding network software and a client corresponding to a control host in a virtual computer host system and a computer diskless system;
step 2: planning the number of the computer hosts to be tested, and starting up; the control host automatically scans the test computer in the network and returns the condition of the online test computer in the log display area;
and step 3: when all the test computer hosts are confirmed to be normally controlled and connected with the wireless network, scanning the test scripts into a warehouse;
and 4, step 4: selecting a script to be tested from a library, clicking to run, carrying out test tasks of different services by a control host based on the test script, and displaying a log generated in the current test running process in a log display area;
and 5: and after the test script is operated, displaying the test report of the test in the test report display area.
5. The apparatus according to claim 4, wherein the test script defines the network services required by each test computer, and the content of each script can be checked by scanning the test script, so that the test script can be customized.
6. The apparatus according to claim 4, wherein the log displayed in the log display area includes abnormal information during operation.
7. The apparatus according to claim 4, wherein the control host collects data items generated from the virtual computer and the diskless computer, and displays the brief data of each test item and whether the test item passes or not in the test report display area; after a button for exporting the test report is clicked, a detailed test report in an HTML format is generated according to results, and the detailed test report comprises test time, test environment, the name of each test item, test steps, test data, judgment standards and information about whether the test items pass or not.
8. The automatic testing device of network multi-service of claim 1, wherein the automatic control software in the control host uses an object-oriented programming method, the control host sends a test command, calls a RemotePc object in Testbed corresponding to the test script, the RemotePc object corresponds to each virtual computer host system computer host or computer diskless system computer host, the RemotePc shares the same API object for operating the computer to open a web page, watch a video, play a game, listen to a sound, and collect the test data of network delay, game delay, and video morton times in the open web page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910058165.7A CN109831353B (en) | 2019-01-22 | 2019-01-22 | Automatic testing device for multiple network services |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910058165.7A CN109831353B (en) | 2019-01-22 | 2019-01-22 | Automatic testing device for multiple network services |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109831353A CN109831353A (en) | 2019-05-31 |
| CN109831353B true CN109831353B (en) | 2020-09-15 |
Family
ID=66861775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910058165.7A Active CN109831353B (en) | 2019-01-22 | 2019-01-22 | Automatic testing device for multiple network services |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109831353B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581065B (en) * | 2020-04-13 | 2023-08-01 | 微梦创科网络科技（中国）有限公司 | Mobile terminal message partial pressure test system and method based on live broadcast scene |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1549541A (en) * | 2003-05-21 | 2004-11-24 | 华为技术有限公司 | Method and apparatus for automatic testing media gateway |
| CN101944129A (en) * | 2010-09-21 | 2011-01-12 | 广东威创视讯科技股份有限公司 | Diskless system, workstation thereof, and building method of local root file by workstation |
| CN104053164A (en) * | 2013-03-14 | 2014-09-17 | 深圳先进技术研究院 | Internet-of-things gateway testing system and method |
| CN109218139A (en) * | 2018-10-23 | 2019-01-15 | 京信通信系统（中国）有限公司 | Gateway test macro |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7516216B2 (en) * | 2001-10-01 | 2009-04-07 | Ixia | Generating traffic for testing a system under test |
| CN102546807B (en) * | 2012-01-17 | 2015-06-17 | 胡建鹤 | Network service system based on cloud computing architecture |
-
2019
- 2019-01-22 CN CN201910058165.7A patent/CN109831353B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1549541A (en) * | 2003-05-21 | 2004-11-24 | 华为技术有限公司 | Method and apparatus for automatic testing media gateway |
| CN101944129A (en) * | 2010-09-21 | 2011-01-12 | 广东威创视讯科技股份有限公司 | Diskless system, workstation thereof, and building method of local root file by workstation |
| CN104053164A (en) * | 2013-03-14 | 2014-09-17 | 深圳先进技术研究院 | Internet-of-things gateway testing system and method |
| CN109218139A (en) * | 2018-10-23 | 2019-01-15 | 京信通信系统（中国）有限公司 | Gateway test macro |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109831353A (en) | 2019-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110351156B (en) | Test method and device | |
| US7099438B2 (en) | Multi-protocol, multi-interface communications device testing system | |
| Peuster et al. | MeDICINE: Rapid prototyping of production-ready network services in multi-PoP environments | |
| CN106445811B (en) | A kind of automatization test system and method based on SecureCRT | |
| US8737980B2 (en) | End to end application automatic testing | |
| EP0947074B1 (en) | Network manager providing advanced interconnection capability | |
| US11405302B1 (en) | Methods, systems, and computer readable media for network testing using configurable test infrastructure | |
| US11032126B2 (en) | Diagnostic traffic generation for automatic testing and troubleshooting | |
| CN108234246B (en) | Method and system for multi-directionally testing network performance of server | |
| CN109525461A (en) | A kind of test method of the network equipment, device, equipment and storage medium | |
| CN101847118A (en) | Automatic test system | |
| CN110048761A (en) | One kind is towards batch production satellite data transmission ground automation high speed data processing analysis system | |
| CN106535240B (en) | Mobile APP centralized performance analysis method based on cloud platform | |
| CN111522727A (en) | Simulation object test method, device and system | |
| CN106815150B (en) | Server-side interface test system and method | |
| CN109831353B (en) | Automatic testing device for multiple network services | |
| CN107844486A (en) | A kind of method and system of analysis webpage problem for client | |
| CN102750143A (en) | Digital signal processing (DSP) developing method based on matrix laboratory (MATLAB) component object model (COM) component calling | |
| CN112583663B (en) | Automatic network performance testing method based on domestic operating system | |
| CN117632089A (en) | Algorithm model reasoning service agility development method based on real-time streaming data | |
| CN110445691B (en) | Method and device for testing network service transmission performance by combining customization and playback | |
| CN112866682A (en) | Audio and video quality evaluation system and method, computer equipment and storage medium | |
| US20240069099A1 (en) | Methods, systems, and computer readable media for using a testbed transpiler | |
| CN113923146B (en) | Visual block chain consensus algorithm performance test method | |
| CN102420722A (en) | Comprehensive networking automation test method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |