Improved evolutionary generation of test data for multiple paths in search-based software testing
Authors: 
Ziming Zhu, Xiong Xu, Li JiaoAuthors Info & Claims
Pages 612 - 620
Abstract
Search-based software testing has achieved great attention recently, but the efficiency is still the bottleneck of it. This paper focuses on improving the efficiency of generating test data for multiple paths. Genetic algorithms are chosen as the heuristic algorithms in search-based software testing in this paper. First, we propose an improved grouping strategy of target paths to balance the load of each calculation resource. This work makes a contribution to the parallel execution in search-based software testing. Then, common constraints of the target paths in the same group are collected to reduce the search space of test data. Symbolic execution technique is used in this phase. Based on the reduced search space, we can accelerate the convergence of search process and improve the efficiency of search-based software testing. Finally, our method is applied to some study cases to compare with other methods.
References
[1]
G.J. Myers, “The art of software testing,” 1979.
[2]
J.H. Shan, J. Wang, and Q.I. Zhi-Chang, “Survey on path-wise automatic generation of test data,” Acta Electronica Sinica, 2004, 32 (1), pp. 109–113.
[3]
A. Watkins, E.M. Hufnagel, “Evolutionary test data generation: a comparison of fitness functions,” Software Practice and Experience, 2006, 36 (1), pp. 95–116.
[4]
J. Miller, M. Reformat, and H. Zhang, “Automatic test data generation using Genetic algorithm and program dependence graphs,” Information and Software Technology, 2006, 48 (7), pp. 586–605.
[5]
S. Xanthakis, C. Ellis, C. Skourlas, A. Le Gall, S. Katsikas, and K. Karapoulios, “Application of genetic algorithms to software testing,” in Proceedings of the 5th International Conference on Software Engineering and Applications, 1992, pp. 625–636.
[6]
B.F. Jones, H. Sthamer, and D.E. Eyres, “Automatic structural testing using genetic algorithms,” Software Engineering Journal, 1996, 11 (5), pp. 299–306.
[7]
A. Watkins, “The automatic generation of test data using genetic algorithms,” in Proceedings of the 4th Software Quality Conference, 1995, vol. 2, pp. 300–309.
[8]
H. Sthamer, “The automatic generation of software test data using genetic algorithms,” University of Glamorgan, 1996.
[9]
C.C. Michael, G. Mcgraw, and M.A. Schatz, “Generating software test data by evolution,” IEEE Transactions on Software Engineering, 2001, 27 (12), pp. 1085–1110.
[10]
K. Lakhotia, M. Harman, and H. Gross, “AUSTIN: An open source tool for search based software testing of C programs,” Information and Software Technology, 2013, 55 (1), pp. 112–125.
[11]
G. Fraser, A. Arcuri, “EvoSuite: automatic test suite generation for object-oriented software,” SIGSOFT/FSE'11, ACM Sigsoft Symposium on the Foundations of Software Engineering, 2011, pp. 416–419.
[12]
N. Tillmann, J. De Halleux, T. Xie, “Transferring an automated test generation tool to practice: from pex to fakes and code digger” Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering, ACM, 2014, pp. 385–396.
[13]
M.A. Ahmed, I. Hermadi, “GA-based multiple paths test data generator,” Computers and Operations Research, 2008, 35 (10), pp. 3107–3124.
[14]
Y. Cao, C.H. Hu, S.B. Chen, L.M. Li, “Automatic test data generation for multiple paths and its applications,” Computer Engineering and Applications, 2010, 46 (27), pp. 32–35.
[15]
M. Harman, Y. Jia, Y. Zhang, “Achievements, open problems and challenges for search based software testing,” IEEE International Conference on Software Testing, Verification and Validation, 2015, pp. 1–12.
[16]
D. Gong, W. Zhang, and Zhang, “Evolutionary generation of test data for multiple paths coverage,” Chinese Journal of Electronics, 2011, 19 (2), pp. 233–237.
[17]
D. Gong, T. Tian, and X. Yao, “Grouping target paths for evolutionary generation of test data in parallel,” Journal of Systems and Software, 2012, 85 (11), pp. 2531–2540.
[18]
R.M. Hierons, M. Li, X. Liu, S. Segura, W. Zhang, “SIP: optimal product selection from feature models using many-objective evolutionary optimization,” ACM Transactions on Software Engineering & Methodology, 2016, 25 (2): 17.
[19]
W. Zheng, R.M. Hierons, M. Li, X.H. Liu, V. Vinciotti, “Multi-objective optimisation for regression testing,” Information Sciences, 2016, 334, pp. 1–16.
[20]
P. Mcminn, “Search-based software testing: past, present and future,” in IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops, 2011, pp. 153–163.
[21]
L.A. Clarke, “A program testing system,” ACM'76 Proceedings of the 1976 Annual Conference, 1976, pp. 488–491.
[22]
A. Coen-Porisini, G. Denaro, C. Ghezzi, and M. Pezze, “Using symbolic execution for verifying safety-critical systems,” ACM Sigsoft Software Engineering Notes, 2001, 26 (5), pp. 142–151.
[23]
S. Khurshid, C.S. Păsăreanu, and W. Visser, “Generalized symbolic execution for model checking and testing,” Tools and Algorithms for the Construction and Analysis of Systems, Springer Berlin Heidelberg, 2003, pp. 553–568.
Index Terms
- Improved evolutionary generation of test data for multiple paths in search-based software testing
Index terms have been assigned to the content through auto-classification.
Recommendations
An Improved Crow Search Algorithm for Test Data Generation Using Search-Based Mutation Testing
AbstractAutomation of test data generation is of prime importance in software testing because of the high cost and time incurred in manual testing. This paper proposes an Improved Crow Search Algorithm (ICSA) to automate the generation of test suites ...
GA-based multiple paths test data generator
Developers have learned over time that software testing costs a considerable amount of a software project budget. Hence, software quality managers have been looking for solutions to reduce testing costs and time. Considering path coverage as the test ...
Beyond unit-testing in search-based test case generation: challenges and opportunities
SBST '19: Proceedings of the 12th International Workshop on Search-Based Software TestingOver the last decades, white-box search-based techniques have been applied to automate the design and the execution of test cases. While most of the research effort has been devoted to unit-level testing, integration-level test case generation requires ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Jun 2017
2814 pages
Copyright © 2017.
Publisher
IEEE Press
Publication History
Published: 05 June 2017
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in