Beyond unit-testing in search-based test case generation: challenges and opportunities
Pages 7 - 8
Abstract
Over the last decades, white-box search-based techniques have been applied to automate the design and the execution of test cases. While most of the research effort has been devoted to unit-level testing, integration-level test case generation requires to solve several open challenges, such as the combinatorial explosion of conditions or pre-condition failures. This paper summarizes these challenges in white-box testing and highlights possible research directions to overcome them.
References
[1]
L. Briand et al. "An investigation of graph-based class integration test order strategies." IEEE Transactions on Software Engineering, vol. 29, issue 7, 2003, pp. 594--607.
[2]
A. Arcuri."RESTful API Automated Test Case Generation with Evo-Master." ACM Transactions on Software Engineering and Methodology (TOSEM) vol. 28, issue 1, 2019, pp. 1--37.
[3]
J. Zhenyi, and J. Offutt, "Coupling-based criteria for integration testing." Software Testing, Verification and Reliability, vol. 8, issue 3, 1998, pp. 133--154.
[4]
A. Amann et al. "A Systematic Evaluation of Static API-Misuse Detectors." IEEE Transactions on Software Engineering, 2018.
[5]
J. Castelein et al. "Search-based test data generation for SQL queries." In Proceedings of the 40th International Conference on Software Engineering (ICSE), 218, pp. 1220--1230.
[6]
M. Emmi et al. "Dynamic test input generation for database applications". Proceedings of the international symposium on Software testing and analysis, 2007.
[7]
A. Arcuri et al. "Private api access and functional mocking in automated unit test generation." IEEE international conference on software testing, verification and validation (ICST), 2017.
[8]
M. Soltani et al. "Search-Based Crash Reproduction and Its Impact on Debugging." IEEE Transactions on Software Engineering, 2018.
[9]
A. Panichella et al. "A large scale empirical comparison of state-of-the-art search-based test case generators." Information and Software Technology, vol. 104, 2018, pp.236--256.
[10]
J. Campos et al. "An empirical evaluation of evolutionary algorithms for unit test suite generation". Information and Software Technology, vol. 104, 2018, pp. 207--235.
[11]
K. Lakhotia et al. "A multi-objective approach to search-based test data generation," The 9th International Conference on Genetic an Evolutionary Computation (GECCO), 2007.
[12]
J. Ferrer et al. "Evolutionary algorithms for the multi-objective test data generation problem." Software: Practice and Experience, vol. 42, issue 11, 2012, pp. 1331--1362,
[13]
P. Huang et al. "Performance Regression Testing Target Prioritization via Performance Risk Analysis," in Proceedings of the 36th International Conference on Software Engineering (ICSE), 2014.
[14]
P. McMinn. "Search-based software test data generation: a survey" Software testing, Verification and reliability, vol. 4, issue 2, 2004, pp. 105--156.
[15]
U. R. Molina et al. "Java unit testing tool competition-sixth round." IEEE/ACM 11th International Workshop on Search-Based Software Testing (SBST), 2018.
[16]
A. Panichella, U. R, Molina. "Java unit testing tool competition-fifth round." IEEE/ACM 10th International Workshop on Search-Based Software Testing (SBST), 2017.
[17]
A. M. Moein et al. "An industrial evaluation of unit test generation: Finding real faults in a financial application." The 39th International Conference on Software Engineering: Software Engineering in Practice Track, pp. 263--272, 2017.
[18]
S. Panichella et al. "The impact of test case summaries on bug fixing performance: An empirical investigation." The 38th International Conference on Software Engineering (ICSE), pp. 547--558, 2016.
[19]
G. Grano et al. "Branch coverage prediction in automated testing.", Journal of Software: Evolution and Process, 2019.
Recommendations
An orchestrated survey of methodologies for automated software test case generation
Test case generation is among the most labour-intensive tasks in software testing. It also has a strong impact on the effectiveness and efficiency of software testing. For these reasons, it has been one of the most active research topics in software ...
Achieving scalable mutation-based generation of whole test suites
Without complete formal specification, automatically generated software tests need to be manually checked in order to detect faults. This makes it desirable to produce the strongest possible test set while keeping the number of tests as small as ...
Toward granular search-based automatic unit test case generation
AbstractUnit testing verifies the presence of faults in individual software components. Previous research has been targeting the automatic generation of unit tests through the adoption of random or search-based algorithms. Despite their effectiveness, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sponsors
- SIGSOFT: ACM Special Interest Group on Software Engineering
- IEEE-CS: Computer Society
Publisher
IEEE Press
Publication History
Published: 27 May 2019
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ICSE '19
Sponsor:
- SIGSOFT
- IEEE-CS
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 121Total Downloads
- Downloads (Last 12 months)14
- Downloads (Last 6 weeks)1
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in