Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/2821339.2821352acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

A novelty search approach for automatic test data generation

Published: 16 May 2015 Publication History

Abstract

In search-based structural testing, metaheuristic search techniques have been frequently used to automate the test data generation. In Genetic Algorithms (GAs) for example, test data are rewarded on the basis of an objective function that represents generally the number of statements or branches covered. However, owing to the wide diversity of possible test data values, it is hard to find the set of test data that can satisfy a specific coverage criterion. In this paper, we introduce the use of Novelty Search (NS) algorithm to the test data generation problem based on statement-covered criteria. We believe that such approach to test data generation is attractive because it allows the exploration of the huge space of test data within the input domain. In this approach, we seek to explore the search space without regard to any objectives. In fact, instead of having a fitness-based selection, we select test cases based on a novelty score showing how different they are compared to all other solutions evaluated so far.

References

[1]
M. Roper, "Computer aided software testing using genetic algorithms," 10th International Quality Week, 1997.
[2]
A. L. Watkins, "The automatic generation of test data using genetic algorithms," in Proceedings of the 4th Software Quality Conference, vol. 2, 1995, pp. 300--309.
[3]
W. Banzhaf, F. D. Francone, and P. Nordin, "The effect of extensive use of the mutation operator on generalization in genetic programming using sparse data sets," in Parallel Problem Solving from NaturePPSN IV. Springer, 1996, pp. 300--309.
[4]
C. Gathercole and P. Ross, "An adverse interaction between crossover and restricted tree depth in genetic programming," in Proceedings of the 1st annual conference on genetic programming. MIT Press, 1996, pp. 291--296.
[5]
M. Harman and P. McMinn, "A theoretical and empirical study of search-based testing: Local, global, and hybrid search," Software Engineering, IEEE Transactions on, vol. 36, no. 2, pp. 226--247, 2010.
[6]
T. Y. Chen, F.-C. Kuo, R. G. Merkel, and T. Tse, "Adaptive random testing: The art of test case diversity," Journal of Systems and Software, vol. 83, no. 1, pp. 60--66, 2010.
[7]
M. Harman, L. Hu, R. M. Hierons, A. Baresel, and H. Sthamer, "Improving evolutionary testing by flag removal." in GECCO, 2002, pp. 1359--1366.
[8]
J. Lehman and K. O. Stanley, "Exploiting open-endedness to solve problems through the search for novelty." in ALIFE, 2008, pp. 329--336.
[9]
S. Risi, C. E. Hughes, and K. O. Stanley, "Evolving plastic neural networks with novelty search," Adaptive Behavior, vol. 18, no. 6, pp. 470--491, 2010.
[10]
P. Krčah, "Solving deceptive tasks in robot body-brain co-evolution by searching for behavioral novelty," in Advances in Robotics and Virtual Reality. Springer, 2012, pp. 167--186.
[11]
P. R. Srivastava, "Test case prioritization," Journal of Theoretical and Applied Information Technology, vol. 4, no. 3, pp. 178--181, 2008.

Cited By

View all
  • (undefined)Automated Test Suite Generation for Software Product Lines based on Quality-Diversity OptimisationACM Transactions on Software Engineering and Methodology10.1145/3628158

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SBST '15: Proceedings of the Eighth International Workshop on Search-Based Software Testing
May 2015
68 pages

Sponsors

Publisher

IEEE Press

Publication History

Published: 16 May 2015

Check for updates

Qualifiers

  • Research-article

Conference

ICSE '15
Sponsor:

Upcoming Conference

ICSE 2025

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (undefined)Automated Test Suite Generation for Software Product Lines based on Quality-Diversity OptimisationACM Transactions on Software Engineering and Methodology10.1145/3628158

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media