Integrating Mutation Techniques to Keep Specification and Source Code in Sync
Pages 1912 - 1914
Abstract
Most software development processes rely on testing for assuring that a software's source code is kept in sync with its specification during software evolution. In testing, the degree of conformance between source code and specification is measured by the test success rate. However, the practical value of this metric depends on the quality of the test suite, i.e., its completeness wrt. the specification and source code. Mutation testing has proved to be effective in assessing test suite completeness; however related work either considers mutating the source code or the specification. Our research will investigate how approaches based on mutating code and specification can be integrated to keep both in sync during software evolution. We aim to contribute (1) a concise method to measuring the degree of conformance between specification and code with each modification, (2) a technique for the identification and visualization of fine-granular trace links between them, and (3) an approach for suggesting updates of specification and code based on detected deviations between them.
References
[1]
2016. Deductive Software Verification - The KeY Book - From Theory to Practice, W. Ahrendt, B. Beckert, R. Bubel, R. Hähnle, P. H. Schmitt, and M. Ulbrich (Eds.) (LNCS, Vol. 10001). Springer. isbn:978-3-319-49811-9 https://doi.org/10.1007/978-3-319-49812-6
[2]
P. Ammann and P. E. Black. 1999. A Specification-Based Coverage Metric to Evaluate Test Sets. In 4th IEEE International Symposium on High-Assurance Systems Engineering (HASE ’99). IEEE Computer Society, 239–248. https://doi.org/10.1109/HASE.1999.809499
[3]
P. E. Black, V. Okun, and Y. Yesha. 2000. Mutation Operators for Specifications. In The Fifteenth IEEE International Conference on Automated Software Engineering, ASE 2000. IEEE Computer Society, 81. https://doi.org/10.1109/ASE.2000.873653
[4]
M. Borg, P. Runeson, and A. Ardö. 2014. Recovering from a decade: a systematic mapping of information retrieval approaches to software traceability. Empir. Softw. Eng., 19, 6 (2014), 1565–1616. https://doi.org/10.1007/S10664-013-9255-Y
[5]
R. J. Cajica, R. E. Gonzalez-Torres, and P. Mejía-Alvarez. 2021. Automatic Generation of Test Cases from Formal Specifications using Mutation Testing. In 18th International Conference on Electrical Engineering, Computing Science and Automatic Control, CCE 2021. IEEE, 1–6. https://doi.org/10.1109/CCE53527.2021.9633118
[6]
M.-C. Gaudel. 1995. Testing Can Be Formal, Too. In TAPSOFT’95: Theory and Practice of Software Development, 6th International Joint Conference CAAP/FASE (LNCS, Vol. 915). Springer, 82–96. https://doi.org/10.1007/3-540-59293-8_188
[7]
F. Hilken, M. Gogolla, L. Burgueño, and A. Vallecillo. 2018. Testing models and model transformations using classifying terms. Softw. Syst. Model., 17, 3 (2018), 885–912. https://doi.org/10.1007/S10270-016-0568-3
[8]
Y. Jia and M. Harman. 2011. An Analysis and Survey of the Development of Mutation Testing. IEEE Trans. Software Eng., 37, 5 (2011), 649–678. https://doi.org/10.1109/TSE.2010.62
[9]
K. Jin and K. Lano. 2022. Design and classification of mutation operators for OCL specification. In Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings, MODELS 2022, Montreal, Quebec, Canada, October 23-28, 2022, Thomas Kühn and Vasco Sousa (Eds.). ACM, 852–861. https://doi.org/10.1145/3550356.3561545
[10]
A. Sullivan, K. Wang, R. N. Zaeem, and S. Khurshid. 2017. Automated Test Generation and Mutation Testing for Alloy. In 2017 IEEE International Conference on Software Testing, Verification and Validation, ICST 2017. IEEE Computer Society, 264–275. https://doi.org/10.1109/ICST.2017.31
[11]
M. Utting, A. Pretschner, and B. Legeard. 2012. A taxonomy of model-based testing approaches. Softw. Test. Verification Reliab., 22, 5 (2012), 297–312. https://doi.org/10.1002/STVR.456
[12]
R. White and J. Krinke. 2022. TCTracer: Establishing test-to-code traceability links using dynamic and static techniques. Empir. Softw. Eng., 27, 3 (2022), 67. https://doi.org/10.1007/s10664-021-10079-1
[13]
C. S. Xia, Y. Wei, and L. Zhang. 2023. Automated Program Repair in the Era of Large Pre-trained Language Models. In 45th IEEE/ACM Intl. Conference on Software Engineering, ICSE 2023, Melbourne, Australia, May 14-20, 2023. IEEE, 1482–1494. https://doi.org/10.1109/ICSE48619.2023.00129
Index Terms
- Integrating Mutation Techniques to Keep Specification and Source Code in Sync
Recommendations
Formal mutation testing for Circus
Context: The demand from industry for more dependable and scalable test-development mechanisms has fostered the use of formal models to guide the generation of tests. Despite many advancements having been obtained with state-based models, such as Finite ...
Excluding code from test coverage: practices, motivations, and impact
AbstractTest coverage measures the percentage of code that is covered (and uncovered) by tests. In practice, not all code is equally important for coverage analysis, like code that will not be executed during tests. Some coverage tools provide support for ...
Combined Source Code Approach for Test Case Prioritization
ICISS '18: Proceedings of the 1st International Conference on Information Science and SystemsRegression testing is an activity in the software testing process to ensure the software is validated and verified after modification occurred on software. It is costly process procedure which has been expected to reach half cost of the software ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
1928 pages
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 September 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
ISSTA '24
Sponsor:
ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis
September 16 - 20, 2024
Vienna, Austria
Acceptance Rates
Overall Acceptance Rate 58 of 213 submissions, 27%
Upcoming Conference
ISSTA '25
- Sponsor:
- sigsoft
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 33Total Downloads
- Downloads (Last 12 months)33
- Downloads (Last 6 weeks)7
Reflects downloads up to 26 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in