short-paper

Test2Feature: feature-based test traceability tool for highly configurable software

Authors:

Willian D. F. Mendonça,

Silvia R. Vergilio,

Gabriela K. Michelon,

Alexander Egyed,

Wesley K. G. AssunçãoAuthors Info & Claims

SPLC '22: Proceedings of the 26th ACM International Systems and Software Product Line Conference - Volume B

Pages 62 - 65

https://doi.org/10.1145/3503229.3547031

Published: 12 September 2022 Publication History

Abstract

To ensure the quality of Highly Configurable Software (HCS) in an evolution and maintenance scenario is a challenging task. As HCSs evolve, new features are added, changed, or removed, which hampers the selection and evolution of test cases. The use of test traceability reports can help in this task, but there is a lack of studies addressing HCS test-to-feature traceability. Existing work usually are based on the variability model, which is not always available or updated. Some tools only link test cases to code lines. Considering this gap, this paper introduces Test2Feature, a tool that traces test cases to features using the source code of annotated HCSs, written in C/C++. The tool produces the following outputs: the code lines that correspond to each feature, the lines that correspond to each test case, and the test cases that are linked to each feature. Test2Feature is based only on the static analysis of the code. The traceability report produced can be used to ease different tasks related, for instance, to regression testing, feature management, and HCS evolution and maintenance.

References

[1]

M. Al-Hajjaji, J. Meinicke, S. Krieter, R. Schröter, T. Thüm, T. Leich, and G. Saake. 2016. Tool demo: testing configurable systems with featureIDE. In GPCE. 173--177.

Digital Library

[2]

S. Apel, H. Speidel, P. Wendler, A. Von Rhein, and D. Beyer. 2011. Detection of feature interactions using feature-aware verification. In ASE. IEEE, 372--375.

Digital Library

[3]

D. Benavides, S. Segura, P. Trinidad, and A. Ruiz-Cortés. 2006. Using Java CSP Solvers in the Automated Analyses of Feature Models. Springer, 399--408.

Digital Library

[4]

G. Cavarlé, A. Plantec, S. Costiou, and V. Ribaud. 2018. A feature-oriented model-driven engineering approach for the early validation of feature-based applications. Science of Computer Programming 161 (2018), 18--33.

Digital Library

[5]

F. Ferreira, J. P. Diniz, C. Silva, and E. Figueiredo. 2019. Testing tools for configurable software systems: A review-based empirical study. In VAMOS. 1--10.

[6]

C. Henard, M. Papadakis, and Y. L. Traon. 2014. Mutation-based generation of software product line test configurations. In SSBSE. Springer, 92--106.

[7]

Martin Fagereng Johansen, Øystein Haugen, and Franck Fleurey. 2011. Properties of realistic feature models make combinatorial testing of product lines feasible. In Model Driven Engineering Languages and Systems. Springer, 638--652.

[8]

C. H. P. Kim, D. S. Batory, and S. Khurshid. 2011. Reducing combinatorics in testing product lines. In AOSD. 57--68.

Digital Library

[9]

Chang Hwan Peter Kim, Sarfraz Khurshid, and Don Batory. 2012. Shared Execution for Efficiently Testing Product Lines. In 23rd SSRE. 221--230.

Digital Library

[10]

K. Ludwig, J. Krüger, and T. Leich. 2019. Covert and phantom features in annotations: do they impact variability analysis?. In SPLC. ACM, 31:1--31:13.

Digital Library

[11]

D. Marijan, A. Gotlieb, S. Sen, and A. Hervieu. 2013. Practical pairwise testing for software product lines. In 17th SPLC. 227--235.

Digital Library

[12]

J. Meinicke, C. Wong, C. Kästner, T. Thüm, and G. Saake. 2016. On essential configuration complexity: Measuring interactions in highly-configurable systems. In ASE. 483--494.

Digital Library

[13]

G. K. Michelon, W. K. G. Assunção, D. Obermann, L. Linsbauer, P. Grünbacher, and A. Egyed. 2021. The life cycle of features in highly-configurable software systems evolving in space and time. In GPCE. ACM, 2--15.

Digital Library

[14]

G. K. Michelon, D Obermann, W. K. G. Assunção, L. Linsbauer, P. Grünbacher, and A. Egyed. 2020. Mining Feature Revisions in Highly-Configurable Software Systems. In SPLC. ACM, 74--78.

Digital Library

[15]

G. K. Michelon, D. Obermann, W. K. G. Assunção, L. Linsbauer, P. Grünbacher, S. Fischer, R. E. Lopez-Herrejon, and A. Egyed. 2022. Evolving software system families in space and time with feature revisions. Empirical Software Engineering 27, 5 (May 2022).

Digital Library

[16]

M. Mukelabai, D. Nešiundefined, S. Maro, T. Berger, and J. Steghöfer. 2018. Tackling Combinatorial Explosion: A Study of Industrial Needs and Practices for Analyzing Highly Configurable Systems. In ASE. ACM, 155--166.

Digital Library

[17]

T. Schiex and S. de Givry (Eds.). 2019. Principles and Practice of Constraint Programming. LNCS '19, Vol. 11802. Springer.

Digital Library

[18]

S. Souto, M. d'Amorim, and R. Gheyi. 2017. Balancing soundness and efficiency for practical testing of configurable systems. In ICSE. IEEE, 632--642.

Digital Library

[19]

H. Tufail, M. F. Masood, B. Zeb, F. Azam, and M. W. Anwar. 2017. A systematic review of requirement traceability techniques and tools. In 2nd ICSRS. 450--454.

[20]

A. von Rhein, A. Grebhahn, S. Apel, N. Siegmund, D. Beyer, and T. Berger. 2015. Presence-condition Simplification in Highly Configurable Systems. In ICSE. IEEE, 178--188.

Cited By

Douglas Ferrari Mendonça WAssunção WVergilio S(2024)Feature-oriented Test Case Prioritization Strategies: An Evaluation for Highly Configurable SystemsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672592(72-83)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672592
Landsberg TDietrich CLohmann D(2024)Should I Bother? Fast Patch Filtering for Statically-Configured Software VariantsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672585(12-23)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672585
Mendonça WAssunção WVergilio S(2024)Feature-oriented test case selection and prioritization during the evolution of highly-configurable systemsJournal of Systems and Software10.1016/j.jss.2024.112157217(112157)Online publication date: Nov-2024
https://doi.org/10.1016/j.jss.2024.112157
Show More Cited By

Index Terms

Test2Feature: feature-based test traceability tool for highly configurable software
1. Software and its engineering
  1. Software creation and management
    1. Software development techniques
      1. Reusability
        Software product lines
    2. Software verification and validation
      1. Process validation
        Traceability
      2. Software defect analysis
        Software testing and debugging
  2. Software notations and tools
    1. Software maintenance tools

Recommendations

Adaptive Test-Case Prioritization Guided by Output Inspection
COMPSAC '13: Proceedings of the 2013 IEEE 37th Annual Computer Software and Applications Conference

Test-case prioritization is to schedule the execution order of test cases so as to maximize some objective (e.g., revealing faults early). The existing test-case prioritization approaches separate the process of test-case prioritization and the process ...
Regression Test Generation Approach Based on Tree-Structured Analysis
ICCSA '10: Proceedings of the 2010 International Conference on Computational Science and Its Applications

Regression test generation is an important process to make sure that changes of program have no unintended side-effects. To achieve full confidence, many projects have to re-run all the test cases for entire program, which makes it a time consuming and ...
Recommendation and Regression Test Suite Optimization Using Heuristic Algorithms
ISEC '15: Proceedings of the 8th India Software Engineering Conference

In the Software Development Life Cycle, testing is an integral and important phase. It is estimated that close to 45% of project cost is marked for testing. Defect removal efficiency is directly proportional to the rigor of the testing and number of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SPLC '22: Proceedings of the 26th ACM International Systems and Software Product Line Conference - Volume B

September 2022

246 pages

ISBN:9781450392068

DOI:10.1145/3503229

General Chairs:
Alexander Felfernig
Graz University of Technology, Austria
,
Lidia Fuentes
University of Málaga, Spain

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

CAPES
CNPq
LIT Secure and Correct Systems Lab
FAPERJ

Conference

SPLC '22

Sponsor:

SIGSOFT

SPLC '22: 26th ACM International Systems and Software Product Line Conference

September 12 - 16, 2022

Graz, Austria

Acceptance Rates

SPLC '22 Paper Acceptance Rate 14 of 41 submissions, 34%;

Overall Acceptance Rate 167 of 463 submissions, 36%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
87
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Reflects downloads up to 17 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Douglas Ferrari Mendonça WAssunção WVergilio S(2024)Feature-oriented Test Case Prioritization Strategies: An Evaluation for Highly Configurable SystemsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672592(72-83)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672592
Landsberg TDietrich CLohmann D(2024)Should I Bother? Fast Patch Filtering for Statically-Configured Software VariantsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672585(12-23)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672585
Mendonça WAssunção WVergilio S(2024)Feature-oriented test case selection and prioritization during the evolution of highly-configurable systemsJournal of Systems and Software10.1016/j.jss.2024.112157217(112157)Online publication date: Nov-2024
https://doi.org/10.1016/j.jss.2024.112157
Michelon GAssunção WGrünbacher PEgyed A(2023)Analysis and Propagation of Feature Revisions in Preprocessor-based Software Product Lines2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)10.1109/SANER56733.2023.00035(284-295)Online publication date: Mar-2023
https://doi.org/10.1109/SANER56733.2023.00035

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents