research-article

A classification of product sampling for software product lines

Authors:

Mahsa Varshosaz,

Mustafa Al-Hajjaji,

Mohammad Reza Mousavi,

Ina SchaeferAuthors Info & Claims

SPLC '18: Proceedings of the 22nd International Systems and Software Product Line Conference - Volume 1

Pages 1 - 13

https://doi.org/10.1145/3233027.3233035

Published: 10 September 2018 Publication History

Abstract

The analysis of software product lines is challenging due to the potentially large number of products, which grow exponentially in terms of the number of features. Product sampling is a technique used to avoid exhaustive testing, which is often infeasible. In this paper, we propose a classification for product sampling techniques and classify the existing literature accordingly. We distinguish the important characteristics of such approaches based on the information used for sampling, the kind of algorithm, and the achieved coverage criteria. Furthermore, we give an overview on existing tools and evaluations of product sampling techniques. We share our insights on the state-of-the-art of product sampling and discuss potential future work.

References

[1]

Iago Abal, Jean Melo, Stefan Stănciulescu, Claus Brabrand, Márcio Ribeiro, and Andrzej Wąsowski. 2018. Variability Bugs in Highly Configurable Systems: A Qualitative Analysis. Trans. Software Engineering and Methodology (TOSEM) 26, 3, Article 10 (Jan. 2018), 10:1--10:34 pages.

Digital Library

[2]

Mustafa Al-Hajjaji, Sebastian Krieter, Thomas Thüm, Malte Lochau, and Gunter Saake. 2016. IncLing: Efficient Product-line Testing Using Incremental Pairwise Sampling. In Proc. Int'l Conf. Generative Programming: Concepts & Experiences (GPCE). ACM, New York, NY, USA, 144--155.

Digital Library

[3]

Mustafa Al-Hajjaji, Jens Meinicke, Sebastian Krieter, Reimar Schröter, Thomas Thüm, Thomas Leich, and Gunter Saake. 2016. Tool Demo: Testing Configurable Systems with FeatureIDE. In Proc. Int'l Conf. Generative Programming: Concepts & Experiences (GPCE). ACM, New York, NY, USA, 173--177.

Digital Library

[4]

Paolo Arcaini, Angelo Gargantini, and Paolo Vavassori. 2015. Generating Tests for Detecting Faults in Feature Models. In Proc. Int'l Conf. Software Testing, Verification and Validation (ICST). IEEE, 1--10.

[5]

Anastasia Cmyrev and Ralf Reissing. 2014. Efficient and Effective Testing of Automotive Software Product Lines. 7, 2 (2014).

[6]

Thiago N. Ferreira, Josiel Neumann Kuk, Aurora Pozo, and Silvia Regina Vergilio. 2016. Product Selection Based on Upper Confidence Bound MOEA/D-DRA for Testing Software Product Lines. In Proc. Congress Evolutionary Computation (CEC). IEEE, Piscataway, NJ, USA, 4135--4142.

[7]

Alireza Ensan, Ebrahim Bagheri, Mohsen Asadi, Dragan Gasevic, and Yevgen Biletskiy. 2011. Goal-Oriented Test Case Selection and Prioritization for Product Line Feature Models. In Proc. Inte'l Conf. Information Technology:New Generations (ITNG). IEEE, 291--298.

Digital Library

[8]

Faezeh Ensan, Ebrahim Bagheri, and Dragan Gasevic. 2012. Evolutionary Search-Based Test Generation for Software Product Line Feature Models. In Proc. Int'l Conf. Advanced Information Systems Engineering (CAiSE). Vol. 7328. Springer, 613--628.

Digital Library

[9]

Thiago N. Ferreira, Jackson A. Prado Lima, Andrei Strickler, Josiel N. Kuk, Silvia R. Vergilio, and Aurora Pozo. 2017. Hyper-Heuristic Based Product Selection for Software Product Line Testing. 12, 2 (May 2017), 34--45.

Digital Library

[10]

Helson L. Jakubovski Filho, Jackson A. Prado Lima, and Silvia R. Vergilio. 2017. Automatic Generation of Search-Based Algorithms Applied to the Feature Testing of Software Product Lines. In Proc. Brazilian Symposium Software Engineering (SBES). ACM, New York, NY, USA, 114--123.

Digital Library

[11]

Brady J. Garvin, Myra B. Cohen, and Matthew B. Dwyer. 2011. Evaluating Improvements to a Meta-Heuristic Search for Constrained Interaction Testing. Empirical Software Engineering (EMSE) 16, 1 (2011), 61--102.

Digital Library

[12]

Alexander Grebhahn, Sebastian Kuckuk, Christian Schmitt, Harald Köstler, Norbert Siegmund, Sven Apel, Frank Hannig, and Jürgen Teich. 2014. Experiments on Optimizing the Performance of Stencil Codes with SPL Conqueror. Parallel Processing Letters 24, 3 (2014).

[13]

Jianmei Guo, Dingyu Yang, Norbert Siegmund, Sven Apel, Atrisha Sarkar, Pavel Valov, Krzysztof Czarnecki, Andrzej Wąsowski, and Huiqun Yu. 2018. Data-Efficient Performance Learning for Configurable Systems. Empirical Software Engineering (EMSE) 23, 3 (June 2018), 1826--1867.

Digital Library

[14]

Evelyn Nicole Haslinger, Roberto E. Lopez-Herrejon, and Alexander Egyed. 2013. Using Feature Model Knowledge to Speed Up the Generation of Covering Arrays. In Proc. Int'l Workshop Variability Modelling of Software-Intensive Systems (VaMoS). ACM, New York, NY, USA, Article 16, 16:1--16:6 pages.

Digital Library

[15]

Christopher Henard, Mike Papadakis, and Yves Le Traon. 2014. Mutation-Based Generation of Software Product Line Test Configurations. In Search-Based Software Engineering, Claire Le Goues and Shin Yoo (Eds.). Lecture Notes in Computer Science, Vol. 8636. Springer International Publishing, 92--106.

[16]

Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, Patrick Heymans, and Yves Le Traon. 2014. Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines. IEEE Trans. Software Engineering (TSE) 40, 7 (July 2014), 650--670.

Digital Library

[17]

Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, and Yves Le Traon. 2013. Multi-Objective Test Generation for Software Product Lines. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, 62--71.

Digital Library

[18]

Martin Fagereng Johansen, Øystein Haugen, and Franck Fleurey. 2011. Properties of Realistic Feature Models Make Combinatorial Testing of Product Lines Feasible. In Proc. Int'l Conf. Model Driven Engineering Languages and Systems (MODELS). Springer, Berlin, Heidelberg, 638--652.

Digital Library

[19]

Martin Fagereng Johansen, Øystein Haugen, and Franck Fleurey. 2012. An Algorithm for Generating T-Wise Covering Arrays from Large Feature Models. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, 46--55.

Digital Library

[20]

Martin Fagereng Johansen, Øystein Haugen, Franck Fleurey, Anne Grete Eldegard, and TorbjØrn Syversen. 2012. Generating Better Partial Covering Arrays by Modeling Weights on Sub-Product Lines. In Proc. Int'l Conf. Model Driven Engineering Languages and Systems (MODELS). Springer, Berlin, Heidelberg, 269--284.

Digital Library

[21]

Chang Hwan Peter Kim, Don Batory, and Sarfraz Khurshid. 2011. Reducing Combinatorics in Testing Product Lines. In Proc. Int'l Conf. Aspect-Oriented Software Development (AOSD). ACM, New York, NY, USA, 57--68.

Digital Library

[22]

Chang Hwan Peter Kim, Eric Bodden, Don Batory, and Sarfraz Khurshid. 2010. Reducing Configurations to Monitor in a Software Product Line. In Proc. Int'l Conf. Runtime Verification (RV). Springer, Berlin, Heidelberg, 285--299.

Digital Library

[23]

Matthias Kowal, Sandro Schulze, and Ina Schaefer. 2013. Towards Efficient SPL Testing by Variant Reduction. In Proce. Int'l workshop on Variability & composition (VariComp). ACM, New York, NY, USA, 1--6.

Digital Library

[24]

Jörg Liebig, Alexander von Rhein, Christian Kästner, Sven Apel, Jens Dörre, and Christian Lengauer. 2013. Scalable Analysis of Variable Software. In Proc. Europ. Software Engineering Conf./Foundations of Software Engineering (ESEC/FSE). ACM, New York, NY, USA, 81--91.

Digital Library

[25]

Roberto Erick Lopez-Herrejon, Javier Ferrer, Francisco Chicano, Alexander Egyed, and Enrique Alba. 2014. Comparative Analysis of Classical Multi-Objective Evolutionary Algorithms and Seeding Strategies for Pairwise Testing of Software Product Lines. In Proc. Congress Evolutionary Computation (CEC). IEEE, 387--396.

[26]

Dusica Marijan, Arnaud Gotlieb, Sagar Sen, and Aymeric Hervieu. 2013. Practical Pairwise Testing for Software Product Lines. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, NewYork, NY, USA, 227--235.

Digital Library

[27]

Rui Angelo Matnei Filho and Silvia Regina Vergilio. 2016. A Multi-Objective Test Data Generation Approach for Mutation Testing of Feature Models. 4, 1 (July 2016).

[28]

Flávio Medeiros, Christian Kästner, Márcio Ribeiro, Rohit Gheyi, and Sven Apel. 2016. A Comparison of 10 Sampling Algorithms for Configurable Systems. In Proc. Int'l Conf. Software Engineering (ICSE). ACM, New York, NY, USA, 643--654.

Digital Library

[29]

Sebastian Oster, Florian Markert, and Philipp Ritter. 2010. Automated Incremental Pairwise Testing of Software Product Lines. In Proc. Int'l Software Product Line Conf. (SPLC). Springer, Berlin, Heidelberg, 196--210.

Digital Library

[30]

Gilles Perrouin, Sagar Sen, Jacques Klein, Benoit Baudry, and Yves Le Traon. 2010. Automated and Scalable T-Wise Test Case Generation Strategies for Software Product Lines. In Proc. Int'l Conf. Software Testing, Verification and Validation (ICST). IEEE, Washington, DC, USA, 459--468.

Digital Library

[31]

Dennis Reuling, Johannes Bürdek, Serge Rotärmel, Malte Lochau, and Udo Kelter. 2015. Fault-Based Product-Line Testing: Effective Sample Generation Based on Feature-Diagram Mutation. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, 131--140.

Digital Library

[32]

Atri Sarkar, Jianmei Guo, Norbert Siegmund, Sven Apel, and Krzysztof Czarnecki. 2015. Cost-Efficient Sampling for Performance Prediction of Configurable Systems. In Proc. Int'l Conf. Automated Software Engineering (ASE). IEEE, Washington, DC, USA, 342--352.

Digital Library

[33]

Jiangfan Shi, Myra B. Cohen, and Matthew B. Dwyer. 2012. Integration Testing of Software Product Lines Using Compositional Symbolic Execution. In Proc. Int'l Conf. Fundamental Approaches to Software Engineering (FASE). Springer, Berlin, Heidelberg, 270--284.

Digital Library

[34]

Norbert Siegmund, Sergiy S. Kolesnikov, Christian Kästner, Sven Apel, Don Batory, Marko Rosenmüller, and Gunter Saake. 2012. Predicting Performance via Automated Feature-Interaction Detection. In Proc. Int'l Conf. Software Engineering (ICSE). IEEE, Piscataway, NJ, USA, 167--177.

Digital Library

[35]

Norbert Siegmund, Marko RosenmüLler, Christian KäStner, Paolo G. Giarrusso, Sven Apel, and Sergiy S. Kolesnikov. 2013. Scalable Prediction of Non-functional Properties in Software Product Lines: Footprint and Memory Consumption. J. Information and Software Technology (IST) 55, 3 (March 2013), 491--507.

Digital Library

[36]

Norbert Siegmund, Marko Rosenmüller, Martin Kuhlemann, Christian Kästner, Sven Apel, and Gunter Saake. 2012. SPL Conqueror: Toward Optimization of Non-functional Properties in Software Product Lines. Software Quality Journal (SQJ) 20, 3--4 (Sept. 2012), 487--517.

Digital Library

[37]

Reinhard Tartler, Christian Dietrich, Julio Sincero, Wolfgang Schröder-Preikschat, and Daniel Lohmann. 2014. Static Analysis of Variability in System Software: The 90,000 #Ifdefs Issue. In Proc. USENIX Annual Technical Conference (ATC). USENIX Association, Berkeley, CA, USA, 421--432.

Digital Library

[38]

Reinhard Tartler, Daniel Lohmann, Christian Dietrich, Christoph Egger, and Julio Sincero. 2012. Configuration Coverage in the Analysis of Large-Scale System Software. ACM SIGOPS Operating Systems Review 45, 3 (Jan. 2012), 10--14.

Digital Library

[39]

Mustafa Al-Hajjaji, Sascha Lity, Remo Lachmann, Thomas Thüm, Ina Schaefer, and Gunter Saake. 2017. Delta-Oriented Product Prioritization for Similarity-Based Product-Line Testing. In Proc. Int'l Workshop Variability and Complexity in Software Design (VACE). IEEE, Piscataway, NJ, USA, 34--40.

Digital Library

[40]

Mustafa Al-Hajjaji, Thomas Thüm, Malte Lochau, Jens Meinicke, and Gunter Saake. 2018. Effective Product-Line Testing Using Similarity-Based Product Prioritization. Software and System Modeling (2018). To appear.

[41]

Xavier Devroey, Gilles Perrouin, Axel Legay, Pierre-Yves Schobbens, and Patrick Heymans. 2015. Covering SPL Behaviour with Sampled Configurations: An Initial Assessment. In Proc. Int'l Workshop Variability Modelling of Software-Intensive Systems (VaMoS). ACM, New York, NY, USA, Article 59, 59:59--59:66 pages.

Digital Library

[42]

Stefan Fischer, Roberto E. Lopez-Herrejon, Rudolf Ramler, and Alexander Egyed. 2016. A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines. In Proc. Int'l Workshop on Search-Based Software Testing (SBST). ACM, New York, NY, USA, 15--18.

Digital Library

[43]

Alexander Grebhahn, Carmen Rodrigo, Norbert Siegmund, Francisco José Gaspar, and Sven Apel. 2017. Performance-Influence Models of Multigrid Methods: A Case Study on Triangular Grids. Concurrency and Computation: Practice and Experience 29, 17 (2017).

[44]

Axel Halin, Alexandre Nuttinck, Mathieu Acher, Xavier Devroey, Gilles Perrouin, and Benoit Baudry. 2017. Test Them All, Is It worth It? A Ground Truth Comparison of Configuration Sampling Strategies. Technical Report arXiv:1710.07980. Cornell University Library.

[45]

Sebastian Oster, Marius Zink, Malte Lochau, and Mark Grechanik. 2011. Pairwise Feature-interaction Testing for SPLs: Potentials and Limitations. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, Article 6, 6:1--6:8 pages.

Digital Library

[46]

Gilles Perrouin, Sebastian Oster, Sagar Sen, Jacques Klein, Benoit Baudry, and Yves Le Traon. 2012. Pairwise Testing for Software Product Lines: Comparison of Two Approaches. Software Quality Journal (SQJ) 20, 3--4 (2012), 605--643.

Digital Library

[47]

Norbert Siegmund, Alexander Grebhahn, Sven Apel, and Christian Kästner. 2015. Performance-Influence Models for Highly Configurable Systems. In Proc. Europ. Software Engineering Conf./Foundations of Software Engineering (ESEC/FSE). ACM, New York, NY, USA, 284--294.

Digital Library

[48]

Norbert Siegmund, Alexander von Rhein, and Sven Apel. 2013. Family-Based Performance Measurement. In Proc. Int'l Conf. Generative Programming: Concepts & Experiences (GPCE). ACM, New York, NY, USA, 95--104.

Digital Library

[49]

Bestoun S. Ahmed, Kamal Z. Zamli, Wasif Afzal, and Miroslav Bures. 2017. Constrained Interaction Testing: A Systematic Literature Study. IEEE Access 5 (2017), 25706--25730.

[50]

Sven Apel, Don Batory, Christian Kästner, and Gunter Saake. 2013. Feature-Oriented Software Product Lines: Concepts and Implementation. Springer, Berlin, Heidelberg.

Digital Library

[51]

Sven Apel, Alexander von Rhein, Philipp Wendler, Armin Größlinger, and Dirk Beyer. 2013. Strategies for Product-Line Verification: Case Studies and Experiments. In Proc. Int'l Conf. Software Engineering (ICSE). IEEE, Piscataway, NJ, USA, 482--491.

Digital Library

[52]

Hauke Baller, Sascha Lity, Malte Lochau, and Ina Schaefer. 2014. Multi-Objective Test Suite Optimization for Incremental Product Family Testing. In Proc. Int'l Conf. Software Testing, Verification and Validation (ICST). IEEE, Washington, DC, USA, 303--312.

Digital Library

[53]

Don Batory. 2005. Feature Models, Grammars, and Propositional Formulas. In Proc. Int'l Software Product Line Conf. (SPLC). Springer, Berlin, Heidelberg, 7--20.

Digital Library

[54]

David Benavides, Sergio Segura, and Antonio Ruiz-Cortés. 2010. Automated Analysis of Feature Models 20 Years Later: A Literature Review. Information Systems 35, 6 (2010), 615--708.

Digital Library

[55]

Daniel Bruns, Vladimir Klebanov, and Ina Schaefer. 2011. Verification of Software Product Lines with Delta-Oriented Slicing. In Proc. Int'l Conf. Formal Verification of Object-Oriented Software (FoVeOOS). Springer, Berlin, Heidelberg, 61--75.

Digital Library

[56]

Ivan Do Carmo Machado, John D. McGregor, Yguaratã Cerqueira Cavalcanti, and Eduardo Santana De Almeida. 2014. On Strategies for Testing Software Product Lines: A Systematic Literature Review. J. Information and Software Technology (IST) 56, 10 (2014), 1183--1199.

Digital Library

[57]

Ivan Do Carmo Machado, John D. McGregor, and Eduardo Santana De Almeida. 2012. Strategies for Testing Products in Software Product Lines. SIGSOFT Software Engineering Notes 37, 6 (Nov. 2012), 1--8.

Digital Library

[58]

Maxime Cordy, Pierre-Yves Schobbens, Patrick Heymans, and Axel Legay. 2012. Towards an Incremental Automata-Based Approach for Software Product-Line Model Checking. In Proc. Int'l Workshop Formal Methods and Analysis in Software Product Line Engineering (FMSPLE). ACM, New York, NY, USA, 74--81.

Digital Library

[59]

Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein. 2009. Introduction to Algorithms, Third Edition (3rd ed.). The MIT Press.

Digital Library

[60]

Christian Dietrich, Reinhard Tartler, Wolfgang Schröder-Preikschat, and Daniel Lohmann. 2012. Understanding Linux Feature Distribution. In Proc. of Workshop on Modularity in Systems Software (MISS). ACM, NY, USA, 15--20.

Digital Library

[61]

Martin Fagereng Johansen, Oystein Haugen, and Franck Fleurey. 2011. A Survey of Empirics of Strategies for Software Product Line Testing. In ICST Workshop Proceedings. IEEE, Washington, DC, USA, 266--269.

Digital Library

[62]

Kyo C. Kang, Sholom G. Cohen, James A. Hess, William E. Novak, and A. Spencer Peterson. 1990. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical Report CMU/SEI-90-TR-21. Software Engineering Institute.

[63]

Christian Kästner, Alexander von Rhein, Sebastian Erdweg, Jonas Pusch, Sven Apel, Tillmann Rendel, and Klaus Ostermann. 2012. Toward Variability-Aware Testing. In Proc. Int'l Workshop Feature-Oriented Software Development (FOSD). ACM, New York, NY, USA, 1--8.

Digital Library

[64]

Sebastian Krieter, Marcus Pinnecke, Jacob Krüger, Joshua Sprey, Christopher Sontag, Thomas Thüm, Thomas Leich, and Gunter Saake. 2017. FeatureIDE: Empowering Third-Party Developers. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, 42--45.

Digital Library

[65]

Beatriz Pérez Lamancha, Macario Polo, and Mario Piattini. 2013. Systematic Review on Software Product Line Testing. Springer, Berlin, Heidelberg, 58--71.

[66]

Jihyun Lee, Sungwon Kang, and Danhyung Lee. 2012. A Survey on Software Product Line Testing. In Proc. Int'l Software Product Line Conf. (SPLC). ACM, New York, NY, USA, 31--40.

Digital Library

[67]

Sascha Lity, Mustafa Al-Hajjaji, Thomas Thüm, and Ina Schaefer. 2017. Optimizing Product Orders Using Graph Algorithms for Improving Incremental Product-line Analysis. In Proc. Int'l Workshop Variability Modelling of Software-Intensive Systems (VaMoS). ACM, New York, NY, USA, 60--67.

Digital Library

[68]

Sascha Lity, Thomas Morbach, Thomas Thüm, and Ina Schaefer. 2016. Applying Incremental Model Slicing to Product-Line Regression Testing. In Proc. Int'l Conf. Software Reuse (ICSR). Springer, Berlin, Heidelberg, 3--19.

Digital Library

[69]

Malte Lochau, Stephan Mennicke, Hauke Baller, and Lars Ribbeck. 2014. DeltaCCS: A Core Calculus for Behavioral Change. In Proc. Int'l Symposium Leveraging Applications of Formal Methods, Verification and Validation (ISoLA), Tiziana Margaria and Bernhard Steffen (Eds.). Springer, New York, NY, USA, 320--335.

Digital Library

[70]

Malte Lochau, Ina Schaefer, Jochen Kamischke, and Sascha Lity. 2012. Incremental Model-Based Testing of Delta-oriented Software Product Lines. In Proc. Int'l Conf. Tests and Proofs (TAP). Springer, Berlin, Heidelberg, 67--82.

Digital Library

[71]

Roberto E. Lopez-Herrejon, Stefan Fischer, Rudolf Ramler, and Aalexander Egyed. 2015. A First Systematic Mapping Study on Combinatorial Interaction Testing for Software Product Lines. In Proc. Int'l Workshop Combinatorial Testing (IWCT). IEEE, Washington, DC, USA, 1--10.

[72]

Jens Meinicke, Thomas Thüm, Reimar Schröter, Fabian Benduhn, Thomas Leich, and Gunter Saake. 2017. Mastering Software Variability with FeatureIDE. Springer, Berlin, Heidelberg.

Digital Library

[73]

Jens Meinicke, Chu-Pan Wong, Christian Kästner, Thomas Thüm, and Gunter Saake. 2016. On Essential Configuration Complexity: Measuring Interactions In Highly-Configurable Systems. In Proc. Int'l Conf. Automated Software Engineering (ASE). ACM, New York, NY, USA, 483--494.

Digital Library

[74]

Marcílio Mendonça, Moises Branco, and Donald Cowan. 2009. S.P.L.O.T.: Software Product Lines Online Tools. In Proc. Conf. Object-Oriented Programming, Systems, Languages and Applications (OOPSLA). ACM, New York, NY, USA, 761--762.

Digital Library

[75]

Jan Midtgaard, Claus Brabrand, and Andrzej Wąsowski. 2014. Systematic Derivation of Static Analyses for Software Product Lines. In Proc. Int'l Conf. Aspect-Oriented Software Development (AOSD). ACM, New York, NY, USA, 181--192.

Digital Library

[76]

Hung Viet Nguyen, Christian Kästner, and Tien N. Nguyen. 2014. Exploring Variability-Aware Execution for Testing Plugin-Based Web Applications. In Proc. Int'l Conf. Software Engineering (ICSE). ACM, New York, NY, USA, 907--918.

Digital Library

[77]

Changhai Nie and Hareton Leung. 2011. A Survey of Combinatorial Testing. Comput. Surveys 43, 2, Article 11 (Feb. 2011), 11:1--11:29 pages.

Digital Library

[78]

Abdel Salam Sayyad, Joseph Ingram, Tim Menzies, and Hany Ammar. 2013. Scalable Product Line Configuration: A Straw to Break the Camel's Back. In Proc. Int'l Conf. Automated Software Engineering (ASE). IEEE, Piscataway, NJ, USA, 465--474.

Digital Library

[79]

Christoph Seidl, Ina Schaefer, and Uwe Assmann. 2013. Variability-Aware Safety Analysis Using Delta Component Fault Diagrams. In Proc. Int'l Workshop Formal Methods and Analysis in Software Product Line Engineering (FMSPLE). ACM, New York, NY, USA, 2--9.

Digital Library

[80]

Norbert Siegmund, Marko Rosenmüller, Christian Kästner, Paolo G. Giarrusso, Sven Apel, and Sergiy Kolesnikov. 2011. Scalable Prediction of Non-Functional Properties in Software Product Lines. In Proc. Int'l Software Product Line Conf. (SPLC). IEEE, Washington, DC, USA, 160--169.

Digital Library

[81]

Thomas Thüm, Sven Apel, Christian Kästner, Ina Schaefer, and Gunter Saake. 2014. A Classification and Survey of Analysis Strategies for Software Product Lines. Comput. Surveys 47, 1 (June 2014), 6:1--6:45.

Digital Library

[82]

Alexander von Rhein, Sven Apel, Christian Kästner, Thomas Thüm, and Ina Schaefer. 2013. The PLA Model: On the Combination of Product-Line Analyses. In Proc. Int'l Workshop Variability Modelling of Software-Intensive Systems (VaMoS). ACM, New York, NY, USA, 14:1--14:8.

Digital Library

[83]

Alexander von Rhein, Thomas Thüm, Ina Schaefer, Jörg Liebig, and Sven Apel. 2016. Variability Encoding: From Compile-Time to Load-Time Variability. J. Logic and Algebraic Methods in Programming (JLAMP) 85, 1, Part 2 (Jan. 2016), 125--145.

[84]

Shin Yoo and Mark Harman. 2012. Regression Testing Minimization, Selection and Prioritization: A Survey. Software Testing, Verification and Reliability (STVR) 22, 2 (2012), 67--120.

Digital Library

Cited By

Pett TKrieter SThüm TSchaefer I(2024)MulTi-Wise Sampling: Trading Uniform T-Wise Feature Interaction Coverage for Smaller SamplesProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672589(47-53)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672589
Landsberg TDietrich CLohmann D(2024)Should I Bother? Fast Patch Filtering for Statically-Configured Software VariantsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672585(12-23)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672585
Acher MCombemale BRandrianaina GJezequel J(2024)Embracing Deep Variability For Reproducibility and ReplicabilityProceedings of the 2nd ACM Conference on Reproducibility and Replicability10.1145/3641525.3663621(30-35)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3641525.3663621
Show More Cited By

Index Terms

A classification of product sampling for software product lines
1. Software and its engineering
  1. Software creation and management
    1. Software development techniques
      1. Reusability
        Software product lines

Recommendations

Product Sampling for Product Lines: The Scalability Challenge
SPLC '19: Proceedings of the 23rd International Systems and Software Product Line Conference - Volume A

Quality assurance for product lines is often infeasible for each product separately. Instead, only a subset of all products (i.e., a sample) is considered during testing such that at least the coverage of certain feature interactions is guaranteed. ...
Scoping Automation in Software Product Lines
ICEIS 2015: Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2

Software product lines (SPL) are recognized as a way to increase the quality as well as to reduce the cost, delivery time, and mitigate risks of software products. Scoping, an essential step in SPLs, requires time and effort of domain experts; thus, ...
Continuous test suite augmentation in software product lines
SPLC '13: Proceedings of the 17th International Software Product Line Conference

Software Product Line (SPL) engineering offers several advantages in the development of families of software products. There is still a need, however, to generate test cases for individual products in product lines more efficiently. In this paper we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

SPLC '18: Proceedings of the 22nd International Systems and Software Product Line Conference - Volume 1

September 2018

324 pages

ISBN:9781450364645

DOI:10.1145/3233027

Editors:
Thorsten Berger
Chalmers | University of Gothenburg, Sweden
,
Paulo Borba
Federal University of Pernambuco, Brazil
,
Goetz Botterweck
University of Limerick, Ireland
,
Tomi Männistö
University of Helsinki, Finland
,
David Benavides
University of Seville, Spain
,
Sarah Nadi
University of Alberta, Canada
,
Timo Kehrer
Humboldt-Universität zu Berlin, Germany
,
Rick Rabiser
Johannes Kepler University Linz, Austria
,
Christoph Elsner
Siemens Corporate Technology, Germany
,
Mukelabai Mukelabai
Chalmers | University of Gothenburg, Sweden

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Research Foundation

Conference

SPLC '18

SPLC '18: 22nd International Systems and Software Product Line Conference

September 10 - 14, 2018

Gothenburg, Sweden

Acceptance Rates

Overall Acceptance Rate 167 of 463 submissions, 36%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
372
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)6

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pett TKrieter SThüm TSchaefer I(2024)MulTi-Wise Sampling: Trading Uniform T-Wise Feature Interaction Coverage for Smaller SamplesProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672589(47-53)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672589
Landsberg TDietrich CLohmann D(2024)Should I Bother? Fast Patch Filtering for Statically-Configured Software VariantsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672585(12-23)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3672585
Acher MCombemale BRandrianaina GJezequel J(2024)Embracing Deep Variability For Reproducibility and ReplicabilityProceedings of the 2nd ACM Conference on Reproducibility and Replicability10.1145/3641525.3663621(30-35)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3641525.3663621
Güthing LWeiß MSchaefer ILochau M(2024)Sampling Cardinality-Based Feature ModelsProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634719(46-55)Online publication date: 7-Feb-2024
https://dl.acm.org/doi/10.1145/3634713.3634719
Heß TSchmidt TOstheimer LKrieter SThüm T(2024)UnWise: High T-Wise Coverage from Uniform SamplingProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634716(37-45)Online publication date: 7-Feb-2024
https://dl.acm.org/doi/10.1145/3634713.3634716
Böhm SKrieter SHeß TThüm TLochau M(2024)Incremental Identification of T-Wise Feature InteractionsProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634715(27-36)Online publication date: 7-Feb-2024
https://dl.acm.org/doi/10.1145/3634713.3634715
Bombarda AGargantini A(2024)Integrating Product Sampling and Behavioral Testing for Software Product Lines with Combinatorial Testing2024 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW60967.2024.00046(197-206)Online publication date: 27-May-2024
https://doi.org/10.1109/ICSTW60967.2024.00046
Bombarda ABonfanti SGargantini A(2024)Testing the Evolution of Feature Models with Specific Combinatorial Tests2024 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW60967.2024.00025(1-10)Online publication date: 27-May-2024
https://doi.org/10.1109/ICSTW60967.2024.00025
Agh HAzamnouri AWagner S(2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1007/s10664-024-10516-x
Tavassoli SKhosravi R(2024)Efficient construction of family-based behavioral models from adaptively learned modelsSoftware and Systems Modeling10.1007/s10270-024-01199-5Online publication date: 7-Aug-2024
https://doi.org/10.1007/s10270-024-01199-5
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents