Abstract
Many software product line testing techniques have been presented in the literature. The majority of those techniques address how to define reusable test assets (such as test models or test scenarios) in domain engineering and how to exploit those assets during application engineering. In addition to test case reuse however, the execution of test cases constitutes one important activity during application testing. Without a systematic support for the test execution in application engineering, while considering the specifics of product lines, product line artifacts might be tested redundantly. Redundant testing in application engineering, however, can lead to an increased testing effort without increasing the chance of uncovering failures. In this paper, we propose the model-based ScenTED-DF technique to avoid redundant testing in application engineering. Our technique builds on data flow-based testing techniques for single systems and adapts and extends those techniques to consider product line variability. The paper sketches the prototypical implementation of our technique to show its general feasibility and automation potential, and it describes the results of experiments using an academic product line to demonstrate that ScenTED-DF is capable of avoiding redundant tests in application engineering.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Pohl, K., Böckle, G., van der Linden, F.: Software Product Line Engineering – Foundations, Principles, and Techniques. Springer, Heidelberg (2005)
Lamancha, B.M., Usaola, M.P., Velthius, M.P.: Software Product Line Testing: A Systematic Review. In: Shishkov, B., Cordeiro, J., Ranchordas, A. (eds.) Proceedings of the 4th International Conference on Software and Data Technologies (ICSOFT), vol. 1, pp. 23–30. INSTICC Press (2009)
Tevanlinna, A., Taina, J., Kauppinen, R.: Product Family Testing – a Survey. ACM SIGSOFT Software Engineering Notes 29(2) (2004)
Pohl, K., Metzger, A.: Software Product Line Testing: Exploring Principles and Potential Solutions. Communications of the ACM 49(12), 78–81 (2006)
Rapps, S., Weyuker, E.J.: Data Flow Analysis Techniques for Test Data Selection. In: Proceedings of 6th International Conference on Software Engineering (ICSE 1982), pp. 272–278. IEEE Computer Society, Los Alamitos (1982) Catalog No. 82CH1795-4
Bertolino, A., Gnesi, S.: Use Case-Based Testing of Product Lines. In: Paakki, J., Inverardi, P. (eds.) Proceedings of the 9th European Software Engineering Conference held jointly with 11th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE), Poster Session, pp. 355–358. ACM Press, New York (2003)
McGregor, J.D.: Testing a Software Product Line. Software Engineering Institute, Technical Report, CMU/SEI-2001-TR-022, ESC-TR-2001-022, Product Line Systems Program. Carnegie Mellon University (2001)
Geppert, B., Li, J., Roessler, F., Weiss, D.M.: Towards Generating Acceptance Tests for Product Lines. In: Bosch, J., Krueger, C. (eds.) ICOIN 2004 and ICSR 2004. LNCS, vol. 3107, pp. 35–48. Springer, Heidelberg (2004)
Nebut, C., Fleurey, F., Le Traon, Y., Jézéquel, J.: A Requirements based Approach to Test Product Families. In: van der Linden, F.J. (ed.) PFE 2003. LNCS, vol. 3014, pp. 198–210. Springer, Heidelberg (2004)
Li, J.J., Geppert, B., Roessler, F., Weiss, D.M.: Reuse Execution Traces to Reduce Testing of Product Lines. In: SPLIT Workshop, Proceedings of the 11th International Product Line Conference (SPLC), Second Volume (Workshops), pp. 65–72. Kindai Kagaku Sha Co. Ltd., Tokyo (2007)
Li, Y., Wahl, N.J.: An Overview of Regression Testing. ACM SIGSOFT Software Engineering Notes 24(1), 69–73 (1999)
Metzger, A., Heymans, P., Pohl, K., Schobbens, P.-Y., Saval, G.: Disambiguating the Documentation of Variability in Software Product Lines: A Separation of Concerns, Formalization and Automated Analysis. In: Sutcliffe, A., Jalote, P. (eds.) Proceedings of the 15th IEEE Intl. Conference on Requirements Engineering (RE 2007), pp. 243–253. IEEE Computer Society, Los Alamitos (2007)
Metzger, A.: Testing in a Software Product Line. Panel Presentation at the 10th International Software Product Line Conference (SPLC) (2006)
Maßen, T.v.d., Lichter, H.: Determining the Variation Degree of Feature Models. In: Obbink, J.H., Pohl, K. (eds.) SPLC 2005. LNCS, vol. 3714, pp. 82–88. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stricker, V., Metzger, A., Pohl, K. (2010). Avoiding Redundant Testing in Application Engineering. In: Bosch, J., Lee, J. (eds) Software Product Lines: Going Beyond. SPLC 2010. Lecture Notes in Computer Science, vol 6287. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15579-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-15579-6_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15578-9
Online ISBN: 978-3-642-15579-6
eBook Packages: Computer ScienceComputer Science (R0)