Article

Compatibility and Regression Testing of COTS-Component-Based Software

Authors:

Leonardo Mariani,

Sofia Papagiannakis,

Mauro PezzeAuthors Info & Claims

ICSE '07: Proceedings of the 29th international conference on Software Engineering

Pages 85 - 95

https://doi.org/10.1109/ICSE.2007.26

Published: 24 May 2007 Publication History

Abstract

Software engineers frequently update COTS components integrated in component-based systems, and can often chose among many candidates produced by different vendors. This paper tackles both the problem of quickly identifying components that are syntactically compatible with the interface specifications, but badly integrate in target systems, and the problem of automatically generating regression test suites. The technique proposed in this paper to automatically generate compatibility and prioritized test suites is based on behavioral models that represent component interactions, and are automatically generated while executing the original test suites on previous versions of target systems.

References

[1]

{1} S. Beydeda and V. Gruhn. Testing Commercial-off-the-Shelf Components and Systems. Springer, 2005.

Digital Library

[2]

{2} J. Bible, G. Rothermel, and D. Rosenblum. A comparative study of course- and fine-grained safe regression test-selection techniques. ACM Transactions on Software Engineering and Methodology, 10(2):149-183, 2001.

Digital Library

[3]

{3} M. E. Delamaro, J. C. Maldonado, and A. P. Mathur. Interface mutation: An approach for integration testing. IEEE Transactions on Software Engineering, 27(3):228- 247, March 2001.

Digital Library

[4]

{4} S. Elbaum, A. Malishevsky, and G. Rothermel. Test case prioritization: a family of empirical studies. IEEE Transactions on Software Engineering, 28(2):159-182, 2002.

Digital Library

[5]

{5} M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Transactions on Software Engineering , 27(2):99-123, 2001.

Digital Library

[6]

{6} S. Ghosh and A. Mathur. Interface mutation to assess the adequacy of tests for components and systems. In proceedings of Technology of Object-Oriented Languages and Systems, pages 37-46. IEEE Computer Society, 2000.

Digital Library

[7]

{7} Ginipad. http://www.mokabyte.it/ginipad/english.htm.

[8]

{8} T. Graves, M. Harrold, M. Kim, Y. Porter, and G. Rothermel. An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology , 10(2):184-208, 2001.

Digital Library

[9]

{9} M. Harder, J. Mellen, and M. D. Ernst. Improving test suites via operational abstraction. In proceedings of the International Conference on Software Engineering. IEEE, 2003.

Digital Library

[10]

{10} M. Harrold, A. Orso, D. Rosenblum, G. Rothermel, M. Soffa, and H. Do. Using component metacontents to support the regression testing of component-based software. In proceedings of the IEEE International Conference on Software Maintenance, 2001.

Digital Library

[11]

{11} M. J. Harrold, J. A. Jones, T. Li, D. Liang, A. Orso, M. Pennings, S. Sinha, S. A. Spoon, and A. Gujarathi. Regression test selection for java software. In proceedigns of the ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications. ACM, 2001.

Digital Library

[12]

{12} J.-M. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In proceedings of the International Conference on Software Engineering, pages 119-129. ACM, 2002.

Digital Library

[13]

{13} L. Mariani and M. Pezzè. Behavior capture and test: Automated analysis of component integration. In proceedings of the IEEE International Conference on Engineering of Complex Computer Systems, 2005.

Digital Library

[14]

{14} L. Mariani, M. Pezzè, and D. Willmor. Generation of selft-test components. In proceedings of the International Workshop on Integration of Testing Methodologies, volume 3236 of LNCS, pages 337-350. Springer, 2004.

[15]

{15} T. J. Ostrand and M. J. Balcer. The category-partition method for specifying and generating functional tests. Communications of the ACM, 31(6):676-686, June 1988.

Digital Library

[16]

{16} M. Pezzè and M. Young. Software Test and Analysis: Process, Principles and Techniques. John Wiley & Sons, 2007.

Digital Library

[17]

{17} G. Rothermel, S. Elbaum, A. Malishevsky, P. Kallakuri, and X. Qiu. On test suite composition and cost-effectiveness regression testing. ACM Transactions on Software Engineering and Methodology, 13(3):277-331, July 2004.

Digital Library

[18]

{18} G. Rothermel and M. Harrold. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering , 22(8):529-551, 1996.

Digital Library

[19]

{19} G. Rothermel, R. Untch, C. Chu, and M. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on software engineering, 27(10):929-948, 2001.

Digital Library

[20]

{20} A. Srivastava and J. Thiagarajan. Effectively prioritizing tests in development environment. In International Symposium on Software Testing and Analysis. ACM Press, 2002.

Digital Library

[21]

{21} M. Vigder and J. Dean. Building maintainable COTS based systems. In International Conference on Software Maintenance . IEEE, 1998.

Digital Library

[22]

{22} L. White and E. Cohen. A domain strategy for computer program testing. IEEE Transactions on Software Engineering, 17:703-711, 1991.

[23]

{23} T. Xie and D. Notkin. Checking inside the black box: Regression testing by comparing value spectra. IEEE Transactions on Software Engineering, 31(10):869-883, 2005.

Digital Library

[24]

{24} J. Yang, D. Evans, D. Bhardwaj, T. Bhat, and M. Das. Perracotta: Mining temporal API rules from imperfect traces. In proceedings of the International Conference on Software Engineering. ACM, 2006.

Digital Library

[25]

{25} J. Zheng, B. Robinson, L. Williams, and K. Smiley. Applying regression test selection for cots-based applications. In proceedings of the International Conference on Software Engineering. ACM, 2006.

Digital Library

Cited By

Hejderup JTorres-Arias SMelara MSimon L(2022)On the Use of Tests for Software Supply Chain ThreatsProceedings of the 2022 ACM Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses10.1145/3560835.3564557(47-49)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3560835.3564557
Busany NMaoz SDillon LVisser WWilliams L(2016)Behavioral log analysis with statistical guaranteesProceedings of the 38th International Conference on Software Engineering10.1145/2884781.2884805(877-887)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2884781.2884805
Cohen HMaoz SCohen MGrunske LWhalen M(2015)Have we seen enough traces?Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.62(93-103)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.62
Show More Cited By

Index Terms

Compatibility and Regression Testing of COTS-Component-Based Software
1. Software and its engineering
  1. Software creation and management
    1. Software development techniques
      1. Reusability
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software notations and tools
    1. Software libraries and repositories

Recommendations

Testing component compatibility in evolving configurations

Software components are increasingly assembled from other components. Each component may further depend on others, and each may have multiple active versions. The total number of configurations-combinations of components and their versions-in use can be ...
Regression Testing of Component-Based Software: A Systematic Practise Based on State Testing
HASE '11: Proceedings of the 2011 IEEE 13th International Symposium on High-Assurance Systems Engineering

Component-based software systems consist of various components, such as third-party components and in-house built components. Component changes frequently occur in software maintenance, which refers to regression testing. When changes made to a component,...
Towards incremental component compatibility testing
CBSE '11: Proceedings of the 14th international ACM Sigsoft symposium on Component based software engineering

Software components are increasingly assembled from other components. Each component may further depend on others, and each may have multiple active versions. The total number of configurations --- combinations of components and their versions --- ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '07: Proceedings of the 29th international conference on Software Engineering

May 2007

784 pages

ISBN:0769528287

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

IEEE Computer Society

United States

Publication History

Published: 24 May 2007

Check for updates

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
842
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hejderup JTorres-Arias SMelara MSimon L(2022)On the Use of Tests for Software Supply Chain ThreatsProceedings of the 2022 ACM Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses10.1145/3560835.3564557(47-49)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3560835.3564557
Busany NMaoz SDillon LVisser WWilliams L(2016)Behavioral log analysis with statistical guaranteesProceedings of the 38th International Conference on Software Engineering10.1145/2884781.2884805(877-887)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2884781.2884805
Cohen HMaoz SCohen MGrunske LWhalen M(2015)Have we seen enough traces?Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.62(93-103)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.62
Chaves L(2014)A cost effective and preventive approach to avoid integration faults caused by mistakes in distribution of software componentsAdvances in Software Engineering10.1155/2014/4394622014(7-7)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1155/2014/439462
Cohen HMaoz SCrnkovic IChechik MGrünbacher P(2014)The confidence in our k-tailsProceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering10.1145/2642937.2642944(605-610)Online publication date: 15-Sep-2014
https://dl.acm.org/doi/10.1145/2642937.2642944
Pastore FMariani LHyvärinen AFedyukovich GSharygina NSehestedt SMuhammad APăsăreanu CMarinov D(2014)Verification-aided regression testingProceedings of the 2014 International Symposium on Software Testing and Analysis10.1145/2610384.2610387(37-48)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1145/2610384.2610387
Long TYoon IMemon APorter ASussman ASeinturier LAlmeida ECarlson J(2014)Enabling collaborative testing across shared software componentsProceedings of the 17th international ACM Sigsoft symposium on Component-based software engineering10.1145/2602458.2602468(55-64)Online publication date: 27-Jun-2014
https://dl.acm.org/doi/10.1145/2602458.2602468
Goffi AJalote PBriand LHoek A(2014)Automatic generation of cost-effective test oraclesCompanion Proceedings of the 36th International Conference on Software Engineering10.1145/2591062.2591078(678-681)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2591062.2591078
Mariani LPezzè MRiganelli OSantoro M(2014)Automatic testing of GUI-based applicationsSoftware Testing, Verification & Reliability10.1002/stvr.153824:5(341-366)Online publication date: 1-Aug-2014
https://dl.acm.org/doi/10.1002/stvr.1538
Fahland DLo DMaoz SDenney EBultan TZeller A(2013)Mining branching-time scenariosProceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2013.6693102(443-453)Online publication date: 11-Nov-2013
https://dl.acm.org/doi/10.1109/ASE.2013.6693102
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten