Article

An Empirical Comparison of Dynamic Impact Analysis Algorithms

Authors:

Alessandro Orso,

Taweesup Apiwattanapong,

Gregg Rothermel,

Mary Jean HarroldAuthors Info & Claims

ICSE '04: Proceedings of the 26th International Conference on Software Engineering

Pages 491 - 500

Published: 23 May 2004 Publication History

Abstract

Impact analysis determining the potential effects of changes on a software system plays an important role in software engineering tasks such as maintenance, regression testing, and debugging. In previous work, two new dynamic impact analysis techniques, Coverage Impact and Path Impact, were presented. These techniques perform impact analysis based on data gathered about program behavior relative to specific inputs, such as inputs gathered from field data, operational profile data, or test-suite executions.Due to various characteristics of the algorithms they employ, Coverage Impact and Path Impact are expected to differ in terms of cost and precision; however, there have been no studies to date examining the extent to which such differences may emerge in practice. Since cost-precision trade offs may play an important role in technique selection and further research, we wished to examine these trade offs.We therefore designed and performed an empirical study,comparing the execution and space costs of the techniques,as well as the precisions of the impact analysis results that they report. This paper presents the results of this study.

References

[1]

{1} R. S. Arnold and S. A. Bohner. Impact analysis - towards a framework for comparison. In Proceedings of the International Conference on Software Maintenance, pages 292- 301, Sept. 1993.

Digital Library

[2]

{2} S. Bohner and R. Arnold. Software Change Impact Analysis. IEEE Press, Los Alamitos, CA, USA, 1996.

Digital Library

[3]

{3} A. Carzaniga, D. S. Rosenblum, and A. L. Wolf. Design and evaluation of a wide-area event notification service. ACM Transactions on Computing Systems, 19(3):332-383, August 2001.

Digital Library

[4]

{4} J. Larus. Whole Program Paths. In Proceedings of SIGPLAN PLDI 99, pages 1-11, Atlanta, GA, May 1999. ACM.

Digital Library

[5]

{5} J. Law and G. Rothermel. Incremental dynamic impact analysis for evolving software systems. In Proceedings of the International Symposium on Software Reliability Engineering, Nov. 2003.

Digital Library

[6]

{6} J. Law and G. Rothermel. Whole program path-based dynamic impact analysis. In Proceedings of the International Conference on Software Engineering, pages 308-318, May 2003.

Digital Library

[7]

{7} J. L. Lions. ARIANE 5, Flight 501 Failure, Report by the Inquiry Board. European Space Agency, July 1996.

[8]

{8} J. P. Loyall, S. A. Mathisen, and C. P. Satterthwaite. Impact analysis and change management for avionics software. In Proceedings of the IEEE National Aeronautics and Electronics Conference, Part 2, pages 740-747, July 1997.

[9]

{9} C. Nevill-Manning and I. Witten. Linear-time, incremental hierarchy inference for compression. In Proceedings of the IEEE Data Compression Conference, pages 3-11, 1997.

Digital Library

[10]

{10} A. Orso, T. Apiwattanapong, and M. J. Harrold. Leveraging field data for impact analysis and regression testing. In Proceedings of the ACM SIGSOFT Symposium on Foundations of Software Engineering, pages 128-137, Sept. 2003.

Digital Library

[11]

{11} A. Orso, M. J. Harrold, D. Rosenblum, G. Rothermel, M. L. Soffa, and H. Do. Using component metadata to support the regression testing of component-based software. In Proceedings of the International Conference on Software Maintenance , pages 716-725, November 2001.

Digital Library

[12]

{12} S. L. Pfleeger. Software Engineering: Theory and Practice. Prentice Hall, Englewood Cliffs, NJ, 1998.

Digital Library

[13]

{13} A. Podgurski and L. Clarke. A formal model of program dependences and its implications for software testing, debugging, and maintenance. IEEE Transactions on Software Engineering, 16(9):965-79, Sept. 1990.

Digital Library

[14]

{14} B. G. Ryder and F. Tip. Change impact analysis for object-oriented programs. In Proceedings of the ACM Worshop on Program Analysis for Software Tools and Engineering, pages 46-53, Oct. 2001.

Digital Library

[15]

{15} M. D. Scheemaecker. NanoXML: A small XML parser for Java. http://nanoxml.n3.net, 2002.

[16]

{16} R. J. Turver and M. Munro. Early impact analysis technique for software maintenance. Journal of Software Maintenance, 6(1):35-52, Jan. 1994.

Cited By

Hu JJoung JJacobs MGajos KSeltzer MRothermel GBae D(2020)Improving data scientist efficiency with provenanceProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380366(1086-1097)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380366
Wang WHe YLi TZhu JLiu J(2018)An Integrated Model for Information Retrieval Based Change Impact AnalysisScientific Programming10.1155/2018/59136342018(5)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1155/2018/5913634
Borg MWnuk KRegnell BRuneson P(2017)Supporting Change Impact Analysis Using a Recommendation System: An Industrial Case Study in a Safety-Critical ContextIEEE Transactions on Software Engineering10.1109/TSE.2016.262045843:7(675-700)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1109/TSE.2016.2620458
Show More Cited By

Index Terms

An Empirical Comparison of Dynamic Impact Analysis Algorithms
1. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
      1. Software reverse engineering
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software notations and tools
    1. Software configuration management and version control systems
2. Theory of computation
  1. Logic
    1. Programming logic
  2. Semantics and reasoning
    1. Program reasoning
      1. Program analysis
    2. Program semantics

Recommendations

Dynamic impact analysis: a cost-effective technique to enforce error-propagation

This paper introduces dynamic impact analysis as a cost-effective technique to enforce the error-propagation condition for detecting a fault. The intuition behind dynamic impact analysis is as follows. In a specific test-case, if an execution of a ...
Path-based dynamic impact analysis
A Comparison of Online and Dynamic Impact Analysis Algorithms
CSMR '05: Proceedings of the Ninth European Conference on Software Maintenance and Reengineering

Impact analysis is the process of determining the effect, or impact, of a change to a software system. Dynamic impact analysis uses data obtained from executing a program to perform analysis after program termination for determining impacts more in line ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '04: Proceedings of the 26th International Conference on Software Engineering

May 2004

761 pages

ISBN:0769521630

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

IEEE Computer Society

United States

Publication History

Published: 23 May 2004

Check for updates

Qualifiers

Article

Conference

ICSE04

Sponsor:

SIGSOFT

ICSE04: 26th International Conference on Software Engineering

May 23 - 28, 2004

Acceptance Rates

ICSE '04 Paper Acceptance Rate 58 of 436 submissions, 13%;

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
635
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hu JJoung JJacobs MGajos KSeltzer MRothermel GBae D(2020)Improving data scientist efficiency with provenanceProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380366(1086-1097)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380366
Wang WHe YLi TZhu JLiu J(2018)An Integrated Model for Information Retrieval Based Change Impact AnalysisScientific Programming10.1155/2018/59136342018(5)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1155/2018/5913634
Borg MWnuk KRegnell BRuneson P(2017)Supporting Change Impact Analysis Using a Recommendation System: An Industrial Case Study in a Safety-Critical ContextIEEE Transactions on Software Engineering10.1109/TSE.2016.262045843:7(675-700)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1109/TSE.2016.2620458
Wiese IR RSteinmacher IKuroda ROliva GTreude CGerosa M(2017)Using contextual information to predict co-changesJournal of Systems and Software10.1016/j.jss.2016.07.016128:C(220-235)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1016/j.jss.2016.07.016
Cai HSantelices RThain D(2016)DiaProACM Transactions on Software Engineering and Methodology10.1145/289475125:2(1-50)Online publication date: 6-Apr-2016
https://dl.acm.org/doi/10.1145/2894751
Jones A(2016)Addressing the Regression Test Problem with Change Impact Analysis for AdaProceedings of the 21st Ada-Europe International Conference on Reliable Software Technologies --- Ada-Europe 2016 - Volume 969510.1007/978-3-319-39083-3_5(61-77)Online publication date: 13-Jun-2016
https://dl.acm.org/doi/10.1007/978-3-319-39083-3_5
Gupta CSrivastav MGupta V(2015)Software change impact analysisInternational Journal of Computer Applications in Technology10.1504/IJCAT.2015.07049851:4(366-375)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1504/IJCAT.2015.070498
Cai HSantelices RCrnkovic IChechik MGrünbacher P(2014)DiverProceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering10.1145/2642937.2642950(343-348)Online publication date: 15-Sep-2014
https://dl.acm.org/doi/10.1145/2642937.2642950
Zanjani MSwartzendruber GKagdi HDevanbu PKim SPinzger M(2014)Impact analysis of change requests on source code based on interaction and commit historiesProceedings of the 11th Working Conference on Mining Software Repositories10.1145/2597073.2597096(162-171)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2597073.2597096
Le WPattison SJalote PBriand LHoek A(2014)Patch verification via multiversion interprocedural control flow graphsProceedings of the 36th International Conference on Software Engineering10.1145/2568225.2568304(1047-1058)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2568225.2568304
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents