Article

Towards a software evolution benchmark

Authors:

Serge Demeyer,

Tom Mens,

Michel WermelingerAuthors Info & Claims

IWPSE '01: Proceedings of the 4th International Workshop on Principles of Software Evolution

Pages 174 - 177

https://doi.org/10.1145/602461.602502

Published: 10 September 2001 Publication History

Get Access

Abstract

Case-studies are extremely popular in rapidly evolving research disciplines such as software engineering because they allow for a quick but fair assessment of new techniques. Unfortunately, a proper experimental set-up is rarely the case: all too often case-studies are based on a single small toy-example chosen to favour the technique under study. Such lack of scientific rigor prevents fair evaluation and has serious consequences for the credibility of our field. In this paper, we propose to use a representative set of cases as benchmarks for comparing various techniques dealing with software evolution. We hope that this proposal will launch a consensus building process that eventually must lead to a scientifically sound validation method for researchers investigating reverse- and re-engineering techniques.

References

[1]

Fenton, N., S. L. Pfleeger and R. L. Glass "Science and Substance: a Challenge to Software Engineers". IEEE Software 11(4), July 1994.

Digital Library

Google Scholar

[2]

Fenton, N. and S. L. Pfleeger, Software Metrics: A Rigourous and Practical Approach, International Thomson Computer Press, 1997.

Digital Library

Google Scholar

Cited By

View all

Karanikolas CDimitroulakos GMasselos K(2023)Simulating Software Evolution to Evaluate the Reliability of Early Decision-making among Design Alternatives toward MaintainabilityACM Transactions on Software Engineering and Methodology10.1145/356993132:3(1-38)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.1145/3569931
Espinha TChen CZaidman AGross H(2012)Maintenance Research in SOA - Towards a Standard Case StudyProceedings of the 2012 16th European Conference on Software Maintenance and Reengineering10.1109/CSMR.2012.49(391-396)Online publication date: 27-Mar-2012
https://dl.acm.org/doi/10.1109/CSMR.2012.49
Mens TD'Hondt M(2007)PrefaceElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2006.09.010166(1-4)Online publication date: 1-Jan-2007
https://dl.acm.org/doi/10.1016/j.entcs.2006.09.010
Show More Cited By

Index Terms

Towards a software evolution benchmark
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
    1. Software post-development issues

Recommendations

Software evolution: background, theory, practice
Special issue: Contribution to computing science

This paper opens with a brief summary of some 30 years of study of the software evolution phenomenon. The results of those studies include the SPE program classification, a principle of software uncertainty and laws of E-type software evolution. The ...
An Empirical Approach to Studying Software Evolution

With the approach of the new millennium, a primary focus in software engineering involves issues relating to upgrading, migrating, and evolving existing software systems. In this environment, the role of careful empirical studies as the basis for ...
Towards a better understanding of software evolution: an empirical study on open-source software

Software evolution is a fact of life. Over the past 30years, researchers have proposed hypotheses on how software changes and provided evidence that both supports and refutes these hypotheses. To paint a clearer image of the software evolution process, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IWPSE '01: Proceedings of the 4th International Workshop on Principles of Software Evolution

September 2001

200 pages

ISBN:1581135084

DOI:10.1145/602461

Conference Chair:
Tetsuo Tamai
University of Tokyo, Japan

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 September 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
642
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Karanikolas CDimitroulakos GMasselos K(2023)Simulating Software Evolution to Evaluate the Reliability of Early Decision-making among Design Alternatives toward MaintainabilityACM Transactions on Software Engineering and Methodology10.1145/356993132:3(1-38)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.1145/3569931
Espinha TChen CZaidman AGross H(2012)Maintenance Research in SOA - Towards a Standard Case StudyProceedings of the 2012 16th European Conference on Software Maintenance and Reengineering10.1109/CSMR.2012.49(391-396)Online publication date: 27-Mar-2012
https://dl.acm.org/doi/10.1109/CSMR.2012.49
Mens TD'Hondt M(2007)PrefaceElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2006.09.010166(1-4)Online publication date: 1-Jan-2007
https://dl.acm.org/doi/10.1016/j.entcs.2006.09.010
Ratzinger JFischer MGall H(2005)Improving evolvability through refactoringProceedings of the 2005 international workshop on Mining software repositories10.1145/1083142.1083155(1-5)Online publication date: 17-May-2005
https://dl.acm.org/doi/10.1145/1083142.1083155
Ratzinger JFischer MGall H(2005)Improving evolvability through refactoringACM SIGSOFT Software Engineering Notes10.1145/1082983.108315530:4(1-5)Online publication date: 17-May-2005
https://dl.acm.org/doi/10.1145/1082983.1083155
Sim SEasterbrook SHolt RClarke LDillon LTichy W(2003)Using benchmarking to advance researchProceedings of the 25th International Conference on Software Engineering10.5555/776816.776826(74-83)Online publication date: 3-May-2003
https://dl.acm.org/doi/10.5555/776816.776826
Sim SEasterbrook SHolt R(2003)Using benchmarking to advance research: a challenge to software engineering25th International Conference on Software Engineering, 2003. Proceedings.10.1109/ICSE.2003.1201189(74-83)Online publication date: 2003
https://doi.org/10.1109/ICSE.2003.1201189
Mens TDemeyer STamai T(2001)Future trends in software evolution metricsProceedings of the 4th International Workshop on Principles of Software Evolution10.1145/602461.602476(83-86)Online publication date: 10-Sep-2001
https://dl.acm.org/doi/10.1145/602461.602476

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Software evolution: background, theory, practice

An Empirical Approach to Studying Software Evolution

Towards a better understanding of software evolution: an empirical study on open-source software