Nothing Special   »   [go: up one dir, main page]

skip to main content
article

An empirical methodology for introducing software processes

Published: 01 September 2001 Publication History

Abstract

There is a growing interest in empirical study in software engineering, both for validating mature technologies and for guiding improvements of less-mature technologies. This paper introduces an empirical methodology, based on experiences garnered over more than two decades of work by the Empirical Software Engineering Group at the University of Maryland and related organizations, for taking a newly proposed improvement to development processes from the conceptual phase through transfer to industry. The methodology presents a series of questions that should be addressed, as well as the types of studies that best address those questions. The methodology is illustrated by a specific research program on inspection processes for Object-Oriented designs. Specific examples of the studies that were performed and how the methodology impacted the development of the inspection process are also described.

References

[1]
Basili, V. R. and Caldiera, G. "Improve Software Quality by Reusing Knowledge and Experience," Sloan Management Review 37, 1 (Fall 1995), 55-64.
[2]
Basili, V.R., Green, S., Laitenberger, O., Shull, F., Sorumgaard, S.L., and Zelkowitz, M.V. "The Empirical Investigation of Perspective-based Reading." Empirical Software Engineering, An International Journal, Volume 1, Number 2, pp. 133- 164, Kluwer Academic Publishers, October 1996.
[3]
Basili, V.R. "Evolving and Packaging Reading Technologies." Special Issue, The Journal of Systems and Software, Volume 38, Number 1, pp.3-12, July 1997.
[4]
Basili, V. R.; Shull, F.; and Lanubile, F. Building Knowledge through Families of Experiments. IEEE Transactions on Software Engineering 25, 4 (July 1999), 456-473.
[5]
Boehm, B. and Basili, V. "Software Defect Reduction Top 10 List", IEEE Computer, 34, 1, (January 2001) 135-137. www.cebase.org
[6]
Campbell, D.; and Stanley, J. Experimental and Quasi-Experimental Designs for Research. Houghton Mifflin Company, Boston 1963.
[7]
"Concluding Panel: Metrics Faceoff - What Industry Needs from Researches: What Researchers need from Industry." Software Metrics Symposium, Bethesda, MD, Nov 1998.
[8]
Host, M.; Regnell, B. and Wohlin, C. Using Students as Subjects: A Comparative Study of Students and Professionals in Lead-Time Impact Assessment. In Empirical Software Engineering - An International Journal. Vol. 5, No. 3, Nov 2000
[9]
Kitchenham, B.; Pickard, L.; and Pfleeger, S.L. Case Studies for Method and Tool Evaluation. IEEE Software 12, 4 (July 1995), 52-62.
[10]
Pfleeger, S.L. Software Engineering: Theory and Practice. Prentice-Hall, 1998.
[11]
Porter, A.; Votta Jr., L.; and Basili, V. R. Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment. IEEE TSE 21, 6 (June 1995), 563-575.
[12]
Pressman, R. Software Engineering: A Practitioner's Approach, 4th ed., McGraw-Hill, 1997.
[13]
Rombach, D. "Fraunhofer: The German Model for Applied Research and Technology Transfer." In Proc. ICSE'00 (Limerick, Ireland, Apr. 2000), 531-7.
[14]
Shull, F. Developing Techniques for Using Software Documents: A Series of Empirical Studies. PhD Thesis, Computer Science Dept., University of Maryland. 1998.
[15]
Shull, F.; Travassos, G.; Carver, J.; and Basili, V. R. Evolving a Set of Techniques for OO Inspections. University of Maryland Technical Report CS-TR- 4070. October 1999.
[16]
Shull, F.; Rus, I.; and Basili, V.R. How Perspective- Based Reading Can Improve Requirements Inspections. IEEE Computer 33, 7 (July 2000), 73-79.
[17]
Singer, J.; and Lethbridge, T. Methods for Studying Maintenance Activities. In Proc. of the Workshop for Empirical Studies of Software Maintenance (Monterey CA, Nov. 1996), 105-110.
[18]
"Software Past, Present, and Future: Views from Government, Industry, and Academia." Panel Discussion, NASA Software Engineering Workshop, Greenbelt, MD, 1999.
[19]
Travassos, G.; Shull, F.; Fredericks, M.; and Basili, V. R. Detecting Defects in Object-Oriented Designs: Using Reading Techniques to Increase Software Quality. In Proc. OOPSLA'99 (Denver CO, Nov. 1999), ACM Press, 47-56.
[20]
Travassos, G.; Shull, F.; Carver, J.; and Basili, V. R. Reading Techniques for OO Design Inspections. In Proc. of the 24 th Annual Software Engineering Workshop (Greenbelt MD, Dec. 1999), NASA Goddard Space Flight Center (SEL-99-002).
[21]
Travassos, G.H., Shull, F. and Carver, J. "A Family of Reading Techniques for OO Design Inspections." In Proceedings of the WQS'2000 - Software Quality Workshop, (October 2000), Brazilian Symposium on Software Engineering, p.225-237.
[22]
Werner, C.M.L., Travassos, G.H., Rocha, A.R.C. "An OO Software Engineering Training Experience within a Collaboration Project between Academia and Industry." In Proceedings of TOOLS27 - Technology of Object Oriented Languages and Systems, IEEE Computer Society, pp.290-294, Beijing, China, 1998.
[23]
Zelkowitz M. V. and D. Wallace, Experimental models for validating computer technology, IEEE Computer 31, 5 (May, 1998) 23-31
[24]
Zhang, Z.; Basili, V. R.; and Shneiderman, B. An Empirical Study of Perspective-Based Usability Inspection. In Proc. of Human Factors and Ergonomics Society Annual Meeting (Chicago IL, Oct. 1998).

Cited By

View all
  • (2024)Maintaining Consistency in the Coevolution of iStar Models and Use Cases in Requirements Engineering2024 L Latin American Computer Conference (CLEI)10.1109/CLEI64178.2024.10700503(1-10)Online publication date: 12-Aug-2024
  • (2024)Evaluating Usability and UX in Touchable Holographic Solutions: A Validation Study of the UUXE-ToH QuestionnaireInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2400755(1-21)Online publication date: 20-Sep-2024
  • (2023)Technologies for Hedonic Aspects Evaluation in Text-based Chatbots: A Systematic Mapping StudyProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638089(1-11)Online publication date: 16-Oct-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes
ACM SIGSOFT Software Engineering Notes  Volume 26, Issue 5
Sept. 2001
329 pages
ISSN:0163-5948
DOI:10.1145/503271
Issue’s Table of Contents
  • cover image ACM Conferences
    ESEC/FSE-9: Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering
    September 2001
    329 pages
    ISBN:1581133901
    DOI:10.1145/503209
    • Conference Chairs:
    • A. Min Tjoa,
    • Volker Gruhn
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2001
Published in SIGSOFT Volume 26, Issue 5

Check for updates

Author Tags

  1. OO design inspections
  2. empirical studies
  3. experimental process
  4. software process
  5. software quality

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)56
  • Downloads (Last 6 weeks)7
Reflects downloads up to 27 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Maintaining Consistency in the Coevolution of iStar Models and Use Cases in Requirements Engineering2024 L Latin American Computer Conference (CLEI)10.1109/CLEI64178.2024.10700503(1-10)Online publication date: 12-Aug-2024
  • (2024)Evaluating Usability and UX in Touchable Holographic Solutions: A Validation Study of the UUXE-ToH QuestionnaireInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2400755(1-21)Online publication date: 20-Sep-2024
  • (2023)Technologies for Hedonic Aspects Evaluation in Text-based Chatbots: A Systematic Mapping StudyProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638089(1-11)Online publication date: 16-Oct-2023
  • (2023)IoThinking: A Design Thinking technique to support the design of IoT systemsProceedings of the XXXVII Brazilian Symposium on Software Engineering10.1145/3613372.3613422(458-463)Online publication date: 25-Sep-2023
  • (2023)A feasibility study of usability and UX evaluation technologies in multi-touch context: A quantitative and qualitative analysisProceedings of the XXXVII Brazilian Symposium on Software Engineering10.1145/3613372.3613393(475-484)Online publication date: 25-Sep-2023
  • (2023)Privacy Threat MOdeling LanguageIEEE Access10.1109/ACCESS.2023.325554811(24448-24471)Online publication date: 2023
  • (2022)Evaluating Approaches to Selecting Design Thinking Techniques : Quantitative and Qualitative AnalysisProceedings of the XXI Brazilian Symposium on Software Quality10.1145/3571473.3571482(1-10)Online publication date: 7-Nov-2022
  • (2022)A Strategy to Support the Infeasible Test Requirements IdentificationProceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing10.1145/3559744.3559748(29-38)Online publication date: 3-Oct-2022
  • (2022)A systematic mapping study on usability and user eXperience evaluation of multi-touch systemsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559131(1-12)Online publication date: 17-Oct-2022
  • (2022)PTMOLProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559115(1-12)Online publication date: 17-Oct-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media