Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1822327.1822341acmconferencesArticle/Chapter ViewAbstractPublication PagesuccsConference Proceedingsconference-collections
research-article

Designing and implementing a measurement program for Scrum teams: what do agile developers really need and want?

Published: 19 May 2010 Publication History

Abstract

Agile developers are generally reluctant to non-agile practices. Promoted by senior software practitioners, agile methods were intended to avoid traditional engineering practices and rather focus on delivering working software as quickly as possible. Thus, the unique measure in Scrum, a well known framework for managing agile projects, is velocity. Its main purpose is to demonstrate the progress in delivering working software. In software engineering (SE), measurement programs have more in depth purposes and allow teams and individuals to improve their development process along with providing better product quality and control over the project. This paper will describe the experience and the approach used in an agile SE company to design and initiate a measurement program taking into account the specificities of their agile environment, principles and values. The lessons learned after five months of investigation are twofold. The first one shows how agile teams, in comparison to traditional teams, have different needs when trying to establish a measurement program. The second confirms that agile teams, as many other groups of workers, are reluctant and resistant to change. Finally, the preliminary results show that agile people are more interested in value delivery, technical debt, and multiple aspects related to team dynamics and will cooperate to the collection of data as soon as there tools can do it for them. It is believed that this research could suggest new guidelines for elaborating specific measurement programs in other agile environments.

References

[1]
Ktata, O. and Lévesque, G. 2009. Agile development: issues and avenues requiring a substantial enhancement of the business perspective in large projects. In Proceedings of the 2nd Canadian Conference on Computer Science and Software Engineering (Montreal, Quebec, Canada, May 19--21, 2009). C3S2E '09. ACM
[2]
Schwaber, K., The enterprise and SCRUM, Microsoft Press, 2007
[3]
Shore, J., 'The art of agile development', O'reilly, 2008
[4]
Mahnic, V., Vrana, I., 'Using stakeholder driven process performance measurement for monitoring the performance of a Scrum based software development process,' Electrotechnical Review, Ljubljana, Vol. 74, No. 5, 2007, pp. 241--247.
[5]
Nicolette, D., http://davenicolette.wikispaces.com/Agile+Metrics., presentation agile conference 2009
[6]
2008 BPM & Workflow Handbook - Spotlight on Human-Centric BPM, May 5, 2008 by Layna Fischer (editor)
[7]
Hartmann, D. and Dymond, R. 2006. Appropriate Agile Measurement: Using Metrics and Diagnostics to Deliver Business Value. In Proceedings of the Conference on AGILE 2006 (July 23--28, 2006). IEEE Computer Society
[8]
Levison M., 'What is a Good Agile Metric?', November 2009, InfoQ
[9]
Van Solingen, R., Basili, V., Caldiera, Gianluigi, and Rombach, D. H. Goal Question Metric (GQM) Approach, Encyclopedia of Software Engineering (Marciniak, J. J. ed.), online version @ Wiley Interscience, John Wiley & Sons, 2002.
[10]
Ragland, B. Measure, Metric, or Indicator: What's the Difference?, Software Technology Support Center, http://www.stsc.hill.af.mil/crosstalk/1995/03/Measure.asp, last visited January 2009
[11]
Van Solingen, Rini and Berghout, Egon, 'The Goal/Question/Metric Method: A Practical Guide for Quality Improvement of Software Development', McGraw Hill, 1999.
[12]
Basili V. R., "Software Modeling and Measurement: The Goal Question Metric Paradigm," Computer Science Technical Report Series, CS-TR-2956 (UMIACS-TR-92-96), University of Maryland, College Park, MD, September 1992
[13]
Russell L. Ackoff, 'Systems Thinking for Curious Managers.' Triarchy Press, 2010
[14]
Henrik, Knieberg, http://www.crisp.se/henrik.kniberg/cause-effect-diagrams.pdf, Last viewed January 2009
[15]
Draper, D., http://www.agiledesign.co.uk/technical/technical-debt-revisited/, last visited January 2010
[16]
Boehm, B. and Turner, R. 2003 Balancing Agility and Discipline: a Guide for the Perplexed. Addison-Wesley Longman Publishing Co., Inc.
[17]
McConnel, S., Software Estimation: Demystifying the Black Art. Redmond, Wa.: Microsoft Press, 200

Cited By

View all
  • (2024)Technical Debt Monitoring Decision Making with Skin in the GameACM Transactions on Software Engineering and Methodology10.1145/366480533:7(1-27)Online publication date: 26-Aug-2024
  • (2024)Security for Machine Learning-based Software Systems: A Survey of Threats, Practices, and ChallengesACM Computing Surveys10.1145/363853156:6(1-38)Online publication date: 23-Feb-2024
  • (2022)Use of software and project management metrics in agile software development methodologiesProceedings of the 2022 European Symposium on Software Engineering10.1145/3571697.3571701(25-32)Online publication date: 27-Oct-2022
  • Show More Cited By

Recommendations

Reviews

Andrew Brooks

Agile software development relies on burn-down charts to track progress. Traditional process control, however, demands substantial measurement programs. So what are the needs and wants of agile developers regarding such programs__?__ To answer this question, a study was undertaken in a company specializing in the use of agile processes. Observations revealed several areas for improvement. For example, discipline was found to be poor in the recording of estimates and actual task times. Semi-structured interviews were held to determine areas for improvement that stakeholders could agree upon. Stakeholder votes are clearly indicated in Tables 4 through 7. The top three areas were visibility of business value (seven votes), estimation of user stories in terms of size and time (five votes), and visibility of technical debt (four votes). Figure 1 is an emergent cause-and-effect diagram for unhealthy technical debt. Increasing a team's estimation ability is the stated remedy to this debt problem. With no report of a pilot study to test the effectiveness of a measurement program, some readers would view the paper's title as misleading. No clear description is provided of estimation techniques used by the company. The reader should not have to assume that "Planning Poker" was the only estimation practice. In addition, if the mean error rate in estimation is worse than 20 percent, what is it__?__ The reader is not informed. Despite these criticisms, insights into one company's agile failings are useful. As such, I recommend this paper to agile teams and those researching agile processes. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
C3S2E '10: Proceedings of the Third C* Conference on Computer Science and Software Engineering
May 2010
156 pages
ISBN:9781605589015
DOI:10.1145/1822327
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 May 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Scrum
  2. agile metrics
  3. agile software process
  4. business value
  5. goal-question-metric
  6. measurement program

Qualifiers

  • Research-article

Conference

C3S2E '10
Sponsor:
  • ACM
  • Concordia University

Acceptance Rates

Overall Acceptance Rate 12 of 42 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)8
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Technical Debt Monitoring Decision Making with Skin in the GameACM Transactions on Software Engineering and Methodology10.1145/366480533:7(1-27)Online publication date: 26-Aug-2024
  • (2024)Security for Machine Learning-based Software Systems: A Survey of Threats, Practices, and ChallengesACM Computing Surveys10.1145/363853156:6(1-38)Online publication date: 23-Feb-2024
  • (2022)Use of software and project management metrics in agile software development methodologiesProceedings of the 2022 European Symposium on Software Engineering10.1145/3571697.3571701(25-32)Online publication date: 27-Oct-2022
  • (2022)How Agile Organizations Use Metrics: A Systematic Literature MappingProceedings of the XXI Brazilian Symposium on Software Quality10.1145/3571473.3571479(1-11)Online publication date: 7-Nov-2022
  • (2021)Key Performance Indicators for the Integration of the Service-Oriented Architecture and Scrum Process Model for IOTScientific Programming10.1155/2021/66135792021(1-11)Online publication date: 2-Feb-2021
  • (2019)Towards an Understanding of Value Creation in Agile Software DevelopmentProceedings of the XV Brazilian Symposium on Information Systems10.1145/3330204.3330256(1-8)Online publication date: 20-May-2019
  • (2018)Calculating Completeness of Agile Scope in Scaled Agile DevelopmentIEEE Access10.1109/ACCESS.2017.27653516(5822-5847)Online publication date: 2018
  • (2017)Risk management analysis in Scrum software projectsInternational Transactions in Operational Research10.1111/itor.1240126:5(1884-1905)Online publication date: 8-Mar-2017
  • (2016)Investigating Vincenti Engineering Principles in Support to the Auditing of Measurement Processes in Agile OrganizationsJournal of Software10.17706/jsw.11.2.201-21111:2(201-211)Online publication date: 2016
  • (2016)An Academic Case Study Using ScrumInformation Technolog: New Generations10.1007/978-3-319-32467-8_63(723-731)Online publication date: 29-Mar-2016
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media