Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

A Controlled Experiment to Evaluate On-Line Process Guidance

  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

Process-centered software engineering environments are expected to improve an individual's comprehension of work activities, as well as improve communication and reduce conflicts among teams of software developers. We chose to investigate individual responses when using such an environment before looking for a group response. A controlled experiment compared off-line and on-line implementations of measurement-based process guidance to test three hypotheses: first, individuals accomplish their work more efficiently when using on-line process guidance as compared to off-line guidance; second, individuals are willing to use an on-line system for guidance; and third, individuals adjust their behavior based on quantitative quality models. The subjects worked alone on two testing exercises. Subjects used either an off-line or an on-line guidance technique during the first exercise, and the other technique during the second exercise. The results did not confirm the hypotheses. On average, subjects worked more efficiently when using off-line guidance, preferred off-line guidance, and ignored quantitative quality models. Post hoc analysis identified a strong correlation between subject experience level and preference for the type of guidance, a result that deserves further investigation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Basili, V. R. 1994. A research agenda for ISERN: Validating the Quality Improvement Paradigm. Presented at the 1994 ISERN annual meeting.

  • Basili, V. R., and Perricone, B. T. 1984. Software errors and complexity: An empirical investigation. Communications of the ACM 27(1): 42–52.

    Google Scholar 

  • Box, G. E. P., Hunter, W. G., and Hunter, J. S. 1978. Statistics for Experimenters. New York: John Wiley & Sons.

    Google Scholar 

  • Brooks, R. E. 1980. Studying programmer behavior experimentally: The problems of proper methodology. Communications of the ACM 23(4): 207–213.

    Google Scholar 

  • Campbell, D. T., and Stanley, J. C. 1966. Experimental and Quasi-Experimental Designs for Research. Boston: Houghton Mifflin.

    Google Scholar 

  • Christie, A. M. 1995. Software Process Automation, The Technology and Its Adoption. Springer-Verlag.

  • Dart, S. A., Ellison, R. J., Feiler, P. H., and Habermann, A. N. 1987. Software development environments. IEEE Computer: pp. 18–28.

  • Kamsties, E., and Lott, C. M. 1995. An empirical evaluation of three defect-detection techniques. In Proceedings of the Fifth European Software Engineering Conference, Schäfer, W., and Botella, P., (eds.), Lecture Notes in Computer Science, Springer-Verlag, Nr. 989, pp. 362–383.

  • Lott, C. M. 1994. Measurement support in software engineering environments. International Journal of Software Engineering & Knowledge Engineering 4(3): 409–426.

    Google Scholar 

  • Lott, C. M. 1996. Measurement-based feedback in a process-centered software engineering environment. PhD thesis, Department of Computer Science, The University of Maryland, College Park, Maryland 20742. Available online at http://www.cs.umd.edu/users/cml/.

    Google Scholar 

  • Lott, C. M., Hoisl, B., and Rombach, H. D. 1995. The use of roles and measurement to enact project plans in MVP-S. In Proceedings of the Fourth European Workshop on Software Process Technology, Schäfer, W., (ed.), Lecture Notes in Computer Science, Noordwijkerhout, The Netherlands, Springer-Verlag, Nr. 913, pp. 30–48.

    Google Scholar 

  • Lott, C. M., and Rombach, H. D. 1993. Measurement-based guidance of software projects using explicit project plans. Information and Software Technology 35(6/7): 407–419.

    Google Scholar 

  • Perry, D. E., and Kaiser, G. E. 1991. Models of software development environments. IEEE Transactions on Software Engineering 17(3): 283–295.

    Google Scholar 

  • Sørumgård, S. 1996. An empirical study of process conformance. In Proceedings of the 21st Annual Software Engineering Workshop. NASA Goddard Space Flight Center, Greenbelt MD 20771.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Bell Communications Research, 445 South Street, MCC 1H-331B, Morristown, NJ, 07960, USA

    Christopher M. Lott

Authors
  1. Christopher M. Lott
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lott, C.M. A Controlled Experiment to Evaluate On-Line Process Guidance. Empirical Software Engineering 2, 269–289 (1997). https://doi.org/10.1023/A:1009768000763

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1009768000763

Search

Navigation