Abstract
This paper describes a replication conducted to compare the effectiveness of inspectors using Perspective Based Reading (PBR) to the effectiveness of inspectors using a checklist. The goal of this replication was to better understand the complementary aspects of the PBR perspectives. To this end, a brief discussion of the original study is provided as well as a more detailed description of the replication. A detailed statistical analysis is then provided along with analysis of the PBR perspectives.
For the individual PBR perspectives, we saw an interesting dichotomy: In the original study there was little overlap among the sets of defects found by each of the three perspectives, while in the replication two of the three perspectives found similar sets of defects on one of the two documents used in the study. Interestingly this document was the only case where the users of PBR were not more effective than the users of a checklist. This result leads to a new hypothesis that the complementary aspect of the PBR perspectives is the characteristic that provides the benefit over other defect detection techniques.
Similar content being viewed by others
References
Basili V, Green S, Laitenberger O, Shull F, Sorumgaard S Zelkowitz M (1996) The empirical investigation of perspective based reading. Empir Softw Eng-Int J 1:133–164
Ciolkowski M, Differding C, Laitenberger O, Munch J (1997) Empirical investigation of perspective-based reading: a replicated experiment. ISERN 97–13
Conradi R, Mahagheghi P, Arif T, Hegde LC, Bunde GA, Pedersen A (2003) Object-oriented reading techniques for inspection of uml models—an industrial experiment. Proc of Eur Conf on Object Oriented Program (ECOOP'03). Darmstadt, Germany, pp. 483–500. Darmstadt, Germany, 483–500
Laitenberger O, Atkinson C, Schlich M, El Emam K (2000) An experimental comparison of reading techniques for defect detection in uml design documents. J Syst Softw 53: 183–204
Laitenberger O, El Emam K, Harbich TG (2001) An internally replicated quasi-experimental comparison of checklist and perspective based reading of code documents. IEEE Trans Softw Eng 27:387–421
Mendonca M, Sunderhaft NL (1999) A state of the Art Report: Mining Software Engineering Data. Department of Defense (DoD) Data & Analysis Center for Software Engineering Data
Porter A, Votta L (1998) Comparing detection methods for software requirements inspections: a replication using professional subjects. Empir Softw Eng-Int Journal 3:355–379
Regnell B, Runeson P, Thelin T (2000) Are the perspectives really different? Further experimentation on scenario-based reading of requirements. Empir Softw Eng 5:331–356
Robson C (2002) Real World Research. Blackwell Publishing, Malden: MA
Shull F (1998) Developing Techniques for Using Software Documents: A Series of Empirical Studies. Ph.D. Thesis. Department of Computer Science, University of Maryland, College Park
Shull F, Basili V, Boehm B, Brown AW, Costa P, Lindvall M, Port D, Rus I, Tesoriero R, Zelkowitz M (2002a). What we have learned about fighting defects. Proc IEEE Symp on Softw Metr 249–258
Shull F, Basili V, Carver J, Maldonado J, Travassos G, Mendonca M, Fabbri S (2002b) Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem. Proc of Int Symp Empir Softw Eng (ISESE'02). Nara, Japan, pp. 7–16
Zhang Z, Basili V, Shneiderman B (1999) Perspective-based usability inspection: an empirical validation of efficacy. Empirical Software Engineering—An International Journal 4:43–70
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Maldonado, J.C., Carver, J., Shull, F. et al. Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness. Empir Software Eng 11, 119–142 (2006). https://doi.org/10.1007/s10664-006-5967-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10664-006-5967-6