Abstract
A considerable number of software suppliers report improvements in product and service quality, development costs and time to market achieved with the help of the ISO 9000 standards. Nevertheless, the ISO 9000 family has received unfavourable criticism in journals, textbooks and at software quality conferences. The paper summarizes, discusses and reviews eleven of the most popular arguments against the ISO 9000 standards. The review of the criticism is based on findings of two empirical surveys among European software suppliers that have implemented an ISO 9000 quality system. The paper concludes with suggestions and guidelines for advances in software quality management concepts, such as the ISO 9000 family, CMM, BOOTSTRAP and the emerging SPICE standard.
Similar content being viewed by others
References
ISO 9000-1 Quality management and quality assurance standards, Part 1: Guidelines for selection and use (ISO, Geneva, 1994).
ISO 9001 Quality systems. Model for quality assurance in design, development, production, installation and servicing (ISO, Geneva, 1994).
ISO 9002 Quality systems. Model for quality assurance in production, installation and servicing (ISO, Geneva, 1994).
ISO 9003 Quality systems. Model for quality assurance in final inspection and test (ISO, Geneva, 1994).
ISO 9000-2 Quality management and quality assurance standards, Part 2: Generic guidelines for the application of ISO 9001, ISO 9002 and ISO 9003 (ISO, Geneva, 1993).
ISO 9000-3 Quality management and quality assurance standards, Part 3: Guidelines for the application of ISO 9001 to the development, supply and maintenance of software (ISO, Geneva, 1992).
ISO 9004-1 Quality management and quality system elements, Part 1: Guidelines (ISO, Geneva, 1994).
G. Bellin and D. Stelzer. Softwarequalitaetsmanagement gemaeß ISO 9000. Ergebnisse einer empirischen Untersuchung zertifizierter Qualitaetsmanagementsysteme.(Studien zur Systementwicklung des Lehrstuhls fuer Wirtschaftsinformatik der Universitaet zu Koeln, Koeln, 1995).
D. Stelzer. Interpretation der ISO 9000-Familie bei der Zertifizierung von Qualitaetsmanagement-systemen fuer die Softwareentwicklung, in Qualitaetsmanagement und Software: ISO 9000 - Softwareentwicklung - Ethik - Analysen - Tools, N. Ruppenthal and U. Sigor, (eds) (Lit Verlag, Muenster, 1995).
D. Stelzer, W. Mellis and G. Herzwurm. Software process improvement via ISO 9000? Results of two surveys among European software houses, in Proceedings of the Twenty-Ninth Annual Hawaii International Conference on System Sciences, 3-6 January, 1996, Wailea, Hawaii, USA, Volume 1. Software Technology and Architecture, H. El-Rewini and B.D. Shriver, (eds) (IEEE Computer Society Press, Washington, 1996) pp. 703-712.
ISO 9004-4 Quality management and quality system elements, Part 4: Guidelines for quality improvement (ISO, Geneva, 1993).
P. Haynes and S. Meyn. Is ISO 9000 going to put you out of business? American Programmer, 7(9), 25-29, 1994.
J. Herbsleb, A. Carleton, J. Rozum, J. Siegel and D. Zubrow. Benefits of CMM-based software process improvement: initial results (Technical Report, CMU/SEI-94-TR-13. ESC-TR-94-013, Pittsburgh, 1994).
T. Matsubara. Does ISO 9000 really help improve software quality? American Programmer, 7(2), 38–45, 1994.
F. Coallier. How ISO 9001 fits into the software world, IEEE Software, 11, 98-100, 1994.
M. Paulk, B. Curtis, M. Chrissis and C. Weber. Capability Maturity Model for Software, Version 1.1 (Technical Report CMU/SEI-93-TR-024, Pittsburgh, 1993).
D.E. Avison, H.U. Shah and D.N. Wilson. Software Quality standards in practice: the limitations of using ISO-9001 to support software development, Software Quality Journal, 3, 105–111, 1994.
Y. Iizuka. Is TQM Effective for Software Quality?, in Proceedings of the First World Congress for Software Quality, 20-22 June, 1995, San Francisco, CA, American Society for Quality Control (ASQC), European Organization for Quality (EOQ), Society for Software Quality-USA (SSQ), Union of Japanese Scientists and Engineers (JUSE) (eds.) (ASQC, San Francisco, 1995) pp. 1-10.
M. Vering and V. Haentjes. Ist ISO 9000 ein geeignetes Werkzeug für Process Engineering? Ein Erfahrungsbericht aus der SAP-Entwicklung. Management & Computer, 3(2), 85-90, 1995.
Department of Trade and Industry (DTI), British Standards Institute (BSI) TickIT - making a better job of software. Guide to Software Quality Management System Construction and Certification using EN 29001.Issue 3.0. (DTI, BSI, London, 1995).
ITQS European Information Technology Quality System Auditor Guide (ITQS, Brussels, 1992).
M. Paulk. Basis of contrast between ISO 9001 and SEI Capability Maturity Model challenged. IEEE Computer, 26(10), 81–82, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Stelzer, D., Mellis, W. & Herzwurm, G. A critical look at ISO 9000 for software quality management. Software Quality Journal 6, 65–79 (1997). https://doi.org/10.1023/A:1018591430752
Issue Date:
DOI: https://doi.org/10.1023/A:1018591430752