Abstract
Open Source Software (OSS) products are widely used although a general consensus on their quality is far to be reached. Providing results on OSS reliability - as quality indicator – contributes to shed some light on this issue and allows organizations to make informed decisions in adopting OSS products or in releasing their own OSS. In this paper, we use a classical technique of Software Reliability Growth to model failures occurrences across versions. We have collected data from the bug tracking systems of three OSS products, Mozilla Firefox, OpenSuse and OpenOffice.org. Our analysis aims at determining and discussing patterns of failure occurrences in the three OSS products to be used to predict reliability behaviour of future releases. Our findings indicate that in the three cases, failures occurrences follow a predetermined pattern, which shows: a) an initial stage in which the community learns the new version b) after this first period a rapid increase of the failure detection rate until c) very few failures are left and the discovery of a new failure discovery is rare. This is the stage in which the version can be considered reliable.
Chapter PDF
Similar content being viewed by others
References
Antoniol, G., Ayari, K., Di Penta, M., Khomh, F., Guéhéneuc, Y.: Is it a bug or an enhancement?: a text-based approach to classify change requests. In: CASCON 2008, vol. 23 (2008)
Bassin, K., Santhanam, P.: Use of software triggers to evaluate software process effectiveness and capture customer usage profiles. In: Eighth International Symposium on Software Reliability Engineering, Case Studies, pp. 103–114. IEEE Computer Society, Los Alamitos (1997)
Draper, N.R., Smith, H.: Applied Regression Analysis. Wiley- Interscience, Chichester (1998)
Fenton, N., Neil, M.: A Critique of Software Defect Prediction Models. IEEE Transactions on Software Engineering 25(5), 675–689 (1999)
Godfrey, M.W., Whitehead, J.: Proceedings of the 2009 6th IEEE International Working Conference on Mining Software Repositories, Vancouver Canada, May 16-17 (2009)
Li, P.L., Herbsleb, J., Shaw, M.: Forecasting field defect rates using a combined timebased and metrics-based approach: a case study of OpenBSD. In: 16th IEEE International Symposium on Software Reliability Engineering (ISSRE), pp. 10–19 (2005)
Li, P.L., Herbsleb, J., Shaw, M.: Finding Predictors of Field Defects for Open Source Software Systems in Commonly Available Data Sources: a Case Study of OpenBSD. In: 11th IEEE International Symposium on Software Metrics (2005)
Li, P.L., Shaw, M., Herbsleb, J., Ray, B., Santhanam, P.: Empirical evaluation of defect projection models for widely-deployed production software systems. In: Proceedings of the twelfth international symposium on Foundations of software engineering, pp. 263–272 (2004)
Li, P.L., Shaw, M., Herbsleb, J.: Selecting a defect prediction model for maintenance resource planning and software insurance. In: Proceedings of the Fifth International Workshop on Economics-driven Software Engineering Research, Oregon, USA (2003)
Lyu, M.R.: Handbook of Software Reliability Engineering. McGraw-Hill, New York (1996)
Musa, J.D., Iannino, A., Okumoto, K.: Software Reliability: Measurement, Prediction, Application. McGraw-Hill, New York (1989)
Rahmani, C., Siy, H., Azadmanesh, A.: An Experimental Analysis of Open Source Software Reliability. In: F2DA 2009 Workshop on 28th IEEE Symposium on Reliable Distributed Systems, Niagara Falls (2009)
Rigdon, S.E., Basu, A.P.: Statistical Methods for the Reliability of Repairable systems, p. 281. Wiley and Sons, Chichester (2000)
Succi, G., Pedrycz, W., Stefanovic, M., Russo, B.: An Investigation on the Occurrence of Service Requests in Commercial Software Applications. Empirical Software Engineering Journal 8(2), 197–215 (2003)
Tamura, Y., Yamada, S.: Comparison of Software Reliability Assessment Methods for Open Source Software. In: 11th International Conference on Parallel and Distributed Systems - Workshops (ICPADS 2005), vol. 2, pp. 488–492 (2005)
Wood, A.: Predicting software reliability. Computer 29(11), 69–77 (1996)
Yamada, S., Ohba, M., Osaki, S.: S-Shaped Reliability Growth Modeling for Software Error Detection. IEEE Transactions on Reliability, 475–484 (December 1983)
Zhou, Y., Davis, J.: Open Source Software Reliability Model: an empirical approach. In: International Conference on Software Engineering: Proceedings of the fifth workshop on Open Source Software Engineering, St. Louis, MO (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 IFIP
About this paper
Cite this paper
Rossi, B., Russo, B., Succi, G. (2010). Modelling Failures Occurrences of Open Source Software with Reliability Growth. In: Ågerfalk, P., Boldyreff, C., González-Barahona, J.M., Madey, G.R., Noll, J. (eds) Open Source Software: New Horizons. OSS 2010. IFIP Advances in Information and Communication Technology, vol 319. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13244-5_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-13244-5_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13243-8
Online ISBN: 978-3-642-13244-5
eBook Packages: Computer ScienceComputer Science (R0)