Abstract
This paper examines the trade-off between the utility of outputs from simplified functional sizing approaches, and the effort required by these sizing approaches, through a pilot study. The goal of this pilot study was to evaluate the quality of sizing output provided by NESMA’s simplified size estimation methods, adapt their general principles to enhance their accuracy and extent of relevance, and empirically validate such an adapted approach using commercial software projects. A dataset of 11 projects was sized using this adapted approach, and these results compared with those of the established Indicative, Estimated and Full NESMA method approaches. The performances of these adaptations were evaluated against the NESMA approaches in three ways: (1) effort to perform; (2) the accuracy of the total function counts produced; and (3) the accuracy of the profiles of the function counts for each of the base functional component types. The adapted approach outperformed the Indicative NESMA in terms of sizing accuracy and generally performed as well as the Estimated NESMA across both datasets, and required only ~ 50 % of the effort incurred by the Estimated NESMA. This adapted approach, applied to varying levels of information presented in commercial requirements documentation, overcame some of the limitations of simplified functional sizing methods by providing more than simply the simplified ‘indication’ of overall functional size. The provision and refinement of the more detailed function profile enable a greater degree of validation and utility for the size estimate.
Similar content being viewed by others
References
Abran, A., Gil, B., & Lefebvre, E. (2004). Estimation models based on functional profiles. In International workshop on software measurement—IWSM/MetriKon (pp. 195–211). Kronisburg, Germany: Shaker Verlag.
Albrecht, A. J. (1979, October 14–17). Measuring application development productivity. In Proceedings of the Joint SHARE, GUIDE, and IBM application development symposium (pp. 83–92). Monterey, California: IBM Corporation.
Bock, D. B., & Klepper, R. (1992). FP-S: A simplified function point counting method. Journal of Systems and Software, 18, 245–254.
Boehm, B. (1981). Software engineering economics. Englewood Cliffs, NJ: Prentice-Hall.
Boehm, B., Abts, C., Brown, W., Chulani, S., Clark, B. K., Horowitz, E., et al. (2000). Software cost estimation with Cocomo II. Reading, MA: Addison-Wesley.
Buglione, L., & Gencel, C. (2008). Impact of base functional component types on software functional size based effort estimation. In A. Jedlitschka & O. Salo (Eds.), PROFES 2008, Lecture Notes in Computer Science (LCNS) (Vol. 5089, pp. 75–89). Heidelberg: Springer.
Candido, E. J. D., & Sanches, R. (2004). Estimating the size of web applications by using a simplified function point method. In Webmedia & La-Web 2004, Proceedings (Vol. 1, pp. 98–105).
Desharnais, J. M., & Abran, A. (2003, September 23–25). Approximation techniques for measuring function points. In Proceedings of the 13th international workshop on software measurement (IWSM 2003). Montréal (Canada).
Forselius, L. (2006). Faster and more accurate functional size measurement by KISS—Keeping it simple. Cambridge, MA: IFPUG FSS.
Gencel, C., & Demirors, O. (2008). Functional size measurement revisited. ACM Transactions on Software Engineering and Methodology, 17(3), 1–36.
Horgan, G., Khaddaj, S., & Forte, P. (1998). Construction of an FPA-type metric for early lifecycle estimation. Information and Software Technology, 40(8), 409–415.
ISBSG. (2009). ISBSG estimating, benchmarking and research suite 11. International Software Benchmarking Standards Group (ISBSG). http://www.isbsg.org.
ISO/IEC 14143–1:2007. (2007). Information technology—Software measurement—Functional size measurement—Part 1: Definition of concepts. Geneva: International Organization for Standardization.
ISO/IEC 19761:2011. (2011). Software engineering—COSMIC: A functional size measurement method. Geneva: International Organization for Standardization.
ISO/IEC IS 20926:2009. (2009). Software and systems engineering—Software Measurement: IFPUG Functional Size Measurement Method. Geneva: International Organization for Standardization.
ISO/IEC IS 20968:2002. (2002). Software engineering—MK II function point analysis—Counting practices manual. Geneva: International Organization for Standardization.
ISO/IEC IS 24570:2005. (2005). Software engineering—NESMA functional size measurement method version 2.1: Definitions and counting guidelines for the application of Function Point Analysis. Geneva: International Organization for Standardization.
ISO/IEC IS 29881:2010. (2010). Information technology—Systems and software engineering—FISMA 1.1 functional size measurement method. Geneva: International Organization for Standardization.
Jorgensen, M. (2007). Forecasting of software development work effort: Evidence on expert judgement and formal models. International Journal of Forecasting, 23(3), 449–462.
Jorgensen, M., & Shepperd, M. (2007). A systematic review of software development cost estimation studies. IEEE Transactions on Software Engineering, 33(1), 33–53.
Kemerer, C. F. (1993). Reliability of function points measurement—A field experiment. Communications of the ACM, 36(2), 85–97.
Kitchenham, B., & Kansala, K. (1993). Interitem correlations among function points. In Proceedings: 15th international conference on software engineering (pp. 477–480).
Kitchenham, B., Mendes, E., & Travassos, G. H. (2007). Cross versus within-company cost estimation studies: A systematic review. IEEE Transactions on Software Engineering, 33(5), 316–329.
Lokan, C. J. (1999). Empirical study of the correlations between function point elements. In Proceedings of the 1999 6th international software metrics symposium, November 4, 1999–November 6, 1999 (pp. 200–206). Boca Raton, FL, USA: IEEE.
Lokan, C. J. (2000). An empirical analysis of function point adjustment factors. Information and Software Technology, 42(9), 649–659.
MacDonell, S. G., & Shepperd, M. J. (2007). Comparing local and global software estimation models—Reflections on a systematic review. In Proceedings of the 1st international symposium on empirical software engineering and measurement (pp. 404–409). Madrid, Spain: IEEE Computer Society Press.
Meli, R. (1997). Early and extended function point: A new method for function points estimation. In IFPUG-fall conference, September 15–19. ScottsDale, Arizona, USA.
Meli, R., & Santillo, L. (1999). Function point estimation methods: A comparative overview. In FESMA’99 conference proceedings, Amsterdam, 4–8 October.
Molokken-Ostvold, K., Jorgensen, M., Tanilkan, S. S., Gallis, H., Lien, A. C., & Hove, S. E. (2004). A survey on software estimation in the Norwegian industry. In 10th international symposium on software metrics, Proceedings (pp. 208–219). 14–16 September.
NESMA. (2004). Definitions and counting guidelines for the application of function point analysis. NESMA functional size measurement method compliant to ISO/IEC 24570 version 2.1. Published by the Netherlands Software Metrics Association, November 2004. ISBN: 978-90-76258-19-5.
Popovic, J., & Bojic, D. (2012). A comparative evaluation of effort estimation methods in the software life cycle. Computer Science and Information Systems, 9(1), 455–484.
Santillo, L., Conte, M., & Meli, R. (2005). Early & quick function point: Sizing more with less. In Proceedings of the 11th IEEE international software metrics symposium (p. 41). September 19–22, 2005.
Tichenor, C. (2008). How to develop an ILF model to reduce the time and costs required for function point sizing. IFPUG MetricViews Winter 2008. Available at:http://www.ifpug.org/members/newsletter/2008MetricViews/MV_Winter_2008.pdf. Accessed January 10, 2011.
van Heeringen, H. S., van Gorp, E. W. M., & Prins, T. G. (2009). Functional size measurement—Accuracy versus costs—Is it really worth it? Available at:http://www.slideshare.net/haroldveendam/smef-2009-fsm-accuracy-vs-cost. Accessed December 10, 2012.
Wang, X., Li, J., & Yu, F. (2008). Simplified function point analysis method aiming at small-to-medium-sized software. Jisuanji Gongcheng/Computer Engineering, 34(9), 103–105.
Wilkie, F. G., McChesney, I. R., Morrow, P., Tuxworth, C., & Lester, N. G. (2011). The value of software sizing. Information and Software Technology, 53, 1236–1249.
Wydenbach, G., & Paynter, J. (1995). Software project estimation: A survey of practices in New Zealand. New Zealand Journal of Computing, 6(1B), 317–327.
Yang, D., Wang, Q., Li, M. S., Yang, Y., Ye, K., & Du, J. (2008). A survey on software cost estimation in the Chinese software industry. In Esem’08: Proceedings of the 2008 ACM-IEEE international symposium on empirical software engineering and measurement (pp. 253–262). ACM Press.
Zivkovic, A., Hericko, M., Brumen, B., Beloglavec, S., & Rozman, I. (2005). The impact of details in the class diagram on software size estimation. Informatica, 16(2), 295–312.
Acknowledgments
The research team gratefully acknowledges the access to staff and documentation, and participation of Equiniti-ICS in this project. In particular, the team expresses thanks to Charlie Tuxworth, Technical Director at Equiniti-ICS, for his commitment to this work. The authors gratefully acknowledge the feedback from reviewers, which provided a valuable contribution to the completion and presentation of our research study. The research team also gratefully acknowledges financial support from the Department for Employment and Learning.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
See Table 10.
Rights and permissions
About this article
Cite this article
Morrow, P., Wilkie, F.G. & McChesney, I.R. Function point analysis using NESMA: simplifying the sizing without simplifying the size. Software Qual J 22, 611–660 (2014). https://doi.org/10.1007/s11219-013-9215-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11219-013-9215-1