Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3555776.3577748acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Towards a Recommender System-based Process for Managing Risks in Scrum Projects

Published: 07 June 2023 Publication History

Abstract

Agile Software Development (ASD) implicitly manages risks through, for example, its short development cycles (i.e., iterations). The absence of explicit risk management activities in ASD might be problematic since this approach cannot handle all types of risks, might cause risks (e.g., technical debt), and does not promote knowledge reuse throughout an organization. Thus, there is a need to bring discipline to agile risk management. This study focuses on bringing such discipline to organizations that conduct multiple projects to develop software products using ASD, specifically, the Scrum framework, which is the most popular way of adopting ASD. For this purpose, we developed a novel solution that was articulated in partnership with an industry partner. It is a process to complement the Scrum framework to use a recommender system that recommends risks and response plans for a target project, given the risks registered for similar projects in an organization's risk memory (i.e., database). We evaluated the feasibility of the proposed recommender system solution using pre-collected datasets from 17 projects from our industry partner. Since we used the KNN algorithm, we focused on finding the best configuration of k (i.e., the number of neighbors) and the similarity measure. As a result, the configuration with the best results had k = 6 (i.e., six neighbors) and used the Manhattan similarity measure, achieving precision = 45%; recall = 90%; and F1-score = 58%. The results show that the proposed recommender system can assist Scrum Teams in identifying risks and response plans, and it is promising to aid decision-making in Scrum-based projects. Thus, we concluded that our proposed recommender system-based risk management process is promising for helping Scrum Teams address risks more efficiently.

References

[1]
Gediminas Adomavicius, Nikos Manouselis, and YoungOk Kwon. 2011. Multi-criteria recommender systems. In Recommender systems handbook. Springer, 769--803.
[2]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE transactions on knowledge and data engineering 17, 6 (2005), 734--749.
[3]
Eman Talal Alharbi and M Rizwan Jameel Qureshi. 2014. Implementation of risk management with SCRUM to achieve CMMI requirements. International Journal of Computer Network and Information Security 6, 11 (2014), 20.
[4]
Samer Alhawari, Louay Karadsheh, Amine Nehari Talet, and Ebrahim Mansour. 2012. Knowledge-based risk management framework for information technology project. International Journal of Information Management 32, 1 (2012), 50--65.
[5]
Xavier Amatriain, Alejandro Jaimes, Nuria Oliver, and Josep M Pujol. 2011. Data mining methods for recommender systems. In Recommender systems handbook. Springer, 39--71.
[6]
Paris Avgeriou, Philippe Kruchten, Ipek Ozkaya, and Carolyn Seaman. 2016. Managing technical debt in software engineering (dagstuhl seminar 16162). In Dagstuhl reports, Vol. 6. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
[7]
Nitin Bhatia and Namarta Kapoor. 2011. Fuzzy cognitive map based approach for software quality risk analysis. ACM SIGSOFT Software Engineering Notes 36, 6 (2011), 1--9.
[8]
Lionel Briand, Domenico Bianculli, Shiva Nejati, Fabrizio Pastore, and Mehrdad Sabetzadeh. 2017. The case for context-driven software engineering research: generalizability is overrated. IEEE Software 34, 5 (2017), 72--75.
[9]
Syrine Chaouch, Asma Mejri, and Sonia Ayachi Ghannouchi. 2019. A framework for risk management in Scrum development process. Procedia Computer Science 164 (2019), 187--192.
[10]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide & deep learning for recommender systems. In Proceedings of the 1st workshop on deep learning for recommender systems. 7--10.
[11]
Seung-Seok Choi, Sung-Hyuk Cha, and Charles C Tappert. 2010. A survey of binary similarity and distance measures. Journal of systemics, cybernetics and informatics 8, 1 (2010), 43--48.
[12]
Sharon Coyle and Kieran Conboy. 2009. A case study of risk management in agile systems development. (2009).
[13]
Emanuel Dantas, Ademar Sousa Neto, Dalton Valadares, Mirko Perkusich, Felipe Ramos, Hyggo Almeida, and Angelo Perkusich. 2022. Investigating technological risks and mitigation strategies in software projects. In Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing. 1527--1535.
[14]
Janez Demšar. 2006. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine learning research 7 (2006), 1--30.
[15]
Christian Desrosiers and George Karypis. 2011. A comprehensive survey of neighborhood-based recommendation methods. Recommender systems handbook (2011), 107--144.
[16]
Chin-Feng Fan and Yuan-Chang Yu. 2004. BBN-based software project risk management. Journal of Systems and Software 73, 2 (2004), 193--203.
[17]
Norman Fenton and Martin Neil. 2018. Risk assessment and decision analysis with Bayesian networks. Crc Press.
[18]
Alexsandro Filippetto, Robson Lima, and Jorge Barbosa. 2020. Átropos: towards a risk prediction model for software project management. International Journal of Agile Systems and Management 13, 3 (2020), 296--314.
[19]
Salvador García, Alberto Fernández, Julián Luengo, and Francisco Herrera. 2010. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Information sciences 180, 10 (2010), 2044--2064.
[20]
Marko Gasparic and Andrea Janes. 2016. What recommendation systems for software engineering recommend: A systematic literature review. Journal of Systems and Software 113 (2016), 101--113.
[21]
Siti Noor Hasanah Ghazali, Siti Salwah Salim, Irum Inayat, and Siti Hafizah Ab Hamid. 2018. A risk poker based testing model for scrum. Computer Systems Science & Engineering 33, 3 (2018), 169--185.
[22]
Benjamin Gold and Clive Vassell. 2015. Using risk management to balance agile methods: A study of the Scrum process. In 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI). IEEE, 49--54.
[23]
Asela Gunawardana and Guy Shani. 2009. A survey of accuracy evaluation metrics of recommendation tasks. Journal of Machine Learning Research 10, 12 (2009).
[24]
Daya Gupta and Mohd Sadiq. 2008. Software Risk Assessment and Estimation Model. In 2008 International Conference on Computer Science and Information Technology. 963--967.
[25]
Muhammad Hammad and Irum Inayat. 2018. Integrating risk management in scrum framework. In 2018 International Conference on Frontiers of Information Technology (FIT). IEEE, 158--163.
[26]
Muhammad Hammad, Irum Inayat, and Maryam Zahid. 2019. Risk management in agile software development: a survey. In 2019 International Conference on Frontiers of Information Technology (FIT). IEEE, 162--1624.
[27]
Wen-Ming Han. 2015. Discriminating Risky Software Project Using Neural Networks. Comput. Stand. Interfaces 40, C (June 2015), 15--22.
[28]
Rashina Hoda, Norsaremah Salleh, and John Grundy. 2018. The rise and evolution of agile software development. IEEE Software 35, 5 (2018), 58--63.
[29]
Emam Hossain, Muhammad Ali Babar, Hye-young Paik, and June Verner. 2009. Risk identification and mitigation processes for using scrum in global software development: A conceptual framework. In 2009 16th Asia-Pacific Software Engineering Conference. IEEE, 457--464.
[30]
Yong Hu, Xiangzhou Zhang, E.W.T. Ngai, Ruichu Cai, and Mei Liu. 2013. Software project risk analysis using Bayesian networks with causality constraints. Decision Support Systems (2013).
[31]
Giuseppe Jurman, Samantha Riccadonna, Roberto Visintainer, and Cesare Furlanello. 2009. Canberra distance on ranked lists. In Proceedings of advances in ranking NIPS 09 workshop. Citeseer, 22--27.
[32]
Sana Khan. 2009. An approach to facilitate software risk identification. In 2009 2nd International Conference on Computer, Control and Communication. IEEE, 1--5.
[33]
Luanna Lopes Lobato, Thiago Jabur Bittar, Paulo Anselmo da Mota Silveira Neto, Ivan Do Carmo Machado, Eduardo Santana De Almeida, and SILVIO ROMERO DE LEMOS MEIRA. 2013. Risk management in software product line engineering: a mapping study. International Journal of Software Engineering and Knowledge Engineering 23, 04 (2013), 523--558.
[34]
Wang Min, Zhang Jun, and Zhang Wei. 2017. The Application of Fuzzy Comprehensive Evaluation Method in the Software Project Risk Assessment. In Proceedings of the 2017 International Conference on Management Engineering, Software Engineering and Service Sciences (ICMSS '17). Association for Computing Machinery, New York, NY, USA, 76--79.
[35]
Edzreena Edza Odzaly, Des Greer, and Darryl Stewart. 2018. Agile risk management using software agents. Journal of Ambient Intelligence and Humanized Computing 9, 3 (2018), 823--841.
[36]
Dulce G Pereira, Anabela Afonso, and Fátima Melo Medeiros. 2015. Overview of Friedman's test and post-hoc analysis. Communications in Statistics-Simulation and Computation 44, 10 (2015), 2636--2653.
[37]
Mirko Perkusich, Lenardo Chaves e Silva, Alexandre Costa, Felipe Ramos, Renata Saraiva, Arthur Freire, Ednaldo Dilorenzo, Emanuel Dantas, Danilo Santos, Kyller Gorgônio, et al. 2020. Intelligent software engineering in the context of agile software development: A systematic literature review. Information and Software Technology 119 (2020), 106241.
[38]
J. Petronijevic, A. Etienne, A. Siadat, and S. Bassetto. 2019. Operational Framework for Managing Risk Interactions in Product Development Projects. In International Conference on Industrial Engineering and Systems Management (IESM). 1--6.
[39]
Muhammad Akil Rafeek, Adila Firdaus Arbain, and Endah Sudarmilah. 2019. Risk mitigation techniques in agile development processes. Int. J. Supply Chain Manag 8, 2 (2019), 1123--1129.
[40]
Felipe Ramos, Alexandre Costa, Mirko Perkusich, Hyggo Almeida, and Angelo Perkusich. 2018. A Non-Functional Requirements Recommendation System for Scrum-based Projects. In The 30th International Conference on Software Engineering and Knowledge Engineering (2018).
[41]
Nornadiah Mohd Razali, Yap Bee Wah, et al. 2011. Power comparisons of shapiro-wilk, kolmogorov-smirnov, lilliefors and anderson-darling tests. Journal of statistical modeling and analytics 2, 1 (2011), 21--33.
[42]
F Ricii, L Rokach, B Shapira, and PB Kantor. 2011. Recommender System Handbook.
[43]
Kenneth A. Ross. 2009. Cache-Conscious Query Processing. Springer US, Boston, MA, 301--304.
[44]
Robert S Russell and Bernard W Taylor-Iii. 2008. Operations management along the supply chain. John Wiley & Sons.
[45]
Ashish B Sasankar and Vinay Chavan. 2011. SWOT analysis of software development process models. International Journal of Computer Science Issues (IJCSI) 8, 5 (2011), 390.
[46]
Suprika Vasudeva Shrivastava and Urvashi Rathod. 2017. A risk management framework for distributed agile projects. Information and software technology 85 (2017), 1--15.
[47]
Lubna Siddique and Bassam A Hussein. 2014. Practical insight about risk management process in agile software projects in Norway. In 2014 IEEE International Technology Management Conference. IEEE, 1--4.
[48]
Yasunari Takagi, Osamu Mizuno, and Tohru Kikuno. 2005. An empirical approach to characterizing risky software projects based on logistic regression analysis. Empirical Software Engineering 10, 4 (2005), 495--515.
[49]
Madjid Tavana, Amir-Reza Abtahi, Debora Di Caprio, and Maryam Poortarigh. 2018. An Artificial Neural Network and Bayesian Network model for liquidity risk assessment in banking. Neurocomputing 275 (2018), 2525--2554.
[50]
Breno Gontijo Tavares, Carlos Eduardo Sanches da Silva, and Adler Diniz de Souza. 2019. Risk management analysis in Scrum software projects. International Transactions in Operational Research 26, 5 (2019), 1884--1905.
[51]
Juliane Teller, Alexander Kock, and Hans Georg Gemünden. 2014. Risk management in project portfolios is more than managing project risks: A contingency perspective on risk management. Project Management Journal 45, 4 (2014), 67--80.
[52]
Nitin Uikey and Ugrasen Suman. 2015. Risk based scrum method: a conceptual framework. In Proceedings of the 9th INDIACom; INDIACom-2015, IEEE Conference ID, Vol. 35071. 4--120.
[53]
VersionOne. 2022. Acessed in: October, 25th, 2022. 15th Annual State of Agile Survey. https://digital.ai/resource-center/analyst-reports/state-of-agile-report/.
[54]
James H Ware, Frederick Mosteller, Fernando Delgado, Christl Donnelly, and Joseph A Ingelfinger. 2019. P values. In Medical uses of statistics. CRC Press, 181--200.
[55]
Bruce S Weir and William G Hill. 2002. Estimating F-statistics. Annual review of genetics 36, 1 (2002), 721--750.
[56]
Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in software engineering. Springer Science & Business Media.
[57]
Zhiwei Xu, Taghi M Khoshgoftaar, and Edward B Allen. 2003. Application of fuzzy expert systems in assessing operational risk of software. Information and software technology 45, 7 (2003), 373--388.
[58]
Reda Yacouby and Dustin Axman. 2020. Probabilistic extension of precision, recall, and F1 score for more thorough evaluation of classification models. In Proceedings of the first workshop on evaluation and comparison of NLP systems. 79--91.

Cited By

View all
  • (2023)Enhancing Resource Allocation in IT Projects: The Potentials of Deep Learning-Based Recommendation Systems and Data-Driven ApproachesData Science and Machine Learning10.1007/978-981-99-8696-5_16(226-238)Online publication date: 5-Dec-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SAC '23: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing
March 2023
1932 pages
ISBN:9781450395175
DOI:10.1145/3555776
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. project risk management
  2. recommender system
  3. agile
  4. scrum
  5. software engineering

Qualifiers

  • Research-article

Conference

SAC '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)48
  • Downloads (Last 6 weeks)4
Reflects downloads up to 01 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Enhancing Resource Allocation in IT Projects: The Potentials of Deep Learning-Based Recommendation Systems and Data-Driven ApproachesData Science and Machine Learning10.1007/978-981-99-8696-5_16(226-238)Online publication date: 5-Dec-2023

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media