Cited By
View all- Cammaerts FSnoeck M(2024)Towards Leveraging Gamified Code-Testing for Effective Model ValidationAdvances in Conceptual Modeling10.1007/978-3-031-75599-6_18(233-248)Online publication date: 29-Oct-2024
Exploring students' opinion on software testing courses
Authors: 
Felix Cammaerts, Porfirio Tramontana, Ana C. R. Paiva, Nuno Flores, Fernando Pastor Ricós, 
Monique SnoeckAuthors Info & Claims
Pages 570 - 579
Abstract
Software testing is an important part of the software development lifecycle. As it is a highly sought-after skill in the industry, it is not surprising that there has been a great deal of research into the teaching of software testing in higher education. Most of this research proposes or evaluates pedagogical approaches or software testing tools to assist teachers in educating the next generation of software engineers. These evaluations are often limited to measuring teachers’ opinions about the use of a novel pedagogical approach or an educational tool and students’ acceptance and performance in terms of desired software testing skills. While tools and pedagogical approaches address specific aspects of a course, to date, little attention has been paid to the opinions of the students about all the individual aspects of a software testing course. This paper aims to address this missing student perspective by taking a holistic view of software testing course designs. To address this gap, an exploratory study was performed by distributing a questionnaire to 103 students from ten different courses to gauge their opinions on a software testing course they are enrolled in. The results show that students generally have a positive perception of the different aspects of their software testing course. However, several areas for improvement were suggested based on the gathered data.
References
[1]
[n. d.]. ENACTEST D4.1: Analysis of current practices and status of course design and resources used for software testing education. http://tinyurl.com/enactest. Accessed: 2024-01-19.
[2]
Hakam W Alomari, Vijayalakshmi Ramasamy, James D Kiper, and Geoff Potvin. 2020. A User Interface (UI) and User eXperience (UX) evaluation framework for cyberlearning environments in computer science and software engineering education. Heliyon 6, 5 (2020).
[3]
John Biggs. 1999. Teaching for Quality Learning at University. Buckingham: Open University Press.
[4]
Robert Maribe Branch and Theodore J. Kopcha. 2014. Instructional Design Models. Springer New York, New York, NY, 77–87. https://doi.org/10.1007/978-1-4614-3185-5_7
[5]
Kevin Buffardi and Stephen H Edwards. 2014. A formative study of influences on student testing behaviors. In 45th ACM technical symposium on Computer science education. 597–602.
[6]
Felix Cammaerts and Monique Snoeck. 2023. ModelDefenders: A novel gamified mutation testing game for model-driven engineering. (2023).
[7]
Felix Cammaerts and Monique Snoeck. 2024. Assessing the testing skills transfer of model-based testing on testing skill acquisition. Software and Systems Modeling (2024), 1–19.
[8]
Felix Cammaerts, Monique Snoeck, and Ana C. R. Paiva. 2023. Collecting cognitive strategies applied by students during test case design(EASE ’23). Association for Computing Machinery, New York, NY, USA, 455–459. https://doi.org/10.1145/3593434.3593954
[9]
Felix Cammaerts, Charlotte Verbruggen, and Monique Snoeck. 2022. Investigating the effectiveness of model-based testing on testing skill acquisition. In IFIP Working Conference on The Practice of Enterprise Modeling. Springer, 3–17.
[10]
Jeffrey C Carver and Nicholas A Kraft. 2011. Evaluating the testing ability of senior-level computer science students. In 24th Conference on Software Engineering Education and Training (CSEE&T). IEEE, 169–178.
[11]
FT Chan, TH Tse, WH Tang, and TY Chen. 2005. Software testing education and training in Hong Kong. In 5th International Conference on Quality Software (QSIC). IEEE, 313–316.
[12]
Peter J Clarke, Debra Davis, Tariq M King, Jairo Pava, and Edward L Jones. 2014. Integrating testing into software engineering courses supported by a collaborative learning environment. ACM Transactions on Computing Education (TOCE) 14, 3 (2014), 1–33.
[13]
Peter J Clarke, Jairo Pava, Debra Davis, Frank Hernandez, and Tariq M King. 2012. Using WReSTT in SE courses: An empirical study. In 43rd ACM technical symposium on Computer Science Education. 307–312.
[14]
Tony Cowling. 2012. Stages in teaching software testing. In 34th International Conference on Software Engineering (ICSE). IEEE, 1185–1194.
[15]
Niels Doorn, Tanja E. J. Vos, Beatriz Marín, Christoph Bockisch, Steffen Dick, and Erik Barendsen. 2023. Domain TILEs: Test Informed Learning with Examples from the Testing Domain. In International Conference on Research Challenges in Information Science (RCIS). Springer, 501–508.
[16]
Niels Doorn, Tanja E. J. Vos, and Beatriz Marín. 2023. Towards understanding students’ sensemaking of test case design. Data & Knowledge Engineering 146 (2023), 102199.
[17]
Stephen H. Edwards and Manuel A. Perez-Quinones. 2008. Web-CAT: Automatically Grading Programming Assignments. In 13th Annual Conference on Innovation and Technology in Computer Science Education (Madrid, Spain) (ITiCSE ’08). ACM, 328.
[18]
Gordon Fraser, Alessio Gambi, Marvin Kreis, and José Miguel Rojas. 2019. Gamifying a software testing course with code defenders. In 50th ACM Technical Symposium on Computer Science Education. 571–577.
[19]
Frank Reyes Garcia, Beatriz Marín, and Sofía Alarcón Bañados. 2019. Visualization of MBT testing coverage. In 13th International Conference on Research Challenges in Information Science (RCIS). IEEE, 1–2.
[20]
Vahid Garousi, Austen Rainer, Per Lauvås Jr, and Andrea Arcuri. 2020. Software-testing education: A systematic literature mapping. Journal of Systems and Software 165 (2020), 110570.
[21]
K Gustafson. 2002. What Is Instructional Design? Trends and Issues in Instructional Design and Technology.Merril/Prentice Hall.
[22]
Paul A. Kirschner Jeroen J. G. van Merrienboer and Liesbeth Kester. 2003. Taking the Load Off a Learner’s Mind: Instructional Design for Complex Learning. Educational Psychologist 38, 1 (2003), 5–13. https://doi.org/10.1207/S15326985EP3801_2
[23]
Matheus Marabesi and Ismar Frango Silveira. 2019. Towards a gamified tool to improve unit test teaching. In XIV Latin American Conference on Learning Technologies (LACLO). IEEE, 12–19.
[24]
M Marabesi and I Frango Silveira. 2020. Evaluation of Testable, a gamified tool to improve unit test teaching. In International Technology, Education and Development Conference (INTED). IATED, 330–338.
[25]
Beatriz Marín. 2023. Gamification to Ignite Learning in Modern Times (Keynote). In 2nd International Workshop on Gamification in Software Development, Verification, and Validation (GAMIFY). 1–1.
[26]
Beatriz Marín, Sofía Alarcón, Giovanni Giachetti, and Monique Snoeck. 2020. Tescav: An approach for learning model-based testing and coverage in practice. In 14th International Conference on Research Challenges in Information Science(RCIS). Springer, 302–317.
[27]
Beatriz Marín, Tanja E. J. Vos, Ana CR Paiva, Anna Rita Fasolino, and Monique Snoeck. 2022. ENACTEST-European Innovation Alliance for Testing Education. In RCIS Workshops.
[28]
Antonio Materazzo, Tommaso Fulcini, Riccardo Coppola, and Marco Torchiano. 2023. Survival of the Tested: Gamified Unit Testing Inspired by Battle Royale. In 7th International Workshop on Games and Software Engineering (GAS). IEEE, 1–7.
[29]
Ana CR Paiva, Nuno H Flores, André G Barbosa, and Tânia PB Ribeiro. 2016. iLearnTest–framework for educational games. Procedia-Social and Behavioral Sciences 228 (2016), 443–448.
[30]
Lilian Passos Scatalon, Jeffrey C Carver, Rogério Eduardo Garcia, and Ellen Francine Barbosa. 2019. Software testing in introductory programming courses: A systematic mapping study. In 50th ACM Technical Symposium on Computer Science Education. 421–427.
[31]
Lilian Passos Scatalon, Rogério Eduardo Garcia, and Ellen Francine Barbosa. 2020. On the Use of Support Mechanisms to Perform Experimental Variables Selection. In SEKE. 192–197.
[32]
Elsje Scott, Alexander Zadirov, Sean Feinberg, and Ruwanga Jayakody. 2004. The alignment of software testing skills of IS students with industry practices–a South African perspective. Journal of Information Technology Education: Research 3, 1 (2004), 161–172.
[33]
Anuj Ramesh Shah. 2003. Web-cat: A web-based center for automated testing. Ph. D. Dissertation. Virginia Tech.
[34]
Swapneel Sheth, Jonathan Bell, and Gail Kaiser. 2015. A gameful approach to teaching software design and software testing. Computer Games and Software Engineering 9 (2015), 91.
[35]
Sulayman K Sowe, Ioannis Stamelos, and Ignatios Deligiannis. 2006. A framework for teaching software testing using F/OSS methodology. In IFIP International Conference on Open Source Systems (OSS). Springer, 261–266.
[36]
Jaime Spacco, David Hovemeyer, William Pugh, Fawzi Emad, Jeffrey K Hollingsworth, and Nelson Padua-Perez. 2006. Experiences with marmoset: designing and using an advanced submission and testing system for programming courses. ACM Sigcse Bulletin 38, 3 (2006), 13–17.
[37]
Porfirio Tramontana, Beatriz Marín, Ana C. R. Paiva, Alexandra Mendes, Tanja E. J. Vos, Domenico Amalfitano, Felix Cammaerts, Monique Snoeck, and Anna Rita Fasolino. 2024. State of the Practice in Software Testing Teaching in Four European Countries. In To appear in 17th IEEE ICST.
[38]
Zulfa Zakaria. 2009. A State Of Practice On Teaching Software Verification And Validation. In 2009 Annual Conference & Exposition. 14–112.
Index Terms
- Exploring students' opinion on software testing courses
Recommendations
What Are Massive Open Online Courses (MOOCs) Teaching About Software Testing?
AST '24: Proceedings of the 5th ACM/IEEE International Conference on Automation of Software Test (AST 2024)Software testing is a necessary aspect of software development. With high expectations placed on software testers and a shortage of qualified professionals, Massive Open Online Courses (MOOCs) have emerged as a potential solution to improve software ...
Survey of Learning Environments for Software Testing Education
ECBS 2021: 7th Conference on the Engineering of Computer Based SystemsSoftware development is one of the fastest growing industries today. The defects in software can be very costly, either in terms of losing money, reputation, or even lives in case of some critical applications. Consequently, there is a high and always ...
Integrating Testing into Software Engineering Courses Supported by a Collaborative Learning Environment
As software becomes more ubiquitous and complex, the cost of software bugs continues to grow at a staggering rate. To remedy this situation, there needs to be major improvement in the knowledge and application of software validation techniques. Although ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
728 pages
ISBN:9798400717017
DOI:10.1145/3661167
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
EASE 2024
EASE 2024: 28th International Conference on Evaluation and Assessment in Software Engineering
June 18 - 21, 2024
Salerno, Italy
Acceptance Rates
Overall Acceptance Rate 71 of 232 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 46Total Downloads
- Downloads (Last 12 months)46
- Downloads (Last 6 weeks)10
Reflects downloads up to 20 Nov 2024
Other Metrics
Citations
Cited By
View all- Cammaerts FSnoeck M(2024)Towards Leveraging Gamified Code-Testing for Effective Model ValidationAdvances in Conceptual Modeling10.1007/978-3-031-75599-6_18(233-248)Online publication date: 29-Oct-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format