research-article

Teaching Exploratory Tests through PBL and JiTT: an experience report in a context of distributed teams

Authors:

Jarbele Coutinho,

Wilkerson Andrade,

Patricia MachadoAuthors Info & Claims

SBES '21: Proceedings of the XXXV Brazilian Symposium on Software Engineering

Pages 205 - 214

https://doi.org/10.1145/3474624.3476977

Published: 05 October 2021 Publication History

Abstract

There is no specific professional responsible for quality assurance in agile teams, such as the Test Engineer. Thus, the skills, competencies, and attributions inherent to this professional are the responsibility of all team members. Due to Exploratory Testing (ET) benefits in agile development, there is a need to train agile professionals. In this sense, this paper aims to investigate the contributions and limitations of adopting Problem-Based Learning (PBL) and Just-in-Time Teaching (JiTT) in ET teaching-learning. For this, we conducted a course in remote learning format with agile developers, distributed geographically. Data were collected through an online questionnaire and examined with quantitative and qualitative analysis at the end of the course. Our main findings are that (1) the collaboration between the participants and the adoption of a real problem, along with (2) activities and resources made available before the class, and (3) the existence of specific tool support for ET sessions optimized learning in the context of remote learning.

References

[1]

Agile Alliance. 2016. Agile glossary. URL: https://www.agilealliance.org/agile101/agile-glossary/Accessed on August 13, 2020.

[2]

Maurício Aniche, Felienne Hermans, and Arie van Deursen. 2019. Pragmatic Software Testing Education. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE ’19). ACM, New York, NY, USA, 414–420.

Digital Library

[3]

James Bach. 2003. Exploratory testing explained.

[4]

Charles C Bonwell and James A Eison. 1991. Active Learning: Creating Excitement in the Classroom. 1991 ASHE-ERIC Higher Education Reports.ERIC, sl.

[5]

Ana Karina Silva de Castro. 2018. Testes Exploratórios: Características, Problemas e Soluções.B.S. thesis. Universidade Federal do Rio Grande do Norte.

[6]

Jean Felipe P. Cheiran, Elder de M. Rodrigues, Ewerson Luiz de S. Carvalho, and João Pablo S. da Silva. 2017. Problem-Based Learning to Align Theory and Practice in Software Testing Teaching. In Proceedings of the 31st Brazilian Symposium on Software Engineering (Fortaleza, CE, Brazil) (SBES’17). ACM, New York, NY, USA, 328–337.

Digital Library

[7]

I Costa, S Oliveira, L Cardoso, A Ramos, and R Sousa. 2019. Uma Gamificação Para Ensino e Aprendizagem de Teste Exploratório de Software: Aplicação em um Estudo Experimental. XVIII Simpósio Brasileiro de Jogos e Entretenimento Digital (Education Track–Short Papers) 2019, 1 (2019), 1232–1235.

[8]

Emanuel Ferreira Coutinho and Carla Ilane Moreira Bezerra. 2018. Uma avaliação inicial do jogo para o ensino de testes de software iTestLeaening sob a ótica de um software educativo. In Congresso sobre Tecnologias na Educação, Vol. 3. SBC Open Library, Fortaleza,CE, 11–22.

[9]

Lisa Crispin and Janet Gregory. 2009. Agile testing: A practical guide for testers and agile teams. Pearson Education, sl.

[10]

Stevão Alves de Andrade, Vânia de Oliveira Neves, and Márcio Eduardo Delamaro. 2019. Software Testing Education: Dreams and Challenges When Bringing Academia and Industry Closer Together. In Proceedings of the XXXIII Brazilian Symposium on Software Engineering (Salvador, Brazil) (SBES 2019). ACM, New York, NY, USA, 47–56.

Digital Library

[11]

Igor Ernesto Ferreira Costa and Sandro Ronaldo Bezerra Oliveira. 2020. The use of gamification to support the teaching-learning of software exploratory testing: an experience report based on the application of a framework. In 2020 IEEE Frontiers in Education Conference (FIE). IEEE, Uppsala, Sweden, 1–9.

Digital Library

[12]

Caliane de O Figuerêdo, Simone C dos Santos, PH Borba, and GH Alexandre. 2011. Using PBL to develop software test engineers. In International Conference on Computers and Advanced Technology in Education. sn, Cambridge, United Kingdom, 305–322.

[13]

Vahid Garousi, Michael Felderer, Marco Kuhrmann, and Kadir Herkiloğlu. 2017. What Industry Wants from Academia in Software Testing? Hearing Practitioners’ Opinions. In Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering (Karlskrona, Sweden) (EASE’17). ACM, New York, NY, USA, 65–69.

Digital Library

[14]

Vahid Garousi, Austen Rainer, Per Lauvås, and Andrea Arcuri. 2020. Software-testing education: A systematic literature mapping. Journal of Systems and Software 165 (2020), 110570.

[15]

Ahmad Nauman Ghazi. 2017. Structuring Exploratory Testing Through Test Charter Design and Decision Support. Ph.D. Dissertation. Blekinge Tekniska Högskola.

[16]

Elisabeth Hendrickson. 2013. Explore it!: reduce risk and increase confidence with exploratory testing. Pragmatic Bookshelf, sl.

[17]

Felipe Torres Leite, Jarbele C. S. Coutinho, and Reudismam Rolim de Sousa. 2020. An Experience Report About Challenges of Software Engineering as a Second Cycle Course. In Proceedings of the 34th Brazilian Symposium on Software Engineering (Natal, Brazil) (SBES ’20). ACM, New York, NY, USA, 824–833.

Digital Library

[18]

Alexandra Martinez. 2018. Use of JiTT in a graduate software testing course: an experience report. In 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). IEEE, Gothenburg,Sweden, 108–115.

Digital Library

[19]

Jeffrey J McConnell. 1996. Active learning and its use in computer science. In Proceedings of the 1st Conference on integrating Technology into Computer Science Education. ACM, Barcelona,Spain, 52–54.

Digital Library

[20]

Gregor M Novak. 2011. Just-in-time teaching. New directions for teaching and learning 2011, 128 (2011), 63–73.

[21]

Marlla Rúbya F. Paiva, José Reginaldo F. Parente, Israel Rocha Brandão, and Ana Helena B. Queiroz. 2016. Metodologias ativas de ensino-aprendizagem: revisão integrativa. SANARE-Revista de Políticas Públicas 15, 2(2016), 145–153.

[22]

Leo Natan Paschoal and Simone do Rocio Senger de Souza. 2018. A Survey on Software Testing Education in Brazil. In Proceedings of the 17th Brazilian Symposium on Software Quality (Curitiba, Brazil) (SBQS). ACM, New York, NY, USA, 334–343.

Digital Library

[23]

Leo Natan Paschoal, Laíza Silva, and Simone Souza. 2017. Abordagem flipped classroom em comparação com o modelo tradicional de ensino: uma investigação empírica no âmbito de teste de software. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE). SBC Open Library, Recife,PE, 476.

[24]

Leo Natan Paschoal and Simone RS Souza. 2018. Planejamento e aplicação de flipped classroom para o ensino de teste de software. RENOTE 16, 2 (2018), 606–614.

[25]

Rafael Queiroz, Fabrício Pinto, and Paulo Silva. 2019. IslandTest: jogo educativo para apoiar o processo ensino-aprendizagem de testes de software. In Anais do XXVII Workshop sobre Educação em Computação. SBC Open Library, Belém,PA, 533–542.

[26]

Paula Raappana, Soili Saukkoriipi, Ilkka Tervonen, and Mika V Mäntylä. 2016. The Effect of Team Exploratory Testing–Experience Report from F-Secure. In 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW). IEEE, Chicago, IL, USA, 295–304.

[27]

Lilian Passos Scatalon, Jeffrey C. Carver, Rogério Eduardo Garcia, and Ellen Francine Barbosa. 2019. Software Testing in Introductory Programming Courses: A Systematic Mapping Study. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE ’19). ACM, New York, NY, USA, 421–427.

Digital Library

[28]

Beni Suranto. 2015. Exploratory software testing in agile project. In 2015 International Conference on Computer, Communications, and Control Technology (I4CT). IEEE, Kuching, Malaysia, 280–283.

[29]

James A Whittaker. 2009. Exploratory software testing: tips, tricks, tours, and techniques to guide test design. Pearson Education, sl.

[30]

Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in software engineering. Springer Science & Business Media, sl.

Cited By

Gopal BCooper S(2023)Process Oriented Guided Inquiry-based learning-like pedagogy (POGIL-like) in Online Software Testing and DevOps – A Replication Study2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW58534.2023.00080(438-445)Online publication date: Apr-2023
https://doi.org/10.1109/ICSTW58534.2023.00080

Recommendations

Experience report on teaching testing through gamification
EASEAI 2021: Proceedings of the 3rd International Workshop on Education through Advanced Software Engineering and Artificial Intelligence

Software systems become increasingly complex and testing is a vital component of the development process. Teaching software testing concepts are now more than ever acknowledged as essential.

The aim of this paper is to report on our software testing ...
Use of JiTT in a graduate software testing course: an experience report
ICSE-SEET '18: Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training

This paper describes our experience using Just-in-Time Teaching (JiTT) in a graduate Software Testing course during two semesters. JiTT is a pedagogical strategy that bridges in-class and out-of-class components through preparatory web-based assignments,...
Just-in-time teaching for CS0

Just-in-Time Teaching (JiTT) is a teaching and learning strategy based on the interaction between web-based study assignments and an active learner classroom. The essence of JiTT is the feedback loop formed by the students' preparation outside the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

SBES '21: Proceedings of the XXXV Brazilian Symposium on Software Engineering

September 2021

473 pages

ISBN:9781450390613

DOI:10.1145/3474624

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SBES '21

SBES '21: Brazilian Symposium on Software Engineering

September 27 - October 1, 2021

Joinville, Brazil

Acceptance Rates

Overall Acceptance Rate 147 of 427 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
83
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gopal BCooper S(2023)Process Oriented Guided Inquiry-based learning-like pedagogy (POGIL-like) in Online Software Testing and DevOps – A Replication Study2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW58534.2023.00080(438-445)Online publication date: Apr-2023
https://doi.org/10.1109/ICSTW58534.2023.00080

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten