research-article

Authentic individual assessment for team-based software engineering projects

Authors:

Jean-Guy Schneider,

Dhananjay Thiruvady,

Niroshinie FernandoAuthors Info & Claims

ICSE-SEET '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training

Pages 71 - 81

https://doi.org/10.1145/3377814.3381702

Published: 18 September 2020 Publication History

Abstract

In order to give students an authentic learning experience and better prepare them for the life-long learning required in contemporary workplaces, educational institutions increasingly use project-based learning in teams. However, this poses the challenge of developing authentic and equitable assessment criteria that reflect individual contributions in a team-work setting without jeopardizing project outcomes. We present a novel and innovative portfolio-based assessment framework that focuses on qualitative outcomes and ensures that the level of achievement reflects a student's competency across each of the defined learning dimensions, including professional behaviour, teamwork, process and relevant contributions towards project deliverables. In this paper, we present the main motivation behind devising and introducing the framework and also reflect on the educational outcomes and challenges of implementing the framework in the context of two final year Software Engineering project units.

References

[1]

Cheryl L. Aasheim, Susan Williams, and E. Sonny Butler. 2009. Knowledge and Skill Requirements for it Graduates. Journal of Computer Information Systems 49, 3 (2009), 48--53.

[2]

Jocelyn Armarego. 2009. Constructive Alignment in SE education: aligning to what? In Software Engineering: effective teaching and learning approaches and practices, Heidi Ellis, Steven A. Demurjian, and J. Fernando Naveda (Eds.). IGI Global, Hershey, PA, 15--37.

[3]

María C. Bastarrica, Daniel Perovich, and Maira M. Samary. 2017. What can students get from a software engineering capstone course?. In Proceedings of 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET). ACM/IEEE, 137--145.

[4]

Kent Beck. 1999. Extreme Programming Explained: Embrace Change. Addison-Wesley.

[5]

John Biggs. 1996. Enhancing teaching through constructive alignment. Higher Education 32 (1996), 347--364.

[6]

Wolf-Gideon Bleek, Carola Lilienthal, and Axel Schmolitzky. 2005. Transferring Experience from Software Engineering Training in Industry to Mass University Education - The Big Picture. In Proceedings of the 18th Conference on Software Engineering Education & Training (Ottawa, Canada) (CSEET '05). IEEE, 195--203.

Digital Library

[7]

Benjamin S. Bloom et al. 1956. Taxonomy of educational objectives. Vol. 1: Cognitive domain. New York: McKay (1956), 20--24.

[8]

David Boud and Heather Middleton. 2003. Learning from others at work: communities of practice and informal learning. Journal of workplace learning 15, 5 (2003), 194--202.

[9]

David Boud and Rebeca Soler. 2016. Sustainable assessment revisited. Assessment & Evaluation in Higher Education 41, 3 (2016), 400--413.

[10]

Jill Bradley-Levine, Beth Berghoff, Joy Seybold, Rachel Sever, Susan Blackwell, and Azure Smiley. 2010. What teachers and administrators "need to know" about project-based learning implementation. In Annual Meeting of the American Educational Research Association. Denver, CO.

[11]

Bernd Bruegge, Stephan Krusche, and Lukas Alperowitz. 2015. Software Engineering Project Courses with Industrial Clients. ACM Transactions on Computing Education (TOCE) 15, 4 (Dec. 2015), 17:1--17:31.

Digital Library

[12]

Andrew Cain and Muhammad A. Babar. 2016. Reflections on Applying Constructive Alignment with Formative Feedback for Teaching Introductory Programming and Software Architecture. In 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C). 336--345.

[13]

Andrew Cain, John Grundy, and Clinton J. Woodward. 2018. Focusing on learning through constructive alignment with task-oriented portfolio assessment. European Journal of Engineering Education 43, 4 (2018), 569--584. arXiv:https://doi.org/10.1080/03043797.2017.1299693

[14]

Joanna C. Dunlap. 2005. Problem-based learning and self-efficacy: How a capstone course prepares students for a profession. Educational Technology Research and Development 53, 1 (2005), 65--83.

[15]

T. Germain, Pierre N. Robillard, and Mihaela Dulipovici. 2002. Process Activities in a Project Based Course in Software Engineering. In Proceedings of 32nd Annual Frontiers in Education, Vol. 3. Boston, MA.

[16]

Graham Gibbs and Claire Simpson. 2004. Conditions under which assessment supports students learning. Learning and Teaching in Higher Education 1, 1 (2004), 3--31.

[17]

Andreas Heberle, Rainer Neumann, Ingo Stengel, and Stefanie Regier. 2018. Teaching agile principles and software engineering concepts through real-life projects. In 2018 IEEE Global Engineering Education Conference (EDUCON). 1723--1728.

[18]

Anders Jonsson. 2013. Facilitating productive use of feedback in higher education. Active learning in higher education 14, 1 (2013), 63--76.

[19]

Robert F. Dugan Jr. 2011. A survey of Computer Science Capstone Course Literature. Computer Science Education 21, 3 (Sept. 2011), 201--267.

[20]

Siim Karus. 2019. Experience report on a move to techniques-oriented student project grading. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering Education and Training. IEEE Press, 138--146.

Digital Library

[21]

Robert Kegan. 1994. In over our heads: The mental demands of modern life. Harvard University Press.

[22]

David R Krathwohl. 1984. Taxonomy of educational objectives: Handbook 2: Affective domain. Longman Publishing Group.

[23]

Marco Kuhrmann, Joyce Nakatumba-Nabende, Rolf-Helge Pfeiffer, Paolo Tell, Jil Klünder, Tayana Conte, Stephen G. MacDonell, and Reina Hebig. 2019. Walking through the method zoo: does higher education really meet software industry demands?. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering Education and Training (Montreal, Canada) (ICSE-SEET '19). IEEE Press, 1--11.

Digital Library

[24]

Check-Yee Law, John Grundy, Andrew Cain, Rajesh Vasa, and Alex Cummaudo. 2017. User Perceptions of using an open learner model visualisation tool for facilitating self-regulated learning. In Proceedings of the Nineteenth Australasian Computing Education Conference. ACM, 55--64.

Digital Library

[25]

Justine Lawson, Mohammad G. Rasul, Prue Howard, Fae Martin, Roger Hadgraft, and Rob Jarman. 2015. Getting it right: The case for supervisors assessing process in capstone projects. International Journal of Engineering Education (2015).

[26]

Margaret C. Lohman. 2006. Factors influencing teachers' engagement in informal learning activities. Journal of workplace learning 18, 3 (2006), 141--156.

[27]

Viljan Mahnic. 2010. Teaching Scrum through team-project work: Students' perceptions and teacher's observations. International Journal of Engineering Education 26, 1 (2010), 96.

[28]

Larry J. McKenzie, Michael S. Trevisan, Denny C. Davis, and Steven W. Beyerlein. 2004. Capstone Design Courses and Assessment: A National Study. In Proceedings of the 2004 American Society of Engineering Education Annual Conference & Exposition. 1545--1562.

[29]

David J. Nicol and Debra Macfarlane-Dick. 2006. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in higher education 31, 2 (2006), 199--218.

[30]

Aletta Nylén, Mats Daniels, Arnold Pears, Åsa Cajander, Roger McDermott, and Ville Isomöttönen. 2018. Why are We Here? The Educational Value Model (EVM) as a Framework to Investigate the Role of Students' Professional Identity Development. In 2018 IEEE Frontiers in Education Conference (FIE). IEEE, 1--8.

[31]

Maria Paasivaara, Jari Vanhanen, and Casper Lassenius. 2019. Collaborating with Industrial Customers in a Capstone Project Course: The Customers' Perspective. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering Education and Training (Montreal, Canada) (ICSE-SEET '19). IEEE Press, 12--22.

Digital Library

[32]

Maria Paasivaara, Dragoş Vodă, Ville T Heikkilä, Jari Vanhanen, and Casper Lassenius. 2018. How does participating in a capstone project with industrial customers affect student attitudes?. In Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET '18). ACM, 49--57.

Digital Library

[33]

Michael J. Prince and Richard M. Felder. 2006. Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases. Journal of Engineering Education 95, 2 (2006), 123--138.

[34]

Paul Ramsden. 1992. Learning to Teach in Higher Education. Psychology Press.

[35]

Daniel G. Rees Lewis, Elizabeth M. Gerber, Spencer E. Carlson, and Matthew W. Easterday. 2019. Opportunities for educational innovations in authentic project-based learning: understanding instructor perceived challenges to design for adoption. Educational Technology Research and Development 67, 4 (Aug. 2019), 953--982.

[36]

Debbie Richards. 2009. Designing project-based courses with a focus on group formation and assessment. ACM Transactions on Computing Education 9, 1 (2009), 2-1--2-40.

Digital Library

[37]

Guillermo Rodriguez, lvaro Soria, and Marcelo Campo. 2016. Measuring the Impact of Agile Coaching on Students' Performance. IEEE Transactions on Education 59, 3 (Aug. 2016), 202--209.

[38]

Jean-Guy Schneider, Peter Eklund, Kevin Lee, Feifei Chen, Andrew Cain, and Mohamed Abdelrazek. 2020. Adopting Industry Agile Practices in Large-scale Capstone Education. In Proceedings of IEEE/ACM 42nd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). ACM, Seoul, South Korea. to appear.

Digital Library

[39]

Jean-Guy Schneider and Lorraine Johnston. 2003. eXtreme Programming at Universities - An Educational Perspective. In Proceedings ICSE 2003. IEEE Computer Society Press, Portland, Oregon, 594--599.

[40]

Jean-Guy Schneider and Rajesh Vasa. 2006. Agile Practices in Software Development - Experiences from Student Projects. In Proceedings of the 17th Australian Software Engineering Conference (ASWEC '06), Jun Han and Mark Staples (Eds.). IEEE Computer Society Press, Sydney, Australia, 401--410.

Digital Library

[41]

Ken Schwaber and Mike Beedle. 2002. Agile Software Development with Scrum. Prentice Hall.

[42]

John W. Thomas. 2000. A review of research on project-based learning. (2000).

[43]

Eray Tuzun, Hakan Erdogmus, and Izzet Gokhan Ozbilgin. 2018. Are Computer Science and Engineering Graduates Ready for the Software Industry? Experiences from an Industrial Student Training Program. In Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training (Gothenburg, Sweden) (ICSE-SEET '18). ACM, New York, NY, USA, 68--77.

Digital Library

Cited By

Tubino LCain AMonga MLonati VBarendsen ESheard JPaterson J(2024)Fostering and Assessing Dispositions by providing Grades a Meaning in a Computing Education ContextProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653616(436-442)Online publication date: 3-Jul-2024
https://dl.acm.org/doi/10.1145/3649217.3653616
Tubino LMorgan KWood-Bradley GCain AHaiduc SSchneider J(2023)Shaping a Tool for Developing Computing Students' Professional Identity - Industry PerspectivesProceedings of the 45th International Conference on Software Engineering: Software Engineering Education and Training10.1109/ICSE-SEET58685.2023.00034(302-307)Online publication date: 17-May-2023
https://dl.acm.org/doi/10.1109/ICSE-SEET58685.2023.00034
Modi BCain AWood-Bradley GRenzella J(2023)Using Focus to Personalise Learning and Feedback in Software Engineering Education2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)10.1109/ICSE-SEET58685.2023.00033(296-301)Online publication date: May-2023
https://doi.org/10.1109/ICSE-SEET58685.2023.00033
Show More Cited By

Recommendations

Learning from achievement: scaffolding student projects in software engineering

It has become almost a truism that students learn more from working on projects than from lectures. This is reflected in pedagogical approaches such as Problem-based Learning, Project-based Learning (PBL) and Work-based Learning. A problem in PBL, ...
Individual Differences and Joyful Assessment-Based Learning
ICALT '14: Proceedings of the 2014 IEEE 14th International Conference on Advanced Learning Technologies

E-assessment learning, which combines the advantages of e-assessment and learning, was proposed in educational settings. However, it still makes most of learners feel anxious. Thus, this study develops a Joyful Assessment-based Learning System (JALS), ...
Implement Individual Web-Based Learning Environment
DEXA '08: Proceedings of the 2008 19th International Conference on Database and Expert Systems Application

The need for providing learners with web-based learning content that match their accessibility needs and preferences, as well as providing ways to match learning content to user's devices has been identified as an important issue in accessible ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE-SEET '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training

June 2020

209 pages

ISBN:9781450371247

DOI:10.1145/3377814

General Chairs:
Gregg Rothermel
North Carolina State University
,
Doo-Hwan Bae
KAIST, South Korea

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

KIISE: Korean Institute of Information Scientists and Engineers
IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

ICSE '20

Sponsor:

SIGSOFT

ICSE '20: 42nd International Conference on Software Engineering

June 27 - July 19, 2020

Seoul, South Korea

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
191
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)12

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tubino LCain AMonga MLonati VBarendsen ESheard JPaterson J(2024)Fostering and Assessing Dispositions by providing Grades a Meaning in a Computing Education ContextProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653616(436-442)Online publication date: 3-Jul-2024
https://dl.acm.org/doi/10.1145/3649217.3653616
Tubino LMorgan KWood-Bradley GCain AHaiduc SSchneider J(2023)Shaping a Tool for Developing Computing Students' Professional Identity - Industry PerspectivesProceedings of the 45th International Conference on Software Engineering: Software Engineering Education and Training10.1109/ICSE-SEET58685.2023.00034(302-307)Online publication date: 17-May-2023
https://dl.acm.org/doi/10.1109/ICSE-SEET58685.2023.00034
Modi BCain AWood-Bradley GRenzella J(2023)Using Focus to Personalise Learning and Feedback in Software Engineering Education2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)10.1109/ICSE-SEET58685.2023.00033(296-301)Online publication date: May-2023
https://doi.org/10.1109/ICSE-SEET58685.2023.00033
Arora CTubino LCain ALee KMalhotra V(2023)Persona-based Assessment of Software Engineering Student Research Projects: An Experience Report2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)10.1109/ICSE-SEET58685.2023.00025(198-209)Online publication date: May-2023
https://doi.org/10.1109/ICSE-SEET58685.2023.00025
Setiawan A(2023)Perception of Biomedical Engineering Students' Contribution to Course Projects During Pandemic2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC40787.2023.10341116(1-4)Online publication date: 24-Jul-2023
https://doi.org/10.1109/EMBC40787.2023.10341116
Mercat C(2022)Introduction to Active Learning TechniquesOpen Education Studies10.1515/edu-2022-00104:1(161-172)Online publication date: 2-May-2022
https://doi.org/10.1515/edu-2022-0010
Modi BBecker BQuille KLaakso MBarendsen ESimon (2022)Incorporating Focus to Enhance Staff-student Interactions in Formative FeedbackProceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 210.1145/3502717.3532115(652-653)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3502717.3532115
Licorish SGalster MKapitsaki GTahir A(2022)Understanding students’ software development projectsJournal of Systems and Software10.1016/j.jss.2021.111156186:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.jss.2021.111156
Tubino LSchneider JCain AThiruvady DRanaweera C(2021)Reforming Assessment: Challenges Beyond Design2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)10.1109/ICSE-SEET52601.2021.00017(78-88)Online publication date: May-2021
https://doi.org/10.1109/ICSE-SEET52601.2021.00017
Schneider JEklund PLee KChen FCain AAbdelrazek MRothermel GBae D(2020)Adopting industry agile practices in large-scale capstone educationProceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training10.1145/3377814.3381715(119-129)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377814.3381715

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents