Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3396452.3396461acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbdeConference Proceedingsconference-collections
research-article

An Easy-to-read Visual Approach to Deal with Peer Reviews and Self-assessments in Virtual Learning Environments

Published: 22 May 2020 Publication History

Abstract

In teaching-learning process, the grade computation is an important part of the critical-thinking process. When faced to assessments of many students, teachers are confronted to a mass of smart data. Lately, the strategies of peer evaluations, in which the students express a critic on different understanding of the taught contents, have been substantially developed in the literature. This paper presents an easy-to-read visual approach integrated with a learning platform to analyze correlations and distances between the grades given by a teacher and the grades produced by students through self-assessments and peer reviews. We observed that the both aforementioned metrics can rank differently the students; hence we propose to aggregate them by producing a single rank. Thus, our framework supports the lecturer either by selecting possible candidates for future class monitors or by focusing on students who need to be more involved in the teaching-learning process. Finally, for the highest ranks, our framework offers a regression model to predict the teachers' grades values only based on the students feedbacks.

References

[1]
James Alves, Wesley Silva, Jessica Oliveira Brito, and Elias Oliveira. 2018. Avaliação em Pares e Autoavaliação: Um Modelo Estatístico Para Perfilação de Alunos. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE), Vol. 29. Comissão Especial de Informática na Educação (CEIE) da Sociedade Brasileira de Computação, Porto Alegre, Brazil, 1653.
[2]
David Boud. 2013. Enhancing learning through self-assessment. Routledge, Abingdon-on-Thames, United Kingdom.
[3]
Lori Breslow, David E Pritchard, Jennifer DeBoer, Glenda S Stump, Andrew D Ho, and Daniel T Seaton. 2013. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment 8 (2013), 13--25.
[4]
Wilton Oliveira Bussab and Pedro Alberto Morettin. 2013. Basic statistics (8 ed.). Saraiva, São Paulo.
[5]
David Carless, Diane Salter, Min Yang, and Joy Lam. 2011. Developing sustainable feedback practices. Studies in higher education 36, 4 (2011), 395--407.
[6]
Bernard Chalk and Kemi Adeboye. 2005. Peer assessment of program code: a comparison of two feedback instruments. In 6th Annual Conference of the Higher Education Academy Subject Centre for Information and Computer Sciences. Higher Education Academy, Heslington, UK, 106--110.
[7]
Orville L Chapman and Michael A Fiore. 2000. Calibrated Peer Review™. Journal of Interactive Instruction Development 12, 3 (2000), 11--15.
[8]
Kwangsu Cho and Christian D. Schunn. 2007. Scaffolded Writing and Rewriting in the Discipline: A Web-Based Reciprocal Peer Review System. Computer Education 48, 3 (April 2007), 409--426. https://doi.org/10.1016/j.compedu.2005.02.004
[9]
Phil Davies. 2000. Computerized Peer Assessment. Innovations in Education and Training International 37, 4 (2000), 346--355. https://doi.org/10.1080/135580000750052955 arXiv:https://doi.org/10.1080/135580000750052955
[10]
Paul Denny, Andrew Luxton-Reilly, and Beth Simon. 2009. Quality of Student Contributed Questions Using PeerWise. In Proceedings of the Eleventh Australasian Conference on Computing Education, Wellington, New Zealand (ACE'09), Vol. 95. Australian Computer Society, Inc., Sydney, Australia, 55--63.
[11]
Nancy Falchikov and Judy Goldfinch. 2000. Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks. Review of Educational Research 70, 3 (2000), 287--322. https://doi.org/10.3102/00346543070003287 arXiv:https://doi.org/10.3102/00346543070003287
[12]
Andrew Luxton-Reilly. 2009. A systematic review of tools that support peer assessment. Computer Science Education 19, 4 (2009), 209--232. https://doi.org/10.1080/08993400903384844
[13]
James H McMillan and Jessica Hearn. 2008. Student self-assessment: The key to stronger student motivation and higher achievement. Educational Horizons 87, 1 (2008), 40--49.
[14]
Anne HH Ngu, John Shepherd, and Doug Magin. 1995. Engineering the'Peers' system: the development of a computer-assisted approach to peer assessment. Research and Development in Higher Education 18 (1995), 582--587.
[15]
David Nicol, Avril Thomson, and Caroline Breslin. 2014. Rethinking feedback practices in higher education: a peer review perspective. Assessment & Evaluation in Higher Education 39, 1 (2014), 102--122.
[16]
Elias Oliveira, Lucas Andrade, Márcia Oliveira, Marcos Spalenza, and Matheus de Araujo Nogueira. 2017. A Framework for Peer Assessment in Programming Classes. In XXII Conferência Internacional sobre Informática na Educação - TISE, Jaime Sánchez (Ed.), Vol. 13. http://tise.cl/, Fortaleza, Brazil, 298--304.
[17]
Elias Oliveira and Marcos A. Spalenza. 2017. Self and Peer Assessment Strategies. In Anais do Computer on the Beach. https://computeronthebeach.com.br/, Florianópolis, Brazil, 396--405. https://siaiap32.univali.br/seer/index.php/acotb/article/view/10625
[18]
Dwayne E. Paré and Steve Joordens. 2008. Peering into large lectures: examining peer and expert mark agreement using peerScholar, an online peer assessment tool. J. Comp. Assisted Learning 24, 6 (2008), 526--540. https://doi.org/10.1111/j.1365-2729.2008.00290.x
[19]
Philippe Perrenoud. 1998. L'évaluation des élèves. De la fabrication de l'excellence à la régulation des apprentissage. De Boeck, Bruxelles.
[20]
Roger Schank and Henrietta Saunders. 2001. Virtual learning: A revolutionary approach to building a highly skilled workforce. Performance Improvement 40, 5 (2001), 39--41. https://doi.org/10.1002/pfi.4140400511 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/pfi.4140400511
[21]
Yumeno Shiba and Toshiharu Sugawara. 2014. Fair assessment of group work by mutual evaluation based on trust network. In IEEE Frontiers in Education Conference, FIE 2014, Proceedings, Madrid, Spain, October 22-25, 2014. IEEE Computer Society, Washington, DC, USA, 1--7. https://doi.org/10.1109/FIE.2014.7044121
[22]
Jirarat Sitthiworachart and Mike Joy. 2004. Effective Peer Assessment for Learning Computer Programming. In Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, Leeds, United Kingdom (ITiCSE '04). Association for Computing Machinery, New York, NY, USA, 122--126. https://doi.org/10.1145/1007996.1008030
[23]
Jirarat Sitthiworachart and Mike Joy. 2008. Computer support of effective peer assessment in an undergraduate programming class. J. Comp. Assisted Learning 24, 3 (2008), 217--231. https://doi.org/10.1111/j.1365-2729.2007.00255.x
[24]
Marcos A. Spalenza, Matheus A. Nogueira, Lucas B. de Andrade, and Elias Oliveira. 2018. Uma Ferramenta para Mineração de Dados Educacionais: Extração de Informação em Ambientes Virtuais de Aprendizagem. In Anais do Computer on the Beach. https://computeronthebeach.com.br/, Florianópolis, Brazil, 741--750.
[25]
Dorothy Spiller. 2012. Assessment Matters: Self-Assessment and Peer Assessment. The University of Waikato, Hamilton, New Zealand.
[26]
Lorraine AJ Stefani. 1994. Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education 19, 1 (1994), 69--75.
[27]
Daniel Stricker, David Weibel, and Bartholomäus Wissmath. 2011. Efficient learning using a virtual learning environment in a university class. Computers & Education 56, 2 (2011), 495--504. https://doi.org/10.1016/j.compedu.2010.09.012
[28]
Michel Tousignant and Jacques Etienne Des Marchais. 2002. Accuracy of Student Self-Assessment Ability Compared to Their Own Performance in a Problem- Based Learning Medical Program: A Correlation Study. Advances in Health Sciences Education 7, 1 (2002), 19--27. https://doi.org/10.1023/A:1014516206120
[29]
Sheng-Chau Tseng and Chin-Chung Tsai. 2007. On-line peer assessment and the role of the peer feedback: A study of high school computer course. Computers & Education 49, 4 (2007), 1161--1174. https://doi.org/10.1016/j.compedu.2006.01.007
[30]
W. Villegas-Ch, Sergio Luján-Mora, Diego Buenaño-Fernandez, and X. Palacios- Pacheco. 2018. Big Data, the Next Step in the Evolution of Educational Data Analysis. In Proceedings of the International Conference on Information Technology & Systems (ICITS 2018), Álvaro Rocha and Teresa Guarda (Eds.). Springer International Publishing, Cham, 138--147.
[31]
Wang, Yanqing et al. "Toward Motivating Participants to Assess Peers' Work More Fairly." Journal of Educational Computing Research 52.2 (2015): 180--198. Crossref. Web.

Cited By

View all
  • (2021)An Architecture for Massive Essays Evaluations2021 16th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI52073.2021.9476467(1-6)Online publication date: 23-Jun-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICBDE '20: Proceedings of the 2020 3rd International Conference on Big Data and Education
April 2020
85 pages
ISBN:9781450374989
DOI:10.1145/3396452
© 2020 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

In-Cooperation

  • University of Sunderland, UK: University of Sunderland, UK
  • City University of Hong Kong: City University of Hong Kong

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 May 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. education
  2. evaluation
  3. machine learning
  4. peer review
  5. self-assessment
  6. statistics
  7. teaching-learning process
  8. visual tool

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICBDE '20

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)An Architecture for Massive Essays Evaluations2021 16th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI52073.2021.9476467(1-6)Online publication date: 23-Jun-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media