article

Learning dashboards: an overview and future research opportunities

Authors:

Katrien Verbert,

Jose Luis Santos,

Joris KlerkxAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 18, Issue 6

Pages 1499 - 1514

https://doi.org/10.1007/s00779-013-0751-2

Published: 01 August 2014 Publication History

Abstract

In this paper, we present work on learning analytics that aims to support learners and teachers through dashboard applications, ranging from small mobile applications to learnscapes on large public displays. Dashboards typically capture and visualize traces of learning activities, in order to promote awareness, reflection, and sense-making, and to enable learners to define goals and track progress toward these goals. Based on an analysis of our own work and a broad range of similar learning dashboards, we identify HCI issues for this exciting research area.

References

[1]

Chatti MA, Agustiawan MR, Jarke M, Specht M (2012) Toward a personal learning environment framework. In: Design, implementation, and evaluation of virtual learning environments. IGI Global, 2012, pp 20---40. Web 14 Dec 2012.

[2]

Duval E, Wiley D (2010) Guest editorial: open educational resources. IEEE Trans Learn Technol 3(2):83---84

[3]

Purpura S, Schwanda V, Williams K, Stubler W, Sengers P (2011) Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI `11), ACM, New York, NY, pp 423---432

[4]

Duval E (2011) Attention please! Learning analytics for visualization and recommendation. In: Proceedings of LAK11, ACM, New York, pp 9---17

[5]

Pechenizkiy M et al (eds) (2011) Proceedings of EDM11: 4th international conference on educational data mining, 2011

[6]

Santos JL, Govaerts S, Verbert K, Duval E (2012) Goal-oriented visualizations of activity tracking: a case study with engineering students. In: Shum SB, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge (LAK `12). ACM, New York, NY, pp 143---152

[7]

Verbert K, Duval E, Klerkx J, Govaerts S, Santos JL (2013) Learning analytics dashboard applications. Am Behav Sci 57(10):1500---1509

[8]

Yu Y-C, You S-CD, Tsai D-R (2012) Social interaction feedback system for the smart classroom. In: Proceedings of the 2012 IEEE international conference on consumer electronics (ICCE), IEEE, pp 500---501

[9]

Pohl A, Bry F, Schwarz J, Gottstein M (2012) Sensing the classroom: improving awareness and self-awareness of students with backstage. In: Proceedings of the international conference on interactive and collaborative learning (ICL), Villach, Austria, 26---28 September 2012

[10]

Barr J, Gunawardena A (2012) Classroom salon: a tool for social collaboration. In: Proceedings of the 43rd ACM technical symposium on computer science education (SIGCSE `12), ACM, New York, NY, pp 197---202

[11]

Fagen W, Kamin S (2012) Developing device-independent applications for active and collaborative learning with the SLICE framework. In: Amiel T, Wilson B (eds) Proceedings of world conference on educational multimedia, hypermedia and telecommunications 2012, AACE, Chesapeake, VA, pp 1565---1572

[12]

Cuendet S, Bonnard Q, Kaplan F, Dillenbourg P (2011) Paper interface design for classroom orchestration. In: CHI `11 extended abstracts on human factors in computing systems (CHI EA `11), ACM, New York, NY, pp 1993---1998

[13]

Son LH (2012) Supporting reflection and classroom orchestration with tangible tabletops. PhD Thesis http://biblion.epfl.ch/EPFL/theses/2012/5313/5313_abs.pdf

[14]

Martinez Maldonado R, Kay J, Yacef K, Schwendimann B (2012) An interactive teacher's dashboard for monitoring groups in a multi-tabletop learning environment. In: Cerri et al (eds) Proceedings of the 11th international conference on intelligent tutoring. Springer, Berlin, pp 482---492

[15]

Gutiérrez Rojas I, Crespo García RM, Delgado Kloos C (2011) Orchestration and feedback in lab sessions: improvements in quick feedback provision. In: Delgado Kloos C et al (eds) ECTEL 2011 towards ubiquitous learning 6th European conference of technology enhanced learning 2023 September 2011, Palermo Italy Proceedings LNCS 6964, vol 6964. Springer, Berlin, pp 424---429

[16]

Gutiérrez Rojas I, Crespo García RM (2012) Towards efficient provision of feedback supported by learning analytics. In: Proceedings of the 12th international conference on advanced learning technologies (ICALT), IEEE, pp 599---603

[17]

Morris MR, Piper AM, Cassanego T, Winograd T (2005) Supporting cooperative language learning: issues in interface design for an interactive table. Stanford University Technical Report, 2005

[18]

Arnold KE, Pistilli MD (2012) Course signals at Purdue: using learning analytics to increase student success. In: Shum SB, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge (LAK `12), ACM, NY, pp 267---270

[19]

Dollár A, Steif PS (2012) Web-based statics course with learning dashboard for instructors. In: Uskov V (ed) Proceedings of computers and advanced technology in education (CATE 2012), June 25---27, 2012, Napoli, Italy

[20]

Govaerts S, Verbert K, Duval E, Pardo A (2012) The student activity meter for awareness and self-reflection. In: The ACM SIGCHI conference on human factors in computing systems, Austin, TX, USA, 5---10 May 2012, CHI EA `12: proceedings of the 2012 ACM annual conference extended abstracts on human factors in computing systems extended abstracts, ACM, pp 869---884

[21]

Ali L, Hatala M, Gašević D, Jovanović J (2012) A qualitative evaluation of evolution of a learning analytics tool. Comput Educ 58(1):470---489

[22]

Podgorelec V, Kuhar S (2011) Taking advantage of education data: advanced data analysis and reporting in virtual learning environments. Electron Electr Eng 114(8):111---116

[23]

Leony D, Pardo A, de la Fuente Valentín L, Sánchez de Castro D, Delgado Kloos C (2012) GLASS: a learning analytics visualization tool. In Buckingham Shum S, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge LAK `12, ACM, New York, NY, pp 162---163

[24]

Scheuer O, Zinn C (2007) How did the e-learning session go? The student inspector. In: Luckin R et al. (eds) Proceedings of the 2007 conference on artificial intelligence in education: building technology rich learning contexts that work. IOS Press, Amsterdam, pp 487---494

[25]

Lafford BA (2004) Review of tell me more Spanish. J Lang Learn Technol 8(3):21---34

[26]

Kerly A, Ellis R, Bull S (2007) CALMsystem: a conversational agent for learner modelling. In: Ellis R et al. (eds) Applications and innovations in intelligent systems XV--proceedings of AI-2007, 27th SGAI international conference on innovative techniques and applications of artificial intelligence. Springer, pp 89---102

[27]

Chen GD, Chang CK, Wang CY (2008) Ubiquitous learning website: scaffold learners by mobile devices with information-aware techniques. Comput Educ 50(1):77---90

[28]

Kobsa E, Dimitrova V, Boyle R (2005) Using student and group models to support teachers in web-based distance education. In: Proceedings of the 10th international conference on user modeling. Edinburgh, UK, pp 124---133

[29]

Santos Odriozola J, Verbert K, Duval E (2012) Empowering students to reflect on their activity with StepUp!: two case studies with engineering students. In: Proceedings of ARTELL'12 2nd workshop on awareness and reflection, CEUR workshop proceedings, pp 73---86

[30]

Nakahara J, Hisamatsu S, Yaegashi K, Yamauchi Y (2005) iTree: does the mobile phone encourage learners to be more involved in collaborative learning? In: Proceedings of the 2005 conference on computer support for collaborative learning: learning 2005: the next 10 years! (CSCL `05). International Society of the Learning Sciences, pp 470---478

[31]

Dawson S, Bakharia A, Heathcote E (2010) SNAPP: realising the affordances of real- time SNA within networked learning environments. In: Dirckinck-Holmfeld L et al (eds), Proceedings of the 7th international conference on networked learning. University of Lancaster, Lancaster, pp 125---133

[32]

Silius K, Miilumaki T, Huhtamaki J, Tebest T, Merilainen J, Pohjolainen S (2010) Students' Motivations for social media enhanced studying and learning. Knowl Manage E-Learn Int J (KM&EL) 2(1):51---67

[33]

France L, Heraud J-M, Marty J-C, Carron T, Heili J (2006) Monitoring virtual classroom: visualization techniques to observe student activities in an e-learning system. In: Proceedings of the sixth international conference on advanced learning technologies, IEEE, pp 716---720

[34]

Govaerts S, Verbert K, Dahrendorf D, Ullrich C, Schmidt M, Werkle M, Chatterjee A, Nussbaumer A, Renzel D, Scheffel M, Friedrich M, Santos Odriozola J, Duval E, Law E (2011) Towards responsive open learning environments: the ROLE interoperability framework. In: Proceedings of 6th European conference of technology enhanced learning, EC-TEL 2011, LNCS vol 6964. Springer, pp 125---138

[35]

Santos JL, Verbert K, Govaerts S, Duval E (2013) Addressing learner issues with StepUp!: an evaluation. In Suthers D, Verbert K, Duval E, Ochoa X (eds) Proceedings of the 2013 ACM international conference on learning analytics and knowledge (LAK'13), ACM, 10 p

[36]

Verbert K, Manouselis N, Ochoa X, Wolpers M, Drachsler H, Bosnic I, Duval E (2012) Context-aware recommender systems for learning: a survey and future challenges. IEEE Trans Learn Technol 5(4):318---335

[37]

Verpoorten D, Westera W, Specht M (2011) Reflection amplifiers in online courses: a classification framework. J Interact Learn Res 22(2):167---190

[38]

Leony D, Crespo RM, Perez-Sanagustin M, Parada GHA, de la Fuente Valentin L, Pardo A (2012). Coverage metrics for learning-event datasets based on client-side monitoring. In: Proceedings of the IEEE 12th international conference on advanced learning technologies (ICALT), 2012, IEEE, pp 652---653

[39]

Dillenbourg P, Zufferey G, Alavi H, Jermann P, Do-lenh S, Bonnard Q, Cuendet S et al. (2011) Classroom orchestration: the third circle of usability. In: CSCL2011 proceedings vol I. International Society of the Learning Sciences, Hong Kong, pp 510---517

[40]

Bakker J, Holenderski L, Kocielnik R, Pechenizkiy M, Sidorova N (2012) Stess@Work: from measuring stress to its understanding, prediction and handling with personalized coaching. In: Proceedings of the 2nd ACM SIGHIT international health informatics symposium (IHI `12), ACM, New York, NY, pp 673---678

[41]

Shum SB, Gasevic D, Ferguson R (eds) (2012) LAK12: proceedings of 2nd international conference on learning analytics and knowledge, ACM

[42]

Suthers D, Verbert K, Duval E, Ochoa X (eds) (2013) LAK13: proceedings of 3rd international conference on learning analytics and knowledge, ACM

[43]

Schaaff K, Müller L, Kirst M, Heuer S (2012) xAffect--a modular framework for online affect recognition and biofeedback applications. In: Proceedings of the 3rd international workshop on motivational and affective aspects of technology enhanced learning, September 2012

[44]

Leony D, Pardo A, Parada Gélvez H, Delgado Kloos C (2012) A widget to recommend learning resources based on the learner affective state. In: Proceedings of the 3rd international workshop on motivational and affective aspects of technology enhanced learning, September 2012

[45]

Harris S (2010) The place of virtual, pedagogic and physical space in the 21st century classroom

[46]

Bizer C (2009) The emerging web of linked data. IEEE Intell Syst 24(5):87---92

[47]

Siemens G, Gasevic D, Haythornthwaite C, Dawson S, Buckingham Shum S, Ferguson R, Duval E, Verbert K, Baker RSJD (2011) Open learning analytics: an integrated & modularized platform proposal to design, implement and evaluate an open platform to integrate heterogeneous learning analytics techniques. Retrieved online from http://solaresearch.org/OpenLearningAnalytics.pdf

[48]

Baillie C (2000) Motivation and attrition in engineering students. Geraldine Fitzgerald Eur J Eng Educ 25(2):145---155

[49]

Killen R (1994) Differences between students' and lecturers' perceptions of factors influencing students' academic success at university. High Educ Res Dev 13:199

[50]

Zhou X, Jin Q (2011) Dynamical user networking and proling based on activity streams for enhanced social learning. Advances in web-based learning-ICWL, Springer, pp 219---225

[51]

Goligoski E (2012) Motivating the learner: mozillas open badges program. Access Knowl Course J 4(1):8

[52]

Domínguez A, Saenz-de-Navarrete J, de-Marcos L, Fernández-Sanz L, Pagés C, Martínez-Herráiz J-J (2013) Gamifying learning experiences: practical implications and outcomes, Comput Educ 63:380---392

[53]

Santos JL, Charleer S, Parra G, Klerkx J, Duval E, Verbert K (2013) Motivating students in an open learning environment through open badges. In: Proceedings of the eighth European conference on technology enhanced learning (ECTEL 2013), 14 p (to appear)

[54]

Jarvis J (2011) Public parts: how sharing in the digital age improves the way we work and live. Simon & Schuster, New York

[55]

Purpura S, Schwanda V, Williams K, Stubler W, Sengers P (2011) Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight. In: Proceedings of the 2011 annual conference on human factors in computing systems, ACM, pp 423---432

[56]

Verbert K, Manouselis N, Drachsler H, Duval E (2012) Dataset-driven research to support learning and knowledge analytics. Educ Technol Soc 15(3):133---148

Cited By

Joseph-Richard PUhomoibhi J(2024)Which Data Sets Are Preferred by University Students in Learning Analytics Dashboards? A Situated Learning Theory PerspectiveINFORMS Transactions on Education10.1287/ited.2023.028924:3(220-237)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1287/ited.2023.0289
Sloan-Lynch JMorse R(2024)Equity-Forward Learning Analytics: Designing a Dashboard to Support Marginalized Student SuccessProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636844(1-11)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636844
Lee-Cultura SSharma KGiannakos M(2024)Multimodal Teacher Dashboards: Challenges and Opportunities of Enhancing Teacher Insights Through a Case StudyIEEE Transactions on Learning Technologies10.1109/TLT.2023.327684817(181-201)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TLT.2023.3276848
Show More Cited By

Index Terms

Learning dashboards: an overview and future research opportunities
1. Applied computing
  1. Education
  2. Enterprise computing

Recommendations

Understanding learning at a glance: an overview of learning dashboard studies
LAK '16: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge

Research on learning dashboards aims to identify what data is meaningful to different stakeholders in education, and how data can be presented to support sense-making processes. This paper summarizes the main outcomes of a systematic literature review ...
How do students interpret feedback delivered via dashboards?
LAK '15: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge

Providing feedback directly to students on their engagement and performance in educational activities is important to supporting students' learning. However, questions have been raised whether such data representations are adequate to inform reflection, ...
Experimental Design of Learning Analysis Dashboards for Teachers and Learners
L@S '21: Proceedings of the Eighth ACM Conference on Learning @ Scale

Since learning in higher education is increasingly taking place online, the multiplication of web-based educational content, learning management systems (LMSs) and collaborative communication platforms have generated a large volume of data on learners ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 18, Issue 6

August 2014

243 pages

ISSN:1617-4909

Issue’s Table of Contents

Copyright © Copyright © 2014 Springer-Verlag London.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 August 2014

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

75
Total Citations
View Citations
980
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Joseph-Richard PUhomoibhi J(2024)Which Data Sets Are Preferred by University Students in Learning Analytics Dashboards? A Situated Learning Theory PerspectiveINFORMS Transactions on Education10.1287/ited.2023.028924:3(220-237)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1287/ited.2023.0289
Sloan-Lynch JMorse R(2024)Equity-Forward Learning Analytics: Designing a Dashboard to Support Marginalized Student SuccessProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636844(1-11)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636844
Lee-Cultura SSharma KGiannakos M(2024)Multimodal Teacher Dashboards: Challenges and Opportunities of Enhancing Teacher Insights Through a Case StudyIEEE Transactions on Learning Technologies10.1109/TLT.2023.327684817(181-201)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TLT.2023.3276848
Mejeh MSarbach LHascher T(2024)Effects of adaptive feedback through a digital tool – a mixed-methods study on the course of self-regulated learningEducation and Information Technologies10.1007/s10639-024-12510-829:14(1-43)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s10639-024-12510-8
Lee SLi NKim J(2024)Conceptual model for Mexican teachers' adoption of learning analytics systems: The integration of the information system success model and the technology acceptance modelEducation and Information Technologies10.1007/s10639-023-12371-729:11(13387-13412)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s10639-023-12371-7
Kaur AChahal K(2024)A learning analytics dashboard for data-driven recommendations on influences of non-cognitive factors in introductory programmingEducation and Information Technologies10.1007/s10639-023-12125-529:8(9221-9256)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s10639-023-12125-5
Kim J(2024)Leading teachers' perspective on teacher-AI collaboration in educationEducation and Information Technologies10.1007/s10639-023-12109-529:7(8693-8724)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1007/s10639-023-12109-5
Shahmoradi SKothiyal ABruno BDillenbourg P(2024)Evaluation of teachers’ orchestration tools usage in robotic classroomsEducation and Information Technologies10.1007/s10639-023-11909-z29:3(3219-3256)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-023-11909-z
Kragten MHoogma TBredeweg B(2024)Integration of a Teacher Dashboard in a Hybrid Support Approach for Constructing Qualitative RepresentationsTechnology Enhanced Learning for Inclusive and Equitable Quality Education10.1007/978-3-031-72315-5_15(208-221)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-72315-5_15
Salazar Morales ABaran E(2024)Using Self-determination Theory to Design User Interfaces for Instructor DashboardsLearning and Collaboration Technologies10.1007/978-3-031-61672-3_6(77-90)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-61672-3_6
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents