Nothing Special   »   [go: up one dir, main page]

Skip to main content

Advertisement

Log in

A handheld classroom dashboard: Teachers’ perspectives on the use of real-time collaborative learning analytics

  • Published:
International Journal of Computer-Supported Collaborative Learning Aims and scope Submit manuscript

A Correction to this article was published on 01 September 2019

This article has been updated

Abstract

In Computer-Supported Collaborative Learning (CSCL) classrooms it may be challenging for teachers to keep awareness of certain aspects of the learning process of each small group or assess whether the enactment of the class script deviates from the original plan. Orchestration tools, aimed at supporting the management of the increasing uncertainty and complexity of CSCL classrooms, have been emerging in response. Similarly, learning analytics innovations hold the promise of empowering teachers by making certain aspects of the classroom visible and by providing information that can prompt actionable responses. However, the active role that data may play in teachers’ decision-making and orchestration processes is still not well understood. This paper investigates the perspectives of teachers who used a real-time analytics tool to support the orchestration of a CSCL classroom. A longitudinal study was conducted with a handheld dashboard deployed in a multi-display collaborative classroom during one full academic term. The dashboard showed real-time information about group participation and task progress; the current state of the CSCL script; and a set of text notifications informing teachers of potential students’ misconceptions automatically detected. The study involved four teachers conducting 72 classroom sessions during 10 weeks with a total of 150 students. The teachers’ perspectives discussed in this paper portray the promises and challenges of introducing new technologies aimed at enhancing orchestration and awareness in a CSCL classroom.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Change history

  • 04 December 2019

    The original version of this article unfortunately contained duplicate images for Figs. 4 and 6. The correct images are hereby published.

References

  • Alavi, H., Dillenbourg, P, & Kaplan, F. (2009). Distributed awareness for class orchestration. In Proceedings of European Conference on Technology Enhanced Learning, (pp. 211–225). Springer.

  • Bannon, L. J. (1995). Issues in computer supported collaborative learning. Paper presented at the Computer supported collaborative learning, (pp. 267–281). Springer.

  • Beetham, H., & Sharpe, R. (2013). Rethinking pedagogy for a digital age: designing and delivering e-learning. London: Routledge Falmer.

    Google Scholar 

  • Bienkowski, M., Feng, M., & Means, B. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. Washington, DC: US Department of Education, Office of Educational Technology.

  • Bishop, J. L., & Verleger, M. A. (2013). The flipped classroom: A survey of the research. In Proceedings of ASEE National Conference, (pp. 1–18).

  • Bodily, R., & Verbert, K. (2017). Trends and issues in student-facing learning analytics reporting systems research. In Proceedings of International Conference on Learning Analytics and Knowledge, LAK'17, (pp. 309–318). ACM.

  • Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of the Learning Sciences, 2(2), 141–178.

    Article  Google Scholar 

  • Bruce, B. C., & Rubin, A. (1993). Electronic quills: A situated evaluation of using computers for writing in classrooms. Hillsdale: Lawrence Erlbaum Associates.

    Google Scholar 

  • Buckingham Shum, S., & Crick, R. D. (2016). Learning Analytics for 21st Century Competencies. Journal of Learning Analytics, 3(2), 6–21.

    Article  Google Scholar 

  • Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999). Readings in information visualization: using vision to think. Burlington, USA: Morgan Kaufmann.

  • Chandrasegaran, Senthil, Chris Bryan, Hidekazu Shidara, Tung-Yen Chuang, and Kwan-Liu Ma. (2019). TalkTraces: Real-Time Capture and Visualization of Verbal Content in Meetings. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems, CHI'19, (pp. 577:571--577:514). ACM.

  • Cheema, S., VanLehn, K., Burkhardt, H., Pead, D., & Schoenfeld, A. (2016). Electronic posters to support formative assessment. In Proceedings of 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, (pp. 1159–1164). ACM.

  • Chen, F.-H., Looi, C.-K., & Chen, W. (2009). Integrating technology in the classroom: a visual conceptualization of teachers' knowledge, goals and beliefs. Journal of Computer Assisted Learning, 25(5), 470–488.

    Article  Google Scholar 

  • Chen, W., Looi, C.-K., & Tan, S. (2010). What do students do in a F2F CSCL classroom? The optimization of multiple communications modes. Computers & Education, 55(3), 1159–1170.

    Article  Google Scholar 

  • Clayphan, A., Martinez-Maldonado, R., Tomitsch, M., Atkinson, S., & Kay, J. (2016). An In-the-Wild Study of Learning to Brainstorm: Comparing Cards, Tabletops and Wall Displays in the Classroom. Interacting with Computers.

  • Dillenbourg, P. (2013). Design for classroom orchestration. Computers & Education, 69, 485–492.

    Article  Google Scholar 

  • Dillenbourg, P. (2015). Orchestration graphs. Lausanne, Switzerland: EPFL Press.

  • Dillenbourg, P., & Evans, M. (2011). Interactive tabletops in education. International Journal of Computer-Supported Collaborative Learning, 6(4), 491–514.

    Article  Google Scholar 

  • Dillenbourg, P., & Hong, F. (2008). The mechanics of CSCL macro scripts. International Journal of Computer-Supported Collaborative Learning, 3(1), 5–23.

    Article  Google Scholar 

  • Dillenbourg, P., Järvelä, S., & Fischer, F. (2009). The evolution of research on computer-supported collaborative learning. In N. Balacheff, S. Ludvigsen, T. de Jong, A. Lazonder, & S. Barnes (Eds.), Technology-enhanced learning: principles and products (pp. 3–19). Dordrecht: Springer.

    Chapter  Google Scholar 

  • Dillenbourg, P., Prieto, L. P., & Olsen, J. K. (2018). Classroom Orchestration. In F. Fischer, C. E. Hmelo-Silver, S. R. Goldman, & P. Reimann (Eds.), International Handbook of the Learning Sciences (pp. 180–190). London, UK: Routledge.

    Chapter  Google Scholar 

  • Dillenbourg, P., Zufferey, G., Alavi, H., Jermann, P., Do-Lenh, S., Bonnard, Q., Cuendet, S., & Kaplan, F. (2011). Classroom orchestration: The third circle of usability. In Proceedings of International Conference on Computer Supported Collaborative Learning, CSCL'11, (pp. 510–517). Springer.

  • Dillenbourg, P., & Jermann, P. (2010). Technology for classroom orchestration. In M. S. Khine & I. M. Saleh (Eds.), New science of learning (pp. 525–552). New York: Springer.

    Chapter  Google Scholar 

  • Dimitriadis, Y. A. (2012). Supporting Teachers in Orchestrating CSCL Classrooms. In A. Jimoyiannis (Ed.), Research on e-Learning and ICT in Education (pp. 71–82). New York: Springer.

    Chapter  Google Scholar 

  • Do-Lenh, Son. (2012). Supporting Reflection and Classroom Orchestration with Tangible Tabletops. Doctoral dissertation. École Polytechnique Fédérale de Lausanne, Switzerland: CRAFT group, School of Computer Science.

  • Echeverria, V., Martinez-Maldonado, R., & Shum, S. B.. (2019). Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems, CHI'19, (pp. 39, 31–16). ACM.

  • Echeverria, V., Martinez-Maldonado, R., Shum, S. B., Chiluiza, K., Granda, R., & Conati, C. (2018). Exploratory versus Explanatory Visual Learning Analytics: Driving Teachers’ Attention through Educational Data Storytelling. Journal of Learning Analytics, 5(3), 72–97.

    Article  Google Scholar 

  • Erickson, T., & Kellogg, W. A. (2000). Social translucence: an approach to designing systems that support social processes. ACM Transactions on Computer-Human Interaction, 7(1), 59–83.

    Article  Google Scholar 

  • Fischer, F., Kollar, I., Mandl, H., & Haake, J. M. (2007). Scripting computer-supported collaborative learning: Cognitive, computational and educational perspectives (Vol. 6). New York: Springer.

    Book  Google Scholar 

  • Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society, 15(3), 42–57.

    Google Scholar 

  • Gutiérrez Rojas, I., Crespo García, R. M., & Kloos, C. D. (2012). Enhancing Orchestration of Lab Sessions by Means of Awareness Mechanisms. In A. Ravenscroft, S. Lindstaedt, C. Kloos, & D. Hernández-Leo (Eds.), 21st Century Learning for 21st Century Skills (pp. 113–125). Berlin Heidelberg: Springer.

    Chapter  Google Scholar 

  • Gweon, Gahgene, Carolyn P. Rosé, Emil Albright, and Yue Cui. (2007). Evaluating the effect of feedback from a CSCL problem solving environment on learning, interaction, and perceived interdependence. In Proceedings of 8th iternational conference on Computer-Supported Collaborative Learning, (pp. 234–243). ISLS.

  • Hämäläinen, R., & Arvaja, M. (2009). Scripted collaboration and group-based variations in a Higher Education CSCL context. Scandinavian Journal of Educational Research, 53(1), 1–16.

    Article  Google Scholar 

  • Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81–112.

    Article  Google Scholar 

  • Hernández-Leo, D., Martinez-Maldonado, R., Pardo, A., Muñoz-Cristóbal, J. A., & Rodríguez-Triana, M. J. (2019). Analytics for learning design: A layered framework and tools. British Journal of Educational Technology, 50(1), 139–152.

    Article  Google Scholar 

  • Higgins, S., Mercier, E., Burd, E., & Hatch, A. (2011). Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review. International Journal of Computer-Supported Collaborative Learning, 6(4), 515–538.

    Article  Google Scholar 

  • Holstein, Kenneth, Bruce M. McLaren, and Aleven, V. (2018). The Classrooom as a Dashboard: Co-designing Wearable Cognitive Augmentation for K-12 Teachers. In Proceedings of International Learning Analytics and Knowledge Conference, LAK'18, (pp. 79–88). ACM.

  • Kaendler, C., Wiedmann, M., Rummel, N., & Spada, H. (2015). Teacher Competencies for the Implementation of Collaborative Learning in the Classroom: a Framework and Research Review. Educational Psychology Review, 27(3), 505–536.

    Article  Google Scholar 

  • Kamin, S., Capitanu, B., Twidale, M., & Peiper, C. (2009). A teacher’s dashboard for a high school algebra class. In R. H. Reed, D. A. Berque, & J. C. Prey (Eds.), The impact of tablet PCs and pen-based technology on education: Evidence and outcomes (pp. 63–72). West Lafayette: Purdue University Press.

    Google Scholar 

  • Kirschner, P. A. (2002). Can we support CSCL? Educational, social and technological affordances for learning.

  • Knaflic, C. N. (2015). Storytelling with data: A data visualization guide for business professionals. Hoboken: John Wiley & Sons.

    Book  Google Scholar 

  • Kreitmayer, Stefan, Yvonne Rogers, Robin Laney, and Stephen Peake. (2013). UniPad: orchestrating collaborative activities through shared tablets and an integrated wall display. In Proceedings of 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UBICOMP 2013), (pp. 801–810). ACM.

  • Liu, A. L., & Nesbit, J. C. (2019). Dashboards for Computer-Supported Collaborative Learning. In M. Virvou, E. Alepis, G. A. Tsihrintzis, & L. C. Jain (Eds.), Machine Learning Paradigms: Advances in Learning Analytics (pp. 157–182). Cham: Springer International Publishing.

    Google Scholar 

  • Liu, A. L., & Nesbit, J. C. (2020). Dashboards for Computer-Supported Collaborative Learning. In M. Virvou, E. Alepis, G. A. Tsihrintzis, & L. C. Jain (Eds.), Machine Learning Paradigms: Advances in Learning Analytics (pp. 157–182). Cham: Springer International Publishing.

    Chapter  Google Scholar 

  • Loibl, K., & Rummel, N. (2014). The impact of guidance during problem-solving prior to instruction on students’ inventions and learning outcomes. Instructional Science, 42(3), 305–326.

    Article  Google Scholar 

  • Looi, C.-K., & Song, Y. (2013). Orchestration in a networked classroom: Where the teacher's real-time enactment matters. Computers & Education, 69, 510–513.

    Article  Google Scholar 

  • Ludvigsen, S., Cress, U., Law, N., Rosé, C. P., & Stahl, G. (2016). Collaboration scripts and scaffolding. International Journal of Computer-Supported Collaborative Learning, 11(4), 381–385.

    Article  Google Scholar 

  • Mangaroska, K., & Giannakos, M. N. (2018). Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning. IEEE Transactions on Learning Technologies, (in press), 1–19.

  • Martinez-Maldonado, R., Clayphan, A., & Kay, J. (2015a). Deploying and Visualising Teacher’s Scripts of Small Group Activities in a Multi-Surface Classroom Ecology: a study in-the-wild. Computer Supported Cooperative Work, 24(2), 177–221.

    Article  Google Scholar 

  • Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2015b). MTFeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200.

    Article  Google Scholar 

  • Martinez-Maldonado, Roberto, Yannis Dimitriadis, Judy Kay, Kalina Yacef, and Marie-Theresa Edbauer. (2013). MTClassroom and MTDashboard: supporting analysis of teacher attention in an orchestrated multi-tabletop classroom. In Proceedings of International Conference on Computer Supported Collaborative Learning (CSCL2013), (pp. 119–128). ISLS.

  • Martinez-Maldonado, Roberto, Judy Kay, and Kalina Yacef. (2011a). Visualisations for longitudinal participation, contribution and progress of a collaborative task at the tabletop. In Proceedings of International Conference on Computer Supported Learning, CSCL'11, (pp. 25–32). ISLS.

  • Martinez-Maldonado, R., Schneider, B., Charleer, S., Shum, S. B., Klerkx, J., & Duval, E. (2016). Interactive Surfaces and Learning Analytics: Data, Orchestration Aspects, Pedagogical Uses and Challenges. In Proceedings of Sixth International Conference on Learning Analytics and Knowledge (pp. 124–133 ). ACM.

  • Martinez-Maldonado, Roberto, Kalina Yacef, Judy Kay, Ahmed Kharrufa, and Ammar Al-Qaraghuli. (2011b). Analysing frequent sequential patterns of collaborative learning activity around an interactive tabletop. In Proceedings of International Conference on Educational Data Mining 2011 (EDM 2011), (pp. 111–120).

  • Martinez-Maldonado, R, Yacef, K., Kay, J., & Schwendimann, B. (2012). An interactive teacher’s dashboard for monitoring multiple groups in a multi-tabletop learning environment. In Proceedings of International Conference on Intelligent Tutoring Systems 2012 (ITS 2012), (pp. 482–492). Springer.

  • Mercier, E. (2016). Teacher orchestration and student learning during mathematics activities in a smart classroom. International Journal of Smart Technology and Learning, 1(1), 33–52.

    Article  Google Scholar 

  • Molenaar, I., & Carolien Knoop-van Campen. (2017). Teacher dashboards in practice: Usage and impact. In Proceedings of European Conference on Technology Enhanced Learning, (pp. 125–138). Springer.

  • Munoz-Cristobal, J. A., Jorrin-Abellan, I. M., Asensio-Perez, J. I., Martinez-Mones, A., Prieto, L. P., & Dimitriadis, Y. (2015). Supporting teacher orchestration in ubiquitous learning environments: a study in primary education. IEEE Transactions on Learning Technologies, 8(1), 83–97.

    Article  Google Scholar 

  • Muñoz-Cristóbal, J. A., Prieto, L. P., Asensio-Pérez, J. I., Martínez-Monés, A., Jorrín-Abellán, I. M., & Dimitriadis, Y. (2014). Deploying learning designs across physical and web spaces: Making pervasive learning affordable for teachers. Pervasive and Mobile Computing, 14, 31–46.

    Article  Google Scholar 

  • Ni, A. Y. (2013). Comparing the effectiveness of classroom and online learning: Teaching research methods. Journal of Public Affairs Education, 19(2), 199–215.

    Article  Google Scholar 

  • Nicolopoulou, A., & Cole, M. (1996). Generation and transmission of shared knowledge in the culture of collaborative learning: The Fifth Dimension, its play-world and its institutional contexts. In E. Forman, N. Minnick, & C. A. Stone (Eds.), Contexts for learning: Sociocultural dynamics in children's development (pp. 283–314). New York: Oxford University.

    Google Scholar 

  • Noel, R., Riquelme, F., Lean, R. M., Merino, E., Cechinel, C., Barcelos, T. S., Villarroel, R., & Munoz, R. (2018). Exploring Collaborative Writing of User Stories With Multimodal Learning Analytics: A Case Study on a Software Engineering Course. IEEE Access, 6, 67783–67798.

    Article  Google Scholar 

  • Noguera, I., Guerrero-Roldán, A.-E., & Masó, R. (2018). Collaborative agile learning in online environments: Strategies for improving team regulation and project management. Computers in Education, 116, 110–129.

    Article  Google Scholar 

  • O’Donnell, A. M., & Hmelo-Silver, C. E. (2013). Introduction: What is collaborative learning? An overview. In C. E. Hmelo-Silver, C. A. Chinn, C. Chan, & A. M. O'Donnell (Eds.), The International Handbook of Collaborative Learning (pp. 1–15). New York: Routledge.

    Google Scholar 

  • Olsen, J. (2017). Orchestrating Combined Collaborative and Individual Learning in the Classroom. Doctoral dissertation. Carnegie Mellon University, Pittsburgh, Pennsylvania: Human-Computer Interaction Institute.

  • Peiper, C. E. (2008). A teacher's dashboard: Monitoring students in Tablet PC classroom settings. Doctoral dissertation. University of Illinois Urbana-Champaign.

  • Phiri, L., Meinel, C., & Suleman, H. (2016). Streamlined orchestration: An orchestration workbench framework for effective teaching. Computers & Education, 95, 231–238.

    Article  Google Scholar 

  • Prieto, L. P., Dimitriadis, Y., Asensio-Pérez, J. I., & Looi, C.-K. (2015a). Orchestration in learning technology research: evaluation of a conceptual framework. Research in Learning Technology, 23, 1–15.

    Article  Google Scholar 

  • Prieto, L. P, Dimitriadis, Y, Harrer, A, Milrad, M., Nussbaum, M, & Slotta, J. D. (2015b). The orchestrated collaborative classroom: Designing and making sense of heterogeneous ecologies of teaching and learning resources. In Proceedings of International Conference on Computer Supported Collaborative Learning (pp. 880–884). International Society of the Learning Sciences.

  • Prieto, L. P., Triana, M. J. R., Maldonado, R. M., Dimitriadis, Y. A., & Gašević, D. (2018). Orchestrating learning analytics (OrLA): Supporting inter-stakeholder communication about adoption of learning analytics at the classroom level. Australasian Journal of Educational Technology, 35(4), 14–33.

    Google Scholar 

  • Prieto, L. P., Sharma, K., Kidzinski, L., & Dillenbourg, P. (2017). Orchestration Load Indicators and Patterns: In-the-wild Studies Using Mobile Eye-tracking. IEEE Transactions on Learning Technologies, 11(2), 1–1.

    Google Scholar 

  • Prieto, L. P., Sharma, K., & Dillenbourg, P. (2015c). Studying Teacher Orchestration Load in Technology-Enhanced Classrooms. In G. Conole, T. Klobučar, C. Rensing, J. Konert, & É. Lavoué (Eds.), Design for Teaching and Learning in a Networked World (pp. 268–281). International Publishing: Springer.

    Chapter  Google Scholar 

  • Prinsen, F., Volman, M. L. L., & Terwel, J. (2007). The influence of learner characteristics on degree and type of participation in a CSCL environment. British Journal of Educational Technology, 38(6), 1037–1055.

    Article  Google Scholar 

  • Rodríguez-Triana, M. J., Prieto, L. P., Martínez-Monés, A., Asensio-Pérez, J. I., & Dimitriadis, Y. (2018). Monitoring Collaborative Learning Activities: Exploring the Differential Value of Collaborative Flow Patterns for Learning Analytics. In Proceedings of 2018 IEEE 18th International Conference on Advanced Learning Technologies, ICALT'18, (pp. 155–159). IEEE.

  • Rodríguez Triana, Jesús, M., Monés, A. M., Asensio Pérez, J. I., & Dimitriadis, Y. (2014). Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situations. British Journal of Educational Technology, 46(2), 330–343.

  • Scheffel, M., Drachsler, H., Stoyanov, S., & Specht, M. (2014). Quality indicators for learning analytics. Journal of Educational Technology & Society, 17(4), 117.

    Google Scholar 

  • Schell, J., Lukoff, B., & Mazur, E. (2013). Catalyzing learner engagement using cutting-edge classroom response systems in higher education. Cutting-edge Technologies in Higher Education, E(6), 233–261.

    Article  Google Scholar 

  • Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41.

    Article  Google Scholar 

  • Sirbu, Maria-Dorinela, Mihai Dascalu, Scott A Crossley, Danielle S McNamara, and Stefan Trausan-Matu. (2019). Longitudinal Analysis and Visualization of Participation in Online Courses Powered by Cohesion Network Analysis. In Proceedings of International Conference on Computer-Supported Collaborative Learning, (pp. 640–643).

  • Slade, S., & Prinsloo, P. (2013). Learning Analytics: Ethical Issues and Dilemmas. American Behavioral Scientist, 57(10), 1510–1529.

    Article  Google Scholar 

  • Soller, A., Martinez, A., Jermann, P., & Muehlenbrock, M. (2005). From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning. International Journal of Artificial Intelligence in Education, 15(4), 261–290.

    Google Scholar 

  • Sottilare, R. A., Shawn Burke, C., Salas, E., Sinatra, A. M., Johnston, J. H., & Gilbert, S. B. (2018). Designing adaptive instruction for teams: A meta-analysis. International Journal of Artificial Intelligence in Education, 28(2), 225–264.

    Article  Google Scholar 

  • Spence, R. (2001). Information visualization (Vol. 1). New York: Addison-Wesley.

    Google Scholar 

  • Stahl, G., Koschmann, T., & Suthers, D. (2006). Computer-supported collaborative learning: An historical perspective. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences (pp. 409–426). Oxford, UK: Cambridge University Press.

    Google Scholar 

  • Stahl, Gerry. (2002). Rediscovering cscl. Paper presented at the CSCL, (pp. 169-181).

  • Stahl, G. (2015). A decade of CSCL. International Journal of Computer-Supported Collaborative Learning, 10(4), 337–344.

    Article  Google Scholar 

  • Stahl, G. (2017). Global introduction to CSCL. Philadelphia: Lulu.

    Google Scholar 

  • Stodel, E. J., Thompson, T. L., & MacDonald, C. J. (2006). Learners' perspectives on what is missing from online learning: Interpretations through the community of inquiry framework. The International Review of Research in Open and Distributed Learning, 7(3).

  • Tchounikine, P. (2013). Clarifying design for orchestration: orchestration and orchestrable technology, scripting and conducting. Computers & Education, 69, 500–503.

    Article  Google Scholar 

  • Tchounikine, P. (2019). Learners’ agency and CSCL technologies: towards an emancipatory perspective. International Journal of Computer-Supported Collaborative Learning, 14(2), 237–250.

    Article  Google Scholar 

  • Teasley, S. D. (2017). Student Facing Dashboards: One Size Fits All? Technology. Knowledge and Learning, 22(3), 377–384.

    Article  Google Scholar 

  • Tissenbaum, Mike, Camillia Matuk, Matthew Berland, Felipe Cocco, Marcia Linn, CREATE Nik Hajny, CREATE Al Olsen, Beat Schwendimann, Mina Shirvani Boroujeni, and Jonathan Vitale. (2016). Real-time visualization of student activities to support classroom orchestration. In Proceedings of 12th International Conference of the Learning Sciences, (pp. 1120–1127). ISLSs.

  • Treisman, A. (1985). Preattentive processing in vision. Computer vision, graphics, and image processing, 31(2), 156–177.

    Article  Google Scholar 

  • van Leeuwen, A. (2015). Learning analytics to support teachers during synchronous CSCL: Balancing between overview and overload. Journal of learning Analytics, 2(2), 138–162.

    Article  Google Scholar 

  • Van Leeuwen, Anouschka, J. J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL. Computers in Education, 79, 28–39.

  • van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of multiple computer-supported collaborating groups. Computers in Human Behavior, 52, 233–242.

    Article  Google Scholar 

  • van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, (in press), 1–29.

  • VanLehn, Kurt, Salman Cheema, Jon Wetzel, and Daniel Pead. (2016). Some less obvious features of classroom orchestration systems Educational Technologies: Challenges, Applications and Learning Outcomes, (pp. 73–94). Nova Science Publishers, Inc.

  • Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning Analytics Dashboard Applications. American Behavioral Scientist, 57(10), 1500–1509.

    Article  Google Scholar 

  • Walton, Jamiahus, Michael C Dorneich, Stephen Gilbert, Desmond Bonner, Eliot Winer, and Colin Ray. (2014). Modality and timing of team feedback: Implications for GIFT. Paper presented at the 2nd Annual GIFT Users Symposium, (pp. 199–207).

  • Wang, Patrick, Pierre Tchounikine, and Matthieu Quignard. (2015). A Model to Support Monitoring for Classroom Orchestration in a Tablet-Based CSCL Activity. In Proceedings of 10th European Conference on Technology Enhanced Learning, (pp. 491–496). Springer.

  • Wise, A., Knight, S., & Shum, S. B. (2020). Collaborative Learning Analytics. In U. Cress, C. Rosé, A. Wise, & J. Oshima (Eds.), International Handbook of Computer-Supported Collaborative Learning, (pp. in press. London: Springer.

  • Wise, A. F., & Schwarz, B. B. (2017). Visions of CSCL: eight provocations for the future of the field. International Journal of Computer-Supported Collaborative Learning, 12(4), 423–467.

    Article  Google Scholar 

  • Xing, Wanli, Bob Wadholm, and Sean Goggins. (2014). Learning analytics in CSCL with a focus on assessment: an exploratory study of activity theory-informed cluster analysis. In Proceedings of International Conference on Learning Analytics and Knowledge, LAK'14, (pp. 59–67). ACM.

  • Yi, Ji Soo, Youn-ah Kang, John T. Stasko, and Julie A. Jacko. (2008). Understanding and characterizing insights: how do people gain insights using information visualization? In Proceedings of 2008 Workshop on Beyond time and errors: novel evaLuation methods for Information Visualization, (pp. 1–6). ACM.

  • Yoo, Yesom, Hyeyun Lee, Il-Hyun Jo, and Yeonjeong Park. (2015). Educational Dashboards for Smart Learning: Review of Case Studies. In Proceedings of Emerging Issues in Smart Learning, (pp. 145–155). Springer.

  • Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning using wirelessly interconnected handheld computers. Computers & Education, 42(3), 289–314.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roberto Martinez-Maldonado.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised due to duplicate images for Figure 4 and 6. The correct images are published.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martinez-Maldonado, R. A handheld classroom dashboard: Teachers’ perspectives on the use of real-time collaborative learning analytics. Intern. J. Comput.-Support. Collab. Learn 14, 383–411 (2019). https://doi.org/10.1007/s11412-019-09308-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11412-019-09308-z

Keywords

Navigation