research-article

Open access

Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration Analytics

Authors:

Sambit Praharaj,

Maren Scheffel,

Marcel Schmitz,

Hendrik DrachslerAuthors Info & Claims

LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference

Pages 358 - 369

https://doi.org/10.1145/3506860.3506922

Published: 21 March 2022 Publication History

All formats PDF

Abstract

Collaboration is one of the four important 21st-century skills. With the pervasive use of sensors, interest on co-located collaboration (CC) has increased lately. Most related literature used the audio modality to detect indicators of collaboration (such as total speaking time and turn taking). CC takes place in physical spaces where group members share their social (i.e., non-verbal audio indicators like speaking time, gestures) and epistemic space (i.e., verbal audio indicators like the content of the conversation). Past literature has mostly focused on the social space to detect the quality of collaboration. In this study, we focus on both social and epistemic space with an emphasis on the epistemic space to understand different evolving collaboration patterns and collaborative convergence and quantify collaboration quality. We conduct field trials by collecting audio recordings in 14 different sessions in a university setting while the university staff and students collaborate over playing a board game to design a learning activity. This collaboration task consists of different phases with each collaborating member having been assigned a pre-fixed role. We analyze the collected group speech data to do role-based profiling and visualize it with the help of a dashboard.

References

[1]

Khaled Bachour, Frederic Kaplan, and Pierre Dillenbourg. 2010. An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Transactions on Learning Technologies 3, 3 (2010), 203–213.

Digital Library

[2]

Nikoletta Bassiou, Andreas Tsiartas, Jennifer Smith, Harry Bratt, Colleen Richey, Elizabeth Shriberg, Cynthia D’Angelo, and Nonye Alozie. 2016. Privacy-Preserving Speech Analytics for Automatic Assessment of Student Collaboration. In INTERSPEECH. 888–892.

[3]

Tony Bergstrom and Karrie Karahalios. 2007. Conversation Clock: Visualizing audio patterns in co-located groups. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS’07). IEEE, 78–78.

Digital Library

[4]

Özgür Çetin and Elizabeth Shriberg. 2006. Overlap in meetings: ASR effects and analysis by dialog factors, speakers, and collection site. In International Workshop on Machine Learning for Multimodal Interaction. Springer, 212–224.

[5]

Senthil Chandrasegaran, Chris Bryan, Hidekazu Shidara, Tung-Yen Chuang, and Kwan-Liu Ma. 2019. TalkTraces: Real-time capture and visualization of verbal content in meetings. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[6]

Carole Chapman, Leonie Ramondt, and Glenn Smiley. 2005. Strong community, deep learning: Exploring the link. Innovations in education and teaching international 42, 3(2005), 217–230.

[7]

Kousik Das, Sovan Samanta, and Madhumangal Pal. 2018. Study on centrality measures in social networks: a survey. Social network analysis and mining 8, 1 (2018), 1–11.

[8]

Daniele Di Mitri, Jan Schneider, Marcus Specht, and Hendrik Drachsler. 2018. From signals to knowledge: A conceptual model for multimodal learning analytics. Journal of Computer Assisted Learning 34, 4 (2018), 338–349.

[9]

Pierre Dillenbourg. 1999. What do you mean by collaborative learning?

[10]

Wen Dong, Taemie Kim, and Alex Pentland. 2009. A quantitative analysis of the collective creativity in playing 20-questions games. In Proceedings of the seventh ACM conference on Creativity and cognition. 365–366.

Digital Library

[11]

Bernd Huber, Stuart Shieber, and Krzysztof Z Gajos. 2019. Automatically analyzing brainstorming language behavior with Meeter. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–17.

Digital Library

[12]

Heisawn Jeong and Michelene TH Chi. 2007. Knowledge convergence and collaborative learning. Instructional Science 35, 4 (2007), 287–315.

[13]

Jaebok Kim, Khiet P Truong, Vicky Charisi, Cristina Zaga, Manja Lohse, Dirk Heylen, and Vanessa Evers. 2015. Vocal turn-taking patterns in groups of children performing collaborative tasks: an exploratory study. In Sixteenth Annual Conference of the International Speech Communication Association.

[14]

Taemie Kim, Agnes Chang, Lindsey Holland, and Alex Sandy Pentland. 2008. Meeting mediator: enhancing group collaboration using sociometric feedback. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. ACM, 457–466.

[15]

Charles Kivunja. 2015. Exploring the pedagogical meaning and implications of the 4Cs ‘super skills’ for the 21st century through Bruner’s 5E lenses of knowledge construction to improve pedagogies of the new learning paradigm. Creative Education 6, 02 (2015), 224.

[16]

Nichola Lubold and Heather Pon-Barry. 2014. Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge. ACM, 5–12.

Digital Library

[17]

Saturnino Luz. 2013. Automatic identification of experts and performance prediction in the multimodal math data corpus through analysis of speech interaction. In Proceedings of the 15th ACM on International conference on multimodal interaction. ACM, 575–582.

Digital Library

[18]

Jun Oshima, Ritsuko Oshima, and Shunsuke Saruwatari. 2020. Analysis of students’ ideas and conceptual artifacts in knowledge-building discourse. British Journal of Educational Technology 51, 4 (2020), 1308–1321.

[19]

Sharon Oviatt, Kevin Hang, Jianlong Zhou, and Fang Chen. 2015. Spoken Interruptions Signal Productive Problem Solving and Domain Expertise in Mathematics. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. ACM, 311–318.

Digital Library

[20]

Sambit Praharaj. 2019. Co-located Collaboration Analytics. In 2019 International Conference on Multimodal Interaction. 473–476.

[21]

Sambit Praharaj, Maren Scheffel, Hendrik Drachsler, and Marcus Specht. 2018. MULTIFOCUS: MULTImodal Learning Analytics FOr Co-located Collaboration Understanding and Support. In EC-TEL (Doctoral Consortium).

[22]

Sambit Praharaj, Maren Scheffel, Hendrik Drachsler, and Marcus Specht. 2018. Multimodal Analytics for Real-Time Feedback in Co-located Collaboration. In European Conference on Technology Enhanced Learning. Springer, 187–201.

[23]

Sambit Praharaj, Maren Scheffel, Hendrik Drachsler, and Marcus Specht. 2019. Group Coach for Co-located Collaboration. In European Conference on Technology Enhanced Learning. Springer, 732–736.

[24]

Sambit Praharaj, Maren Scheffel, Hendrik Drachsler, and Marcus Specht. 2021. Literature Review on Co-Located Collaboration Modeling Using Multimodal Learning Analytics—Can We Go the Whole Nine Yards?IEEE Transactions on Learning Technologies 14, 3 (2021), 367–385.

[25]

Sambit Praharaj, Maren Scheffel, Marcel Schmitz, Marcus Specht, and Hendrik Drachsler. May 2021. Towards automatic collaboration analytics for group speech data using learning analytics. Sensors 21, 9 (May 2021), 3156.

[26]

Marcel Schmitz, Maren Scheffel, Roger Bemelmans, and Hendrik Drachsler. 2019. Fellowship Of The Learning Activity - Learning Analytics 4 Learning Design Game.https://doi.org/10.25385/zuyd.9884279

[27]

Bertrand Schneider and Roy Pea. 2014. The Effect of Mutual Gaze Perception on Students’ Verbal Coordination. In EDM. 138–144.

[28]

Bertrand Schneider and Roy Pea. 2015. Does seeing one another’s gaze affect group dialogue? A computational approach. Journal of Learning Analytics 2, 2 (2015), 107–133.

[29]

Daniel Spikol, Emanuele Ruffaldi, Lorenzo Landolfi, and Mutlu Cukurova. 2017. Estimation of success in collaborative learning based on multimodal learning analytics features. In 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT). IEEE, 269–273.

[30]

Stephanie Teasley, Frank Fischer, Pierre Dillenbourg, Manu Kapur, Michelene Chi, Armin Weinberger, and Karsten Stegmann. 2008. Cognitive convergence in collaborative learning. (2008).

[31]

Jacques Terken and Janienke Sturm. 2010. Multimodal support for social dynamics in co-located meetings. Personal and Ubiquitous Computing 14, 8 (2010), 703–714.

Digital Library

[32]

Kui Xie, Gennaro Di Tosto, Lin Lu, and Young Suk Cho. 2018. Detecting leadership in peer-moderated online collaborative learning through text mining and social network analysis. The Internet and Higher Education 38 (2018), 9–17.

[33]

Jianlong Zhou, Kevin Hang, Sharon Oviatt, Kun Yu, and Fang Chen. 2014. Combining empirical and machine learning techniques to predict math expertise using pen signal features. In Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge. ACM, 29–36.

Digital Library

Cited By

Buseyne SVrijdags ASaid-Metwaly SDanquigny THeutte JDepaepe FRaes A(2024)Peering into the team role kaleidoscope: the interplay of personal characteristics and verbal interactions in collaborative problem solvingFrontiers in Psychology10.3389/fpsyg.2024.134589215Online publication date: 16-Sep-2024
https://doi.org/10.3389/fpsyg.2024.1345892
Chandler CBreideband TReitman JChitwood MBush JHoward ALeonhart SFoltz PPenuel WD'Mello S(2024)Computational Modeling of Collaborative Discourse to Enable Feedback and Reflection in Middle School ClassroomsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636917(576-586)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636917
Echeverria VYan LZhao LAbel SAlfredo RDix SJaggard HWotherspoon ROsborne ABuckingham Shum SGasevic DMartinez-Maldonado R(2024)TeamSlides: a Multimodal Teamwork Analytics Dashboard for Teacher-guided Reflection in a Physical Learning SpaceProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636857(112-122)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636857
Show More Cited By

Recommendations

Co-located Collaboration Analytics
ICMI '19: 2019 International Conference on Multimodal Interaction

Collaboration is an important skill of the 21st century. It can take place in an online (or remote) setting or in a co-located (or face-to-face) setting. With the large scale adoption of sensor use, studies on co-located collaboration (CC) has gained ...
Group Coach for Co-located Collaboration
Transforming Learning with Meaningful Technologies
Abstract
Collaboration is an important 21st century skill; it can take place in a remote or co-located setting. Co-located collaboration (CC) gives rise to subtle human interactions that can be described with multimodal indicators like gaze, speech and ...
Multimodal Analytics for Real-Time Feedback in Co-located Collaboration
Lifelong Technology-Enhanced Learning
Abstract
Collaboration is an important 21st century skill; it can take place in a remote or co-located setting. Co-located collaboration (CC) is a very complex process which involves subtle human interactions that can be described with multimodal ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference

March 2022

582 pages

ISBN:9781450395731

DOI:10.1145/3506860

Program Chairs:
Alyssa Friend Wise
New York University, USA
,
Roberto Martinez-Maldonado
Monash University, Australia
,
Isabel Hilliger
Pontificia Universidad Católica de Chile, Chile

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

LAK22

LAK22: 12th International Learning Analytics and Knowledge Conference

March 21 - 25, 2022

Online, USA

Acceptance Rates

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
828
Total Downloads

Downloads (Last 12 months)355
Downloads (Last 6 weeks)48

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Buseyne SVrijdags ASaid-Metwaly SDanquigny THeutte JDepaepe FRaes A(2024)Peering into the team role kaleidoscope: the interplay of personal characteristics and verbal interactions in collaborative problem solvingFrontiers in Psychology10.3389/fpsyg.2024.134589215Online publication date: 16-Sep-2024
https://doi.org/10.3389/fpsyg.2024.1345892
Chandler CBreideband TReitman JChitwood MBush JHoward ALeonhart SFoltz PPenuel WD'Mello S(2024)Computational Modeling of Collaborative Discourse to Enable Feedback and Reflection in Middle School ClassroomsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636917(576-586)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636917
Echeverria VYan LZhao LAbel SAlfredo RDix SJaggard HWotherspoon ROsborne ABuckingham Shum SGasevic DMartinez-Maldonado R(2024)TeamSlides: a Multimodal Teamwork Analytics Dashboard for Teacher-guided Reflection in a Physical Learning SpaceProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636857(112-122)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636857
Zhao LGašević DSwiecki ZLi YLin JSha LYan LAlfredo RLi XMartinez‐Maldonado R(2024)Towards automated transcribing and coding of embodied teamwork communication through multimodal learning analyticsBritish Journal of Educational Technology10.1111/bjet.13476Online publication date: 30-May-2024
https://doi.org/10.1111/bjet.13476
Buseyne SRajagopal KDanquigny TDepaepe FHeutte JRaes A(2023)Assessing verbal interaction of adult learners in computer‐supported collaborative problem solvingBritish Journal of Educational Technology10.1111/bjet.1339155:4(1465-1485)Online publication date: 29-Sep-2023
https://doi.org/10.1111/bjet.13391
Zheng LZhong LFan Y(2023)An immediate analysis of the interaction topic approach to promoting group performance, knowledge convergence, cognitive engagement, and coregulation in online collaborative learningEducation and Information Technologies10.1007/s10639-023-11588-w28:8(9913-9934)Online publication date: 18-Jan-2023
https://dl.acm.org/doi/10.1007/s10639-023-11588-w
Zhao LTan YGašević DShaffer DYan LAlfredo RLi XMartinez-Maldonado R(2023)Analysing Verbal Communication in Embodied Team Learning Using Multimodal Data and Ordered Network AnalysisArtificial Intelligence in Education10.1007/978-3-031-36272-9_20(242-254)Online publication date: 3-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-36272-9_20
Praharaj SScheffel MSpecht MDrachsler H(2023)Measuring Collaboration Quality Through Audio Data and Learning AnalyticsUnobtrusive Observations of Learning in Digital Environments10.1007/978-3-031-30992-2_6(91-110)Online publication date: 14-Jun-2023
https://doi.org/10.1007/978-3-031-30992-2_6
Ohnishi RMurakami YNakanish TOkada ROzawa TFukushima KMiyamae TOgasawara YAkiyama KOhashi K(2023)Time-Series Multidimensional Dialogue Feature Visualization Method for Group WorkSoftware Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing 2022-Winter10.1007/978-3-031-26135-0_6(59-76)Online publication date: 5-May-2023
https://doi.org/10.1007/978-3-031-26135-0_6

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents