MAI - A Proactive Speech Agent for Metacognitive Mediation in Collaborative Learning
Authors: 
Justin Edwards, 
Andy Nguyen, Marta Sobocinski, Joni Lämsä, Adelson de Araujo, Belle Dang, Ridwan Whitehead, Anni-Sofia Roberts, Matti Kaarlela, Sanna JarvelaAuthors Info & Claims
Article No.: 46, Pages 1 - 5
Abstract
We introduce MAI - a proactive speech agent aimed at enhancing metacognitive awareness among learners in collaborative learning settings. Background is presented around Socially Shared Regulation of Learning and the role of metacognition in learning. Next, the design of the rules that MAI uses to prompt learners and mediate metacognition are introduced. We describe the conditions in which MAI has been piloted thus far, including as a Wizard of Oz prototype and as a fully functional prototype using natural language processing. We discuss the ethical considerations that went into the prototyping and testing of MAI. Finally, we describe our next steps for understanding the interactions learners had with MAI already, planned design changes, and the future of testing the agent.
References
[1]
Juan M. Coria, Hervé Bredin, Sahar Ghannay, and Sophie Rosset. 2021. Overlap-Aware Low-Latency Online Speaker Diarization Based on End-to-End Local Segmentation. In 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU). 1139–1146. https://doi.org/10.1109/ASRU51503.2021.9688044
[2]
Michael E. Dawson, Anne M. Schell, and Diane L. Filion. 2007. The Electrodermal System. Cambridge University Press, 159–181.
[3]
Adelson de Araujo, Pantelis M Papadopoulos, Susan McKenney, and Ton de Jong. 2023. Supporting Collaborative Online Science Education with a Transferable and Configurable Conversational Agent. CSCL23 (2023).
[4]
Philip Doyle. 2022. The Dimensions and Adaptation of Partner Models in Human-Machine Dialogue. PhD Thesis. University College Dublin. School of Information and Communication Studies.
[5]
Justin Edwards, Leigh Clark, and Allison Perrone. 2021. LGBTQ-AI? Exploring Expressions of Gender and Sexual Orientation in Chatbots. In Proceedings of the 3rd Conference on Conversational User Interfaces (Bilbao (online), Spain) (CUI ’21). Association for Computing Machinery, New York, NY, USA, Article 2, 4 pages. https://doi.org/10.1145/3469595.3469597
[6]
Justin Edwards, Christian Janssen, Sandy Gould, and Benjamin R Cowan. 2021. Eliciting spoken interruptions to inform proactive speech agent design. In Proceedings of the 3rd Conference on Conversational User Interfaces. 1–12.
[7]
Eetu Haataja, Jonna Malmberg, and Sanna Järvelä. 2018. Monitoring in collaborative learning: Co-occurrence of observed behavior and physiological synchrony explored. Computers in Human Behavior 87 (2018), 337–347.
[8]
Sanna Järvelä, Andy Nguyen, and Allyson Hadwin. 2023. Human and artificial intelligence collaboration for socially shared regulation in learning. British Journal of Educational Technology (2023).
[9]
Hanna Järvenoja, Sanna Järvelä, and Jonna Malmberg. 2020. Supporting groups’ emotion and motivation regulation during collaborative learning. Learning and Instruction 70 (2020), 101090.
[10]
Sanna Järvelä, Allyson Hadwin, Jonna Malmberg, and Mariel Miller. 2018. Contemporary Perspectives of Regulated Learning in Collaboration. In International Handbook of the Learning Sciences (1 ed.), Frank Fischer, Cindy E. Hmelo-Silver, Susan R. Goldman, and Peter Reimann (Eds.). Routledge, New York, NY : Routledge, 2018., 127–136. https://doi.org/10.4324/9781315617572-13
[11]
Peekaboo Kidz. 2015. Energy. https://www.youtube.com/watch?v=Q0LBegPWzrg
[12]
J. Lämsä, J. Edwards, E. Haataja, M. Sobocinski, A. Nguyen, P.R. Peña, and S. Jarvela. submitted. Learners’ linguistic alignment and physiological synchrony: Identifying trigger events that invite socially shared regulation of learning. Journal of Learning Analytics (submitted).
[13]
Ashish Mittal, Rudra Murthy, Vishwajeet Kumar, and Riyaz Bhat. 2024. Towards understanding and mitigating the hallucinations in NLP and Speech. In Proceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD). 489–492.
[14]
University of Colorado Boulder. 2023. Energy skate park. https://phet.colorado.edu/en/simulations/energy-skate-park
[15]
Jun Oshima and Ritsuko Oshima. 2013. Collaborative Learning Through Socially Shared Regulation Supported by a Robotic Agent. In To See the World and a Grain of Sand: Learning across Levels of Space, Time, and Scale: CSCL 2013 Conference Proceedings Volume 2. Madison, WI, 327–328. https://doi.org/10.22318/cscl2013.2.327
[16]
Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. In International Conference on Machine Learning. PMLR, 28492–28518.
[17]
Márta Sobocinski, Sanna Järvelä, Jonna Malmberg, Muhterem Dindar, Antti Isosalo, and Kai Noponen. 2020. How does monitoring set the stage for adaptive regulation or maladaptive behavior in collaborative learning?Metacognition and Learning 15 (2020), 99–127.
[18]
Selina Jeanne Sutton. 2020. Gender Ambiguous, not Genderless: Designing Gender in Voice User Interfaces (VUIs) with Sensitivity. In Proceedings of the 2nd Conference on Conversational User Interfaces. ACM, Bilbao Spain, 1–8. https://doi.org/10.1145/3405755.3406123
[19]
Suzanne Tolmeijer, Naim Zierau, Andreas Janson, Jalil Sebastian Wahdatehagh, Jan Marco Marco Leimeister, and Abraham Bernstein. 2021. Female by Default? – Exploring the Effect of Voice Assistant Gender and Pitch on Trait and Trust Attribution. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–7. https://doi.org/10.1145/3411763.3451623
[20]
Eija Vuorenmaa, Sanna Järvelä, Muhterem Dindar, and Hanna Järvenoja. 2023. Sequential patterns in social interaction states for regulation in collaborative learning. Small Group Research 54, 4 (2023), 512–550.
[21]
Barry J Zimmerman. 2002. Becoming a Self-Regulated Learner: An Overview. THEORY INTO PRACTICE (2002).
Index Terms
- MAI - A Proactive Speech Agent for Metacognitive Mediation in Collaborative Learning
Recommendations
Comparing Perceptions of Static and Adaptive Proactive Speech Agents
CUI '24: Proceedings of the 6th ACM Conference on Conversational User InterfacesA growing literature on speech interruptions describes how people interrupt one another with speech, but these behaviours have not yet been implemented in the design of artificial agents which interrupt. Perceptions of a prototype proactive speech agent ...
Technology supported collaborative learning for higher education: comparative case studies in Tanzania
Collaboration for knowledge networking in developmentTo learn, a person has to be able to communicate effectively with others about the knowledge to be learned. Communication processes in classrooms can be supported by Group Support Systems (GSS), that enable students to communicate anonymously and in ...
Towards a Smart Learning Management System (smart-LMS) to Improve Collaborative Learning in Higher Education
SCA '18: Proceedings of the 3rd International Conference on Smart City ApplicationsWith the increasing number of higher education students using e-learning technology, collaborative learning has been suggested as a solution to the lack of sufficient support to learners in e-learning environments, particularly LMS (Learning Management ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
616 pages
ISBN:9798400705113
DOI:10.1145/3640794
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 July 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
Conference
CUI '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 34 of 100 submissions, 34%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 93Total Downloads
- Downloads (Last 12 months)93
- Downloads (Last 6 weeks)11
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format