Scaffolded versus Self-Paced Training for Human-Agent Teams
Pages 335 - 337
Abstract
Two pilot studies compare the impacts of scaffolded versus self-paced practice on teaming and performance on an open-ended design challenge. In both studies, guiding players early on in how to leverage AI assistance (scaffolded practice) led to much more robust teaming than allowing players to learn at their own pace, but did not improve task performance.
References
[1]
Francisco Maria Calisto, João Fernandes, Margarida Morais, Carlos Santiago, João Maria Abrantes, Nuno Nunes, and Jacinto C Nascimento. 2023. Assertiveness-based agent communication for a personalized medicine on medical imaging diagnosis. In Proceedings of the 2023 CHI conference on human factors in computing systems. 1–20.
[2]
Joseph Cohen and Andrew Imada. 2005. Agent-based training of distributed command and control teams. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 49. SAGE Publications Sage CA: Los Angeles, CA, 2164–2168.
[3]
Mustafa Demir, Nathan J McNeese, and Nancy J Cooke. 2016. Team communication behaviors of the human-automation teaming. In 2016 IEEE international multi-disciplinary conference on cognitive methods in situation awareness and decision support (CogSIMA). IEEE, 28–34.
[4]
Christopher Flathmann, Beau G Schelble, and Anna Galeano. 2024. Empirical Impacts of Independent and Collaborative Training on Task Performance and Improvement in Human-AI Teams. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE Publications Sage CA: Los Angeles, CA, 10711813241274425.
[5]
Christopher Flathmann, Beau G Schelble, Patrick J Rosopa, Nathan J McNeese, Rohit Mallick, and Kapil Chalil Madathil. 2023. Examining the impact of varying levels of AI teammate influence on human-AI teams. International Journal of Human-Computer Studies 177 (2023), 103061.
[6]
Alexandra M Harris-Watson, Lindsay E Larson, Nina Lauharatanahirun, Leslie A DeChurch, and Noshir S Contractor. 2023. Social perception in Human-AI teams: Warmth and competence predict receptivity to AI teammates. Computers in Human Behavior 145 (2023), 107765.
[7]
Rehan Iftikhar, Yi-Te Chiu, Mohammad Saud Khan, and Catherine Caudwell. 2023. Human–Agent Team Dynamics: A Review and Future Research Opportunities. IEEE Transactions on Engineering Management (2023).
[8]
Deanna Kuhn and Victoria Ho. 1980. Self-directed activity and cognitive development. Journal of Applied Developmental Psychology 1, 2 (1980), 119–133.
[9]
Lane Lawley and Christopher Maclellan. 2024. VAL: Interactive Task Learning with GPT Dialog Parsing. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–18.
[10]
Nathan J McNeese, Mustafa Demir, Nancy J Cooke, and Christopher Myers. 2018. Teaming with a synthetic teammate: Insights into human-autonomy teaming. Human factors 60, 2 (2018), 262–273.
[11]
Jason S Metcalfe, Brandon S Perelman, David L Boothe, and Kaleb Mcdowell. 2021. Systemic oversimplification limits the potential for human-AI partnership. IEEE Access 9 (2021), 70242–70260.
[12]
Stefanos Nikolaidis, Przemyslaw Lasota, Ramya Ramakrishnan, and Julie Shah. 2015. Improved human–robot team performance through cross-training, an approach inspired by human team training practices. The International Journal of Robotics Research 34, 14 (2015), 1711–1730.
[13]
Chuen-Tsai Sun, Dai-Yi Wang, and Hui-Ling Chan. 2011. How digital scaffolds in games direct problem-solving behaviors. Computers & Education 57, 3 (2011), 2118–2125.
[14]
Allen Tough 1967. Learning without a teacher: A study of tasks and assistance during adult self-teaching projects. Educational Research Series; 3 (1967).
[15]
Jonathan G Tullis and Aaron S Benjamin. 2011. On the effectiveness of self-paced learning. Journal of memory and language 64, 2 (2011), 109–118.
[16]
David Wood, Jerome S Bruner, and Gail Ross. 1976. The role of tutoring in problem solving. Journal of child psychology and psychiatry 17, 2 (1976), 89–100.
[17]
Kevin T Wynne and Joseph B Lyons. 2018. An integrative model of autonomous agent teammate-likeness. Theoretical Issues in Ergonomics Science 19, 3 (2018), 353–374.
Index Terms
- Scaffolded versus Self-Paced Training for Human-Agent Teams
Index terms have been assigned to the content through auto-classification.
Recommendations
"An Ideal Human": Expectations of AI Teammates in Human-AI Teaming
CSCWDriven by state-of-the-art AI technologies, human-AI collaboration has become an important area in computer-supported teamwork research. While human-AI collaboration has been investigated in various domains, more research is needed to explore human ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2024
502 pages
ISBN:9798400711787
DOI:10.1145/3687272
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 November 2024
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Funding Sources
Conference
HAI '24
Sponsor:
HAI '24: International Conference on Human-Agent Interaction
November 24 - 27, 2024
Swansea, United Kingdom
Acceptance Rates
Overall Acceptance Rate 121 of 404 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 8Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)5
Reflects downloads up to 20 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format