Article

Six Challenges for Human-AI Co-learning

Authors:

Karel van den Bosch,

Tjeerd Schoonderwoerd,

Romy Blankendaal,

Mark NeerincxAuthors Info & Claims

Adaptive Instructional Systems: First International Conference, AIS 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings

Pages 572 - 589

https://doi.org/10.1007/978-3-030-22341-0_45

Published: 26 July 2019 Publication History

Abstract

The increasing use of ever-smarter AI-technology is changing the way individuals and teams learn and perform their tasks. In hybrid teams, people collaborate with artificially intelligent partners. To utilize the different strengths and weaknesses of human and artificial intelligence, a hybrid team should be designed upon the principles that foster successful human-machine learning and cooperation. The implementation of the identified principles sets a number of challenges. Machine agents should, just like humans, have mental models that contain information about the task context, their own role (self-awareness), and the role of others (theory of mind). Furthermore, agents should be able to express and clarify their mental states to partners. In this paper we identify six challenges for humans and machines to collaborate in an adaptive, dynamic and personalized fashion. Implications for research are discussed.

References

[1]

Bader, S., Hitzler, P.: Dimensions of neural-symbolic integration-a structured survey (2005). arXiv preprint cs/0511042

[2]

Bard, N., et al.: The Hanabi challenge: a new frontier for AI research (2019). arXiv preprint: arXiv:1902.00506

[3]

Bergstein, B.: AI isn’t very smart yet. But we need to get moving to make sure automation works for more people (2017). https://www.technologyreview.com/s/609318/the-great-ai-paradox/

[4]

van den Bosch, K., Bronkhorst, A.: Human-AI cooperation to benefit military decision making. In: Proceedings of the NATO IST-160 Specialist’ Meeting on Big Data and Artificial Intelligence for Military Decision Making, Bordeaux, France, 30 May–1 June 2018, S3-1/1-S3-1/12 (2018)

[5]

Bosse T, Breebaart L, Diggelen JV, Neerincx MA, Rosa J, and Smets NJ Developing epartners for human-robot teams in space based on ontologies and formal abstraction hierarchies Int. J. Agent-Oriented Softw. Eng. 2017 5 4 366-398

[6]

Bron, R., Endedijk, M.D., van Veelen, R., Veldkamp, B.P.: The joint influence of intra-and inter-team learning processes on team performance: a constructive or destructive combination? Vocations and learning, pp. 1–26 (2018)

[7]

Brooks, R.: The Seven Deadly Sins of AI Predictions (2017). https://www.technologyreview.com/s/609048/the-seven-deadly-sins-of-ai-predictions/

[8]

Converse, S., Cannon-Bowers, J., Salas, E.: Shared mental models in expert team decision making. In: Individual and Group Decision Making: Current Issues Issues, p. 221 (1993)

[9]

Costa AC, Fulmer CA, and Anderson NR Trust in work teams: an integrative review, multilevel model, and future directions J. Organ. Behav. 2018 39 2 169-184

[10]

Evans JSB Dual-processing accounts of reasoning, judgment, and social cognition Annu. Rev. Psychol. 2008 59 255-278

[11]

Fryer LK, Nakao K, and Thompson A Chatbot learning partners: connecting learning experiences, interest and competence Comput. Hum. Behav. 2019 93 279-289

[12]

de Graaf, M., Malle, B.F.: How people explain action (and autonomous intelligent systems should too). In: AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction (2017)

[13]

de Greeff, J., Hindriks, K., Neerincx, M.A., Kruijff-Korbayova, I.: Human-robot teamwork in USAR environments: the TRADR project. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts, pp. 151–152. ACM (2015)

[14]

de Greeff, J., Mioch, T., van Vught, W., Hindriks, K., Neerincx, M.A., Kruijff-Korbayová, I.: Persistent robot-assisted disaster response. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 99–100. ACM (2018)

[15]

Harari, Y.N.: Homo Deus: A Brief History of Tomorrow. Random House (2016)

[16]

Harbers M and Neerincx MA Value sensitive design of a virtual assistant for workload harmonization in teams Cogn. Technol. Work 2017 19 2–3 329-343

[17]

Heider F The Psychology of Interpersonal Relations 1958 New York Psychology Press

[18]

Janis IL Groupthink IEEE Eng. Manag. Rev. 2008 36 1 36

[19]

Johnson M et al. Coactive design: designing support for interdependence in joint activity J. Hum. Robot Interact. 2014 3 1 43-69

[20]

Johnson M, Jonker C, van Riemsdijk B, Feltovich PJ, and Bradshaw JM Aldewereld H, Dignum V, and Picard G Joint activity testbed: blocks world for teams (BW4T) Engineering Societies in the Agents World X 2009 Heidelberg Springer 254-256

[21]

Johnson-Laird PN Mental models in cognitive science Cogn. Sci. 1980 4 1 71-115

[22]

Kahneman D and Egan P Thinking, Fast and Slow 2011 New York Farrar, Straus and Giroux

[23]

Kaptein F, Broekens J, Hindriks KV, and Neerincx M Traum D, Swartout W, Khooshabeh P, Kopp S, Scherer S, and Leuski A CAAF: a cognitive affective agent programming framework Intelligent Virtual Agents 2016 Cham Springer 317-330

[24]

Kenny, P., et al.: Building interactive virtual humans for training environments. In: Proceedings of I/ITSEC, vol. 174, pp. 911–916 (2007)

[25]

Kim Y and Baylor AL based design of pedagogical agent roles: a review, progress, and recommendations Int. J. Artif. Intell. Educ. 2016 26 1 160-169

[26]

Klein G, Woods DD, Bradshaw JM, Hoffman RR, and Feltovich PJ Ten challenges for making automation a “team player” in joint human-agent activity IEEE Intell. Syst. 2004 19 6 91-95

[27]

Knight, W.: More evidence that humans and machines are better when they team up - MIT Technology Review.pdf (2017). https://www.technologyreview.com/s/609331/more-evidence-that-humans-and-machines-are-better-when-they-team-up/

[28]

Kruijff-Korbayová I et al. TRADR project: long-term human-robot teaming for robot assisted disaster response KI-Künstliche Intell. 2015 29 2 193-201

[29]

Lake BM, Ullman TD, Tenenbaum JB, and Gershman SJ Building machines that learn and think like people Behav. Brain Sci. 2017 40 e253

[30]

Lemaignan S, Warnier M, Sisbot EA, Clodic A, and Alami R Artificial cognition for social human-robot interaction: an implementation Artif. Intell. 2017 247 45-69

[31]

Lin, J., Spraragen, M., Zyda, M.: Computational models of emotion and cognition. In: Advances in Cognitive Systems. Citeseer (2012)

[32]

Liszka-Hackzell JJ Prediction of blood glucose levels in diabetic patients using a hybrid AI technique Comput. Biomed. Res. 1999 32 2 132-144

[33]

Looije R, Neerincx MA, and Cnossen F Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors Int. J. Hum. Comput. Stud. 2010 68 6 386-397

[34]

Malle BF How the Mind Explains Behavior. Folk Explanation, Meaning and Social Interaction 2004 Cambridge MIT Press

[35]

Mathieu JE, Heffner TS, Goodwin GF, Salas E, and Cannon-Bowers JA The influence of shared mental models on team process and performance J. Appl. Psychol. 2000 85 2 273

[36]

Mayer RC, Davis JH, and Schoorman FD An integrative model of organizational trust Acad. Manag. Rev. 1995 20 3 709-734

[37]

Miller, T.: Explanation in artificial intelligence: insights from the social sciences. In: Artificial Intelligence (2018)

[38]

Mioch, T., Peeters, M.M., Nccrincx, M.A.: Improving adaptive human-robot cooperation through work agreements. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 1105–1110. IEEE (2018)

[39]

Morrison, J.E., Meliza, L.L.: Foundations of the after action review process. Technical report, Institute for Defense Analyses, Alexandria, VA (1999)

[40]

Neerincx, M., et al.: The mission execution crew assistant: improving human-machine team resilience for long duration missions. In: Proceedings of the 59th International Astronautical Congress (IAC 2008) (2008)

[41]

Neerincx MA, van der Waa J, Kaptein F, and van Diggelen J Harris D Using perceptual and cognitive explanations for enhanced human-agent team performance Engineering Psychology and Cognitive Ergonomics 2018 Cham Springer 204-214

[42]

Nikolaidis S, Hsu D, and Srinivasa S Human-robot mutual adaptation in collaborative tasks: models and experiments Int. J. Robot. Res. 2017 36 5–7 618-634

[43]

Parasuraman, R., Barnes, M., Cosenzo, K., Mulgund, S.: Adaptive automation for human-robot teaming in future command and control systems. Technical report, Army Research Lab Aberdeen proving ground MD Human Research and Engineering Directorate (2007)

[44]

Patterson RE, Pierce BJ, Bell HH, and Klein G Implicit learning, tacit knowledge, expertise development, and naturalistic decision making J. Cogn. Eng. Decis. Mak. 2010 4 4 289-303

[45]

Premack D and Woodruff G Does the Chimpanzee have a theory of mind? Behav. Brain Sci. 1978 1 4 515-526

[46]

Reber AS Implicit learning and tacit knowledge J. Exp. Psychol. Gen. 1989 118 3 219

[47]

Salas E Team Training Essentials: A Research-Based Guide 2015 London Routledge

[48]

Salas E, Reyes DL, and McDaniel SH The science of teamwork: progress, reflections, and the road ahead Am. Psychol. 2018 73 4 593

[49]

Siegel AW and Schraagen JM Team reflection makes resilience-related knowledge explicit through collaborative sensemaking: observation study at a rail post Cogn. Technol. Work 2017 19 1 127-142

[50]

Silver D et al. Mastering the game of go without human knowledge Nature 2017 550 7676 354

[51]

Stout RJ, Salas E, and Carson R Individual task proficiency and team process behavior: what’s important for team functioning? Mil. Psychol. 1994 6 3 177-192

[52]

Stout, R.J., Cannon-Bowers, J.A., Salas, E.: The role of shared mental models in developing team situational awareness: implications for training. In: Situational Awareness, pp. 287–318. Routledge (2017)

[53]

Teo G, Wohleber R, Lin J, and Reinerman-Jones L Savage-Knepshield P and Chen J The relevance of theory to human-robot teaming research and development Advances in Human Factors in Robots and Unmanned Systems 2017 Cham Springer 175-185

[54]

Tielman ML, Neerincx MA, Bidarra R, Kybartas B, and Brinkman WP A therapy system for post-traumatic stress disorder using a virtual agent and virtual storytelling to reconstruct traumatic memories J. Med. Syst. 2017 41 8 125

[55]

Tielman ML, Neerincx MA, van Meggelen M, Franken I, and Brinkman WP How should a virtual agent present psychoeducation? Influence of verbal and textual presentation on adherence Technol. Health Care 2017 25 1-16 Preprint

[56]

Tsaih R, Hsu Y, and Lai CC Forecasting s&p 500 stock index futures with a hybrid ai system Decis. Support Syst. 1998 23 2 161-174

[57]

Van Diggelen J, Neerincx M, Peeters M, and Schraagen JM Developing effective and resilient human-agent teamwork using team design patterns IEEE Intell. Syst. 2018 34 2 15-24

[58]

de Visser, E.J., et al.: Longitudinal trust development in human-robot teams: models, methods and a research agenda. IEEE Trans. Hum. Mach. Syst., 1–20 (2018)

[59]

Werkhoven, P., Kester, L., Neerincx, M.: Telling autonomous systems what to do. In: Proceedings of the 36th European Conference on Cognitive Ergonomics, p. 2. ACM (2018)

[60]

Wiltshire TJ and Fiore SM Social cognitive and affective neuroscience in human-machine systems: a roadmap for improving training, human-robot interaction, and team performance IEEE Trans. Hum. Mach. Syst. 2014 44 6 779-787

[61]

Wooldridge M and Jennings NR Wooldridge MJ and Jennings NR Agent theories, architectures, and languages: a survey Intelligent Agents 1995 Heidelberg Springer 1-39

[62]

Xiao, Z., et al.: A deep learning-based segmentation method for brain tumor in MR images. In: 2016 IEEE 6th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS), pp. 1–6. IEEE (2016)

Cited By

Xiao CMa WSong QXu SZhang KWang YFu Q(2025)Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706507(293-305)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706507
Do HBrachman MDugan CJohnson JLauer JRai PPan Q(2024)Grounding with Structure: Exploring Design Variations of Grounded Human-AI Collaboration in a Natural Language InterfaceProceedings of the ACM on Human-Computer Interaction10.1145/36869028:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686902
Wang ZShen LKuang EZhang SFan M(2024)Exploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX CollaborationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660703(1594-1606)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660703
Show More Cited By

Recommendations

Theory of Mind in Human-AI Interaction
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Theory of Mind (ToM), humans’ capability of attributing mental states such as intentions, goals, emotions, and beliefs to ourselves and others, has become a concept of great interest in human-AI interaction research. Given the fundamental role of ToM in ...
From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Artificial Intelligent (AI) and Machine Learning (ML) algorithms are coming out of research labs into the real-world applications, and recent research has focused a lot on Human-AI Interaction (HAI) and Explainable AI (XAI). However, Interaction is not ...
Human-Robot Co-Learning for Fluent Collaborations
HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

A team develops competency by progressive mutual adaptation and learning, a process we call co-learning. In human teams, partners naturally adapt to each other and learn while collaborating. This is not self-evident in human-robot teams. There is a need ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Adaptive Instructional Systems: First International Conference, AIS 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings

Jul 2019

647 pages

ISBN:978-3-030-22340-3

DOI:10.1007/978-3-030-22341-0

Editors:
Robert A. Sottilare
Soar Technology, Inc.,, Orlando, FL, USA
,
Jessica Schwarz
Fraunhofer FKIE, Wachtberg, Germany

© Springer Nature Switzerland AG 2019.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 26 July 2019

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xiao CMa WSong QXu SZhang KWang YFu Q(2025)Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706507(293-305)Online publication date: 3-Mar-2025
https://dl.acm.org/doi/10.1145/3706468.3706507
Do HBrachman MDugan CJohnson JLauer JRai PPan Q(2024)Grounding with Structure: Exploring Design Variations of Grounded Human-AI Collaboration in a Natural Language InterfaceProceedings of the ACM on Human-Computer Interaction10.1145/36869028:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686902
Wang ZShen LKuang EZhang SFan M(2024)Exploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX CollaborationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660703(1594-1606)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660703
Darban M(2024)Navigating virtual teams in generative AI-led learning: The moderation of team perceived virtualityEducation and Information Technologies10.1007/s10639-024-12681-429:17(23225-23248)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10639-024-12681-4
Breideband TBush JChandler CChang MDickler RFoltz PGanesh ALieber RPenuel WReitman JWeatherley JD'Mello S(2023)The Community Builder (CoBi): Helping Students to Develop Better Small Group Collaborative Learning SkillsCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3607498(376-380)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3607498
Kalff EMaaiveld TSchadd MVoogd JWeyland L(2023)Survey on Sensing, Modelling and Reasoning Aspects in Military Autonomous SystemsModelling and Simulation for Autonomous Systems10.1007/978-3-031-71397-2_17(263-284)Online publication date: 17-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-71397-2_17
Hu XTwidale M(2023)A Scoping Review of Mental Model Research in HCI from 2010 to 2021HCI International 2023 – Late Breaking Papers10.1007/978-3-031-48038-6_7(101-125)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-48038-6_7

View Options

View options

Figures

Tables

Media

View Table of Conten