research-article

Public Access

Implicit Communication of Actionable Information in Human-AI teams

Authors:

Ross A. KnepperAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 95, Pages 1 - 13

https://doi.org/10.1145/3290605.3300325

Published: 02 May 2019 Publication History

All formats PDF

Abstract

Humans expect their collaborators to look beyond the explicit interpretation of their words. Implicature is a common form of implicit communication that arises in natural language discourse when an utterance leverages context to imply information beyond what the words literally convey. Whereas computational methods have been proposed for interpreting and using different forms of implicature, its role in human and artificial agent collaboration has not yet been explored in a concrete domain. The results of this paper provide insights to how artificial agents should be structured to facilitate natural and efficient communication of actionable information with humans. We investigated implicature by implementing two strategies for playing Hanabi, a cooperative card game that relies heavily on communication of actionable implicit information to achieve a shared goal. In a user study with 904 completed games and 246 completed surveys, human players randomly paired with an implicature AI are 71% more likely to think their partner is human than players paired with a non-implicature AI. These teams demonstrated game performance similar to other state of the art approaches.

References

[1]

Sultan A Alharthi, Ruth C Torres, Ahmed S Khalaf, Zachary O Toups, Igor Dolgov, and Lennart E Nacke. 2018. Investigating the impact of annotation interfaces on player performance in distributed multiplayer games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 314.

Digital Library

[2]

Dean Allemang, Michael C Tanner, Tom Bylander, and John Josephson. 1987. Computational complexity of hypothesis assembly. In Proceedings of the 10th International Joint Conference on Artificial Intelligence, Vol. 2. Morgan Kaufmann Publishers Inc., 1112--1117.

Digital Library

[3]

Erik Andersen, Yun-En Liu, Rich Snider, Roy Szeto, and Zoran Popovic. 2011. Placing a value on aesthetics in online casual games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1275--1278.

Digital Library

[4]

Erik Andersen, Eleanor O'Rourke, Yun-En Liu, Rich Snider, Jeff Lowdermilk, David Truong, Seth Cooper, and Zoran Popovic. 2012. The impact of tutorials on games of varying complexity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 59--68.

Digital Library

[5]

Douglas E Appelt and Martha E Pollack. 1992. Weighted abduction for plan ascription. User Modeling and User-Adapted Interaction 2, 1--2 (1992), 1--25.

[6]

Amartya Banerjee, Michael S Horn, and Pryce Davis. 2016. Invasion of the energy monsters: A family board game about energy consumption. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1828--1834.

Digital Library

[7]

Michael Blome-Tillmann. 2008. Conversational implicature and the cancellability test. Analysis 68, 2 (2008), 156--160.

[8]

Bruno Bouzy. 2017. Playing Hanabi near-optimally. In Advances in Computer Games. Springer, 51--62.

[9]

Cynthia Breazeal, Cory D Kidd, Andrea Lockerd Thomaz, Guy Hoffman, and Matt Berlin. 2005. Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In Intelligent Robots and Systems (IROS), 2005 IEEE/RSJ International Conference on. IEEE, 708--713.

[10]

Cynthia Breazeal and Brian Scassellati. 1999. How to build robots that make friends and influence people. In Intelligent Robots and Systems, 1999. IROS'99. Proceedings. 1999 IEEE/RSJ International Conference on, Vol. 2. IEEE, 858--863.

[11]

Richard Breheny, Napoleon Katsos, and John Williams. 2006. Are generalised scalar implicatures generated by default? An on-line investigation into the role of context in generating pragmatic inferences. Cognition 100, 3 (2006), 434--463.

[12]

Cameron B Browne, Edward Powley, Daniel Whitehouse, Simon M Lucas, Peter I Cowling, Philipp Rohlfshagen, Stephen Tavener, Diego Perez, Spyridon Samothrakis, and Simon Colton. 2012. A survey of Monte Carlo tree search methods. IEEE Transactions on Computational Intelligence and AI in Games 4, 1 (2012), 1--43.

[13]

Bruce Buchanan, Georgia Sutherland, and Edward A Feigenbaum. 1969. Heuristic DENDRAL: A program for generating explanatory hypotheses in organic chemistry. In Machine Intelligence, Bernard Meltzer and Donald Michie (Eds.). Vol. 4. Edinburgh University Press.

[14]

Tom Bylander. 1991. The monotonic abduction problem: A functional characterization on the edge of tractability. In Proceedings of the Second International Conference on Principles of Knowledge Representation and Reasoning. Morgan Kaufmann Publishers Inc., 70--77.

Digital Library

[15]

Tom Bylander, Dean Allemang, Michael C Tanner, and John R Josephson. 1991. The computational complexity of abduction. Artificial Intelligence 49, 1--3 (1991), 25--60.

Digital Library

[16]

Murray Campbell, A Joseph Hoane Jr, and Feng-hsiung Hsu. 2002. Deep Blue. Artificial Intelligence 134, 1--2 (2002), 57--83.

Digital Library

[17]

Rogelio Enrique Cardona-Rivera and Robert Michael Young. 2014. Games as conversation. In Tenth Artificial Intelligence and Interactive Digital Entertainment Conference.

[18]

Cristiano Castelfranchi, Giovanni Pezzulo, and Luca Tummolini. 2012. Behavioral implicit communication (BIC): Communicating with smart environments. Innovative Applications of Ambient Intelligence: Advances in Smart Systems: Advances in Smart Systems (2012), 1.

[19]

Joyce Yue Chai, Zahar Prasov, and Shaolin Qu. 2006. Cognitive principles in robust multimodal interpretation. Journal of Artificial Intelligence Research 27 (2006), 55--83.

Digital Library

[20]

Huo-Tsan Chang, Cheng-Chen Lin, Cheng-Hung Chen, and Yeong-Ho Ho. 2017. Explicit and implicit team coordination: Development of a multidimensional scale. Social Behavior and Personality: an international journal 45, 6 (2017), 915--929.

[21]

Eugene Charniak and Robert Goldman. 1991. A probabilistic model of plan recognition. In Proceedings of the Ninth National Conference on Artificial Intelligence, Vol. 1. AAAI Press, 160--165.

Digital Library

[22]

Philip R Cohen and Hector J Levesque. 1991. Teamwork. Nous 25, 4 (1991), 487--512.

[23]

Christopher Cox, Jessica de Silva, Philip Deorsey, Franklin H. J. Kenter, Troy Retter, and Josh Tobin. 2015. How to make the perfect fireworks display: Two strategies for Hanabi. Mathematics Magazine 88 (2015), 323--336.

[24]

G. Csibra and G. Gergely. 2007. 'Obsessed with goals': Functions and mechanisms of teleological interpretation of actions in humans. Acta Psychologica 124, 1 (2007), 60--78.

[25]

Anca D Dragan, Kenton CT Lee, and Siddhartha S Srinivasa. 2013. Legibility and predictability of robot motion. In Human-Robot Interaction (HRI), 2013 8th ACM/IEEE International Conference on. IEEE, 301--308.

Digital Library

[26]

Markus Eger, Chris Martens, and Marcela Alfaro Córdoba. 2017. An intentional AI for Hanabi. In CIG 2017.

[27]

Elliot E. Entin and Daniel Serfaty. 1999. Adaptive Team Coordination. Human Factors 41, 2 (1999), 312--325.

[28]

Olivier Fischer, Ashok Goel, John R Svirbely, and Jack W Smith. 1991. The role of essential explanation in abduction. Artificial Intelligence in Medicine 3, 4 (1991), 181--191.

Digital Library

[29]

Rachel Gockley, Reid Simmons, and Jodi Forlizzi. 2006. Modeling affect in socially interactive robots. In Robot and Human Interactive Communication, 2006. ROMAN 2006. The 15th IEEE International Symposium on. IEEE, 558--563. CHI '19, May 2019, Glasgow, UK Claire Liang, Julia Proft, Erik Andersen, and Ross A. Knepper

[30]

Ashok K Goel, John R Josephson, Olivier Fischer, and P Sadayappan. 1995. Practical abduction: Characterization, decomposition and concurrency. Journal of Experimental & Theoretical Artificial Intelligence 7, 4 (1995), 429--450.

[31]

Noah D Goodman and Andreas Stuhlmüller. 2013. Knowledge and implicature: Modeling language understanding as social cognition. Topics in Cognitive Science 5, 1 (2013), 173--184.

[32]

Thore Graepel, Ralf Herbrich, and Julian Gold. 2004. Learning to fight. In Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education. 193--200.

[33]

Herbert P Grice. 1975. Logic and conversation. Syntax and Semantics (1975), 41--58.

[34]

H Paul Grice. 1978. Further notes on logic and conversation. 1978 1 (1978), 13--128.

[35]

Julia Linn Bell Hirschberg. 1985. A theory of scalar implicature. University of Pennsylvania.

[36]

Jerry R Hobbs, Mark E Stickel, Douglas E Appelt, and Paul Martin. 1993. Interpretation as abduction. Artificial Intelligence 63, 1--2 (1993), 69--142.

Digital Library

[37]

Laurence Horn. 1984. Toward a new taxonomy for pragmatic inference: Q-based and R-based implicature. Meaning, Form, and Use in Context: Linguistic Applications (1984), 11--42.

[38]

Laurence R. Horn. 2004. Implicature. In The Handbook of Pragmatics, Laurence R. Horn and Gregory Ward (Eds.). Blackwell, Oxford, 3--28.

[39]

Julian Hough and David Schlangen. 2017. A model of continuous intention grounding for HRI. (2017).

[40]

Sandy H Huang, David Held, Pieter Abbeel, and Anca D Dragan. 2017. Enabling robots to communicate their objectives. Autonomous Robots (2017), 1--18.

Digital Library

[41]

John R Josephson, B Chandrasekaran, Jack W Smith, and Michael C Tanner. 1987. A mechanism for forming composite explanatory hypotheses. IEEE Transactions on Systems, Man, and Cybernetics 17, 3 (1987), 445--454.

[42]

Malte F Jung. 2017. Affective grounding in human-robot interaction. In Proceedings of the 2017 ACM/IEEE International Conference on HumanRobot Interaction. ACM, 263--273.

Digital Library

[43]

Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra. 1998. Planning and acting in partially observable stochastic domains. Artificial intelligence 101, 1 (1998), 99--134.

Digital Library

[44]

Edward C Kaiser. 2013. Systems and methods for implicitly interpreting semantically redundant communication modes. US Patent 8,457,959.

[45]

Gabriele Kasper. 1997. Can pragmatic competence be taught? http://www.nflrc.hawaii.edu/NetWorks/NW06/ (1997).

[46]

Sara Kiesler. 2005. Fostering common ground in human-robot interaction. In Robot and Human Interactive Communication, 2005. ROMAN 2005. IEEE International Workshop on. IEEE, 729--734.

[47]

Young Ji Kim, David Engel, Anita Williams Woolley, Jeffrey Yu-Ting Lin, Naomi McArthur, and Thomas W Malone. 2017. What makes a strong team?: Using collective intelligence to predict team performance in League of Legends. In CSCW. 2316--2329.

Digital Library

[48]

Ross A Knepper, Christoforos I Mavrogiannis, Julia Proft, and Claire Liang. 2017. Implicit communication in a joint action. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 283--292.

Digital Library

[49]

Ross A Knepper, Stefanie Tellex, Adrian Li, Nicholas Roy, and Daniela Rus. 2015. Recovering from failure by asking for help. Autonomous Robots 39, 3 (2015), 347--362.

Digital Library

[50]

Hector J Levesque. 1989. A knowledge-level account of abduction. In Proceedings of the 11th International Joint Conference on Artificial Intelligence, Vol. 2. Morgan Kaufmann Publishers Inc., 1061--1067.

Digital Library

[51]

Stephen C Levinson. 2000. Presumptive meanings: The theory of generalized conversational implicature. MIT Press.

Digital Library

[52]

Claire Liang, Julia Proft, and Ross A Knepper. 2017. Implicature-based inference for socially-fluent robotic teammates. (2017).

[53]

Victor Ei-Wen Lo and Paul A Green. 2013. Development and evaluation of automotive speech interfaces: useful information from the human factors and the related literature. International Journal of Vehicular Technology 2013 (2013).

[54]

Derek Lomas, Kishan Patel, Jodi L Forlizzi, and Kenneth R Koedinger. 2013. Optimizing challenge in an educational game using large-scale design experiments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 89--98.

Digital Library

[55]

J Derek Lomas, Kenneth Koedinger, Nirmal Patel, Sharan Shodhan, Nikhil Poonwala, and Jodi L Forlizzi. 2017. Is difficulty overrated?: The effects of choice, novelty and suspense on intrinsic motivation in educational games. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1028--1039.

Digital Library

[56]

Christoforos I Mavrogiannis, Valts Blukis, and Ross A Knepper. 2017. Socially competent navigation planning by deep learning of multiagent path topologies. In Intelligent Robots and Systems (IROS), 2017 IEEE/RSJ International Conference on. IEEE, 6817--6824.

[57]

Randolph A Miller, Harry E Pople Jr, and Jack D Myers. 1982. INTERNIST-I, an experimental computer-based diagnostic consultant for general internal medicine. New England Journal of Medicine 307, 8 (1982), 468--476.

[58]

Charles G Morgan. 1971. Hypothesis generation by machine. Artificial Intelligence 2, 2 (1971), 179--187.

[59]

Stefanos Nikolaidis, David Hsu, and Siddhartha Srinivasa. 2017. Human-robot mutual adaptation in collaborative tasks: Models and experiments. The International Journal of Robotics Research (2017), 0278364917690593.

Digital Library

[60]

Hirotaka Osawa. 2015. Solving Hanabi: Estimating hands by opponent's actions in cooperative game with incomplete information. In Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence.

[61]

Lynne E Parker. 2000. Current state of the art in distributed autonomous mobile robotics. In Distributed Autonomous Robotic Systems 4. Springer, 3--12.

[62]

Charles S. Peirce. 1901. The proper treatment of hypotheses: A preliminary chapter, toward an examination of Hume's argument against miracles, in its logic and in its history. MS {R} 692. (1901).

[63]

Yun Peng and James A Reggia. 1990. Abductive inference models for diagnostic problem-solving. Springer.

Digital Library

[64]

André Pereira, Rui Prada, and Ana Paiva. 2012. Socially present board game opponents. In Advances in Computer Entertainment. Springer, 101--116.

Digital Library

[65]

Harry E Pople. 1973. On the mechanization of abductive logic. In Proceedings of the 3rd International Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers Inc., 147--152.

Digital Library

[66]

Harry E Pople, Jack D Myers, and Randolph A Miller. 1975. DIALOG: A model of diagnostic logic for internal medicine. In Proceedings of the 4th International Joint Conference on Artificial Intelligence, Vol. 1. Morgan Kaufmann Publishers Inc., 848--855.

Digital Library

[67]

Christopher Potts. 2015. Presupposition and implicature. In The Handbook of Contemporary Semantic Theory, Shalom Lappin and Chris Fox (Eds.). John Wiley & Sons, Chapter 6.

[68]

Zahar Prasov and Joyce Y Chai. 2008. What's in a gaze?: The role of eyegaze in reference resolution in multimodal conversational interfaces. In Proceedings of the 13th International Conference on Intelligent User Interfaces. ACM, 20--29.

Digital Library

[69]

François Recanati. 2001. What is said. Synthese 128, 1 (2001), 75--91.

[70]

Melissa J Rogerson, Martin R Gibbs, and Wally Smith. 2017. What can we learn from eye tracking boardgame play?. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction Implicit Communication of Actionable Information in Human-AI teams CHI '19, May 2019, Glasgow, UK in Play. ACM, 519--526.

Digital Library

[71]

Melissa J Rogerson, Martin R Gibbs, and Wally Smith. 2018. Cooperating to compete: The mutuality of cooperation and competition in boardgame play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 193.

Digital Library

[72]

Benjamin Russell. 2012. Probabilistic reasoning and the computation of scalar implicatures. Unpublished doctoral dissertation, Brown University (2012).

[73]

Albrecht Schmidt. 2000. Implicit human computer interaction through context. Personal Technologies 4, 2--3 (2000), 191--199.

[74]

Alessandra Sciutti, Ambra Bisio, Francesco Nori, Giorgio Metta, Luciano Fadiga, and Giulio Sandini. 2013. Robots can be perceived as goal-oriented agents. Interaction Studies 14, 3 (2013), 329--350.

[75]

Alessandra Sciutti, Laura Patane, Francesco Nori, and Giulio Sandini. 2014. Understanding object weight from human and humanoid lifting actions. IEEE Transactions on Autonomous Mental Development 6, 2 (2014), 80--92.

Digital Library

[76]

Yasaman S Sefidgar, Prerna Agarwal, and Maya Cakmak. 2017. Situated tangible robot programming. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 473--482.

Digital Library

[77]

Mei Si, Stacy C. Marsella, and David V. Pynadath. 2009. Modeling appraisal in theory of mind reasoning. Autonomous Agents and MultiAgent Systems 20, 1 (10 May 2009), 14.

Digital Library

[78]

David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al. 2016. Mastering the game of Go with deep neural networks and tree search. nature 529, 7587 (2016), 484.

[79]

David Silver and Joel Veness. 2010. Monte-Carlo planning in large POMDPs. In Advances in Neural Information Processing Systems 23, J. D. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. S. Zemel, and A. Culotta (Eds.). Curran Associates, Inc., 2164--2172. http://papers.nips.cc/paper/ 4031-monte-carlo-planning-in-large-pomdps.pdf

Digital Library

[80]

Karin Slegers, Sanne Ruelens, Jorick Vissers, and Pieter Duysburgh. 2015. Using game principles in UX research: A board game for eliciting future user needs. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1225--1228.

Digital Library

[81]

Jack W Smith, John R Svirbely, Charles A Evans, Pat Strohm, John R Josephson, and Mike Tanner. 1985. RED: A red-cell antibody identification expert module. Journal of Medical Systems 9, 3 (1985), 121--138.

[82]

Mark E Stickel. 1990. Rationale and methods for abductive reasoning in natural-language interpretation. In Natural Language and Logic. Springer, 233--252.

Digital Library

[83]

Mark JH van den Bergh, Anne Hommelberg, Walter A Kosters, and Flora M Spieksma. 2016. Aspects of the cooperative card game Hanabi. In Benelux Conference on Artificial Intelligence. Springer, 93--105.

[84]

Adam Vogel, Christopher Potts, and Dan Jurafsky. 2013. Implicatures and nested beliefs in approximate decentralized-POMDPs. In ACL (2). 74--80.

[85]

Annika Wærn. 1994. Plan inference for a purpose. In Proceedings of the Fourth International Conference on User Modeling. 93--98.

[86]

Joseph Walton-Rivers, Piers R. Williams, Richard Bartle, Diego Perez Liebana, and Simon M. Lucas. 2017. Evaluating and modelling Hanabiplaying agents. CoRR abs/1704.07069 (2017). http://arxiv.org/abs/1704. 07069

[87]

Deirdre Wilson and Dan Sperber. 1981. On Grice's theory of conversation. Conversation and discourse (1981), 155--78.

[88]

Jason Wuertz, Sultan A Alharthi, William A Hamilton, Scott Bateman, Carl Gutwin, Anthony Tang, Zachary Toups, and Jessica Hammer. 2018. A design framework for awareness cues in distributed multiplayer games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 243.

Digital Library

[89]

Taoshuai Zhang, Jie Liu, and Yuanchun Shi. 2012. Enhancing collaboration in tabletop board game. In Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction. ACM, 7--10.

Digital Library

[90]

Shengdong Zhao, Koichi Nakamura, Kentaro Ishii, and Takeo Igarashi. 2009. Magic cards: A paper tag interface for implicit robot control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 173--182.

Digital Library

[91]

Wenjun Zhou, Wangcheng Yan, and Xi Zhang. 2017. Collaboration for success in crowdsourced innovation projects: Knowledge creation, team diversity, and tacit coordination. In Proceedings of the 50th Hawaii International Conference on System Sciences.

Cited By

Briseno JParać RArdon LVilamala MFurelos-Blanco DKaplan LMishra VCerutti FPreece ARusso ASrivastava M(2024)TeamCollab: A Framework for Collaborative Perception-Cognition-Communication-Action2024 27th International Conference on Information Fusion (FUSION)10.23919/FUSION59988.2024.10706435(1-8)Online publication date: 8-Jul-2024
https://doi.org/10.23919/FUSION59988.2024.10706435
Zhang RDuan WFlathmann CMcNeese NKnijnenburg BFreeman G(2024)Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team CompositionsProceedings of the ACM on Human-Computer Interaction10.1145/36869768:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686976
Attig CWollstadt PSchrills TFranke TWiebel-Herboth C(2024)More than Task Performance: Developing New Criteria for Successful Human-AI Teaming Using the Cooperative Card Game HanabiExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650853(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650853
Show More Cited By

Index Terms

Implicit Communication of Actionable Information in Human-AI teams
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing
  2. Human computer interaction (HCI)

Recommendations

Action-a-Bot: Exploring Human-Chatbot Conversations for Actionable Instruction Giving and Following
CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing

Conversation serves as one critical mechanism for knowledge-sharing and instruction-giving in collaborative work. Conversation allows people to take turns to make contributions, plan joint actions, align shared understanding of work status and resolve ...
Cognitive and Emotional Characteristics of Communication in Human-Human/Human-Agent Interaction
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction

A psychological experiment was conducted to capture the nature of Human-Human and Human-Agent Interactions where humans and computer agents coexist in a collaborative environment. Two factors were manipulated to investigate the influences of the 'schema'...
Entrainment in Human-Agent Text Communication
Agent Computing and Multi-Agent Systems

Non-verbal information such as utterance speed and switching pause create an impression of the speaker. If intelligent agents could handle such non-verbal information properly, the quality of interactions between agents and human users would improve. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

Office of Naval Research

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
3,255
Total Downloads

Downloads (Last 12 months)776
Downloads (Last 6 weeks)107

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Briseno JParać RArdon LVilamala MFurelos-Blanco DKaplan LMishra VCerutti FPreece ARusso ASrivastava M(2024)TeamCollab: A Framework for Collaborative Perception-Cognition-Communication-Action2024 27th International Conference on Information Fusion (FUSION)10.23919/FUSION59988.2024.10706435(1-8)Online publication date: 8-Jul-2024
https://doi.org/10.23919/FUSION59988.2024.10706435
Zhang RDuan WFlathmann CMcNeese NKnijnenburg BFreeman G(2024)Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team CompositionsProceedings of the ACM on Human-Computer Interaction10.1145/36869768:CSCW2(1-34)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686976
Attig CWollstadt PSchrills TFranke TWiebel-Herboth C(2024)More than Task Performance: Developing New Criteria for Successful Human-AI Teaming Using the Cooperative Card Game HanabiExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650853(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650853
Kim SEun JOh CLee J(2024)“Journey of Finding the Best Query”: Understanding the User Experience of AI Image Generation SystemInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2307670(1-19)Online publication date: 2-Feb-2024
https://doi.org/10.1080/10447318.2024.2307670
Shi YGao TJiao XCao N(2023)Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36102177:CSCW2(1-35)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610217
Zhang RDuan WFlathmann CMcNeese NFreeman GWilliams A(2023)Investigating AI Teammate Communication Strategies and Their Impact in Human-AI Teams for Effective TeamworkProceedings of the ACM on Human-Computer Interaction10.1145/36100727:CSCW2(1-31)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610072
Momose KWeekes TMehta RWright CMoukpe JEskridge T(2023)Patterns of Effective Human-Agent TeamsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585608(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585608
Chu MZong KShu XGong JLu ZGuo KDai XZhou G(2023)Work with AI and Work for AI: Autonomous Vehicle Safety Drivers’ Lived ExperiencesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581564(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581564
Sidji MSmith WRogerson M(2023)The Hidden Rules of Hanabi: How Humans Outperform AI AgentsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581550(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581550
He ZSong YZhou SCai Z(2023)Interaction of Thoughts: Towards Mediating Task Assignment in Human-AI Cooperation with a Capability-Aware Shared Mental ModelProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580983(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580983
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents