research-article

Team reactions to voiced agent instructions in a pervasive game

Authors:

Khaled Bachour,

Joel E. Fischer,

Martin Flintham,

Simon JohnsonAuthors Info & Claims

IUI '13: Proceedings of the 2013 international conference on Intelligent user interfaces

Pages 371 - 382

https://doi.org/10.1145/2449396.2449445

Published: 19 March 2013 Publication History

Abstract

The assumed role of humans as controllers and instructors of machines is changing. As systems become more complex and incomprehensible to humans, it will be increasingly necessary for us to place confidence in intelligent interfaces and follow their instructions and recommendations. This type of relationship becomes particularly intricate when we consider significant numbers of humans and agents working together in collectives. While instruction-based interfaces and agents already exist, our understanding of them within the field of Human-Computer Interaction is still limited.

As such, we developed a large-scale pervasive game called 'Cargo', where a semi-autonomous ruled-based agent distributes a number of text-to-speech instructions to multiple teams of players via their mobile phone as an interface. We describe how people received, negotiated and acted upon the instructions in the game both individually and as a team and how players initial plans and expectations shaped their understanding of the instructions.

References

[1]

Ball, M. and Callaghan, V. Introducing Intelligent Environments, Agents and Autonomy to Users. Proceedings of the 7th International Conference on Intelligent Environments (IE '11), (2011), 382--385.

Digital Library

[2]

Benford, S., Magerkurth, C., and Ljungstrand, P. Bridging the physical and digital in pervasive gaming. Communications of the ACM (CACM ) 48, 3 (2005), 54--57.

Digital Library

[3]

Benotti, L. and Denis, A. Giving instructions in virtual environments by corpus based selection. Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL '11), (2011), 68--77.

Digital Library

[4]

Bulitko, V. V. and Wilkins, D. C. Automated Instructor Assistant for Ship Damage Control. Proceedings of the Sixteenth National Conference on Artificial Intelligence and the Eleventh Innovative Applications of Artificial Intelligence Conference Innovative Applications of Artificial Intelligence AAAI '99/IAAI '99, (1999), 778--785.

Digital Library

[5]

Chan, V., Ray, P., and Parameswaran, N. Mobile e-Health monitoring: an agent-based approach. IET Communications 2, 2 (2008), 223--230.

[6]

Christoffersen, K. and Woods, D. D. How to make automated systems team players. Advances in human performance and cognitive engineering research 2, (2002), 1--12.

[7]

Cuevas, H. M., Fiore, S. M., Caldwell, B. S., and Strater, L. Augmenting Team Cognition in Human-Automation Teams Performing in Complex Operational Environments. Aviation, Space, and Environmental Medicine 78, 1 (2007), B63--B70(8).

[8]

Doswell, J. and Harmeyer, K. Extending the 'Serious Game' Boundary: Virtual Instructors in Mobile Mixed Reality Learning Games. Proceedings of the Digital Games Research Association International Conference (DiGRA 2007), (2007), 524--529.

[9]

Fiore, S. M., Salas, E., Cuevas, H. M., and Bowers, C. A. Distributed coordination space: Toward a theory of distributed team process and performance. Theoretical Issues in Ergonomics Science 4, 3-4 (2003), 340--364.

[10]

Fischer, J., Jiang, W., and Moran, S. AtomicOrchid: A Mixed Reality Game to Investigate Coordination in Disaster Response. In Mobile Gaming Workshop (MOGA) 2012 as a part of Proceedings of the 11th International Conference on Entertainment Computing (ICEC 2012), (2012), 572--577.

Digital Library

[11]

Fischer, J. E., Flintham, M., Price, D., Goulding, J., Pantidi, N., and Rodden, T. Serious Mixed Reality Games. In Proceedings of Mixed-Reality Games Workshop as a part of the International Conference on Computer Supported Cooperative Work (CSCW'12), (2012).

[12]

Hexmoor, H. and Heng, T. Air Traffic Control Agents: Landing and Collision Avoidance. Proceedings of International Conference in Artificial Intelligence, (IC-AI '00), (2000).

[13]

Heylen, D., Nijholt, A., op den Akker, R., and Vissers, M. Socially Intelligent Tutor Agents. Proceedings of Intelligent Virtual Agents (IVA '03), Lecture Notes in Artificial Intelligence (2003), 341--347.

[14]

Koschmann, T., LeBaron, C., Goodwin, C., and Feltovich, P. The mystery of the missing referent: objects, procedures, and the problem of the instruction follower. Proceedings of the 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06), ACM New York, NY, USA (2006), 373--382.

Digital Library

[15]

Maes, P. Agents that reduce work and information overload. Communications of the ACM 37, 7 (2007), 30--40.

Digital Library

[16]

McGrath, S., Chacón, D., and Whitebread, K. Intelligent Mobile Agents in Military Command and Control. Proceedings of the Autonomous Agents Workshop on Agents in Industry, (2000).

[17]

Milgram, S. Obedience to Authority: An Experimental View. Harper Perennial Modern Classics, 2009.

[18]

Mittrup, I., Smarsly, K., Hartmann, D., and Bettzieche, V. An Agent-Based Approach to Dam Monitoring. Proceedings of the 20th CIB W78 Conference on Information Technology in Construction., (2003), 239--246.

[19]

Murata, K., Enomoto, M., Arimoto, Y., and Nakano, Y. When Should Animated Agents Give Additional Instructions to Users? - Monitoring User's Understanding in Multimodal Dialogues. International Conference on Control, Automation and Systems, ICCAS '07, (2007), 733--736.

[20]

Murthy, S., Akkiraju, R., Rachlin, J., and Wu, F. Agent-Based Cooperative Scheduling. Proceedings of AAAI Workshop on Constraints and Agents, AAAI Press (1997), 112--117.

[21]

Norman, D. A. The 'problem' with automation: inappropriate feedback and interaction, nou 'over-automation'. Philosophical Transactions of the Royal Society of London. B 327, 1241 (1990), 585--593.

[22]

Pacaux-Lemoine, M.-P. and Debernard, S. Common work space for human-machine cooperation in air traffic control. Control Engineering Practice 10, 5 (2002), 571--576.

[23]

Schaafstal, A. M., Johnston, J. H., and Oser, R. L. Training teams for emergency management. Computers in Human Behavior 17, 5-6 (2001), 615--626.

[24]

Suchman, L. A. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, 1999.

[25]

Sukthankar, G., Shumaker, R., and Lewis, M. Intelligent Agents as Teammates. In Eduardo Salas, S. M. Fiore and M. P. Letsky, eds., Theories of Team Cognition: Cross-Disciplinary Perspectives. 2012, 313--343.

[26]

Tolmie, P., Benford, S., Flintham, M., et al. "Act Natural": Instructions, Compliance and Accountability in Ambulatory Experiences. CHI '12 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2012), 1519--1528.

Digital Library

[27]

Traum, D., Rickel, J., Gratch, J., and Marsella, S. Negotiating over Tasks in Hybrid Human-Agent Teams for Simulation-Based Training. Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS '03 ), ACM New York, NY, USA (2003), 441--448.

Digital Library

[28]

Woods, D. D. Human-centered software agents: Lessons from clumsy automation. In S. J. Flanagan, T. Huang, P. Jones, & S. Kasif, ed., Human centered systems: Information, interactivity, and in. Washington, DC: National Science Foundation, 1997, 288--293.

[29]

http://cars.uk.msn.com/features/sat-nav-catastrophes Accessed on 09/01/2013.

[30]

http://www.phidgets.com Accessed on 09/01/2013.

[31]

http://slingshoteffect.co.uk/ Accessed on 09/01/2013.

[32]

http://igfest.org/ Accessed on 09/01/2013.

Cited By

Judkins JHwang YKim S(2024)Human-AI interaction: Augmenting decision-making for IT leader's project selectionInformation Development10.1177/02666669241249744Online publication date: 21-May-2024
https://doi.org/10.1177/02666669241249744
Regenbrecht HKnott AFerreira JPantidi N(2024)To See and be Seen—Perceived Ethics and Acceptability of Pervasive Augmented RealityIEEE Access10.1109/ACCESS.2024.336622812(32618-32636)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3366228
Amaro IDella Greca AFrancese RTortora GTucci C(2023)AI Unreliable Answers: A Case Study on ChatGPTArtificial Intelligence in HCI10.1007/978-3-031-35894-4_2(23-40)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35894-4_2
Show More Cited By

Recommendations

The art of game-mastering pervasive games
ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology

Pervasive Games can benefit greatly from being game-mastered rather than fully automatic. However, game-mastering pervasive games is not a simple task neither from a technical nor a game design perspective.

In this article we discuss some of the core ...
Experimental investigation of human adaptation to change in agent's strategy through a competitive two-player game
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We conducted an experimental investigation on human adaptation to change in an agent's strategy through a competitive two-player game. Modeling the process of human adaptation to agents is important for designing intelligent interface agents and ...
Blending history and fiction in a pervasive game prototype
MUM '14: Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia

Pervasive games represent an exciting development in gaming which leverages the use of sensor, visualization and networking technologies to provide immerse live-action game experiences. The field of pervasive games has been intensively researched in the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '13: Proceedings of the 2013 international conference on Intelligent user interfaces

March 2013

470 pages

ISBN:9781450319652

DOI:10.1145/2449396

General Chair:
Jihie Kim
University of Southern California, USA
,
Program Chairs:
Jeffrey Nichols
IBM Research -- Almaden, USA
,
Pedro Szekely
University of Southern California, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 March 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUI '13

Sponsor:

IUI '13: 18th International Conference on Intelligent User Interfaces

March 19 - 22, 2013

California, Santa Monica, USA

Acceptance Rates

IUI '13 Paper Acceptance Rate 43 of 192 submissions, 22%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
348
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Judkins JHwang YKim S(2024)Human-AI interaction: Augmenting decision-making for IT leader's project selectionInformation Development10.1177/02666669241249744Online publication date: 21-May-2024
https://doi.org/10.1177/02666669241249744
Regenbrecht HKnott AFerreira JPantidi N(2024)To See and be Seen—Perceived Ethics and Acceptability of Pervasive Augmented RealityIEEE Access10.1109/ACCESS.2024.336622812(32618-32636)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3366228
Amaro IDella Greca AFrancese RTortora GTucci C(2023)AI Unreliable Answers: A Case Study on ChatGPTArtificial Intelligence in HCI10.1007/978-3-031-35894-4_2(23-40)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35894-4_2
Haring KSatterfield KTossell Cde Visser ELyons JMancuso VFinomore VFunke G(2021)Robot Authority in Human-Robot Teaming: Effects of Human-Likeness and Physical Embodiment on ComplianceFrontiers in Psychology10.3389/fpsyg.2021.62571312Online publication date: 31-May-2021
https://doi.org/10.3389/fpsyg.2021.625713
Jaber RMcMillan DTorres MSchlögl SClark LPorcheron M(2020)Conversational User Interfaces on Mobile DevicesProceedings of the 2nd Conference on Conversational User Interfaces10.1145/3405755.3406130(1-11)Online publication date: 22-Jul-2020
https://dl.acm.org/doi/10.1145/3405755.3406130
Fuentes CPorcheron MFischer JCostanza EMalilk ORamchurn SBrewster SFitzpatrick GCox AKostakos V(2019)Tracking the Consumption of Home EssentialsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300869(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300869
Wynne KLyons J(2018)An integrative model of autonomous agent teammate-likenessTheoretical Issues in Ergonomics Science10.1080/1463922X.2016.126018119:3(353-374)Online publication date: 23-Feb-2018
https://doi.org/10.1080/1463922X.2016.1260181
Tintarev NO'donovan JFelfernig A(2016)Introduction to the Special Issue on Human Interaction with Artificial Advice GiversACM Transactions on Interactive Intelligent Systems10.1145/30144326:4(1-12)Online publication date: 26-Dec-2016
https://dl.acm.org/doi/10.1145/3014432
Clark LOfemile AAdolphs SRodden T(2016)A Multimodal Approach to Assessing User Experiences with Agent HelpersACM Transactions on Interactive Intelligent Systems10.1145/29839266:4(1-31)Online publication date: 19-Nov-2016
https://dl.acm.org/doi/10.1145/2983926
Sutherland SHarteveld CYoung M(2016)Effects of the Advisor and Environment on Requesting and Complying With Automated AdviceACM Transactions on Interactive Intelligent Systems10.1145/29053706:4(1-36)Online publication date: 7-Nov-2016
https://dl.acm.org/doi/10.1145/2905370
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten