short-paper

Public Access

Competitive Physical Human-Robot Game Play

Authors:

Joshua R. SmithAuthors Info & Claims

HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

Pages 242 - 246

https://doi.org/10.1145/3434074.3447168

Published: 08 March 2021 Publication History

Abstract

While competitive games have been studied extensively in the AI community for benchmarking purposes, there has only been limited discussion of human interaction with embodied agents under competitive settings. In this work, we aim to motivate research in competitive human-robot interaction (competitive-HRI) by discussing how human users can benefit from robot competitors. We then examine the concepts from game AI that we can adopt for competitive-HRI. Based on these discussions, we propose a robotic system that is designed to support future competitive-HRI research. A human-robot fencing game is also proposed to evaluate a robot's capability in competitive-HRI scenarios. Finally, we present the initial experimental results and discuss possible future research directions.

References

[1]

Trapit Bansal, Jakub Pachocki, Szymon Sidor, Ilya Sutskever, and Igor Mordatch. 2017. Emergent complexity via multi-agent competition. arXiv preprint arXiv:1710.03748 (2017).

[2]

Tapomayukh Bhattacharjee, Ethan K Gordon, Rosario Scalise, Maria E Cabrera, Anat Caspi, Maya Cakmak, and Siddhartha S Srinivasa. 2020. Is More Autonomy Always Better? Exploring Preferences of Users with Mobility Impairments in Robot-assisted Feeding. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 181--190.

Digital Library

[3]

Murray Campbell, A Joseph Hoane Jr, and Feng-hsiung Hsu. 2002. Deep blue. Artificial intelligence 134, 1--2 (2002), 57--83.

[4]

Min Chen, Stefanos Nikolaidis, Harold Soh, David Hsu, and Siddhartha Srinivasa. 2020. Trust-aware decision making for human-robot collaboration: Model learning and planning. ACM Transactions on Human-Robot Interaction (THRI) 9, 2 (2020), 1--23.

Digital Library

[5]

Aaron Edsinger and Charles C Kemp. 2007. Human-robot interaction for cooperative manipulation: Handing objects to one another. In RO-MAN 2007-The 16th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 1167--1172.

[6]

Juan Fasola and Maja J Mataric. 2010. Robot exercise instructor: A socially assistive robot system to monitor and encourage physical exercise for the elderly. In 19th International Symposium in Robot and Human Interactive Communication. IEEE, 416--421.

[7]

Deborah L Feltz, Samuel T Forlenza, Brian Winn, and Norbert L Kerr. 2014. Cyber buddy is better than no buddy: A test of the Köhler motivation effect in exergames. GAMES FOR HEALTH: Research, Development, and Clinical Applications 3, 2 (2014), 98--105.

[8]

Jakob N Foerster, Richard Y Chen, Maruan Al-Shedivat, Shimon Whiteson, Pieter Abbeel, and Igor Mordatch. 2017. Learning with opponent-learning awareness. arXiv preprint arXiv:1709.04326 (2017).

[9]

He He, Jordan Boyd-Graber, Kevin Kwok, and Hal Daumé III. 2016. Opponent modeling in deep reinforcement learning. In International conference on machine learning. 1804--1813.

Digital Library

[10]

Suzanne Hidi and K Ann Renninger. 2006. The four-phase model of interest development. Educational psychologist 41, 2 (2006), 111--127.

[11]

W Daniel Hillis. 1990. Co-evolving parasites improve simulated evolution as an optimization procedure. Physica D: Nonlinear Phenomena 42, 1--3 (1990), 228--234.

Digital Library

[12]

Alap Kshirsagar, Bnaya Dreyfuss, Guy Ishai, Ori Heffetz, and Guy Hoffman. 2019. Monetary-incentive competition between humans and robots: experimental results. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 95--103.

[13]

Rui Li, Marc van Almkerk, Sanne van Waveren, Elizabeth Carter, and Iolanda Leite. 2019. Comparing human-robot proxemics between virtual reality and the real world. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 431--439.

[14]

Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015).

[15]

Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. In Advances in neural information processing systems. 6379--6390.

Digital Library

[16]

Ruikun Luo, Rafi Hayne, and Dmitry Berenson. 2018. Unsupervised early prediction of human reaching for human--robot collaboration in shared workspaces. Autonomous Robots 42, 3 (2018), 631--648.

Digital Library

[17]

Elias Matsas and George-Christopher Vosniakos. 2017. Design of a virtual reality training system for human--robot collaboration in manufacturing tasks. International Journal on Interactive Design and Manufacturing (IJIDeM) 11, 2 (2017), 139--153.

[18]

Bilge Mutlu, Steven Osman, Jodi Forlizzi, Jessica Hodgins, and Sara Kiesler. 2006. Perceptions of ASIMO: an exploration on co-operation and competition with humans and humanoid robots. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. 351--352.

Digital Library

[19]

Lerrel Pinto, James Davidson, Rahul Sukthankar, and Abhinav Gupta. 2017. Robust adversarial reinforcement learning. arXiv preprint arXiv:1703.02702 (2017).

[20]

Jan L Plass, Paul A O'Keefe, Bruce D Homer, Jennifer Case, Elizabeth O Hayward, Murphy Stein, and Ken Perlin. 2013. The impact of individual, competitive, and collaborative mathematics game play on learning, performance, and motivation. Journal of educational psychology 105, 4 (2013), 1050.

[21]

Katie Salen, Katie Salen Tekinba?, and Eric Zimmerman. 2004. Rules of play: Game design fundamentals. MIT press.

[22]

Kosuke Sato, KeitaWatanabe, Shuichi Mizuno, Masayoshi Manabe, Hiroaki Yano, and Hiroo Iwata. 2017. Development of a block machine for volleyball attack training. In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1036--1041.

Digital Library

[23]

Jonathan Schaeffer, Neil Burch, Yngvi Björnsson, Akihiro Kishimoto, Martin Müller, Robert Lake, Paul Lu, and Steve Sutphen. 2007. Checkers is solved. science 317, 5844 (2007), 1518--1522.

[24]

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).

[25]

Elaine Short, Justin Hart, Michelle Vu, and Brian Scassellati. 2010. No fair!! an interaction with a cheating robot. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 219--226.

[26]

David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, et al. 2018. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science 362, 6419 (2018), 1140--1144.

[27]

David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, et al. 2017. Mastering the game of go without human knowledge. nature 550, 7676 (2017), 354--359.

[28]

Kenneth O Stanley and Risto Miikkulainen. 2004. Competitive coevolution through evolutionary complexification. Journal of artificial intelligence research 21 (2004), 63--100.

Digital Library

[29]

Luise Süssenbach, Nina Riether, Sebastian Schneider, Ingmar Berger, Franz Kummert, Ingo Lütkebohle, and Karola Pitsch. 2014. A robot as fitness companion: towards an interactive action-based motivation model. In The 23rd IEEE international symposium on robot and human interactive communication. IEEE, 286--293.

[30]

Ardi Tampuu, Tambet Matiisen, Dorian Kodelja, Ilya Kuzovkin, Kristjan Korjus, Juhan Aru, Jaan Aru, and Raul Vicente. 2017. Multiagent cooperation and competition with deep reinforcement learning. PloS one 12, 4 (2017), e0172395.

[31]

M Viru, Anthony Hackney, K Karelson, T Janson, M Kuus, and A Viru. 2010. Competition effects on physiological responses to exercise: performance, cardiorespiratory and hormonal factors. Acta Physiologica Hungarica 97, 1 (2010), 22--30.

Cited By

Roesler EWinhold LOnnasch LGrollman DBroadbent EJu WSoh HWilliams T(2024)Compete, Cooperate, or Both? Exploring How Interaction Settings Shape Human-Robot InteractionCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640587(901-905)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640587
Mahdi HJouaiti MSaleh SDautenhahn K(2024)Towards accessible robot-assisted physical play for children with physical disabilitiesInteraction Studies. Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies / Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies10.1075/is.00023.mah25:1(36-69)Online publication date: 7-Jun-2024
https://doi.org/10.1075/is.00023.mah
Memarian BDoleck T(2024)Embodied AI in education: A review on the body, environment, and mindEducation and Information Technologies10.1007/s10639-023-12346-829:1(895-916)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s10639-023-12346-8
Show More Cited By

Index Terms

Competitive Physical Human-Robot Game Play

Recommendations

Preliminary Interactions of Human-Robot Trust, Cognitive Load, and Robot Intelligence Levels in a Competitive Game
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

This paper presents a pilot study in which we examine the interactions between human-robot teammate trust, cognitive load, and robot intelligence levels. In particular, we attempt to assess these interactions during a competitive game of capture the ...
Robot to Play Video Games Together
HAI '23: Proceedings of the 11th International Conference on Human-Agent Interaction

This study proposes a communication robot that plays video games together with the user to create a fun atmosphere for a daily-use robot. In recent years, the lack of conversation in daily life has become a problem, and as a solution to this problem, a ...
Safe Close-Proximity and Physical Human-Robot Interaction Using Industrial Robots
CRV '15: Proceedings of the 2015 12th Conference on Computer and Robot Vision

Industrial robots have been employed worldwide in the manufacturing sector for performing tasks quickly, repeatedly and accurately in relatively static environments for over 30 years. In recent years, close physical interaction between industrial robots ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

March 2021

756 pages

ISBN:9781450382908

DOI:10.1145/3434074

General Chairs:
Cindy Bethel
Mississippi State University, USA
,
Ana Paiva
INESC-ID, IST, University of Lisbon, Portugal & Radcliffe Institute for Advanced Study, Harvard University, USA
,
Program Chairs:
Elizabeth Broadbent
University of Auckland, New Zealand
,
David Feil-Seifer
University of Nevada Reno, USA
,
Daniel Szafir
University of Colorado Boulder, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

NSF

Conference

HRI '21

Sponsor:

HRI '21: ACM/IEEE International Conference on Human-Robot Interaction

March 8 - 11, 2021

CO, Boulder, USA

Acceptance Rates

Overall Acceptance Rate 192 of 519 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
531
Total Downloads

Downloads (Last 12 months)162
Downloads (Last 6 weeks)14

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roesler EWinhold LOnnasch LGrollman DBroadbent EJu WSoh HWilliams T(2024)Compete, Cooperate, or Both? Exploring How Interaction Settings Shape Human-Robot InteractionCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640587(901-905)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640587
Mahdi HJouaiti MSaleh SDautenhahn K(2024)Towards accessible robot-assisted physical play for children with physical disabilitiesInteraction Studies. Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies / Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies10.1075/is.00023.mah25:1(36-69)Online publication date: 7-Jun-2024
https://doi.org/10.1075/is.00023.mah
Memarian BDoleck T(2024)Embodied AI in education: A review on the body, environment, and mindEducation and Information Technologies10.1007/s10639-023-12346-829:1(895-916)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s10639-023-12346-8
Ahmad MAlzahrani ARobinson SRahat A(2023)Modelling Human Trust in Robots During Repeated InteractionsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623892(281-290)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623892
Wozniak MChang CLuebbers MIkeda BWalker MRosen EGroechel TCastellano GRiek LCakmak MLeite I(2023)Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI)Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3579959(938-940)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3579959
Yang BZheng LRatliff LBoots BSmith J(2023)Stackelberg Games for Learning Emergent Behaviors During Competitive Autocurricula2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10160875(5501-5507)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10160875
LC RBenayoun MLindborg PXu HChung Chan HMan Yip KZhang T(2021)Power ChessProceedings of the 10th International Conference on Digital and Interactive Arts10.1145/3483529.3483844(1-11)Online publication date: 13-Oct-2021
https://dl.acm.org/doi/10.1145/3483529.3483844

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents