research-article

A robotic game to evaluate interfaces used to show and teach visual objects to a robot in real world condition

Authors:

Pierre Rouanet,

Fabien Danieau,

Pierre-Yves OudeyerAuthors Info & Claims

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

Pages 313 - 320

https://doi.org/10.1145/1957656.1957782

Published: 06 March 2011 Publication History

Abstract

In this paper, we present a real world user study of 4 interfaces designed to teach new visual objects to a social robot. This study was designed as a robotic game in order to maintain the user's motivation during the whole experiment. Among the 4 interfaces 3 were based on mediator objects such as an iPhone, a Wiimote and a laser pointer. They also provided the users with different kind of feedback of what the robot is perceiving. The fourth interface was a gesture based interface with a Wizard-of-Oz recognition system added to compare our mediator interfaces with a more natural interaction. Here, we specially studied the impact the interfaces have on the quality of the learning examples and the usability. We showed that providing non-expert users with a feedback of what the robot is perceiving is needed if one is interested in robust interaction. In particular, the iPhone interface allowed non-expert users to provide better learning examples due to its whole visual feedback. Furthermore, we also studied the user's gaming experience and found that in spite of its lower usability, the gestures interface was stated as entertaining as the other interfaces and increases the user's feeling of cooperating with the robot. Thus, we argue that this kind of interface could be well-suited for robotic game.

References

[1]

C. Breazeal and B. Scassellati. Infant-like social interactions between a robot and a human caregiver. Adapt. Behav., 8(1):49--74, 2000.

Digital Library

[2]

A. G. Brooks, J. Gray, G. Hoffman, A. Lockerd, H. Lee, and C. Breazeal. Robot's play: interactive games with sociable machines. Comput. Entertain., 2(3):10--10, 2004.

Digital Library

[3]

D. Filliat. Interactive learning of visual topological navigation. In Proceedings of the 2008 IEEE International Conference on Intelligent Robots and Systems (IROS 2008), 2008.

[4]

K. Ishii, S. Zhao, M. Inami, T. Igarashi, and M. Imai. Designing laser gesture interface for robot control. In Proceedings of the 12th IFIP Conference on Human-Computer Interaction, INTERACT2009, pages 479--492, 2009.

Digital Library

[5]

F. Kaplan. Les machines apprivoisées comprendre les robots de loisir. vuibert, 2005.

[6]

F. Kaplan and V. Hafner. The challenges of joint attention. Proceedings of the 4th International Workshop on Epigenetic Robotics, 2004.

[7]

C. C. Kemp, C. D. Anderson, H. Nguyen, A. J. Trevor, and Z. Xu. A point-and-click interface for the real world: laser designation of objects for mobile manipulation. In HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, pages 241--248, New York, NY, USA, 2008. ACM.

Digital Library

[8]

F. Lömker and G. Sagerer. A multimodal system for object learning. In Proceedings of the 24th DAGM Symposium on Pattern Recognition, pages 490--497, London, UK, 2002. Springer-Verlag.

Digital Library

[9]

D. R. Michael and S. L. Chen. Serious Games: Games That Educate, Train, and Inform. Muska & Lipman/Premier-Trade, 2005.

Digital Library

[10]

P. Rouanet, J. Béchu, and P.-Y. Oudeyer. A comparison of three interfaces using handheld devices to intuitively drive and show objects to a social robot : the impact of underlying metaphors. RO-MAN, 2009.

[11]

P. Rouanet, P. Oudeyer, and D. Filliat. Using mediator objects to easily and robustly teach visual objects to a robot. In ACM SIGGRAPH 2010 Posters. ACM, 2010.

Digital Library

[12]

P. Rouanet, P.-Y. Oudeyer, and D. Filliat. An integrated system for teaching new visually grounded words to a robot for non-expert users using a mobile device. In Proceedings of the Humanoids 2009 Conference, 2009.

[13]

S. S. Rumbaugh and R. Lewin. Kanzi : The Ape at the Brink of the Human Mind. Wiley, September 1996.

[14]

B. Scassellati. Mechanisms of shared attention for a humanoid robot. In Embodied Cognition and Action: Papers from the 1996 AAAI Fall Symposium, 1996.

[15]

L. Steels and F. Kaplan. Aibo's first words: The social learning of language and meaning. Evolution of Communication, 4(1):3--32, 2000.

[16]

M. L. Walters, S. N. Woods, K. L. Koay, and K. Dautenhahn. Practical and methodological challenges in designing and conducting human-robot interaction studies. In Proceedings of the AISB'05 Symposium on Robot Companions Hard Problems and Open Challenges in Human-Robot Interaction, pages 110--119. University of Hertfordshire, University of Hertfordshire, April 2005.

[17]

H. Wersing, S. Kirstein, M. Götting, H. Brandl, M. Dunn, I. Mikhailova, C. Goerick, J. J. Steil, H. Ritter, and E. Körner. A biologically motivated system for unconstrained online learning of visual objects. In ICANN (2), pages 508--517, 2006.

Digital Library

[18]

M. Xin and E. Sharlin. Playing Games with Robots - A Method for Evaluating Human-Robot Interaction. Education, 2007.

[19]

H. A. Yanco, J. L. Drury, and J. Scholtz. Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition. Hum.-Comput. Interact., 19(1):117--149, 2004.

Digital Library

Cited By

Gonzalez-Jimenez SGallo DSosa RSandoval EColombino TGrasso M(2022)A Decision Support Design Framework for Selecting a Robotic InterfaceProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3561913(104-113)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3561913
Schneiders ECheon EKjeldskov JRehm MSkov M(2022)Non-Dyadic Interaction: A Literature Review of 15 Years of Human-Robot Interaction Conference PublicationsACM Transactions on Human-Robot Interaction10.1145/348824211:2(1-32)Online publication date: 8-Feb-2022
https://dl.acm.org/doi/10.1145/3488242
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Show More Cited By

Index Terms

A robotic game to evaluate interfaces used to show and teach visual objects to a robot in real world condition
1. Applied computing
  1. Operations research
    1. Industry and manufacturing
      1. Command and control
2. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. External interfaces for robotics

Recommendations

Single robot - Multiple human interaction via intelligent user interfaces

This project addresses some research issues concerning design of intelligent user interfaces for improving human-robot interaction. In some critical applications, users interact with robots via Graphical User Interfaces (GUIs), which usually contain ...
Multimedia Interfaces: Don't Move My Cheese!

The author notes ways to be more consistent and practical when designing an interface.He also provides a concrete example of a less-than-perfect user interface on a phone/fax/answering machine.
User Feedback on Physical Marker Interfaces for Protecting Visual Privacy from Mobile Robots
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

We present a study that examines the efficiency and usability of three different interfaces for specifying which objects should be kept private (i.e., not visible) in an office environment. Our study context is a robot "janitor" system that has the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '11: Proceedings of the 6th international conference on Human-robot interaction

March 2011

526 pages

ISBN:9781450305617

DOI:10.1145/1957656

General Chairs:
Aude Billard
EPFL, Switzerland
,
Peter Kahn
University of Washington, USA
,
Program Chairs:
Julie A. Adams
Vanderbilt University, USA
,
Greg Trafton
US Naval Research Laboratories, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

RA: IEEE Robotics and Automation Society
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc
The Association for the Advancement of Artificial Intelligence (AAAI)
IEEE Systems, Man and Cybernetics Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI'11

Sponsor:

HRI'11: International Conference on Human-Robot Interaction

March 6 - 9, 2011

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
353
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gonzalez-Jimenez SGallo DSosa RSandoval EColombino TGrasso M(2022)A Decision Support Design Framework for Selecting a Robotic InterfaceProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3561913(104-113)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3561913
Schneiders ECheon EKjeldskov JRehm MSkov M(2022)Non-Dyadic Interaction: A Literature Review of 15 Years of Human-Robot Interaction Conference PublicationsACM Transactions on Human-Robot Interaction10.1145/348824211:2(1-32)Online publication date: 8-Feb-2022
https://dl.acm.org/doi/10.1145/3488242
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Yáñez-Gómez RCascado-Caballero DSevillano J(2017)Academic methods for usability evaluation of serious gamesMultimedia Tools and Applications10.1007/s11042-016-3845-976:4(5755-5784)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3845-9
Marichal SMalaisé AModugno VDermy OCharpillet FIvaldi S(2016)One-Shot Evaluation of the Control Interface of a Robotic Arm by Non-expertsSocial Robotics10.1007/978-3-319-47437-3_45(458-468)Online publication date: 7-Oct-2016
https://doi.org/10.1007/978-3-319-47437-3_45
Doisy GMeyer JEdan Y(2014)The Impact of Human–Robot Interface Design on the Use of a Learning Robot SystemIEEE Transactions on Human-Machine Systems10.1109/THMS.2014.233161844:6(788-795)Online publication date: Dec-2014
https://doi.org/10.1109/THMS.2014.2331618
Rouanet POudeyer PDanieau FFilliat D(2013)The Impact of Human–Robot Interfaces on the Learning of Visual ObjectsIEEE Transactions on Robotics10.1109/TRO.2012.222813429:2(525-541)Online publication date: 1-Apr-2013
https://dl.acm.org/doi/10.1109/TRO.2012.2228134
Stollnberger GWeiss ATscheligi M(2013)"The harder it gets" Exploring the interdependency of input modalities and task complexity in human-robot collaboration2013 IEEE RO-MAN10.1109/ROMAN.2013.6628457(264-269)Online publication date: Aug-2013
https://doi.org/10.1109/ROMAN.2013.6628457
Riek L(2012)Wizard of Oz studies in HRIJournal of Human-Robot Interaction10.5898/JHRI.1.1.Riek1:1(119-136)Online publication date: 28-Jul-2012
https://dl.acm.org/doi/10.5898/JHRI.1.1.Riek
Doisy GMeyer JEdan Y(2011)Toward an ecological approach to interface design for teaching robotsProceedings of the 12th Annual conference on Towards autonomous robotic systems10.5555/2035304.2035362(420-421)Online publication date: 31-Aug-2011
https://dl.acm.org/doi/10.5555/2035304.2035362

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents