research-article

Teaching people how to teach robots: the effect of instructional materials and dialog design

Authors:

Leila TakayamaAuthors Info & Claims

HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

Pages 431 - 438

https://doi.org/10.1145/2559636.2559675

Published: 03 March 2014 Publication History

Abstract

Allowing end-users to harness the full capability of general purpose robots, requires giving them powerful tools. As the functionality of these tools increase, learning how to use them becomes more challenging. In this paper we investigate the use of instructional materials to support the learnability of a Programming by Demonstration tool. We develop a system that allows users to program complex manipulation skills on a two-armed robot through a spoken dialog interface and by physically moving the robot's arms. We present a user study (N=30) in which participants are left alone with the robot and a user manual, without any prior instructions on how to program the robot. Instead, they are asked to figure it out on their own. We investigate the effect of providing users with an additional written tutorial or an instructional video. We find that videos are most effective in training the user; however, this effect might be superficial and ultimately trial-and-error plays an important role in learning to program the robot. We also find that tutorials can be problematic when the interaction has uncertainty due to speech recognition errors. Overall, the user study demonstrates the effectiveness and learnability of the our system, while providing useful feedback about the dialog design.

References

[1]

S. Ainsworth. Deft: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16(3):183--198, 2006.

[2]

B. Akgun, M. Cakmak, K. Jiang, and A. Thomaz. Keyframe-based learning from demonstration. Journal of Social Robotics, Special issue on LfD, 4(4), 2012.

[3]

A. Bandura. Social Learning Theory. General Learning Corporation, 1971.

[4]

A. Billard, S. Calinon, R. Dillmann, and S. Schaal. Robot programming by demonstration. In B. Siciliano and O. Khatib, editors, Handbook of Robotics. Springer, 2007.

[5]

M. Cakmak and A. L. Thomaz. Designing robot learners that ask good questions. In Proc. of the Intl. Conf. on Human-Robot Interaction (HRI), 2012.

Digital Library

[6]

L. Dybkjær and N. O. Bernsen. Usability issues in spoken dialogue systems. Natural Language Engineering, 6(3&4):243--271, 2000.

Digital Library

[7]

K. Fischer. How people talk with robots: Designing dialog to reduce user uncertainty. AI Magazine, 32(4):31--38, 2011.

Digital Library

[8]

M. E. Foster, M. Giuliani, A. Isard, C. Matheson, J. Oberlander, and A. Knoll. Evaluating description and reference strategies in a cooperative human-robot dialogue system. In IJCAI, pages 1818--1823, 2009.

Digital Library

[9]

J. Gustafson, A. Larsson, R. Carlson, and K. Hellman. How do system questions influence lexical choices in user answers? In EUROSPEECH, 1997.

[10]

C. A. Kamm, D. J. Litman, and M. A. Walker. From novice to expert: the effect of tutorials on user expertise with spoken dialogue systems. In ICSLP, 1998.

[11]

D. E. Kieras and S. Bovair. The role of a mental model in learning to operate a device. Cognitive science, 8(3):255--273, 1984.

[12]

N. Koenig, L. Takayama, and M. Matarić. Communication and knowledge sharing in human-robot interaction and learning from demonstration. Neural Networks, 23(8), 2010.

Digital Library

[13]

H. Nguyen, M. Ciocarlie, and K. Hsiao. Ros commander (rosco): Behavior creation for home robots. In IEEE Intl. Conference on Robotics and Automation, 2013.

[14]

S. Niekum, S. Osentoski, S. Chitta, B. Marthi, and A. Barto. Incremental semantically grounded learning from demonstration. In Robotics: Science and Systems, 2013.

[15]

N. Otero, A. Alissandrakis, K. Dautenhahn, C. Nehaniv, D. Syrdal, and K. Koay. Human to robot demonstrations of routine home tasks: Exploring the role of the robot's feedback. In Proc. of the Intl. Conf. on Human-Robot Interaction (HRI), 2008.

Digital Library

[16]

J. Pearson, J. Hu, H. P. Branigan, M. J. Pickering, and C. I. Nass. Adaptive language behavior in hci: how expectations and beliefs about a system affect users' word choice. In Proc. of the SIGCHI conference on Human Factors in computing systems, 2006.

Digital Library

[17]

R. C. Schank, T. R. Berman, and K. A. Macpherson. Learning by doing. In C. M. Reigeluth, editor, Instructional-Design Theories and Models. LEA, 1999.

[18]

J. Schulman, A. Gupta, S. Venkatesan, M. Tayson-Frederick, and P. Abbeel. A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario. In IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), 2013.

[19]

H. Suay, R. Toris, and S. Chernova. A practical comparison of three robot learning from demonstration algorithms. Intl. Journal of Social Robotics, special issue on LfD, 4(4), 2012.

[20]

J. J. Van Merriënboer, P. A. Kirschner, and L. Kester. Taking the load off a learner's mind: Instructional design for complex learning. Educational psychologist, 38(1):5--13, 2003.

[21]

A. Weiss, J. Igelsboeck, S. Calinon, A. Billard, and M. Tscheligi. Teaching a humanoid: A user study on learning by demonstration with hoap-3. In IEEE RO-MAN, pages 147--152, 2009.

Cited By

Vaiani GPaternò F(2024)End-User Development for Human-Robot Interaction: Results and Trends in an Emerging FieldProceedings of the ACM on Human-Computer Interaction10.1145/36611468:EICS(1-40)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3661146
Aliasghari PGhafurian MNehaniv CDautenhahn K(2024)How Non-experts Kinesthetically Teach a Robot over Multiple Sessions: Diversity in Teaching Styles and Effects on PerformanceInternational Journal of Social Robotics10.1007/s12369-024-01164-8Online publication date: 23-Aug-2024
https://doi.org/10.1007/s12369-024-01164-8
Ajaykumar GHager GHuang C(2023)Curricula for teaching end-users to kinesthetically program collaborative robotsPLOS ONE10.1371/journal.pone.029478618:12(e0294786)Online publication date: 1-Dec-2023
https://doi.org/10.1371/journal.pone.0294786
Show More Cited By

Index Terms

Teaching people how to teach robots: the effect of instructional materials and dialog design

Recommendations

Implementation of advanced manipulation tasks on humanoids through kinesthetic teaching
PETRA '14: Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments

In this paper, we describe a software framework for programming by demonstration (PbD) using kinesthetic teaching. A Personal Robot 2 (PR2) robot platform was used to demonstrate teaching effectiveness and conduct dual arm manipulation operations during ...
Interactive Teaching for Vision-Based Mobile Robots: A Sensory-Motor Approach

For the last decade, we have been developing a vision-based architecture for mobile robot navigation. Using our bio-inspired model of navigation, robots can perform sensory-motor tasks in real time in unknown indoor as well as outdoor environments. We ...
Contextual Programming of Collaborative Robots
Artificial Intelligence in HCI
Abstract
Collaborative robots are envisioned to assist people in an increasing range of domains, from manufacturing to home care; however, due to the variable nature of these fields, such robots will inevitably face unfamiliar situations and unforeseen ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

March 2014

538 pages

ISBN:9781450326582

DOI:10.1145/2559636

General Chairs:
Gerhard Sagerer
Bielefeld University, Germany
,
Michita Imai
Keio University, Japan
,
Program Chairs:
Tony Belpaeme
Plymouth University, UK
,
Andrea Thomaz
Georgia Institute of Technology, USA

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
RA: IEEE Robotics and Automation Society
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

programming by demonstration

Qualifiers

Research-article

Conference

HRI'14

Sponsor:

HRI'14: ACM/IEEE International Conference on Human-Robot Interaction

March 3 - 6, 2014

Bielefeld, Germany

Acceptance Rates

HRI '14 Paper Acceptance Rate 32 of 132 submissions, 24%;

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
494
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vaiani GPaternò F(2024)End-User Development for Human-Robot Interaction: Results and Trends in an Emerging FieldProceedings of the ACM on Human-Computer Interaction10.1145/36611468:EICS(1-40)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3661146
Aliasghari PGhafurian MNehaniv CDautenhahn K(2024)How Non-experts Kinesthetically Teach a Robot over Multiple Sessions: Diversity in Teaching Styles and Effects on PerformanceInternational Journal of Social Robotics10.1007/s12369-024-01164-8Online publication date: 23-Aug-2024
https://doi.org/10.1007/s12369-024-01164-8
Ajaykumar GHager GHuang C(2023)Curricula for teaching end-users to kinesthetically program collaborative robotsPLOS ONE10.1371/journal.pone.029478618:12(e0294786)Online publication date: 1-Dec-2023
https://doi.org/10.1371/journal.pone.0294786
Ajaykumar GPineda KHuang C(2023)Older adults’ expectations, experiences, and preferences in programming physical robot assistanceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103127180(103127)Online publication date: Dec-2023
https://doi.org/10.1016/j.ijhcs.2023.103127
Aliasghari PGhafurian MNehaniv CDautenhahn K(2023)Kinesthetic Teaching of a Robot over Multiple Sessions: Impacts on Speed and SuccessSocial Robotics10.1007/978-3-031-24670-8_15(160-170)Online publication date: 2-Feb-2023
https://doi.org/10.1007/978-3-031-24670-8_15
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496
Hindemith LGöpfert JWiebel-Herboth CWrede BVollmer A(2022)Why robots should be technicalInteraction Studies. Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies / Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies10.1075/is.20023.hin22:2(244-279)Online publication date: 28-Feb-2022
https://doi.org/10.1075/is.20023.hin
Qahtani EJaved YShehab M(2021)User Perceptions of Gmail’s Confidential ModeProceedings on Privacy Enhancing Technologies10.2478/popets-2022-00102022:1(187-206)Online publication date: 20-Nov-2021
https://doi.org/10.2478/popets-2022-0010
Ajaykumar GSteele MHuang C(2021)A Survey on End-User Robot ProgrammingACM Computing Surveys10.1145/346681954:8(1-36)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3466819
Frijns HSchürer OKoeszegi S(2021)Communication Models in Human–Robot Interaction: An Asymmetric MODel of ALterity in Human–Robot Interaction (AMODAL-HRI)International Journal of Social Robotics10.1007/s12369-021-00785-715:3(473-500)Online publication date: 3-May-2021
https://doi.org/10.1007/s12369-021-00785-7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents