Article

Teaching and Working with Robots as a Collaboration

Authors:

Cynthia Breazeal,

Andrea LockerdAuthors Info & Claims

AAMAS '04: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3

Pages 1030 - 1037

Published: 19 July 2004 Publication History

Abstract

New applications for autonomous robots bring them into the human environment where they are to serve as helpful assistants to untrained users in the home or office, or work as capable members of human-robot teams for security, military, and space efforts. These applications require robots to be able to quickly learn how to perform new tasks from natural human instruction, and to perform tasks collaboratively with human teammates. Using joint intention theory as our theoretical framework, our approach integrates learning and collaboration through a goal based task structure. Specifically, we use collaborative discourse with accompanying gestures and social cues to teach a humanoid robot a structurally complex task. Having learned the representation for the task, the robot then performs it shoulder-to-shoulder with a human partner, using social communication acts to dynamically mesh its plans with those of its partner, according to the relative capabilities of the human and the robot.

References

[1]

{1} D.A. Baldwin and J.A. Baird. Discerning intentions in dynamic human action. Trends in Cognitive Sciences, 5(4):171-178, 2001.

[2]

{2} William Bluethmann, Robert Ambrose, Myron Diftler, Scott Askew, Eric Huber, Michael Goza, Fredrik Rehnmark, Chris Lovchik, and Darby Magruder. Robonaut: A robot designed to work with humans in space. Auton. Robots, 14(2-3):179- 197, 2003.

Digital Library

[3]

{3} M. Bratman. Shared cooperative activity. The Philosophical Review, 101(2):327-341, 1992.

[4]

{4} R. Burke, D. Isla, M. Downie, Y. Ivanov, and B. Blumberg. Creature Smarts: The art and architecture of a virtual brain. In Proceedings of the Game Developers Conference, pages 147-166, 2001.

[5]

{5} P. R. Cohen and H. J. Levesque. Teamwork. NOÚS, 35:487- 512, 1991.

[6]

{6} P. R. Cohen, H. J. Levesque, J. H. T. Nunes, and S. L. Oviatt. Task-oriented dialogue as a consequence of joint activity. In Proceedings of the Pacific Rim International Conference on Artificial Intelligence, Nagoya, Japan, November 1990.

[7]

{7} D. C. Dennett. Three kinds of intentional psychology. In The Intentional Stance, chapter 3. MIT Press, Cambridge, MA, 1987.

[8]

{8} Terrence W. Fong, Charles Thorpe, and C. Baur. Collaboration, dialogue, and human-robot interaction. In proc of the 10th International Symposium of Robotics Research, Lorne, Victoria, Australia, London, November 2001. Springer-Verlag.

[9]

{9} H. P. Grice. Logic and conversation. In P. Cole and J. L. Morgan, editors, Syntax and Semantics: Vol. 3: Speech Acts, pages 41-58. Academic Press, San Diego, CA, 1975.

[10]

{10} B. J. Grosz. Collaborative systems. AI Magazine, 17(2):67- 85, 1996.

Digital Library

[11]

{11} B. J. Grosz and C. L. Sidner. Plans for discourse. In P. R. Cohen, J. Morgan, and M. E. Pollack, editors, Intentions in communication , chapter 20, pages 417-444. MIT Press, Cambridge, MA, 1990.

[12]

{12} Hank Jones and Pamela Hinds. Extreme work teams: using swat teams as a model for coordinating distributed robots. In Proceedings of the 2002 ACM conference on Computer supported cooperative work, pages 372-381. ACM Press, 2002.

Digital Library

[13]

{13} Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10:799-822, 1994.

[14]

{14} Stanislao Lauria, Guido Bugmann, Theocharis Kyriacou, and Ewan Klein. Mobile robot programming using natural language. Robotics and Autonomous Systems, 38(3-4):171- 181, 2002.

[15]

{15} H. J. Levesque, P. R. Cohen, and J. H. T. Nunes. On acting together. In Proceedings of AAAI-90, pages 94-99, Boston, MA, 1990.

[16]

{16} Diane J. Litman and James F. Allen. Discourse processing and commonsense plans. In P. R. Cohen, J. Morgan, and M. E. Pollack, editors, Intentions in communication, chapter 17, pages 417-444. MIT Press, Cambridge, MA, 1990.

[17]

{17} Michael Montemerlo, Joelle Pineau, Nicholas Roy, Sebastian Thrun, and Vandi Verma. Experiences with a mobile robotic elderly guide for the elderly. In National Conference on Artificial Intelligence. AAAI, August 2002.

Digital Library

[18]

{18} Monica N. Nicolescu and Maja J. Matari¿. Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, Melbourne, Australia, July 2003.

Digital Library

[19]

{19} Dennis Perzanowski, Alan C. Schultz, William Adams, Elaine Marsh, and Magda Bugajska. Building a multimodal human-robot interface. IEEE Intelligent Systems, 16(1):16- 21, 2001.

Digital Library

[20]

{20} C. Rich, C. L. Sidner, and N. Lesh. Collagen: Applying collaborative discourse theory to human-computer collaboration. AI Magazine, 22(4):15-25, 2001.

Digital Library

[21]

{21} J. R. Searle. Collective intentions and actions. In P. R. Cohen, J. Morgan, and M. E. Pollack, editors, Intentions in Communication, chapter 19, pages 401-416. MIT Press, Camridge, MA, 1990.

[22]

{22} R. Voyles and P. Khosla. A multi-agent system for programming robotic agents by human demonstration. In Proceedings of AI and Manufacturing Research Planning Workshop, 1998.

[23]

{23} L. S. Vygotsky. Mind in society: the development of higher psychological processes. Harvard University Press, Cambridge, MA, 1978.

[24]

{24} A. L. Woodward, J. A. Sommerville, and J. J. Guajardo. How infants make sense of intentional actions. In B. Malle, L. Moses, and D. Baldwin, editors, Intentions and Intentionality: Foundations of Social Cognition, chapter 7, pages 149- 169. MIT Press, Cambridge, MA, 2001.

Cited By

Grondahl KChattopadhyay AAzhar MZhang JSherriff MHeckman SCutter PMonge A(2020)Program Cozmo to Enhance CS0/CS1 Learning of Secure CodingProceedings of the 51st ACM Technical Symposium on Computer Science Education10.1145/3328778.3372683(1354-1354)Online publication date: 26-Feb-2020
https://dl.acm.org/doi/10.1145/3328778.3372683
Grigore EMangin ORoncone AScassellati BAndre EKoenig SDastani MSukthankar G(2018)Predicting Supportive Behaviors for Human-Robot CollaborationProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3238115(2186-2188)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3238115
Admoni HScassellati B(2017)Social eye gaze in human-robot interactionJournal of Human-Robot Interaction10.5898/JHRI.6.1.Admoni6:1(25-63)Online publication date: 26-May-2017
https://dl.acm.org/doi/10.5898/JHRI.6.1.Admoni
Show More Cited By

Index Terms

Teaching and Working with Robots as a Collaboration

Recommendations

Interactive Teaching for Vision-Based Mobile Robots: A Sensory-Motor Approach

For the last decade, we have been developing a vision-based architecture for mobile robot navigation. Using our bio-inspired model of navigation, robots can perform sensory-motor tasks in real time in unknown indoor as well as outdoor environments. We ...
Collaboration of multiple SCARA robots with guaranteed safety using recurrent neural networks
Abstract
SCARA robot is one of the most popularly used robots in industry. The obstacle avoidance feature of multiple SCARA robot collaboration is essential and prominent, which can be used to support multiple robots to accomplish not only more ...
Working with Bounded Collaboration: A Qualitative Study on How Collaboration is Co-constructed around Collaborative Robots in Industry
CSCW

We investigate how collaboration is understood and configured in industrial workplaces with collaborative robots (cobots). Through a qualitative analysis of 115 case studies of companies using cobots and 14 semi-structured interviews with cobot ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AAMAS '04: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3

July 2004

487 pages

ISBN:1581138644

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

IEEE Computer Society

United States

Publication History

Published: 19 July 2004

Check for updates

Qualifiers

Article

Conference

AAMAS04

Sponsor:

SIGAI

AAMAS04: The Third International Joint Conference on Autonomous Agents and Multi-Agent Systems 2004

July 19 - 23, 2004

New York, New York

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
65
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Grondahl KChattopadhyay AAzhar MZhang JSherriff MHeckman SCutter PMonge A(2020)Program Cozmo to Enhance CS0/CS1 Learning of Secure CodingProceedings of the 51st ACM Technical Symposium on Computer Science Education10.1145/3328778.3372683(1354-1354)Online publication date: 26-Feb-2020
https://dl.acm.org/doi/10.1145/3328778.3372683
Grigore EMangin ORoncone AScassellati BAndre EKoenig SDastani MSukthankar G(2018)Predicting Supportive Behaviors for Human-Robot CollaborationProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3238115(2186-2188)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3238115
Admoni HScassellati B(2017)Social eye gaze in human-robot interactionJournal of Human-Robot Interaction10.5898/JHRI.6.1.Admoni6:1(25-63)Online publication date: 26-May-2017
https://dl.acm.org/doi/10.5898/JHRI.6.1.Admoni
Wentzel JRea DYoun JSharlin ELee MOmori TOsawa HPark HYoung J(2015)Shared Presence and Collaboration Using a Co-Located Humanoid RobotProceedings of the 3rd International Conference on Human-Agent Interaction10.1145/2814940.2814995(273-276)Online publication date: 21-Oct-2015
https://dl.acm.org/doi/10.1145/2814940.2814995
Okazaki HKanai YOgata MHasegawa KIshii KImai MLee MOmori TOsawa HPark HYoung J(2015)Building Pedagogical Relationships Between Humans and Robots in Natural InteractionsProceedings of the 3rd International Conference on Human-Agent Interaction10.1145/2814940.2814941(115-120)Online publication date: 21-Oct-2015
https://dl.acm.org/doi/10.1145/2814940.2814941
Schmitz MGross MNunes NDo EBrewster SOakley I(2011)Concepts for life-like interactive objectsProceedings of the fifth international conference on Tangible, embedded, and embodied interaction10.1145/1935701.1935732(157-164)Online publication date: 22-Jan-2011
https://dl.acm.org/doi/10.1145/1935701.1935732
Wang LRau PEvers VRobinson BHinds PHinds PIshiguro HKanda TKahn P(2010)When in RomeProceedings of the 5th ACM/IEEE international conference on Human-robot interaction10.5555/1734454.1734578(359-366)Online publication date: 2-Mar-2010
https://dl.acm.org/doi/10.5555/1734454.1734578
Yu CScheutz MSchermerhorn PHinds PIshiguro HKanda TKahn P(2010)Investigating multimodal real-time patterns of joint attention in an hri word learning taskProceedings of the 5th ACM/IEEE international conference on Human-robot interaction10.5555/1734454.1734561(309-316)Online publication date: 2-Mar-2010
https://dl.acm.org/doi/10.5555/1734454.1734561
Riek LRabinowitch TBremner PPipe AFraser MRobinson PHinds PIshiguro HKanda TKahn P(2010)Cooperative gesturesProceedings of the 5th ACM/IEEE international conference on Human-robot interaction10.5555/1734454.1734474(61-68)Online publication date: 2-Mar-2010
https://dl.acm.org/doi/10.5555/1734454.1734474
Babaian TLucas WXu JTopi H(2010)Usability through system-user collaborationProceedings of the 5th international conference on Global Perspectives on Design Science Research10.1007/978-3-642-13335-0_27(394-409)Online publication date: 4-Jun-2010
https://dl.acm.org/doi/10.1007/978-3-642-13335-0_27
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents