research-article

ShadowPlay: a generative model for nonverbal human-robot interaction

Authors:

Eric M. Meisner,

Selma Àbanovic,

Linnda R. Caporeal,

Jeff TrinkleAuthors Info & Claims

HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

Pages 117 - 124

https://doi.org/10.1145/1514095.1514118

Published: 09 March 2009 Publication History

Abstract

Humans rely on a finely tuned ability to recognize and adapt to socially relevant patterns in their everyday face-to-face interactions. This allows them to anticipate the actions of others, coordinate their behaviors, and create shared meaning to communicate. Social robots must likewise be able to recognize and perform relevant social patterns, including interactional synchrony, imitation, and particular sequences of behaviors. We use existing empirical work in the social sciences and observations of human interaction to develop nonverbal interactive capabilities for a robot in the context of shadow puppet play, where people interact through shadows of hands cast against a wall. We show how information theoretic quantities can be used to model interaction between humans and to generate interactive controllers for a robot. Finally, we evaluate the resulting model in an embodied human-robot interaction study. We show the benefit of modeling interaction as a joint process rather than modeling individual agents.

References

[1]

C. L. Breazeal, Designing Sociable Robots. Cambridge, MA: MIT Press, 2002.

Digital Library

[2]

G. R. Semin, "Grounding communication: Synchrony, Social Psychology: Handbook of Basic Principles 2nd Edition, pp. 630--649, 2007.

[3]

K. Dautenhahn, B. Ogden, and T. Quick,"From embodied to socially embedded agents' Implications for interaction-aware robots,"Cognitive Systems Research, vol. 3, pp. 397--428, 2002.

Digital Library

[4]

L.W. Barsalou, C. Breazeal, and L. B. Smith, Cognition as coordinated non-cognition,"Cognitive Processing, vol. 8, no. 2, pp. 79--91, June 2007.

[5]

E. R. Smith and G. R. Semin, Socially situated cognition: Cognition in its social context, Advances in Experimental Social Psychology, vol. 36, pp. 53--117, 2004.

[6]

S. Sabanovic, M. P. Michalowski, and L. R. Caporael, Making friends: Building social robots through interdisciplinary collaboration, in Multidisciplinary Collaboration for Socially Assistive Robotics: Papers from the 2007 AAAI Spring Symposium, Technical Report SS-07-07. AAAI, March 2007, pp. 71--77.

[7]

W. S. Condon and L.W. Sander,"Synchrony demonstrated between movements of the neonate and adult speech,"Child Development, vol. 45, no. 2, pp. 456--462, 1974.

[8]

D. McNeill, Gesture & Thought. Chicago: Chicago University Press, 2005.

[9]

C. Crick, M. Munz, T. Nad, and B. Scassellati, Robotic drumming: Synchronization in social tasks, in IEEE ROMAN, 2006, pp. 97--102.

[10]

M. P. Michalowski, S. Sabanovic, and H. Kozima, A dancing robot for rhythmic social interaction, in Human-Robot Interaction Conference, 2007.

Digital Library

[11]

H. Ogawa and T. Watanabe, Interrobot: speech-driven embodied interaction robot," Advanced Robotics, vol. 15, pp. 371--377, 2001.

[12]

H. Clark and S. A. Brennan, Perspectives on socially shared cognition. Academic Press, 1991, ch. Grounding in communication.

[13]

L. Barrett,"Too much monkey business,"in Proc. Grounding Sociality: Neurons, Minds, and Culture, 2007.

[14]

J. K. Burgoon, L. A. Stern, and L. Dillman, Interpersonal Adaptation: Dyadic Interaction Patterns. Cambridge: Cambridge University Press, 1995.

[15]

L. R. Caporael, The evolution of truly social cognition: The core configuration model,"Personality and Social Psychology Review, vol. 1, pp. 276--298, 1997.

[16]

E. Z. Tronick and J. F. Cohn, "Infant-mother face-to-face interaction: age and gender differences in coordination and the occurrence of miscoordination,"Child Development, vol. 60, no. 1, pp. 85--92, 1989.

[17]

T. L. Chartrand and J. A. Bargh,"The chameleon effect: The perception-behavior link and social interaction, Journal of Personality and Social Psychology, vol. 76, pp. 893--910, 1999.

[18]

P. Andry, P. Gaussier, S. Moga, J. P. Banquet, and J. Nadel,"Learning and communication via imitation: An autonomous robot perspective, IEEE Trans. Systems, Man, and Cybernetics, vol. 31, no. 5, pp. 431--442, 2000.

Digital Library

[19]

S. Penny, Embodied cultural agents: at the intersection of robotics, cognitive science, and interactive art, in AAAI Socially Intelligent Agents Symposium, 1997.

[20]

M. Blow, K. Dautenhahn, A. Appleby, C. L. Nehaniv, and D. Lee,"The art of designing robot faces: Dimensions for human-robot interaction, in HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. New York, NY, USA: ACM, 2006, pp. 331--332.

Digital Library

[21]

H. Kozima and C. Nakagawa, Social robots for children: Practice in communication-care, in Proc. IEEE Intl. Workshop on Advanced Motion Control, 2006, pp. 768--773.

[22]

F. J. Bernieri, J. S. Reznick, and R. Rosenthal, Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions,"Journal of Personality and Social Psychology, vol. 54, no. 2, pp. 243--253, 1988.

[23]

Meisner and Sabanovic,"Shadow puppet interaction site,"May 2008, www.cs.rpi.edu/~meisne/interaction.

[24]

M.-K. Hu,"Visual pattern recognition by moment invariants, Information Theory, IEEE Transactions on, vol. 8, no. 2, pp. 179--187, 1962.

[25]

M. Cuturi and J.-P. Vert, A mutual information kernel for sequences, Proc. IEEE Intl. Joint Conf. on Neural Networks, vol. 3, pp. 1905--1910 vol.3, July 2004.

[26]

M. Seeger,"Covariance kernels from bayesian generative models, in NIPS, vol. 14, 2002, pp. 905--912.

[27]

Meisner, www.cs.rpi.edu/~meisne/interaction/wam.html.

Cited By

Mourtzis D(2024)Industry 4.0 and smart manufacturingManufacturing from Industry 4.0 to Industry 5.010.1016/B978-0-443-13924-6.00002-8(13-61)Online publication date: 2024
https://doi.org/10.1016/B978-0-443-13924-6.00002-8
Wollstadt PKruger M(2022)Quantifying cooperation between artificial agents using synergistic information2022 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI51031.2022.10022283(1044-1051)Online publication date: 4-Dec-2022
https://doi.org/10.1109/SSCI51031.2022.10022283
Shu TRyoo MZhu S(2016)Learning social affordance for human-robot interactionProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3061053.3061104(3454-3461)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3061053.3061104
Show More Cited By

Index Terms

ShadowPlay: a generative model for nonverbal human-robot interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Cooperation and coordination

Recommendations

Robotic Stand-Up Comedy: State-of-the-Art
Distributed, Ambient and Pervasive Interactions: Understanding Humans
Abstract
Humanoid and social robots have to perform in socially acceptable ways. They interact with humans and support humans in their needs and their activities. Stand-up comedy is an extreme form of human-human and human-audience interaction. It can be ...
Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions

In human-human interactions, entrainment is a naturally occurring phenomenon that happens when interlocutors mutually adapt their behaviors through the course of an interaction. This mutual behavioral dependency has been at the center of psychological ...
How Robots’ Unintentional Metacommunication Affects Human–Robot Interactions. A Systemic Approach
Abstract
In this paper, we theoretically address the relevance of unintentional and inconsistent interactional elements in human–robot interactions. We argue that elements failing, or poorly succeeding, to reproduce a humanlike interaction create ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

March 2009

348 pages

ISBN:9781605584041

DOI:10.1145/1514095

General Chairs:
Matthias Scheutz
Indiana University, USA
,
François Michaud
Université de Sherbrooke, Canada
,
Program Chairs:
Pamela Hinds
Stanford University, USA
,
Brian Scassellati
Yale University, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI09

Sponsor:

HRI09: International Conference on Human Robot Interaction

March 9 - 13, 2009

California, La Jolla, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
495
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)2

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mourtzis D(2024)Industry 4.0 and smart manufacturingManufacturing from Industry 4.0 to Industry 5.010.1016/B978-0-443-13924-6.00002-8(13-61)Online publication date: 2024
https://doi.org/10.1016/B978-0-443-13924-6.00002-8
Wollstadt PKruger M(2022)Quantifying cooperation between artificial agents using synergistic information2022 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI51031.2022.10022283(1044-1051)Online publication date: 4-Dec-2022
https://doi.org/10.1109/SSCI51031.2022.10022283
Shu TRyoo MZhu S(2016)Learning social affordance for human-robot interactionProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3061053.3061104(3454-3461)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3061053.3061104
Cheng HYu CChua TLu KMei TWu X(2013)Moving skin and shadow region analysis via adaptive modelsProceedings of the Fifth International Conference on Internet Multimedia Computing and Service10.1145/2499788.2499791(82-86)Online publication date: 17-Aug-2013
https://dl.acm.org/doi/10.1145/2499788.2499791
Meisner EDas SIsler VTrinkle JŠabanović SCaporael L(2010)Predictive State Representations for grounding human-robot communication2010 IEEE International Conference on Robotics and Automation10.1109/ROBOT.2010.5509740(178-185)Online publication date: May-2010
https://doi.org/10.1109/ROBOT.2010.5509740
Šabanović S(2010)Robots in Society, Society in RobotsInternational Journal of Social Robotics10.1007/s12369-010-0066-72:4(439-450)Online publication date: 22-Oct-2010
https://doi.org/10.1007/s12369-010-0066-7

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents