Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/2447556.2447646acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
abstract

Generating finely synchronized gesture and speech for humanoid robots: a closed-loop approach

Published: 03 March 2013 Publication History

Abstract

Previous work focusing on the production of communicative robot gesture has not sufficiently addressed the challenge of speech-gesture synchrony. We propose a novel multimodal scheduler that comprises two features to improve the synchronization process. First, the scheduler integrates an experimentally fitted forward model at the behavior planning stage to provide a more accurate estimation of the robot's gesture preparation time. Second, the model incorporates a feedback-based adaptation mechanism which allows for an on-line adjustment of the synchronization of the two modalities during execution. In this way, it represents the first closed-loop approach to speech and gesture generation for humanoid robots.

References

[1]
J. Cassell, T. Bickmore, L. Campbell, H. Vilhjálmsson, and H. Yan. Human Conversation as a System Framework: Desigining Embodied Conversational Agents. In Embodied Conversational Agents, pages 29--63. MIT Press: Cambridge, MA, 2000.
[2]
B. Habets, S. Kita, Z. Shao, A. Özyürek, and P. Hagoort. The Role of Synchrony and Ambiguity in Speech: Gesture Integration During Comprehension. Journal of Cognitive Neuroscience. Advance Online Publication, 23(8):1845--1854, 2011.
[3]
A. Kendon. Gesture: Visible Action as Utterance. Gesture, 6(1):119--144, 2004.
[4]
D. McNeill. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago, 1992.
[5]
V. Ng-Thow-Hing, P. Luo, and S. Okita. Synchronized Gesture and Speech Production for Humanoid Robots. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 4617--4624, 2010.
[6]
M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin. Generation and Evaluation of Communicative Robot Gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions, 4(2):201--217, 2012.

Cited By

View all
  • (2014)Advances in Wikipedia-based Interaction with RobotsProceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction10.1145/2666499.2666503(13-18)Online publication date: 16-Nov-2014

Index Terms

  1. Generating finely synchronized gesture and speech for humanoid robots: a closed-loop approach

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HRI '13: Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
    March 2013
    452 pages
    ISBN:9781467330558

    Sponsors

    In-Cooperation

    • AAAI: American Association for Artificial Intelligence
    • Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

    Publisher

    IEEE Press

    Publication History

    Published: 03 March 2013

    Check for updates

    Author Tags

    1. cross-modal synchrony
    2. multimodal communication
    3. robot gesture and speech
    4. social human-robot interaction

    Qualifiers

    • Abstract

    Conference

    HRI'13
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 268 of 1,124 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 29 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2014)Advances in Wikipedia-based Interaction with RobotsProceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction10.1145/2666499.2666503(13-18)Online publication date: 16-Nov-2014

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media