research-article

A speech-driven embodied entrainment wall picture system for supporting virtual communication

Authors:

Yoshihiro Sejima,

Tomio WatanabeAuthors Info & Claims

IUCS '09: Proceedings of the 3rd International Universal Communication Symposium

Pages 309 - 314

https://doi.org/10.1145/1667780.1667844

Published: 03 December 2009 Publication History

Get Access

Abstract

We have developed a speech-driven embodied entrainment system called "InterPicture" and have demonstrated the effectiveness of the system using an embodied virtual communication system. InterPicture is an image containing flowers that react to the speech input of talkers. We confirmed the importance of providing a communication environment in which not only avatars but also CG objects placed around the avatars are related to virtual communication. In this study, we have developed an advanced speech-driven embodied entrainment system called "InterWall". This system projects wall picture widely onto the wall surrounding avatars and behaves as a listener by producing nodding and body movements on the basis of the speech input of a talker. Further, a communication experiment has been performed, and the effectiveness of "InterWall" has been demonstrated by carrying out a sensory evaluation and a speech-overlap analysis for 20 pairs of 40 talkers.

References

[1]

R. Mech, and P. Prusinkiewicz.: Visual Models of Plants Interacting with Their Environment, Proceedings of ACM SIGGRAPH,. pages 397--410, 1996.

Digital Library

Google Scholar

[2]

M. Sato.: Effects of Windows, Potted Plants and Paintings in a Room on Electroencephalogram and the Like: A study on physiological and psychological effects of visual environment in an office space, Journal of architecture, planning and environmental engineering, pages 87--95, 1994.

Google Scholar

[3]

Y. Iwasaki, S. Yamamoto, H. Kweon and M. Watanabe: Experiment on Moderating Effect of the Stress of Botanical Companion in Indoor Space, Transactions of The Japanese Society of Revegetation Technology, 32(2): 247--249, 2006.

Crossref

Google Scholar

[4]

M. Henmi, Y. Sejima, K. Imai and T. Watanabe: A Speech-Driven Embodied Entrainment Picture System, The Journal Article of 10th IEEE HISS, pages 248--251, 2008.

Google Scholar

[5]

Y. Sejima and T. Watanabe.: An Embodied Virtual Communication System with a Speech-Driven Embodied Entrainment Picture, Proceedings of 18th IEEE International Symposium on Robot and Human Interactive Communication(RO-MAN2009), pages 979--984, 2009.

Crossref

Google Scholar

[6]

Y. Hiraoka, N. Oi and H. Takahashi. Doke: A variation of impression of street by conspicuous signs and difference of their size in townscape: The Journal Article of Architectural Institute of Japan, 2006: 771--772, 2006.

Google Scholar

[7]

W. S. Condon and L. W. Sander.: Neonate movement is synchronized with adult speech, Science, 183: 99--101, 1974.

Crossref

Google Scholar

[8]

T. Watanabe, M. Okubo, M. Nakashige and R. Danbara.: InterActor: Speech-Driven Embodied Interactive Actor. International Journal of Human-Computer Interaction, 17(1): 43--60, 2004.

Crossref

Google Scholar

[9]

M. Yoshida, T. Watanabe and M. Yamamoto.: Development of a Speech-Driven Embodied Entrainment System with 3DCG Objects, Transactions of Human Interface Society, 9(3):87--96, 2007.

Google Scholar

[10]

Y. Sejima, T. Watanabe and M. Yamamoto.: Analysis by Synthesis of Embodied Communication via VirtualActor with a Nodding Response Model, Proceedings of Second International Symposium on Universal Communication (ISUC2008), pages 225--230, 2008.

Digital Library

Google Scholar

[11]

"goo ranking", http://ranking.goo.ne.jp/

Google Scholar

[12]

H. Ito, M. Shigeno, T. Nishimoto, M. Araki and Y. Niimi.: The Analysis of the Atmosphere in the Dialogs, Technical report of IPSJ, SLP, 2002(10): 103--108, 2002.

Google Scholar

[13]

R. Nishimura, N. Kitaoka and S. Nakagawa.: Response Timing and Prosody Change Modeling in Conversations and Their Application to a Spoken Dialog System, Proceedings of the 48th SIG-SLUD of the Japanese Society for Artificial Intelligence, (SIG-SLUD-A602-07): 37--42, 2006.

Google Scholar

Cited By

View all

Sejima YIshii YWatanabe T(2011)A virtual audience system for enhancing embodied interaction based on conversational activityProceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II10.5555/2021604.2021628(180-189)Online publication date: 9-Jul-2011
https://dl.acm.org/doi/10.5555/2021604.2021628
Sejima YIshii YWatanabe T(2011)A Virtual Audience System for Enhancing Embodied Interaction Based on Conversational ActivityHuman Interface and the Management of Information. Interacting with Information10.1007/978-3-642-21669-5_22(180-189)Online publication date: 2011
https://doi.org/10.1007/978-3-642-21669-5_22

Index Terms

A speech-driven embodied entrainment wall picture system for supporting virtual communication
1. Human-centered computing
  1. Collaborative and social computing
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

Analysis by Synthesis of Embodied Communication via VirtualActor with a Nodding Response Model
ISUC '08: Proceedings of the 2008 Second International Symposium on Universal Communication

In human face-to-face communication, not only verbal messages but nonverbal behavior such as nodding and body movements are rhythmically related and mutually synchronized between the talkers.We have already developed an embodied virtual communication ...
Speech-driven embodied entrainment character system with hand motion input in mobile environment
ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

InterActor is a speech-input-driven CG-embodied interaction character that can generate communicative movements and actions for entrained interactions. InterPuppet, on the other hand, is an embodied interaction character that is driven by both speech ...
A virtual audience system for enhancing embodied interaction based on conversational activity
HCII'11: Proceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II

In this paper, we propose a model for estimating conversational activity based on the analysis of enhanced embodied interaction, and develop a virtual audience system. The proposed model is applied to a speech-driven embodied entrainment wall picture, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IUCS '09: Proceedings of the 3rd International Universal Communication Symposium

December 2009

404 pages

ISBN:9781605586410

DOI:10.1145/1667780

General Chair:
Kazumasa Enami
National Institute of Information and Communications Technology (NICT), Japan

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUCS '09

Sponsor:

NICT

IUCS '09: 3rd International Universal Communication Symposium

December 3 - 4, 2009

Tokyo, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
70
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sejima YIshii YWatanabe T(2011)A virtual audience system for enhancing embodied interaction based on conversational activityProceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II10.5555/2021604.2021628(180-189)Online publication date: 9-Jul-2011
https://dl.acm.org/doi/10.5555/2021604.2021628
Sejima YIshii YWatanabe T(2011)A Virtual Audience System for Enhancing Embodied Interaction Based on Conversational ActivityHuman Interface and the Management of Information. Interacting with Information10.1007/978-3-642-21669-5_22(180-189)Online publication date: 2011
https://doi.org/10.1007/978-3-642-21669-5_22

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Analysis by Synthesis of Embodied Communication via VirtualActor with a Nodding Response Model

Speech-driven embodied entrainment character system with hand motion input in mobile environment

A virtual audience system for enhancing embodied interaction based on conversational activity