short-paper

Effects of multimodal cues on children's perception of uncanniness in a social robot

Authors:

Christopher Peters,

Ingela Nyström,

Ginevra CastellanoAuthors Info & Claims

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Pages 297 - 301

https://doi.org/10.1145/2993148.2993157

Published: 31 October 2016 Publication History

Abstract

This paper investigates the influence of multimodal incongruent gender cues on the perception of a robot's uncanniness and gender in children. The back-projected robot head Furhat was equipped with a female and male face texture and voice synthesizer and the voice and facial cues were tested in congruent and incongruent combinations. 106 children between the age of 8 and 13 participated in the study. Results show that multimodal incongruent cues do not trigger the feeling of uncanniness in children. These results are significant as they support other recent research showing that the perception of uncanniness cannot be triggered by a categorical ambiguity in the robot. In addition, we found that children rely on auditory cues much stronger than on the facial cues when assigning a gender to the robot if presented with incongruent cues. These findings have implications for the robot design, as it seems possible to change the gender of a robot by only changing its voice without creating a feeling of uncanniness in a child.

References

[1]

CereProc Synthesizer. https://www.cereproc.com/. Accessed: 2016-05-08.

[2]

FaceGen Modeller. http://facegen.com/. Accessed: 2016-05-08.

[3]

S. Al Moubayed, J. Beskow, G. Skantze, and B. Granström. Furhat: a back-projected human-like robot head for multiparty human-machine interaction. In Cognitive Behavioural Systems, pages 114–130. Springer, 2012.

Digital Library

[4]

C. Bartneck, T. Kanda, H. Ishiguro, and N. Hagita. Is the uncanny valley an uncanny cliff? In The 16th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pages 368–373. IEEE, 2007.

[5]

C. Bartneck, T. Kanda, H. Ishiguro, and N. Hagita. My robotic doppelgänger - A critical look at the uncanny valley. In The 18th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pages 269–276. IEEE, 2009.

[6]

C. Bartneck, D. Kuli´ c, E. Croft, and S. Zoghbi. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. International Journal of Social Robotics, 1(1):71–81, 2009.

[7]

N. Borgers, E. De Leeuw, and J. Hox. Children as respondents in survey research: Cognitive development and response quality 1. Bulletin de Methodologie Sociologique, 66(1):60–75, 2000.

[8]

M. Cheetham, P. Suter, and L. Jäncke. The human likeness dimension of the “uncanny valley hypothesis”: behavioral and functional MRI findings. Frontiers in Human Neuroscience, 5(126):10–3389, 2011.

[9]

C.-C. Ho and K. F. MacDorman. Revisiting the uncanny valley theory: Developing and validating an alternative to the godspeed indices. Computers in Human Behavior, 26(6):1508–1518, 2010.

Digital Library

[10]

J. Kätsyri, K. Förger, M. Mäkäräinen, and T. Takala. A review of empirical evidence on different uncanny valley hypotheses: support for perceptual mismatch as one road to the valley of eeriness. Frontiers in Psychology, 6, 2015.

[11]

M. Latinus and P. Belin. Human voice perception. Current Biology, 21(4):R143–R145, 2011.

[12]

K. F. MacDorman and D. Chattopadhyay. Reducing consistency in human realism increases the uncanny valley effect; increasing category uncertainty does not. Cognition, 146:190–205, 2016.

[13]

K. F. MacDorman, R. D. Green, C.-C. Ho, and C. T. Koch. Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior, 25(3):695–710, 2009.

Digital Library

[14]

R. McDonnell, M. Breidt, and H. Bülthoff. Render me real?: investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics, 31(4):91, 2012.

Digital Library

[15]

L. F. Meah and R. K. Moore. The uncanny valley: A focus on misaligned cues. In 6th International Conference on Social Robotics (ICSR), pages 256–265. Springer, 2014.

[16]

T. Minato, M. Shimada, H. Ishiguro, and S. Itakura. Development of an android robot for studying human-robot interaction. In Innovations in Applied Artificial Intelligence, pages 424–434. Springer, 2004.

Digital Library

[17]

W. J. Mitchell, K. A. Szerszen, A. S. Lu, P. W. Schermerhorn, M. Scheutz, and K. F. MacDorman. A mismatch in the human realism of face and voice produces an uncanny valley. i-Perception, 2(1):10–12, 2011.

[18]

Y. Moon and C. Nass. How “real” are computer personalities? Psychological responses to personality types in human-computer interaction. Communication Research, 23(6):651–674, 1996.

[19]

R. K. Moore. A Bayesian explanation of the ’Uncanny Valley’ effect and related psychological phenomena. Scientific Reports, 2, 2012.

[20]

M. Mori, K. F. MacDorman, and N. Kageki. The uncanny valley {from the field}. Robotics & Automation Magazine, IEEE, 19(2):98–100, 2012.

[21]

E. Mower, M. J. Mataric, and S. Narayanan. Human perception of audio-visual synthetic character emotion expression in the presence of ambiguous and conflicting information. Multimedia, IEEE Transactions on, 11(5):843–855, 2009.

Digital Library

[22]

M. Paetzel, C. Peters, I. Nyström, and G. Castellano. Congruency matters - How ambiguous gender cues increase a robot’s uncanniness. In 8th International Conference on Social Robotics (ICSR), 2016.

[23]

A. M. Rosenthal-von der Pütten and N. C. Krämer. How design characteristics of robots determine evaluation and uncanny valley related responses. Computers in Human Behavior, 36:422–439, 2014.

Digital Library

[24]

G. Skantze and S. Al Moubayed. IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In Proceedings of the 14th ACM International Conference on Multimodal Interaction, pages 69–76. ACM, 2012.

Digital Library

[25]

A. Tinwell and R. J. Sloan. Children’s perception of uncanny human-like virtual characters. Computers in Human Behavior, 36:286–296, 2014.

Digital Library

[26]

M. L. Walters, D. S. Syrdal, K. Dautenhahn, R. Te Boekhorst, and K. L. Koay. Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion. Autonomous Robots, 24(2):159–178, 2008.

Digital Library

[27]

S. Woods, K. Dautenhahn, and J. Schulz. The design space of robots: Investigating children’s views. In Robot and Human Interactive Communication, 2004. ROMAN 2004. 13th IEEE International Workshop on, pages 47–52. IEEE, 2004.

Cited By

Robben DFukuda EDe Haas MCastellano GRiek LCakmak MLeite I(2023)The Effect of Gender on Perceived Anthropomorphism and Intentional Acceptance of a Storytelling RobotCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580134(495-499)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580134
Perugia GLisy D(2023)Robot’s Gendering Trouble: A Scoping Review of Gendering Humanoid Robots and Its Effects on HRIInternational Journal of Social Robotics10.1007/s12369-023-01061-615:11(1725-1753)Online publication date: 22-Nov-2023
https://doi.org/10.1007/s12369-023-01061-6
Seaborn KPennefather PSakamoto DWeiss AHiatt LShiomi M(2022)Neither "Hear" Nor "Their": Interrogating Gender Neutrality in RobotsProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523929(1030-1034)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523929
Show More Cited By

Index Terms

Effects of multimodal cues on children's perception of uncanniness in a social robot
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Intelligent agents
    2. Knowledge representation and reasoning
      1. Cognitive robotics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

The influence of appearance and interaction strategy of a social robot on the feeling of uncanniness in humans
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Most research on the uncanny valley effect is concerned with the influence of unimodal visual cues in the dimensions human-likeness and realism as a trigger of an uncanny feeling in humans. This leads to a lack of investigation how multimodality ...
Effects of Previous Exposure on Children’s Perception of a Humanoid Robot
Social Robotics
Abstract
The study described in this paper investigated the effects of previous exposure to robots on children’s perception of the Kaspar robot. 166 children aged between 7 and 11 participated in the study in the framework of a UK robotics week 2018 event, ...
Exploring the Effects of Robot Gender on Child-Robot Interaction
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

Despite the increase of research and applications for child-robot interactions, little is known about children»s responses to a robot»s gender across age and gender groups. This paper presents an exploratory study intended to examine whether the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

October 2016

605 pages

ISBN:9781450345569

DOI:10.1145/2993148

General Chairs:
Yukiko I. Nakano
Seikei University, Japan
,
Elisabeth André
Augsburg University, Germany
,
Toyoaki Nishida
Kyoto University, Japan
,
Program Chairs:
Louis-Philippe Morency
Carnegie Mellon University, USA
,
Carlos Busso
University of Texas at Dallas, USA
,
Catherine Pelachaud
ISIR, France / University of Paris6, France

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICMI '16

Sponsor:

SIGCHI

ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 12 - 16, 2016

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
299
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Robben DFukuda EDe Haas MCastellano GRiek LCakmak MLeite I(2023)The Effect of Gender on Perceived Anthropomorphism and Intentional Acceptance of a Storytelling RobotCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580134(495-499)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3580134
Perugia GLisy D(2023)Robot’s Gendering Trouble: A Scoping Review of Gendering Humanoid Robots and Its Effects on HRIInternational Journal of Social Robotics10.1007/s12369-023-01061-615:11(1725-1753)Online publication date: 22-Nov-2023
https://doi.org/10.1007/s12369-023-01061-6
Seaborn KPennefather PSakamoto DWeiss AHiatt LShiomi M(2022)Neither "Hear" Nor "Their": Interrogating Gender Neutrality in RobotsProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523929(1030-1034)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523929
Perugia GGuidi SBicchi MParlangeli OSakamoto DWeiss AHiatt LShiomi M(2022)The Shape of Our BiasProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523779(110-119)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523779
Dou XYan LWu KNiu J(2022)Effects of Voice and Lighting Color on the Social Perception of Home Healthcare RobotsApplied Sciences10.3390/app12231219112:23(12191)Online publication date: 28-Nov-2022
https://doi.org/10.3390/app122312191
Thunberg SArnelid MZiemke T(2022)Older Adults’ Perception of the Furhat RobotProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3561924(4-12)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3561924
Perugia GGuidi SBicchi MParlangeli O(2022)The Shape of Our Bias: Perceived Age and Gender in the Humanoid Robots of the ABOT Database2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889366(110-119)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889366
Seaborn KPennefather P(2022)Neither “Hear” Nor “Their”: Interrogating Gender Neutrality in Robots2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889350(1030-1034)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889350
Diel AWeigelt SMacdorman K(2021)A Meta-analysis of the Uncanny Valley's Independent and Dependent VariablesACM Transactions on Human-Robot Interaction10.1145/347074211:1(1-33)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3470742
Moon BChoi JKwak S(2021) "Pretending to be Okay in a Sad Voice": Social Robot’s Usage of Verbal and Nonverbal Cue Combination and its Effect on Human Empathy and Behavior Inducement * 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS51168.2021.9636709(854-861)Online publication date: 27-Sep-2021
https://doi.org/10.1109/IROS51168.2021.9636709
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents