short-paper

Open access

Perception of Emotion in Torso and Arm Movements on Humanoid Robot Quori

Authors:

Roshni Kaushik,

Reid SimmonsAuthors Info & Claims

HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

Pages 62 - 66

https://doi.org/10.1145/3434074.3447129

Published: 08 March 2021 Publication History

Abstract

Displaying emotional states is an important part of nonverbal communication that can facilitate successful interactions. Facial expressions have been studied for their emotional expression, but this work looks at the capacity of body movements to convey different emotions. This work first generates a large set of nonverbal behaviors with a variety of torso and arm properties on a humanoid robot, Quori. Participants in a user study evaluated how much each movement displayed each of eight different emotions. Results indicate that specific movement properties are associated with particular emotions; such as leaning backward and arms held high displaying surprise and leaning forward displaying sadness. Understanding the emotions associated with certain movements can allow for the design of more appropriate behaviors during interactions with humans and could improve people's perception of the robot.

References

[1]

Aryel Beck, Lola Ca namero, and Kim A. Bard. 2010. Towards an Affect Space for Robots to Display Emotional Body Language. In 19th International Symposium in Robot and Human Interactive Communication. IEEE, 464--469.

[2]

Stéphanie Buisine, Matthieu Courgeon, Aurélien Charles, Céline Clavel, Jean-Claude Martin, Ning Tan, and Ouriel Grynszpan. 2014. The Role of Body Postures in the Recognition of Emotions in Contextually Rich Scenarios. International Journal of Human-Computer Interaction, Vol. 30, 1 (2014), 52--62.

[3]

Mark Coulson. 2004. Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence. Journal of nonverbal behavior, Vol. 28, 2 (2004), 117--139.

[4]

Nele Dael, Marcello Mortillaro, and Klaus R. Scherer. 2012. Emotion Expression in Body Action and Posture. Emotion, Vol. 12, 5 (2012), 1085.

[5]

Paul Ekman. 1993. Facial Expression and Emotion. American psychologist, Vol. 48, 4 (1993), 384.

[6]

Paul Ekman and Wallace V. Friesen. 1978. Facial Action Coding Systems .Consulting Psychologists Press.

[7]

Brittney A. English, Alexis Coates, and Ayanna Howard. 2017. Recognition of Gestural Behaviors Expressed by Humanoid Robotic Platforms for Teaching Affect Recognition to Children with Autism-a Healthy Subjects Pilot Study. In International Conference on Social Robotics. Springer, 567--576.

[8]

Heather Knight and Reid Simmons. 2014. Expressive Motion with x, y and Theta: Laban Effort Features for Mobile Robots. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 267--273.

[9]

Heather Knight and Reid Simmons. 2016. Laban Head-Motions Convey Robot State: A Call for Robot Body Language. In 2016 IEEE International Conference on Robotics and Automation (ICRA ). IEEE, 2881--2888.

[10]

Rudolf Laban and Lisa Ullmann. 1971. The Mastery of Movement. (1971).

[11]

Derek McColl and Goldie Nejat. 2014. Recognizing Emotional Body Language Displayed by a Human-like Social Robot. International Journal of Social Robotics, Vol. 6, 2 (2014), 261--280.

[12]

Albert Mehrabian. 1971. Silent Messages. Vol. 8. Wadsworth Belmont, CA.

[13]

TIMOTHY P. Mottet and VIRGINIA P. Richmond. 2002. Student Nonverbal Communication and Its Influence on Teachers and Teaching. Communication for teachers (2002), 47--61.

[14]

Sunghyun Park, Lilia Moshkina, and Ronald C. Arkina. 2010. Recognizing Nonverbal Affective Behavior in Humanoid Robots. In Intelligent Autonomous Systems, Vol. 11. 12.

[15]

Rifca Peters, Joost Broekens, and Mark A. Neerincx. 2017. Robots Educate in Style: The Effect of Context and Non-Verbal Behaviour on Children's Perceptions of Warmth and Competence. In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO -MAN ). IEEE, 449--455.

[16]

Virginia P. Richmond, James C. McCroskey, and Mark Hickson. 2008. Nonverbal Behavior in Interpersonal Relations .Allyn & Bacon.

[17]

Rod D. Roscoe and Michelene TH Chi. 2007. Understanding Tutor Learning: Knowledge -Building and Knowledge-Telling in Peer Tutors' Explanations and Questions. Review of educational research, Vol. 77, 4 (2007), 534--574.

[18]

Shane Saunderson and Goldie Nejat. 2019. How Robots Influence Humans: A Survey of Nonverbal Communication in Social Humantextendash Robot Interaction. International Journal of Social Robotics, Vol. 11, 4 (2019), 575--608.

[19]

Sofia Serholt and Wolmet Barendregt. 2016. Robots Tutoring Children: Longitudinal Evaluation of Social Engagement in Child-Robot Interaction. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, 64.

Digital Library

[20]

Megha Sharma, Dale Hildebrandt, Gem Newman, James E. Young, and Rasit Eskicioglu. 2013. Communicating Affect via Flight Path: Exploring Use of the Laban Effort System for Designing Affective Locomotion Paths. In Proceedings of the 8th ACM /IEEE International Conference on Human -Robot Interaction. IEEE Press, 293--300.

[21]

Mohammad Shayganfar, Charles Rich, and Candace L. Sidner. 2012. A Design Methodology for Expressing Emotion on Robot Faces. In 2012 IEEE /RSJ International Conference on Intelligent Robots and Systems. IEEE, 4577--4583.

[22]

Howard A. Smith. 1979. Nonverbal Communication in Teaching. Review of Educational Research, Vol. 49, 4 (1979), 631--672.

[23]

Andrew Specian, Nick Eckenstein, Mark Yim, Ross Mead, Braden McDorman, Simon Kim, and Maja Matarić. 2018. Preliminary System and Hardware Design for Quori, a Low-Cost, Modular, Socially Interactive Robot. In Workshop on Social Robots in the Wild.

[24]

Ioanna-Ourania Stathopoulou and George A. Tsihrintzis. 2011. Emotion Recognition from Body Movements and Gestures. In Intelligent Interactive Multimedia Systems and Services. Springer, 295--303.

[25]

Anita E. Woolfolk and Douglas M. Brooks. 1983. Chapter 5: Nonverbal Communication in Teaching. Review of research in education, Vol. 10, 1 (1983), 103--149.

[26]

Junchao Xu, Joost Broekens, Koen Hindriks, and Mark A. Neerincx. 2013. Mood Expression through Parameterized Functional Behavior of Robots. IEEE.

[27]

Junchao Xu, Joost Broekens, Koen Hindriks, and Mark A. Neerincx. 2014. Effects of Bodily Mood Expression of a Robotic Teacher on Students. In 2014 IEEE /RSJ International Conference on Intelligent Robots and Systems. IEEE, 2614--2620.

Cited By

Gao WShen SJi YTian Y(2024)Human Perception of the Emotional Expressions of Humanoid Robot Body Movements: Evidence from Survey and Eye-Tracking MeasurementsBiomimetics10.3390/biomimetics91106849:11(684)Online publication date: 8-Nov-2024
https://doi.org/10.3390/biomimetics9110684
Sica ASætra HGrollman DBroadbent EJu WSoh HWilliams T(2024)Artificial Emotions and the Evolving Moral Status of Social RobotsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634934(649-657)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634934
Cárdenas PGarcía JBegazo RAguilera ADongo ICardinale Y(2024)Evaluation of Robot Emotion Expressions for Human–Robot InteractionInternational Journal of Social Robotics10.1007/s12369-024-01167-5Online publication date: 30-Sep-2024
https://doi.org/10.1007/s12369-024-01167-5
Show More Cited By

Index Terms

Perception of Emotion in Torso and Arm Movements on Humanoid Robot Quori
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing design and evaluation methods
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Perceiving emotions in robot body language

Reliance on socioemotional assistive robots is projected to increase, yet little is known about how our ability to perceive their emotional expression is impacted by psychological factors. In high-risk and high-tension domains such as emergency services ...
Interaction of robot with humans by communicating simulated emotional states through expressive movements

This paper presents a non-verbal and non-facial method for effective communication of a "mechanoid robot" by conveying the emotions through gestures. This research focuses on human---robot interaction using a mechanoid robot that does not possess any ...
The Role of Empathic Traits in Emotion Recognition and Emotion Contagion of Cozmo Robots
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

In this online study, we investigated how well people could recognize emotions displayed by video recordings of a Cozmo robot, and the extent to which emotion recognition is shaped by individuals' empathic traits. We also explored whether participants ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

March 2021

756 pages

ISBN:9781450382908

DOI:10.1145/3434074

General Chairs:
Cindy Bethel
Mississippi State University, USA
,
Ana Paiva
INESC-ID, IST, University of Lisbon, Portugal & Radcliffe Institute for Advanced Study, Harvard University, USA
,
Program Chairs:
Elizabeth Broadbent
University of Auckland, New Zealand
,
David Feil-Seifer
University of Nevada Reno, USA
,
Daniel Szafir
University of Colorado Boulder, USA

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2021

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

NSF (National Science Foundation)

Conference

HRI '21

Sponsor:

HRI '21: ACM/IEEE International Conference on Human-Robot Interaction

March 8 - 11, 2021

CO, Boulder, USA

Acceptance Rates

Overall Acceptance Rate 192 of 519 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
563
Total Downloads

Downloads (Last 12 months)128
Downloads (Last 6 weeks)22

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao WShen SJi YTian Y(2024)Human Perception of the Emotional Expressions of Humanoid Robot Body Movements: Evidence from Survey and Eye-Tracking MeasurementsBiomimetics10.3390/biomimetics91106849:11(684)Online publication date: 8-Nov-2024
https://doi.org/10.3390/biomimetics9110684
Sica ASætra HGrollman DBroadbent EJu WSoh HWilliams T(2024)Artificial Emotions and the Evolving Moral Status of Social RobotsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634934(649-657)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634934
Cárdenas PGarcía JBegazo RAguilera ADongo ICardinale Y(2024)Evaluation of Robot Emotion Expressions for Human–Robot InteractionInternational Journal of Social Robotics10.1007/s12369-024-01167-5Online publication date: 30-Sep-2024
https://doi.org/10.1007/s12369-024-01167-5
Johansen SDonovan JRittenbruch MCastellano GRiek LCakmak MLeite I(2023)Illustrating Robot MovementsProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576956(231-242)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576956
Yoshimura NSato YKageyama YMurao JYagi SPunpongsanon PSakamoto DWeiss AHiatt LShiomi M(2022)Hugmon: Exploration of Affective Movements for Hug Interaction using Tensegrity RobotProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523944(1105-1109)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523944
Gao WCeccarelli M(2022)Design and Performance Analysis of LARMbot Torso V1Micromachines10.3390/mi1309154813:9(1548)Online publication date: 18-Sep-2022
https://doi.org/10.3390/mi13091548
de Wit JVogt PKrahmer E(2022)The Design and Observed Effects of Robot-performed Manual Gestures: A Systematic ReviewACM Transactions on Human-Robot Interaction10.1145/354953012:1(1-62)Online publication date: 19-Jul-2022
https://dl.acm.org/doi/10.1145/3549530
Kaushik RSimmons R(2022)Affective Robot Behavior Improves Learning in a Sorting Game2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN53752.2022.9900654(436-441)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1109/RO-MAN53752.2022.9900654
Yoshimura NSato YKageyama YMurao JYagi SPunpongsanon P(2022)Hugmon: Exploration of Affective Movements for Hug Interaction using Tensegrity Robot2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889410(1105-1109)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889410

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents