abstract

Recognizing emotions in spoken dialogue with acoustic and lexical cues

Authors:

ISIAA 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents

Pages 45 - 46

https://doi.org/10.1145/3139491.3139497

Published: 13 November 2017 Publication History

Get Access

Abstract

Emotions play a vital role in human communications. Therefore, it is desirable for virtual agent dialogue systems to recognize and react to user's emotions. However, current automatic emotion recognizers have limited performance compared to humans. Our work attempts to improve performance of recognizing emotions in spoken dialogue by identifying dialogue cues predictive of emotions, and by building multimodal recognition models with a knowledge-inspired hierarchy. We conduct experiments on both spontaneous and acted dialogue data to study the efficacy of the proposed approaches. Our results show that including prior knowledge on emotions in dialogue in either the feature representation or the model structure is beneficial for automatic emotion recognition.

References

[1]

Johanna Moore, Leimin Tian, and Catherine Lai. 2014. Word-level emotion recognition using high-level features. In Proceedings of 15th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing’14). Springer, Kathmandu, Nepal, 17–31.

Digital Library

Google Scholar

[2]

Leimin Tian, Johanna Moore, and Catherine Lai. 2016. Recognizing emotions in spoken dialogue with hierarchically fused acoustic and lexical features. Proceedings of 2016 Spoken Language Technology Workshop (SLT’16) (2016), 565–572.

Crossref

Google Scholar

[3]

Leimin Tian, Johanna D Moore, and Catherine Lai. 2015. Emotion recognition in spontaneous and acted dialogues. In Proceedings of 6th International Conference on Affective Computing and Intelligent Interaction (ACII’15). IEEE, Xi’an, China, 698–704.

Digital Library

Google Scholar

[4]

Leimin Tian, Michal Muszynski, Catherine Lai, Johanna D Moore, Theodoros Kostoulas, Patrizia Lombardo, Thierry Pun, and Guillaume Chanel. 2017. Recognizing induced emotions of movie audiences: Are induced and perceived emotions the same?. In Proceedings of 7th International Conference on Affective Computing and Intelligent Interaction (ACII’17). IEEE, San Antonio, Texas, USA, 28–35. Abstract 1 Introduction 2 DIS-NV Features 3 HL Fusion 4 Conclusions and Discussion References

Crossref

Google Scholar

Cited By

View all

Elshan EZierau NEngel CJanson ALeimeister J(2022)Understanding the Design Elements Affecting User Acceptance of Intelligent Agents: Past, Present and FutureInformation Systems Frontiers10.1007/s10796-021-10230-924:3(699-730)Online publication date: 4-Jan-2022
https://doi.org/10.1007/s10796-021-10230-9
Koutsombogera MVogel C(2019)Observing Collaboration in Small-Group InteractionMultimodal Technologies and Interaction10.3390/mti30300453:3(45)Online publication date: 28-Jun-2019
https://doi.org/10.3390/mti3030045
Braley MMurray G(2018)The Group Affect and Performance (GAP) CorpusProceedings of the Group Interaction Frontiers in Technology10.1145/3279981.3279985(1-9)Online publication date: 16-Oct-2018
https://dl.acm.org/doi/10.1145/3279981.3279985

Index Terms

Recognizing emotions in spoken dialogue with acoustic and lexical cues
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics

Recommendations

Designing Expressive Lights and In-Situ Motions for Robots to Express Emotions
HAI '18: Proceedings of the 6th International Conference on Human-Agent Interaction

In this paper, we explore how a utility robot might express emotions via expressive lights and in-situ motions. In most previous work, methods for either modality were investigated alone, leaving a huge potential to improve the expression of emotions by ...
Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent
Special issue: Subtle expressivity for characters and robots

Embodied computer agents are becoming an increasingly popular human-computer interaction technique. Often, these agents are programmed with the capacity for emotional expression. This paper investigates the psychological effects of emotion in agents ...
Generation and Evaluation of Audio-Visual Anger Emotional Expression for Android Robot
HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

Recent studies in human-human interaction (HHI) have revealed the propensity of negative emotional expression to initiate affiliating functions that are beneficial to the expresser and also help to foster cordiality and closeness amongst interlocutors. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ISIAA 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents

November 2017

48 pages

ISBN:9781450355582

DOI:10.1145/3139491

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2017

Check for updates

Author Tags

Qualifiers

Abstract

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13, 2017

Glasgow, UK

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
223
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Elshan EZierau NEngel CJanson ALeimeister J(2022)Understanding the Design Elements Affecting User Acceptance of Intelligent Agents: Past, Present and FutureInformation Systems Frontiers10.1007/s10796-021-10230-924:3(699-730)Online publication date: 4-Jan-2022
https://doi.org/10.1007/s10796-021-10230-9
Koutsombogera MVogel C(2019)Observing Collaboration in Small-Group InteractionMultimodal Technologies and Interaction10.3390/mti30300453:3(45)Online publication date: 28-Jun-2019
https://doi.org/10.3390/mti3030045
Braley MMurray G(2018)The Group Affect and Performance (GAP) CorpusProceedings of the Group Interaction Frontiers in Technology10.1145/3279981.3279985(1-9)Online publication date: 16-Oct-2018
https://dl.acm.org/doi/10.1145/3279981.3279985

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Designing Expressive Lights and In-Situ Motions for Robots to Express Emotions

Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent

Generation and Evaluation of Audio-Visual Anger Emotional Expression for Android Robot