research-article

Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction

Authors:

Yuchong HuAuthors Info & Claims

CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management

Pages 1401 - 1410

https://doi.org/10.1145/3357384.3357937

Published: 03 November 2019 Publication History

Abstract

The consistency of a response to a given post at semantic-level and emotional-level is essential for a dialogue system to deliver human-like interactions. However, this challenge is not well addressed in the literature, since most of the approaches neglect the emotional information conveyed by a post while generating responses. This article addresses this problem by proposing a unified end-to-end neural architecture, which is capable of simultaneously encoding the semantics and the emotions in a post for generating more intelligent responses with appropriately expressed emotions. Extensive experiments on real-world data demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both content coherence and emotion appropriateness.

References

[1]

Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, and Lei Zhang. 2018. Bottom-up and top-down attention for image captioning and visual question answering. In CVPR. 6077--6086.

[2]

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR .

[3]

Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In ACL workshop. 65--72.

[4]

Zoraida Callejas, David Griol, and Ramón López-Cózar. 2011. Predicting user mental states in spoken dialogue systems. EJASP (2011), 6.

[5]

Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In EMNLP .

[6]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv (2018).

[7]

John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. JMLR, Vol. 12, 7 (2011), 257--269.

[8]

Sayan Ghosh, Mathieu Chollet, Eugene Laksana, Louis-Philippe Morency, and Stefan Scherer. 2017. Affect-lm: A neural language model for customizable affective text generation. arXiv (2017).

[9]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.

[10]

Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P Xing. 2017. Toward controlled generation of text. In ICML .

[11]

Chenyang Huang, Osmar Zaiane, Amine Trabelsi, and Nouha Dziri. 2018. Automatic Dialogue Generation with Expressed Emotions. In NAACL. 49--54.

[12]

Sébastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. 2014. On using very large target vocabulary for neural machine translation. arXiv (2014).

[13]

Zongcheng Ji, Zhengdong Lu, and Hang Li. 2014. An information retrieval approach to short text conversation. arXiv (2014).

[14]

Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2015. A diversity-promoting objective function for neural conversation models. In NAACL .

[15]

Jiwei Li, Michel Galley, Chris Brockett, Georgios P Spithourakis, Jianfeng Gao, and Bill Dolan. 2016a. A persona-based neural conversation model. In ACL .

[16]

Jiwei Li, Will Monroe, and Dan Jurafsky. 2016b. A simple, fast diverse decoding algorithm for neural generation. arXiv (2016).

[17]

Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out (2004).

[18]

Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A structured self-attentive sentence embedding. arXiv (2017).

[19]

Chia-Wei Liu, Ryan Lowe, Iulian V Serban, Michael Noseworthy, Laurent Charlin, and Joelle Pineau. 2016. How not to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. In EMNLP .

[20]

Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective approaches to attention-based neural machine translation. In EMNLP .

[21]

Bilyana Martinovski and David Traum. 2003. Breakdown in human-machine interaction: the error is the clue. In ISCA tutorial and research workshop. 11--16.

[22]

Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv (2013).

[23]

Lili Mou, Yiping Song, Rui Yan, Ge Li, Lu Zhang, and Zhi Jin. 2016. Sequence to backward and forward sequences: A content-introducing approach to generative short-text conversation. In COLING .

[24]

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In ACL. 311--318.

[25]

Yehong Peng, Yizhen Fang, Zhiwen Xie, and Guangyou Zhou. 2019. Topic-enhanced emotional conversation generation with attention mechanism. KBS, Vol. 163 (2019), 429--437.

[26]

Robert Plutchik. 1980. A general psychoevolutionary theory of emotion. In Theories of emotion . Elsevier, 3--33.

[27]

Robert Plutchik. 2001. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American scientist, Vol. 89, 4 (2001), 344--350.

[28]

Helmut Prendinger, Junichiro Mori, and Mitsuru Ishizuka. 2005. Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. IJHCS (2005), 231--245.

[29]

Qiao Qian, Minlie Huang, Haizhou Zhao, Jingfang Xu, and Xiaoyan Zhu. 2017. Assigning personality/identity to a chatting machine for coherent conversation generation. arXiv (2017).

[30]

Alan Ritter, Colin Cherry, and William B Dolan. 2011. Data-driven response generation in social media. In EMNLP. 583--593.

[31]

Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C Courville, and Joelle Pineau. 2016. Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models. In AAAI. 3776--3784.

[32]

Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin, Joelle Pineau, Aaron Courville, and Yoshua Bengio. 2017. A hierarchical latent variable encoder-decoder model for generating dialogues. In AAAI .

[33]

Lifeng Shang, Zhengdong Lu, and Hang Li. 2015. Neural responding machine for short-text conversation. In ACL .

[34]

Yan Song, Shuming Shi, Jing Li, and Haisong Zhang. 2018. Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings. In NAACL. 175--180.

[35]

Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Margaret Mitchell, Jian-Yun Nie, Jianfeng Gao, and Bill Dolan. 2015. A neural network approach to context-sensitive generation of conversational responses. arXiv (2015).

[36]

Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In NIPS. 3104--3112.

[37]

Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, and Bing Qin. 2014. Learning sentiment-specific word embedding for twitter sentiment classification. In ACL . 1555--1565.

[38]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NIPS. 5998--6008.

[39]

Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R Selvaraju, Qing Sun, Stefan Lee, David Crandall, and Dhruv Batra. 2018. Diverse beam search: Decoding diverse solutions from neural sequence models. In AAAI .

[40]

Oriol Vinyals, Łukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. 2015. Grammar as a foreign language. In NIPS. 2773--2781.

[41]

Oriol Vinyals and Quoc Le. 2015. A neural conversational model. In ICML Deep Learning Workshop .

[42]

Richard Wallace. 2003. The elements of AIML style. Alice AI Foundation (2003).

[43]

Bruce Wilcox. 2011. Beyond Facc ade: Pattern matching for natural language applications. GamaSutra. com (2011).

[44]

Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, and Wei-Ying Ma. 2017. Topic Aware Neural Response Generation. In AAAI. 3351--3357.

[45]

Hainan Zhang, Yanyan Lan, Jiafeng Guo, Jun Xu, and Xueqi Cheng. 2018. Tailored Sequence to Sequence Models to Different Conversation Scenarios. In ACL . 1479--1488.

[46]

Hao Zhou, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. 2018a. Emotional chatting machine: Emotional conversation generation with internal and external memory. In AAAI .

[47]

Hao Zhou, Tom Young, Minlie Huang, Haizhou Zhao, Jingfang Xu, and Xiaoyan Zhu. 2018b. Commonsense Knowledge Aware Conversation Generation with Graph Attention. In IJCAI . 4623--4629.

[48]

Xianda Zhou and William Yang Wang. 2017. Mojitalk: Generating emotional responses at scale. arXiv (2017).

Cited By

Wen ZCao JShen JYang RLiu SSun M(2024)Personality-affected Emotion Generation in Dialog SystemsACM Transactions on Information Systems10.1145/365561642:5(1-27)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3655616
Chen CLi YWei CCui JWang BYan RAngélica LLattanzi SMuñoz Medina AAkoglu LGionis AVassilvitskii S(2024)Empathetic Response Generation with Relation-aware Commonsense KnowledgeProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635836(87-95)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1145/3616855.3635836
Li BFei HSu FLi FJi D(2024)Integrating discourse features and response assessment for advancing empathetic dialogueInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10380361:5Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.ipm.2024.103803
Show More Cited By

Index Terms

Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics
      2. Natural language generation

Recommendations

Target-guided Emotion-aware Chat Machine
The consistency of a response to a given post at the semantic level and emotional level is essential for a dialogue system to deliver humanlike interactions. However, this challenge is not well addressed in the literature, since most of the approaches ...
Positive Emotion Elicitation in Chat-Based Dialogue Systems

We aim to draw on an important overlooked potential of affective dialogue systems—their application to promote positive emotional states, similar to that of emotional support between humans. This can be achieved by eliciting a more positive emotional ...
Learning to Converse Emotionally Like Humans: A Conditional Variational Approach
Natural Language Processing and Chinese Computing
Abstract
Emotional intelligence is one of the key parts of human intelligence. Exploring how to endow conversation models with emotional intelligence is a recent research hotspot. Although several emotional conversation approaches have been introduced, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management

November 2019

3373 pages

ISBN:9781450369763

DOI:10.1145/3357384

General Chairs:
Wenwu Zhu
Tsinghua University, China
,
Dacheng Tao
University of Massachusetts, USA
,
Xueqi Cheng
Institute of Computing Technology, CAS, China
,
Program Chairs:
Peng Cui
Tsinghua University, China
,
Elke Rundensteiner
Worcester Polytechnic Institute, USA
,
David Carmel
Amazon Research, USA
,
Qi He
LinkedIn, USA
,
Jeffrey Xu Yu
Chinese University of Hong Kong, China

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

CIKM '19

Sponsor:

CIKM '19: The 28th ACM International Conference on Information and Knowledge Management

November 3 - 7, 2019

Beijing, China

Acceptance Rates

CIKM '19 Paper Acceptance Rate 202 of 1,031 submissions, 20%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
893
Total Downloads

Downloads (Last 12 months)110
Downloads (Last 6 weeks)15

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wen ZCao JShen JYang RLiu SSun M(2024)Personality-affected Emotion Generation in Dialog SystemsACM Transactions on Information Systems10.1145/365561642:5(1-27)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3655616
Chen CLi YWei CCui JWang BYan RAngélica LLattanzi SMuñoz Medina AAkoglu LGionis AVassilvitskii S(2024)Empathetic Response Generation with Relation-aware Commonsense KnowledgeProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635836(87-95)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1145/3616855.3635836
Li BFei HSu FLi FJi D(2024)Integrating discourse features and response assessment for advancing empathetic dialogueInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10380361:5Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.ipm.2024.103803
He YHuang XZou SZhang C(2024)PSAN: Prompt Semantic Augmented Network for aspect-based sentiment analysisExpert Systems with Applications10.1016/j.eswa.2023.121632238(121632)Online publication date: Mar-2024
https://doi.org/10.1016/j.eswa.2023.121632
Lou WYang WWei F(2023)DialogCIN: Contextual Inference Networks for Emotional Dialogue GenerationApplied Sciences10.3390/app1315862913:15(8629)Online publication date: 26-Jul-2023
https://doi.org/10.3390/app13158629
Zhang HSong HLi SZhou MSong D(2023)A Survey of Controllable Text Generation Using Transformer-based Pre-trained Language ModelsACM Computing Surveys10.1145/361768056:3(1-37)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3617680
Scott ANeumann DNiess JWoźniak P(2023)Do You Mind? User Perceptions of Machine ConsciousnessProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581296(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581296
Ren YHaonan ZFu LWang XZhou CChen HDuh WHuang HKato MMothe JPoblete B(2023)Distillation-Enhanced Graph Masked Autoencoders for Bundle RecommendationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591666(1660-1669)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591666
Noorani SKhan SMahmood AIshtiaq MRauf UAli Z(2023)Transformative Conversational AI: Sentiment Recognition in Chatbots via Transformers2023 25th International Multitopic Conference (INMIC)10.1109/INMIC60434.2023.10465887(1-6)Online publication date: 17-Nov-2023
https://doi.org/10.1109/INMIC60434.2023.10465887
Lu XZhao WZhao YQin BZhang ZWen J(2023)A Topic-Enhanced Approach for Emotion Distribution Forecasting in ConversationsICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10096414(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10096414
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents