research-article

Metaphorical affect sensing in an intelligent conversational agent

Author:

Li ZhangAuthors Info & Claims

ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology

Pages 100 - 106

https://doi.org/10.1145/1501750.1501773

Published: 03 December 2008 Publication History

Abstract

We report new developments of an affect detection component on the processing of several different types of metaphorical affective expressions. The component has been embedded in an intelligent conversational AI agent interacting with human users under loose scenarios. The detected affective states also play an important role in producing emotional animation for users' avatars. Evaluation for the affect detection component is provided. Our work contributes to the conference themes on human-robots interaction based on affect sensing, affective computing, learning and children, narrative storytelling and evaluation of affective social interaction.

References

[1]

Zhang, L., Barnden, J. A., Hendley, R. J., Lee, M. G., Wallington, A. M. and Wen, Z. 2008. Affect Detection and Metaphor in E-drama. Int. J. Continuing Engineering Education and Life-Long Learning, Vol. 18, No. 2, 234--252.

[2]

Liu, H. & Singh, P. 2004. ConceptNet: A practical commonsense reasoning toolkit. BT Technology Journal, Volume 22, Kluwer Academic Publishers.

Digital Library

[3]

Shaikh, M. A. M., Prendinger, H. & Mitsuru, I. 2007. Assessing sentiment of text by semantic dependency and contextual valence analysis. In Proceeding of ACII 2007, 191--202.

Digital Library

[4]

Mateas, M. 2002. Ph.D. Thesis. Interactive Drama, Art and Artificial Intelligence. School of Computer Science, Carnegie Mellon University.

Digital Library

[5]

Zhe, X. & Boucouvalas, A. C. 2002. Text-to-Emotion Engine for Real Time Internet Communication. In Proceedings of International Symposium on Communication Systems, Networks and DSPs, Staffordshire University, UK, 164--168.

[6]

Boucouvalas, A. C. 2002. Real Time Text-to-Emotion Engine for Expressive Internet Communications. In Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments. G. Riva, F. Davide and W. IJsselsteijn (eds.), 305--318.

[7]

Craggs, R. & Wood. M. 2004. A Two Dimensional Annotation Scheme for Emotion in Dialogue. In Proceedings of AAAI Spring Symposium: Exploring Attitude and Affect in Text.

[8]

Egges, A., Kshirsagar, S. & Magnenat-Thalmann, N. 2003. A Model for Personality and Emotion Simulation, In Proceedings of Knowledge-Based Intelligent Information & Engineering Systems (KES2003), Lecture Notes in AI. Springer-Verlag: Berlin, 453--461.

[9]

Elliott, C., Rickel, J. & Lester, J. 1997. Integrating Affective Computing into Animated Tutoring Agents. In Proceedings of IJCAI'97 Workshop on Intelligent Interface Agents, 113--121.

[10]

Aylett, R., Louchart, S., Dias, J., Paiva, A., Vala M., Woods, S. Hall, L. E. 2006. Unscripted Narrative for Affectively Driven Characters. IEEE Computer Graphics and Applications 26(3). 42--52.

Digital Library

[11]

Cavazza, M., Smith, C., Charlton, D., Zhang, L., Turunen, M. and Hakulinen, J. 2008. A 'Companion' ECA with Planning and Activity Modelling. In Proceedings of the 7th International Conference on Autonomous Agents and Multi-Agent Systems. Portugal, 1281--1284.

Digital Library

[12]

Esuli 1, A. and Sebastiani, F. 2006. Determining Term Subjectivity and Term Orientation for Opinion Mining. In Proceedings of EACL-06, 11th Conference of the European Chapter of the Association for Computational Linguistics, Trento, IT. 193--200.

[13]

ATT-Meta Project Databank: Examples of Usage of Metaphors of Mind. http://www.cs.bham.ac.uk/~jab/ATT-Meta/Databank/. July 2008.

[14]

Kövecses, Z. 1998. Are There Any Emotion-Specific Metaphors? In Speaking of Emotions: Conceptualization and Expression. Athanasiadou, A. and Tabakowska, E. (eds.), Berlin and New York: Mouton de Gruyter, 127--151.

[15]

Strapparava, C. and Valitutti, A. 2004. WordNet-Affect: An Affective Extension of WordNet, In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, 1083--1086.

[16]

Rayson, P. 2003. Matrix: A statistical method and software tool for linguistic analysis through corpus comparison. Ph.D. thesis, Lancaster University.

[17]

Zhang, L., Gillies, M. & Barnden, J. A. 2008. EMMA: an Automated Intelligent Actor in E-drama. In Proceedings of International Conference on Intelligent User Interfaces. Canary Islands, Spain, 409--412.

Digital Library

[18]

Sharoff, S. 2005. How to Handle Lexical Semantics in SFL: a Corpus Study of Purposes for Using Size Adjectives. Systemic Linguistics and Corpus. London: Continuum.

[19]

Gillies, M. & Ballin, D. 2004. Integrating autonomous behavior and user control for believable agents. In Proceedings of the Third International Joint Conference on Autonomous Agents and Multi-Agent Systems. Columbia University, New York, 336--343.

Digital Library

Cited By

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Beaver I(2022)The success of Conversational AI and the AI evaluation challenge it revealsAI Magazine10.1002/aaai.1203043:1(139-141)Online publication date: 31-Mar-2022
https://doi.org/10.1002/aaai.12030
Sharma KPapavlasopoulou SGiannakos M(2021)Faces Don’t Lie: Analysis of Children’s Facial expressions during Collaborative CodingFabLearn Europe / MakeEd 2021 - An International Conference on Computing, Design and Making in Education10.1145/3466725.3466757(1-10)Online publication date: 2-Jun-2021
https://dl.acm.org/doi/10.1145/3466725.3466757
Show More Cited By

Index Terms

Metaphorical affect sensing in an intelligent conversational agent
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics
      2. Language resources

Recommendations

An intelligent agent with affect sensing from metaphorical language and speech
ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment Technology

We report new developments on affect detection from textual metaphorical affective expression and affect sensing from speech. The textual affect detection component has been embedded in an intelligent conversational AI agent interacting with human users ...
Automatic detection of learner's affect from conversational cues

We explored the reliability of detecting a learner's affect from conversational features extracted from interactions with AutoTutor, an intelligent tutoring system (ITS) that helps students learn by holding a conversation in natural language. Training ...
Toward an Affect-Sensitive AutoTutor

Emotions (affective states) are inextricably bound to the learning process, as are cognition, motivation, discourse, action, and the environment. Augmenting an intelligent tutoring system with the ability to incorporate such states into its pedagogical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology

December 2008

427 pages

ISBN:9781605583938

DOI:10.1145/1501750

General Chairs:
Masa Inakage
Keio University Graduate School of Media Design
,
Adrian David Cheok
Keio University Graduate School of Media Design/National University of Singapore

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IPSJ: Information Processing Society of Japan
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ACE2008

Sponsor:

IPSJ
SIGCHI

ACE2008: International Conference in Advances in Computer Entertainment Technology

December 3 - 5, 2008

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
277
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Beaver I(2022)The success of Conversational AI and the AI evaluation challenge it revealsAI Magazine10.1002/aaai.1203043:1(139-141)Online publication date: 31-Mar-2022
https://doi.org/10.1002/aaai.12030
Sharma KPapavlasopoulou SGiannakos M(2021)Faces Don’t Lie: Analysis of Children’s Facial expressions during Collaborative CodingFabLearn Europe / MakeEd 2021 - An International Conference on Computing, Design and Making in Education10.1145/3466725.3466757(1-10)Online publication date: 2-Jun-2021
https://dl.acm.org/doi/10.1145/3466725.3466757
Sharma KPapavlasopoulou SLee-Cultura SGiannakos MRoussou MShahid SFails JLandoni M(2021)Information flow and children’s emotions during collaborative coding: A causal analysisProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3460731(350-362)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3459990.3460731
Sharma KPapavlasopoulou SGiannakos MFails J(2019)Joint Emotional State of Children and Perceived Collaborative Experience in Coding ActivitiesProceedings of the 18th ACM International Conference on Interaction Design and Children10.1145/3311927.3323145(133-145)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3311927.3323145
Sharma KPapavlasopoulou SGiannakos M(undefined)Children's Facial Expressions During Collaborative Coding: Objective Versus Subjective PerformancesSSRN Electronic Journal10.2139/ssrn.4003866
https://doi.org/10.2139/ssrn.4003866

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents