research-article

System Personality and Persuasion in Human-Computer Dialogue

Author:

Pierre Y. AndrewsAuthors Info & Claims

ACM Transactions on Interactive Intelligent Systems (TiiS), Volume 2, Issue 2

Article No.: 12, Pages 1 - 27

https://doi.org/10.1145/2209310.2209315

Published: 01 June 2012 Publication History

Abstract

The human-computer dialogue research field has been studying interaction with computers since the early stage of Artificial Intelligence, however, research has often focused on very practical tasks to be completed with the dialogues. A new trend in the field tries to implement persuasive techniques with automated interactive agents; unlike booking a train ticket, for example, such dialogues require the system to show more anthropomorphic qualities. The influences of such qualities in the effectiveness of persuasive dialogue is only starting to be studied. In this article we focus on one important perceived trait of the system: personality, and explore how it influences the persuasiveness of a dialogue system. We introduce a new persuasive dialogue system and combine it with a state of the art personality utterance generator. By doing so, we can control the system’s extraversion personality trait and observe its influence on the user’s perception of the dialogue and its output. In particular, we observe that the user’s extraversion influences their perception of the dialogue and its persuasiveness, and that the perceived personality of the system can affect its trustworthiness and persuasiveness. We believe that theses observations will help to set up guidelines to tailor dialogue systems to the user’s interaction expectations and improve the persuasive interventions.

Supplementary Material

PDF File (a12-andrews_appendix.pdf)

The proof is given in an electronic appendix, available online in the ACM Digital Library.

Download
123.12 KB

References

[1]

Allen, J. F., Ferguson, G., and Stent, A. 2001. An architecture for more realistic conversational systems. In Proceedings of the 6th International Conference on Intelligent User Interfaces (IUI). ACM Press, New York, NY, 1--8.

Digital Library

[2]

Andrews, P. and Manandhar, S. 2009a. Measure of belief change as an evaluation of persuasion. In Persuasive Technology and Digital Behaviour Intervention Symposium, J. Masthoff and F. Grasso Eds., The Society for the Study of Artificial Intelligence and the Simulation of Behaviour, London, UK.

[3]

Andrews, P. and Manandhar, S. 2009b. A SVM cascade for agreement/disagreement classifcation. Journal du Traitement Automatique des Langues (Special Issue on Machine Learning for NLP) 50, 3, 89--107.

[4]

Andrews, P., Manandhar, S., and De Boni, M. 2008. Argumentative human computer dialogue for automated persuasion. In Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue. The Association for Computational Linguistics. 138--147.

Digital Library

[5]

Barakova, E., de Ruyter, B., and Spink, A., Eds. 2010. Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research (MB). ACM, New York, NY.

[6]

Basili, R., Lemon, O., Webb, N., and Webber, B., Eds. 2006. Proceedings of the Interactive Question Answering Workshop at HLT-NAACL. Association for Computational Linguistics, Stroudsburd, PA.

[7]

Bench-Capon, T. J. M. 2003a. Persuasion in practical argument using value-based argumentation frameworks. J. Logic Computat. 13, 3, 429--448.

[8]

Bench-Capon, T. J. M. 2003b. Try to see it my way: Modelling persuasion in legal discourse. Artif. Intell. Law 11, 4, 271--287.

Digital Library

[9]

Bench-Capon, T. J. M., Atkinson, K., and Chorley, A. 2005. Persuasion and value in legal argument. J. Logic Computat. 15, 6, 1075--1097.

Digital Library

[10]

Bickmore, T. W. and Picard, R. W. 2005. Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput.-Hum. Interact. 12, 2, 293--327.

Digital Library

[11]

Breivik, E. and Supphellen, M. 2003. Elicitation of product attributes in an evaluation context: A comparison of three elicitation techniques. J. Econ. Psychol. 24, 1, 77--98.

[12]

Carenini, G. and Moore, J. D. 2000. An empirical study of the influence of argument conciseness on argument effectiveness. In Proceedings of the 38th Annual Meeting on Association for Computational Linguistics. H. Iida Ed., 150--157.

Digital Library

[13]

Cassell, J. and Bickmore, T. W. 2002. Negotiated collusion: Modeling social language and its relationship effects in intelligent agents. User Model. Adapt. Interfaces 13, 1--2, 89--132.

Digital Library

[14]

Cavazza, M., Smith, C., Charlton, D., Crook, N., Boye, J., Pulman, S. G., Moilanen, K., Pizzi, D., de la Camara, R. S., and Turunen, M. 2010. Persuasive dialogue based on a narrative theory: An ECA implementation. In Proceedings of Persuasive Technology 5th International Conference (PERSUASIVE). Lecture Notes in Computer Science, vol. 6137, Springer, 250--261.

Digital Library

[15]

Cook, J. and Salvendy, G. 1989. Perception of computer dialogue personality: An exploratory study. Int. J. Man-Mach. Studies 31, 6, 717--728.

Digital Library

[16]

De Boni, M., Richardson, A., and Hurling, R. 2008. Humour, relationship maintenance and personality matching in automated dialogue: A controlled study. Interact. Comput. 20, 3, 342--353.

Digital Library

[17]

Edwards, W. 1994. SMARTS and SMARTER: Improved simple methods for multiattribute utility measurement. Organiz. Behav. Hum. Decision Proc. 60, 3, 306--325.

[18]

Fagin, R., Kumar, R., and Sivakumar, D. 2003. Comparing top k lists. In Proceedings of the 14th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). SIAM, Philadelphia, PA, 28--36.

Digital Library

[19]

Fogg, B. J. 2003. Persuasive Technology: Using Computers To Change What We Think And Do. Morgan Kaufmann, San Francisco, CA.

Digital Library

[20]

Gilbert, M. A., Grasso, F., Groarke, L., Gurr, C., and Gerlofs, J. M. 2003. The persuasion machine. In Argumentation Machines: New Frontiers in Argument and Computation (Argumentation Library), Chapter 5, 121--174.

[21]

Gosling, S. D., Rentfrow, P. J., and Swann, W. B. 2003. A very brief measure of the big-five personality domains. J. Res. Personal. 37, 6, 504--528.

[22]

Guerini, M., Stock, O., and Zancanaro, M. 2004. Persuasive strategies and rhetorical relation selection. In Proceedings of the European Conference on Artificial Intelligence Workshop on Computational Models of Natural Argument. IOS Press, Valencia, Spain.

[23]

Guerini, M., Strapparava, C., and Stock, O. 2010. Evaluation metrics for persuasive NLP with Google Adwords. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC). 19--21.

[24]

Halko, S. and Kientz, J. A. 2010. Personality and persuasive technology: An exploratory study on health-promoting mobile applications. In Proceedings of Persuasive Technology 5th International Conference (PERSUASIVE). Lecture Notes in Computer Science, vol. 6137, Springer, 150--161.

Digital Library

[25]

Jameson, A. 2008. Adaptive interfaces and agents. In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications 2nd Ed., A. Sears and J. A. Jacko Eds., CRC Press, Boca Raton, FL, 433--458.

Digital Library

[26]

Kaptein, M., Lacroix, J., and Saini, P. 2010. Individual differences in persuadability in the health promotion domain. In Proceedings of Persuasive Technology 5th International Conference (PERSUASIVE). Lecture Notes in Computer Science, vol. 6137, Springer, 94--105.

Digital Library

[27]

Kendall, M. and Gibbons, J. D. 1990. Rank Correlation Methods 5th Ed. Charles Griffin Book Series. Oxford University Press, Oxford, UK.

[28]

Kroeze, W., Werkman, A., and Brug, J. 2006. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Annals Behav. Med. 31, 3, 205--223.

[29]

Lafferty, J. C. and Eady, P. M. 1974. The Desert Survival Problem. Experimental Learning Methods. Plymouth, MI.

[30]

Lavoie, B. and Rambow, O. 1997. A fast and portable realizer for text generation systems. In Proceedings of the 5th Conference on Applied Natural Language Processing (ANLC). Association for Computational Linguistics, Stroudsburg, PA, 265--268.

Digital Library

[31]

Mairesse, F. and Walker, M. 2007. PERSONAGE: Personality generation for dialogue. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL). The Association for Computational Linguistics, Stroudsburg, PA.

[32]

Mason, W. and Suri, S. 2010. Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 1--23.

[33]

Masthoff, J. and Grasso, F., Eds. 2009. Persuasive Technology and Digital Behaviour Intervention Symposium. The Society for the Study of Artificial Intelligence and the Simulation of Behaviour, London, UK.

[34]

Mazzotta, I., de Rosis, F., and Carofiglio, V. 2007. Portia: A user-adapted persuasion system in the healthy-eating domain. IEEE Intell. Syst. 22, 6, 42--51.

Digital Library

[35]

Moon, Y. 1998. The effects of distance in local versus remote human-computer interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press/Addison-Wesley Publishing Co., New York, NY, 103--108.

Digital Library

[36]

Neville, L. M., O’Hara, B., and Milat, A. J. 2009. Computer-tailored dietary behavior change interventions: A systematic review. Health Educat. Res. 42, 4, 699--720.

[37]

Niculescu, A. I., van Dijk, E. M. A. G., Cao, Y., and Nijholt, A. 2010. Measuring stress and cognitive load effects on the perceived quality of a multimodal dialogue system. In Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research (MB). ACM, New York, NY, 453--455.

[38]

Norman, T. J. and Reed, C. 2003. Argumentation Machines: New Frontiers in Argument and Computation (Argumentation Library). Springer.

[39]

Norman, W. T. 1963. Toward an adequate taxonomy of personality attributes: Replicated factors structure in peer nomination personality ratings. J. Abnorm. Soc. Psychol. 66, 574--583.

[40]

Pervin, L. A. and John, O. P. 2001. Handbook of Personality: Theory and Research 2nd Ed. The Guilford Press.

[41]

Quarteroni, S. and Manandhar, S. 2009. Designing an interactive open domain question answering system. Natural Lang. Eng. (Special Issue on Interactive Question Answering) 15, 1, 73--95.

Digital Library

[42]

R Development Core Team. 2010. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0.

[43]

Reed, C. 1998. Generating arguments in natural language. Ph.D. thesis, University College London.

[44]

Reeves, B. and Nass, C. 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press.

Digital Library

[45]

Reips, U. 2002. Standards for Internet-based experimenting. Exper. Psychol. 49, 243--256.

[46]

Reiter, E., Robertson, R., and Osman, L. M. 2003. Lessons from a failure: Generating tailored smoking cessation letters. Artif. Intell. 144, 1--2, 41--58.

Digital Library

[47]

Rosis, F., Novielli, N., Carofiglio, V., Cavalluzzi, A., and Carolis, B. D. 2006. User modeling and adaptation in health promotion dialogs with an animated character. J. Biomed. Informatics 39, 5, 514--531.

Digital Library

[48]

Schmitt, C., Dengler, D., and Bauer, M. 2003. Multivariate preference models and decision making with the MAUT machine. In User Modeling 2003, P. Brusilovsky, A. Corbett and F. de Rosis Eds., Lecture Notes in Computer Science, vol. 2702, Springer, 148.

Digital Library

[49]

Schulman, D. and Bickmore, T. 2009. Persuading users through counseling dialogue with a conversational agent. In Proceedings of the 4th International Conference on Persuasive Technology (PERSUASIVE). ACM, New York, NY, 25:1--25:8.

Digital Library

[50]

Seneff, S. and Polifroni, J. 2000. Dialogue management in the mercury fight reservation system. In Proceedings of the ANLP/NAACL Workshop on Conversational Systems. ANLP/NAACL-ConvSyst’00 Series, vol. 3. Association for Computational Linguistics, Stroudsburg, PA, 11--16.

Digital Library

[51]

Stent, A. 2002. A conversation acts model for generating spoken dialogue contributions. Comput. Speech Lang. 16, 3--4, 313--352.

[52]

Stiff, J. B. and Mongeau, P. A. 2002. Persuasive Communication 2nd Ed. The Guilford Press.

[53]

Tørning, K. and Oinas-Kukkonen, H. 2009. Persuasive system design: State of the art and future directions. In Proceedings of the International Conference on Persuasive Technology (PERSUASIVE). ACM, New York, NY.

Digital Library

[54]

Varges, S., Quarteroni, S., Riccardi, G., and Ivanov, A. V. 2010. Investigating clarification strategies in a hybrid POMDP dialog manager. In Proceedings of SIGDial. The Association for Computer Linguistics, Stroudsburg, PA, 213--216.

Digital Library

[55]

Walker, M. A., Litman, D. J., Kamm, C. A., and Abella, A. 1997. Paradise: A framework for evaluating spoken dialogue agents. In Proceedings of the 8th Conference of European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Stroudsburg, PA, 271--280.

Digital Library

[56]

Walker, M. A., Whittaker, S. J., Stent, A., Maloor, P., Moore, J., Johnston, M., and Vasireddy, G. 2004. Generation and evaluation of user tailored responses in multimodal dialogue. Cog. Sci. Multidis. J. 28, 5, 811--840.

[57]

Weizenbaum, J. 1966. Eliza-a computer program for the study of natural language communication between man and machine. Comm. ACM 9, 1, 36--45.

Digital Library

[58]

Zinn, C., Moore, J. D., and Core, M. G. 2002. A 3-tier planning architecture for managing tutorial dialogue. In Proceedings of the 6th International Conference on Intelligent Tutoring Systems (ITS). Springer-Verlag, Berlin, 574--584.

Digital Library

[59]

Zukerman, I., McConachy, R., and Korb, K. B. 2000. Using argumentation strategies in automated argument generation. In Proceedings of the 1st International Conference on Natural Language Generation (INLG). Association for Computational Linguistics, Stroudsburg, PA, USA, 55--62.

Digital Library

Cited By

Pasquali DKothig AAroyo AMuñoz Cadorna JDautenhahn KBencetti SFrancesco RSciutti A(2023)That's not a Good Idea: A Robot Changes Your Behavior Against Social EngineeringProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623879(63-71)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623879
Wei CKim YKuzminykh A(2023)The Bot on Speaking Terms: The Effects of Conversation Architecture on Perceptions of Conversational AgentsProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597139(1-16)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597139
Shamim SYang YUl Zia NKhan ZShariq S(2023)Mechanisms of cognitive trust development in artificial intelligence among front line employees: An empirical examination from a developing economyJournal of Business Research10.1016/j.jbusres.2023.114168167(114168)Online publication date: Nov-2023
https://doi.org/10.1016/j.jbusres.2023.114168
Show More Cited By

Index Terms

System Personality and Persuasion in Human-Computer Dialogue
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics
      2. Natural language generation
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

User Perceptions of Extraversion in Chatbots after Repeated Use
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Whilst imbuing robots and voice assistants with personality has been found to positively impact user experience, little is known about user perceptions of personality in purely text-based chatbots. In a within-subjects study, we asked N=34 participants ...
Manipulating and Evaluating Levels of Personality Perceptions of Voice Assistants through Enactment-Based Dialogue Design
CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

We present an enactment-based dialogue design approach to imbue voice assistants with different levels of personality. In two focus groups, we asked amateur actors to animate different voice assistant personalities by writing and enacting dialogues ...
Measuring the Effect of Mental Health Chatbot Personality on User Engagement
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia

Artificial Intelligence is seen as humanity’s current best bet to solve the looming crisis in healthcare. Conversational Agents, or chatbots, rely on advances in AI and are increasingly investigated in the context of digital mental health care. Given ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems

ACM Transactions on Interactive Intelligent Systems Volume 2, Issue 2

June 2012

133 pages

ISSN:2160-6455

EISSN:2160-6463

DOI:10.1145/2209310

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2012

Accepted: 01 March 2012

Revised: 01 February 2012

Received: 01 February 2011

Published in TIIS Volume 2, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
946
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pasquali DKothig AAroyo AMuñoz Cadorna JDautenhahn KBencetti SFrancesco RSciutti A(2023)That's not a Good Idea: A Robot Changes Your Behavior Against Social EngineeringProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623879(63-71)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623879
Wei CKim YKuzminykh A(2023)The Bot on Speaking Terms: The Effects of Conversation Architecture on Perceptions of Conversational AgentsProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597139(1-16)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597139
Shamim SYang YUl Zia NKhan ZShariq S(2023)Mechanisms of cognitive trust development in artificial intelligence among front line employees: An empirical examination from a developing economyJournal of Business Research10.1016/j.jbusres.2023.114168167(114168)Online publication date: Nov-2023
https://doi.org/10.1016/j.jbusres.2023.114168
Luo BLau RLi C(2023)Emotion-regulatory chatbots for enhancing consumer servicingInformation and Management10.1016/j.im.2023.10379460:5Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1016/j.im.2023.103794
Anggia PSumi K(2023)Persuasion-Building Fundamental Premises and Implications for Conversational Agents: A Conceptual Model in CaptologyPersuasive Technology10.1007/978-3-031-30933-5_18(275-289)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1007/978-3-031-30933-5_18
Nicolescu LTudorache M(2022)Human-Computer Interaction in Customer Service: The Experience with AI Chatbots—A Systematic Literature ReviewElectronics10.3390/electronics1110157911:10(1579)Online publication date: 15-May-2022
https://doi.org/10.3390/electronics11101579
Oinas-Kukkonen HPohjolainen SAgyei E(2022)Mitigating Issues With/of/for True PersonalizationFrontiers in Artificial Intelligence10.3389/frai.2022.8448175Online publication date: 26-Apr-2022
https://doi.org/10.3389/frai.2022.844817
Omrani NRivieccio GFiore USchiavone FAgreda S(2022)To trust or not to trust? An assessment of trust in AI-based systems: Concerns, ethics and contextsTechnological Forecasting and Social Change10.1016/j.techfore.2022.121763181(121763)Online publication date: Aug-2022
https://doi.org/10.1016/j.techfore.2022.121763
Torre ICarrigan EDomijan KMcDonnell RHarte N(2021)The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human–Agent Interaction TaskACM Transactions on Computer-Human Interaction10.1145/346923228:6(1-38)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3469232
Garcia-Mendez SDe Arriba-Perez FGonzalez-Castano FRegueiro-Janeiro JGil-Castineira F(2021)Entertainment Chatbot for the Digital Inclusion of Elderly People Without Abstraction CapabilitiesIEEE Access10.1109/ACCESS.2021.30808379(75878-75891)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3080837
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents