short-paper

A need for trust in conversational interface research

Authors:

Justin Edwards,

Elaheh SanoubariAuthors Info & Claims

CUI '19: Proceedings of the 1st International Conference on Conversational User Interfaces

Article No.: 21, Pages 1 - 3

https://doi.org/10.1145/3342775.3342809

Published: 22 August 2019 Publication History

Abstract

Across several branches of conversational interaction research including interactions with social robots, embodied agents, and conversational assistants, users have identified trust as a critical part of those interactions. Nevertheless, there is little agreement on what trust means within these sort of interactions or how trust can be measured. In this paper, we explore some of the dimensions of trust as it has been understood in previous work and we outline some of the ways trust has been measured in the hopes of furthering discussion of the concept across the field.

References

[1]

Oya Celiktutan and Hatice Gunes. 2017. Automatic Prediction of Impressions in Time and across Varying Context: Personality, Attractiveness and Likeability. IEEE Transactions on Affective Computing 8, 1 (Jan. 2017), 29--42.

Digital Library

[2]

Leigh Clark, Phillip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, and Benjamin Cowan. 2018. The State of Speech in HCI: Trends, Themes and Challenges. arXiv:1810.06828 {cs} (Oct. 2018). http://arxiv.org/abs/1810.06828 arXiv: 1810.06828.

[3]

Leigh Clark, Cosmin Munteanu, Vincent Wade, Benjamin R. Cowan, Nadia Pantidi, Orla Cooney, Philip Doyle, Diego Garaialde, Justin Edwards, Brendan Spillane, Emer Gilmartin, and Christine Murad. 2019. What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press, Glasgow, Scotland Uk, 1--12.

Digital Library

[4]

Benjamin R Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. What can i help you with?: infrequent users' experiences of intelligent personal assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 43.

Digital Library

[5]

Ewart J de Visser, Samuel S Monfort, Ryan McKendrick, Melissa AB Smith, Patrick E McKnight, Frank Krueger, and Raja Parasuraman. 2016. Almost human: Anthropomorphism increases trust resilience in cognitive agents. Journal of Experimental Psychology: Applied 22, 3 (2016), 331.

[6]

Florian N Egger. 2000. Trust me, I'm an online vendor: towards a model of trust for e-commerce system design. In CHI'00 extended abstracts on Human factors in computing systems. ACM, 101--102.

Digital Library

[7]

Andrew J. Flanagin and Miriam J. Metzger. 2007. The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. New Media & Society 9, 2 (April 2007), 319--342.

[8]

BJ Fogg and Hsiang Tseng. 1999. The elements of computer credibility. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 80--87.

Digital Library

[9]

Amos Freedy, Ewart DeVisser, Gershon Weltman, and Nicole Coeyman. 2007. Measurement of trust in human-robot collaboration. In 2007 International Symposium on Collaborative Technologies and Systems. IEEE, 106--114.

[10]

Kerstin Sophie Haring, David Silvera-Tawil, Yoshio Matsumoto, Mari Velonaki, and Katsumi Watanabe. 2014. Perception of an android robot in Japan and Australia: A cross-cultural comparison. In International conference on social robotics. Springer, 166--175.

[11]

Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors 57, 3 (2015), 407--434.

[12]

Oliver P John, Sanjay Srivastava, and others. 1999. The Big Five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of personality: Theory and research 2, 1999 (1999), 102--138.

[13]

Spiro Kiousis. 2001. Public Trust or Mistrust? Perceptions of Media Credibility in the Information Age. Mass Communication and Society 4, 4 (Nov. 2001), 381--403.

[14]

John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50--80.

[15]

Jin Joo Lee, Brad Knox, Jolie Baumann, Cynthia Breazeal, and David DeSteno. 2013. Computationally modeling interpersonal trust. Frontiers in psychology 4 (2013), 893.

[16]

Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, Santa Clara, California, USA, 5286--5297.

Digital Library

[17]

D Harrison McKnight, Vivek Choudhury, and Charles Kacmar. 2002. The impact of initial consumer trust on intentions to transact with a web site: a trust building model. The journal of strategic information systems 11, 3--4 (2002), 297--323.

[18]

Panagiotis Mitkidis, John J McGraw, Andreas Roepstorff, and Sebastian Wallot. 2015. Building trust: Heart rate synchrony and arousal during joint action increased by public goods game. Physiology & behavior 149 (2015), 101--106.

[19]

Christie Olson and Kelli Kemery. 2019. 2019 Voice report: Consumer adoption of voice technology and digital assistants. Technical Report. Microsoft.

[20]

Jens Riegelsberger, M Angela Sasse, and John D McCarthy. 2003. Shiny happy people building trust?: photos on e-commerce websites and consumer trust. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 121--128.

Digital Library

[21]

Denise M Rousseau, Sim B Sitkin, Ronald S Burt, and Colin Camerer. 1998. Not so different after all: A cross-discipline view of trust. Academy of management review 23, 3 (1998), 393--404.

[22]

Maha Salem, Gabriella Lakatos, Farshid Amirabdollahian, and Kerstin Dautenhahn. 2015. Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, 141--148.

Digital Library

[23]

Lauren E. Scissors, Alastair J. Gill, Kathleen Geraghty, and Darren Gergle. 2009. In CMC we trust: the role of similarity. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, Boston, MA, USA, 527.

Digital Library

[24]

Elaine Short, Justin Hart, Michelle Vu, and Brian Scassellati. 2010. No fair an interaction with a cheating robot. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 219--226.

Digital Library

[25]

Ilaria Torre, Leigh Clark, and Benjamin R Cowan. 2018. Measuring and designing trust in Human-Agent Interaction.

[26]

Ilaria Torre, Jeremy Goslin, Laurence White, and Debora Zanatto. 2018. Trust in artificial voices: A congruency effect of first impressions and behavioural experience. In Proceedings of the Technology, Mind, and Society. ACM, 40.

Digital Library

[27]

Lin Wang, Pei-Luen Patrick Rau, Vanessa Evers, Benjamin Krisper Robinson, and Pamela Hinds. 2010. When in Rome: the role of culture & context in adherence to robot recommendations. In Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction. IEEE Press, 359--366.

Digital Library

[28]

James E Young, Richard Hawkins, Ehud Sharlin, and Takeo Igarashi. 2009. Toward acceptable domestic robots: Applying insights from social psychology. International Journal of Social Robotics 1, 1 (2009), 95.

Cited By

Shafei HTan C(2024)Enhancing Alexa Skill Testing Through Improved Utterance DiscoveryACM Transactions on Internet Technology10.1145/369820024:4(1-25)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3698200
Desai SWei CSin JDubiel MZargham NAhire SPorcheron MKuzminykh ALee MCandello HFischer JMunteanu CCowan B(2024)CUI@CHI 2024: Building Trust in CUIs—From Design to DeploymentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636287(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636287
Etori NGini M(2024)WisCompanion: Integrating the Socratic Method with ChatGPT-Based AI for Enhanced Explainability in Emotional Support for Older AdultsArtificial Intelligence in HCI10.1007/978-3-031-60606-9_11(179-198)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60606-9_11
Show More Cited By

Index Terms

A need for trust in conversational interface research
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design
    2. Interaction design theory, concepts and paradigms

Recommendations

Conversational Agents Trust Calibration: A User-Centred Perspective to Design
CUI '22: Proceedings of the 4th Conference on Conversational User Interfaces

Previous work identified trust as one of the key requirements for adoption and continued use of conversational agents (CAs). Given recent advances in natural language processing and deep learning, it is currently possible to execute simple goal-oriented ...
Trust and distrust on the web

We examine the content of trustful and distrustful user experience reports on the web.Distrust is mostly an effect of graphical and structural design issues of a website.Trust is based on social factors such as reviews or recommendations by friends. The ...
Toward an Understanding of Trust Repair in Human-Robot Interaction: Current Research and Future Directions

Gone are the days of robots solely operating in isolation, without direct interaction with people. Rather, robots are increasingly being deployed in environments and roles that require complex social interaction with humans. The implementation of human-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CUI '19: Proceedings of the 1st International Conference on Conversational User Interfaces

August 2019

131 pages

ISBN:9781450371872

DOI:10.1145/3342775

General Chairs:
Benjamin R Cowan
University College Dublin, Dublin, Ireland
,
Leigh Clark
University College Dublin, Dublin, Ireland

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

CogSIS Project: CogSIS Project
ADAPT: ADAPT Centre
Irish Research Council: Irish Research Council

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Science Foundation Ireland (SFI)

Conference

CUI 2019

Sponsor:

CogSIS Project
ADAPT
Irish Research Council

CUI 2019: 1st International Conference on Conversational User Interfaces

August 22 - 23, 2019

Dublin, Ireland

Acceptance Rates

CUI '19 Paper Acceptance Rate 9 of 28 submissions, 32%;

Overall Acceptance Rate 34 of 100 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
599
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shafei HTan C(2024)Enhancing Alexa Skill Testing Through Improved Utterance DiscoveryACM Transactions on Internet Technology10.1145/369820024:4(1-25)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3698200
Desai SWei CSin JDubiel MZargham NAhire SPorcheron MKuzminykh ALee MCandello HFischer JMunteanu CCowan B(2024)CUI@CHI 2024: Building Trust in CUIs—From Design to DeploymentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636287(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636287
Etori NGini M(2024)WisCompanion: Integrating the Socratic Method with ChatGPT-Based AI for Enhanced Explainability in Emotional Support for Older AdultsArtificial Intelligence in HCI10.1007/978-3-031-60606-9_11(179-198)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60606-9_11
Jin YChen LCai WZhao X(2023)CRS-Que: A User-centric Evaluation Framework for Conversational Recommender SystemsACM Transactions on Recommender Systems10.1145/36315342:1(1-34)Online publication date: 2-Nov-2023
https://dl.acm.org/doi/10.1145/3631534
Dowthwaite LPerez Vallejos EPortillo VPatel MZhao JCreswick H(2023)An Exploration of how Trust Online Relates to Psychological and Subjective WellbeingProceedings of the First International Symposium on Trustworthy Autonomous Systems10.1145/3597512.3599708(1-13)Online publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1145/3597512.3599708
Fischer J(2023)Generative AI Considered HarmfulProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3603756(1-5)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3603756
Weidmüller L(2022)Human, Hybrid, or Machine? Exploring the Trustworthiness of Voice-Based AssistantsHuman-Machine Communication10.30658/hmc.4.54(85-110)Online publication date: 2022
https://doi.org/10.30658/hmc.4.5
Dubiel MDaronnat SLeiva L(2022)Conversational Agents Trust CalibrationProceedings of the 4th Conference on Conversational User Interfaces10.1145/3543829.3544518(1-6)Online publication date: 26-Jul-2022
https://dl.acm.org/doi/10.1145/3543829.3544518
Kinnee BRosner DDesjardins A(2022)Sonic Technologies of a Queer BreakupProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533542(1377-1393)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533542
Do TMcMahan RWisniewski P(2022)A New Uncanny Valley? The Effects of Speech Fidelity and Human Listener Gender on Social Perceptions of a Virtual-Human SpeakerProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517564(1-11)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517564
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten