Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3393527.3393561acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesacm-turcConference Proceedingsconference-collections
research-article

Research on the Influencing Factors of User Trust Based on Artificial Intelligence Self Diagnosis System

Published: 26 October 2020 Publication History

Abstract

Artificial intelligence technology has gradually become an important auxiliary means for people to obtain medical consultation. However, many researches reflect users' doubts about the feedback results of AI system. Therefore, this paper focuses on the design of the user-friendly intelligent self diagnosis system, using interdisciplinary research methods. Firstly, based on the psychological questionnaire and interview, this paper studies the public's cognition of the intelligent self diagnosis system, and discusses how to effectively improve the user's recognition and trust of the intelligent self diagnosis system. It is found that the credibility of the intelligent self diagnosis system can be improved by further improving the transparency of the system. For example, users can be provided with four different types of information, including system reasoning, system reliability, information source and personalized information. On the basis of interviews, 48 volunteers were invited to carry out a comparative experiment in groups to evaluate the impact of medical interpretation of intelligent self diagnosis system on patients' perception and trust under different transparency and accuracy models. We found that the improvement of system reliability information (i.e. accuracy model and confidence score) composed of accuracy model and confidence score strengthens patients' cognition of AI system and improves the user trust of the system; while the detailed display of system reasoning and logic can improve the comprehensibility of medical advice output of the system, but does not substantially improve the user trust. At the end of this paper, some suggestions are put forward to design an interpretable and reliable intelligent self diagnosis system.

References

[1]
Fan X M, Fan J J, Tian F, et al. Human-computer interaction and artificial intelligence: from competition to integration (in Chinese). Sci Sin Inform, 2019.
[2]
Fan J J, Tian F, Du Y, et al. Thoughts on human-computer interaction in the age of artificial intelligence (in Chinese).Sci Sin Inform, 2018, 48: 361-375.
[3]
Wang H, Yao N M, Dong J, et al. Interface paradigm of Bots-based humancomputer interaction (in Chinese). Sci Sin Inform, 2018, 48: 475 -484.
[4]
Simon Hoermann, Kathryn L McCabe, David N Milne, and Rafael A Calvo. 2017. Application of synchronous text-based dialogue systems in mental health interventions: systematic review. Journal of medical Internet research 19, 8 (2017), e267.
[5]
Saurav Kumar Mishra, Dhirendra Bharti, and Nidhi Mishra. 2018. Dr. Vdoc: A Medical Chatbot that Acts as a Virtual Doctor. Research & Reviews: Journal of Medical Science and Technology 6, 3 (2018), 16--20.
[6]
Eleonora Harwich and K Layock. 2018. Thinking on its own: AI in the NHS. Reform). See http://www. reform. uk/wp-content/uploads/2018/01/AI-in-Healthcare-report_. pdf (2018).
[7]
Joseph Weizenbaum. 1966a. ELIZA --- a computer program for the study of natural language communication between man and machine. Commun.ACM 9, 1 (1966), 36--45.
[8]
Rik Crutzen, Gjalt-Jorn Y Peters, Sarah Dias Portugal, Erwin M Fisser, and Jorne J Grolleman. 2011. An artificially intelligent chat agent that answers adolescents' questions related to sex, drugs, and alcohol: an exploratory study. Journal of Adolescent Health 48, 5 (2011), 514--519.
[9]
Shameek Ghosh, Sammi Bhatia, and Abhi Bhatia. 2018. Quro: Facilitating User Symptom Check Using a Personalised Chatbot-Oriented Dialogue System. Studies in health technology and informatics 252 (2018), 51 -56.
[10]
Jorne Grolleman, Betsy van Dijk, Anton Nijholt, and Andrée van Emst. 2006. Break the habit! designing an e-therapy intervention using a virtual coach in aid of smoking cessation. In International Conference on Persuasive Technology. Springer, 133--141.
[11]
Danielle Elmasri and Anthony Maeder. 2016. A conversational agent for an online mental health intervention. In International Conference on Brain Informatics. Springer, 243--251.
[12]
Saurav Kumar Mishra, Dhirendra Bharti, and Nidhi Mishra. 2018. Dr. Vdoc: A Medical Chatbot that Acts as a Virtual Doctor. Research & Reviews: Journal of Medical Science and Technology 6, 3 (2018), 16--20.
[13]
Matthew K Hong, Clayton Feustel, Meeshu Agnihotri, Max Silverman, Stephen F Simoneaux, and Lauren Wilcox. 2017. Supporting families in reviewing and communicating about radiology imaging studies. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5245--5256.
[14]
Kien Hoa Ly, Ann-Marie Ly, and Gerhard Andersson. 2017. A fully automated conversational agent for promoting mental well-being: a pilot RCT using mixed methods. Internet interventions 10 (2017), 39--46.
[15]
Jessica Schroeder, Chelsey Wilkes, Kael Rowan, Arturo Toledo, Ann Paradiso, Mary Czerwinski, Gloria Mark, and Marsha M Linehan. 2018. Pocket skills: A conversational mobile web app to support dialectical behavioral therapy. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 398.
[16]
Eric Vorm and Andrew D Miller. 2018. Assessing the Value of Transparency in Recommender Systems: An End-User Perspective. In IntRS@ RecSys. 61--68.
[17]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.
[18]
Wikipedia contributors. 2019. Affinity diagram --- Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/wiki/Affinity_diagram [Online; accessed 14-October-2019].
[19]
Tom Nadarzynski, Oliver Miles, Aimee Cowie, and Damien Ridge. 2019. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study. Digital health 5 (2019), 2055207619871808.
[20]
Eun Kyoung Choe, Marisa E Duarte, Hyewon Suh, Wanda Pratt, and Julie A Kientz. 2019. Communicating Bad News: Insights for the Design of Consumer Health Technologies. JMIR human factors 6, 2 (2019), e8885.
[21]
Eugenia L Siegler and Ronald Adelman. 2009. Copy and paste: a remediable hazard of electronic health records. The American journal of medicine 122, 6 (2009), 495--496.
[22]
Eric S Vorm. 2018. Assessing Demand for Transparency in Intelligent Systems Using Machine Learning. In 2018 Innovations in Intelligent Systems and Applications (INISTA). IEEE, 1 -7.
[23]
Liu Y, Wang Y M, Bian Y L, et al. A psychological model of human-computer cooperation for the era of artificial intelligence (in Chinese). Sci Sin Inform, 2018, 48: 376--389.

Cited By

View all
  • (2024)Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.343719012(106385-106414)Online publication date: 2024
  • (2024)Facilitating public involvement in research about healthcare AI: A scoping review of empirical methodsInternational Journal of Medical Informatics10.1016/j.ijmedinf.2024.105417186(105417)Online publication date: Jun-2024
  • (2022)Perceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping ReviewJournal of Medical Internet Research10.2196/3293924:1(e32939)Online publication date: 14-Jan-2022

Index Terms

  1. Research on the Influencing Factors of User Trust Based on Artificial Intelligence Self Diagnosis System

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ACM TURC '20: Proceedings of the ACM Turing Celebration Conference - China
    May 2020
    220 pages
    ISBN:9781450375344
    DOI:10.1145/3393527
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Baidu Research: Baidu Research

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 October 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. artificial intelligence
    2. human computer interaction
    3. user trust

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ACM TURC'20

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)88
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 21 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.343719012(106385-106414)Online publication date: 2024
    • (2024)Facilitating public involvement in research about healthcare AI: A scoping review of empirical methodsInternational Journal of Medical Informatics10.1016/j.ijmedinf.2024.105417186(105417)Online publication date: Jun-2024
    • (2022)Perceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping ReviewJournal of Medical Internet Research10.2196/3293924:1(e32939)Online publication date: 14-Jan-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media