research-article

Overtrust in External Cues of Automated Vehicles: An Experimental Investigation

Authors:

Kai Holländer,

Philipp Wintersberger,

Andreas ButzAuthors Info & Claims

AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 211 - 221

https://doi.org/10.1145/3342197.3344528

Published: 21 September 2019 Publication History

Abstract

The intentions of an automated vehicle are hard to spot in the absence of eye contact with a driver or other established means of communication. External car displays have been proposed as a solution, but what if they malfunction or display misleading information? How will this influence pedestrians' trust in the vehicle? To investigate these questions, we conducted a between-subjects study in Virtual Reality (N = 18) in which one group was exposed to erroneous displays. Our results show that participants already started with a very high degree of trust. Incorrectly communicated information led to a strong decline in trust and perceived safety, but both recovered very quickly. This was also reflected in participants' road crossing behavior. We found that malfunctions of an external car display motivate users to ignore it and thereby aggravate the effects of overtrust. Therefore, we argue that the design of external communication should avoid misleading information and at the same time prevent the development of overtrust by design.

References

[1]

Michael Clamann, Miles Aubert, and Mary L Cummings. 2017. Evaluation of vehicle-to-pedestrian communication displays for autonomous vehicles. Technical Report. National Science Foundation.

[2]

Jacob Cohen. 1992. A Power Primer. Psychological Bulletin 112, 1 (1992), 155--159. https://doi.org/10.1037/0033-2909.112.L155

[3]

Ashley Colley, Jonna Häkkilä, Meri-Tuulia Forsman, Bastian Pfleging, and Florian Alt. 2018. Car Exterior Surface Displays: Exploration in a Real-World Context. In Proceedings of the 7th ACM International Symposium on Pervasive Displays (PerDis '18). ACM, New York, NY, USA, Article 7, 8 pages. https://doi.org/10.1145/3205873.3205880

Digital Library

[4]

Debargha Dey, Walker Francesco, Martens Marieke, and Terken Jacques. 2019. Gaze Patterns in Pedestrian Interaction with Vehicles - Towards Effective Design of External Human-Machine Interfaces for Automated Vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '19). ACM, New York, NY, USA.

Digital Library

[5]

Debargha Dey, Azra Habibovic, Maria Klingegård, Victor Malmsten Lundgren, Jonas Andersson, and Anna Schieben. 2018. Workshop on Methodology: Evaluating Interactions between Automated Vehicles and Other Road Users---What Works in Practice?. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 17--22.

[6]

Debargha Dey, Marieke Martens, Chao Wang, Felix Ros, and Jacques Terken. 2018. Interface concepts for intent communication from autonomous vehicles to vulnerable road users. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 82--86.

Digital Library

[7]

D. Dey and J.M.B. Terken. 2017. Pedestrian interaction with vehicles: roles of explicit and implicit communication. In AutomotiveUI '17 Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 24-27 September 2017, Oldenbourg, Germany. Association for Computing Machinery, Inc, United States, 109--113. https://doi.org/10.1145/3122986.3123009

Digital Library

[8]

Paul M Fitts. 1951. Human engineering for an effective air-navigation and traffic-control system. (1951).

[9]

Lex Fridman, Bruce Mehler, Lei Xia, Yangyang Yang, Laura Yvonne Facusse, and Bryan Reimer. 2017. To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays. CoRR abs/1707.02698 (2017). arXiv:1707.02698 http://arxiv.org/abs/1707.02698

[10]

Anna-Katharina Frison, Philipp Wintersberger, Andreas Riener, Clemens Schartmüller, Linda Ng Boyle, Erika Miller, and Klemens Weigl. 2019. In UX We Trust: Investigation of Aesthetics and Usability of Driver-Vehicle Interfaces and Their Impact on the Perception of Automated Driving. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 144, 13 pages. https://doi.org/10.1145/3290605.3300374

Digital Library

[11]

Nicolas Guéguen, Sebastien Meineri, and Chloé Eyssartier. 2015. A pedestrian's stare and drivers' stopping behavior: A field experiment at the pedestrian crossing. Safety Science 75 (06 2015). https://doi.org/10.1016/j.ssci.2015.01.018

[12]

Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors 57, 3 (2015), 407--434.

[13]

Kai Holländer, Ashley Colley, Christian Mai, Jonna Häkkilä, Florian Alt, and Bastian Pfleging. 2019. Investigating the Influence of External Car Displays on Pedestrians' Crossing Behavior in Virtual Reality. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019). ACM, New York, NY, USA, 11. https://doi.org/10.1145/3338286.3340138

Digital Library

[14]

Toshiyuki Inagaki and Makoto Itoh. 2013. Human's Overtrust in and Overreliance on Advanced Driver Assistance Systems: A Theoretical Framework. International Journal of Vehicular Technology 2013 (2013), 1--8. https://doi.org/10.1155/2013/951762

[15]

Makoto Itoh, Genya Abe, and Kenji Tanaka. 1999. Trust in and use of automation: their dependence on occurrence patterns of malfunctions. In IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 99CH37028), Vol. 3. IEEE, 715--720.

[16]

Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 4 (2015), 269--275.

[17]

Johannes Maria Kraus, Jessica Sturn, Julian Elias Reiser, and Martin Baumann. 2015. Anthropomorphic agents, transparent automation and driver personality: towards an integrative multi-level model of determinants for effective driver-vehicle cooperation in highly automated vehicles. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 8--13.

Digital Library

[18]

Alexander Kunze, Stephen J Summerskill, Russell Marshall, and Ashleigh J Filtness. 2017. Enhancing driving safety and user experience through unobtrusive and function-specific feedback. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct. ACM, 183--189.

Digital Library

[19]

John D Lee and Kristin Kolodge. 2018. Understanding attitudes towards self-driving vehicles: Quantitative analysis of qualitative data. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications Sage CA: Los Angeles, CA, 1399--1403.

[20]

John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50--80.

[21]

Michael Lewis, Katia Sycara, and Phillip Walker. 2018. The Role of Trust in Human-Robot Interaction. Springer International Publishing, Cham, 135--159. https://doi.org/10.1007/978-3-319-64816-3_8

[22]

Yeti Li, Murat Dikmen, Thana G Hussein, Yahui Wang, and Catherine Burns. 2018. To Cross or Not to Cross: Urgency-Based External Warning Displays on Autonomous Vehicles to Improve Pedestrian Crossing Safety. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 188--197.

Digital Library

[23]

Karthik Mahadevan, Sowmya Somanath, and Ehud Sharlin. 2018. Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 429, 12 pages. https://doi.org/10.1145/3173574.3174003

Digital Library

[24]

Milecia Matthews, Girish Chowdhary, and Emily Kieson. 2017. Intent Communication between Autonomous Vehicles and Pedestrians. CoRR abs/1708.07123 (2017). arXiv:1708.07123 http://arxiv.org/abs/1708.07123

[25]

Alexander G Mirnig, Philipp Wintersberger, Alexander Meschtscherjakov, Andreas Riener, and Susanne Boll. 2018. Workshop on Communication between Automated Vehicles and Vulnerable Road Users. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 65--71.

[26]

Bonnie M Muir. 1987. Trust between humans and machines, and the design of decision aids. International journal of man-machine studies 27, 5-6 (1987), 527--539.

[27]

Brittany E. Noah, Thomas M. Gable, Shao-Yu Chen, Shruti Singh, and Bruce N. Walker. 2017. Development and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 202--208. https://doi.org/10.1145/3122986.3123007

[28]

Brittany E. Noah, Philipp Wintersberger, Alexander G. Mirnig, Shailie Thakkar, Fei Yan, Thomas M. Gable, Johannes Kraus, and Roderick McCall. 2017. First Workshop on Trust in the Age of Automated Driving. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct (AutomotiveUI '17). ACM, New York, NY, USA, 15--21. https://doi.org/10.1145/3131726.3131733

Digital Library

[29]

Donald A Norman. 1990. The 'problem' with automation: inappropriate feedback and interaction, not 'over-automation'. Philosophical Transactions of the Royal Society of London. B, Biological Sciences 327, 1241 (1990), 585--593.

[30]

Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use, misuse, disuse, abuse. Human factors 39, 2 (1997), 230--253.

[31]

Wintersberger Philipp, Frison Anna-Katharina, Andreas Riener, and Tamara von Sawitzky. 2019. Fostering User Acceptance and Trust in Fully Automated Vehicles: Evaluating the Potential of Augmented Reality. Presence-Teleoperators and Virtual Environments (2019), 27--1.

[32]

A. Rasouli, I. Kotseruba, and J. K. Tsotsos. 2017. Agreeing to cross: How drivers and pedestrians communicate. In 2017 IEEE Intelligent Vehicles Symposium (IV). 264--269. https://doi.org/10.1109/IVS.2017.7995730

[33]

A. Rasouli, I. Kotseruba, and J. K. Tsotsos. 2018. Towards Social Autonomous Vehicles: Understanding Pedestrian-Driver Interactions. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC). 729--734. https://doi.org/10.1109/ITSC.2018.8569324

[34]

Amir Rasouli and John K Tsotsos. 2018. Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practice. arXiv preprint arXiv:1805.11773 (2018).

[35]

Anna Schieben, Marc Wilbrink, Carmen Kettwich, Ruth Madigan, Tyron Louw, and Natasha Merat. 2018. Designing the interaction of automated vehicles with other traffic participants: design considerations based on human needs and expectations. Cognition, Technology & Work (15 Sep 2018). https://doi.org/10.1007/s10111-018-0521-z

[36]

SAE Society of Automotive Engineers. 2018. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles (J3016 Ground Vehicle Standard). https://doi.org/10.4271/J3016_201806

[37]

Matúš Šucha. 2014. Road users' strategies and communication: driver-pedestrian interaction. Transport Research Arena (TRA) (2014).

[38]

Matus Sucha, Daniel Dostal, and Ralf Risser. 2017. Pedestrian-driver communication and decision strategies at marked crossings. Accident Analysis & Prevention 102 (2017), 41--50. https://doi.org/10.1016/j.aap.2017.02.018

[39]

Nguyen Trung Thanh, Holländer Kai, Hoggenmueller Marius, Parker Callum, and Tomitsch Martin. 2019. Designing for Projection-based Communication between Autonomous Vehicles and Pedestrians. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '19). ACM, New York, NY, USA. https://doi.org/10.1145/3342197.3344543

[40]

Alan R. Wagner, Jason Borenstein, and Ayanna Howard. 2018. Overtrust in the Robotic Age. Commun. ACM 61, 9 (Aug. 2018), 22--24. https://doi.org/10.1145/3241365

Digital Library

[41]

Michael Wagner and Philip Koopman. 2015. A Philosophy for Developing Trust in Self-driving Cars. In Road Vehicle Automation 2, Gereon Meyer and Sven Beiker (Eds.). Springer International Publishing, Cham, 163--171.

[42]

Philipp Wintersberger, Dmitrijs Dmitrenko, Clemens Schartmüller, Anna-Katharina Frison, Emanuela Maggioni, Marianna Obrist, and Andreas Riener. 2019. S(C)ENTINEL: Monitoring Automated Vehicles with Olfactory Reliability Displays. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). ACM, New York, NY, USA, 538--546. https://doi.org/10.1145/3301275.3302332

Digital Library

[43]

Philipp Wintersberger, Brittany E. Noah, Johannes Kraus, Roderick McCall, Alexander G. Mirnig, Alexander Kunze, Shailie Thakkar, and Bruce N. Walker. 2018. Second Workshop on Trust in the Age of Automated Driving. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '18). ACM, New York, NY, USA, 56--64. https://doi.org/10.1145/3239092.3239099

[44]

Philipp Wintersberger and Andreas Riener. 2016. Trust in technology as a safety aspect in highly automated driving. i-com 15, 3 (2016), 297--310.

[45]

Jingyi Zhang, Erik Vinkhuyzen, and Melissa Cefkin. 2017. Evaluation of an autonomous vehicle external communication system concept: a survey study. In International Conference on Applied Human Factors and Ergonomics. Springer, 650--661.

[46]

Xiangling Zhuang and Changxu Wu. 2014. Pedestrian gestures increase driver yielding at uncontrolled mid-block road crossings. Accident Analysis & Prevention 70 (2014), 235--244. https://doi.org/10.1016/j.aap.2013.12.015

[47]

Raphael Zimmermann and Reto Wettach. 2017. First Step into Visceral Interaction with Autonomous Vehicles. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 58--64. https://doi.org/10.1145/3122986.3122988

Digital Library

Cited By

Song JKi JJeong YHwang D(2024)Proposing a Design Concept for an External Human-Machine Interface of Autonomous Vehicle Based on Communication Intention and Driving ScenariosJournal of Digital Contents Society10.9728/dcs.2024.25.2.31125:2(311-320)Online publication date: 28-Feb-2024
https://doi.org/10.9728/dcs.2024.25.2.311
Papagni GZafari SSchrammel JTscheligi M(2024)Automating Logistics Operations: Qualitative Insights from Four European SitesLogistics10.3390/logistics80401148:4(114)Online publication date: 8-Nov-2024
https://doi.org/10.3390/logistics8040114
Jun SChung HKim SLee Y(2024)Child Pedestrians’ Perception of External Car Display: Effects of Communication Style and Visualization Type on Trust and Perceived SafetyArchives of Design Research10.15187/adr.2024.02.37.1.737:1(7-24)Online publication date: 29-Feb-2024
https://doi.org/10.15187/adr.2024.02.37.1.7
Show More Cited By

Index Terms

Overtrust in External Cues of Automated Vehicles: An Experimental Investigation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Virtual reality
  2. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

(Over)Trust in Automated Driving: The Sleeping Pill of Tomorrow?
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Both overtrust in technology and drowsy driving are safety-critical issues. Monitoring a system is a tedious task and overtrust in technology might also influence drivers' vigilance, what in turn could multiply the negative impact of both issues. The ...
Automated Driving: Acceptance and Chances for Elderly People
AutomotiveUI '17: Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct

The increasing life expectancy has led to new models of aging, which empower people to have a fulfilling life. Especially mobility becomes a critical issue and automated vehicles seam to offer many possibilities concerning safety and independence. To ...
Bringing the thrill to automated vehicles: an evaluation of thrill-seeking driving displays
AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings

As vehicles with automated features are becoming more common on roadways, it is important to help drivers appropriately trust and accept those automated systems. Utilizing personalized driving displays may enhance the experience of operating a highly ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2019

402 pages

ISBN:9781450368841

DOI:10.1145/3342197

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AutomotiveUI '19

Sponsor:

SIGCHI

AutomotiveUI '19: 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 21 - 25, 2019

Utrecht, Netherlands

Acceptance Rates

AutomotiveUI '19 Paper Acceptance Rate 34 of 119 submissions, 29%;

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

86
Total Citations
View Citations
965
Total Downloads

Downloads (Last 12 months)139
Downloads (Last 6 weeks)25

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Song JKi JJeong YHwang D(2024)Proposing a Design Concept for an External Human-Machine Interface of Autonomous Vehicle Based on Communication Intention and Driving ScenariosJournal of Digital Contents Society10.9728/dcs.2024.25.2.31125:2(311-320)Online publication date: 28-Feb-2024
https://doi.org/10.9728/dcs.2024.25.2.311
Papagni GZafari SSchrammel JTscheligi M(2024)Automating Logistics Operations: Qualitative Insights from Four European SitesLogistics10.3390/logistics80401148:4(114)Online publication date: 8-Nov-2024
https://doi.org/10.3390/logistics8040114
Jun SChung HKim SLee Y(2024)Child Pedestrians’ Perception of External Car Display: Effects of Communication Style and Visualization Type on Trust and Perceived SafetyArchives of Design Research10.15187/adr.2024.02.37.1.737:1(7-24)Online publication date: 29-Feb-2024
https://doi.org/10.15187/adr.2024.02.37.1.7
Talypova DLingler AWintersberger P(2024)Prolonged Usage of AI Assistant for Improving Multitasking PerformanceProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690898(404-407)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690898
Duan WZhou SScalia MYin XWeng NZhang RFreeman GMcNeese NGorman JTolston M(2024)Understanding the Evolvement of Trust Over Time within Human-AI TeamsProceedings of the ACM on Human-Computer Interaction10.1145/36870608:CSCW2(1-31)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687060
Wang YTran TTomitsch M(2024)Physiological Measurements in Automated Vehicle-Pedestrian Research: Review and Future OpportunitiesAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685043(172-177)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685043
Peintner JManger CBerger MRiener A(2024)Explaining Away Control: Exploring the Relationship between Explainable AI and Passengers' Desire for Control in Automated VehiclesAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685040(155-160)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685040
Kotsios HAsteriou PWintersberger P(2024)Only Trust a Hidden Wizard: Investigating the Effects of Wizard Visibility in Automotive Wizard of Oz StudiesProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675738(74-82)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675738
Colley MSpeidel OStrohbeck JRixen JBelz JRukzio E(2024)Effects of Uncertain Trajectory Prediction Visualization in Highly Automated Vehicles on Trust, Situation Awareness, and Cognitive LoadProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314087:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631408
Tran TParker CHoggenmüller MWang YTomitsch M(2024)Exploring the Impact of Interconnected External Interfaces in Autonomous Vehicles on Pedestrian Safety and ExperienceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642118(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642118
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents