short-paper

Should Conditional Self-Driving Cars Consider the State of the Human Inside the Vehicle?

Authors:

David Puertas-Ramirez,

Ana Serrano-Mamolar,

David Martin Gomez,

Jesus G. BoticarioAuthors Info & Claims

UMAP '21: Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization

Pages 137 - 141

https://doi.org/10.1145/3450614.3462243

Published: 22 June 2021 Publication History

Abstract

Autonomous vehicles with conditional automation are said to be the next step in the development of self-driving cars. The human driver still performs a critical role in them, by taking over the control of the vehicle if prompted. As the technology is still facing pending challenges, the human drivers are also required to be able to detect and react in case of Autonomous Drive System (ADS) malfunctions. Within this context, in this work we argue that to assure safety during autonomous operation the user state should be measured all the time, which is intended to support a ”fallback ready state”. From an in-depth literature review, this article identifies the human factors involved in the aforementioned ”fallback ready state” that affect the personalization of human-vehicle interaction.

References

[1]

National Highway Traffic Safety Administration. 2021. Automated Vehicles for Safety. NHTSA. https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety

[2]

Christer Ahlström, Anna Anund, and Erik Håkansson Kjellman. 2018. Stress, fatigue and inattention amongst city bus drivers – an explorative study on real roads within the ADAS & ME project. Paper presented at the 6th International Conference on Driver Distraction and Inattention (DDI2018) 2 (2018), 1–7.

[3]

Andrei Aksjonov, Pavel Nedoma, Valery Vodovozov, Eduard Petlenkov, and Martin Herrmann. 2018. A Novel Driver Performance Model Based on Machine Learning. IFAC-PapersOnLine 51, 9 (2018), 267–272. https://doi.org/10.1016/j.ifacol.2018.07.044

[4]

Kamilla Egedal Andersen, Simon Köslich, Bjarke Kristian Maigaard Kjær Pedersen, Bente Charlotte Weigelin, and Lars Christian Jensen. 2017. Do we blindly trust self-driving cars. ACM/IEEE International Conference on Human-Robot Interaction (2017), 67–68. https://doi.org/10.1145/3029798.3038428

Digital Library

[5]

Lisanne Bainbridge. 1983. Ironies of automation. Automatica 19, 6 (1983), 775–779. https://doi.org/10.1016/0005-1098(83)90046-8

Digital Library

[6]

Adella Bhaskara, Michael Skinner, and Shayne Loft. 2020. Agent Transparency: A Review of Current Theory and Evidence. IEEE Transactions on Human-Machine Systems 50, 3 (2020), 215–224. https://doi.org/10.1109/THMS.2020.2965529

[7]

Barry Brown and Eric Laurier. 2017. The trouble with autopilots: Assisted and autonomous driving on the social road. Conference on Human Factors in Computing Systems - Proceedings 2017-May (2017), 416–429. https://doi.org/10.1145/3025453.3025462

Digital Library

[8]

Naomi Dunn, Thoma Dingus, and Susan Soccolich. 2019. Understanding the Impact of Technology: Do Advanced Driver Assistance and Semi-Automated Vehicle Systems Lead to Improper Driving Behavior?AAA Report 19-0460December (2019), 103. https://aaafoundation.org/wp-content/uploads/2019/12/19-0460_AAAFTS_VTTI-ADAS-Driver-Behavior-Report_Final-Report.pdf

[9]

Mica Endsley. 1995. Endsley, M.R.: Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors Journal 37(1), 32-64. Human Factors: The Journal of the Human Factors and Ergonomics Society 37 (03 1995), 32–64. https://doi.org/10.1518/001872095779049543

[10]

Mica Endsley. 2019. Situation Awareness in Future Autonomous Vehicles: Beware of the Unexpected: Volume VII: Ergonomics in Design, Design for All, Activity Theories for Work Analysis and Design, Affective Design. 303–309. https://doi.org/10.1007/978-3-319-96071-5_32

[11]

Sarah Faltaous, Martin Baumann, Stefan Schneegass, and Lewis L. Chuang. 2018. Design guidelines for reliability communication in autonomous vehicles. Proceedings - 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2018 (2018), 258–267. https://doi.org/10.1145/3239060.3239072

Digital Library

[12]

National Center for Statistics and Analysis. 2017. 2016 fatal motor vehicle crashes: Overview. Technical Report DOT HS 812 456. National Highway Traffic Safety Administration, Washington, DC. https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812456

[13]

Ryan Harrington, Carmine Senatore, John Scanlon, and Ryan Yee. 2018. The Role of Infrastructure in an Automated Vehicle Future. Bridge 40 (06 2018), 48–55.

[14]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9

[15]

Gaojian Huang, Clayton Steele, Xinrui Zhang, and Brandon J. Pitts. 2019. Multimodal Cue Combinations: A Possible Approach to Designing In-Vehicle Takeover Requests for Semi-autonomous Driving. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 63, 1(2019), 1739–1743. https://doi.org/10.1177/1071181319631053

[16]

Zhentao Huang, Rongze Li, Wangkai Jin, Zilin Song, Yu Zhang, Xiangjun Peng, and Xu Sun. 2020. Face2Multi-modal: In-vehicle Multi-modal Predictors via Facial Expressions. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 30–33. https://doi.org/10.1145/3409251.3411716

Digital Library

[17]

Tesla Inc. 2020. Autopilot. https://www.tesla.com/autopilot

[18]

SAE International. 2018. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. https://doi.org/10.4271/J3016

[19]

Hyungil Kim, Joseph L. Gabbard, Sujitha Martin, Ashish Tawari, and Teruhisa Misu. 2019. Toward Prediction of Driver Awareness of Automotive Hazards: Driving-Video-Based Simulation Approach. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 63, 1(2019), 2099–2103. https://doi.org/10.1177/1071181319631003 arXiv:https://doi.org/10.1177/1071181319631003

[20]

Quentin Meteier, Marine Capallera, Emmanuel de Salis, Andreas Sonderegger, Leonardo Angelini, Stefano Carrino, Omar Abou Khaled, and Elena Mugellini. 2020. The Effect of Instructions and Context-Related Information about Limitations of Conditionally Automated Vehicles on Situation Awareness. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 241–251. https://doi.org/10.1145/3409120.3410649

Digital Library

[21]

Walter Morales-Alvarez, Oscar Sipele, Régis Léberon, Hadj Hamma Tadjine, and Cristina Olaverri-Monreal. 2020. Automated Driving: A Literature Review of the Take over Request in Conditional Automation. Electronics 9, 12 (2020). https://doi.org/10.3390/electronics9122087

[22]

Alberto Morando. 2019. Drivers’ response to attentional demand in automated driving. Ph.D. Dissertation. Chalmers University of Technology. https://research.chalmers.se/en/publication/508802

[23]

Ian J. Reagan, Wen Hu, Jessica B. Cicchino, Bobbie Seppelt, Lex Fridman, and Michael Glazer. 2019. Measuring Adult Drivers’ Use of Level 1 and 2 Driving Automation by Roadway Functional Class. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 63, 1(2019), 2093–2097. https://doi.org/10.1177/1071181319631225

[24]

Manuel Seet, Jonathan Harvy, Rohit Bose, Andrei Dragomir, Anastasios Bezerianos, and Nitish Thakor. 2020. Differential Impact of Autonomous Vehicle Malfunctions on Human Trust. IEEE Transactions on Intelligent Transportation Systems (2020), 1–10. https://doi.org/10.1109/TITS.2020.3013278

[25]

Shervin Shahrdar, Corey Park, and Mehrdad Nojoumian. 2019. Human trust measurement using an immersive virtual reality autonomous vehicle simulator. AIES 2019 - Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (2019), 515–520. https://doi.org/10.1145/3306618.3314264

Digital Library

[26]

Cláudia Sofia Silveira, Jaime S. Cardoso, André L. Lourenço, and Christer Ahlström. 2019. Importance of subject-dependent classification and imbalanced distributions in driver sleepiness detection in realistic conditions. IET Intelligent Transport Systems 13, 2 (2019), 398–405. https://doi.org/10.1049/iet-its.2018.5284

[27]

Daniele Sportillo, Alexis Paljic, and Luciano Ojeda. 2019. On-Road Evaluation of Autonomous Driving Training. ACM/IEEE International Conference on Human-Robot Interaction 2019-March(2019), 182–190. https://doi.org/10.1109/HRI.2019.8673277

[28]

Alexander Trende, Daniela Gräfing, and Lars Weber. 2019. Personalized user profiles for autonomous vehicles. Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019 (2019), 287–291. https://doi.org/10.1145/3349263.3351315

Digital Library

[29]

Anna Anund Vti and Lena Nilsson Vti. 2020. Deliverable 10 . 4 – Project Final Report. 688900 (2020).

[30]

Griffith Wynne Williams. 1963. Highway Hypnosis: An Hypothesis. International Journal of Clinical and Experimental Hypnosis 11, 3(1963), 143–151. https://doi.org/10.1080/00207146308409239 arXiv:https://doi.org/10.1080/00207146308409239PMID: 14050133.

Cited By

Kravitz DMitroff SCallahan-Flintoft COie K(2024)Crowdsourced Data Collection Opens New Avenues for the Behavioral Sciences to Impact Real-World ApplicationsPolicy Insights from the Behavioral and Brain Sciences10.1177/23727322241274745Online publication date: 9-Sep-2024
https://doi.org/10.1177/23727322241274745
Martin-Melero ÍSerrano-Mamolar ARodríguez-Diez J(2024)Evaluation of Semi-Supervised Machine Learning applied to Affective State Detection2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops59983.2024.10502901(320-325)Online publication date: 11-Mar-2024
https://doi.org/10.1109/PerComWorkshops59983.2024.10502901
Rahim ABarabady JYuan F(2024)Self-driving Cars in the Arctic EnvironmentInternational Congress and Workshop on Industrial AI and eMaintenance 202310.1007/978-3-031-39619-9_7(89-100)Online publication date: 1-Jan-2024
https://doi.org/10.1007/978-3-031-39619-9_7
Show More Cited By

Index Terms

Should Conditional Self-Driving Cars Consider the State of the Human Inside the Vehicle?
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Dynamic intersections and self-driving vehicles
ICCPS '18: Proceedings of the 9th ACM/IEEE International Conference on Cyber-Physical Systems

Connected and automated vehicles are expected to be at the core of future intelligent transportation systems. One of the main practical challenges for self-driving vehicles on public roads is safe cooperation and collaboration among multiple vehicles ...
A merging protocol for self-driving vehicles
ICCPS '17: Proceedings of the 8th International Conference on Cyber-Physical Systems

Self-driving vehicle technologies are progressing rapidly and are expected to play a significant role in the future of transportation. One of the main challenges for self-driving vehicles on public roads is the safe cooperation and collaboration among ...
Carpooling and the Economics of Self-Driving Cars
EC '19: Proceedings of the 2019 ACM Conference on Economics and Computation

We study the interplay between autonomous transportation, carpooling, and road pricing. We discuss how improvements in these technologies, and interactions among them, will affect transportation markets. Our main results show how to achieve socially ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '21: Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization

June 2021

431 pages

ISBN:9781450383677

DOI:10.1145/3450614

Editors:
Judith Masthoff
Utrecht University, The Netherlands and University of Aberdeen, UK
,
Eelco Herder
Radboud University, The Netherlands
,
Nava Tintarev
University of Maastricht, The Netherlands
,
Marko Tkalčič
University of Primorska, Slovenia

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

Government of the Comunidad de Madrid
Spanish Ministry of Science, Innovation and Universities
Interministerial Science and Technology Committee (CICYT)

Conference

UMAP '21

Sponsor:

UMAP '21: 29th ACM Conference on User Modeling, Adaptation and Personalization

June 21 - 25, 2021

Utrecht, Netherlands

Acceptance Rates

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kravitz DMitroff SCallahan-Flintoft COie K(2024)Crowdsourced Data Collection Opens New Avenues for the Behavioral Sciences to Impact Real-World ApplicationsPolicy Insights from the Behavioral and Brain Sciences10.1177/23727322241274745Online publication date: 9-Sep-2024
https://doi.org/10.1177/23727322241274745
Martin-Melero ÍSerrano-Mamolar ARodríguez-Diez J(2024)Evaluation of Semi-Supervised Machine Learning applied to Affective State Detection2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops59983.2024.10502901(320-325)Online publication date: 11-Mar-2024
https://doi.org/10.1109/PerComWorkshops59983.2024.10502901
Rahim ABarabady JYuan F(2024)Self-driving Cars in the Arctic EnvironmentInternational Congress and Workshop on Industrial AI and eMaintenance 202310.1007/978-3-031-39619-9_7(89-100)Online publication date: 1-Jan-2024
https://doi.org/10.1007/978-3-031-39619-9_7
Patel SDufresne-Camaro CSakamoto YFan KHasan KIrani P(2023)On the Road to Productivity: Investigating Text-Presentation Techniques and Audio Assistance for Non-Driving Tasks in Conditionally Automated VehiclesProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627787(122-133)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627787
Engelbrecht Edu Preez J(2023)On the link between generative semi-supervised learning and generative open-set recognitionScientific African10.1016/j.sciaf.2023.e0190322(e01903)Online publication date: Nov-2023
https://doi.org/10.1016/j.sciaf.2023.e01903

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents