research-article

How Will Drivers Take Back Control in Automated Vehicles? A Driving Simulator Test of an Interleaving Framework

Authors:

Divyabharathi Nagaraju,

Nabil Al Nahin Ch,

Christian P. Janssen,

Andrew L KunAuthors Info & Claims

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 20 - 27

https://doi.org/10.1145/3409118.3475128

Published: 20 September 2021 Publication History

Abstract

We explore the transfer of control from an automated vehicle to the driver. Based on data from N=19 participants who participated in a driving simulator experiment, we find evidence that the transfer of control often does not take place in one step. In other words, when the automated system requests the transfer of control back to the driver, the driver often does not simply stop the non-driving task. Rather, the transfer unfolds as a process of interleaving the non-driving and driving tasks. We also find that the process is moderated by the length of time available for the transfer of control: interleaving is more likely when more time is available. Our interface designs for automated vehicles must take these results into account so as to allow drivers to safely take back control from automation.

References

[1]

Brian P Bailey and Shamsi T Iqbal. 2008. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Transactions on Computer-Human Interaction (TOCHI) 14, 4(2008), 1–28. https://doi.org/10.1145/1314683.1314689

Digital Library

[2]

Deborah A Boehm-Davis and Roger Remington. 2009. Reducing the disruptive effects of interruption: A cognitive framework for analysing the costs and benefits of intervention strategies. Accident Analysis & Prevention 41, 5 (2009), 1124–1129. https://doi.org/10.1016/j.aap.2009.06.029

[3]

Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2015. What Makes Interruptions Disruptive? A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2971–2980. https://doi.org/10.1145/2702123.2702156

[4]

Víctor Corcoba, Zoe Falomir, and Nourelhoda Mohamed. 2018. Using Wearable Sensors to Detect Workload on Driving Simulated Scenarios. In Artificial Intelligence Research and Development. IOS Press, Amsterdam, Netherlands, 287–296. https://doi.org/10.3233/978-1-61499-918-8-287

[5]

Alexander Eriksson and Neville A Stanton. 2017. Takeover time in highly automated vehicles: noncritical transitions to and from manual control. Human factors 59, 4 (2017), 689–705. https://doi.org/10.1177/0018720816685832

[6]

Nadia Fereydooni, Orit Shaer, and Andrew L. Kun. 2019. Switching between Augmented Reality and a Manual-Visual Task: A Preliminary Study. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 99–103. https://doi.org/10.1145/3349263.3351502

Digital Library

[7]

Alessio Gambi, Marc Mueller, and Gordon Fraser. 2019. Automatically Testing Self-Driving Cars with Search-Based Procedural Content Generation. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (Beijing, China) (ISSTA 2019). Association for Computing Machinery, New York, NY, USA, 318–328. https://doi.org/10.1145/3293882.3330566

Digital Library

[8]

Christian Gold, Daniel Damböck, Lutz Lorenz, and Klaus Bengler. 2013. “Take over!” How long does it take to get the driver back into the loop?Proceedings of the Human Factors and Ergonomics Society Annual Meeting 57, 1(2013), 1938–1942. https://doi.org/10.1177/1541931213571433 arXiv:https://doi.org/10.1177/1541931213571433

[9]

Bengt Halvorson. 2017. Traffic Jamming: In the 2019 Audi A8, We Let Automated-Driving Tech Take the Wheel. Car and Driver. Retrieved 2021-05-13 from https://www.caranddriver.com/news/a15339688/traffic-jamming-in-the-2019-audi-a8-we-let-automated-driving-tech-take-the-wheel/

[10]

Christian P Janssen and Duncan P Brumby. 2010. Strategic adaptation to performance objectives in a dual-task setting. Cognitive science 34, 8 (2010), 1548–1560. https://doi.org/10.1111/j.1551-6709.2010.01124.x

[11]

Christian P Janssen, Shamsi T Iqbal, Andrew L Kun, and Stella F Donker. 2019. Interrupted by my car? Implications of interruption and interleaving research for automated vehicles. International Journal of Human-Computer Studies 130 (2019), 221–233. https://doi.org/10.1016/j.ijhcs.2019.07.004

Digital Library

[12]

Andrew Kun, Hidde van der Meulen, and Christian Janssen. 2017. Calling While Driving: An Initial Experiment with HoloLens. In Proceedings of the Ninth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design. University of Iowa, Manchester Village, Vermont, 200–206. https://doi.org/10.17077/drivingassessment.1636

[13]

Andrew L Kun. 2018. Human-machine interaction for vehicles: Review and outlook. Foundations and Trends® in Human–Computer Interaction 11, 4(2018), 201–293. https://doi.org/10.1561/1100000069

[14]

Andrew L Kun, Oskar Palinko, Zeljko Medenica, and Peter A Heeman. 2013. On the feasibility of using pupil diameter to estimate cognitive load changes for in-vehicle spoken dialogues. In INTERSPEECH. ISCA, Lyon, France, 3766–3770.

[15]

Andrew L Kun, Alexander Shyrokov, and Peter A Heeman. 2013. Interactions between human–human multi-threaded dialogues and driving. Personal and Ubiquitous Computing 17, 5 (2013), 825–834. https://doi.org/10.1007/s00779-012-0518-1

Digital Library

[16]

David R. Large, Gary Burnett, Davide Salanitri, Anneka Lawson, and Elizabeth Box. 2019. A Longitudinal Simulator Study to Explore Drivers’ Behaviour in Level 3 Automated Vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 222–232. https://doi.org/10.1145/3342197.3344519

Digital Library

[17]

John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50–80.

[18]

Natasha Merat, A Hamish Jamson, Frank CH Lai, and Oliver Carsten. 2012. Highly automated driving, secondary task performance, and driver state. Human factors 54, 5 (2012), 762–771. https://doi.org/10.1177/0018720812442087

[19]

Brian Mok, Mishel Johns, Key Jung Lee, David Miller, David Sirkin, Page Ive, and Wendy Ju. 2015. Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems. IEEE, Piscataway, NJ, 2458–2464. https://doi.org/10.1109/ITSC.2015.396

[20]

Oscar Oviedo-Trespalacios. 2018. Getting away with texting: Behavioural adaptation of drivers engaging in visual-manual tasks while driving. Transportation Research Part A: Policy and Practice 116 (2018), 112–121. https://doi.org/10.1016/j.tra.2018.05.006

[21]

Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. 2014. How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58, 1(2014), 2063–2067. https://doi.org/10.1177/1541931214581434 arXiv:https://doi.org/10.1177/1541931214581434

[22]

Sijun Shen and David M Neyens. 2017. Assessing drivers’ response during automated driver support system failures with non-driving tasks. Journal of safety research 61 (2017), 149–155. https://doi.org/10.1016/j.jsr.2017.02.009

[23]

Jennifer Shuttleworth. 2019. SAE Standards News: J3016 automated-driving graphic update. SAE international. Retrieved 2021-05-13 from https://www.sae.org/news/2019/01/sae-updates-j3016-automated-driving-graphic

[24]

Remo M.A. van der Heiden, Shamsi T. Iqbal, and Christian P. Janssen. 2017. Priming Drivers before Handover in Semi-Autonomous Cars. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 392–404. https://doi.org/10.1145/3025453.3025507

Digital Library

[25]

Marcel Walch, Kristin Lange, Martin Baumann, and Michael Weber. 2015. Autonomous Driving: Investigating the Feasibility of Car-Driver Handover Assistance. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Nottingham, United Kingdom) (AutomotiveUI ’15). Association for Computing Machinery, New York, NY, USA, 11–18. https://doi.org/10.1145/2799250.2799268

Digital Library

[26]

Philipp Wintersberger, Andreas Riener, Clemens Schartmüller, Anna-Katharina Frison, and Klemens Weigl. 2018. Let Me Finish before I Take Over: Towards Attention Aware Device Integration in Highly Automated Vehicles. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 53–65. https://doi.org/10.1145/3239060.3239085

Digital Library

[27]

Bo Zhang, Joost de Winter, Silvia Varotto, Riender Happee, and Marieke Martens. 2019. Determinants of take-over time from automated driving: A meta-analysis of 129 studies. Transportation research part F: traffic psychology and behaviour 64 (2019), 285–307. https://doi.org/10.1016/j.trf.2019.04.020

Cited By

Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Ch NFortier JJanssen CShaer OMills CKun A(2024)Text a Bit Longer or Drive Now? Resuming Driving after Texting in Conditionally Automated CarsProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675737(13-22)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675737
Garikapati DPoovalingam SHau Wde Castro RShinde C(2024)A Comprehensive Review of Parallel Autonomy Systems Within Vehicles: Applications, Architectures, Safety Considerations, and StandardsIEEE Access10.1109/ACCESS.2024.343093312(150395-150418)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3430933
Show More Cited By

Recommendations

Can EEG Measurements be Used to Estimate the Performance of Taking over Control from an Autonomous Vehicle for Different Levels of Distracted Driving? An Explorative Study
AutomotiveUI '22: Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Driver distraction is a concern for traffic safety. Most research has been focused on validating or quantifying the relationship between eyes-off-road metrics and driving performance without specifically addressing cognitive aspects of distracted ...
Two Methods to Bring Drivers Back Better into the Loop after Automated Driving at SAE Level 3
AutomotiveUI '22: Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Vehicles offering conditional automated driving (SAE Level 3 [1]) are now becoming available worldwide. At this automated driving level, it is possible for drivers to engage in non-driving related activities while the vehicle takes over all lateral and ...
Assisting Drivers with Ambient Take-Over Requests in Highly Automated Driving
Automotive'UI 16: Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Take-over situations in highly automated driving occur when drivers have to take over vehicle control due to automation shortcomings. Due to high visual processing demand of the driving task and time limitation of a take-over maneuver, appropriate user ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2021

306 pages

ISBN:9781450380638

DOI:10.1145/3409118

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AutomotiveUI '21

Sponsor:

SIGCHI

AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 9 - 14, 2021

Leeds, United Kingdom

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
419
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Ch NFortier JJanssen CShaer OMills CKun A(2024)Text a Bit Longer or Drive Now? Resuming Driving after Texting in Conditionally Automated CarsProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675737(13-22)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675737
Garikapati DPoovalingam SHau Wde Castro RShinde C(2024)A Comprehensive Review of Parallel Autonomy Systems Within Vehicles: Applications, Architectures, Safety Considerations, and StandardsIEEE Access10.1109/ACCESS.2024.343093312(150395-150418)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3430933
Janssen CPraetorius LBorst J(2024)PREDICTOR: A tool to predict the timing of the take-over response process in semi-automated drivingTransportation Research Interdisciplinary Perspectives10.1016/j.trip.2024.10119227(101192)Online publication date: Sep-2024
https://doi.org/10.1016/j.trip.2024.101192
Gruden TJakus G(2023)Determining Key Parameters with Data-Assisted Analysis of Conditionally Automated DrivingApplied Sciences10.3390/app1311664913:11(6649)Online publication date: 30-May-2023
https://doi.org/10.3390/app13116649
Heidinger JBernhardt LFranke T(2023)Ecosimlab - A Low-Cost Driving Simulator Environment for Examining Human Factors in Vehicle Energy EfficiencyAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609881(66-70)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3581961.3609881
Araluce JBergasa LOcaña MLópez-Guillén EGutiérrez-Moreno RArango J(2022)Driver Take-Over Behaviour Study Based on Gaze Focalization and Vehicle Data in CARLA SimulatorSensors10.3390/s2224999322:24(9993)Online publication date: 19-Dec-2022
https://doi.org/10.3390/s22249993
Ch NTosca DCrump TAnsah AKun AShaer OJi YJeon M(2022)Gesture and Voice Commands to Interact With AR Windshield Display in Automated Vehicle: A Remote Elicitation StudyProceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3543174.3545257(171-182)Online publication date: 17-Sep-2022
https://dl.acm.org/doi/10.1145/3543174.3545257
Teodorovicz TKun ASadun RShaer O(2022)Multitasking while drivingInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102789162:COnline publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102789

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten