A Review on the Development of the In-Vehicle Human-Machine Interfaces in Driving Automation: A Design Perspective
Authors: 
Haoyu Dong, Tram Thi Minh Tran, Rutger Verstegen, Miguel Bruns, Marieke MartensAuthors Info & Claims
Pages 160 - 174
Abstract
The advancement of automated driving technologies is fundamentally transforming the relationship between humans and vehicles, shifting from direct control to a more collaborative dynamic. Consequently, the design of in-vehicle Human-Machine Interfaces (iHMIs) is becoming increasingly intricate, focusing on aspects beyond mechanics and ergonomics towards enriched interaction and enhanced user experience. This shift has prompted research efforts to explore and advance iHMI concepts. Despite the iterative nature of design and its role in knowledge creation, our high-level understanding of the design processes utilised in iHMI development remains limited. To provide a comprehensive overview, this paper presents a scoping review of 324 papers (2013—2023) focused on the design underpinnings of iHMI development. Our review presents a categorisation of study goals and a detailed classification of five key stages within the design process. Based on these analyses, we discuss the influence of design and identify potential avenues for future research on iHMIs.
Supplemental Material
XLSX File - A full list of the papers included in this review
A full list of the papers included in this review
- Download
- 29.60 KB
References
[1]
Hilary Arksey and Lisa O’Malley. 2005. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology 8, 1 (2005), 19–32. https://doi.org/10.1080/1364557032000119616
[2]
Jackie Ayoub, Feng Zhou, Shan Bao, and X. Jessie Yang. 2019. From manual driving to automated driving: A review of 10 years of AutoUI. In Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019. Association for Computing Machinery, Inc, 70–90. https://doi.org/10.1145/3342197.3344529
[3]
Wushuang Bai, Liming Gao, Evan Pelletier, Guangwei Zhou, and Sean Brennan. 2021. An In-Vehicle Speed Advisories HMI for Driving Safety and Fuel Economy Improvement. In 2021 IEEE 94th Vehicular Technology Conference (VTC2021-Fall). IEEE, 1–7.
[4]
Marcel CA Baltzer, Daniel López, and Frank Flemisch. 2022. Interaction Patterns for Cooperative Guidance and Control of Vehicles. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 929–934.
[5]
Marcel C A Baltzer, Daniel López, Frank Flemisch, and Gina Weßel. 2017. Interaction Patterns for Cooperative Guidance and Control - Automation Mode Transition in Highly Automated Truck Convoys. https://doi.org/10.0/Linux-x86_64
[6]
Anika Boelhouwer, Jelle van Dijk, and Marieke H. Martens. 2019. Turmoil Behind the Automated Wheel: An Embodied Perspective on Current HMI Developments in Partially Automated Vehicles. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11596 LNCS. Springer Verlag, 3–25. https://doi.org/10.1007/978-3-030-22666-4_1
[7]
Julian Brinkley, Brianna Posadas, Imani Sherman, Shaundra B Daily, and Juan E Gilbert. 2019. An open road evaluation of a self-driving vehicle human–machine interface designed for visually impaired users. International Journal of Human–Computer Interaction 35, 11 (2019), 1018–1032.
[8]
Richard Buchanan. 1992. Wicked Problems in Design Thinking. Design Issues 8 (1992), 5. https://api.semanticscholar.org/CorpusID:15191019
[9]
Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (New York City, New York, USA) (DIS ’00). Association for Computing Machinery, New York, NY, USA, 424–433. https://doi.org/10.1145/347642.347802
[10]
J.L. Campbell, J.L. Brown, J.S. Graving, C.M. Richard, M.G. Lichty, T. Sanquist, and J.L. Morgan. 2016. Human factors design guidance for driver-vehicle interfaces. Technical Report. National Highway Traffic Safety Administration, Washington, DC, USA. www.ntis.gov
[11]
Oliver Carsten and Marieke H. Martens. 2018. How can humans understand their automated cars? HMI principles, problems and solutions. Cognition, Technology and Work 21, 1 (2 2018), 3–20. https://doi.org/10.1007/s10111-018-0484-0
[12]
Stephen Carvalho, Aaron Gluck, Daniel Quinn, Mengyuan Zhang, Lingyuan Li, Kimberly Groves, and Julian Brinkley. 2021. An Accessible Autonomous Vehicle Ridesharing Ecosystem. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 65. 342–346.
[13]
Kuan Ting Chen, Huei Yen Winnie Chen, and Ann Bisantz. 2023. Adding visual contextual information to continuous sonification feedback about low-reliability situations in conditionally automated driving: A driving simulator study. Transportation Research Part F: Traffic Psychology and Behaviour 94 (4 2023), 25–41. https://doi.org/10.1016/j.trf.2023.01.017
[14]
Jediah R. Clark, Neville A. Stanton, and Kirsten M.A. Revell. 2020. Automated Vehicle Handover Interface Design: Focus Groups with Learner, Intermediate and Advanced Drivers. Automotive Innovation 3 (3 2020), 14–29. Issue 1. https://doi.org/10.1007/s42154-019-00085-x
[15]
Nigel Cross. 1982. Designerly ways of knowing. Technical Report.
[16]
Rebecca Currano, So Yeon Park, Dylan James Moore, Kent Lyons, and David Sirkin. 2021. Little Road Driving HUD: Heads-Up Display Complexity Influences Drivers’ Perceptions of Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. https://doi.org/10.1145/3411764.3445575
[17]
Simon Danner, Matthias Pfromm, and Klaus Bengler. 2020. Does information on automated driving functions and the way of presenting it before activation influence users’ behavior and perception of the system?Information 11, 1 (2020).
[18]
Henrik Detjen, Sarah Faltaous, Bastian Pfleging, Stefan Geisler, and Stefan Schneegass. 2021. How to Increase Automated Vehicles’ Acceptance through In-Vehicle Interaction Design: A Review. International Journal of Human-Computer Interaction 37, 4 (2021), 308–330. https://doi.org/10.1080/10447318.2020.1860517
[19]
Henrik Detjen, Stefan Geisler, and Stefan Schneegass. 2020. Help, accident ahead using mixed reality environments in automated vehicles to support occupants after passive accident experiences. Adjunct Proceedings - 12th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2020, 58–61. https://doi.org/10.1145/3409251.3411723
[20]
Andrea Di Salvo and Andrea Arcoraci. 2020. Exploring new concepts to create natural and trustful dialogue between humans and intelligent autonomous vehicles. In Advances in Intelligent Systems and Computing. Springer, 34–40. https://doi.org/10.1007/978-3-030-39512-4_6
[21]
Haoyu Dong, Brent Temmink, Simone De Waart, and Miguel Bruns. 2023. Seamlessly Embedding Buttons into the Leather Fabric of a Car Interior, an Exploration. In Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 307–310.
[22]
d.school. 2010. An Introduction to Design Thinking PROCESS GUIDE. Technical Report. Institute of Design at Stanford.
[23]
Anthony Dunne and Fiona Raby. 2013. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press.
[24]
Kai Eckoldt, Marc Hassenzahl, Matthias Laschke, and Martin Knobel. 2013. Alternatives: Exploring the car’s design space from an experience-oriented perspective. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces, DPPI 2013. Association for Computing Machinery, 156–164. https://doi.org/10.1145/2513506.2513523
[25]
Fredrick Ekman, Mikael Johansson, and Jana Sochor. 2016. To see or not to see-the effect of object recognition on users’ Trust in "automated Vehicles". ACM International Conference Proceeding Series 23-27-October-2016. https://doi.org/10.1145/2971485.2971551
[26]
Fredrick Ekman, Mikael Johansson, and Jana Sochor. 2018. Creating appropriate trust in automated vehicle systems: A framework for HMI design. IEEE Transactions on Human-Machine Systems 48, 1 (2 2018), 95–101. https://doi.org/10.1109/THMS.2017.2776209
[27]
Daniel Fallman. 2008. The Interaction Design Research Triangle of Design Practice, Design Studies, and Design Exploration. Design Issues 24, 3 (2008), 4–18. http://direct.mit.edu/desi/article-pdf/24/3/4/1714481/desi.2008.24.3.4.pdf
[28]
Alexander Feierle, Fabian Schlichtherle, and Klaus Bengler. 2022. Augmented Reality Head-Up Display: A Visual Support During Malfunctions in Partially Automated Driving?IEEE Transactions on Intelligent Transportation Systems 23 (5 2022), 4853–4865. Issue 5. https://doi.org/10.1109/TITS.2021.3119774
[29]
Paul D.S. Fink, Velin Dimitrov, Hiroshi Yasuda, Tiffany L. Chen, Richard R. Corey, Nicholas A. Giudice, and Emily S. Sumner. 2023. Autonomous is Not Enough: Designing Multisensory Mid-Air Gestures for Vehicle Interactions Among People with Visual Impairments. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3544548.3580762
[30]
Lukas A. Flohr, Sofie Kalinke, Antonio Krüger, and DIeter P. Wallach. 2021. Chat or Tap? Comparing Chatbots with ’Classic’ Graphical User Interfaces for Mobile Interaction with Autonomous Mobility-on-Demand Systems. Proceedings of MobileHCI 2021 - ACM International Conference on Mobile Human-Computer Interaction: Mobile Apart, MobileTogether. https://doi.org/10.1145/3447526.3472036
[31]
Yannick Forster, Sebastian Hergeth, Frederik Naujoks, and Josef F. Krems. 2018. How usability can save the day - Methodological considerations for making automated driving a success story. In Proceedings - 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2018. Association for Computing Machinery, Inc, 278–290. https://doi.org/10.1145/3239060.3239076
[32]
Interaction Design Foundation. [n. d.]. Design Thinking (DT): Your constantly-updated definition of Design Thinking (DT) and collection of videos and articles. https://www.interaction-design.org/literature/topics/design-thinking [Accessed: March 2024].
[33]
Anna Katharina Frison, Yannick Forster, Philipp Wintersberger, Viktoria Geisel, and Andreas Riener. 2020. Where we come from and where we are going: A systematic review of human factors research in driving automation. Applied Sciences (Switzerland) 10, 24 (12 2020), 1–36. https://doi.org/10.3390/app10248914
[34]
Anna Katharina Frison, Amelie Oberhofer, Philipp Wintersberger, and Andreas Riener. 2019. ATHENA - Supporting UX of conditionally automated driving with natural language reliability displays. Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019, 187–193. https://doi.org/10.1145/3349263.3351312
[35]
Anna Katharina Frison, Philipp Wintersberger, and Andreas Riener. 2019. Resurrecting the ghost in the shell: A need-centered development approach for optimizing user experience in highly automated vehicles. Transportation Research Part F: Traffic Psychology and Behaviour 65 (8 2019), 439–456. https://doi.org/10.1016/j.trf.2019.08.001
[36]
Anna Katharina Frison, Philipp Wintersberger, Andreas Riener, Clemens Schartmüller, Linda Ng Boyle, Erika Miller, and Klemens Weigl. 2019. In UX we trust investigation of aesthetics and usability of driver-vehicle interfaces and their impact on the perception of automated driving. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery. https://doi.org/10.1145/3290605.3300374
[37]
Peter Fröhlich, Raimund Schatz, Markus Buchta, Johann Schrammel, Stefan Suette, and Manfred Tscheligi. 2019. “What’s the Robo-Driver up to?” Requirements for Screen-based Awareness and Intent Communication in Autonomous Buses. i-com 18, 2 (2019), 151–165.
[38]
Peter Fröhlich, Raimund Schatz, Markus Buchta, Johann Schrammel, Stefan Suette, and Manfred Tscheligi. 2019. "what’s the robo-driver up to?" Requirements for screen-based awareness and intent communication in autonomous buses. i-com (2019). Issue 2. https://doi.org/10.1515/icom-2018-0032
[39]
William Gaver. 2012. What should we expect from research through design?. In Conference on Human Factors in Computing Systems - Proceedings. 937–946. https://doi.org/10.1145/2207676.2208538
[40]
Aaron Gluck, Kwajo Boateng, Earl W Huff Jr, and Julian Brinkley. 2020. Putting older adults in the driver seat: using user enactment to explore the design of a shared autonomous vehicle. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 291–300. https://doi.org/10.1145/3409120.3410645
[41]
Elizabeth Goodman, Erik Stolterman, and Ron Wakkary. 2011. Understanding interaction design practices. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, 1061–1070. https://doi.org/10.1145/1978942.1979100
[42]
Madeline J Hallewell, Nancy Hughes, David R Large, Catherine Harvey, James Springthorpe, and Gary Burnett. 2022. Deriving Personas to Inform HMI Design for Future Autonomous Taxis: A Case Study on User Requirement Elicitation., 41-64 pages. Issue 2.
[43]
Martina Hasenjaeger and Heiko Wersing. 2017. Personalization in Advanced Driver Assistance Systems and Autonomous Vehicles: A Review. In IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).
[44]
Kai Holländer, Gesa Wiegand, Katharina Rupp, and Heinrich Hussmann. 2020. The Joy of Collaborating with Highly Automated Vehicles. (2020). https://doi.org/10.1145/3409120
[45]
Kristina Hoök and Jonas Lowgren. 2012. Strong concepts: Intermediate-level knowledge in interaction Design research. ACM Transactions on Computer-Human Interaction 19, 3 (10 2012). https://doi.org/10.1145/2362364.2362371
[46]
Paul Hornberger, Stephanie Cramer, and Alexander Lange. 2018. Evaluation of Driver Input Variations for Partially Automated Lane Changes. (2018). https://doi.org/10.0/Linux-x86_64
[47]
IDEO. 2023. IDEO-Design Thinking. https://designthinking.ideo.com/
[48]
Pascal Jansen, Mark Colley, and Enrico Rukzio. 2022. A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review. https://doi.org/10.1145/3534617
[49]
Myounghoon Jeon, Maryam FakhrHosseini, Eric Vasey, and Michael A. Nees. 2017. Blueprint of the auditory interactions in automated vehicles: Report on the workshop and tutorial. AutomotiveUI 2017 - 9th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, Adjunct Proceedings, 178–182. https://doi.org/10.1145/3131726.3131743
[50]
Burak Karakaya and Klaus Bengler. 2023. Minimal Risk Maneuvers of Automated Vehicles: Effects of a Contact Analog Head-Up Display Supporting Driver Decisions and Actions in Transition Phases. Safety 9 (3 2023). Issue 1. https://doi.org/10.3390/safety9010007
[51]
Hyunji Kim and Eui Chul Jung. 2019. Automotive cluster UI design based on time and path from the perspective of the ’Passenger’. Archives of Design Research 32 (2019), 5–17. Issue 3. https://doi.org/10.15187/adr.2019.08.32.3.5
[52]
Naeun Kim, Kwangmin Jeong, Minyoung Yang, Yejeon Oh, and Jinwoo Kim. 2017. "Are you ready to take-over?": An exploratory study on Visual Assistance to enhance driver vigilance. Conference on Human Factors in Computing Systems - Proceedings Part F127655, 1771–1778. https://doi.org/10.1145/3027063.3053155
[53]
Soyeon Kim, Riender Happee, and René van Egmond. 2023. Beyond Beeps: Designing Ambient Sound as a Take-Over Request in Automated Vehicles. CEUR Workshop Proceedings (2023).
[54]
Seungju Kim, Jungseok Oh, Minwoo Seong, Eunki Jeon, Yeon Kug Moon, and Seungjun Kim. 2023. Assessing the Impact of AR HUDs and Risk Level on User Experience in Self-Driving Cars: Results from a Realistic Driving Simulation. Applied Sciences (Switzerland) 13 (2023). Issue 8. https://doi.org/10.3390/app13084952
[55]
Penny Kong, Henriette Cornet, and Fritz Frenkler. 2020. Closing the human-machine disconnect: Design requirements for two extreme companions for future autonomous mobility. In Proceedings of the Design Society: DESIGN Conference, Vol. 1. Cambridge University Press, 1627–1636.
[56]
Andrew L. Kun. 2018. Human-machine interaction for vehicles: Review and outlook., 201–293 pages. https://doi.org/10.1561/1100000069
[57]
Andrew L. Kun, Susanne Boll, and Albrecht Schmidt. 2016. Shifting Gears: User Interfaces in the Age of Autonomous Driving. Pervasive Computing (2016). www.computer.org/pervasive
[58]
M. Kyriakidis, J. C.F. de Winter, N. Stanton, T. Bellet, B. van Arem, K. Brookhuis, M. H. Martens, K. Bengler, J. Andersson, N. Merat, N. Reed, M. Flament, M. Hagenzieker, and R. Happee. 2019. A Human Factors Perspective on Automated Driving. Theoretical Issues in Ergonomics Science 20, 3 (5 2019), 223–249. https://doi.org/10.1080/1463922X.2017.1293187
[59]
Lukas Lamm and Christian Wolff. 2019. Exploratory analysis of the research literature on evaluation of in-vehicle systems. In Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019. Association for Computing Machinery, Inc, 60–69. https://doi.org/10.1145/3342197.3344527
[60]
J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159–174.
[61]
Joruts LBwgret. 1999. Applying Design Methodology to Software Development. https://api.semanticscholar.org/CorpusID:13384140
[62]
Heung Gu Lee, Dong Hyun Kang, and Deok Hwan Kim. 2021. Human–machine interaction in driving assistant systems for semi-autonomous driving vehicles. Electronics (Switzerland) 10 (10 2021). Issue 19. https://doi.org/10.3390/electronics10192405
[63]
Jung Min Lee and Da Young Ju. 2018. Classification of human–vehicle interaction: User perspectives on design. Social Behavior and Personality 46 (2018), 1057–1070. Issue 7. https://doi.org/10.2224/sbp.6242
[64]
Sang Hun Lee and Hwisoo Eom. 2015. Design of driver-vehicle interface to reduce mode confusion for adaptive cruise control systems. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 67–71.
[65]
Jingyi Li, Andreas Butz, and Kai Holländer. 2019. Introducing automated driving to the generation 50+. Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019, 375–380. https://doi.org/10.1145/3349263.3351329
[66]
Jingyi Li, Kai Holländer, and Andreas Butz. 2019. Introducing automated driving to the generation 50+. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 375–380.
[67]
Youn Kyung Lim, Erik Stolterman, and Josh Tenenberg. 2008. The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas. ACM Transactions on Computer-Human Interaction 15, 2 (7 2008). https://doi.org/10.1145/1375761.1375762
[68]
Weimin Liu, Qingkun Li, Zhenyuan Wang, Wenjun Wang, Chao Zeng, and Bo Cheng. 2023. A Literature Review on Additional Semantic Information Conveyed from Driving Automation Systems to Drivers through Advanced In-Vehicle HMI Just Before, During, and Right After Takeover Request. International Journal of Human-Computer Interaction 39, 10 (2023), 1995–2015. https://doi.org/10.1080/10447318.2022.2074669
[69]
J. Lowgren. 2014. Interaction Design - brief intro (2nd ed.). Interaction Design Foundation - IxDF.
[70]
Maria Luce Lupetti, Luciano Cavalcante Siebert, and David Abbink. 2023. Steering Stories: Confronting Narratives of Driving Automation through Contestational Artifacts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (, Hamburg, Germany, ) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 601, 20 pages. https://doi.org/10.1145/3544548.3581194
[71]
Maria Luce Lupetti, Cristina Zaga, and Nazli Cila. 2021. Designerly ways of knowing in HRI - Broadening the scope of design-oriented HRI through the concept of intermediate-level knowledge. In ACM/IEEE International Conference on Human-Robot Interaction. IEEE Computer Society, 389–398. https://doi.org/10.1145/3434073.3444668
[72]
Andreas Löcken, Wilko Heuten, and Susanne Boll. 2016. Autoambicar: Using ambient light to inform drivers about intentions of their automated cars. AutomotiveUI 2016 - 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Adjunct Proceedings, 57–62. https://doi.org/10.1145/3004323.3004329
[73]
Rachel H.Y. Ma, Andrew Morris, Paul Herriotts, and Stewart Birrell. 2021. Investigating what level of visual information inspires trust in a user of a highly automated vehicle. Applied Ergonomics (2021). https://doi.org/10.1016/j.apergo.2020.103272
[74]
Nikolas Martelaro, Patrick Carrington, Sarah Fox, and Jodi Forlizzi. 2022. Designing an Inclusive Mobile App for People with Disabilities to Independently Use Autonomous Vehicles. Main Proceedings - 14th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2022, 45–55. https://doi.org/10.1145/3543174.3546850
[75]
Lesley-Ann Mathis, Kathrin Werner, and Gerald J. Schmidt. 2023. Proactive voice assistance in automated vehicles: Understanding when to engage the user. https://doi.org/10.24406/publica-1499
[76]
Shashank Mehrotra, Meng Wang, Nicholas Wong, B S Jah’inaya Parker, Shannon C Roberts, Woon Kim, Alicia Romo, and William J Horrey. 2022. Human-Machine Interfaces and Vehicle Automation: A Review of the Literature and Recommendations for System Design, Feedback, and Alerts. Technical Report. AAA Foundation for Traffic Safety, SAFER-SIM. https://orcid.org/0000-0001-7583-5174
[77]
Alexander G. Mirnig, Magdalena Gärtner, Arno Laminger, Alexander Meschtscherjakov, Sandra Trösterer, Manfred Tscheligi, Rod McCall, and Fintan McGee. 2017. Control transition interfaces in semiautonomous vehicles: A categorization framework and literature analysis. In AutomotiveUI 2017 - 9th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, Proceedings. Association for Computing Machinery, Inc, 209–220. https://doi.org/10.1145/3122986.3123014
[78]
Alexander G Mirnig, Magdalena Gärtner, Vivien Wallner, Sandra Trösterer, Alexander Meschtscherjakov, and Manfred Tscheligi. 2019. Where does it go? A study on visual on-screen designs for exit management in an automated shuttle bus. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 233–243.
[79]
Brian Mok, Mishel Johns, Stephen Yang, and Wendy Ju. 2017. Actions speak louder: Effects of a transforming steering wheel on post-transition driver performance. In 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC). IEEE Press. https://doi.org/10.1109/ITSC.2017.8317878
[80]
Prajval Kumar Murali, Mohsen Kaboli, and Ravinder Dahiya. 2022. Intelligent In-Vehicle Interaction Technologies. Advanced Intelligent Systems 4, 2 (2022), 2100122. https://doi.org/10.1002/aisy.202100122 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/aisy.202100122
[81]
Chihab Nadri, Ignacio Alvarez, Esther Bosch, Michael Oehl, Michael Braun, Jennifer Healey, Christophe Jallais, Wendy Ju, Jingyi Li, and Myounghoon Jeon. 2022. Empathic vehicle design: Use cases and design directions from two workshops. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
[82]
Chihab Nadri, Sangjin Ko, Colin Diggs, Michael Winters, V. K. Sreehari, and Myounghoon Jeon. 2021. Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience. Proceedings of the Human Factors and Ergonomics Society 65, 586–590. Issue 1. https://doi.org/10.1177/1071181321651071
[83]
Chihab Nadri, Sangjin Ko, Colin Diggs, Michael Winters, Sreehari Vattakkandy, and Myounghoon Jeon. 2023. Sonification Use Cases in Highly Automated Vehicles: Designing and Evaluating Use Cases in Level 4 Automation. International Journal of Human-Computer Interaction (2023). https://doi.org/10.1080/10447318.2023.2180236
[84]
Pranav Nair, Wei Wang, and Hongnan Lin. 2020. Lookie Here! Designing Directional User Indicators across Displays in Conditional Driving Automation. SAE Technical Papers. Issue April. https://doi.org/10.4271/2020-01-1201
[85]
Michael Oehl, Klas Ihme, Uwe Drewitz, Martin Schramm, Anna Antonia Pape, and Sonja Cornelsen. 2019. Towards a frustration-aware assistant for increased in-vehicle UX: F-RElACs. Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019, 260–264. https://doi.org/10.1145/3349263.3351518
[86]
Charles Owen. 2007. Design Thinking: Notes on its Nature and Use. Design Research Quarterly 2, 1 (2007), 16–27. www.designresearchsociety.orgwww.designresearchsociety.org
[87]
Junho Park, Maryam Zahabi, Skylar Blanchard, Xi Zheng, Marcia Ory, and Mark Benden. 2023. A novel autonomous vehicle interface for older adults with cognitive impairment. Applied Ergonomics 113 (11 2023). https://doi.org/10.1016/j.apergo.2023.104080
[88]
Junho Park, Maryam Zahabi, Skylar Blanchard, Xi Zheng, Marcia Ory, and Mark Benden. 2023. A novel autonomous vehicle interface for older adults with cognitive impairment. Applied Ergonomics 113 (2023), 104080.
[89]
Kibum Park and Youngjae Im. 2020. Ergonomic guidelines of head-up display user interface during semi-automated driving. Electronics (Switzerland) 9 (4 2020). Issue 4. https://doi.org/10.3390/electronics9040611
[90]
Ingrid Pettersson and Wendy Ju. 2017. Design Techniques for Exploring Automotive Interaction in the Drive towards Automation. In Proceedings of the 2017 ACM Conference on Designing Interactive Systems. Association for Computing Machinery, Inc, 147–160. https://doi.org/10.1145/3064663.3064666
[91]
Ioannis Politis, Patrick Langdon, Damilola Adebayo, Mike Bradley, P. John Clarkson, Lee Skrypchuk, Alexander Mouzakitis, Alexander Eriksson, James W.H. Brown, Kirsten Revell, and Neville Stanton. 2018. An evaluation of inclusive dialogue-based interfaces for the takeover of control in autonomous cars. International Conference on Intelligent User Interfaces, Proceedings IUI, 601–606. https://doi.org/10.1145/3172944.3172990
[92]
Ioannis Politis, Patrick Langdon, Damilola Adebayo, Mike Bradley, P. John Clarkson, Lee Skrypchuk, Alexander Mouzakitis, Alexander Eriksson, James W.H. Brown, Kirsten Revell, and Neville Stanton. 2018. An evaluation of inclusive dialogue-based interfaces for the takeover of control in autonomous cars. International Conference on Intelligent User Interfaces, Proceedings IUI, 601–606. https://doi.org/10.1145/3172944.3172990
[93]
Anuj K. Pradhan, Ganesh Pai, Heejin Jeong, and Shan Bao. 2023. Simulator evaluation of an intersection maneuver assist system with connected and automated vehicle technologies. Ergonomics 66 (2023), 999–1014. Issue 7. https://doi.org/10.1080/00140139.2022.2121006
[94]
Kaspar Raats, Vaike Fors, and Sarah Pink. 2020. Trusting autonomous vehicles: An interdisciplinary approach. Transportation Research Interdisciplinary Perspectives 7 (9 2020). https://doi.org/10.1016/j.trip.2020.100201
[95]
Rim Razzouk and Valerie Shute. 2012. What Is Design Thinking and Why Is It Important?Review of Educational Research 82, 3 (2012), 330–348. https://doi.org/10.3102/0034654312457429
[96]
Patrice Reilhac, Katharina Hottelart, Frederik Diederichs, and Christopher Nowakowski. 2017. User Experience with Increasing Levels of Vehicle Automation: Overview of the Challenges and Opportunities as Vehicles Progress from Partial to High Automation. In Automotive User Interfaces. Springer, Chapter 17, 457–482. https://doi.org/10.1007/978-3-319-49448-7_17
[97]
Tara Rezvani, Katherine Driggs-Campbell, and Ruzena Bajcsy. 2017. Optimizing interaction between humans and autonomy via information constraints on interface design. In 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 1–6.
[98]
Mark Rice, Chee-Wei Ang, Vasudha Ramnath, Jerry Hoe, Huang Jian, and Hiroki Saito. 2017. Deployment of public bus HMI displays for intelligent junction safety: A field trial. In 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC). https://doi.org/10.1109/ITSC.2017.8317658
[99]
Andreas Riener, Myounghoon Jeon, and Ignacio Alvarez. 2022. User experience design in the era of automated driving. Springer.
[100]
SAE International. 2021. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical Report.
[101]
Tobias Schneider, Sabiha Ghellal, Steve Love, and Ansgar R.S. Gerlicher. 2021. Increasing the User Experience in Autonomous Driving through different Feedback Modalities. International Conference on Intelligent User Interfaces, Proceedings IUI, 7–10. https://doi.org/10.1145/3397481.3450687
[102]
Shili Sheng, Erfan Pakdamanian, Kyungtae Han, Ziran Wang, John Lenneman, and Lu Feng. 2021. Trust-based route planning for automated vehicles. ICCPS 2021 - Proceedings of the 2021 ACM/IEEE 12th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2021), 1–10. https://doi.org/10.1145/3450267.3450529
[103]
Annika Stampf, Mark Colley, and Enrico Rukzio. 2022. Towards Implicit Interaction in Highly Automated Vehicles - A Systematic Literature Review. Proceedings of the ACM on Human-Computer Interaction 6. Issue MHCI. https://doi.org/10.1145/3546726
[104]
Gunnar Stevens, Johanna Meurer, Christina Pakusch, and Paul Bossauer. 2019. Investigating Car Futures from Different Angles: An Overview of Methods Used to Study Human Factors of Autonomous Driving. In Lecture Notes in Informatics (LNI), Proceedings - Series of the Gesellschaft fur Informatik (GI). Gesellschaft fur Informatik (GI), 400–409. https://doi.org/10.18420/muc2019-ws-453
[105]
Jelle Stienstra, Sander Bogers, and Joep Frens. 2015. Designerly Handles:Dynamic and Contextualized Enablers for Interaction Designers. In Desform. Italy.
[106]
Helena Strömberg, Ingrid Pettersson, Jonas Andersson, Annie Rydström, Debargha Dey, Maria Klingegård, and Jodi Forlizzi. 2018. Designing for social experiences with and within autonomous vehicles-exploring methodological directions. Design Science 4 (2018). https://doi.org/10.1017/dsj.2018.9
[107]
Helena STRÖMBERG, Ingrid PETTERSSON, and Wendy JU. 2018. Horse, Butler or Elevator? Metaphors and enactment as a catalyst for exploring interaction with autonomous technology. In Design Research Society 2018. https://doi.org/10.21606/drs.2018.329
[108]
Helena Strömberg, Fredrick Ekman, Lars Ola Bligård, and Mikael Johansson. 2019. Keeping a finger in the pie? Exploring different collaborative interactions with autonomous vehicles. ECCE 2019 - Proceedings of the 31st European Conference on Cognitive Ergonomics: ”Design for Cognition”, 118–126. https://doi.org/10.1145/3335082.3335092
[109]
Helena Strömberg, Ingrid Pettersson, and Wendy Ju. 2020. Enacting metaphors to explore relations and interactions with automated driving systems. Design Studies 67 (3 2020), 77–101. https://doi.org/10.1016/j.destud.2019.12.001
[110]
Stavros Tasoudis and Andreas Riener. 2022. UX Design for Automated Driving: Industry Perspective. In Studies in Computational Intelligence. Vol. 980. Springer Science and Business Media Deutschland GmbH, 273–303. https://doi.org/10.1007/978-3-030-77726-5_11
[111]
Angelica M. Tinga, Ilse M. van Zeumeren, Michiel Christoph, Elmer van Grondelle, Diane Cleij, Anna Aldea, and Nicole van Nes. 2023. Development and evaluation of a human machine interface to support mode awareness in different automated driving modes. Transportation Research Part F: Traffic Psychology and Behaviour 92 (1 2023), 238–254. https://doi.org/10.1016/j.trf.2022.10.023
[112]
Arun Ulahannan, Paul Jennings, Luis Oliveira, and Stewart Birrell. 2020. Designing an adaptive interface: Using eye tracking to classify how information usage changes over time in partially automated vehicles. IEEE Access 8 (2020), 16865–16875. https://doi.org/10.1109/ACCESS.2020.2966928
[113]
Peter-Paul Verbeek. 2015. Beyond Interaction: A Short Introduction to Mediation Theory. Interactions (2015).
[114]
Wenjuan Wang, Fang You, Yang Li, Sebastian Feuerstack, and Jianmin Wang. 2022. The Influence of Spatio-temporal Based Human-Machine Interface Design on Driver Workload - A Case Study of Adaptive Cruise Control Using in Cutting-in Scenarios. 2022 IEEE/SICE International Symposium on System Integration, SII 2022, 155–160. https://doi.org/10.1109/SII52469.2022.9708771
[115]
Florian Weidner and Wolfgang Broll. 2022. Stereoscopic 3D dashboards: An investigation of performance, workload, and gaze behavior during take-overs in semi-autonomous driving. Personal and Ubiquitous Computing 26 (6 2022), 697–719. Issue 3. https://doi.org/10.1007/s00779-020-01438-8
[116]
Stephan Wensveen and Ben Matthews. 2014. Prototypes and prototyping in design research. In The Routledge Companion to Design Research. Taylor and Francis, 262–276. https://doi.org/10.4324/9781315758466-25
[117]
G. Weßel, E. Altendorf, M. Schwalm, Y. Canpolat, C. Burghardt, and F. Flemisch. 2019. Self-determined nudging: a system concept for human–machine interaction. Cognition, Technology and Work 21 (11 2019), 621–630. Issue 4. https://doi.org/10.1007/s10111-019-00556-5
[118]
Philipp Wintersberger, Michael Rathmayr, and Alexander Lingler. 2023. Spot’Em: Interactive Data Labeling as a Means to Maintain Situation Awareness. ACM International Conference Proceeding Series, 72–80. https://doi.org/10.1145/3580585.3607163
[119]
Jacob O. Wobbrock and Julie A. Kientz. 2016. Research contributions in human-computer interaction. Interactions 23, 3 (apr 2016), 38–44. https://doi.org/10.1145/2907069
[120]
Peter Wright, Mark Blythe, and John McCarthy. 2006. User experience and the idea of design in HCI. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 3941 LNCS, 1–14. https://doi.org/10.1007/11752707_1
[121]
Yanbin Wu, Naoki Konishi, Ken Kihara, Motohiro Kimura, Yuji Takeda, and Naohisa Hashimoto. 2023. Passenger’s Preference on Internal Interface Design in Automated Buses: A Survey. ACM International Conference Proceeding Series, 162–167. https://doi.org/10.1145/3581961.3609880
[122]
Yanbin Wu, Naoki Konishi, Ken Kihara, Motohiro Kimura, Yuji Takeda, and Naohisa Hashimoto. 2023. Passenger’s Preference on Internal Interface Design in Automated Buses: A Survey. In Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 162–167.
[123]
Yang Xing, Chen Lv, Dongpu Cao, and Peng Hang. 2021. Toward human-vehicle collaboration: Review and perspectives on human-centered collaborative automated driving. Transportation Research Part C: Emerging Technologies 128 (7 2021). https://doi.org/10.1016/j.trc.2021.103199
[124]
Ming Yan, Zijun Lin, Peng Lu, Mansu Wang, Lucia Rampino, and Giandomenico Caruso. 2023. Speculative Exploration on Future Sustainable Human-Machine Interface Design in Automated Shuttle Buses. Sustainability 15, 6 (3 2023), 5497. https://doi.org/10.3390/su15065497
[125]
Ming Yan, Zijun Lin, Peng Lu, Mansu Wang, Lucia Rampino, and Giandomenico Caruso. 2023. Speculative Exploration on Future Sustainable Human-Machine Interface Design in Automated Shuttle Buses. Sustainability 15, 6 (2023), 5497.
[126]
Ming Yan, Lucia Rosa Elena Rampino, Huimin Zhao, and and Giandomenico Caruso. 2022. Implications of Human-Machine Interface for Inclusive Shared Autonomous Vehicles. In Human Factors in Transportation, Vol. 60. AHFE International. https://doi.org/10.54941/ahfe1002488
[127]
Fang You, Qianwen Fu, Jingyan Yang, Huiyan Chen, Wei Cui, and Jianmin Wang. 2023. Team Situation Awareness-Based Augmented Reality Head-Up Display Design for Security Requirements. International Journal of Human-Computer Interaction (2023). https://doi.org/10.1080/10447318.2023.2231281
[128]
Fang You, Jun Zhang, Jie Zhang, Lian Shen, Weixuan Fang, Wei Cui, and Jianmin Wang. 2023. A Novel Cooperation-Guided Warning of Invisible Danger from AR-HUD to Enhance Driver’s Perception. International Journal of Human-Computer Interaction (2023). https://doi.org/10.1080/10447318.2023.2233734
[129]
Bo Zhang, Joost de Winter, Silvia Varotto, Riender Happee, and Marieke Martens. 2019. Determinants of take-over time from automated driving: A meta-analysis of 129 studies. Transportation Research Part F: Traffic Psychology and Behaviour 64 (7 2019), 285–307. https://doi.org/10.1016/j.trf.2019.04.020
[130]
Yaqi Zheng and Xipei Ren. 2022. Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous Vehicles. Multimodal Technologies and Interaction 6 (9 2022). Issue 9. https://doi.org/10.3390/mti6090084
[131]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research Through Design as a Method for Interaction Design Research in HCI. In CHI 2007. ACM.
[132]
Emma M. Van Zoelen, Sander J. Bos, Laure Peeters, and Feng Ye. 2019. Shared control and the democratization of driving in autonomous vehicles. Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019, 120–124. https://doi.org/10.1145/3349263.3351332
Index Terms
- A Review on the Development of the In-Vehicle Human-Machine Interfaces in Driving Automation: A Design Perspective
Recommendations
Architecture for intelligent transport system for automated vehicle
ACAI '11: Proceedings of the International Conference on Advances in Computing and Artificial IntelligenceAn ITS Automated Vehicle is a vehicle equipped with an autopilot system, which is capable of driving from one point to another without input from a human operator (Driver). It is a proposed system depends on infrastructure-based guidance systems (i.e. ...
Human Factor Risks in Driving Automation Crashes
HCI in Mobility, Transport, and Automotive SystemsAbstractDriving automation systems are capable of continuously performing part or all of the dynamic driving task. Driving automation is intended to reduce the probability and severity of traffic crashes by minimizing manual operation. However, inadequate ...
Toward Defining Driving Automation from a Human-Centered Perspective
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing SystemsThis paper aims to redefine the unfamiliar and ambiguous ideas related to autonomous driving such as "Is it permissible not to hold the steering wheel during autonomous driving"?, "Should the driver keep his/her eyes looking forward"?, "Can the driver ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
438 pages
ISBN:9798400705106
DOI:10.1145/3640792
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
AutomotiveUI '24
Sponsor:
AutomotiveUI '24: 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 22 - 25, 2024
CA, Stanford, USA
Acceptance Rates
Overall Acceptance Rate 248 of 566 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 308Total Downloads
- Downloads (Last 12 months)308
- Downloads (Last 6 weeks)195
Reflects downloads up to 23 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in