research-article

Affective Automotive User Interfaces–Reviewing the State of Driver Affect Research and Emotion Regulation in the Car

Authors:

Florian AltAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 54, Issue 7

Article No.: 137, Pages 1 - 26

https://doi.org/10.1145/3460938

Published: 17 September 2021 Publication History

Abstract

Affective technology offers exciting opportunities to improve road safety by catering to human emotions. Modern car interiors enable the contactless detection of user states, paving the way for a systematic promotion of safe driver behavior through emotion regulation. We review the current literature regarding the impact of emotions on driver behavior and analyze the state of emotion regulation approaches in the car. We summarize challenges for affective interaction in the form of technological hurdles and methodological considerations, as well as opportunities to improve road safety by reinstating drivers into an emotionally balanced state. The purpose of this review is to outline the community’s combined knowledge for interested researchers, to provide a focussed introduction for practitioners, raise awareness for cultural aspects, and to identify future directions for affective interaction in the car.

References

[1]

Yomna Abdelrahman and Albrecht Schmidt. 2018. Beyond the visible: Sensing with thermal imaging. Interactions 26, 1 (Dec. 2018), 76–78. https://doi.org/10.1145/329

Digital Library

[2]

Anna Aljanaki, Yi-Hsuan Yang, and Mohammad Soleymani. 2017. Developing a benchmark for emotional analysis of music. PLOS ONE 12, 3 (03 2017), 1–22. https://doi.org/10.1371/journal.pone.0173392

[3]

Florian Alt, Dagmar Kern, Fabian Schulte, Bastian Pfleging, Alireza Sahami Shirazi, and Albrecht Schmidt. 2010. Enabling micro-entertainment in vehicles based on context information. In Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI-10). Association for Computing Machinery, New York, 117-124. https://doi.org/10.1145/1969773.1969794

Digital Library

[4]

Audi. 2017. Audi Elaine. https://audi-encounter.com/en/audi-fit-driver. Retrieved: October 28, 2019.

[5]

Audi. 2020. Mobility goes smart and individual: Audi at CES 2020. https://www.audi-mediacenter.com/en/press-releases/mobility-goes-smart-and-individualaudi-at-ces-2020-12455. Retrieved: January 10, 2020.

[6]

Stephanie Balters, James A. Landay, and Pablo E. Paredes. 2019. On-road guided slow breathing interventions for car commuters. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA’19). ACM Press, Glasgow, Scotland, UK, 1–5. https://doi.org/10.1145/3290607.3312785

Digital Library

[7]

Stephanie Balters, Elizabeth L. Murnane, James A. Landay, and Pablo E. Paredes. 2018. Breath booster!: in-car, fast-paced breathing interventions to enhance driver arousal state. In Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth’18). ACM, New York, 128–137. https://doi.org/10.1145/3240925.3240939

Digital Library

[8]

Chinmayi Bankar, Aditya Bhide, Anuja Kulkarni, Chirag Ghube, and Mangesh Bedekar. 2018. Driving control using emotion analysis via EEG. In Proceedings of the 2018 IEEE Punecon. IEEE, Pune, India, 1–7. https://doi.org/10.1109/PUNECON.2018.8745412

[9]

Lisa Feldman Barrett, Ralph Adolphs, Stacy Marsella, Aleix M. Martinez, and Seth D. Pollak. 2019. Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest 20, 1 (July 2019), 1–68. https://doi.org/10.1177/1529100619832930

[10]

BMW. 2019. BMW Intelligent Personal Assistant.https://youtu.be/C-gRJrDrICs. Retrieved: October 28, 2019.

[11]

Tibor Bosse. 2017. On computational models of emotion regulation and their applications within HCI. In Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier, San Diego, CA, 311–337. https://doi.org/10.1016/b978-0-12-801851-4.00013-6

[12]

Michael Braun and Florian Alt. 2019. Affective assistants: A matter of states and traits. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA’19). ACM, Glasgow, Scotland UK, 1–6. https://doi.org/10.1145/3290607.3313051

Digital Library

[13]

Michael Braun, Ronee Chadowitz, and Florian Alt. 2019. User experience of driver state visualizations: A look at demographics and personalities. In Proceedings of the Symposium on Human-Computer Interaction (INTERACT 2019), David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Vol. 11749. Springer International Publishing, Cham, 158–176. https://doi.org/10.1007/978-3-030-29390-1_9

Digital Library

[14]

Michael Braun, Jingyi Li, Florian Weber, Bastian Pfleging, Andreas Butz, and Florian Alt. 2020. What if your car would care? Exploring use cases for affective automotive user interfaces. In Proceedings of the 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’20). ACM, New York, Article 37, 12 pages. https://doi.org/10.1145/3379503.3403530

Digital Library

[15]

Michael Braun, Anja Mainz, Ronee Chadowitz, Bastian Pfleging, and Florian Alt. 2019. At your service: Designing voice assistant personalities to improve automotive user interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19). ACM, New York, Article 40, 11 pages. https://doi.org/10.1145/3290605.3300270

Digital Library

[16]

Michael Braun, Bastian Pfleging, and Florian Alt. 2018. A survey to understand emotional situations on the road and what they mean for affective automotive UIs. Multimodal Technologies and Interaction 2, 4 (Oct. 2018), 75. https://doi.org/10.3390/mti2040075

[17]

Michael Braun, Jonas Schubert, Bastian Pfleging, and Florian Alt. 2019. Improving driver emotions with affective strategies. Multimodal Technologies and Interaction 3, 1 (March 2019), 21. https://doi.org/10.3390/mti3010021

[18]

Michael Braun, Simon Weiser, Bastian Pfleging, and Florian Alt. 2018. A comparison of emotion elicitation methods for affective driving studies. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’18). ACM, New York, 77–81. https://doi.org/10.1145/3239092.3265945

Digital Library

[19]

Warren Brodsky and Micha Kizner. 2012. Exploring an alternative in-car music background designed for driver safety. Transportation Research Part F: Traffic Psychology and Behaviour 15, 2 (March 2012), 162–173. https://doi.org/10.1016/j.trf.2011.12.001

[20]

Ronald G. Burns and Michael A. Katovich. 2003. Examining road rage / aggressive driving: Media depiction and prevention suggestions. Environment and Behavior 35, 5 (Sept. 2003), 621–636. https://doi.org/10.1177/0013916503254758

[21]

Hua Cai and Yingzi Lin. 2011. Modeling of operators’ emotion and task performance in a virtual driving environment. International Journal of Human-Computer Studies 69, 9 (Aug. 2011), 571–586. https://doi.org/10.1016/j.ijhcs.2011.05.003

Digital Library

[22]

Erion Çano, Riccardo Coppola, Eleonora Gargiulo, Marco Marengo, and Maurizio Morisio. 2017. Mood-based on-car music recommendations. In Industrial Networks and Intelligent Systems, Leandros A. Maglaras, Helge Janicke, and Kevin Jones (Eds.). Vol. 188. Springer International Publishing, Cham, 154–163. https://doi.org/10.1007/978-3-319-52569-3_14

[23]

Michelle Chan and Anthony Singhal. 2015. Emotion matters: Implications for distracted driving. Safety Science 72 (Feb. 2015), 302–309. https://doi.org/10.1016/j.ssci.2014.10.002

[24]

J. F. Coughlin, B. Reimer, and B. Mehler. 2011. Monitoring, managing, and motivating driver safety and well-being. IEEE Pervasive Computing 10, 3 (2011), 14–21. https://doi.org/10.1109/mprv.2011.54

Digital Library

[25]

Jerry L. Deffenbacher, David M. Deffenbacher, Rebekah S. Lynch, and Tracy L. Richards. 2003. Anger, aggression, and risky behavior: A comparison of high and low anger drivers. Behaviour Research and Therapy 41, 6 (June 2003), 701–718. https://doi.org/10.1016/S0005-7967(02)00046-3

[26]

Merriam-Webster Online Dictionary. 2020. https://www.merriam-webster.com/dictionary/affective. Retrieved: January 8, 2020.

[27]

Chris S. Dula and E. Scott Geller. 2003. Risky, aggressive, or emotional driving: Addressing the need for consistent communication in research. Journal of Safety Research 34, 5 (Jan. 2003), 559–566. https://doi.org/10.1016/j.jsr.2003.03.004

[28]

Paul Ekman and Richard J. Davidson (Eds.). 1994. The Nature of Emotion – Fundamental Questions. Oxford University Press, New York.

[29]

Paul Ekman, Wallace V. Friesen, and Phoebe Ellsworth. 1972. Emotion in the Human Face: Guidelines for Research and an Integration of Findings.Pergamon Press, Oxford, England.

[30]

Johan Engström, Gustav Markkula, Trent Victor, and Natasha Merat. 2017. Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis. Human Factors: The Journal of the Human Factors and Ergonomics Society 59, 5 (Aug. 2017), 734–764. https://doi.org/10.1177/0018720817690639

[31]

Florian Eyben, Martin Wöllmer, Tony Poitschke, Björn Schuller, Christoph Blaschke, Berthold Färber, and Nhu Nguyen-Thien. 2010. Emotion on the road—Necessity, acceptance, and feasibility of affective computing in the car. Advances in Human-Computer Interaction 2010 (2010), 1–17. https://doi.org/10.1155/2010/263593

Digital Library

[32]

Stephen H. Fairclough. 2009. Fundamentals of physiological computing. Interacting with Computers 21, 1-2 (Jan. 2009), 133–145. https://doi.org/10.1016/j.intcom.2008.10.011

Digital Library

[33]

Seyedeh Maryam Fakhrhosseini and Myounghoon Jeon. 2016. The effects of various music on angry drivers’ subjective, behavioral, and physiological states. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’16 Adjunct). ACM, New York, 191–196. https://doi.org/10.1145/3004323.3004346

Digital Library

[34]

S. Maryam Fakhrhosseini and Myounghoon Jeon. 2019. How do angry drivers respond to emotional music? A comprehensive perspective on assessing emotion. Journal on Multimodal User Interfaces 13, 2 (June 2019), 137–150. https://doi.org/10.1007/s12193-019-00300-3

[35]

Seyedeh Maryam Fakhrhosseini, Steven Landry, Yin Yin Tan, Saru Bhattarai, and Myounghoon Jeon. 2014. If you’re angry, turn the music on: Music can mitigate anger effects on driving performance. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’14). ACM, New York, Article 18, 7 pages. https://doi.org/10.1145/2667317.2667410

Digital Library

[36]

Ford. 2018. Ford Buzz Car. https://youtu.be/AFpt6jziFsU. Retrieved: October 28, 2019.

[37]

Nikolaos Fragkiadakis and SeungHee Lee. 2018. In-car indirect communication. Creating an interface for the expression of emotions between the driver and the passengers. In Proceedings of the 7th International Conference on Kansei Engineering and Emotion Research 2018, Anitawati Mohd Lokman, Toshimasa Yamanaka, Pierre Lévy, Kuohsiang Chen, and Shinichi Koyama (Eds.). Vol. 739. Springer Singapore, Singapore, 821–830. https://doi.org/10.1007/978-981-10-8612-0_85

[38]

Jose Maria Garcia-Garcia, Victor M. R. Penichet, and Maria D. Lozano. 2017. Emotion detection: A technology review. In Proceedings of the XVIII International Conference on Human Computer Interaction - Interacción’17. ACM Press, Cancun, Mexico, 1–8. https://doi.org/10.1145/3123818.3123852

Digital Library

[39]

Gartner. 2019. 5 Trends Appear on the Gartner Hype Cycle for Emerging Technologies, 2019. https://www.gartner.com/smarterwithgartner/5-trends-appear-on-the-gartner-hype-cycle-for-emerging-technologies-2019.Retrieved: January 11, 2020.

[40]

James J. Gross. 2001. Emotion Regulation in Adulthood: Timing is everything. Current Directions in Psychological Science 10, 6 (Dec. 2001), 214–219. https://doi.org/10.1111/1467-8721.00152

[41]

Oleg Gusikhin, Erica Klampfl, Dimitar Filev, and Yifan Chen. 2011. Emotive Driver Advisor System (EDAS). In Informatics in Control, Automation and Robotics, Juan Andrade Cetto, Jean-Louis Ferrier, and Joaquim Filipe (Eds.). Vol. 89. Springer Berlin Heidelberg, Berlin, 21–36. https://doi.org/10.1007/978-3-642-19539-6_2

[42]

Edward T. Hall. 1989. Beyond Culture. Doubleday, New York.

[43]

Helen Harris and Clifford Nass. 2011. Emotion regulation for frustrating driving contexts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, 749–752. https://doi.org/10.1145/1978942.1979050

Digital Library

[44]

Marc Hassenzahl, Matthias Laschke, Kai Eckoldt, Eva Lenz, and Josef Schumann. 2017. “It’s more fun to commute”—An example of using automotive interaction design to promote well-being in cars. In Automotive User Interfaces, Gerrit Meixner and Christian Müller (Eds.). Springer International Publishing, Cham, 95–120. https://doi.org/10.1007/978-3-319-49448-7_4

[45]

Mariam Hassib, Michael Braun, Bastian Pfleging, and Florian Alt. 2019. Detecting and influencing driver emotions using psycho-physiological sensors and ambient light. In Proceedings of the Human-Computer Interaction (INTERACT 2019), David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Vol. 11746. Springer International Publishing, Cham, 721–742. https://doi.org/10.1007/978-3-030-29381-9_43

Digital Library

[46]

Jennifer Anne Healey. 2000. Wearable and Automotive Systems for Affect Recognition from Physiology. Ph.D. Dissertation. Massachusetts Institute of Technology.

[47]

Javier Hernandez, Daniel McDuff, Xavier Benavides, Judith Amores, Pattie Maes, and Rosalind Picard. 2014. AutoEmotive: Bringing empathy to the driving experience to manage stress. In Proceedings of the 2014 Companion Publication on Designing Interactive Systems -DIS Companion 14. ACM, Vancouver, BC, Canada, 53–56. https://doi.org/10.1145/2598784.2602780

Digital Library

[48]

Honda. 2017. Honda NeuV Concept. https://www.honda.com/mobility/NeuV-Concept. Retrieved: October 29, 2019.

[49]

Li Hsieh, Sean Seaman, and Richard Young. 2010. Effect of emotional speech tone on driving from lab to road: FMRI and ERP Studies. In Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’10). ACM, New York, 22–28. https://doi.org/10.1145/1969773.1969778

Digital Library

[50]

Tian-Yi Hu, Xiaofei Xie, and Jie Li. 2013. Negative or positive? The effect of emotion and mood on risky driving. Transportation Research Part F: Traffic Psychology and Behaviour 16 (Jan. 2013), 29–40. https://doi.org/10.1016/j.trf.2012.08.009

[51]

SAE International. 2015. Operational Definitions of Driving Performance Measures and Statistics. Surface Vehicle Recommended Practice SAE J2944. Society of Automotive Engineers.

[52]

Christophe Jallais, Catherine Gabaude, and Laurence Paire-ficout. 2014. When emotions disturb the localization of road elements: Effects of anger and sadness. Transportation Research Part F: Traffic Psychology and Behaviour 23 (March 2014), 125–132. https://doi.org/10.1016/j.trf.2013.12.023

[53]

Myounghoon Jeon. 2016. Don’t cry while you’re driving: Sad driving is as bad as angry driving. International Journal of Human-Computer Interaction 32, 10 (June 2016), 1–14. https://doi.org/10.1080/10447318.2016.1198524

[54]

M. Jeon and B. N. Walker. 2011. What to detect?: Analyzing factor structures of affect in driving contexts for an emotion eetection and Regulation System. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting 55, 1 (Sept. 2011), 1889–1893. https://doi.org/10.1177/1071181311551393

[55]

Myounghoon Jeon, Bruce N. Walker, and Jung-Bin Yim. 2014. Effects of specific emotions on subjective judgment, driving performance, and perceived workload. Transportation Research Part F: Traffic Psychology and Behaviour 24 (2014), 197–209. https://doi.org/10.1016/j.trf.2014.04.003

[56]

Myounghoon Jeon, Jung-Bin Yim, and Bruce N. Walker. 2011. An angry driver is not the same as a fearful driver: Effects of specific negative emotions on risk perception, driving performance, and workload. In Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI’11. ACM, Salzburg, Austria, 137. https://doi.org/10.1145/2381416.2381438

Digital Library

[57]

Mark B. Johnson and Scott McKnight. 2009. Warning drivers about potential congestion as a means to reduce frustration-driven aggressive driving. Traffic Injury Prevention 10, 4 (July 2009), 354–360. https://doi.org/10.1080/15389580902969765

[58]

Karma. 2019. Xperi Technology in the Karma Revero. https://youtu.be/LQtCc0W1wrw. Retrieved: October 28, 2019.

[59]

KIA. 2019. Space of Emotive Driving. https://www.kiamedia.com/us/en/media/pressreleases/14844/ces-2019-kia-prepares-for-post-autonomous-driving-era-with-ai-based-real-time-emotion-recognition-te. Retrieved: October 31, 2019.

[60]

Malte Klüver, Carolin Herrigel, Christian Heinrich, Hans-Peter Schöner, and Heiko Hecht. 2016. The behavioral validity of dual-task driving performance in fixed and moving base driving simulators. Transportation Research Part F: Traffic Psychology and Behaviour 37 (Feb. 2016), 78–96. https://doi.org/10.1016/j.trf.2015.12.005

[61]

Florian Lachner, Constantin von Saucken, Florian ‘Floyd’ Mueller, and Udo Lindemann. 2015. Cross-cultural user experience design helping product designers to consider cultural differences. In Cross-Cultural Design Methods, Practice and Impact, P.L.Patrick Rau (Ed.). Springer International Publishing, Cham, 58–70. https://doi.org/10.1007/978-3-319-20907-4_6

[62]

Yi-Ching Lee. 2010. Measuring drivers frustration in a driving simulator. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 54, 19 (Sept. 2010), 1531–1535. https://doi.org/10.1177/154193121005401937

[63]

Jingyi Li, Michael Braun, Andreas Butz, and Florian Alt. 2019. Designing emotion-aware in-car interactions for unlike markets. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct Proceedings - (AutomotiveUI’19). ACM, Utrecht, Netherlands, 352–357. https://doi.org/10.1145/3349263.3351324

Digital Library

[64]

Shuling Li, Tingru Zhang, Ben D. Sawyer, Wei Zhang, and Peter A. Hancock. 2019. Angry drivers take risky decisions: Evidence from neurophysiological assessment. International Journal of Environmental Research and Public Health 16, 10 (May 2019), 1701. https://doi.org/10.3390/ijerph16101701

[65]

Andreas Löcken, Klas Ihme, and Anirudh Unni. 2017. Towards designing affect-aware systems for mitigating the effects of in-vehicle Frustration. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct - (AutomotiveUI’17). ACM, Oldenburg, Germany, 88–93. https://doi.org/10.1145/3131726.3131744

Digital Library

[66]

Jingyi Lu, Xiaofei Xie, and Ruogu Zhang. 2013. Focusing on appraisals: How and why anger and fear influence driving risk perception. Journal of Safety Research 45 (June 2013), 65–73. https://doi.org/10.1016/j.jsr.2013.01.009

[67]

Daniel McDuff and Mary Czerwinski. 2018. Designing emotionally sentient agents. Commun. ACM 61, 12 (Nov. 2018), 74–83. https://doi.org/10.1145/3186591

Digital Library

[68]

Mercedes-Benz. 2020. CLA 250. https://www.mercedes-benz.com/en/exhibitions/ces/vehicles/cla-250/.Retrieved: January 10, 2020.

[69]

Mercedes-Benz. 2020. Inspired by the future: The VISION AVTR. https://www.mercedes-benz.com/en/vehicles/passenger-cars/mercedes-benz-concept-cars/vision-avtr.Retrieved: January 10, 2020.

[70]

Jolieke Mesken, Marjan P. Hagenzieker, Talib Rothengatter, and Dick de Waard. 2007. Frequency, determinants, and consequences of different drivers’ emotions: An on-the-road study using self-reports, (observed) behaviour, and physiology. Transportation Research Part F: Traffic Psychology and Behaviour 10, 6 (Nov. 2007), 458–475. https://doi.org/10.1016/j.trf.2007.05.001

[71]

Kimberly Sena Moore. 2013. A systematic review on the neural effects of music on emotion regulation: Implications for music therapy practice. Journal of Music Therapy 50, 3 (10 2013), 198–242. https://doi.org/10.1093/jmt/50.3.198

[72]

General Motors. 2019. GM Super Cruise. https://www.cadillac.com/ownership/vehicle-technology/super-cruise. Retrieved: October 30, 2019.

[73]

Fatma Nasoz, Christine L. Lisetti, and Athanasios V. Vasilakos. 2010. Affectively intelligent and adaptive car interfaces. Information Sciences 180, 20 (Oct. 2010), 3817–3836. https://doi.org/10.1016/j.ins.2010.06.034

Digital Library

[74]

Fatma Nasoz, Onur Ozyer, Christine L. Lisetti, and Neal Finkelstein. 2002. Multimodal affective driver interfaces for future cars. In Proceedings of the 10th ACM International Conference on Multimedia (MULTIMEDIA’02). ACM, New York, 319–322. https://doi.org/10.1145/641007.641074

Digital Library

[75]

Clifford Nass, Ing-Marie Jonsson, Helen Harris, Ben Reaves, Jack Endo, Scott Brave, and Leila Takayama. 2005. Improving automotive safety by pairing driver emotion and car voice emotion. In Proceedings of the CHI’05 Extended Abstracts on Human Factors in Computing Systems (CHI EA’05). ACM, New York, 1973–1976. https://doi.org/10.1145/1056808.1057070

Digital Library

[76]

Nio. 2017. Nio NOMI. https://youtu.be/SAZ2Dd9lrVc. Retrieved: October 29, 2019.

[77]

Michael Oehl, Klas Ihme, Uwe Drewitz, Anna-Antonia Pape, Sonja Cornelsen, and Martin Schramm. 2019. Towards a frustration-aware assistant for increased in-vehicle UX: F-RELACS. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct Proceedings - (AutomotiveUI’19). ACM, Utrecht, Netherlands, 260–264. https://doi.org/10.1145/3349263.3351518

Digital Library

[78]

Michael Oehl, Klas Ihme, Anna-Antonia Pape, Mathias Vukelić, and Michael Braun. 2020. Affective use cases for empathic vehicles in highly automated driving: Results of an expert workshop. In Proceedings of HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design, Heidi Krömker (Ed.). Springer International Publishing, Cham, 89–100. https://doi.org/10.1007/978-3-030-50523-3_7

Digital Library

[79]

Pablo E. Paredes, Stephanie Balters, Kyle Qian, Elizabeth L. Murnane, Francisco Ordóñez, Wendy Ju, and James A. Landay. 2018. Driving with the fishes: Towards calming and mindful virtual reality experiences for the car. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (Dec. 2018), 1–21. https://doi.org/10.1145/3287062

Digital Library

[80]

Pablo E. Paredes, Yijun Zhou, Nur Al-Huda Hamdan, Stephanie Balters, Elizabeth Murnane, Wendy Ju, and James A. Landay. 2018. Just breathe: In-car internventions for guided slow breathing. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (March 2018), 1–23. https://doi.org/10.1145/3191760

Digital Library

[81]

Christelle Pêcher, Céline Lemercier, and Jean-Marie Cellier. 2009. Emotions drive attention: Effects on driver’s behaviour. Safety Science 47, 9 (Nov. 2009), 1254–1259. https://doi.org/10.1016/j.ssci.2009.03.011

[82]

Bastian Pfleging, Alexander Meschtscherjakov, Stefan Schneegass, and Manfred Tscheligi. 2014. Experience maps: Experience-enhanced routes for car navigation. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - (AutomotiveUI’14). ACM, Seattle, WA, 1–6. https://doi.org/10.1145/2667239.2667275

Digital Library

[83]

Rosalind W. Picard. 1997. Affective Computing. MIT Press, Cambridge, MA.

[84]

Soujanya Poria, Erik Cambria, Rajiv Bajpai, and Amir Hussain. 2017. A review of affective computing: From unimodal analysis to multimodal fusion. Information Fusion 37 (Sept. 2017), 98–125. https://doi.org/10.1016/j.inffus.2017.02.003

Digital Library

[85]

Lisa Precht, Andreas Keinath, and Josef F. Krems. 2017. Effects of driving anger on driver behavior – Results from naturalistic driving data. Transportation Research Part F: Traffic Psychology and Behaviour 45 (Feb. 2017), 75–92. https://doi.org/10.1016/j.trf.2016.10.019

[86]

Rainer Reisenzein. 2000. The subjective experience of surprise. In The Message within: The Role of Subjective Experience in Social Cognition and Behavior.Psychology Press, New York, 262–279.

[87]

Ernst Roidl, Berit Frehse, and Rainer Höger. 2014. Emotional states of drivers and the impact on speed, acceleration and traffic violations—A simulator study. Accident Analysis & Prevention 70 (Sept. 2014), 282–292. https://doi.org/10.1016/j.aap.2014.04.010

[88]

Ernst Roidl, Berit Frehse, Michael Oehl, and Rainer Höger. 2013. The emotional spectrum in traffic situations: Results of two online-studies. Transportation Research Part F: Traffic Psychology and Behaviour 18 (2013), 168–188. https://doi.org/10.1016/j.trf.2012.12.009

[89]

Yea-Kyung Row, Chang Min Kim, and Tek-Jin Nam. 2016. DooBoo: Pet-like interactive dashboard towards emotional electric vehicle. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA’16. ACM, Santa Clara, CA, 2673–2680. https://doi.org/10.1145/2851581.2892460

Digital Library

[90]

James A. Russell. 1980. A circumplex model of affect.Journal of Personality and Social Psychology 39, 6 (1980), 1161–1178. https://doi.org/10.1037/h0077714

[91]

Sm Sarala, Dh Sharath Yadav, and Asadullah Ansari. 2018. Emotionally adaptive driver voice alert system for advanced driver assistancesystem (ADAS) applications. In Proceedings of the 2018 International Conference on Smart Systems and Inventive Technology (ICSSIT). IEEE, Tirunelveli, India, 509–512. https://doi.org/10.1109/ICSSIT.2018.8748541

[92]

Elisabeth Schmidt and Angelika C. Bullinger. 2017. Mitigating passive fatigue during monotonous drives with thermal stimuli: Insights into the effect of different stimulation durations. Accident Analysis Prevention 126 (Dec. 2017), 115–121. https://doi.org/10.1016/j.aap.2017.12.005

[93]

Elisabeth Schmidt, Ralf Decke, and Ralph Rasshofer. 2016. Correlation between subjective driver state measures and psychophysiological and vehicular data in simulated driving. In Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV). IEEE, Gothenburg, Sweden, 1380–1385. https://doi.org/10.1109/ivs.2016.7535570

Digital Library

[94]

Elisabeth Schmidt, Ralf Decke, Ralph Rasshofer, and Angelika C. Bullinger. 2017. Psychophysiological responses to short-term cooling during a simulated monotonous driving task. Applied Ergonomics 62 (July 2017), 9–18. https://doi.org/10.1016/j.apergo.2017.01.017

[95]

Rob Semmens, Nikolas Martelaro, Pushyami Kaveti, Simon Stent, and Wendy Ju. 2019. Is now a good time?: An empirical study of vehicle-driver communication timing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - (CHI’19). ACM, Glasgow, Scotland, UK, 1–12. https://doi.org/10.1145/3290605.3300867

Digital Library

[96]

Sina Shafaei, Tahir Hacizade, and Alois Knoll. 2019. Integration of driver behavior into emotion recognition systems: A preliminary study on steering wheel and vehicle acceleration. In Computer Vision – ACCV 2018 Workshops, Gustavo Carneiro and Shaodi You (Eds.). Vol. 11367. Springer International Publishing, Cham, 386–401. https://doi.org/10.1007/978-3-030-21074-8_32

[97]

P. Slovic. 1987. Perception of risk. Science 236, 4799 (April 1987), 280. https://doi.org/10.1126/science.3563507

[98]

Elena Spiridon and Stephen Fairclough. 2017. The effects of ambient blue light on anger levels: Applications in the design of unmanned aircraft GCS. International Journal of Unmanned Systems Engineering 5, 3 (2017), 53–69.

[99]

Klara Steinhauser, Felix Leist, Kathrin Maier, Vera Michel, Nikolai Pärsch, Philip Rigley, Franz Wurm, and Marco Steinhauser. 2018. Effects of emotions on driving behavior. Transportation Research Part F: Traffic Psychology and Behaviour 59 (Nov. 2018), 150–163. https://doi.org/10.1016/j.trf.2018.08.012

[100]

Orit Taubman-Ben-Ari. 2012. The effects of positive emotion priming on self-reported reckless driving. Accident Analysis & Prevention 45 (March 2012), 718–725. https://doi.org/10.1016/j.aap.2011.09.039

[101]

Thanyathorn Thanapattheerakul, Katherine Mao, Jacqueline Amoranto, and Jonathan H. Chan. 2018. Emotion in a century: A review of emotion recognition. In Proceedings of the 10th International Conference on Advances in Information Technology - (IAIT 2018). ACM, Bangkok, Thailand, 1–8. https://doi.org/10.1145/3291280.3291788

Digital Library

[102]

Gokul Sidarth Thirunavukkarasu, Hamid Abdi, and Navid Mohajer. 2016. A smart HMI for driving safety using emotion prediction of EEG signals. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, Budapest, Hungary, 6. https://doi.org/10.1109/smc.2016.7844882

Digital Library

[103]

Toyota. 2017. Toyota Concept-I. https://youtu.be/cQna409Nctk. Retrieved: October 29, 2019.

[104]

Toyota. 2019. Toyota LQ Concept. https://www.netcarshow.com/toyota/2019-lq_concept. Retrieved: October 28, 2019.

[105]

Lana M. Trick, Seneca Brandigampola, and James T. Enns. 2012. How fleeting emotions affect hazard perception and steering while driving: The impact of image arousal and valence. Accident Analysis & Prevention 45 (March 2012), 222–229. https://doi.org/10.1016/j.aap.2011.07.006

[106]

Geoffrey Underwood, Peter Chapman, Sharon Wright, and David Crundall. 1999. Anger while driving. Transportation Research Part F: Traffic Psychology and Behaviour 2, 1 (March 1999), 55–68. https://doi.org/10.1016/S1369-8478(99)00006-6

[107]

Marjolein D. van der Zwaag, Chris Dijksterhuis, Dick de Waard, Ben L. J. M. Mulder, Joyce H. D. M. Westerink, and Karel A. Brookhuis. 2012. The influence of music on mood and performance while driving. Ergonomics 55, 1 (Jan. 2012), 12–22. https://doi.org/10.1080/00140139.2011.638403

[108]

Hans-Jörg Vögel, Raphaël Troncy, Benoit Huet, Melek Önen, Adlen Ksentini, Jörg Conradt, Asaf Adi, Alexander Zadorojniy, Jacques Terken, Jonas Beskow, Ann Morrison, Christian Süß, Kynan Eng, Florian Eyben, Samer Al Moubayed, Susanne Müller, Thomas Hubregtsen, Viviane Ghaderi, Ronee Chadowitz, Elisabeth André, Nicholas Cummins, Björn Schuller, and Jérôme Härri. 2018. Emotion-awareness for intelligent vehicle assistants: A research agenda. In Proceedings of the 1st International Workshop on Software Engineering for AI in Autonomous Systems - (SEFAIS’18). ACM, Gothenburg, Sweden, 11–15. https://doi.org/10.1145/3194085.3194094

Digital Library

[109]

Thurid Vogt, Elisabeth André, and Johannes Wagner. 2008. Automatic recognition of emotions from speech: A review of the literature and recommendations for practical realisation. In Affect and Emotion in Human-Computer Interaction, Christian Peter and Russell Beale (Eds.). Vol. 4868. Springer Berlin, Berlin, 75–91. https://doi.org/10.1007/978-3-540-85099-1_7

Digital Library

[110]

Sarah Theres Völkel, Julia Graefe, Ramona Schödel, Renate Häuslschmid, Clemens Stachl, Quay Au, and Heinrich Hussmann. 2018. I drive my car and my states drive me: Visualizing driver’s emotional and physical states. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’18). ACM, New York, 198–203. https://doi.org/10.1145/3239092.3267102

Digital Library

[111]

Volvo. 2019. Volvo Cars to Deploy In-Car Cameras and Intervention against Intoxication, Distraction.https://www.media.volvocars.com/global/en-gb/media/pressreleases/250015/volvo-cars-to-deploy-in-car-cameras-and-intervention-against-intoxication-distraction.Retrieved: October 29, 2019.

[112]

Isabel Wagner. 2019. Passenger cars-sales in selected countries worldwide 2005–2018, Statista. https://www.statista.com/statistics/257660/passenger-car-sales-in-selected-countries.Retrieved: January 20, 2020.

[113]

Chao Wang, Jacques Terken, Jun Hu, and Matthias Rauterberg. 2016. “Likes” and “dislikes” on the road: A social feedback system for improving driving behavior. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Automotive’UI 16). ACM, New York, 43–50. https://doi.org/10.1145/3003715.3005403

Digital Library

[114]

Marlene Weber. 2018. Automotive Emotions: A Human-Centred Approach Towards the Measurement and Understanding of Drivers’ Emotions and Their Triggers. Ph.D. Dissertation. Brunel University.

[115]

Karla Conn Welch, Cindy Harnett, and Yi-Ching Lee. 2019. A review on measuring affect with practical sensors to monitor driver behavior. Safety 5, 4 (2019), 18. https://doi.org/10.3390/safety5040072

[116]

Markus Winkler, Rainer Mehl, Jerome Buvat, Ramya Krishna Puttur, Gaurav Aggarwal, and Hiral Shah. 2019. Voice on the Go - How can Auto Manufacturers Provide a Superior In-Car Voice Experience. Technical Report. Capgemini Research Institute.

[117]

Daniela Wurhofer, Alina Krischkowsky, Marianna Obrist, Evangelos Karapanos, Evangelos Niforatos, and Manfred Tscheligi. 2015. Everyday commuting: Prediction, actual experience and recall of anger and frustration in the car. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - (AutomotiveUI’15). ACM, Nottingham, United Kingdom, 233–240. https://doi.org/10.1145/2799250.2799251

Digital Library

[118]

Robert M. Yerkes and John D. Dodson. 1908. The relation of strength of stimulus to rapidity of habit-formation. Journal of Comparative Neurology and Psychology 18, 5 (Nov. 1908), 459–482. https://doi.org/10.1002/cne.920180503

[119]

Sebastian Zepf, Monique Dittrich, Javier Hernandez, and Alexander Schmitt. 2019. Towards empathetic car interfaces: Emotional triggers while driving. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA’19). ACM, Glasgow, Scotland UK, 1–6. https://doi.org/10.1145/3290607.3312883

Digital Library

[120]

Tingru Zhang, Alan H. S. Chan, Yutao Ba, and Wei Zhang. 2016. Situational driving anger, driving performance and allocation of visual attention. Transportation Research Part F: Traffic Psychology and Behaviour 42 (Oct. 2016), 376–388. https://doi.org/10.1016/j.trf.2015.05.008

[121]

Yueyan Zhu, Ying Wang, Guofa Li, and Xiang Guo. 2016. Recognizing and releasing drivers’ negative emotions by using music: Evidence from driver anger. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI’16 Adjunct). ACM, New York, 173–178. https://doi.org/10.1145/3004323.3004344

Digital Library

[122]

Tatjana Zimasa, Samantha Jamson, and Brian Henson. 2019. The influence of driver’s mood on car following and glance behaviour: Using cognitive load as an intervention. Transportation Research Part F: Traffic Psychology and Behaviour 66 (Oct. 2019), 87–100. https://doi.org/10.1016/j.trf.2019.08.019

Cited By

Wan FTeng JFeng L(2024)Exploring User Attitudes and Behavioral Intentions towards Augmented Reality Automotive Assistants: A Mixed-Methods ApproachWorld Electric Vehicle Journal10.3390/wevj1506025815:6(258)Online publication date: 12-Jun-2024
https://doi.org/10.3390/wevj15060258
Balada FAluja AGarcía ÓAymamí NGarcía L(2024)Gender Differences in Prefrontal Cortex Response to Negative Emotional Stimuli in DriversBrain Sciences10.3390/brainsci1409088414:9(884)Online publication date: 30-Aug-2024
https://doi.org/10.3390/brainsci14090884
Lohani MDo AAisa A(2024)Design considerations for future affective automotive interfaces: a review of self-regulation strategies to manage affect behind the wheelFrontiers in Future Transportation10.3389/ffutr.2024.14588285Online publication date: 28-Oct-2024
https://doi.org/10.3389/ffutr.2024.1458828
Show More Cited By

Index Terms

Affective Automotive User Interfaces–Reviewing the State of Driver Affect Research and Emotion Regulation in the Car
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Towards Empathetic Car Interfaces: Emotional Triggers while Driving
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Monitoring the emotions of drivers can play a critical role to reduce road accidents and enable novel driver-car interactions. To help understand the possibilities, this work systematically studies the in-road triggers that may lead to different ...
What If Your Car Would Care? Exploring Use Cases For Affective Automotive User Interfaces
MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

In this paper we present use cases for affective user interfaces (UIs) in cars and how they are perceived by potential users in China and Germany. Emotion-aware interaction is enabled by the improvement of ubiquitous sensing methods and provides ...
Improving automotive safety by pairing driver emotion and car voice emotion
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

This study examines whether characteristics of a car voice can affect driver performance and affect. In a 2 (driver emotion: happy or upset) x 2 (car voice emotion: energetic vs. subdued) experimental study, participants (N=40) had emotion induced ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 54, Issue 7

September 2022

778 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/3476825

Editor:
Albert Zomaya
University of Sydney, Australia

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 September 2021

Accepted: 01 April 2021

Revised: 01 October 2020

Received: 01 January 2020

Published in CSUR Volume 54, Issue 7

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
1,423
Total Downloads

Downloads (Last 12 months)443
Downloads (Last 6 weeks)60

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wan FTeng JFeng L(2024)Exploring User Attitudes and Behavioral Intentions towards Augmented Reality Automotive Assistants: A Mixed-Methods ApproachWorld Electric Vehicle Journal10.3390/wevj1506025815:6(258)Online publication date: 12-Jun-2024
https://doi.org/10.3390/wevj15060258
Balada FAluja AGarcía ÓAymamí NGarcía L(2024)Gender Differences in Prefrontal Cortex Response to Negative Emotional Stimuli in DriversBrain Sciences10.3390/brainsci1409088414:9(884)Online publication date: 30-Aug-2024
https://doi.org/10.3390/brainsci14090884
Lohani MDo AAisa A(2024)Design considerations for future affective automotive interfaces: a review of self-regulation strategies to manage affect behind the wheelFrontiers in Future Transportation10.3389/ffutr.2024.14588285Online publication date: 28-Oct-2024
https://doi.org/10.3389/ffutr.2024.1458828
江靖(2024)Road Rage Identification and Real-Time Monitoring: Technological Advances and ChallengesAdvances in Psychology10.12677/ap.2024.14856714:08(447-460)Online publication date: 2024
https://doi.org/10.12677/ap.2024.148567
江靖(2024)Emotional Traffic Light: Real-Time Regulation of Driving AngerAdvances in Psychology10.12677/ap.2024.141285114:12(28-35)Online publication date: 2024
https://doi.org/10.12677/ap.2024.1412851
Wang YTran TTomitsch M(2024)Physiological Measurements in Automated Vehicle-Pedestrian Research: Review and Future OpportunitiesAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685043(172-177)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685043
Karas VSchuller DSchuller B(2024)Audiovisual Affect Recognition for Autonomous Vehicles: Applications and Future AgendasIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.333374925:6(4918-4932)Online publication date: Jun-2024
https://doi.org/10.1109/TITS.2023.3333749
Li GYuan BOuyang DLi WPan YGuo ZGuo G(2024)Emotion Recognition Based on Selected EEG Signals by Common Spatial PatternIEEE Sensors Journal10.1109/JSEN.2024.335840024:6(8414-8426)Online publication date: 15-Mar-2024
https://doi.org/10.1109/JSEN.2024.3358400
Han QFan HWang XZhang JLiu XGuan X(2024) Rationally engineered smart automotive upholstery leather based on gradient feeding in situ one-pot reaction in microreactors of natural skin Journal of Materials Chemistry A10.1039/D4TA06569G12:46(32217-32229)Online publication date: 2024
https://doi.org/10.1039/D4TA06569G
Chanmas GTaveekitworachai PYou XThawonmas RNukoolkit CDajpratham P(2024)Driving assistant using generative AI pre-generated messages in simulator-based driving assessment: A step towards low-cost simulator-based driving assessmentHeliyon10.1016/j.heliyon.2024.e3594110:16(e35941)Online publication date: Aug-2024
https://doi.org/10.1016/j.heliyon.2024.e35941
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents