Abstract
Autonomous driving cars hopefully could improve road safety. However, they pose new challenges, not only on a technological level but also from ethical and social points of view. In particular, social acceptance of those vehicles is a crucial point to obtain a widespread adoption of them. People nowadays are used to owning manually driven vehicles, but in the future, it will be more probable that the autonomous driving cars will not be owned by the end users, but rented like a sort of driverless taxis. Customers can feel uncomfortable while riding an autonomous driving car, while rental agencies will need to differentiate the services offered by their fleets of vehicles. If people are afraid to travel by these vehicles, even if from the technological point of view they are safer with respect to the manually driven ones, customers will not use them, making the safety improvements useless. To prevent the occupants of the vehicle from having bad feelings, the proposed strategy is to adapt the vehicle driving style based on their moods. This requires the usage of a neural network trained by means of facial expressions databases, of which there are many freely available online for research purposes. These resources are very useful, but it is difficult to combine them due to their different structures. To overcome this issue, a tool designed to uniform them, in order to use the same training scripts, and to simplify the application of commonly used postprocessing operations, has been implemented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Burns L.D.: Sustainable mobility: a vision of our transport future. In: Nature 497(7448), 181–182 (2013)
Trògolo, A.M., Melchior, F., Medrano, L.A.: The role of difficulties in emotion regulation on driving behavior. J. Behav. Health Soc. Issues (2014). https://doi.org/10.5460/jbhsi.v6.1.47607
Hu T, Xie X., Lee, J.: Negative or positive? The effect of emotion and mood on risky driving (2013). https://doi.org/10.1016/j.trf.2012.08.009
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
DeepMind company website, https://deepmind.com/. Last accessed 10 May 2019
Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)
Ekman, P.: Basic Emotions. In: Dalgleish, T., Power, M.J. (eds.) Handbook of Cognition and Emotion, pp. 45–60. Wiley, New York, NY (1999)
Ekman, P., Cordaro, D.: What is meant by calling emotions basic. Emot. Rev. 3(4), 364–370 (2011)
Cordaro, D.T., Sun, R., Keltner, D., Kamble, S., Huddar, N., McNeil, G.: Universals and cultural variations in 22 emotional expressions across five cultures. Emotion 18(1), 75–93 (2018)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Ekman, Paul, Friesen, Wallace V., Hager, Joseph C.: Facial Action Coding System: The Manual on CD ROM. A Human Face, Salt Lake City (2002)
Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 300–305 (1998)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)
Fraedrich, E., Lenz, B.: Societal and individual acceptance of autonomous driving. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_29
Fraedrich, E., Lenz, B.: Taking a drive, hitching a ride: autonomous driving and car usage. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_31
Woisetschläger, D.M.: Consumer perceptions of automated driving technologies: an examination of use cases and branding strategies. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_32
Kanade, T., Cohn, J. F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG’00), Grenoble, France, pp. 46–53 (2000)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade Dataset (CK+): a complete expression dataset for action unit and emotion-specified expression. In: Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB 2010), San Francisco, USA, pp. 94–101 (2010)
Goodfellow, I., Erhan, D., Carrier, P.L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D.H., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L., Xu, B., Chuang, Z., Bengio, Y.: Challenges in representation learning: a report on three machine learning contests. arXiv (2013)
Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets. In: 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205 (1998)
Aifanti, N., Papachristou, C., Delopoulos, A.: The MUG facial expression database. In: Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano, Italy, April 12–14 (2010)
Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D.H.J., Hawk, S.T., van Knippenberg, A.: Presentation and validation of the Radboud faces database. Cogn. Emot. 24(8), 1377–1388 (2010). https://doi.org/10.1080/02699930903485076
Chollet, F., Keras, et al.: https://keras.io (2015). Last accessed 10 May 2019
Scikit-learn: Machine Learning in Python, Pedregosa et al., JMLR 12, pp. 2825–2830 (2011)
Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools 120, 122–125 (2000)
Facial Expression Database Classifier (FEDC), https://github.com/AntonioMarceddu/Facial_Expression_Database_Classifier. Last accessed 10 May 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Sini, J., Marceddu, A.C., Violante, M., Dessì, R. (2021). Passengers’ Emotions Recognition to Improve Social Acceptance of Autonomous Driving Vehicles. In: Esposito, A., Faundez-Zanuy, M., Morabito, F., Pasero, E. (eds) Progresses in Artificial Intelligence and Neural Systems. Smart Innovation, Systems and Technologies, vol 184. Springer, Singapore. https://doi.org/10.1007/978-981-15-5093-5_3
Download citation
DOI: https://doi.org/10.1007/978-981-15-5093-5_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-5092-8
Online ISBN: 978-981-15-5093-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)