Analysis of deep learning algorithms for emotion classification based on facial expression recognition
Pages 161 - 167
Abstract
Facial expression recognition (FER) is essential for discerning human emotions and is applied extensively in big data analytics, healthcare, security, and user experience enhancement. This paper presents an empirical study that evaluates four existing deep learning models—VGG16, DenseNet, ResNet50, and GoogLeNet—utilizing the Facial Expression Recognition 2013 (FER2013) dataset. The dataset contains seven distinct emotional expressions: angry, disgust, fear, happy, neutral, sad, and surprise. Each model underwent rigorous assessment based on metrics including test accuracy, training duration, and weight file size to test their effectiveness in FER tasks. ResNet50 emerged as the top performer with a test accuracy of 69.46%, leveraging its residual learning architecture to effectively address challenges inherent in training deep neural networks. Conversely, GoogLeNet exhibited the lowest test accuracy among the models, suggesting potential architectural constraints in FER applications. VGG16, while competitive in accuracy, demonstrated lengthier training times and a larger weight file size (512MB), highlighting the inherent balance between model complexity and computational efficiency.
References
[1]
P. Naga, S. D. Marri, and R. Borreo, ‘Facial emotion recognition methods, datasets and technologies: A literature survey’, Materials Today: Proceedings, vol. 80, pp. 2824–2828, 2023.
[2]
E. G. Krumhuber, L. I. Skora, H. C. H. Hill, and K. Lander, ‘The role of facial movements in emotion recognition’, Nat Rev Psychol, vol. 2, no. 5, pp. 283–296, Mar. 2023.
[3]
Y. K. Bhatti, A. Jamil, N. Nida, M. H. Yousaf, S. Viriri, and S. A. Velastin, ‘Facial Expression Recognition of Instructor Using Deep Features and Extreme Learning Machine’, Computational Intelligence and Neuroscience, vol. 2021, pp. 1–17, Apr. 2021.
[4]
A. Mehrabian, ‘Communication without words’, 1968. [Online]. Available: https://api.semanticscholar.org/CorpusID:62098432
[5]
C. D. Mortensen, Ed., Communication theory, Second edition. London [England]: Routledge, 2017.
[6]
A. Ortony, ‘Are All “Basic Emotions” Emotions? A Problem for the (Basic) Emotions Construct’, Perspect Psychol Sci, vol. 17, no. 1, pp. 41–61, Jan. 2022.
[7]
Z. He and X. Qin, ‘Analysis of Facial Expressions in Class Based on Lightweight Convolutional Neural Network’, in 2022 International Conference on Industrial Automation, Robotics and Control Engineering (IARCE), Jun. 2022, pp. 68–74.
[8]
P. Metgud, N. D. Naik, S. M. S, and A. S. Prasad, ‘Real-time Student Emotion and Performance Analysis’, in 2022 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Jul. 2022, pp. 1–5.
[9]
B. Baranidharan, H. Bhandari, A. Tewari, I. Sachadeva, and Abhinav, ‘Engagement in Video Graphic Online Learning Using the Emotional Dimensions in the Learning Context’, in 2023 International Conference for Advancement in Technology (ICONAT), Jan. 2023, pp. 1–6.
[10]
S. Suraj and V. M. Sapna, ‘Deep Learning Approach For Human Emotion-Gender-Age Recognition’, in 2022 3rd International Conference on Communication, Computing and Industry 4.0 (C2I4), Dec. 2022, pp. 1–6.
[11]
L. Atymtayeva, M. Kanatov, A. M. A Musleh, and G. Tulemissova, ‘Fast Facial Expression Recognition System: Selection of Models’, Applied Mathematics and Information Sciences, vol. 17, no. 2, pp. 375–383, 2023.
[12]
H. Wang, D. P. Tobón V., M. S. Hossain, and A. E. Saddik, ‘Deep Learning (DL)-Enabled System for Emotional Big Data’, IEEE Access, vol. 9, pp. 116073–116082, 2021.
[13]
‘Facial Expression Recognition Based on GSO Enhanced Deep Learning in IOT Environment’, IJIES, vol. 17, no. 3, pp. 445–459, Jun. 2024.
[14]
N. Aikyn, A. Zhanegizov, T. Aidarov, D.-M. Bui, and N. A. Tu, ‘Efficient facial expression recognition framework based on edge computing’, Journal of Supercomputing, 2023.
[15]
Priti Singh, ‘Efficient Facial Emotion Detection through Deep Learning Techniques’, cana, vol. 31, no. 2s, pp. 630–638, Jun. 2024.
[16]
L. Hu and Q. Ge, ‘Automatic facial expression recognition based on MobileNetV2 in Real-time’, presented at the Journal of Physics: Conference Series, 2020.
[17]
Q. Xia and X. Ding, ‘Facial Micro-expression Recognition Algorithm Based on Big Data’, J. Phys.: Conf. Ser., vol. 2066, no. 1, p. 012023, Nov. 2021.
[18]
S. Deng, ‘Face expression image detection and recognition based on big data technology’, International Journal of Intelligent Networks, vol. 4, pp. 218–223, 2023.
[19]
R. Lu and F. Ji, ‘Design and implementation of a virtual teacher teaching system algorithm based on facial expression recognition in the era of big data’, Applied Mathematics and Nonlinear Sciences, vol. 9, no. 1, p. 20230053, Jan. 2024.
[20]
R. Sathya, R. Manivannan, and K. Vaidehi, ‘Vision-Based Personal Face Emotional Recognition Approach Using Machine Learning and Tree-Based Classifier’, presented at the Lecture Notes in Networks and Systems, 2022, pp. 561–573.
[21]
A. I. Siam, N. F. Soliman, A. D. Algarni, F. E. Abd El-Samie, and A. Sedik, ‘Deploying Machine Learning Techniques for Human Emotion Detection’, Computational Intelligence and Neuroscience, vol. 2022, 2022.
[22]
A. Mohammad Hemmatiyan-Larki, F. Rafiee-Karkevandi, and M. Yazdian-Dehkordi, ‘Facial Expression Recognition: a Comparison with Different Classical and Deep Learning Methods’, in 2022 International Conference on Machine Vision and Image Processing (MVIP), Ahvaz, Iran, Islamic Republic of: IEEE, Feb. 2022, pp. 1–5.
[23]
S. Saeed et al., ‘Empirical Evaluation of SVM for Facial Expression Recognition’, ijacsa, vol. 9, no. 11, 2018.
[24]
M. A. Haghpanah, E. Saeedizade, M. T. Masouleh, and A. Kalhor, ‘Real-Time Facial Expression Recognition using Facial Landmarks and Neural Networks’, in 2022 International Conference on Machine Vision and Image Processing (MVIP), Feb. 2022, pp. 1–7.
[25]
P. Kumar, S. L. Happy, and A. Routray, ‘A real-time robust facial expression recognition system using HOG features’, in 2016 International Conference on Computing, Analytics and Security Trends (CAST), Pune, India: IEEE, Dec. 2016, pp. 289–293.
[26]
A. Krizhevsky, I. Sutskever, and G. E. Hinton, ‘ImageNet classification with deep convolutional neural networks’, Commun. ACM, vol. 60, no. 6, pp. 84–90, May 2017.
[27]
K. Simonyan and A. Zisserman, ‘Very Deep Convolutional Networks for Large-Scale Image Recognition’. arXiv, 2014.
[28]
K. He, X. Zhang, S. Ren, and J. Sun, ‘Deep Residual Learning for Image Recognition’. arXiv, 2015.
[29]
C. Szegedy et al., ‘Going Deeper with Convolutions’. arXiv, 2014.
[30]
Y. Bhargavi, B. D, and S. Prince, ‘AI-based Emotion Therapy Bot for Children with Autism Spectrum Disorder (ASD)’, in 2023 9th International Conference on Advanced Computing and Communication Systems (ICACCS), Mar. 2023, pp. 1895–1899.
[31]
S. Gupta, P. Kumar, and R. K. Tekchandani, ‘Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models’, Multimedia Tools and Applications, vol. 82, no. 8, pp. 11365–11394, 2023.
[32]
G. Agrawal, U. Jha, and R. Bidwe, ‘Automatic Facial Expression Recognition Using Advanced Transfer Learning’, in Proceedings of the 2023 Fifteenth International Conference on Contemporary Computing, in IC3-2023. New York, NY, USA: Association for Computing Machinery, 2023, pp. 450–458.
[33]
I. J. Goodfellow et al., ‘Challenges in representation learning: A report on three machine learning contests’, Neural Networks, vol. 64, pp. 59–63, Apr. 2015.
Index Terms
- Analysis of deep learning algorithms for emotion classification based on facial expression recognition
Recommendations
Automatic Facial Expression Recognition using Advanced Transfer Learning
IC3-2023: Proceedings of the 2023 Fifteenth International Conference on Contemporary ComputingFacial expression recognition has emerged as a remarkable technology that has transformed the way we perceive, understand, and interact with human emotions. In our complex and diverse world, where non-verbal communication plays a vital role, facial ...
Facial expression recognition via learning deep sparse autoencoders
Facial expression recognition is an important research issue in the pattern recognition field. In this paper, we intend to present a novel framework for facial expression recognition to automatically distinguish the expressions with high accuracy. ...
Benchmarking deep learning techniques for face recognition
Highlights- Training networks for face recognition is very complex and time-consuming.
- ...
AbstractRecent progresses in Convolutional Neural Networks (CNNs) and GPUs have greatly advanced the state-of-the-art performance for face recognition. However, training CNNs for face recognition is complex and time-consuming. Multiple factors ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
412 pages
ISBN:9798400717529
DOI:10.1145/3697355
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
BDIOT 2024
BDIOT 2024: 2024 8th International Conference on Big Data and Internet of Things
September 14 - 16, 2024
Macau, China
Acceptance Rates
Overall Acceptance Rate 75 of 136 submissions, 55%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 15Total Downloads
- Downloads (Last 12 months)15
- Downloads (Last 6 weeks)15
Reflects downloads up to 22 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in