research-article

FExR.A-DCNN: Facial Emotion Recognition with Attention mechanism using Deep Convolution Neural Network

Authors:

Pratishtha Verma,

Jyoti MagguAuthors Info & Claims

IC3-2022: Proceedings of the 2022 Fourteenth International Conference on Contemporary Computing

Pages 196 - 203

https://doi.org/10.1145/3549206.3549243

Published: 24 October 2022 Publication History

Abstract

Human Facial Emotions play an important role in non-verbal communication between people. Automated Facial Recognition can have various impacts on our technology, helping us to better understand human behaviour, detect mental disorders, and synthesising facial expressions. Methods based on appearance and geometry are predominantly used, but fail to achieve high accuracy with limited data-sets. In this article we proposed various techniques using deep learning concepts of CNN to identify 7 key human emotions. We achieved 98% accuracy on CK+ data set having low sample count in 100 epochs, which confirms the superiority of the model in detecting and focusing on key global features for Facial Emotion Recognition.

References

[1]

Man Hao, Wei-Hua Cao, Zhen-Tao Liu, Min Wu, and Peng Xiao. 2020. Visual-audio emotion recognition based on multi-task and ensemble learning with multiple features. Neurocomputing 391(2020), 42–51.

[2]

Behzad Hasani. 2020. Automated Recognition of Facial Affect Using Deep Neural Networks. Ph. D. Dissertation. University of Denver.

[3]

Mahdi Jampour, Thomas Mauthner, and Horst Bischof. 2015. Multi-view facial expressions recognition using local linear regression of sparse codes. In Proceedings of the 20th Computer Vision Winter Workshop Paul Wohlhart.

[4]

MinSeop Lee, Yun Kyu Lee, Myo-Taeg Lim, and Tae-Koo Kang. 2020. Emotion recognition using convolutional neural network with selected statistical photoplethysmogram features. Applied Sciences 10, 10 (2020), 3501.

[5]

Shan Li and Weihong Deng. 2020. Deep facial expression recognition: A survey. IEEE transactions on affective computing(2020).

[6]

Qirong Mao, Qiyu Rao, Yongbin Yu, and Ming Dong. 2016. Hierarchical Bayesian theme models for multipose facial expression recognition. IEEE Transactions on Multimedia 19, 4 (2016), 861–873.

Digital Library

[7]

Evangelos Sariyanidi, Hatice Gunes, and Andrea Cavallaro. 2014. Automatic analysis of facial affect: A survey of registration, representation, and recognition. IEEE transactions on pattern analysis and machine intelligence 37, 6(2014), 1113–1133.

[8]

Justus Schwan, Esam Ghaleb, Enrique Hortal, and Stylianos Asteriadis. 2017. High-performance and lightweight real-time deep face emotion recognition. In 2017 12th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). IEEE, 76–79.

[9]

Mesut Toğaçar, Zafer Cömert, and Burhan Ergen. 2020. Classification of brain MRI using hyper column technique with convolutional neural network and feature selection method. Expert Systems with Applications 149 (2020), 113274.

[10]

Su-Jing Wang, Wen-Jing Yan, Xiaobai Li, Guoying Zhao, Chun-Guang Zhou, Xiaolan Fu, Minghao Yang, and Jianhua Tao. 2015. Micro-expression recognition using color spaces. IEEE Transactions on Image Processing 24, 12 (2015), 6034–6047.

Digital Library

[11]

Shengli Xie and Yifan Feng. 2015. A recommendation system combining LDA and collaborative filtering method for Scenic Spot. In 2015 2nd International Conference on Information Science and Control Engineering. IEEE, 67–71.

Digital Library

[12]

Siyue Xie and Haifeng Hu. 2018. Facial expression recognition using hierarchical features with deep comprehensive multipatches aggregation convolutional neural networks. IEEE Transactions on Multimedia 21, 1 (2018), 211–220.

Digital Library

[13]

Xiaofeng Yang, Zhe Wang, Hongxia Deng, Haifang Li, Rong Yao, Peng Gao, 2020. Recognizing image semantic information through multi-feature fusion and SSAE-based deep network. Journal of Medical Systems 44, 2 (2020), 1–16.

Digital Library

[14]

Hui Yu and Honghai Liu. 2014. Regression-based facial expression optimization. IEEE transactions on human-machine systems 44, 3 (2014), 386–394.

[15]

Sicheng Zhao, Yue Gao, Xiaolei Jiang, Hongxun Yao, Tat-Seng Chua, and Xiaoshuai Sun. 2014. Exploring principles-of-art features for image emotion recognition. In Proceedings of the 22nd ACM international conference on Multimedia. 47–56.

Digital Library

[16]

Ruicong Zhi, Mengyi Liu, and Dezheng Zhang. 2020. A comprehensive survey on automatic facial action unit analysis. The Visual Computer 36, 5 (2020), 1067–1093.

Digital Library

[17]

Xinge Zhu, Liang Li, Weigang Zhang, Tianrong Rao, Min Xu, Qingming Huang, and Dong Xu. 2017. Dependency Exploitation: A Unified CNN-RNN Approach for Visual Emotion Recognition. In IJCAI. 3595–3601.

Cited By

Gupta MMishra A(2023)AB-DeepLabv3+: An Encoder-Decoder Method with Attention Mechanism for Polyp SegmentationProceedings of the 2023 Fifteenth International Conference on Contemporary Computing10.1145/3607947.3607997(262-268)Online publication date: 3-Aug-2023
https://dl.acm.org/doi/10.1145/3607947.3607997
Tripathy SSingh DJaiswal A(2023)Multi-Layer Feature Fusion-based Deep Multi-layer Depth Separable Convolution Neural Network for Alzheimer's Disease Detection2023 International Conference on IoT, Communication and Automation Technology (ICICAT)10.1109/ICICAT57735.2023.10263657(1-5)Online publication date: 23-Jun-2023
https://doi.org/10.1109/ICICAT57735.2023.10263657

Recommendations

Pose-robust feature learning for facial expression recognition

Automatic facial expression recognition (FER) from non-frontal views is a challenging research topic which has recently started to attract the attention of the research community. Pose variations are difficult to tackle and many face analysis methods ...
Extended deep neural network for facial emotion recognition
Highlights
- A new Deep Fully Connected model for facial emotion recognition.
- The model ...
Abstract
Humans use facial expressions to show their emotional states. However, facial expression recognition has remained a challenging and interesting problem in computer vision. In this paper we present our approach which is the extension of ...
Unconstrained face recognition using deep convolution neural network

Different methods have been proposed for face recognition during the past decades that differ essentially on how to determine discriminant facial features for better recognition. Recently, very deep neural networks achieved great success on general object ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IC3-2022: Proceedings of the 2022 Fourteenth International Conference on Contemporary Computing

August 2022

710 pages

ISBN:9781450396752

DOI:10.1145/3549206

General Chairs:
Sartaj Sahni
University of Florida, USA
,
Vikas Saxena
JIIT Noida, India
,
Program Chair:
Sundaraja Sitharama Iyengar
Florida International University, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IC3-2022

IC3-2022: 2022 Fourteenth International Conference on Contemporary Computing

August 4 - 6, 2022

Noida, India

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
72
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gupta MMishra A(2023)AB-DeepLabv3+: An Encoder-Decoder Method with Attention Mechanism for Polyp SegmentationProceedings of the 2023 Fifteenth International Conference on Contemporary Computing10.1145/3607947.3607997(262-268)Online publication date: 3-Aug-2023
https://dl.acm.org/doi/10.1145/3607947.3607997
Tripathy SSingh DJaiswal A(2023)Multi-Layer Feature Fusion-based Deep Multi-layer Depth Separable Convolution Neural Network for Alzheimer's Disease Detection2023 International Conference on IoT, Communication and Automation Technology (ICICAT)10.1109/ICICAT57735.2023.10263657(1-5)Online publication date: 23-Jun-2023
https://doi.org/10.1109/ICICAT57735.2023.10263657

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents