Abstract
An important method in the “human–computer interface” (HCI) is emotion recognition. Conventional emotion detection algorithms rely on exterior behaviors like facial expression, which may not be able to accurately capture authentic human emotion because facial expression signals can sometimes be hidden. Recently, it has become increasingly important for the BCI system to become more intelligent to recognize emotions using electroencephalograms (EEG). EEG signal is very similar to human emotion and can therefore accurately represent human emotion. Since EEG signals are often noisy, nonlinear, and contain non-stationary characteristics, it is challenging to develop an intelligent framework that can distinguish emotions with high accuracy. To accurately analyze emotions from brain data, we offer a fuzzy method-based emotion identification model in this study. Initially, the DEAP dataset is collected and preprocessed using Butterworth “bandpass” filter as well as stationary “wavelet transform” filters. Signal features are extracted using “Hilbert Huang transform” and “differential entropy” methods. The proposed “fractional feedback fuzzy neural network” with the “chaotic drifted Red Deer optimization algorithm” effectively classifies the emotions from the extracted features. Our suggested method increases the recognition accuracy rate when compared to conventional emotion recognition algorithms, according to experiments on the DEAP dataset. Applications for real-time automatic emotion recognition can leverage the fuzzy model we built.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The paper does not fall under the definition of data sharing because no datasets were created or examined in this particular study.
References
Adyapady RR, Annappa B (2022) A comprehensive review of facial expression recognition techniques. Multimedia Systems, pp1–31
Alqahtani AS, Mubarakali A, Parthasarathy P et al (2022) Solar PV fed brushless drive with an optical encoder for agriculture applications using IoT and FPGA. Opt Quant Electron 54:715. https://doi.org/10.1007/s11082-022-04065-0
Alsamhi SH, Lee B (2020) Blockchain-empowered multi-robot collaboration to fight COVID-19 and future pandemics. IEEE Access 9:44173–44197
Alsamhi SH, et al (2022) Blockchain-empowered security and energy efficiency of drone swarm consensus for environment exploration. IEEE Trans Green Commun Netw
Bazgir O, Mohammadi Z, Habibi SAH (2018) Emotion recognition with machine learning using EEG signals. In: 2018 25th national and 3rd international Iranian conference on biomedical engineering (ICBME). IEEE, pp 1–5
Cao G, Ma Y, Meng X, Gao Y, Meng M (2019). Emotion recognition based on CNN. In: 2019 Chinese control conference (CCC). IEEE, pp 8627–8630
Chaturvedi V, Kaur AB, Varshney V, Garg A, Chhabra GS, Kumar M (2021). Music mood and human emotion recognition based on physiological signals: a systematic review. Multimed Syst, pp1–24
Chen T, Yin H, Yuan X, Gu Y, Ren F, Sun X (2021) Emotion recognition is based on a fusion of long short-term memory networks and SVMs. Digital Signal Process 117:103153
Cimtay Y, Ekmekcioglu E, Caglar-Ozhan S (2020) Cross-subject multimodal emotion recognition based on hybrid fusion. IEEE Access 8:168865–168878
Cui H, Liu A, Zhang X, Chen X, Wang K, Chen X (2020) EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network. Knowl-Based Syst 205:106243
Gobhinath S, Karhtikeyan S, Janani K, Arunkumar U (2022) Detection and analysis of earlier cognitive disorder using ai based transcranial magnetic stimulator. In: 2022 8th international conference on advanced computing and communication systems (ICACCS), pp 553–556. https://doi.org/10.1109/ICACCS54159.2022.9785250
Gopi SP et al (2021) Machine learning-assisted adaptive modulation for optimized drone-user communication in b5g. Drones 5(4):128
Hassan MM, Alam MGR, Uddin MZ, Huda S, Almogren A, Fortino G (2019) Human emotion recognition using deep belief network architecture. Inf Fus 51:10–18
Hassanien AE, Kilany M, Houssein EH, AlQaheri H (2018) Intelligent human emotion recognition based on elephant herding optimization tuned support vector regression. Biomed Signal Process Control 45:182–191
Khare SK, Bajaj V (2020) Time–frequency representation and convolutional neural network-based emotion recognition. IEEE Trans Neural Netw Learn Syst 32(7):2901–2909
Kwon YH, Shin SB, Kim SD (2018) Electroencephalography based fusion two-dimensional (2D)-convolution neural networks (CNN) model for emotion recognition system. Sensors 18(5):1383
Lan Z, Sourina O, Wang L, Scherer R, Müller-Putz GR (2018) Domain adaptation techniques for EEG-based emotion recognition: a comparative study on two public datasets. IEEE Trans Cognit Dev Syst 11(1):85–94
Li J, Qiu S, Shen YY, Liu CL, He H (2019) Multisource transfer learning for cross-subject EEG emotion recognition. IEEE Trans Cybern 50(7):3281–3293
Liu ZT, Xie Q, Wu M, Cao WH, Mei Y, Mao JW (2018) Speech emotion recognition based on an improved brain emotion learning model. Neurocomputing 309:145–156
Liu S, Wang X, Zhao L, Zhao J, Xin Q, Wang SH (2020) Subject-independent emotion recognition of EEG signals based on dynamic empirical convolutional neural network. IEEE/ACM Trans Comput Biol Bioinf 18(5):1710–1721
Moon SE, Jang S, Lee JS (2018) Convolutional neural network approach for EEG-based emotion recognition using brain connectivity and its spatial information. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2556–2560
Mukhopadhyay M, Dey A, Shaw RN, Ghosh A (2021) Facial emotion recognition based on textural pattern and convolutional neural network. In: 2021 IEEE 4th international conference on computing, power and communication technologies (GUCON). IEEE., pp. 1–6
Padhmashree V, Bhattacharyya A (2022) Human emotion recognition based on time–frequency analysis of multivariate EEG signal. Knowl-Based Syst 238:107867
Poria S, Majumder N, Mihalcea R, Hovy E (2019) Emotion recognition in conversation: Research challenges, datasets, and recent advances. IEEE Access 7:100943–100953
Prasanth S, Thanka MR, Edwin EB, Nagaraj V (2021) Speech emotion recognition based on machine learning tactics and algorithms. Mater Today: Proc
Praveen RG, de Melo WC, Ullah N, Aslam H, Zeeshan O, Denorme T, Pedersoli M, Koerich AL, Bacon S, Cardinal P, Granger E (2022) A joint cross-attention model for audio-visual fusion in dimensional emotion recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2486–2495
Rayatdoost S, Soleymani M (2018) Cross-corpus EEG-based emotion recognition. In 2018 IEEE 28th international workshop on machine learning for signal processing (MLSP). IEEE, pp 1–6
Santamaria-Granados L, Munoz-Organero M, Ramirez-Gonzalez G, Abdulhay E, Arunkumar NJIA (2018) Using the deep convolutional neural network for emotion detection on a physiological signals dataset (AMIGOS). IEEE Access 7:57–67
Shahin I, Nassif AB, Hamsa S (2019) Emotion recognition using a hybrid Gaussian mixture model and deep neural network. IEEE Access 7:26777–26787
Suhaimi NS, Mountstephens J, Teo J (2020) EEG-based emotion recognition: A state-of-the-art review of current trends and opportunities. Computational intelligence and neuroscience
Wang F, Wu S, Zhang W, Xu Z, Zhang Y, Wu C, Coleman S (2020) Emotion recognition with convolutional neural network and EEG-based EFDMs. Neuropsychologia 146:107506
Yang Y, Wu Q, Qiu M, Wang Y, Chen X (2018) Emotion recognition from multi-channel EEG through parallel convolutional recurrent neural network. In 2018 international joint conference on neural networks (IJCNN). IEEE, pp 1–7
Zhang T, Zheng W, Cui Z, Zong Y, Li Y (2018) Spatial–temporal recurrent neural network for emotion recognition. IEEE Trans Cybern 49(3):839–847
Zhang J, Zhou Y, Liu Y (2020) EEG-based emotion recognition using an improved radial basis function neural network. J Ambient Intell Humaniz Comput, pp1–12
Zhang Y, Cheng C, Wang S, Xia T (2022) Emotion recognition using heterogeneous convolutional neural networks combined with multimodal factorized bilinear pooling. Biomed Signal Process Control 77:103877
Funding
The submitted work was not supported financially by any organization, according to the authors.
Author information
Authors and Affiliations
Contributions
To the idea, analysis, experimentation, and design of the study, each author made an equal contribution. The final draft was read by each author before it was approved. The authors attest that no other publisher has previously accepted or published this or similar material, nor have they done so in the future. The writers also attest that they have contributed to the work sufficiently to bear public responsibility for its substance, including involvement in its conception, design, analysis, writing, or rewriting.
Corresponding author
Ethics declarations
Conflict of interest
Each author declares that it is not involved in any competing interests. The study's author declares that they have no financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Alruwaili, M., Alruwaili, R., Kumar, U.A. et al. Human emotion recognition based on brain signal analysis using fuzzy neural network. Soft Comput (2023). https://doi.org/10.1007/s00500-023-08224-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s00500-023-08224-7