Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3627341.3630372acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccvitConference Proceedingsconference-collections
research-article

A Case-based Channel Selection Method for EEG Emotion Recognition Using Interpretable Transformer Networks

Published: 15 December 2023 Publication History

Abstract

Optimizing the selection of features and channels with satisfactory emotion classification accuracy is important for electroencephalograph (EEG)-based emotion recognition. Here, we propose a novel case-based channel selection method based on interpretable transformer networks for emotion recognition. Gradients and relevance of the prediction of the transformer model were used for backpropagation to produce the attention relevance map. Critical channels were selected by ranking the attention relevance value. We test the effectiveness of the proposed method on the multi-channel EEG emotional datasets SEED. The results demonstrated that the method can pick out the critical channels effectively with relatively high classification accuracy. The locations of selected channels converged on the frontal and temporal areas which were consistent with neuroscience findings. Thus, the proposed method has a potential to reduce computation time and assist source localization in cognitive neuroscience studies.

References

[1]
John T Cacioppo. 2004. Feelings and emotions: roles for electrophysiological markers. Biological psychology 67, 1-2. (2004), 235–243.
[2]
Rab Nawaz, Kit Hwa Cheah, Humaira Nisar, and Vooi Voon Yap. 2020. Comparison of different feature extraction methods for EEG-based emotion recognition. Biocybernetics and Biomedical Engineering 40, 3 (2020), 910–926.
[3]
Robert Jenke, Angelika Peer, and Martin Buss. 2013. Effect-size-based electrode and feature selection for emotion recognition from EEG. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 1217–1221.
[4]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012).
[5]
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision. 2961–2969.
[6]
Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision. 618–626.
[7]
Wei-Long Zheng and Bao-Liang Lu. 2015. Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Transactions on autonomous mental development 7, 3 (2015), 162–175.
[8]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
[9]
Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017).
[10]
Hila Chefer, Shir Gur, and Lior Wolf. 2021. Transformer interpretability beyond attention visualization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 782–791.
[11]
Zhong-Min Wang, Shu-Yuan Hu, and Hui Song. 2019. Channel selection method for EEG emotion recognition using normalized mutual information. IEEE Access 7 (2019), 143303–143311.
[12]
Wenming Zheng. 2016. Multichannel EEG-based emotion recognition via group sparse canonical correlation analysis. IEEE Transactions on Cognitive and Developmental Systems 9, 3 (2016), 281–290.
[13]
Xuefen Lin, Jielin Chen, Weifeng Ma, Wei Tang, and Yuchen Wang. 2023. EEG emotion recognition using improved graph neural network with channel selection. Computer Methods and Programs in Biomedicine 231 (2023), 107380.
[14]
Ralph Adolphs. 2002. Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behavioral and cognitive neuroscience reviews 1, 1 (2002), 21–62.

Index Terms

  1. A Case-based Channel Selection Method for EEG Emotion Recognition Using Interpretable Transformer Networks
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ICCVIT '23: Proceedings of the 2023 International Conference on Computer, Vision and Intelligent Technology
      August 2023
      378 pages
      ISBN:9798400708701
      DOI:10.1145/3627341
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 15 December 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Channel selection
      2. EEG
      3. Emotion recognition
      4. Transformer
      5. Visualization

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • Pazhou Lab

      Conference

      ICCVIT 2023

      Acceptance Rates

      ICCVIT '23 Paper Acceptance Rate 54 of 142 submissions, 38%;
      Overall Acceptance Rate 54 of 142 submissions, 38%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 50
        Total Downloads
      • Downloads (Last 12 months)50
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 12 Nov 2024

      Other Metrics

      Citations

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media