Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3038439.3038444acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Real World BCI: Cross-Domain Learning and Practical Applications

Published: 13 March 2017 Publication History

Abstract

In order to develop real-world BCI solutions machine learning models must generalize not only to unseen users but also to unseen scenarios. In this concept paper we describe our initial investigation into Deep Learning tools to create generalized models for both cross-subject and cross-domain learning. We demonstrate our approach using two different, laboratory grade data sets to train a learning model that we then apply to a third more complex scenario. While our results indicate that cross-domain learning is possible, we also identify potential avenues for further research and development (such as disentangling spatially or temporally overlapping responses). Finally, we describe our work to implement a system that uses cross-domain learning to develop a real-time application for performing BCI-based Human-Centric Scene Analysis.

References

[1]
F. Lotte, 2015. Signal processing approaches to minimize or suppress calibration time in oscillatory activity-based brain--computer interfaces. Proceedings of the IEEE, 103(6), pp.871--890.
[2]
J.E. Kamienkowski, M.J. Ison, R.Q. Quiroga, and M. Sigman, 2012. Fixation-related potentials in visual search: A combined EEG and eye tracking study Fixation-related potentials in visual search. Journal of vision, 12(7), pp.4--4.
[3]
A.J. Ries, J. Touryan, B. Ahrens, and P. Connolly, 2016. The Impact of Task Demands on Fixation-Related Brain Potentials during Guided Search. PloS one, 11(6), p.e0157260.
[4]
A. Yagi, 198 Visual signal detection and lambda responses. Electroencephalography and clinical Neurophysiology, 52(6), pp.604--610.
[5]
Krizhevsky, I. Sutskever, and G.E. Hinton, 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097--1105).
[6]
V.J. Lawhern, A.J. Solon, N.R. Waytowich, S.M. Gordon, C.P. Hung, and B.J. Lance, 2016. EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces, arXiv:1611.08024
[7]
A.R. Marathe, A.J. Ries, V.J. Lawhern, B.J. Lance, J. Touryan, K. McDowell, and H. Cecotti, 2015. The effect of target and non-target similarity on neural classification performance: a boost from confidence. Frontiers in neuroscience, 9.
[8]
https://github.com/sccn/labstreaminglayer
[9]
A.M. Brouwer, M.A. Hogervorst, J.B. Van Erp, T. Heffelaar, P.H. Zimmerman, and R. Oostenveld, 2012. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of neural engineering, 9(4), p.045008.

Cited By

View all
  • (2024)Evidence of elevated situational awareness for active duty soldiers during navigation of a virtual environmentPLOS ONE10.1371/journal.pone.029886719:5(e0298867)Online publication date: 10-May-2024
  • (2024)EM-SAM: Eye-Movement-Guided Segment Anything Model for Object Detection and Recognition in Complex Scenes2024 WRC Symposium on Advanced Robotics and Automation (WRC SARA)10.1109/WRCSARA64167.2024.10685712(401-408)Online publication date: 23-Aug-2024
  • (2024)Online BCI systems: cross-subject motor imagery classification based on weighted time-domain feature extraction methodsJournal of Engineering Design10.1080/09544828.2024.232639635:6(685-708)Online publication date: 19-Mar-2024
  • Show More Cited By

Index Terms

  1. Real World BCI: Cross-Domain Learning and Practical Applications

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    BCIforReal '17: Proceedings of the 2017 ACM Workshop on An Application-oriented Approach to BCI out of the laboratory
    March 2017
    50 pages
    ISBN:9781450349017
    DOI:10.1145/3038439
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 March 2017

    Check for updates

    Author Tags

    1. brain-computer interface
    2. deep learning
    3. real-world neuroscience

    Qualifiers

    • Research-article

    Funding Sources

    • Army Research Laboratory

    Conference

    IUI'17
    Sponsor:

    Acceptance Rates

    BCIforReal '17 Paper Acceptance Rate 8 of 12 submissions, 67%;
    Overall Acceptance Rate 8 of 12 submissions, 67%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)18
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Evidence of elevated situational awareness for active duty soldiers during navigation of a virtual environmentPLOS ONE10.1371/journal.pone.029886719:5(e0298867)Online publication date: 10-May-2024
    • (2024)EM-SAM: Eye-Movement-Guided Segment Anything Model for Object Detection and Recognition in Complex Scenes2024 WRC Symposium on Advanced Robotics and Automation (WRC SARA)10.1109/WRCSARA64167.2024.10685712(401-408)Online publication date: 23-Aug-2024
    • (2024)Online BCI systems: cross-subject motor imagery classification based on weighted time-domain feature extraction methodsJournal of Engineering Design10.1080/09544828.2024.232639635:6(685-708)Online publication date: 19-Mar-2024
    • (2024)Temporal-spatial cross attention network for recognizing imagined charactersScientific Reports10.1038/s41598-024-59263-514:1Online publication date: 4-Jul-2024
    • (2024)Enhancing cross-subject transfer performance for SSVEP identification using small data-based transferability evaluationBiomedical Signal Processing and Control10.1016/j.bspc.2024.10628294(106282)Online publication date: Aug-2024
    • (2023)Classification of Targets and Distractors in an Audiovisual Attention Task Based on ElectroencephalographySensors10.3390/s2323958823:23(9588)Online publication date: 3-Dec-2023
    • (2023)Latent State Synchronization in Dyadic Partners using EEG2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394383(4734-4739)Online publication date: 1-Oct-2023
    • (2023)Assessing Temporal Variability in Fixation-Locked P300 Responses during Free-Viewing Visual Search2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)10.1109/NER52421.2023.10123724(1-4)Online publication date: 24-Apr-2023
    • (2021)During natural viewing, neural processing of visual targets continues throughout saccadesJournal of Vision10.1167/jov.21.10.721:10(7)Online publication date: 7-Sep-2021
    • (2021)A survey on deep learning-based non-invasive brain signals: recent advances and new frontiersJournal of Neural Engineering10.1088/1741-2552/abc90218:3(031002)Online publication date: 5-Mar-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media