research-article

Research on the Application of Augmented Reality in SSVEP-BCI

Authors:

Ran WeiAuthors Info & Claims

ICCAI '20: Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence

Pages 505 - 509

https://doi.org/10.1145/3404555.3404587

Published: 20 August 2020 Publication History

Abstract

Visual stimulators play an important role in the steady-state visually evoked potential (SSVEP) brain computer interface (BCI). Traditional displays limit the application of SSVEP-BCI. Augmented reality, as a new pattern of visual stimulator, can be more flexible in the practical applications of SSVEP-BCI. In this study, the stimulus interface was presented by liquid crystal display and HoloLens, respectively. The feasibility experiment was to compared the influence on the acquisition of EEG signals when HoloLens was on and off. The stability experiment compared the flicker of HoloLens with LCD. The feasibility and stability of HoloLens in SSVEP-BCI was proved by the accuracy of SSVEP. First, the accuracy of HoloLens's is consistent with the accuracy of traditional display during the acquisition of EEG signals. It was proved that the application of HoloLens will not affect the acquisition of EEG signals. Second, compared the ARinduced SSVEP with traditional display-induced SSVEP, the accuracy of EEG signal classification in AR environment was 44.27%, 83.85%, 93.23%, 98.44% and 98.44% respectively when the data length was 0.5 s, 1.0 s, 1.5 s, 2.0 s and 2.5 s. The corresponding accuracy rate of the display was 73.44%, 95.31%, 98.44%, 99.48% and 99.48%. There was no difference in accuracy values after 2 seconds. HoloLens can completely replace the traditional display in the application of SSVEP-BCI.

References

[1]

Fernández-Rodríguez., á, ÁVelasco-álvarez, F., Ron-Angevin, R. 2016. Review of real brain-controlled wheelchairs. Journal of Neural Engineering. 13(6), 061001.

[2]

Jonathan, R., NielsBirbaumer., Dennis, JMcFarland., et al. 2002. Brain-computer interfaces for communication and control. Clinical Neurophysiology. 113, 767--791.

[3]

Xu, Z., Li, J., Gu, R., Xia, B. 2015. Steady-State Visually Evoked Potential (SSVEP)-Based Brain-Computer Interface (BCI): A Low-Delayed Asynchronous Wheelchairs Control System. International Conference on Neural Information Processing. 7663, 305--314.

[4]

Lin, Z., Zhang, C., Wu, W., Gao, X. 2006. Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs. IEEE Transactions on Biomedical Engineering. 53(12), 2610--2614.

[5]

Bin, G., Gao, X., Wang, Y., et al. 2009.VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier]. Computational Intelligence Magazine IEEE. 4(4), 22--26.

Digital Library

[6]

Navarro, K. F. 2004. Wearable, Wireless Brain Computer Interfaces In Augmented Reality Environments. International Conference on Information Technology: Coding and Computing (ITCC'04). Volume 2, Las Vegas, Nevada, USA.

[7]

Chen, X., Zhao, B., Wang, Y., et al. 2018. Control of A 7-DOF Robotic ARM System with an SSVEP-Based BCI. International Journal of Neural Systems. S0129065718500181.

[8]

Lenhardt, A., Ritter H. 2010. An Augmented-Reality Based Brain-Computer Interface for Robot Control. Neural Information Processing Models & Applications-international Conference. 58--65.

[9]

Takano, K., Hata, N., Kansaku, K. 2011. Towards Intelligent Environments: An Augmented Reality -- Brain -- Machine Interface Operated with a See-Through Head-Mount Display. Frontiers in Neuroscience. 5, 60.

[10]

Horii, S., Nakauchi, S., Kitazaki, M. 2015. AR-SSVEP for brain-machine interface: Estimating user's gaze in head-mounted display with USB camera. 2015 IEEE Virtual Reality (VR).

[11]

Dang-Manh, T., Huong-Giang, D., et al. 2019. Robustness Analysis of 3D Convolutional Neural Network for Human Hand Gesture Recognition. International Journal of Machine Learning and Computing.9(22), 135--142.

[12]

Si-Mohammed H., Petit J., Jeunet C., Argelaguet F., Spindler F., Evain A., et al.2018. Towards BCI-based Interfaces for Augmented Reality: Feasibility, Design and Evaluation. IEEE Transactions on Visualization and Computer Graphics. 1--1.

[13]

Meng W., Li R., Zhang R., et al. (2018). A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device. IEEE Access. 6 (2169-3536), 26789--26798.

[14]

Furlan and Rod. 2016. The future of augmented reality: HoloLens - Microsofts AR headset shines despite rough edges [Resources_Tools and Toys]. IEEE Spectrum. 53(6), 21--21.

[15]

Zhang, L., Zhang, Y., Ke, Y., et al. 2019. A Study of Argument Reality Based Brain-Computer Interface (AR-BCI) in HoloLens. Chinese Journal of Biomedical Engineering. 38(01), 51--58.

[16]

Chen, X., Wang, Y., Zhang, S., et al. 2017. A novel stimulation method for multi-class SSVEP-BCI using intermodulation frequencies. Journal of Neural Engineering. 14(2), 026013.

[17]

Chen, X., Wang, Y., Nakanishi, M., Gao, X., Jung, T., Gao S. 2015. High-speed spelling with a noninvasive brain-computer interface. Proceedings of the National Academy of Sciences of the United States of America. 112(44), 58--67.

[18]

Chen., X, Wang, Y., Gao, S., et al. 2015. Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface. Journal of Neural Engineering. 12, 046008.

[19]

Lei, Y. 2017. Progress in technology and application of brain-computer interface. Chinese Journal of Pharmacology and Toxicology. 31(11), 1068--1074.

[20]

Zhu, D., Bieger, J., Garcia, M.2010. A survey of stimulation methods used in SSVEP-based BCIs. Comput Intell Neurosci. 702357.

[21]

Volosyak, I., Valbuena, D., Luth, T., Malechka, T., et al. 2011. BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI?. IEEE Transactions on neural systems and rehabilitation engineering. 19(3), 232--239.

[22]

Chen, X., Zhao, B., Wang, Y., et al. 2018. Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm. Journal of Neural Engineering. 16, 026012.

Cited By

Fu RYang BGeng YXia X(2023)3D SSVEP Visual stimulus in Augmented Reality for Robotic Arm GraspingProceedings of the 2023 12th International Conference on Computing and Pattern Recognition10.1145/3633637.3633724(562-568)Online publication date: 27-Oct-2023
https://dl.acm.org/doi/10.1145/3633637.3633724
Wolf PGötzelmann T(2023)A Systematic Review of Interaction Approaches based on Visually Evoked PotentialsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594862(396-401)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594862
Auda JGruenefeld UKosch TSchneegass S(2022)The Butterfly Effect: Novel Opportunities for Steady-State Visually-Evoked Potential Stimuli in Virtual RealityProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519397(254-266)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519397

Index Terms

Research on the Application of Augmented Reality in SSVEP-BCI
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing

Recommendations

Humanoid Robot Control System Based on AR-SSVEP
ICCAI '20: Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence

In the brain computer interface (BCI), steady-state visual evoked potential (SSVEP) is a relatively common input signal of human-computer interaction systems. However, it often requires a fixed computer screen as a visual stimulator, which limits the ...
Asynchronous Robotic Arm System Based on Augmented Reality and SSVEP-based BCI
IMIP '21: Proceedings of the 2021 3rd International Conference on Intelligent Medicine and Image Processing

With the development of robot technology, more and more disabled people can improve their external environment's interactive ability. But for some people with severe interaction barriers, the current interaction methods are still difficult to meet their ...
Augmented control of an avatar using an SSVEP based BCI
AH '12: Proceedings of the 3rd Augmented Human International Conference

The demonstration shows the usage of an EEG-based brain-computer interface (BCI) for the real-time control of an avatar in World of Warcraft. Visitors can test the installation during the conference after about 5 minutes of training time. World of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICCAI '20: Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence

April 2020

563 pages

ISBN:9781450377089

DOI:10.1145/3404555

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

University of Tsukuba: University of Tsukuba

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 August 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCAI '20

ICCAI '20: 2020 6th International Conference on Computing and Artificial Intelligence

April 23 - 26, 2020

Tianjin, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
142
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fu RYang BGeng YXia X(2023)3D SSVEP Visual stimulus in Augmented Reality for Robotic Arm GraspingProceedings of the 2023 12th International Conference on Computing and Pattern Recognition10.1145/3633637.3633724(562-568)Online publication date: 27-Oct-2023
https://dl.acm.org/doi/10.1145/3633637.3633724
Wolf PGötzelmann T(2023)A Systematic Review of Interaction Approaches based on Visually Evoked PotentialsProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594862(396-401)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594862
Auda JGruenefeld UKosch TSchneegass S(2022)The Butterfly Effect: Novel Opportunities for Steady-State Visually-Evoked Potential Stimuli in Virtual RealityProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519397(254-266)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519397

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents