demonstration

Neurogoggles for Multimodal Augmented Reality

Authors:

Tej TadiAuthors Info & Claims

AH '16: Proceedings of the 7th Augmented Human International Conference 2016

Article No.: 48, Pages 1 - 2

https://doi.org/10.1145/2875194.2875242

Published: 25 February 2016 Publication History

Get Access

Abstract

We present a neurogoggles system that offers truly immersive augmented and virtual reality with unique biofeedback based on brain and bodily signals. The system consists of a wearable head-mounted display that integrates two stereoscopic color cameras for video-through experience, a depth sensor for object tracking, an inertial sensor for head tracking and electrophysiological measurements for brain and bodily signals. The system is designed to ensure low-latency synchronization across all functional modules, which is a key element for multimodal real-time data analysis. We showcase this technology with an immersive experience combining multimodal data and artistic digital content using Kudan augmented reality engine. In this experience, the user is presented with an interactive world behind a brain image wall poster, which reacts to user's brain state.

References

[1]

R. Azuma. Tracking requirements for augmented reality. Communications of the ACM, 36(7):50--51, 1993.

Digital Library

Google Scholar

[2]

C. J. Bohil, B. Alicea, and F. A. Biocca. Virtual reality in neuroscience research and therapy. Nature reviews neuroscience, 12(12):752--762, 2011.

Google Scholar

[3]

P. Milgram, H. Takemura, A. Utsumi, and F. Kishino. Augmented reality: A class of displays on the reality-virtuality continuum. In Photonics for Industrial Applications, pages 282--292. International Society for Optics and Photonics, 1995.

Google Scholar

Cited By

View all

Böhmer MKuehnel SDamarowsky J(2024)Bridging the Gap Between Augmentation and CognitionImpact of Digital Solutions for Improved Healthcare Delivery10.4018/979-8-3693-5237-3.ch016(409-444)Online publication date: 18-Oct-2024
https://doi.org/10.4018/979-8-3693-5237-3.ch016
Seddighi NChen YMerryweather AForeman KKuntz ABattaglia EZhang HTaylor EWong BFino P(2024)The Impact of Design Factors on User Behavior in a Virtual Hospital Room to Explore Fall Prevention StrategiesHERD: Health Environments Research & Design Journal10.1177/1937586724123843417:3(124-143)Online publication date: 9-Apr-2024
https://doi.org/10.1177/19375867241238434
Russo VBilucaglia MZito M(2022)From virtual reality to augmented reality: A neuromarketing perspectiveFrontiers in Psychology10.3389/fpsyg.2022.96549913Online publication date: 9-Sep-2022
https://doi.org/10.3389/fpsyg.2022.965499
Show More Cited By

Neurogoggles for Multimodal Augmented Reality
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems

As shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AH '16: Proceedings of the 7th Augmented Human International Conference 2016

February 2016

258 pages

ISBN:9781450336802

DOI:10.1145/2875194

General Chairs:
Jean-Marc Seigneur
University of Geneva, Switzerland
,
Jose M. Hernandez-Munoz
Telefonica I+D, Spain
,
Paul McCullagh
University of Ulster, United Kingdom
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tsutomu Terada
University of Kobe, Japan
,
Woontack Woo
Korea Advanced Institute of Science and Technology
,
Pranav Mistry
Samsung Research America, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

University of Geneva

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2016

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

AH '16

AH '16: Augmented Human International Conference 2016

February 25 - 27, 2016

Geneva, Switzerland

Acceptance Rates

AH '16 Paper Acceptance Rate 21 of 138 submissions, 15%;

Overall Acceptance Rate 121 of 306 submissions, 40%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
363
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Böhmer MKuehnel SDamarowsky J(2024)Bridging the Gap Between Augmentation and CognitionImpact of Digital Solutions for Improved Healthcare Delivery10.4018/979-8-3693-5237-3.ch016(409-444)Online publication date: 18-Oct-2024
https://doi.org/10.4018/979-8-3693-5237-3.ch016
Seddighi NChen YMerryweather AForeman KKuntz ABattaglia EZhang HTaylor EWong BFino P(2024)The Impact of Design Factors on User Behavior in a Virtual Hospital Room to Explore Fall Prevention StrategiesHERD: Health Environments Research & Design Journal10.1177/1937586724123843417:3(124-143)Online publication date: 9-Apr-2024
https://doi.org/10.1177/19375867241238434
Russo VBilucaglia MZito M(2022)From virtual reality to augmented reality: A neuromarketing perspectiveFrontiers in Psychology10.3389/fpsyg.2022.96549913Online publication date: 9-Sep-2022
https://doi.org/10.3389/fpsyg.2022.965499
Brun DD'Mello SGeorgiou PScherer SProvost ESoleymani MWorsley M(2018)Multimodal and Context-Aware Interaction in Augmented Reality for Active AssistanceProceedings of the 20th ACM International Conference on Multimodal Interaction10.1145/3242969.3264966(506-510)Online publication date: 2-Oct-2018
https://dl.acm.org/doi/10.1145/3242969.3264966
Viyanon WSongsuittipong TPiyapaisarn PSudchid S(2017)AR FurnitureProceedings of the 2nd International Conference on Intelligent Information Processing10.1145/3144789.3144825(1-7)Online publication date: 17-Jul-2017
https://dl.acm.org/doi/10.1145/3144789.3144825

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Multimodal augmented reality: the norm rather than the exception

Haptics in Augmented Reality

Augmented reality as perceptual reality