demonstration

Immersive virtual reality with multimodal interaction and streaming technology

Authors:

Min-Chun HuAuthors Info & Claims

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Page 416

https://doi.org/10.1145/2993148.2998526

Published: 31 October 2016 Publication History

Get Access

Abstract

In this demo, we present an immersive virtual reality (VR) system which integrates multimodal interaction sensors (i.e., smartphone, Kinect v2, and Myo armband) and streaming technology to improve the VR experience. The integrated system solves the common problems in most VR systems: (1) the very limited playing area due to transmission cable between computer and display/interaction devices, and (2) non-intuitive way of controlling virtual objects. We use Unreal Engine 4 to develop an immersive VR game with 6 interactive levels to demonstrate the feasibility of our system. In the game, the user not only can freely walk within a large playing area surrounded by multiple Kinect sensors but also select the virtual objects to grab and throw with the Myo armband. The experiment shows that our idea is workable for VR experience.

Cited By

View all

García-Pereira IVera LAixendri MPortalés CCasas S(2020)Multisensory Experiences in Virtual Reality and Augmented Reality Interaction ParadigmsSmart Systems Design, Applications, and Challenges10.4018/978-1-7998-2112-0.ch014(276-298)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-2112-0.ch014
Popovici I(2020)Experimental Results on the Accuracy of the Myo Armband for Short-Range Pointing Tasks2020 International Conference on Development and Application Systems (DAS)10.1109/DAS49615.2020.9108916(185-188)Online publication date: May-2020
https://doi.org/10.1109/DAS49615.2020.9108916
Mohan PBoon Goh WFu CYeung SJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)Head-Fingers-Arms: Physically-Coupled and Decoupled Multimodal Interaction Designs in Mobile VRProceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365697(1-9)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365697
Show More Cited By

Index Terms

Immersive virtual reality with multimodal interaction and streaming technology
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

Virtualized reality
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Virtual reality is the creation of an entirely digital world. Virtualized reality is the translation of the real world into a digital space. There, the real and virtual unify. We have created an alternate reality in which participants explore their ...
Overcome Acrophobia with the Help of Virtual Reality and Kinect Technology

There are many people in this world who are feared of high places. In general, there are two types of people: the prior one is people that are afraid of height and the latter one is people who really cannot handle high places (i.e. acrophobia). The ...
Visualizing the keyboard in virtual reality for enhancing immersive experience
SIGGRAPH '17: ACM SIGGRAPH 2017 Posters

Recently, virtual reality (VR) becomes more and more popular and provides users an immersive experience with a head-mounted display (HMD). However, in some applications, users have to interact with physical objects while immersed in VR. With a non-see-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

October 2016

605 pages

ISBN:9781450345569

DOI:10.1145/2993148

General Chairs:
Yukiko I. Nakano
Seikei University, Japan
,
Elisabeth André
Augsburg University, Germany
,
Toyoaki Nishida
Kyoto University, Japan
,
Program Chairs:
Louis-Philippe Morency
Carnegie Mellon University, USA
,
Carlos Busso
University of Texas at Dallas, USA
,
Catherine Pelachaud
ISIR, France / University of Paris6, France

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2016

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ICMI '16

Sponsor:

SIGCHI

ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 12 - 16, 2016

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
317
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

García-Pereira IVera LAixendri MPortalés CCasas S(2020)Multisensory Experiences in Virtual Reality and Augmented Reality Interaction ParadigmsSmart Systems Design, Applications, and Challenges10.4018/978-1-7998-2112-0.ch014(276-298)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-2112-0.ch014
Popovici I(2020)Experimental Results on the Accuracy of the Myo Armband for Short-Range Pointing Tasks2020 International Conference on Development and Application Systems (DAS)10.1109/DAS49615.2020.9108916(185-188)Online publication date: May-2020
https://doi.org/10.1109/DAS49615.2020.9108916
Mohan PBoon Goh WFu CYeung SJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)Head-Fingers-Arms: Physically-Coupled and Decoupled Multimodal Interaction Designs in Mobile VRProceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365697(1-9)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365697
Popovici IVatavu RWu W(2019)TV Channels in Your Pocket! Linking Smart Pockets to Smart TVsProceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3317697.3325119(193-198)Online publication date: 4-Jun-2019
https://dl.acm.org/doi/10.1145/3317697.3325119
Guérit RCierro AVanderdonckt JPérez-Medina J(2019)Gesture Elicitation and Usability Testing for an Armband Interacting with Netflix and SpotifyInformation Technology and Systems10.1007/978-3-030-11890-7_60(625-637)Online publication date: 29-Jan-2019
https://doi.org/10.1007/978-3-030-11890-7_60
Tsai WAizawa KLew MSatoh S(2018)Personal Basketball CoachProceedings of the 2018 ACM on International Conference on Multimedia Retrieval10.1145/3206025.3206084(481-484)Online publication date: 5-Jun-2018
https://dl.acm.org/doi/10.1145/3206025.3206084
Botev JRothkugel S(2017)High-Precision Gestural Input for Immersive Large-Scale Distributed Virtual EnvironmentsProceedings of the 9th Workshop on Massively Multiuser Virtual Environments10.1145/3083207.3083209(7-11)Online publication date: 20-Jun-2017
https://dl.acm.org/doi/10.1145/3083207.3083209

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Virtualized reality

Overcome Acrophobia with the Help of Virtual Reality and Kinect Technology

Visualizing the keyboard in virtual reality for enhancing immersive experience