Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3607546.3616804acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

A Haptic-enabled, Distributed and Networked Immersive System for Multi-User Collaborative Virtual Reality

Published: 29 October 2023 Publication History

Abstract

Virtual Reality (VR) is gaining attention in various domains such as entertainment, industry, mental healthcare and VR training. Al- though most of these use-cases are still limited to single-user tasks, a lot of applications are heavily depending on multi-user collaboration. Existing multi-user VR systems are most often created in a classic server-client architecture, however, which induces unpredictable network behaviour which can affect the end-user's Quality-of-Experience (QoE) and performance. In addition, the interaction methods in these systems are often constrained to either traditional VR controllers or very use-case specific interaction methods, such that general purpose haptic gloves form a somewhat under-explored part of literature. Therefore, we (i) present a networked, distributed multi-user VR system with synchronization of environments over a low-bandwidth networked connection. In addition, we (ii) enhance the experience by adding haptic gloves to the system, which we compare to the traditional VR controllers in a subjective experiment. As a proof-of-concept, a use case is implemented in which two users have to prepare and bake a virtual pizza. The results show that high framerates (> 90 Frames Per Second (FPS)) can be obtained while keeping network throughput to a minimum ( < 1 Mbps). The accompanying user study shows that haptic gloves are preferred when immersiveness is the main emphasis of the virtual environment, while controllers are more suited when performance is in the center of attention. In objective terms, the applicability of haptic feedback is highly dependent on the task at hand.

Supplementary Material

MP4 File (ixr003-video.mp4)
19 min. Presentation video on the content of the accompanying paper "A Haptic-enabled, Distributed and Networked Immersive System for Multi-User Collaborative Virtual Reality"

References

[1]
Alteruna. 2023. Alteruna Multiplayer. Alteruna. https://www.alteruna.com/
[2]
Vuthea Chheang, Patrick Saalfeld, Tobias Huber, Florentine Huettl, Werner Kneist, Bernhard Preim, and Christian Hansen. 2019. Collaborative Virtual Reality for Laparoscopic Liver Surgery Training. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, San Diego, California, USA, 1--17. https://doi.org/10.1109/AIVR46125.2019.00011
[3]
Lorenzo Damiani, Melissa Demartini, Guido Guizzi, Roberto Revetria, and Flavio Tonelli. 2018. Augmented and virtual reality applications in industrial systems: A qualitative review towards the industry 4.0 era. IFAC-PapersOnLine 51, 11 (2018), 624--630. https://doi.org/10.1016/j.ifacol.2018.08.388 16th IFAC Symposium on Information Control Problems in Manufacturing INCOM 2018.
[4]
Carmine Elvezio, Frank Ling, Jen-Shuo Liu, and Steven Feiner. 2018. Collaborative Virtual Reality for Low-Latency Interaction (UIST '18 Adjunct). Association for Computing Machinery, New York, NY, USA, 179--181. https://doi.org/10.1145/ 3266037.3271643
[5]
Arturo S García, Terrence Fernando, David J Roberts, Christian Bar, Michele Cencetti, Wito Engelke, and Andreas Gerndt. 2019. Collaborative virtual reality platform for visualizing space data and mission planning. Multimedia Tools and Applications 78 (2019), 33191--33220.
[6]
IrisVR. 2023. The importance of Frame Rates. IrisVR. https://help.irisvr.com/hc/enus/articles/215884547-The-Importance-of-Frame-Rates
[7]
Alexandra D. Kaplan, Jessica Cruit, Mica Endsley, Suzanne M. Beers, Ben D. Sawyer, and P. A. Hancock. 2021. The Effects of Virtual Reality, Augmented Reality, and Mixed Reality as Training Enhancement Methods: A Meta-Analysis. Human Factors 63, 4 (2021), 706--726. https://doi.org/10.1177/0018720820904229 arXiv:https://doi.org/10.1177/0018720820904229 32091937.
[8]
Dieter Lerner, Stefan Mohr, Jonas Schild, Martin Göring, and Thomas Luiz. 2020. An Immersive Multi-User Virtual Reality for Emergency Simulation Training: Usability Study. JMIR Serious Games 8, 3 (31 Jul 2020), e18822. https://doi.org/ 10.2196/18822
[9]
Manus. 2023. Manus Prime. Manus. https://www.manus-meta.com/
[10]
Meta. 2023. The Link cable. Meta. https://www.meta.com/be/en/quest/ accessories/link-cable/
[11]
Meta. 2023. Meta Quest. Meta. https://www.oculus.com/experiences/quest/
[12]
Giuseppe Riva. 2005. Virtual Reality in Psychotherapy:Review. CyberPsychology & Behavior 8, 3 (2005), 220--230. https://doi.org/10.1089/cpb.2005.8.220 arXiv:https://doi.org/10.1089/cpb.2005.8.220 15971972.
[13]
Jonas Schild, Dieter Lerner, Sebastian Misztal, and Thomas Luiz. 2018. EPICSAVE - Enhancing vocational training for paramedics with multi-user virtual reality. In 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH). IEEE, Vienna, Austria, 1--8. https://doi.org/10.1109/SeGAH.2018. 8401353
[14]
SurgicalScience. 2023. Simball Box: Mastering the Elements of Laparoscopy. SurgicalScience. https://surgicalscience.com/simulators/simball-box/
[15]
Kristen M Triandafilou, Daria Tsoupikova, Alexander J Barry, Kelly N Thielbar, Nikolay Stoykov, and Derek G Kamper. 2018. Development of a 3D, networked multi-user virtual reality environment for home therapy after stroke. Journal of neuroengineering and rehabilitation 15 (2018), 1--13.
[16]
Unity. 2023. Unity. Unity. https://unity.com/
[17]
Sam Van Damme, Nicolas Legrand, Joris Heyse, Femke De Backere, Filip De Turck, and Maria Torres Vega. 2022. Effects of Haptic Feedback on User Perception and Performance in Interactive Projected Augmented Reality. In Proceedings of the 1st Workshop on Interactive EXtended Reality (Lisboa, Portugal) (IXR '22). Association for Computing Machinery, New York, NY, USA, 11--18. https://doi.org/10.1145/ 3552483.3556456
[18]
Sam Van Damme, Jordy Tack, Glenn Van Wallendael, Filip De Turck, and Maria Torres Vega. 2023. Are we ready for Haptic Interactivity in VR? An Experimental Comparison of Different Interaction Methods in Virtual Reality Training. In 2023 15th International Conference on Quality of Multimedia Experience (QoMEX). IEEE, Ghent, Belgium, 294--299. https://doi.org/10.1109/QoMEX58391. 2023.10178453
[19]
Yentl Vermeulen, Sam Van Damme, Glenn Van Wallendael, Filip De Turck, and Maria Torres Vega. 2023. Haptic Interactions for Extended Reality. In 2023 IEEE International Conference on Consumer Electronics (ICCE). IEEE, Las Vegas, NV, USA, 1--6. https://doi.org/10.1109/ICCE56470.2023.10043499
[20]
Peng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Dechuan Han, Mengmeng Sun, Zhuo Wang, Hao Lv, and Shu Han. 2020. Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction. International Journal of Human--Computer Interaction 36, 13 (2020), 1242--1257. https://doi.org/10.1080/10447318.2020.1732140 arXiv:https://doi.org/10.1080/10447318.2020.1732140
[21]
Mary Webb, Megan Tracey, William Harwin, Ozan Tokatli, Faustina Hwang, Ros Johnson, Natasha Barrett, and Chris Jones. 2022. Haptic-enabled collaborative learning in virtual reality for schools. Education and Information Technologies 27 (2022), 1--24.
[22]
Biao Xie, Huimin Liu, Rawan Alghofaili, Yongqi Zhang, Yeling Jiang, Flavio Destri Lobo, Changyang Li, Wanwan Li, Haikun Huang, Mesut Akdere, Christos Mousas, and Lap-Fai Yu. 2021. A Review on Virtual Reality Skill Training Applications. Frontiers in Virtual Reality 2 (2021), 19 pages. https://doi.org/10.3389/frvir.2021. 645153

Cited By

View all
  • (2024)Impact of Latency on QoE, Performance, and Collaboration in Interactive Multi-User Virtual RealityApplied Sciences10.3390/app1406229014:6(2290)Online publication date: 8-Mar-2024
  • (2024)MetaDragonBoat: Exploring Paddling Techniques of Virtual Dragon Boating in a Metaverse CampusProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681078(6335-6344)Online publication date: 28-Oct-2024
  • (2024)Evaluating the Effect of Binaural Auralization on Audiovisual Plausibility and Communication Behavior in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00104(849-858)Online publication date: 16-Mar-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
IXR '23: Proceedings of the 2nd International Workshop on Interactive eXtended Reality
October 2023
44 pages
ISBN:9798400702808
DOI:10.1145/3607546
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. collaborative vr
  2. haptic feedback
  3. multi-user
  4. quality-of-experience (qoe)
  5. virtual reality (vr)

Qualifiers

  • Research-article

Funding Sources

Conference

MM '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 9 of 9 submissions, 100%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)130
  • Downloads (Last 6 weeks)13
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Impact of Latency on QoE, Performance, and Collaboration in Interactive Multi-User Virtual RealityApplied Sciences10.3390/app1406229014:6(2290)Online publication date: 8-Mar-2024
  • (2024)MetaDragonBoat: Exploring Paddling Techniques of Virtual Dragon Boating in a Metaverse CampusProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681078(6335-6344)Online publication date: 28-Oct-2024
  • (2024)Evaluating the Effect of Binaural Auralization on Audiovisual Plausibility and Communication Behavior in Virtual Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00104(849-858)Online publication date: 16-Mar-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media