poster

Public Access

Mixed Reality Communication System for Procedural Tasks

Authors:

Krzysztof PietroszekAuthors Info & Claims

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

Article No.: 72, Pages 1 - 3

https://doi.org/10.1145/3531073.3534497

Published: 06 June 2022 Publication History

All formats PDF

Abstract

We design a volumetric communication system for remote assistance of procedural medical tasks. The system allows a remote expert to spatially guide a local operator using a real-time volumetric representation of the patient. Guidance is provided by voice, virtual hand metaphor, and annotations performed in situ. We include the feedback we received from the medical professionals and early NASA TLX [5] data on the cognitive load of the system.

References

[1]

2022. Microsoft Azure Kinect. https://azure.microsoft.com/en-us/services/kinect-dk/#overview.

Google Scholar

[2]

2022. Microsoft Hololens 2. https://www.microsoft.com/en-us/hololens/buy.

Google Scholar

[3]

Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, 2021. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

Google Scholar

[4]

Pavel Gurevich, Joel Lanir, Benjamin Cohen, and Ran Stone. 2012. TeleAdvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 619–622.

Digital Library

Google Scholar

[5]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications Sage CA: Los Angeles, CA, 904–908.

Crossref

Google Scholar

[6]

D. Mourtzis, V. Zogopoulos, and E. Vlachou. 2017. Augmented Reality Application to Support Remote Maintenance as a Service in the Robotics Industry. Procedia CIRP (2017), 46 – 51.

Google Scholar

[7]

Manuel Rebol, Christian Güti, and Krzysztof Pietroszek. 2021. Passing a non-verbal turing test: Evaluatina gesture animations generated from speech. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 573–581.

Google Scholar

[8]

Manuel Rebol, Christian Gütl, and Krzysztof Pietroszek. 2021. Real-Time Gesture Animation Generation from Speech for Virtual Human Interaction. Association for Computing Machinery.

Google Scholar

[9]

Manuel Rebol, Colton Hood, Claudia Ranniger, Adam Rutenberg, Neal Sikka, Erin Maria Horan, Christian Gütl, and Krzysztof Pietroszek. 2021. Remote Assistance with Mixed Reality for Procedural Tasks. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 653–654. https://doi.org/10.1109/VRW52623.2021.00209.

Crossref

Google Scholar

[10]

G. Suciu, S. Stefanescu, C. Beceanu, and M. Ceaparu. 2020. WebRTC role in real-time communication and video conferencing. In 2020 Global Internet of Things Summit (GIoTS). 1–6.

Google Scholar

[11]

S. Wang, M. Parsons, Jordan Stone-McLean, P. Rogers, S. Boyd, K. Hoover, O. Pastor, Minglun Gong, and A. Smith. 2017. Augmented Reality as a Telemedicine Platform for Remote Procedural Training. Sensors (Basel, Switzerland) 17 (2017).

Google Scholar

Cited By

View all

Rebol MPietroszek KRanniger CHood CRutenberg ASikka NSteinmaurer AGutl C(2022)Work-in-Progress-Volumetric Communication for Remote Assistance Giving Cardiopulmonary Resuscitation2022 8th International Conference of the Immersive Learning Research Network (iLRN)10.23919/iLRN55037.2022.9815989(1-3)Online publication date: 30-May-2022
https://doi.org/10.23919/iLRN55037.2022.9815989

Recommendations

Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality Conference

In this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Vision and Graphics in Producing Mixed Reality Worlds
CVVRHC '98: Proceedings of the 1998 Workshop on Computer Vision for Virtual Reality Based Human Communications (CVVRHC '98)

This paper introduces prominent topics of our Mixed Reality (MR) project and states what kind of role computer vision and graphics play in the project. MR is a part of VR in broader sense, but it treats the physical space as well as the virtual space ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

June 2022

414 pages

ISBN:9781450397193

DOI:10.1145/3531073

General Chair:
Paolo Bottoni
Sapienza University of Rome, Italy
,
Program Chair:
Emanuele Panizzi
Sapienza University of Rome, Italy

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

NSF (National Science Foundation)

Conference

AVI 2022

AVI 2022: International Conference on Advanced Visual Interfaces

June 6 - 10, 2022

Frascati, Rome, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
215
Total Downloads

Downloads (Last 12 months)77
Downloads (Last 6 weeks)18

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rebol MPietroszek KRanniger CHood CRutenberg ASikka NSteinmaurer AGutl C(2022)Work-in-Progress-Volumetric Communication for Remote Assistance Giving Cardiopulmonary Resuscitation2022 8th International Conference of the Immersive Learning Research Network (iLRN)10.23919/iLRN55037.2022.9815989(1-3)Online publication date: 30-May-2022
https://doi.org/10.23919/iLRN55037.2022.9815989

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

Mixed reality in virtual world teleconferencing

Vision and Graphics in Producing Mixed Reality Worlds

Merging environments for shared spaces in mixed reality

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

HTML Format

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations