abstract

Designing a Social VR Clinic for Medical Consultations

Authors:

Huib de Ridder,

Pablo CesarAuthors Info & Claims

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 9

https://doi.org/10.1145/3334480.3382836

Published: 25 April 2020 Publication History

Abstract

Social Virtual Reality (VR) invites multiple users to "interact" in a shared immersive environment, which creates new opportunities for remote communication, and can potentially be a new tool for remote medical consultations. Using knee osteoarthritis consultation as a use case, this paper presents a social VR clinic that allows patients to consult a nurse represented as a virtual avatar with head, upper body and hands visible. We started with an ethnographic study at a hospital with three medical professionals and observed three patient consultation sessions to map the patient treatment journey (PTJ) and distill design requirements for social VR consultation. Based on the results of the study, we designed and implemented a social VR clinic to meet the identified requirements. Our work expands on the potential of social VR to help reshape patient treatment by reducing the workload of medical staff and the travel time of patients. In the future, we plan to conduct user studies to compare face-to-face (F2F) with social VR consultations.

References

[1]

Michelle Aebersold and Dana Tschannen. 2012. Using virtual simulations in second life for teaching and learning in nursing education. Engaging the Avatar: New Frontiers in Immersive Education (2012), 311.

[2]

Karolien Aelbrecht, Michela Rimondini, Jozien Bensing, Francesca Moretti, Sara Willems, Mariangela Mazzi, Ian Fletcher, and Myriam Deveugele. 2015. Quality of doctor--patient communication through the eyes of the patient: variation according to the patient's educational level. Advances in Health Sciences Education 20, 4 (2015), 873--884.

[3]

Jeffrey A Alexander, Larry R Hearld, Jessica N Mittler, and Jillian Harvey. 2012. Patient--physician role relationships and patient activation among individuals with chronic illness. Health services research 47, 3pt1 (2012), 1201--1223.

[4]

Michael Angrosino. 2007. Doing ethnographic and observational research. Sage.

[5]

K Louise Barriball and Alison While. 1994. Collecting data using a semi-structured interview: A discussion paper. Journal of Advanced Nursing-Institutional Subscription 19, 2 (1994), 328--335.

[6]

Penny E Bee, Peter Bower, Karina Lovell, Simon Gilbody, David Richards, Linda Gask, and Pamela Roach. 2008. Psychotherapy mediated by remote communication technologies: A meta-analytic review. BMC psychiatry 8, 1 (2008), 60.

[7]

Inrak Choi, Heather Culbertson, Mark R Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A wearable haptic interface for simulating weight and grasping in virtual reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 119--130.

Digital Library

[8]

Alessandro Di Cerbo, Julio Cesar Morales-Medina, Beniamino Palmieri, and Tommaso Iannitti. 2015. Narrative review of telemedicine consultation in medical practice. Patient preference and adherence 9 (2015), 65.

[9]

David T Felson, Allan Naimark, Jennifer Anderson, Lewis Kazis, William Castelli, and Robert F Meenan. 1987. The prevalence of knee osteoarthritis in the elderly. The Framingham Osteoarthritis Study. Arthritis & Rheumatism: Official Journal of the American College of Rheumatology 30, 8 (1987), 914--918.

[10]

Trisha Greenhalgh, Sara Shaw, Joseph Wherton, Shanti Vijayaraghavan, Joanne Morris, Satya Bhattacharya, Philippa Hanson, Desirée Campbell-Richards, Seendy Ramoutar, Anna Collard, and others. 2018. Real-world implementation of video outpatient consultations at macro, meso, and micro levels: mixed-method study. Journal of medical Internet research 20, 4 (2018), e150.

[11]

Walter Greenleaf. 2016. How VR technology will transform healthcare. In ACM SIGGRAPH 2016 VR Village. ACM, 5.

Digital Library

[12]

Paul Heidicker, Eike Langbehn, and Frank Steinicke. 2017. Influence of avatar appearance on presence in social VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 233--234.

[13]

Trevor Jamieson, Ross Wallace, Katie Armstrong, Payal Agarwal, Bailey Griffin, Ivy Wong, and S Bahtia. 2015. Virtual care: A framework for a patient-centric system. Toronto: Women's College Hospital Institute for Health Systems Solutions and Virtual Care (2015).

[14]

Sarah Jones and Steve Dawkins. 2018. The sensorama revisited: evaluating the application of multi-sensory input on the sense of presence in 360-degree immersive film in virtual reality. In Augmented reality and virtual reality. Springer, 183--197.

[15]

K-F Kaltenborn and O Rienhoff. 1993. Virtual reality in medicine. Methods of information in medicine 32, 05 (1993), 407--417.

[16]

Barbara B Kawulich. 2005. Participant Observation as a Data Collection Method. (2005).

[17]

John M Kelley, Anthony J Lembo, J Stuart Ablon, Joel J Villanueva, Lisa A Conboy, Ray Levy, Carl D Marci, Catherine Kerr, Irving Kirsch, Eric E Jacobson, and others. 2009. Patient and practitioner influences on the placebo effect in irritable bowel syndrome. Psychosomatic medicine 71, 7 (2009), 789.

[18]

Roy PC Kessels. 2003. Patients' memory for medical information. Journal of the Royal Society of Medicine 96, 5 (2003), 219--222.

[19]

Jie Li, Yiping Kong, Thomas Röggla, Francesca De Simone, Swamy Ananthanarayan, Huib de Ridder, Abdallah El Ali, and Pablo Cesar. 2019. Measuring and understanding photo sharing experiences in social Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 667.

Digital Library

[20]

Robyn Longhurst. 2003. Semi-structured interviews and focus groups. Key methods in geography 3 (2003), 143--156.

[21]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1471--1482.

Digital Library

[22]

Elhassan Makled, Amal Yassien, Passant Elagroudy, Mohamed Magdy, Slim Abdennadher, and Nabila Hamdi. 2019. PathoGenius VR: VR medical training. In Proceedings of the 8th ACM International Symposium on Pervasive Displays. ACM, 31.

Digital Library

[23]

Daniel G McDonald and Michael A Shapiro. 1992. I'm Not a Real Doctor, but I Play One in Virtual Reality: Implications of Virtual Reality for Judgments about Reality. Journal of Communication 42, 4 (1992).

[24]

Marianna Obrist, Elia Gatti, Emanuela Maggioni, Chi Thanh Vi, and Carlos Velasco. 2017. Multisensory experiences in HCI. IEEE MultiMedia 24, 2 (2017), 9--13.

Digital Library

[25]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, and others. 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 741--754.

Digital Library

[26]

Corwin N. Rhyan. 2019. Travel and Wait Times Are Longest for Health Care Services. (2019). https://altarum.org/travel-and-wait

[27]

David Riedl and Gerhard Schüßler. 2017. The influence of doctor-patient communication on health outcomes: A systematic review. Zeitschrift für Psychosomatische Medizin und Psychotherapie 63, 2 (2017), 131--150.

[28]

Giuseppe Riva. 2014. Medical clinical uses of virtual worlds. In The Oxford handbook of virtuality. Oxford University Press, New York, 649--665.

[29]

Giuseppe Riva, Antonios Dakanalis, and Fabrizia Mantovani. 2015. Leveraging psychology of virtual body for health and wellness. The Handbook of the Psychology of Communication Technology. Chichester, UK: John Wiley & Sons, Ltd (2015), 528--47.

[30]

Liz Sanders. 2012. Convivial Toolbox: Generative Research for the Front End of Design pdf by. (2012).

[31]

Donghee Shin. 2018. Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience? Computers in Human Behavior 78 (2018), 64--73.

Digital Library

[32]

David R Thomas. 2006. A general inductive approach for analyzing qualitative evaluation data. American journal of evaluation 27, 2 (2006), 237--246.

[33]

Ann M Thomson, Susan J Cunningham, and Nigel P Hunt. 2001. A comparison of information retention at an initial orthodontic consultation. The European Journal of Orthodontics 23, 2 (2001), 169--178.

[34]

Anh N Tran, Paul Haidet, Richard L Street Jr, Kimberly J O'Malley, Frank Martin, and Carol M Ashton. 2004. Empowering communication: A community-based intervention for patients. Patient education and counseling 52, 1 (2004), 113--121.

[35]

Jose E Venson, Jean Berni, Carlos S Maia, A Marques da Silva, Marcos d'Ornelas, and Anderson Maciel. 2016. Medical imaging VR: can immersive 3D aid in diagnosis?. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology. ACM, 349--350.

Digital Library

[36]

William B Ventres and Richard M Frankel. 2015. Shared presence in physician-patient communication: A graphic representation. Families, Systems, & Health 33, 3 (2015), 270.

[37]

Nitin Walia, Fatemeh Mariam Zahedi, and Hemant Jain. 2017. Potential of Virtual Worlds for Nursing Care: Lessons and Outcomes. OJIN: the Online Journal of Issues in Nursing 23, 1 (2017).

[38]

Harry F Wolcott. 1999. Ethnography: A way of seeing. Rowman Altamira.

[39]

Yajie Zhao, Qingguo Xu, Weikai Chen, Chao Du, Jun Xing, Xinyu Huang, and Ruigang Yang. 2019. Mask-off: Synthesizing face images in the presence of head-mounted displays. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 267--276.

Cited By

Dhunnoo PKemp BMcGuigan KMeskó BO’Rourke VMcCann M(2024)Evaluation of Telemedicine Consultations Using Health Outcomes and User Attitudes and Experiences: Scoping ReviewJournal of Medical Internet Research10.2196/5326626(e53266)Online publication date: 9-Jul-2024
https://doi.org/10.2196/53266
Röggla TShamma DWilliamson JViola IRossi SCesar P(2024)A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla HubsProceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3652212.3652225(41-44)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3652212.3652225
Neuhaus RRingfort-Felner RCourtney DKneile MHassenzahl M(2024)Virtual Unreality: Augmentation-Oriented Ideation Through Design CardsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642364(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642364
Show More Cited By

Index Terms

Designing a Social VR Clinic for Medical Consultations
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Social VR Platform: Building 360-degree Shared VR Spaces
TVX '17 Adjunct: Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video

Virtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. In this demo, we present our ongoing efforts towards social and shared VR; ...
Let’s Get in Touch! Adding Haptics to Social VR
IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

Social VR shall allow natural communication between users with high social presence, as if users are in the same room. One way to increase social presence is to add haptic interaction to allow, for example, users to give each other a ”high-five” or to ...
A Virtual Space for All: Exploring Children's Experience in Social Virtual Reality
CHI PLAY '20: Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Social virtual reality (VR) is increasingly becoming an emerging online social ecosystem where multiple users can interact with one another through VR head-mounted displays in 3Dvirtual spaces. The co-existence of minors and adults in social VR presents ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

4474 pages

ISBN:9781450368193

DOI:10.1145/3334480

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Horizon 2020

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
783
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)7

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dhunnoo PKemp BMcGuigan KMeskó BO’Rourke VMcCann M(2024)Evaluation of Telemedicine Consultations Using Health Outcomes and User Attitudes and Experiences: Scoping ReviewJournal of Medical Internet Research10.2196/5326626(e53266)Online publication date: 9-Jul-2024
https://doi.org/10.2196/53266
Röggla TShamma DWilliamson JViola IRossi SCesar P(2024)A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla HubsProceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3652212.3652225(41-44)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3652212.3652225
Neuhaus RRingfort-Felner RCourtney DKneile MHassenzahl M(2024)Virtual Unreality: Augmentation-Oriented Ideation Through Design CardsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642364(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642364
Tashiro YMiyafuji SKojima YKiyofuji SKin TIgarashi TKoike H(2024)MR Microsurgical Suture Training System with Level-Appropriate SupportProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642324(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642324
Uhl JGutierrez RRegal GSchrom-Feiertag HSchuster BTscheligi M(2024)Choosing the Right Reality: A Comparative Analysis of Tangibility in Immersive Trauma SimulationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641912(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641912
Lee SViola IRossi SGuo ZReimat IŁawicka KStriner ACesar P(2024)Designing and Evaluating a VR Lobby for a Socially Enriching Remote Opera Watching ExperienceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337208130:5(2055-2065)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372081
Pervez FShoukat MUsama MSandhu MLatif SQadir J(2024)Affective Computing and the Road to an Emotionally Intelligent MetaverseIEEE Open Journal of the Computer Society10.1109/OJCS.2024.33894625(195-214)Online publication date: 2024
https://doi.org/10.1109/OJCS.2024.3389462
Preukschas AWise PBettscheider LPfeiffer MWagner MHuber MGolriz MFischer LMehrabi ARössler FSpeidel SHackert TMüller-Stich BNickel FKenngott H(2024)Comparing a virtual reality head-mounted display to on-screen three-dimensional visualization and two-dimensional computed tomography data for training in decision making in hepatic surgery: a randomized controlled studySurgical Endoscopy10.1007/s00464-023-10615-838:5(2483-2496)Online publication date: 8-Mar-2024
https://doi.org/10.1007/s00464-023-10615-8
Dhunnoo PMeskó BO’Rourke VMcGuigan KMcCann M(2024)Towards Enhanced Virtual Chronic Care: Artificial Intelligence-Human Computer Interaction Integration in Synchronous Virtual ConsultationsIntelligent Systems and Applications10.1007/978-3-031-66329-1_2(16-23)Online publication date: 31-Jul-2024
https://doi.org/10.1007/978-3-031-66329-1_2
Fang SYatani K(2023)Towards Understanding Sense of Inclusion in Social VR OnboardingExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585751(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585751
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents