Embodied Hybrid Bodystorming to Design an XR Suture Training Experience
Authors: 
Elena Márquez Segura, 
José Manuel Vega-Cebrián, 
Andrés A. Maldonado Morillo, Lara Cristóbal Velasco, 
Andrea BellucciAuthors Info & Claims
Article No.: 14, Pages 1 - 12
Abstract
Extended Reality (XR) technology offers promising results to support skill training. In the field of surgical education, Virtual Reality (VR) has long been explored, showing the potential to foster improved skill development and learning. However, XR in this domain is still underinvestigated, and there is a lack of design knowledge, design methods, and guidelines to inform how to best design XR experiences for effective surgical training. Here, we focus on suture training and show how participatory embodied design activities with experienced surgeons can help open the design space and arrive at interesting design solutions. We report on a hybrid bodystorming combining physical props with XR headsets with passthrough capabilities, supporting rich embodied explorations, a better understanding and articulation of key steps of suturing, uncovering essential design requirements and features, and arriving at an interesting design concept proposal that can be inspiring for future works in the domain.
Supplemental Material
PDF File
Supplementary Material
- Download
- 3.53 MB
References
[1]
Julian Abich, Jason Parker, Jennifer S. Murphy, and Morgan Eudy. 2021. A review of the evidence for training effectiveness with virtual reality technology. Virtual Reality 25, 4 (Dec. 2021), 919–933. https://doi.org/10.1007/s10055-020-00498-8
[2]
Medhat Alaker, Greg R. Wynn, and Tan Arulampalam. 2016. Virtual reality training in laparoscopic surgery: A systematic review & meta-analysis. International Journal of Surgery 29 (May 2016), 85–94. https://doi.org/10.1016/j.ijsu.2016.03.034
[3]
Luluah Albarrak, Oussama Metatla, and Anne Roudaut. 2023. Using Virtual Reality and Co-Design to Study the Design of Large-scale Shape-Changing Interfaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3544548.3581144
[4]
Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[5]
Janis A. Cannon-Bowers, Clint Bowers, and Katelyn Procci. 2010. Optimizing Learning in Surgical Simulations: Guidelines from the Science of Learning and Human Performance. Surgical Clinics of North America 90, 3 (June 2010), 583–603. https://doi.org/10.1016/j.suc.2010.02.006
[6]
A. Chellali, W. Ahn, G. Sankaranarayanan, J. T. Flinn, S. D. Schwaitzberg, D. B. Jones, Suvranu De, and C. G. L. Cao. 2015. Preliminary evaluation of the pattern cutting and the ligating loop virtual laparoscopic trainers. Surgical Endoscopy 29, 4 (April 2015), 815–821. https://doi.org/10.1007/s00464-014-3764-7
[7]
Amanda B. Cooper and Elizabeth J. Tisdell. 2020. Embodied aspects of learning to be a surgeon. Medical Teacher 42, 5 (May 2020), 515–522. https://doi.org/10.1080/0142159X.2019.1708289
[8]
Alexandra C. Cope, Stella Mavroveli, Jeff Bezemer, George B. Hanna, and Roger Kneebone. 2015. Making Meaning From Sensory Cues: A Qualitative Investigation of Postgraduate Learning in the Operating Room. Academic Medicine 90, 8 (Aug. 2015), 1125–1131. https://doi.org/10.1097/ACM.0000000000000740
[9]
Eléonore Ferrier-Barbut, Ignacio Avellino, Geoffroy Canlorbe, Marie-Aude Vitrani, and Vanda Luengo. 2023. Learning With Pedagogical Models: Videos As Adjuncts to Apprenticeship for Surgical Training. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 1–40. https://doi.org/10.1145/3579615
[10]
Payal Guha, Jason Lawson, Iona Minty, James Kinross, and Guy Martin. 2023. Can mixed reality technologies teach surgical skills better than traditional methods? A prospective randomised feasibility study. BMC Medical Education 23, 1 (March 2023), 144. https://doi.org/10.1186/s12909-023-04122-6
[11]
Christian Heath, John Hindmarsh, and Paul Luff. 2010. Video in Qualitative Research: Analysing Social Interaction in Everyday Life (1 edition ed.). SAGE Publications Ltd, Los Angeles.
[12]
Florian Jeanne, Yann Soullard, and Indira Thouvenin. 2016. What is wrong with your gesture? An error-based assistance for gesture training in virtual environments. In 2016 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 247–248.
[13]
Hans-Christian Jetter, Roman Rädle, Tiare Feuchtner, Christoph Anthes, Judith Friedl, and Clemens Nylandsted Klokmose. 2020. “In VR, everything is possible!”: Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3313831.3376652
[14]
David Kirsh. 2013. Embodied Cognition and the Magical Future of Interaction Design. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 3 (apr 2013), 30 pages. https://doi.org/10.1145/2442106.2442109
[15]
Hillary Lia, Gregory Paulin, Nelson Yi, Hassan Haq, Steve Emmanuel, Kristian Ludig, Zsuzsanna Keri, Andras Lasso, Gabor Fichtinger, Caitlin T. Yeo, and Jessica Andrews. 2018. HoloLens in suturing training. In Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Robert J. Webster and Baowei Fei (Eds.). SPIE, Houston, United States, 69. https://doi.org/10.1117/12.2293934
[16]
Alexander Hvidbjerg Kjær Lund, Amalie Finnemannn Sørensen, Lars Elbæk, and Maximus D. Kaos. 2021. Insights from design processes used in developing exergames. In 15th European Conference on Game Based Learning, ECGBL 2021. Dechema eV, 490–498.
[17]
Claudia Mareis. 2012. The Epistemology of the Unspoken: On the Concept of Tacit Knowledge in Contemporary Design Research. Design Issues 28, 2 (2012), 61–71.
[18]
Joshua McVeigh-Schultz, Max Kreminski, Keshav Prasad, Perry Hoberman, and Scott S. Fisher. 2018. Immersive Design Fiction: Using VR to Prototype Speculative Interfaces and Interaction Rituals within a Virtual Storyworld. In Proceedings of the 2018 Designing Interactive Systems Conference(DIS ’18). Association for Computing Machinery, New York, NY, USA, 817–829. https://doi.org/10.1145/3196709.3196793
[19]
Adnan Munawar, Zhaoshuo Li, Punit Kunjam, Nimesh Nagururu, Andy S. Ding, Peter Kazanzides, Thomas Looi, Francis X. Creighton, Russell H. Taylor, and Mathias Unberath. 2022. Virtual reality for synergistic surgical training and data generation. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 10, 4 (July 2022), 366–374. https://doi.org/10.1080/21681163.2021.1999331
[20]
Elena Márquez Segura, Laia Turmo Vidal, and Asreen Rostami. 2016. Bodystorming for movement-based interaction design. Human Technology: An Interdisciplinary Journal on Humans in ICT Environments 12, 2 (2016), 193–251. https://doi.org/10.17011/ht/urn.201611174655
[21]
Elena Márquez Segura, Laia Turmo Vidal, Asreen Rostami, and Annika Waern. 2016. Embodied Sketching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 6014–6027. https://doi.org/10.1145/2858036.2858486
[22]
Rebekah A. Naylor, Lisa A. Hollett, R. James Valentine, Ian C. Mitchell, Monet W. Bowling, A. Moe Ma, Sean P. Dineen, Brandon R. Bruns, and Daniel J. Scott. 2009. Can medical students achieve skills proficiency through simulation training?The American Journal of Surgery 198, 2 (Aug. 2009), 277–282. https://doi.org/10.1016/j.amjsurg.2008.11.036
[23]
Jakob Nielsen. 1993. Usability Engineering (1st edition ed.). Morgan Kaufmann, Boston.
[24]
Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and Ubiquitous Computing 7, 2 (July 2003), 125–134. https://doi.org/10.1007/s00779-003-0238-7
[25]
Robert V. O’Toole, Robert R. Playter, Thomas M. Krummel, William C. Blank, Nancy H. Cornelius, Webb R. Roberts, Whitney J. Bell, and Marc Raibert. 1999. Measuring and developing suturing technique with a virtual reality surgical simulator11All authors, except Krummel, have an affiliation with Boston Dynamics Inc., an organization that has a financial interest in the editorial content discussed in the manuscript.Journal of the American College of Surgeons 189, 1 (July 1999), 114–127. https://doi.org/10.1016/S1072-7515(99)00076-9
[26]
Jocelyn Parong and Richard E. Mayer. 2021. Cognitive and affective processes for learning science in immersive virtual reality. Journal of Computer Assisted Learning 37, 1 (Feb. 2021), 226–241. https://doi.org/10.1111/jcal.12482
[27]
Panayiotis E. Pelargos, Daniel T. Nagasawa, Carlito Lagman, Stephen Tenn, Joanna V. Demos, Seung J. Lee, Timothy T. Bui, Natalie E. Barnette, Nikhilesh S. Bhatt, Nolan Ung, Ausaf Bari, Neil A. Martin, and Isaac Yang. 2017. Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of Clinical Neuroscience 35 (Jan. 2017), 1–4. https://doi.org/10.1016/j.jocn.2016.09.002
[28]
M Polanyi. 1966. The Tacit Dimension (Edition 2009 with a new forward by Amartya Sen).
[29]
Rachel Prentice. 2007. Drilling Surgeons: The Social Lessons of Embodied Surgical Learning. Science, Technology, & Human Values 32, 5 (Sept. 2007), 534–553. https://doi.org/10.1177/0895904805303201
[30]
Rachel Prentice. 2013. Bodies information: an ethnography of anatomy and surgery education. Duke University Press, Durham, NC.
[31]
Unnikrishnan Radhakrishnan, Francesco Chinello, and Konstantinos Koumaditis. 2023. Investigating the effectiveness of immersive VR skill training and its link to physiological arousal. Virtual Reality 27, 2 (June 2023), 1091–1115. https://doi.org/10.1007/s10055-022-00699-3
[32]
Anke V. Reinschluessel, Thomas Muender, Daniela Salzmann, Tanja Döring, Rainer Malaka, and Dirk Weyhe. 2022. Virtual Reality for Surgical Planning – Evaluation Based on Two Liver Tumor Resections. Frontiers in Surgery 9 (Feb. 2022), 821060. https://doi.org/10.3389/fsurg.2022.821060
[33]
Ana Rojo, Laura Raya, and Alberto Sanchez. 2021. A Novel Mixed Reality Solution Based on Learning Environment for Sutures in Minor Surgery. Applied Sciences 11, 5 (March 2021), 2335. https://doi.org/10.3390/app11052335
[34]
Dennis Schleicher, Peter Jones, and Oksana Kachur. 2010. Bodystorming as embodied designing. Interactions 17, 6 (Nov. 2010), 47–51. https://doi.org/10.1145/1865245.1865256
[35]
Donald A. Schön. 1983. The reflective practitioner: how professionals think in action. Ashgate, Farnham.
[36]
Adalberto L. Simeone, Robbe Cools, Stan Depuydt, João Maria Gomes, Piet Goris, Joseph Grocott, Augusto Esteves, and Kathrin Gerling. 2022. Immersive Speculative Enactments: Bringing Future Scenarios and Technology to Life Using Virtual Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 17, 20 pages. https://doi.org/10.1145/3491102.3517492
[37]
Alexander Skulmowski and Günter Daniel Rey. 2018. Embodied learning: introducing a taxonomy based on bodily engagement and task integration. Cognitive research: principles and implications 3, 1 (2018), 1–10.
[38]
Erik Stolterman. 2008. The Nature of Design Practice and Implications for Interaction Design Research. International Journal of Design 2, 1 (2008), 55–65.
[39]
Yuka Tashiro, Shio Miyafuji, Dong-Hyun Hwang, Satoshi Kiyofuji, Taichi Kin, Takeo Igarashi, and Hideki Koike. 2023. GAuze-MIcrosuture-FICATION: Gamification in Microsuture training with real-time feedback. In Augmented Humans Conference. ACM, Glasgow United Kingdom, 15–26. https://doi.org/10.1145/3582700.3582704
[40]
José Manuel Vega-Cebrián, Elena Márquez Segura, Laia Turmo Vidal, Omar Valdiviezo-Hernández, Annika Waern, Robby Van Delden, Joris Weijdom, Lars Elbæk, Rasmus Vestergaard Andersen, Søren Stigkær Lekbo, and Ana Tajadura-Jiménez. 2023. Design Resources in Movement-based Design Methods: a Practice-based Characterization. In Proceedings of the 2023 ACM Designing Interactive Systems Conference(DIS ’23). Association for Computing Machinery, New York, NY, USA, 871–888. https://doi.org/10.1145/3563657.3596036
[41]
Joris Weijdom. 2022. Performative prototyping in collaborative mixed reality environments: an embodied design method for ideation and development in virtual reality. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’22). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3490149.3501316
[42]
Danielle Wilde, Anna Vallgårda, and Oscar Tomico. 2017. Embodied Design Ideation Methods: Analysing the Power of Estrangement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 5158–5170. https://doi.org/10.1145/3025453.3025873
[43]
George J. Xeroulis, Jason Park, Carol-Anne Moulton, Richard K. Reznick, Vicki LeBlanc, and Adam Dubrowski. 2007. Teaching suturing and knot-tying skills to medical students: A randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 141, 4 (April 2007), 442–449. https://doi.org/10.1016/j.surg.2006.09.012
[44]
Zhuoming Zhou, Elena Márquez Segura, Jared Duval, Michael John, and Katherine Isbister. 2019. Astaire: A Collaborative Mixed Reality Dance Game for Collocated Players. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’19). ACM, New York, NY, USA, 5–18. https://doi.org/10.1145/3311350.3347152 event-place: Barcelona, Spain.
[45]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research Through Design As a Method for Interaction Design Research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’07). ACM, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704
[46]
John Zimmerman, Erik Stolterman, and Jodi Forlizzi. 2010. An Analysis and Critique of Research Through Design: Towards a Formalization of a Research Approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems(DIS ’10). ACM, New York, NY, USA, 310–319. https://doi.org/10.1145/1858171.1858228
[47]
Peter Zimmermann. 2008. Virtual Reality Aided Design. A survey of the use of VR in automotive industry. Springer Netherlands, Dordrecht, 277–296. https://doi.org/10.1007/978-1-4020-8200-9_13
Index Terms
- Embodied Hybrid Bodystorming to Design an XR Suture Training Experience
Recommendations
User Experience Guidelines for Designing HMD Extended Reality Applications
Human-Computer Interaction – INTERACT 2019AbstractWith the rise of Extended Reality (XR) technologies, such as head mounted displays (HMD) for Virtual Reality (VR), Mixed Reality (MR), and Augmented Reality (AR), designers are presented with many unique challenges and opportunities when creating ...
An Authoring Tool for XR Learning Environments
Extended RealityAbstractThe creation of extended reality applications, which combine elements of virtual reality, augmented reality and mixed reality, is complex and demanding, especially in education where its use has grown exponentially in recent years. This paper ...
Exploring Extended Reality as a Simulation Training Tool Through Naturalistic Interactions and Enhanced Immersion
Virtual, Augmented and Mixed Reality. Applications and Case StudiesAbstractAugmented reality (AR), mixed reality (MR), and virtual reality (VR) technologies – collectively extended reality (XR) – have been discussed in the context of training applications since their introduction to the market. While this discussion was ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2024
1058 pages
ISBN:9798400704024
DOI:10.1145/3623509
- General Chairs:
- Luigina Ciolfi,
- Trevor Hogan,
- Program Chairs:
- Tanja Döring,
- Tom Jenkins,
- Jelle van Dijk,
- Samuel Huron,
- Zhuying Li,
- Publications Chairs:
- David Coyle,
- Beat Signer
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 February 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Data Availability
Supplementary Material https://dl.acm.org/doi/10.1145/3623509.3633362#SupplementaryMaterial_TEI24-14.pdf
Funding Sources
Conference
TEI '24
Sponsor:
TEI '24: Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction
February 11 - 14, 2024
Cork, Ireland
Acceptance Rates
Overall Acceptance Rate 393 of 1,367 submissions, 29%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 224Total Downloads
- Downloads (Last 12 months)224
- Downloads (Last 6 weeks)16
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format