research-article

Open access

Enhancing Accuracy, Time Spent, and Ubiquity in Critical Healthcare Delineation via Cross-Device Contouring

Authors:

Michael V. Sherer,

Larry Hernandez,

James D. Murphy,

Nadir WeibelAuthors Info & Claims

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

Pages 905 - 919

https://doi.org/10.1145/3643834.3660718

Published: 01 July 2024 Publication History

All formats PDF

Abstract

Improving accuracy, time spent, and ubiquity of delineation has been a long-standing design aim, yet many HCI works have overlooked high-stakes and complex healthcare annotation. We explore contouring, a critical workflow aimed at identifying and segmenting tumors, usually performed on immobile desktop computers in clinics, in which limited support for mobile access leads to prolonged and subpar treatment planning. Following interviews and think-aloud studies (N = 10 physicians), we report key contouring behaviors, and later design a novel cross-device prototype that enables contouring on everyday touch devices. We compared contouring via desktop and touch in a lab study (N = 8 residents) and found that mobile phones not only yielded similar accuracy, but also took significantly less time. Our results point to three broad design guidelines for cross-device solutions deployed within standalone healthcare workflows, and highlight how incorporating different device and input modalities can improve treatment delivery in today’s distributed healthcare environments.

References

[1]

2021. Cornerstone Library for Javascript. https://docs.cornerstonejs.org/api.html

[2]

2021. Eclipse planning software (Varian Medical Systems, Palo Alto, CA, USA). https://www.varian.com/products/radiotherapy/treatment-planning/eclipse

[3]

2021. MIM MAESTRO (MIM Software Inc., Cleveland, OH). https://www.mimsoftware.com/radiationoncology/maestro

[4]

2021. Paper.js Open-source Vector Graphics Framework). http://paperjs.org/reference/global/

[5]

2022. openCV (Open Source Computer Vision). https://docs.opencv.org/3.4

[6]

Alexandra Branzan Albu, Trevor Beugeling, and Denis Laurendeau. 2008. A morphology-based approach for interslice interpolation of anatomical slices from volumetric images. IEEE Transactions on Biomedical Engineering 55, 8 (2008), 2022–2038.

[7]

VA Andrianarison, M Laouiti, O Fargier-Bochaton, G Dipasquale, X Wang, NP Nguyen, R Miralbell, and V Vinh-Hung. 2018. Contouring workload in adjuvant breast cancer radiotherapy. Cancer/Radiotherapie 22, 8 (2018), 747–753.

[8]

A Aselmaa, RHM Goossens, A Laprie, S Ken, T Fechter, A Ramkumar, and A Freudenthal. 2013. Workflow analysis report. 7th Framework Programme of the European Union, FP7-PEOPLE-2011-ITN, Summer Marie Curie Research Training Network (PITN-GA-2011-290148) (2013).

[9]

Anet Aselmaa, Richard HM Goossens, Ben Rowland, Anne Laprie, Yu Song, and Adinda Freudenthal. 2014. Medical factors of brain tumor delineation in radiotherapy for software design. In 5th International conference on applied human factors and ergonomics (AHFE). 4865–4875.

[10]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies 4, 3 (2009), 114–123.

Digital Library

[11]

James E Bates, Akash D Parekh, Mudit Chowdhary, and Robert J Amdur. 2020. Geographic distribution of radiation oncologists in the United States. Practical radiation oncology 10, 6 (2020), e436–e443.

[12]

Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1923–1932.

Digital Library

[13]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.

[14]

John Brooke. 1996. Sus: a “quick and dirty’usability. Usability evaluation in industry 189, 3 (1996).

[15]

Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. Association for Computing Machinery, New York, NY, USA, 1–28. https://doi.org/10.1145/3290605.3300792

Digital Library

[16]

Neil G Burnet, Simon J Thomas, Kate E Burton, and Sarah J Jefferies. 2004. Defining the tumour and target volumes for radiotherapy. Cancer Imaging 4, 2 (2004), 153.

[17]

Chen Chen, Matin Yarmand, Varun Singh, Michael V. Sherer, James D. Murphy, Yang Zhang, and Nadir Weibel. 2022. Exploring Needs and Design Opportunities for Virtual Reality-based Contour Delineations of Medical Structures. In Companion of the 2022 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Sophia Antipolis, France) (EICS ’22 Companion). Association for Computing Machinery, New York, NY, USA, 19–25. https://doi.org/10.1145/3531706.3536456

Digital Library

[18]

Chen Chen, Matin Yarmand, Varun Singh, Michael V. Sherer, James D. Murphy, Yang Zhang, and Nadir Weibel. 2022. VRContour: Bringing Contour Delineations of Medical Structures Into Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR) (Singapore) (ISMAR ’22). https://doi.org/10.1109/ISMAR55827.2022.00020

[19]

Chen Chen, Matin Yarmand, Zhuoqun Xu, Varun Singh, Yang Zhang, and Nadir Weibel. 2022. Investigating Input Modality and Task Geometry on Precision-first 3D Drawing in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 384–393. https://doi.org/10.1109/ISMAR55827.2022.00054

[20]

Andy Cockburn, David Ahlström, and Carl Gutwin. 2012. Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse. International Journal of Human-Computer Studies 70, 3 (2012), 218–233.

Digital Library

[21]

Indra J Das, Vadim Moskvin, and Peter A Johnstone. 2009. Analysis of treatment planning time among systems and planners for intensity-modulated radiation therapy. Journal of the American College of Radiology 6, 7 (2009), 514–517.

[22]

Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319–340.

Digital Library

[23]

Brock Debenham, Robyn Banerjee, Alysa Fairchild, George Dundas, Theresa Trotter, and Don Yee. 2012. 2009 Canadian radiation oncology resident survey. International Journal of Radiation Oncology* Biology* Physics 82, 4 (2012), 1326–1331.

[24]

Charles Denis and Laurent Karsenty. 2004. Inter-usability of multi-device systems: A conceptual framework. Multiple user interfaces: Cross-platform applications and context-aware interfaces (2004), 373–384.

[25]

Frances Duane, Marianne C Aznar, Freddie Bartlett, David J Cutter, Sarah C Darby, Reshma Jagsi, Ebbe L Lorenzen, Orla McArdle, Paul McGale, Saul Myerson, 2017. A cardiac contouring atlas for radiotherapy. Radiotherapy and Oncology 122, 3 (2017), 416–422.

[26]

Jean-Christophe Faivre, Jean-Emmanuel Bibault, Thomas Leroy, Mikaël Agopiantz, Julia Salleron, Maxime Wack, Guillaume Janoray, Henri Roché, Stéphane Culine, and Sofia Rivera. 2018. Evaluation of the theoretical teaching of postgraduate radiation oncology medical residents in France: a cross-sectional study. Journal of Cancer Education 33, 2 (2018), 383–390.

[27]

Leah Findlater, Jon E Froehlich, Kays Fattal, Jacob O Wobbrock, and Tanya Dastyar. 2013. Age-related differences in performance with touchscreens compared to traditional mouse input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 343–346.

Digital Library

[28]

Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 647–656.

Digital Library

[29]

Adam Fouse, Nadir Weibel, Edwin Hutchins, and James D Hollan. 2011. ChronoViz: a system for supporting navigation of time-coded data. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 299–304.

[30]

Peter N Furness. 1997. The use of digital images in pathology. The Journal of Pathology: A Journal of the Pathological Society of Great Britain and Ireland 183, 3 (1997), 253–263.

[31]

Anthony G Greenwald. 1976. Within-subjects designs: To use or not to use?Psychological Bulletin 83, 2 (1976), 314.

[32]

Jonathan Grudin. 2001. Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In Proceedings of the SIGCHI conference on Human factors in computing systems. 458–465.

Digital Library

[33]

Eli R Hooten and Julie A Adams. 2011. Comparing input error for mouse and touch input. In 2011 IEEE International Conference on Systems, Man, and Cybernetics. IEEE, 2853–2858.

[34]

Ibrar Hussain, A Khan, Imran Ali Khan, Syed Sajid Hussain, and Attiqa Rehman. 2017. A survey on usage of touchscreen versus mouse for interaction. Sci Int (Lahore) 29 (2017), 83–88.

[35]

Multi-Institutional Target Delineation in Oncology Group+ 1-210-4501127+ 1-210-4505085 fullercd@ uthscsa. edu. 2011. Human–computer interaction in radiotherapy target volume delineation: a prospective, multi-institutional comparison of user input devices. Journal of digital imaging 24 (2011), 794–803.

[36]

Yosuke Kano, Hitoshi Ikushima, Motoharu Sasaki, and Akihiro Haga. 2021. Automatic contour segmentation of cervical cancer using artificial intelligence. Journal of Radiation Research 62, 5 (08 2021), 934–944. https://doi.org/10.1093/jrr/rrab070

[37]

James Lamb, Minsong Cao, Amar Kishan, Nzhde Agazaryan, David H Thomas, Narek Shaverdian, Yingli Yang, Suzette Ray, Daniel A Low, Ann Raldow, 2017. Online adaptive radiation therapy: implementation of a new process of care. Cureus 9, 8 (2017).

[38]

Stephanie Lim-Reinders, Brian M Keller, Shahad Al-Ward, Arjun Sahgal, and Anthony Kim. 2017. Online adaptive radiation therapy. International Journal of Radiation Oncology* Biology* Physics 99, 4 (2017), 994–1003.

[39]

Pasquale Loiacono and Luca Pascoletti. 2012. Photography in dentistry: theory and techniques in modern documentation. Quintessenza Edizioni Milan.

[40]

Kalle Lyytinen and Youngjin Yoo. 2002. Ubiquitous computing. Commun. ACM 45, 12 (2002), 63–96.

Digital Library

[41]

I Scott MacKenzie. 1992. Fitts’ law as a research and design tool in human-computer interaction. Human-computer interaction 7, 1 (1992), 91–139.

Digital Library

[42]

Shawna Meyer, Oryx Cohen, and Erik Nilsen. 1994. Device comparisons for goal-directed drawing tasks. In Conference companion on Human factors in computing systems. 251–252.

Digital Library

[43]

Marcel Nachbar, Monica lo Russo, Cihan Gani, Simon Boeke, Daniel Wegener, Frank Paulsen, Daniel Zips, Thais Roque, Nikos Paragios, and Daniela Thorwarth. 2023. Automatic AI-based contouring of prostate MRI for online adaptive radiotherapy. Zeitschrift für Medizinische Physik (2023). https://doi.org/10.1016/j.zemedi.2023.05.001

[44]

Anna Newcomb, Amber W Trickey, Elena Lita, and Jonathan Dort. 2018. Evaluating surgical residents’ patient-centered communication skills: practical alternatives to the “apprenticeship model”. Journal of surgical education 75, 3 (2018), 613–621.

[45]

Vicki L O’Day, Daniel G Bobrow, and Mark Shirley. 1996. The social-technical design circle. In Proceedings of the 1996 ACM conference on Computer supported cooperative work. 160–169.

Digital Library

[46]

Pamela Oliver, Gerald Marwell, and Ruy Teixeira. 1985. A theory of the critical mass. I. Interdependence, group heterogeneity, and the production of collective action. American journal of Sociology 91, 3 (1985), 522–556.

[47]

Wanda J Orlikowski. 1992. The duality of technology: Rethinking the concept of technology in organizations. Organization science 3, 3 (1992), 398–427.

[48]

Lester J Peters, Brian O’Sullivan, Jordi Giralt, Thomas J Fitzgerald, Andy Trotti, Jacques Bernier, Jean Bourhis, Kally Yuen, Richard Fisher, and Danny Rischin. 2010. Critical impact of radiotherapy protocol compliance and quality in the treatment of advanced head and neck cancer: results from TROG 02.02. Journal of clinical oncology 28, 18 (2010), 2996–3001.

[49]

Dong Joo Rhee, Anuja Jhingran, Bastien Rigaud, Tucker Netherton, Carlos E Cardenas, Lifei Zhang, Sastry Vedam, Stephen Kry, Kristy K Brock, William Shaw, 2020. Automatic contouring system for cervical cancer using convolutional neural networks. Medical physics 47, 11 (2020), 5648–5658.

[50]

Stephanie Santosa and Daniel Wigdor. 2013. A field study of multi-device workflows in distributed workspaces. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 63–72.

Digital Library

[51]

Katie A Siek, Yvonne Rogers, and Kay H Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In IFIP Conference on Human-Computer Interaction. Springer, 267–280.

Digital Library

[52]

Ashok Sivaji, Azween Abdullah, and Alan Giffin Downe. 2011. Usability testing methodology: Effectiveness of heuristic evaluation in E-government website development. In 2011 fifth Asia modelling symposium. IEEE, 68–72.

[53]

Maaike Van Den Haak, Menno De Jong, and Peter Jan Schellens. 2003. Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behaviour & information technology 22, 5 (2003), 339–351.

[54]

MW Van Someren, YF Barnard, and JAC Sandberg. 1994. The think aloud method: a practical approach to modelling cognitive. London: AcademicPress (1994).

[55]

Catherine G Wolf. 1992. A comparative study of gestural, keyboard, and mouse interfaces. Behaviour & information technology 11, 1 (1992), 13–23.

[56]

Evan J Wuthrick, Qiang Zhang, Mitchell Machtay, David I Rosenthal, Phuc Felix Nguyen-Tan, André Fortin, Craig L Silverman, Adam Raben, Harold E Kim, Eric M Horwitz, 2015. Institutional clinical trial accrual volume and survival of patients with head and neck cancer. Journal of Clinical Oncology 33, 2 (2015), 156.

[57]

Haijun Xia, Tovi Grossman, and George Fitzmaurice. 2015. NanoStylus: Enhancing input on ultra-small displays with a finger-mounted stylus. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 447–456.

Digital Library

[58]

Matin Yarmand, Chen Chen, Kexin Cheng, James Murphy, and Nadir Weibel. 2024. “I’d be watching him contour till 10 o’clock at night”: Understanding Tensions between Teaching Methods and Learning Needs in Healthcare Apprenticeship. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1–19. https://doi.org/10.1145/3613904.3642453

Digital Library

[59]

Matin Yarmand, Michael Sherer, Chen Chen, Larry Hernandez, Nadir Weibel, and James D. Murphy. 2022. Evaluating Accuracy, Completion Time and Usability of Everyday Touch Devices for Contouring. International Journal of Radiation Oncology, Biology, Physics 114, 3 (2022), S96. https://doi.org/10.1016/j.ijrobp.2022.07.515

[60]

Matin Yarmand, Borui Wang, Chen Chen, Michael Sherer, Larry Hernandez, James Murphy, and Nadir Weibel. 2023. Design and Development of a Training and Immediate Feedback Tool to Support Healthcare Apprenticeship. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7. https://doi.org/10.1145/3544549.3585894

Digital Library

[61]

Stanislaw Zabramski. 2011. Careless touch: A comparative evaluation of mouse, pen, and touch input in shape tracing task. In Proceedings of the 23rd Australian Computer-Human Interaction Conference. 329–332.

Digital Library

[62]

Stanislaw Zabramski, Suman Shrestha, and Wolfgang Stuerzlinger. 2013. Easy vs. tricky: The shape effect in tracing, selecting, and steering with mouse, stylus, and touch. In Proceedings of International Conference on Making Sense of Converging Media. 99–103.

Digital Library

[63]

Stanislaw Zabramski and Wolfgang Stuerzlinger. 2012. The effect of shape properties on ad-hoc shape replication with mouse, pen, and touch input. In Proceeding of the 16th International Academic MindTrek Conference. 275–278.

Digital Library

Cited By

Righi AFischer GRighi RCosta CRoehrs A(2024)TriCache: Providing three-tier caching for time series data in serverless healthcare servicesAnais do XVIII Simpósio Brasileiro de Componentes, Arquiteturas e Reutilização de Software (SBCARS 2024)10.5753/sbcars.2024.3867(81-90)Online publication date: 30-Sep-2024
https://doi.org/10.5753/sbcars.2024.3867

Index Terms

Enhancing Accuracy, Time Spent, and Ubiquity in Critical Healthcare Delineation via Cross-Device Contouring
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods

Recommendations

Delineating low-count defective-contour SPECT lung scans for PE diagnosis using adaptive dual exponential thresholding and active contours

To develop an automated lung delineation method that greatly improves the accuracy of contour extraction in SPECT lung scans with low maximum count, total counts, and-or defective contour edges, by combining deformable contour and planar image processing ...
A new automated delineation method for SPECT lung scans using adaptive dual-exponential thresholding

An accurate method for delineating lung contours in single photon emission computed tomography (SPECT) is critical to respiratory studies such as pulmonary embolism (PE) and respiratory aerosol deposition. Current delineation methods are not adaptive in ...
A Review on Diffusion of Personal Digital Assistants in Healthcare

This review draws from a comprehensive literature search and reviews the adoption, usage and impact of personal digital assistants (PDAs) in healthcare. Adoption relates to the rationale for, barriers to and scope of adopting PDAs. Usage relates to the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

July 2024

3616 pages

ISBN:9798400705830

DOI:10.1145/3643834

Editors:
Anna Vallgårda
IT University of Copenhagen
,
Li Jönsson
Malmö University
,
Jonas Fritsch
IT University of Copenhagen
,
Sarah Fdili Alaoui
LISN-Université Paris Saclay
,
Christopher A. Le Dantec
Northeastern University

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

AGENCY FOR HEALTH CARE RESEARCH AND QUALITY

Conference

DIS '24

Sponsor:

SIGCHI

DIS '24: Designing Interactive Systems Conference

July 1 - 5, 2024

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
171
Total Downloads

Downloads (Last 12 months)171
Downloads (Last 6 weeks)62

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Righi AFischer GRighi RCosta CRoehrs A(2024)TriCache: Providing three-tier caching for time series data in serverless healthcare servicesAnais do XVIII Simpósio Brasileiro de Componentes, Arquiteturas e Reutilização de Software (SBCARS 2024)10.5753/sbcars.2024.3867(81-90)Online publication date: 30-Sep-2024
https://doi.org/10.5753/sbcars.2024.3867

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents