research-article

Doctor, Can You See My Squats?: Understanding Bodily Communication in Video Consultations for Physiotherapy

Authors:

Deepti Aggarwal,

Bernd Ploderer,

Thuong HoangAuthors Info & Claims

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

Pages 1197 - 1208

https://doi.org/10.1145/2901790.2901871

Published: 04 June 2016 Publication History

Abstract

This paper investigates the challenges of bodily communication during video-based clinical consultations. While previous works describe the lack of eye contact and gestures over video, it is unclear how these limitations impact the course of a clinical consultation, particularly in a domain like physiotherapy where the focus is on improving body movements and functioning. To contribute to this understanding, we conducted observations of 10 naturally occurring video and face-to-face consultations for physiotherapy. We found that clinicians rely on a variety of incidental bodily cues and fine-details of body movements to assess and examine the patient. These bodily cues were noticeable during face-to-face consultations; however, a variety of bodily cues got missed over video. Consequently, video consultations became conversational where the clinicians used verbal conduct to get a fair understanding of the patient's health. To guide design of future video consultation systems, we reflect on our understanding as 4 design sensitivities: Visual Acuity, Field-of-view, Clinical Asymmetries, and Time Sequence.

References

[1]

Australian Physiotherapy Association. Retrieved on September 10, 2015 from https://www.physiotherapy.asn.au/DocumentsFolder/A PAWCM/Resources/InPractice_2025.pdf

[2]

Deepti Aggarwal, Robyn Garnett, Bernd Ploderer, Frank Vetere, Patricia Eadie, Bronwyn Joy Davidson. 2015. Understanding Video based Parent Training for Children with Autism. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI'15), ACM, 1019. http://dx.doi.org/10.1145/2838739.2838770

Digital Library

[3]

Michael Argyle. 2013. Bodily communication. Routledge.

[4]

Julie Bernhardt, Tom Matyas & Patricia Bate. 2002. Does experience predict observational kinematic assessment accuracy? Physiotherapy Theory and Practice: An International Journal of Physiotherapy, 18(3), 2002, 141--149.

[5]

Shirley Beul, Martina Ziefle, & Eva-Maria Jakobs. 2011. It's All about the Medium: Identifying Patients' Medial Preferences for Telemedical Consultations. In. Human-Computer Interaction Information Quality in E-Health. eds. A. Holzinger and K.-M. Simonic. Berlin, Heidelberg: Springer, 321--336.

Digital Library

[6]

Ann Blandford, Erik Berndt, Ken Catchpole, Dominic Furniss, Astrid Mayer, Helena Mentis, Aisling Ann O'Kane, Tom Owen, Atish Rajkomar, and Rebecca Randell. 2012. Experiencing Interactive Healthcare Technologies: embracing "the wild" on its own terms. Invited submission to ToCHI's special issue on "The Turn to the Wild." http://doi.acm.org/10.1145/0000000.0000000

[7]

Patrick Sarsfield Byrne and Long B. E. 1976. Doctors talking to patients. A study of the verbal behaviour of general practitioners consulting in their surgeries. Her Majesty's Stationery Office, London, England.

[8]

Yunan Chen, Victor Ngo, Sidney Harrison, and Victoria Duong. 2011. Unpacking exam-room computing: negotiating computer-use in patientphysician interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM, New York, NY, USA, 3343--3352.

Digital Library

[9]

Liugina Ciolfi. 2004. Situating "Place" in Interaction Design: Enhancing the User Experience in Interactive Environments. 2004. Dept. of Computer Science and Information Systems, University of Limerick, Ireland.

[10]

Marvin G. Cline. 1967. The Perception of Where a Person Is Looking. The American Journal of Psychology, 80(1), 41--50.

[11]

D. Mark Chaput de Saintonge, and Andrew Herxheimer. 1994. Harnessing placebo effects in health care. The Lancet 1994, 995--998.

[12]

George Demiris, Neil Charness, Elizabeth Krupinski, David Ben-Arieh, Karla Washington, John Wu, and Bonne Farberow. The Role of Human Factors in Telehealth. Telemedicine and e-Health. May 2010, 16(4): 446--453.

[13]

Sarah Dods, Jill Freyne, Leila Alem, Surya Nepal, Jane Li, & Julian Jang-Jaccard. 2012. Caring for the Last 3%: Telehealth Potential and Broadband Implications for Remote Australia. Canberra: CSIRO. https://publications.csiro.au/rpr/download?pid=csiro:E P129516&dsid=DS3

[14]

Paul Dourish and Victoria Bellotti. 1992. Awareness and Coordination in Shared Workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. ACM, 143468, 107--114. http://dx.doi.org/10.1145/143457.143468

Digital Library

[15]

Anne G. Ekeland, Alison Bowes, and Signe Flottorp. 2010. Effectiveness of telemedicine: A systematic review of reviews. International Journal of medical informatics 2010, 79(11), 736--771.

[16]

Geraldine Fitzpatrick, and Gunnar Ellingsen. A review of 25 years of CSCW Research in Healthcare: Contributions, Challenges and Future Agendas. Comput. Supported Coop. Work 22, 4--6 (August 2013), 609--665. http://dx.doi.org/10.1007/s10606-012-9168-0

Digital Library

[17]

William W. Gaver. 1992. The affordances of media spaces for collaboration. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work (CSCW'92). ACM, New York, NY, USA, 17--24. http://doi.acm.org/10.1145/143457.371596

Digital Library

[18]

William W. Gaver, Abigail Sellen, Christian Heath and Paul Luff. 1993. One Is Not Enough: Multiple Views in a Media Space. In Proceedings of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems. ACM, 169268, 335--341. http://dx.doi.org/10.1145/169059.169268

Digital Library

[19]

GotoMeeting. Retrieved on September 10, 2015 from http://www.gotomeeting.com.au

[20]

HealthDirect. Retrieved on September 10, 2015 from http://www.healthdirect.gov.au/hda-video-call

[21]

Christian Heath.1986. Body movement and speech in medical interaction. Cambridge University Press.

[22]

Christian Heath. 2002. Demonstrative Suffering: The Gestural (Re)embodiment of Symptoms.Journal of Communication, 52(3), 597--616.

[23]

Christian Heath and Paul Luff. 1992. Media Space and Communicative Asymmetries: Preliminary Observations of Video-Mediated Interaction. Human-Computer Interaction 7, 3 (1992), 315--346. http://dx.doi.org/10.1207/s15327051hci0703_3

Digital Library

[24]

Christian Heath, Paul Luff, and Marcus Sanchez Svensson. 2003. Technology and medical practice. Sociology of Health & illness 25, no. 3 (2003): 75--96.

[25]

Jean E. Jackson. 2011. "Pain and Bodies" in A Companion to the Anthropology of the Body and Embodiment, Frances E. Mascia-Lees (Editor), Chapter 21, Wiley-Blackwell, May 2011.

[26]

Steven Johnson, Irene Rae, Bilge Mutlu, and Leila Takayama. 2015. Can You See Me Now?: How Field of View Affects Collaboration in Robotic Telepresence. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15). ACM, New York, NY, USA, 2397--2406.

Digital Library

[27]

Agnes W.K. Lam, Danniel Varona-Marin, Yeti Li, Mitchell Fergenbaum & Dana Kulic. 2016. Automated Rehabilitation System: Movement Measurement and Feedback for Patients and Physiotherapists in the Rehabilitation Clinic. Human Computer Interaction 2016, 1--41.

Digital Library

[28]

Thomas Albert Matyas, Patricia Bate, Julie Bernhardt. 2002. Does clinical experience predict observational kinematic assessment accuracy of upper limb movement pattern following stroke? Physiotherapy Theory and Practice 2002, 18: 141--149.

[29]

Helena M. Mentis, Rita Shewbridge, Sharon Powell, Melissa Armstrong, Paul Fishman, and Lisa Shulman, 2015. Co-Interpreting Movement With Sensors: Assessing Parkinson's Patients' Deep Brain Stimulation Programming. Human Computer Interaction 2015, 1--34.

Digital Library

[30]

Edward Alan Miller. 2003. The technical and interpersonal aspects of telemedicine: effects on doctor-patient communication. Telemedicine and Telecare, 9(1): 1--7.

[31]

Edward Alan Miller. 2011. The continuing need to investigate the nature and content of Teleconsultation communication using interaction analysis techniques. Telemedicine and Telecare, 17(2): 55--64.

[32]

Judith S. Olson and Gary M. Olson. Working Together Apart: Collaboration over the Internet. Morgan & Claypool Publishers, 2013.

[33]

Nelly Oudshoorn. 2008. Physical and digital proximity: Emerging ways of health care in face-to-face and telemonitoring of heart-failure patients. Sociology of Health and Illness, 30, 272--295.

[34]

Pain Australia. Retrieved on January 5, 2016 from http://www.painaustralia.org.au/the-national-painstrategy/why-we-need-the-nps.html

[35]

Michael Quinn Patton. 2005. Qualitative research. John Wiley & Sons, Ltd.

[36]

Jeffrey David Robinson. 1998. Getting Down to Business Talk, Gaze, and Body Orientation During Openings of Doctor-Patient Consultations. Human Communication Research, 25(1), 97--123.

[37]

Clive Seale. 1999. Quality in qualitative research. Qualitative inquiry 5.4 (1999): 465--478.

[38]

Aneesha Singh, Stefano Piana, Davide Pollarolo, Gualtiero Volpe, Giovanna Varni, Ana TajaduraJimenez, Amanda CdeC Williams, Antonio Camurri & Nadia Bianchi-Berthouze. 2016. Go-with-the-Flow: Tracking, Analysis and Sonification of Movement and Breathing to Build Confidence in Activity Despite Chronic Pain. Human Computer Interaction 2016, 149.

Digital Library

[39]

Duncan Roderick Stevenson. 2011. Tertiary-Level Telehealth: A Media Space Application. Comput. Supported Coop. Work, 20: 61--92.

Digital Library

[40]

Cristiano Storni. 2009. The politics of design in Sociotechnical dispositif. Reconciling Healthcare toward a future patient-centric perspective. In Proceedings of the IFIP 2009 Conference on Human Computer Interaction (INTERACT '09). Berlin, Germany.

[41]

Richard Tang, Xing-Dong Yang, Scott Bateman, Joaquim Jorge, and Anthony Tang. 2015. Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15). ACM, New York, NY, USA, 4123--4132. http://doi.acm.org/10.1145/2702123.2702401

Digital Library

[42]

Paul ten Have. 1991. Talk and institution: A reconsideration of the "asymmetry" of doctor-patient interaction. Talk and Social structure: Studies in ethnomethodology and conversation analysis, 138--163. Los Angeles: University of California Press.

[43]

Liezl van Dyk. 2014. A review of Telehealth Service Implementation Frameworks. International journal of environmental research and public health 11, no. 2 (2014): 1279--1298.

[44]

Karen Vanderloock, Vero Vanden Abeele, Johan A.K. Suykens, and Luc Geurts. 2013. The skweezee system: enabling the design and the programming of squeeze interactions. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST'13). ACM, New York, NY, USA, 521--530.

Digital Library

[45]

Susan William, John Weinman, and Jeremy Dale. 1998. Doctor-patient communication and patient satisfaction: a review. In Family Practice 1998, 15: 480--492.

[46]

Peter M Yellowlees. 2005. Successfully developing a telemedicine system. Journal of Telemedicine and Telecare, 11(7), 331--335.

[47]

Zhengyou Zhang. 2012. Microsoft Kinect Sensor and Its Effect. In MultiMedia, IEEE 2012,19(2): 4--10.

Digital Library

[48]

Xinxin Zhu, and Amos Cahan. 2015. Wearable Technologies and Telehealth in Care Management for Chronic Illness. Springer International Publishing 2016.

Cited By

Karnatak NLoughrin BKuo TMateu-Silvernail OMedhi Thies IThies WJain M(2023) “Is it Even Giving the Correct Reading or Not?”: How Trust and Relationships Mediate Blood Pressure Management in IndiaACM Transactions on Computer-Human Interaction10.1145/360932730:6(1-27)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3609327
Turmo Vidal LMárquez Segura EWaern A(2023)Intercorporeal Biofeedback for Movement LearningACM Transactions on Computer-Human Interaction10.1145/358242830:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582428
Han DGeiskkovitch DYuan YMills CZhong CChen AStuerzlinger WNeustaedter C(2023)Dr.’s Eye: The Design and Evaluation of a Video Conferencing System to Support Doctor Appointments in Home SettingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581350(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581350
Show More Cited By

Index Terms

Doctor, Can You See My Squats?: Understanding Bodily Communication in Video Consultations for Physiotherapy
1. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

SoPhy: A Wearable Technology for Lower Limb Assessment in Video Consultations of Physiotherapy
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Physiotherapists are increasingly using video conferencing tools for their teleconsultations. Yet, the assessment of subtle differences in body movements remains a challenge. To support lower limb assessment in video consultations, we present SoPhy, a ...
Supporting Bodily Communication in Video-based Clinical Consultations
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Over the last two decades, video consultations have emerged as an effective practice to offer diagnostic and therapeutic advice to the patients living in rural and remote areas. This thesis aims to understand how bodily expressions such as eye gaze and ...
Unveiling High-speed Follow-up Consultation for Chronic Disease Treatment: A Pediatric Hospital Case in China
CSCW

In developing countries suffering from a severe shortage of physicians, the follow-up clinical consultation of long-term chronic care becomes a high-speed collaborative work, which has to be conducted in a few minutes. Although much existing work ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

June 2016

1374 pages

ISBN:9781450340311

DOI:10.1145/2901790

General Chair:
Marcus Foth
Queensland University of Technology
,
Program Chairs:
Wendy Ju
Stanford University
,
Ronald Schroeter
Queensland University of Technology
,
Stephen Viller
University of Queensland

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DIS '16

Sponsor:

SIGCHI

DIS '16: Designing Interactive Systems Conference 2016

June 4 - 8, 2016

QLD, Brisbane, Australia

Acceptance Rates

DIS '16 Paper Acceptance Rate 107 of 418 submissions, 26%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
689
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)6

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Karnatak NLoughrin BKuo TMateu-Silvernail OMedhi Thies IThies WJain M(2023) “Is it Even Giving the Correct Reading or Not?”: How Trust and Relationships Mediate Blood Pressure Management in IndiaACM Transactions on Computer-Human Interaction10.1145/360932730:6(1-27)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3609327
Turmo Vidal LMárquez Segura EWaern A(2023)Intercorporeal Biofeedback for Movement LearningACM Transactions on Computer-Human Interaction10.1145/358242830:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582428
Han DGeiskkovitch DYuan YMills CZhong CChen AStuerzlinger WNeustaedter C(2023)Dr.’s Eye: The Design and Evaluation of a Video Conferencing System to Support Doctor Appointments in Home SettingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581350(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581350
Bhat KKumar NShamanna KKwatra NJain M(2023)Towards Intermediated Workflows for Hybrid TelemedicineProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580653(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580653
Han DHeshmat YGeiskkovitch DTan ZNeustaedter C(2022)A Scenario-Based Study of Doctors and Patients on Video Conferencing Appointments from HomeACM Transactions on Computer-Human Interaction10.1145/351423429:5(1-35)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3514234
Semeraro ATurmo Vidal L(2022)Visualizing Instructions for Physical Training: Exploring Visual Cues to Support Movement Learning from Instructional VideosProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517735(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517735
Buckingham SSein KAnil KDemain SGunn HJones RKent BLogan AMarsden JPlayford EFreeman J(2022)Telerehabilitation for physical disabilities and movement impairment: A service evaluation in South West EnglandJournal of Evaluation in Clinical Practice10.1111/jep.1368928:6(1084-1095)Online publication date: 19-Apr-2022
https://doi.org/10.1111/jep.13689
Buckingham SAnil KDemain SGunn HJones RKent BLogan AMarsden JPlayford EFreeman J(2021)Telerehabilitation for people with physical disabilities and movement impairment: A survey of United Kingdom practitioners (Preprint)JMIRx Med10.2196/30516Online publication date: 18-May-2021
https://doi.org/10.2196/30516
Jones RHubble STaylor LGunn HLogan ARowland TBradwell HConnolly LAlgie KAnil KHalliday BHouston SDennett RChatfield SBuckingham SFreeman J(2021)Technologies to Support Assessment of Movement During Video Consultations: Exploratory StudyJMIRx Med10.2196/302332:3(e30233)Online publication date: 24-Sep-2021
https://doi.org/10.2196/30233
Groven KAhlsen BDahl-Michelsen T(2021)Psykomotorisk fysioterapi & covid-19: psykisk helse og samtaler på nye måterTidsskrift for psykisk helsearbeid10.18261/issn.1504-3010-2021-02-0718:2(149-161)Online publication date: 21-May-2021
https://doi.org/10.18261/issn.1504-3010-2021-02-07
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents