research-article

Patient-Tailored Augmented Reality Games for Assessing Upper Extremity Motor Impairments in Parkinson’s Disease and Stroke

Authors:

Paulina J. M. Bank,

Marina A. Cidota,

P. (Elma) W. Ouwehand,

Stephan G. LukoschAuthors Info & Claims

Journal of Medical Systems, Volume 42, Issue 12

https://doi.org/10.1007/s10916-018-1100-9

Published: 30 October 2018 Publication History

Abstract

In clinical practice, upper extremity motor impairments are commonly assessed with disease-specific, subjectively scored and low-resolution rating scales that often do not consider the variations in tasks and environment that are essential aspects of daily life. Augmented reality (AR) systems with contactless tracking of the hand and upper body offer opportunities for objective quantification of motor (dys)function in a challenging, engaging and patient-tailored environment. In this study, we explore the potential of AR for evaluating 1) speed and goal-directedness of movements within the individually determined interaction space, 2) adaptation of hand opening to objects of different sizes, and 3) obstacle avoidance in healthy individuals (N = 10) and two highly prevalent neurological conditions (N = 10 patients with Parkinson’s Disease and N = 10 stroke patients). We successfully implemented three AR games to evaluate these key aspects of motor function. As expected, PD patients moved slower than controls and needed more time for task completion. No differences were observed between stroke patients and controls, perhaps because motor impairments in this patient group were relatively mild. Importantly, usability of our AR system was good and considerably improved compared to our previous study due to more natural and patient-tailored interaction. Although our findings testify to the potential of AR for assessing motor impairments in patients with neurological conditions and provide starting points for further improvement, there are still many steps to be taken towards application in clinical practice.

References

[1]

Hondori, H.M., Khademi, M., Dodakian, L., Cramer, S.C., and Lopes, C.V., A spatial augmented reality rehab system for post-stroke hand rehabilitation. In: Medicine Meets Virtual Reality, pp 279–285, 2013.

[2]

Taske, A., Oppermann, L., Niemann, K., and Wilken, R., Design and Evaluation of a Stroke Rehabilitation Program. In: Virtuelle und Erweiterte Realität-12. Workshop der GI-Fachgruppe VR/AR. Shaker Verlag, pp 34–45, 2015.

[3]

Burke JW, McNeill M, Charles DK, Morrow PJ, Crosbie JH, and McDonough SM Optimising engagement for stroke rehabilitation using serious games Vis. Comput. 2009 25 12 1085

[4]

Luo, X., Kenyon, R.V., Kline, T., Waldinger, H.C., and Kamper, D.G., An augmented reality training environment for post-stroke finger extension rehabilitation. In: 9th International Conference on Rehabilitation Robotics (ICORR). IEEE, pp 329–332, 2005.

[5]

Shen, Y., Ong, S., and Nee, A., Hand rehabilitation based on augmented reality. In: Proceedings of the 3rd International Convention on Rehabilitation Engineering & Assistive Technology. ACM, p 23, 2009.

[6]

Alamri A, Cha J, and El Saddik A AR-REHAB: An augmented reality framework for poststroke-patient rehabilitation IEEE Trans. Instrum. Meas. 2010 59 10 2554-2563

[7]

Liu J, Mei J, Zhang X, Lu X, and Huang J Augmented reality-based training system for hand rehabilitation Multimedia Tools and Applications 2017 76 13 14847-14867

[8]

Khademi, M., Hondori, H.M., Lopes, C.V., Dodakian, L., and Cramer, S.C., Haptic augmented reality to monitor human arm's stiffness in rehabilitation. In: 2012 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES). IEEE, pp 892–895, 2012.

[9]

Khademi, M., Mousavi Hondori, H., McKenzie, A., Dodakian, L., Lopes, C.V., and Cramer, S.C., Comparing direct and indirect interaction in stroke rehabilitation. In: CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 1639–1644, 2014.

[10]

Mousavi Hondori H, Khademi M, Dodakian L, McKenzie A, Lopes CV, and Cramer SC Choice of human–computer interaction mode in stroke rehabilitation Neurorehabil. Neural Repair 2016 30 3 258-265

[11]

Sousa, M., Vieira, J., Medeiros, D., Arsenio, A., and Jorge, J., SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback. In: Proceedings of the 21st International Conference on Intelligent User Interfaces. ACM, pp 175–185, 2016.

[12]

Da Gama AEF, Chaves TM, Figueiredo LS, Baltar A, Meng M, Navab N, Teichrieb V, and Fallavollita P MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system Comput. Methods Prog. Biomed. 2016 135 105-114

[13]

Regenbrecht, H., McGregor, G., Ott, C., Hoermann, S., Schubert, T., Hale, L., Hoermann, J., Dixon, B., and Franz, E., Out of reach?—A novel AR interface approach for motor rehabilitation. In: 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, pp 219–228, 2011.

[14]

Khademi, M., Mousavi Hondori, H., McKenzie, A., Dodakian, L., Lopes, C.V., and Cramer, S.C., Free-hand interaction with leap motion controller for stroke rehabilitation. In: CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 1663–1668, 2014.

[15]

Cidota, M.A., Bank, P.J.M., Ouwehand, P.W., and Lukosch, S.G., Assessing Upper Extremity Motor Dysfunction Using an Augmented Reality Game. In: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, pp 144–154, 2017.

[16]

Cidota, M.A., Lukosch, S.G., Bank, P.J.M., and Ouwehand, P.W., Towards Engaging Upper Extremity Motor Dysfunction Assessment Using Augmented Reality Games. In: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). IEEE, pp 275–278, 2017.

[17]

Hoehn MM and Yahr MD Parkinsonism: onset, progression, and mortality Neurology 1998 50 2 318-318

[18]

Marinus J, Visser M, Stiggelbout AM, Rabey JM, Martínez-Martín P, Bonuccelli U, Kraus PH, and van Hilten JJ A short scale for the assessment of motor impairments and disabilities in Parkinson’s disease: the SPES/SCOPA J. Neurol. Neurosurg. Psychiatry 2004 75 3 388-395

[19]

van Swieten J C, Koudstaal P J, Visser M C, Schouten H J, and van Gijn J Interobserver agreement for the assessment of handicap in stroke patients Stroke 1988 19 5 604-607

[20]

Fugl-Meyer AR, Jääskö L, Leyman I, Olsson S, and Steglind S The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance Scand. J. Rehabil. Med. 1975 7 1 13-31

[21]

Hart, S.G., and Staveland, L.E., Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Advances in psychology, vol 52. Elsevier, pp 139–183, 1988.

[22]

IJsselsteijn, W., van den Hoogen, W., Klimmt, C., De Kort, Y., Lindley, C., Mathiak, K., Poels, K., Ravaja, N., Turpeinen, M., Vorderer, P., Measuring the experience of digital game enjoyment. In: Proceedings of Measuring Behavior, 2008. Noldus Information Tecnology Wageningen, Netherlands, pp 88–89, 2008.

[23]

IJsselsteijn WA, de Kort YAW, and Poels K The Game Experience Questionnaire 2013 Eindhoven Technische Universiteit Eindhoven

[24]

Brooke J SUS-A quick and dirty usability scale Usability Evaluation in Industry 1996 189 194 4-7

[25]

Gandy, M., Catrambone, R., MacIntyre, B., Alvarez, C., Eiriksdottir, E., Hilimire, M., Davidson, B., and McLaughlin, A.C., Experiences with an AR evaluation test bed: Presence, performance, and physiological measurement. In: 2010 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, pp 127–136, 2010.

[26]

Cidota, M. A., Lukosch, S. G., Dezentje, P., Bank, P. J.M., Lukosch, H. K., and Clifford, R. M., Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions. I-Com 15(2):155–169, 2016.

[27]

Field, A., Discovering statistics using IBM SPSS statistics. London, UK: SAGE Publications, 2013.

[28]

Marsden C Slowness of movement in Parkinson's disease Movement Disorders: Official Journal of the Movement Disorder Society 1989 4 S1 S26-S37

[29]

Bootsma RJ, Marteniuk RG, MacKenzie CL, and Zaal FT The speed-accuracy trade-off in manual prehension: effects of movement amplitude, object size and object width on kinematic characteristics Exp. Brain Res. 1994 98 3 535-541

[30]

Richard P, Birebent G, Coiffet P, Burdea G, Gomez D, and Langrana N Effect of frame rate and force feedback on virtual object manipulation Presence: Teleoperators & Virtual Environments 1996 5 1 95-108

[31]

Levin MF, Magdalon EC, Michaelsen SM, and Quevedo AA Quality of grasping and the role of haptics in a 3-D immersive virtual reality environment in individuals with stroke IEEE Transactions on Neural Systems and Rehabilitation Engineering 2015 23 6 1047-1055

[32]

Magdalon EC, Michaelsen SM, Quevedo AA, and Levin MF Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment Acta Psychol. 2011 138 1 126-134

Cited By

Wang QLuo CYang SXu SYang YJia JYu B(2024)MRehab: A Mixed Reality Rehabilitation System Supporting Integrated Speech and Hand TrainingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785328:3(1-23)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678532
Tychola KVoulgaridis KLagkas T(2023)Tactile IoT and 5G & beyond schemes as key enabling technologies for the future metaverseTelecommunications Systems10.1007/s11235-023-01052-y84:3(363-385)Online publication date: 15-Sep-2023
https://dl.acm.org/doi/10.1007/s11235-023-01052-y
Evans JTsaneva-Atanasova KBuckingham G(2023)Using immersive virtual reality to remotely examine performance differences between dominant and non-dominant handsVirtual Reality10.1007/s10055-023-00794-z27:3(2211-2226)Online publication date: 6-May-2023
https://dl.acm.org/doi/10.1007/s10055-023-00794-z
Show More Cited By

Index Terms

Patient-Tailored Augmented Reality Games for Assessing Upper Extremity Motor Impairments in Parkinson’s Disease and Stroke

Index terms have been assigned to the content through auto-classification.

Recommendations

Augmented Reality Games for Upper-Limb Stroke Rehabilitation
VS-GAMES '10: Proceedings of the 2010 Second International Conference on Games and Virtual Worlds for Serious Applications

Stroke is the number one cause of severe physical disability in the UK. Recent studies have shown that technologies such as virtual reality and imaging can provide an engaging and motivating tool for physical rehabilitation. In this paper we summarize ...
Designing for Engagement in Augmented Reality Games to Assess Upper Extremity Motor Dysfunctions
ISMAR-MASHD '15: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design

Currently, each medical discipline involved in assessing motor disorders in various patient groups is using subjectively scored clinical tests, qualitative video analysis, or cumbersome marker-based motion capturing. This extended abstract investigates ...
Effects of upper limb robot-assisted rehabilitation on motor function recovery and neuromuscular electrophysiological changes of stroke patients
RobCE '22: Proceedings of the 2022 2nd International Conference on Robotics and Control Engineering

[Objective] To evaluate the effect of bilateral upper limb robot-assisted rehabilitation on upper extremity motor function recovery and neuromuscular electrophysiological changes in stroke patients, compared to the routine therapy. [Methods] Forty ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Medical Systems

Journal of Medical Systems Volume 42, Issue 12

Nov 2018

323 pages

ISSN:0148-5598

Issue’s Table of Contents

© The Author(s) 2018.

Publisher

Plenum Press

United States

Publication History

Published: 30 October 2018

Accepted: 09 October 2018

Received: 04 July 2018

Author Tags

Qualifiers

Research-article

Funding Sources

Netherlands Organisation for Scientific Research

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang QLuo CYang SXu SYang YJia JYu B(2024)MRehab: A Mixed Reality Rehabilitation System Supporting Integrated Speech and Hand TrainingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785328:3(1-23)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678532
Tychola KVoulgaridis KLagkas T(2023)Tactile IoT and 5G & beyond schemes as key enabling technologies for the future metaverseTelecommunications Systems10.1007/s11235-023-01052-y84:3(363-385)Online publication date: 15-Sep-2023
https://dl.acm.org/doi/10.1007/s11235-023-01052-y
Evans JTsaneva-Atanasova KBuckingham G(2023)Using immersive virtual reality to remotely examine performance differences between dominant and non-dominant handsVirtual Reality10.1007/s10055-023-00794-z27:3(2211-2226)Online publication date: 6-May-2023
https://dl.acm.org/doi/10.1007/s10055-023-00794-z
Arlati SMondellini MGuanziroli ERossini MMartinelli IMolteni F(2023)Virtual Reality-Based Rehabilitation for Patients with Stroke: Preliminary Results on User ExperienceExtended Reality10.1007/978-3-031-43404-4_30(441-453)Online publication date: 6-Sep-2023
https://dl.acm.org/doi/10.1007/978-3-031-43404-4_30
Campo-Prieto PCancela JRodríguez-Fuentes G(2021)Immersive virtual reality as physical therapy in older adults: present or future (systematic review)Virtual Reality10.1007/s10055-020-00495-x25:3(801-817)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1007/s10055-020-00495-x
Garcia-Hernandez NGuzman-Alvarado MParra-Vega V(2021)Virtual body representation for rehabilitation influences on motor performance of cerebral palsy childrenVirtual Reality10.1007/s10055-020-00481-325:3(669-680)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1007/s10055-020-00481-3

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents