Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3558884.3558897acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiwoarConference Proceedingsconference-collections
research-article

Evaluating neurorehabilitation exercises captured with commodity sensors and machine-learning framework

Published: 05 January 2023 Publication History

Abstract

During the last decades, disease-related disabilities, primarily caused by stroke have increased worldwide. Neurorehabilitation exercise therapy plays a vital role in the recovery of such disabilities. However, due to global demographic changes and the increasing number of stroke patients, therapists are facing difficulties in coping with the demand. Consequently, the necessity for appropriate technical support to help the therapists for providing helpful progress feedback to the patients is becoming evident. So far, such technological systems are not yet available for clinical usage. Moreover, there is still a lack of research demonstrating the possibility of pursuing the therapeutic exercises by the patients themselves at their homes using non-invasive commodity sensors. In this work, we design a system pipeline containing commodity cameras by which the patients would be able to record their exercises at home; we also evaluate and analyze the acquired data using an off-the-shelf machine-learning framework. The medical experts can utilize our system to monitor the patients’ progress over the prescribed duration of the therapy. Here, rather than using specialized sensors with the body to acquire the movement information of the body joints, which some of the existing works use, we use a machine-learning framework to acquire this information. Our evaluation process demonstrates the situations in which these activities can be reliably acquired with commodity RGB cameras; moreover, the challenging aspects of the acquisition which can affect the accuracy of recognition of the framework are discussed and analyzed.

References

[1]
David Antón, Alfredo Goni, and Arantza Illarramendi. 2015. Exercise recognition for Kinect-based telerehabilitation. Methods of information in medicine 54, 02 (2015), 145–155.
[2]
Ilktan Ar and Yusuf Sinan Akgul. 2014. A computerized recognition system for the home-based physiotherapy exercises using an RGBD camera. IEEE Transactions on Neural Systems and Rehabilitation Engineering 22, 6(2014), 1160–1171.
[3]
Moez Baccouche, Franck Mamalet, Christian Wolf, Christophe Garcia, and Atilla Baskurt. 2011. Sequential deep learning for human action recognition. In International workshop on human behavior understanding. Springer, 29–39.
[4]
Judith Butepage, Michael J Black, Danica Kragic, and Hedvig Kjellstrom. 2017. Deep representation learning for human motion prediction and classification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6158–6166.
[5]
Christel Eickhof. 2001. Grundlagen der Therapie bei erworbenen Lähmungen. Pflaum.
[6]
Roshanak Houmanfar, Michelle Karg, and Dana Kulić. 2014. Movement analysis of rehabilitation exercises: Distance metrics for measuring patient progress. IEEE Systems Journal 10, 3 (2014), 1014–1025.
[7]
Tahir Hussain, Hafiz Farhan Maqbool, Nadeem Iqbal, Mukhtaj Khan, Salman, and Abbas A Dehghani-Sanij. 2019. Computational model for the recognition of lower limb movement using wearable gyroscope sensor. International Journal of Sensor Networks 30, 1 (2019), 35–45.
[8]
Grégoire Lefebvre, Samuel Berlemont, Franck Mamalet, and Christophe Garcia. 2013. BLSTM-RNN based 3D gesture classification. In International conference on artificial neural networks. Springer, 381–388.
[9]
Yalin Liao, Aleksandar Vakanski, and Min Xian. 2020. A deep learning framework for assessing physical rehabilitation exercises. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28, 2(2020), 468–477.
[10]
Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Guang Yong, Juhyun Lee, 2019. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172(2019).
[11]
Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16, 1 (2016), 115.
[12]
T Platz. 2004. Impairment-oriented training (IOT)–scientific concept and evidence-based treatment strategies. Restorative neurology and neuroscience 22, 3-5 (2004), 301–315.
[13]
Thomas Platz. 2006. IOT Impairment‐Oriented Training. Schädigungs‐orientiertes Training. Theorie und deutschsprachige Manuale für Therapie und Assessment. Arm‐BASIS‐Training, Arm‐Fähigkeits‐Training, Fugl‐Meyer test (Arm), TEMPA(1st. ed.). Deutscher Wissenschafts‐Verlag (DWV), Baden‐Baden.
[14]
Hiroaki Sakoe and Seibi Chiba. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE transactions on acoustics, speech, and signal processing 26, 1(1978), 43–49.
[15]
Chuan-Jun Su, Chang-Yu Chiang, and Jing-Yan Huang. 2014. Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic. Applied Soft Computing 22 (2014), 652–666.
[16]
Platz T, Elsner B, and Mehrholz J. 2015. Arm basis training and arm ability training: two impairment‐oriented exercise training techniques for improving arm function after stroke. Cochrane Database of Systematic Reviews9 (2015). https://doi.org/10.1002/14651858.CD011854
[17]
Md Zia Uddin and Ahmet Soylu. 2021. Human activity recognition using wearable sensors, discriminant analysis, and long short-term memory-based neural structured learning. Scientific Reports 11, 1 (2021), 1–15.
[18]
A Vakanski, JM Ferguson, and S Lee. 2016. Mathematical modeling and evaluation of human motions in physical therapy using mixture density neural networks. Journal of physiotherapy & physical rehabilitation 1, 4(2016).
[19]
Zhe Zhang, Qiang Fang, and Xudong Gu. 2015. Objective assessment of upper-limb mobility for poststroke rehabilitation. IEEE Transactions on Biomedical Engineering 63, 4 (2015), 859–868.
[20]
Zhe Zhang, Qiang Fang, Liuping Wang, and Peter Barrett. 2011. Template matching based motion classification for unsupervised post-stroke rehabilitation. In International Symp. on Bioelectronics and Bioinformations 2011. IEEE, 199–202.
[21]
Zoom. 2022. Zoom Video Communications. Retrieved June 25, 2020 from https://zoom.us

Cited By

View all
  • (2024)Towards Transforming Neurorehabilitation: The Impact of Artificial Intelligence on Diagnosis and Treatment of Neurological DisordersBiomedicines10.3390/biomedicines1210241512:10(2415)Online publication date: 21-Oct-2024

Index Terms

  1. Evaluating neurorehabilitation exercises captured with commodity sensors and machine-learning framework

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    iWOAR '22: Proceedings of the 7th International Workshop on Sensor-based Activity Recognition and Artificial Intelligence
    September 2022
    117 pages
    ISBN:9781450396240
    DOI:10.1145/3558884
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 January 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Machine Learning
    2. Neuro Rehabilitation Therapy
    3. Rehabilitation Exercise Recognition
    4. Sensor System

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • European Social Fund (ESF)

    Conference

    iWOAR '22

    Acceptance Rates

    Overall Acceptance Rate 46 of 73 submissions, 63%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)13
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Towards Transforming Neurorehabilitation: The Impact of Artificial Intelligence on Diagnosis and Treatment of Neurological DisordersBiomedicines10.3390/biomedicines1210241512:10(2415)Online publication date: 21-Oct-2024

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media