Nothing Special   »   [go: up one dir, main page]

Skip to main content

Advertisement

Log in

Machine Learning and Computer Visualization for Monocular Biomechanical Analysis

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

The gap between machine learning-assisted digital processing and modern scientific analysis has been closed by advances in computer vision technologies. In the realm of biomechanics, tactics that combine traditional and machine-assisted methods have demonstrated remarkable effectiveness in enhancing the electromyographical sensor observations; nevertheless, these methods are limited by specialized, multi-source arrays. This work is an effort to apply multiple different technologies to a single optical sensor in order to obtain comparable outcomes. The goal of this work is to provide an overview of the research, development, and use of a monocular feature extraction pipeline that can be used to enhance current sports biomechanics analysis. We will look at the methods that related publications have provided and how we have incorporated these approaches into our framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. Ng, K. D., Mehdizadeh, S., Iaboni, A., Mansfield, A., Flint, A., & Taati, B. (2020). Measuring gait variables using computer vision to assess mobility and fall risk in older adults with dementia. IEEE Journal of Translational Engineering in Health and Medicine, 8, 2100609.

    Article  Google Scholar 

  2. Dolatabadi, E., Taati, B., & Mihailidis, A. (2017). An automated classification of pathological gait using unobtrusive sensing technology. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, 2336–2346.

    Article  Google Scholar 

  3. Khera, P., & Kumar, N. (2020). Role of machine learning in gait analysis: A review. Journal of Medical Engineering and Technology, 44, 441–467.

    Article  Google Scholar 

  4. Ortells, J., Herrero-Ezquerro, M. T., & Mollineda, R. A. (2018). Vision-based gait impairment analysis for aided diagnosis. Medical and Biological Engineering and Computing, 56, 1553–1564.

    Article  Google Scholar 

  5. Zakaria, N. K. (2020). ASD children gait classification based on principal component analysis and linear discriminant analysis. International Journal of Emerging Trends in Engineering Research, 8, 2438–2445.

    Article  Google Scholar 

  6. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005). Scape: shape completion and animation of people. ACM Transactions on Graphics, 24, 408–416.

    Article  Google Scholar 

  7. Arnab, A., Doersch, C., Zisserman, A. (2019). Exploiting temporal context for 3d human pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3395–3404.

  8. Belagiannis, V., Zisserman, A. (2017). Recurrent human pose estimation. In: 12th IEEE international conference on automatic face & gesture recognition (FG 2017), pp. 468–475.

  9. Chen, B., Chen, C., Hu, J., Sayeed, Z., Qi, J., Darwiche, H. F., Little, B. E., Lou, S., Darwish, M., Foote, C., et al. (2022). Computer vision and machine learning-based gait pattern recognition for flat fall prediction. Sensors, 22(20), 7960. https://doi.org/10.3390/s22207960

    Article  Google Scholar 

  10. Colyer, S. L., Evans, M., Cosker, D. P., et al. (2018). A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Medicine - Open, 4, 24. https://doi.org/10.1186/s40798-018-0139-y

    Article  Google Scholar 

  11. Chena, Y., Tianb, Y., & Hea, M. (2020). Monocular human pose estimation: a survey of deep learning-based methods. Computer Vision and Image Understanding, 192, 102897.

    Article  Google Scholar 

  12. Hellsten, T., Karlsson, J., Shamsuzzaman, M., & Pulkkis, G. (2021). The potential of computer vision-based marker-less human motion analysis for rehabilitation. Rehabilitation Process and Outcome. https://doi.org/10.1177/11795727211022330

    Article  Google Scholar 

  13. Rill, R. A., & Faragó, K. B. (2021). Collision avoidance using deep learning-based monocular vision. SN Computer Science, 2, 375. https://doi.org/10.1007/s42979-021-00759-6

    Article  Google Scholar 

  14. Khan, F., Salahuddin, S., & Javidnia, H. (2020). Deep learning-based monocular depth estimation methods—a state-of-the-art review. Sensors, 20(8), 2272. https://doi.org/10.3390/s20082272

    Article  Google Scholar 

  15. Harris, E. J., Khoo, H., & Demircan, E. (2021). A survey of human gait-based artificial intelligence applications. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2021.749274

    Article  Google Scholar 

  16. Wang, H., Ban, X., Ding, F., Xiao, Y., & Zhou, J. (2020). Monocular VO based on deep siamese convolutional neural network. Hindawi Complexity. https://doi.org/10.1155/2020/6367273

    Article  Google Scholar 

  17. Ostrek, M., Rhodin, H., Fua, P., Müller, E., & Spörri, J. (2019). Are existing monocular computer vision-based 3D motion capture approaches ready for deployment? A methodological study on the example of alpine skiing. Sensors, 19(19), 4323. https://doi.org/10.3390/s19194323

    Article  Google Scholar 

  18. Mehrizi, R., Xi Peng, XuXu., Zhang, S., & Li, K. (2019). A deep neural network-based method for estimation of 3D lifting motions. Journal of Biomechanics, 84, 87–93.

    Article  Google Scholar 

  19. Abuella, H., Miramirkhani, F., Ekin, S., Uysal, M., & Ahmed, S. (2019). Vildar-visible light sensing based speed estimation using vehicle’s headlamps. IEEE Transaction on Vehicular Technology. https://doi.org/10.1109/TVT.2019.2941705

    Article  Google Scholar 

  20. Afzal, S., Chen, J., Ramakrishnan, K. K. (2017). Characterization of 360-degree videos. In: Proceedings of the workshop on virtual reality and augmented reality network, ACM, New York. pp. 1–6, https://doi.org/10.1145/3097895.3097896.

  21. Aichinger, C., Nitsche, P., Stütz, R., & Harnisch, M. (2016). Using low-cost smartphone sensor data for locating crash risk spots in a road network. Transportation Research Procedia, 14, 2015–24. https://doi.org/10.1016/j.trpro.2016.05.169

    Article  Google Scholar 

  22. Clark, R., Wang, S., & Wen, H. (2017). VINet: Visual-inertial odometry as a sequence-to-sequence learning problem. In: Proceedings of the 31st AAAI conference on artificial intelligence, pp. 3995–4001, San Francisco, CA, USA.

  23. Scaramuzza, D., & Fraundorfer, F. (2011). Visual odometry (tutorial). IEEE Robotics and Automation Magazine, 18(4), 80–92.

    Article  Google Scholar 

  24. Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 39(6), 1137–1149.

    Google Scholar 

Download references

Funding

There is no funding support in this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arun Kumar.

Ethics declarations

Conflict of Interest

All authors do not have any conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chakravarty, S., Kumar, A., Hales, M. et al. Machine Learning and Computer Visualization for Monocular Biomechanical Analysis. Wireless Pers Commun 135, 2131–2144 (2024). https://doi.org/10.1007/s11277-024-11116-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-024-11116-0

Keywords

Navigation