Abstract
The gap between machine learning-assisted digital processing and modern scientific analysis has been closed by advances in computer vision technologies. In the realm of biomechanics, tactics that combine traditional and machine-assisted methods have demonstrated remarkable effectiveness in enhancing the electromyographical sensor observations; nevertheless, these methods are limited by specialized, multi-source arrays. This work is an effort to apply multiple different technologies to a single optical sensor in order to obtain comparable outcomes. The goal of this work is to provide an overview of the research, development, and use of a monocular feature extraction pipeline that can be used to enhance current sports biomechanics analysis. We will look at the methods that related publications have provided and how we have incorporated these approaches into our framework.
References
Ng, K. D., Mehdizadeh, S., Iaboni, A., Mansfield, A., Flint, A., & Taati, B. (2020). Measuring gait variables using computer vision to assess mobility and fall risk in older adults with dementia. IEEE Journal of Translational Engineering in Health and Medicine, 8, 2100609.
Dolatabadi, E., Taati, B., & Mihailidis, A. (2017). An automated classification of pathological gait using unobtrusive sensing technology. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, 2336–2346.
Khera, P., & Kumar, N. (2020). Role of machine learning in gait analysis: A review. Journal of Medical Engineering and Technology, 44, 441–467.
Ortells, J., Herrero-Ezquerro, M. T., & Mollineda, R. A. (2018). Vision-based gait impairment analysis for aided diagnosis. Medical and Biological Engineering and Computing, 56, 1553–1564.
Zakaria, N. K. (2020). ASD children gait classification based on principal component analysis and linear discriminant analysis. International Journal of Emerging Trends in Engineering Research, 8, 2438–2445.
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005). Scape: shape completion and animation of people. ACM Transactions on Graphics, 24, 408–416.
Arnab, A., Doersch, C., Zisserman, A. (2019). Exploiting temporal context for 3d human pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3395–3404.
Belagiannis, V., Zisserman, A. (2017). Recurrent human pose estimation. In: 12th IEEE international conference on automatic face & gesture recognition (FG 2017), pp. 468–475.
Chen, B., Chen, C., Hu, J., Sayeed, Z., Qi, J., Darwiche, H. F., Little, B. E., Lou, S., Darwish, M., Foote, C., et al. (2022). Computer vision and machine learning-based gait pattern recognition for flat fall prediction. Sensors, 22(20), 7960. https://doi.org/10.3390/s22207960
Colyer, S. L., Evans, M., Cosker, D. P., et al. (2018). A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Medicine - Open, 4, 24. https://doi.org/10.1186/s40798-018-0139-y
Chena, Y., Tianb, Y., & Hea, M. (2020). Monocular human pose estimation: a survey of deep learning-based methods. Computer Vision and Image Understanding, 192, 102897.
Hellsten, T., Karlsson, J., Shamsuzzaman, M., & Pulkkis, G. (2021). The potential of computer vision-based marker-less human motion analysis for rehabilitation. Rehabilitation Process and Outcome. https://doi.org/10.1177/11795727211022330
Rill, R. A., & Faragó, K. B. (2021). Collision avoidance using deep learning-based monocular vision. SN Computer Science, 2, 375. https://doi.org/10.1007/s42979-021-00759-6
Khan, F., Salahuddin, S., & Javidnia, H. (2020). Deep learning-based monocular depth estimation methods—a state-of-the-art review. Sensors, 20(8), 2272. https://doi.org/10.3390/s20082272
Harris, E. J., Khoo, H., & Demircan, E. (2021). A survey of human gait-based artificial intelligence applications. Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2021.749274
Wang, H., Ban, X., Ding, F., Xiao, Y., & Zhou, J. (2020). Monocular VO based on deep siamese convolutional neural network. Hindawi Complexity. https://doi.org/10.1155/2020/6367273
Ostrek, M., Rhodin, H., Fua, P., Müller, E., & Spörri, J. (2019). Are existing monocular computer vision-based 3D motion capture approaches ready for deployment? A methodological study on the example of alpine skiing. Sensors, 19(19), 4323. https://doi.org/10.3390/s19194323
Mehrizi, R., Xi Peng, XuXu., Zhang, S., & Li, K. (2019). A deep neural network-based method for estimation of 3D lifting motions. Journal of Biomechanics, 84, 87–93.
Abuella, H., Miramirkhani, F., Ekin, S., Uysal, M., & Ahmed, S. (2019). Vildar-visible light sensing based speed estimation using vehicle’s headlamps. IEEE Transaction on Vehicular Technology. https://doi.org/10.1109/TVT.2019.2941705
Afzal, S., Chen, J., Ramakrishnan, K. K. (2017). Characterization of 360-degree videos. In: Proceedings of the workshop on virtual reality and augmented reality network, ACM, New York. pp. 1–6, https://doi.org/10.1145/3097895.3097896.
Aichinger, C., Nitsche, P., Stütz, R., & Harnisch, M. (2016). Using low-cost smartphone sensor data for locating crash risk spots in a road network. Transportation Research Procedia, 14, 2015–24. https://doi.org/10.1016/j.trpro.2016.05.169
Clark, R., Wang, S., & Wen, H. (2017). VINet: Visual-inertial odometry as a sequence-to-sequence learning problem. In: Proceedings of the 31st AAAI conference on artificial intelligence, pp. 3995–4001, San Francisco, CA, USA.
Scaramuzza, D., & Fraundorfer, F. (2011). Visual odometry (tutorial). IEEE Robotics and Automation Magazine, 18(4), 80–92.
Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 39(6), 1137–1149.
Funding
There is no funding support in this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
All authors do not have any conflict of interest.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chakravarty, S., Kumar, A., Hales, M. et al. Machine Learning and Computer Visualization for Monocular Biomechanical Analysis. Wireless Pers Commun 135, 2131–2144 (2024). https://doi.org/10.1007/s11277-024-11116-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-024-11116-0