Abstract
Human identification plays a prominent role in terms of security. In modern times security is becoming the key term for an individual or a country, especially for countries which are facing internal or external threats. Gait analysis is interpreted as the systematic study of the locomotive in humans. It can be used to extract the exact walking features of individuals. Walking features depends on biological as well as the physical feature of the object; hence, it is unique to every individual. In this work, gait features are used to identify an individual. The steps involve object detection, background subtraction, silhouettes extraction, skeletonization, and training 3D Convolution Neural Network (3D-CNN) on these gait features. The model is trained and evaluated on the dataset acquired by CASIA—B Gait, which consists of 15,000 videos of 124 subjects’ walking pattern captured from 11 different angles carrying objects such as bag and coat. The proposed method focuses more on the lower body part to extract features such as the angle between knee and thighs, hip angle, angle of contact, and many other features. The experimental results are compared with amongst accuracies of silhouettes as datasets for training and skeletonized image as training data. The results show that extracting the information from skeletonized data yields improved accuracy.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Akman O, Alatan AA, Çiloglu T (2008) Multi-camera visual surveillance for motion detection, occlusion handling, tracking and event recognition. In: workshop on multi-camera and multi-modal sensor fusion algorithms
Angra S, Ahuja S (2017) Machine learning and its application. IEEE. https://doi.org/10.1109/ICBDACI.2017.8070809
Ariyanto G, Nixon MS (2011) Model-based 3D gait biometrics. In: 2011 international joint conference on biometrics (IJCB)
Blanke DJ, Hageman PA (1989) Comparison of gait of young men and elderly men. Phys Ther 69(2):144–148
Bobick F, Johnson AY (2001) Gait recognition using static activity-specific parameters. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:423–430
Boudaoud LB, Sider A, Tari A (2015) A new thinning algorithm for binary images. In: 2015 3rd international conference on control, engineering & information technology (CEIT), p 1–6. Doi: https://doi.org/10.1109/CEIT.2015.7233099.
Boulgouris NV, Chi ZX (2007) Gait recognition using radon transform and linear discriminant analysis. IEEE Trans Image Process 16(3):731–740
Chuang J-H, Tsai C-H, Ko M-C (2000) Skeletonisation of three dimensional object using generalized potential field. IEEE Trans Patterns Anal Mach Learn. https://doi.org/10.1109/34.888709
Cutting JE, Kozlowski LT (1977) Recognizing friends by their walk: gait perception without familiarity cues. Bull Psychon Soc 9(5):353–6
El-Alfy H, Mitsugami I, Yagi Y (2014) A new gait-based identification method using local Gauss maps. In: Asian conference on computer vision. Springer, Cham, p 3–18
Fleuret F, Berclaz J, Lengagne R, Fua P (2008) Multicamera people tracking with a probabilistic occupancy map. IEEE Trans Pattern Anal Mach Intell 30(2):267–282
Geng X, Zhou ZH, Smith-Miles K (2008) Individual stable space: an approach to face recognition under uncontrolled conditions. IEEE Trans Neural Netw 19(8):1354–1368
Gu J, Ding X, Wang S, Wu Y (2010) Action and gait recognition from recovered 3-D human joints. IEEE Trans Syst Man Cybern B Cybern 40(4):1021–1033
Guha T, Ward R (2010) Differential radon transform for gait recognition. In: 2010 IEEE international conference on acoustics, speech and signal processing, p 834-837
Han J, Bhanu B (2006) Individual recognition using gait energy image. IEEE Trans PAMI 28(2):316–322
Jagna A (2014) An efficient image independent thinning algorithm. Int J Adv Res Comp Commun Eng 3(10):8309–8311
Ji S, Xu W, Yang M (2012) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2012.59
Johansson G (1975) Visual motion perception. Sci Am 232:6
Kumar AN, Sureshkumar C (2013) Background subtraction based on threshold detection using modified k-means algorithm. In: 2013 international conference on pattern recognition, informatics and mobile engineering 2013. Doi: https://doi.org/10.1109/ICPRIME.2013.6496505
Kusakunniran W, Wu Q, Zhang J, Ma Y, Li H (2013) A new view-invariant feature for cross-view gait recognition. IEEE Trans Inf Forensics Secur 8(10):1642–1653
Lee J (2017) Analysis of precision and accuracy in a simple model of machine learning. J Korean Phys Soc 71(12):866–870
Lee H, Kim H, Kim JI (2016) Background subtraction using background sets with image-and color-space reduction. IEEE Trans Multimed 18(10):2093–2103. https://doi.org/10.1109/TMM.2016.2595262
Lpuridas P, Ebert C (2016) Machine learning. IEEE Softw. https://doi.org/10.1109/MS.2016.114
Luo J, Lin S, Ni J, Lei M (2008) An improved fingerprint recognition algorithm using EBFNN. In: 2008 second international conference on genetic and evolutionary computing. IEEE conference, p 504-507
Manjunatha Guru VG, Kamalesh VN (2011) Vision based human gait recognition system: observations, pragmatic conditions and datasets. Indian J Sci Technol 8(15):71237
Mittal A, Davis LS (2003) M 2 tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. Int J Comp Vis 51(3):189–203
Mohamed SS, Tahir NM, Adnan R (2010) Background modelling and background subtraction performance for object detection. In: 2010 6th international colloquium on signal processing & its applications, Mallaca City, Mallaysia. Doi: https://doi.org/10.1109/CSPA.2010.5545291
Nithyakani P, Vinothini S, Ganapathy V (2017) Gait analysis for better prediction of silhouettes using wavelet transformation 116(23): 391–397. ISSN: 1311-8080 (printed version)
Nixon S, Tan T, Chellappa R (2006) Human identification based on gait. Springer, New York
Rathod VJ, Iyer NC, Meena SM (2015) “A survey on fingerprint biometric recognition system”. In: 2015 international conference on green computing and internet of things (ICGIoT)
Stevenage SV, Nixon MS, Vince K (1999) Visual analysis of gait as a cue to identity. Appl Cogn Psychol 13:513
Tathe SV, Narote SP (2013) Real-time human detection and tracking. In: 2013 annual IEEE India conference (INDICON) 2013, Mumbai, India
Vladimir M (2018) Petrovic, “artificial intelligence and virtual worlds—toward human-level AI agents.” IEEE. https://doi.org/10.1109/ACCESS.2018.2855970
Wang X (2013) Intelligent multi-camera video surveillance: a review. Pattern Recogn Lett 34(1):3–19
Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell 25(12):1505–1518
Wang L, Tan T, Hu W, Ning H (2003) Automatic gait recognition based on statistical shape analysis. IEEE Trans Image Process 12(9):1120–1131
Wang C, Zhang J, Pu J, Yuan X, Wang L (2010) Chrono-gait image: a novel temporal template for gait recognition—ECCV. Springer, Berlin, pp 257–270
Whittle MW (1996) Clinical gait analysis: a review. Human Mov Sci 15:369
Wu Z, Huang Y, Wang L, Wang X, Tan T (2016) A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Trans Pattern Anal Mach Intell 39(2):209–226
Yang M, Lv F, Xu W, Gong Y (2009) Detection driven adaptive multi-cue integration for multiple human tracking. In: 2009 IEEE 12th International Conference on Computer Vision, p 1554–1561
Yao G, Lei T, Zhong J, Jiang P, Jia W (2017) Comparative evaluation of background subtraction algorithm in remote scene video captured by MWIR. Sensors 17:1945. https://doi.org/10.3390/s17091945
Zhang Y, Yang N, Lio W, Wuo X, Ruan Q (2009) Gait recognition using procrustes shape analysis and shape context" in computer Vision ACCV. Springer, Berlin, pp 256–265
Zhang S, Wang C, Chan SC, Wei X, Ho CH (2014) New object detection, tracking, and recognition approaches for video surveillance over camera network. IEEE Sens J 15(5):2679–2691
Zhang Y, Li X, Gao X, Zhang C (2016) A simple algorithm of superpixel segmentation with boundary constraint. IEEE Trans Circuits Syst Video Tech 27(7):1502–1514. https://doi.org/10.1109/TCSVT2016.2539839
Zheng S, Zhang J, Huang K, He R, Tan T (2011) Robust view transformation model for gait recognition. In: 2011 18th IEEE international conference on image processing (ICIP)
Acknowledgements
This research was supported by High Performance Computing Centre (HPCC), SRM Institute of Science and Technology for providing the computational facility for training, testing and obtaining the desired result. We thank Centre for Biometrics and Security Research (CASIA) for providing the dataset which consist of 15000+ video of 124 object walking in different angles.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Supraja, P., Tom, R.J., Tiwari, R.S. et al. 3D convolution neural network-based person identification using gait cycles. Evolving Systems 12, 1045–1056 (2021). https://doi.org/10.1007/s12530-021-09397-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12530-021-09397-y