Abstract
Human identification by gait analysis has attracted a great deal of interest in the computer vision and forensics communities as an unobtrusive technique that is capable of recognizing humans at range. In recent years, significant progress has been made, and a number of approaches capable of this task have been proposed and developed. Among them, approaches based on single source features are the most popular. However, the recognition rate of these methods is often unsatisfactory due to the lack of information contained in single feature sources. Consequently, in this paper, a hierarchal and multi-featured fusion approach is proposed for effective gait recognition. In practice, using more features for fusion does not necessarily mean a better recognition rate and features should in fact be carefully selected such that they are complementary to each other. Here, complementary features are extracted in three groups: Dynamic Region Area; Extension and Space features; and 2D Stick Figure Model features. To balance the proportion of features used in fusion, a hierarchical feature-level fusion method is proposed. Comprehensive results of applying the proposed techniques to three well-known datasets have demonstrated that our fusion-based approach can improve the overall recognition rate when compared to a benchmark algorithm.
Similar content being viewed by others
References
Choudhury DS, Tjahjadi T (2013) Gait recognition based on shape and motion analysis of silhouette contours. Comput Vis Image Underst 117(12):1770–1785
Dadashi F, Araabi BN, Soltanian-Zadeh H (2009) Gait recognition using Wavelet packet silhouette representation and transductive support vector machines. In: Proceedings of the 2nd international congress on image and signal processing, pp 1–5
Ichino M, Kasahara H, Yoshii H et al (2013) A study on gait recognition using LPC cepstrum for mobile terminal. In: Proceedings of the IEEE/ACIS 12th international conference on computer and information science, pp 11–16
Hayfron-Acquah JB, Nixon MS, Carter JN (2003) Automatic gait recognition by symmetry analysis. Pattern Recognit Lett 24(13):2175–2183
Cunado D, Nixon MS, Carter JN (2003) Automatic extraction and description of human gait models for recognition purposes. Comput Vis Image Underst 90(1):1–41
Lee L, Grimson WEL (2002) Gait analysis for recognition and classification. In: Proceedings of the 5th IEEE international conference on automatic face and gesture recognition, pp 155–162
Zhang R, Vogler C, Metaxas D (2007) Human gait recognition at sagittal plane. Image Vis Comput 25(3):321–330
Zheng H, Zhang K (2013) Decision fusion gait recognition based on bayesian rule and support vector machine. Appl Mech Mater 411:1287–1290
Yu G, Li C, Hu Y (2012) Gait recognition under carrying condition: a static dynamic fusion method. In: Proceedings of the International Society for Optical Engineering, V 8436
Fu Y, Cao L, Guo G, Huang T (2008) Multiple feature fusion by subspace learning. In: Proceedings of the ACM conference on content-based image and video retrieval, pp 127–134
Liu W, Tao D (2013) Multiview Hessian regularization for image annotation. IEEE Trans Image Process 22(7):2676–2687
Liu Z, Sarkar S (2004) Simplest representation yet for gait recognition: averaged silhouette. In: Proceedings of the 17th international conference on pattern recognition (ICPR). 4:211–214
Jiang J, Chen F, Zhang G (2011) Fusion of multi-region features for gait recognition. Comput Eng Appl 47(7):159–161
Chai Y, Wang Q, Jia J, Zhao R (2006) A novel gait recognition method via fusing shape and kinematics features. Lect Notes Comput Sci, 4291:80–89, Lake Tahoe, NV, USA
Yoo JH, Nixon MS (2003) On laboratory gait analysis via vomputer vision. In: Proceedings of the international symposium on biologically-inspired machine vision, theory and application. Aberystwyth, UK, pp 109–113
Chai Y, Wang Q, Jia J, Zhao R (2006) A novel human gait recognition method by segmenting and extracting the region variance feature. In: Proceedings of the 18th international conference on pattern recognition, pp 425–428, Hong Kong
Cuntoor N, Kale A, Chellappa R (2003) Combining multiple evidences for gait recognition. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing, vol 3, pp 33–36
Phillips PJ, Moon H, Rizvi SA, Rause PJ (2000) The FERET evaluation methodology for face recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104
Sarkar S, Phillips PJ, Liu Z, Vega IR, Grother P, Bowyer KW (2005) The humanID gait challenge problem: data sets, performance, and analysis. IEEE Trans Pattern Anal Mach Intell 27(2):162–177
Sunderesan A, Roy Chowdhury AK, Chellappa R (2003) A hidden Markov model based framework for recognition of humans from gait sequences. In: Proceedings of IEEE international conference on image processing
Tolliver D, Collins R (2003) Gait shape estimation for identification. In: Proceedings of international conference on audio- and video-based biometric person authentication
Lee L, Dalley G, Tieu K (2003) Learning pedestrian models for silhouette refinement. In: Proceedings of the international conference on computer vision
Venkat I, Wilde PD (2011) Robust gait recognition by learning and exploiting sub-gait characteristics. Int J Comput Vis 91:7–23
Chai Y, Ren J, Zhao R, Jia J (2006) Automatic gait recognition using dynamic variance features. In: Proceedings of the 7th international conference on automatic face and gesture recognition, Southampton, U.K., pp 475–480
Lu J, Tan Y-P (2010) Gait-based human age estimation. IEEE Trans. Inf Foren Secur 5(4):761–770
Matovski DS, Nixon MS, Mahmoodi S, Carter JN (2012) The effect of time on gait recognition performance. IEEE Trans Inf Foren Secur 7(2):543–552
Chai Y, Ren J, Han W, Li H (2011) Human gait recognition: approaches, datasets and challenges. In: Proceedings of 4th international conference on imaging for crime detection and prevention, Surrey, UK
Han J, Awad G, Sutherland A (2009) Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recognit Lett 30(6):623–633
Ren J, Jiang J, Vlachos T (2010) High-accuracy sub-pixel motion estimation from noisy images in fourier domain. IEEE Trans Image Process 19(5):1379–1384
Han J, McKenna S (2014) Lattice estimation from images of patterns that exhibit translational symmetry. Image Vis Comput 32(1):64–73
Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl-Based Syst 26:144–153
Alkhateeb J, Jiang J, Ren J, Ipson S (2009) Component-based segmentation of words from handwritten Arabic text. Int J Comput Syst Sci Eng 5(1):305–309
Ren J, Jiang J (2009) Hierarchical modelling and adaptive clustering for real-time summarization of rush videos. IEEE Trans Multimed 11(5):906–917
Ren J, Vlachos T (2007) Efficient detection of temporally impulse dirt impairments in archived films. Signal Process 87(3):541–551
Acknowledgments
This paper is partially supported by the Research Innovation Fund, Education Department of Shaanxi Province and National Natural Science Foundation of China (61272381). The authors also wish to thank the editors and anonymous reviewers for their valuable and constructive comments in further improving the quality of this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chai, Y., Ren, J., Zhao, H. et al. Hierarchical and multi-featured fusion for effective gait recognition under variable scenarios. Pattern Anal Applic 19, 905–917 (2016). https://doi.org/10.1007/s10044-015-0471-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-015-0471-5