Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3490035.3490308acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicvgipConference Proceedingsconference-collections
research-article

Discriminative multiscale CNN network for smartphone based robust gait recognition

Published: 19 December 2021 Publication History

Abstract

A smartphone-based gait recognition system is very interesting research in surveillance. Its goal is to recognize a target user from their walking pattern using the inertial signal. However, the performance in realistic scenarios is unsatisfactory due to several covariate factors such as carrying conditions, different surface types, wearing different shoes, wearing different clothes, and also unconstrained placing of mobile phone during walking which affects gait sample data captured by sensors. Recently, many traditional single-scale CNN networks are employed for sensor-based gait recognition. However, these have limited capability to classify only normal gait samples without covariate factors. To address these challenges, in this paper, a novel discriminative Multiscale CNN network (DMSCNN) is designed to introduce both local and global feature extraction procedures for improving classification accuracy. At first, the proposed network discovers the coarse-grained features (local feature) using multiscale CNN analysis to handle different covariate-based variation effects and highlights the significance of local features with respect to class-specific samples by incorporating a class-specific weight update network. Further, fused them to get global features for improving the overall recognition rate. The experiments are performed to evaluate the robustness of the proposed model using four benchmark datasets. The result shows that the proposed model achieves higher accuracy in identification as compared to other state-of-art methods.

References

[1]
Imed Bouchrika. 2018. A survey of using biometrics for smart visual surveillance: Gait recognition. In Surveillance in Action. Springer, 3--23.
[2]
David S Chen and Ramesh C Jain. 1994. A robust backpropagation learning algorithm for function approximation. IEEE Transactions on Neural Networks 5, 3 (1994), 467--479.
[3]
Zhicheng Cui, Wenlin Chen, and Yixin Chen. 2016. Multi-scale convolutional neural networks for time series classification. arXiv preprint arXiv:1603.06995 (2016).
[4]
Rubén Delgado-Escaño, Francisco M Castro, Julián Ramos Cózar, Manuel J Marín-Jiménez, and Nicolas Guil. 2018. An end-to-end multi-task and fusion CNN for inertial-based gait recognition. IEEE Access 7 (2018), 1897--1908.
[5]
Yang Feng, Yuncheng Li, and Jiebo Luo. 2016. Learning effective gait features using LSTM. In Proc of 23rd international conference on pattern recognition (ICPR). 325--330.
[6]
Pablo Fernandez-Lopez, Jorge Sanchez-Casanova, Paloma Tirado-Martín, and Judith Liu-Jimenez. 2017. Optimizing resources on smartphone gait recognition. In Proc. of IEEE International Joint Conference on Biometrics (IJCB). 31--36.
[7]
Matteo Gadaleta and Michele Rossi. 2018. Idnet: Smartphone-based gait recognition with convolutional neural networks. Pattern Recognition 74 (2018), 25--37.
[8]
Jiaqi Gong, Myla D Goldman, and John Lach. 2016. Deepmotion: A deep convolutional neural network on inertial body sensors for gait assessment in multiple sclerosis. In Proc. of IEEE Wireless Health (WH). 1--8.
[9]
Sarthak Gupta and Ajeet Kumar. 2015. Human Activity Recognition through Smartphone's Tri-Axial Accelerometer using Time Domain Wave Analysis and Machine Learning. International Journal of Computer Applications 975 (2015), 8887.
[10]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[11]
Ha V Hoang and Minh-Triet Tran. 2017. DeepSense-inception: gait identification from inertial sensors with inception-like architecture and recurrent network. In Proc. of 13th International Conference on Computational Intelligence and Security (CIS). 594--598.
[12]
Ebenezer RHP Isaac, Susan Elias, Srinivasan Rajagopalan, and KS Easwarakumar. 2019. Template-based gait authentication through Bayesian thresholding. IEEE/CAA Journal of Automatica Sinica 6, 1 (2019), 209--219.
[13]
Songmin Jia, Lijia Wang, and Xiuzhi Li. 2015. View-invariant gait authentication based on silhouette contours analysis and view estimation. IEEE/CAA Journal of Automatica Sinica 2, 2 (2015), 226--232.
[14]
Felix Juefei-Xu, Chandrasekhar Bhagavatula, Aaron Jaech, Unni Prasad, and Marios Savvides. 2012. Gait-id on the move: Pace independent human identification using cell phone accelerometer dynamics. In Proc. of 5th IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS). 8--15.
[15]
Pradeep Kumar, Subham Mukherjee, Rajkumar Saini, Pallavi Kaushik, Partha Pratim Roy, and Debi Prosad Dogra. 2018. Multimodal gait recognition with inertial sensor data and video using evolutionary algorithm. IEEE Transactions on Fuzzy Systems 27, 5 (2018), 956--965.
[16]
Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. 2010. Cell phone-based biometric identification. In Proc. of 4th IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS). 1--7.
[17]
Sagar Arun More and Pramod Jagan Deore. 2018. Gait recognition by cross wavelet transform and graph model. IEEE/CAA Journal of Automatica Sinica 5, 3 (2018), 718--726.
[18]
Claudia Nickel, Holger Brandt, and Christoph Busch. 2011. Classification of acceleration data for biometric gait recognition on mobile devices. BIOSIG 2011--Proceedings of the Biometrics Special Interest Group (2011).
[19]
Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16, 1 (2016), 115.
[20]
Pierre Sermanet, David Eigen, Xiang Zhang, Michael Mathieu, Rob Fergus, and Yann LeCun. 2014. Overfeat: Integrated recognition, localization and detection using convolutional networks. 2nd international conference on learning representations, iclr 2014. In Proc. of 2nd International Conference on Learning Representations, ICLR 2014.
[21]
Bing Sun, Yang Wang, and Jacob Banda. 2014. Gait characteristic analysis and identification based on the iPhone's accelerometer and gyrometer. Sensors 14, 9 (2014), 17037--17054.
[22]
Yuji Watanabe and Masaki Kimura. 2020. Gait identification and authentication using LSTM based on 3-axis accelerations of smartphone. Procedia Computer Science 176 (2020), 3873--3880.
[23]
Shuochao Yao, Shaohan Hu, Yiran Zhao, Aston Zhang, and Tarek Abdelzaher. 2017. Deepsense: A unified deep learning framework for time-series mobile sensing data processing. In Proc. of the 26th International Conference on World Wide Web. 351--360.
[24]
Yuqi Zhang, Yongzhen Huang, Liang Wang, and Shiqi Yu. 2019. A comprehensive study on gait biometrics using a joint CNN-based method. Pattern Recognition 93 (2019), 228--236.
[25]
Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. 2016. Learning deep features for discriminative localization. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2921--2929.
[26]
Qin Zou, Yanling Wang, Qian Wang, Yi Zhao, and Qingquan Li. 2020. Deep Learning-Based Gait Recognition Using Smartphones in the Wild. IEEE Transactions on Information Forensics and Security 15 (2020), 3197--3212.

Cited By

View all
  • (2024)An adaptive threshold based gait authentication by incorporating quality measuresAI Communications10.3233/AIC-23012137:1(149-168)Online publication date: 21-Mar-2024
  • (2022)Reliability and generalization of gait biometrics using 3D inertial sensor data and 3D optical system trajectoriesScientific Reports10.1038/s41598-022-12452-612:1Online publication date: 19-May-2022

Index Terms

  1. Discriminative multiscale CNN network for smartphone based robust gait recognition

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICVGIP '21: Proceedings of the Twelfth Indian Conference on Computer Vision, Graphics and Image Processing
    December 2021
    428 pages
    ISBN:9781450375962
    DOI:10.1145/3490035
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 December 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. gait recognition
    2. inertial sensor
    3. multi-scale CNN
    4. smartphone sensor

    Qualifiers

    • Research-article

    Conference

    ICVGIP '21

    Acceptance Rates

    Overall Acceptance Rate 95 of 286 submissions, 33%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 22 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)An adaptive threshold based gait authentication by incorporating quality measuresAI Communications10.3233/AIC-23012137:1(149-168)Online publication date: 21-Mar-2024
    • (2022)Reliability and generalization of gait biometrics using 3D inertial sensor data and 3D optical system trajectoriesScientific Reports10.1038/s41598-022-12452-612:1Online publication date: 19-May-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media