Gait Recognition Algorithm of Coal Mine Personnel Based on LoRa
<p>Waveform of a chirp signal. (<b>a</b>) Frequency domain signal representation. (<b>b</b>) Time domain signal representation.</p> "> Figure 2
<p>Sensing scenario.</p> "> Figure 3
<p>Signal vector representation.</p> "> Figure 4
<p>Amplitude of received signal.</p> "> Figure 5
<p>System architecture.</p> "> Figure 6
<p>Signal amplitude before and after filtering.</p> "> Figure 7
<p>Signal segmentation.</p> "> Figure 8
<p>Network model.</p> "> Figure 9
<p>Experiment scenario deployment diagram.</p> "> Figure 10
<p>Confusion matrix of experiment.</p> "> Figure 11
<p>Recognition accuracy of a different number of people.</p> "> Figure 12
<p>Recognition accuracy of different sample sizes.</p> "> Figure 13
<p>Scenario of through-wall experiments.</p> "> Figure 14
<p>Recognition accuracy of different number of people in through-wall scenario.</p> "> Figure 15
<p>Diagram of coal mine underground.</p> "> Figure 16
<p>Scenario of coal mine underground.</p> "> Figure 17
<p>Confusion matrix with distance of 5 m.</p> "> Figure 18
<p>Confusion matrix with distance of 20 m.</p> "> Figure 19
<p>Comparison of recognition accuracy of different models.</p> ">
Abstract
:1. Introduction
- This paper is the first work to apply the LoRa signal to gait recognition. We verify the feasibility of gait recognition based on LoRa signals and construct a gait recognition dataset. The gait recognition algorithm is studied by analyzing and processing the wireless signals received by the LoRa gateway.
- We analyze the signal change pattern when the target walks. Based on the amplitude data of the received signal, the features of the target when walking are extracted using an autoencoder. We transform it into a multi-classification problem to further identify the target identity.
- Many gait recognition experiments are carried out to compare the various impacts of the recognition accuracy. The results show that the recognition accuracy of 2~6 people in an indoor environment is 99.7~95.6%. In the coal mine underground environment, the recognition accuracy of six people can still reach 90.2% at a long distance of 20 m.
2. Materials and Methods
2.1. Wireless Sensing Model Based on LoRa
2.2. Preliminary Experiment
2.3. System Architecture
2.4. Data Preprocessing
2.5. Signal Segmentation Based on Autocorrelation
2.6. Feature Extraction and Identity Recognition
2.6.1. Feature Extraction Based on Autoencoder
2.6.2. Identity Recognition Based on Softmax
3. Results
3.1. Experiment Setup
3.2. Indoor Laboratory Environment
3.2.1. Experiment Result
3.2.2. Recognition Accuracy for Different Numbers of People
3.2.3. Recognition Accuracy of Different Sample Sizes
3.2.4. Impact of Through-Wall Sensing
3.3. Coal Mine Underground Environment
3.3.1. Experiment Results
3.3.2. Underground Long-Distance Sensing
3.4. Evaluation of Different Models
4. Discussion
4.1. Related Work
4.1.1. Gait Recognition Based on Sensor
4.1.2. Gait Recognition for Coal Mine
4.1.3. Gait Recognition Based on Wireless Signal
4.1.4. Wireless Sensing Based on LoRa
4.2. Proposed System and Future Work
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Yan, W.; Ya-ru, Z.; Yong, M. Study on the coal mine personnel position system based on wireless body sensor networks. In Proceedings of the 2008 5th International Summer School and Symposium on Medical Devices and Biosensors, Hong Kong, China, 1–3 June 2008; pp. 75–78. [Google Scholar]
- Duta, N. A survey of biometric technology based on hand shape. Pattern Recognit. 2009, 42, 2797–2806. [Google Scholar] [CrossRef]
- Malaspina, D.; Coleman, E.; Goetz, R.R.; Harkavy-Friedman, J.; Corcoran, C.; Amador, X.; Yale, S.; Gorman, J.M. Odor identification, eye tracking and deficit syndrome schizophrenia. Biol. Psychiatry 2002, 51, 809–815. [Google Scholar] [CrossRef] [Green Version]
- Park, H.A.; Park, K.R. Iris recognition based on score level fusion by using SVM. Pattern Recognit. Lett. 2007, 28, 2019–2028. [Google Scholar] [CrossRef]
- Kurita, K. Human identification from walking signal based on measurement of current generated by electrostatic induction. Kansei Eng. Int. J. 2012, 11, 183–189. [Google Scholar] [CrossRef] [Green Version]
- Little, J.; Boyd, J. Recognizing people by their gait: The shape of motion. Videre J. Comput. Vis. Res. 1998, 1, 1–32. [Google Scholar]
- Nickel, C.; Busch, C.; Rangarajan, S.; Möbius, M. Using hidden markov models for accelerometer-based biometric gait recognition. In Proceedings of the 2011 IEEE 7th International Colloquium on Signal Processing and its Applications, Penang, Malaysia, 4–6 March 2011; pp. 58–63. [Google Scholar]
- Wu, Z.; Huang, Y.; Wang, L.; Wang, X.; Tan, T. A comprehensive study on cross-view gait based human identification with deep cnns. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 39, 209–226. [Google Scholar] [CrossRef] [PubMed]
- Konz, L.; Hill, A.; Banaei-Kashani, F. ST-DeepGait: A Spatiotemporal Deep Learning Model for Human Gait Recognition. Sensors 2022, 22, 8075. [Google Scholar] [CrossRef] [PubMed]
- Zhang, Y.; Pan, G.; Jia, K.; Lu, M.; Wang, Y.; Wu, Z. Accelerometer-based gait recognition by sparse representation of signature points with clusters. IEEE Trans. Cybern. 2014, 45, 1864–1875. [Google Scholar] [CrossRef] [PubMed]
- Al-Naimi, I.; Wong, C.B.; Moore, P.; Chen, X. Multimodal approach for non-tagged indoor identification and tracking using smart floor and pyroelectric infrared sensors. Int. J. Comput. Sci. Eng. 2017, 14, 1–15. [Google Scholar]
- Augustin, A.; Yi, J.; Clausen, T.; Townsley, W.M. A study of LoRa: Long range & low power networks for the internet of things. Sensors 2016, 16, 1466. [Google Scholar] [PubMed] [Green Version]
- Peng, Y.; Shangguan, L.; Hu, Y.; Qian, Y.; Lin, X.; Chen, X.; Fang, D.; Jamieson, K. PLoRa: A passive long-range data network from ambient LoRa transmissions. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, Budapest, Hungary, 20–25 August 2018; pp. 147–160. [Google Scholar]
- Berni, A.; Gregg, W. On the utility of chirp modulation for digital signaling. IEEE Trans. Commun. 1973, 21, 748–751. [Google Scholar] [CrossRef]
- Jennison, B.K. Performance of a linear frequency-modulated signal detection algorithm. In Proceedings of the Record of the IEEE 2000 International Radar Conference [Cat. No. 00CH37037], Alexandria, VA, USA, 7–12 May 2000; pp. 447–450. [Google Scholar]
- Zhu, R.; Zhou, Z. A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package. IEEE Trans. Neural Syst. Rehabil. Eng. 2004, 12, 295–302. [Google Scholar] [PubMed]
- Glowinski, S.; Blazejewski, A.; Krzyzynski, T. Human gait feature detection using inertial sensors wavelets. In Proceedings of the Wearable Robotics: Challenges and Trends: Proceedings of the 2nd International Symposium on Wearable Robotics, WeRob2016, Segovia, Spain, 18–21 October 2016; Springer: Berlin/Heidelberg, Germany, 2017; pp. 397–401. [Google Scholar]
- Tadano, S.; Takeda, R.; Miyagawa, H. Three dimensional gait analysis using wearable acceleration and gyro sensors based on quaternion calculations. Sensors 2013, 13, 9321–9343. [Google Scholar] [CrossRef] [PubMed]
- Liu, X.; Liu, J. Gait recognition method of underground coal mine personnel based on densely connected convolution network and stacked convolutional autoencoder. Entropy 2020, 22, 695. [Google Scholar] [CrossRef] [PubMed]
- Chao, L.; Jinye, P.; Wang, Z.; Shi, Y. Gait Recognition Underground Coal Mine by Combining Wavelet Packet Transforms and Principle Component Analysis. In Proceedings of the 2015 Sixth International Conference on Intelligent Systems Design and Engineering Applications (ISDEA), Guizhou, China, 18–19 August 2015; pp. 421–425. [Google Scholar]
- Li, X.; Wang, S.; Liu, B.; Chen, W.; Fan, W.; Tian, Z. Improved YOLOv4 network using infrared images for personnel detection in coal mines. J. Electron. Imaging 2022, 31, 013017. [Google Scholar] [CrossRef]
- Shi, C.; Liu, J.; Liu, H.; Chen, Y. Smart user authentication through actuation of daily activities leveraging WiFi-enabled IoT. In Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Chennai, India, 10–14 July 2017; pp. 1–10. [Google Scholar]
- Wang, W.; Liu, A.X.; Shahzad, M. Gait recognition using wifi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 12–16 September 2016; pp. 363–373. [Google Scholar]
- Zeng, Y.; Pathak, P.H.; Mohapatra, P. WiWho: WiFi-based person identification in smart spaces. In Proceedings of the 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Vienna, Austria, 11–14 April 2016; pp. 1–12. [Google Scholar]
- Zhang, J.; Wei, B.; Hu, W.; Kanhere, S.S. Wifi-id: Human identification using wifi signal. In Proceedings of the 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS), Washington, DC, USA, 26–28 May 2016; pp. 75–82. [Google Scholar]
- Xin, T.; Guo, B.; Wang, Z.; Li, M.; Yu, Z.; Zhou, X. Freesense: Indoor human identification with Wi-Fi signals. In Proceedings of the 2016 IEEE Global Communications Conference (GLOBECOM), Washington, DC, USA, 4–8 December 2016; pp. 1–7. [Google Scholar]
- Vandersmissen, B.; Knudde, N.; Jalalvand, A.; Couckuyt, I.; Bourdoux, A.; De Neve, W.; Dhaene, T. Indoor person identification using a low-power FMCW radar. IEEE Trans. Geosci. Remote Sens. 2018, 56, 3941–3952. [Google Scholar] [CrossRef] [Green Version]
- Zhao, P.; Lu, C.X.; Wang, J.; Chen, C.; Wang, W.; Trigoni, N.; Markham, A. mid: Tracking and identifying people with millimeter wave radar. In Proceedings of the 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS), Santorini Island, Greece, 29–31 May 2019; pp. 33–40. [Google Scholar]
- Meng, Z.; Fu, S.; Yan, J.; Liang, H.; Zhou, A.; Zhu, S.; Ma, H.; Liu, J.; Yang, N. Gait recognition for co-existing multiple people using millimeter wave sensing. In Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA, 7–12 February 2020; Volume 34, pp. 849–856. [Google Scholar]
- Li, T.; Cao, X.; Liu, H.; Shi, C.; Chen, P. MTPGait: Multi-person Gait Recognition with Spatio-temporal Information via Millimeter Wave Radar. In Proceedings of the 2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS), Beijing, China, 14–16 December 2021; pp. 660–666. [Google Scholar]
- Hossain, T.; Doi, Y.; Tazin, T.; Ahad, M.A.R.; Inoue, S. Study of lorawan technology for activity recognition. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore, 8–12 October 2018; pp. 1449–1453. [Google Scholar]
- Petäjäjärvi, J.; Mikhaylov, K.; Yasmin, R.; Hämäläinen, M.; Iinatti, J. Evaluation of LoRa LPWAN technology for indoor remote health and wellbeing monitoring. Int. J. Wirel. Inf. Netw. 2017, 24, 153–165. [Google Scholar] [CrossRef] [Green Version]
- Ke, K.H.; Liang, Q.W.; Zeng, G.J.; Lin, J.H.; Lee, H.C. A LoRa wireless mesh networking module for campus-scale monitoring: Demo abstract. In Proceedings of the 6th ACM/IEEE International Conference on Information Processing in Sensor Networks, Milano, Italy, 4–6 May 2017; pp. 259–260. [Google Scholar]
- Chen, L.; Xiong, J.; Chen, X.; Lee, S.I.; Chen, K.; Han, D.; Fang, D.; Tang, Z.; Wang, Z. WideSee: Towards wide-area contactless wireless sensing. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems, New York, NY, USA, 10–13 November 2019; pp. 258–270. [Google Scholar]
- Zhang, F.; Chang, Z.; Niu, K.; Xiong, J.; Jin, B.; Lv, Q.; Zhang, D. Exploring lora for long-range through-wall sensing. Proc. ACM Interact. Mobile Wearable Ubiquitous Technol. 2020, 4, 68. [Google Scholar] [CrossRef]
- Zhang, F.; Chang, Z.; Xiong, J.; Zheng, R.; Ma, J.; Niu, K.; Jin, B.; Zhang, D. Unlocking the beamforming potential of LoRa for long-range multi-target respiration sensing. Proc. ACM Interact. Mobile Wearable Ubiquitous Technol. 2021, 5, 85. [Google Scholar] [CrossRef]
- Xie, B.; Xiong, J. Combating interference for long range LoRa sensing. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems, Virtual, 16–19 November 2020; pp. 69–81. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yin, Y.; Zhang, X.; Lan, R.; Sun, X.; Wang, K.; Ma, T. Gait Recognition Algorithm of Coal Mine Personnel Based on LoRa. Appl. Sci. 2023, 13, 7289. https://doi.org/10.3390/app13127289
Yin Y, Zhang X, Lan R, Sun X, Wang K, Ma T. Gait Recognition Algorithm of Coal Mine Personnel Based on LoRa. Applied Sciences. 2023; 13(12):7289. https://doi.org/10.3390/app13127289
Chicago/Turabian StyleYin, Yuqing, Xuehan Zhang, Rixia Lan, Xiaoyu Sun, Keli Wang, and Tianbing Ma. 2023. "Gait Recognition Algorithm of Coal Mine Personnel Based on LoRa" Applied Sciences 13, no. 12: 7289. https://doi.org/10.3390/app13127289
APA StyleYin, Y., Zhang, X., Lan, R., Sun, X., Wang, K., & Ma, T. (2023). Gait Recognition Algorithm of Coal Mine Personnel Based on LoRa. Applied Sciences, 13(12), 7289. https://doi.org/10.3390/app13127289