Tracking Method of GM-APD LiDAR Based on Adaptive Fusion of Intensity Image and Point Cloud
<p>Overall flow of KCF.</p> "> Figure 2
<p>Overall flow of KCF based on multi-feature fusion.</p> "> Figure 3
<p>The Kalman filtering process.</p> "> Figure 4
<p>2D target response graph.</p> "> Figure 5
<p>The results of PSLR and ISS in different occlusion.</p> "> Figure 6
<p>The comparation of different methods in different occlusion.</p> "> Figure 6 Cont.
<p>The comparation of different methods in different occlusion.</p> "> Figure 7
<p>CLE curve of different algorithms in the tracking experiment based on KITTI data set.</p> "> Figure 8
<p>The first outdoor detection scenario.</p> "> Figure 9
<p>Tracking results of the first outdoor detection scenario.</p> "> Figure 9 Cont.
<p>Tracking results of the first outdoor detection scenario.</p> "> Figure 10
<p>CLE curve of different algorithms in the first outdoor detection scenario.</p> "> Figure 11
<p>The second outdoor detection scenario.</p> "> Figure 12
<p>Tracking results of the second outdoor detection scenario.</p> "> Figure 12 Cont.
<p>Tracking results of the second outdoor detection scenario.</p> "> Figure 13
<p>CLE curve of different algorithms in the second outdoor detection scenario.</p> ">
Abstract
:1. Introduction
- (1)
- In order to overcome the defect that KCF algorithm cannot fully distinguish target from other similar objects using only one single feature, this method fuses the HOG and Fourier descriptor features of the target for the GM-APD LiDAR intensity image, and combines the frequency-domain information and spatial information to describe the target more comprehensively, sufficiently distinguishing the target from other similar objects and improving the tracking performance of the KCF algorithm.
- (2)
- Aiming at the declining of tracking accuracy or even tracking failure when the target is in occlusion, this method uses the peak sidelobe ratio (PSLR) and intrinsic shape signature (ISS) to effectively judge the occlusion state of the target. Then, an adaptive factor is proposed to fuse the tracking results of kernel correlation filter and Kalman filter, according to the occlusion state of the target, improving the tracking accuracy when the target is in occlusion.
2. Intensity Image KCF Target Tracking Method Based on the Muti-Feature Fusion
2.1. The Principle of KCF Tracking Algorithm
2.1.1. Ridge Regression
2.1.2. Kernelized Correlation Detection
2.2. KCF Tracking Algorithm Based on Muti-Feature Fusion
2.2.1. HOG Feature
2.2.2. Fourier Descriptor Feature
3. The Adaptive Fusion of KCF and Kalman Filter
3.1. Target Tracking Method Based on Kalman Filter
3.2. Target Occlusion Judgment
3.3. The Proposal of Adaptive Factor
4. Experiment and Result Analysis
4.1. Tracking Experiment Based on KITTI Data Set
4.2. Tracking Experiment Based on Data Collected by GM-APD LiDAR
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Zhang, J.X.; Yang, G.H. Fault-tolerant output-constrained control of unknown Euler-Lagrange systems with prescribed tracking accuracy. Automatica 2020, 111, 108606. [Google Scholar] [CrossRef]
- Giancola, S.; Zarzar, J.; Ghanem, B. Leveraging Shape Completion for 3D Siamese Tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019. [Google Scholar]
- Zheng, C.; Yan, X.; Zhang, H.; Wang, B.; Cheng, S.; Cui, S.; Li, Z. Beyond 3D Siamese Tracking: A Motion-centric Paradigm for 3D Single Object Tracking in Point Clouds. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LO, USA, 19 June 2022. [Google Scholar]
- Xu, T.X.; Guo, Y.C.; Lai, Y.K.; Zhang, S.H. CXTrack: Improving 3D Point Cloud Tracking with Contextual Information. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 18–22 June 2023. [Google Scholar]
- X.Z. Research on Single Target Tracking Technology Based on LiDAR Point Cloud. Ph.D. Thesis, National University of Defense Technology, Changsha, China, 1 December 2021.
- T.D. Research on Target Detection and Tracking Technology in Complex Occlusion Environment. Ph.D. Thesis, Changchun University of Science and Technology, Changchun, China, 4 June 2021.
- Bolme, D.S.; Beveridge, J.R.; Draper, B.A.; Lui, Y.M. Visual Object Tracking Using Adaptive Correlation Filters. In Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, 13–18 June 2010. [Google Scholar]
- Henriques, J.F.; Caseiro, R.; Martins, P.; Batista, J. Exploiting the Circulant Structure of Tracking-by-Detection with Kernels. In Proceedings of the 2012 European Conference on Computer Vision, Firenze, Italy, 7–13 October 2012. [Google Scholar]
- Henriques, J.F.; Caseiro, R.; Martins, P.; Batista, J. High-Speed Tracking with Kernelized Correlation Filters. IEEE Trans. Pattern Anal. Mach. Intell. 2015, 37, 583–596. [Google Scholar] [CrossRef] [PubMed]
- Hannuna, S.; Camplani, M.; Hall, J.; Mirmehdi, M.; Damen, D.; Burghardt, T.; Paiement, A.; Tao, L. DS-KCF: A Real-time Tracker for RGB-D Data. J. Real-Time Image Process. 2019, 16, 1439–1458. [Google Scholar] [CrossRef]
- Zolfaghari, M.; Ghanei-Yakhdan, H.; Yazdi, M. Real-time Object Tracking based on an Adaptive Transition Model and Extended Kalman Filter to Handle Full Occlusion. Vis. Comput. 2020, 36, 701–715. [Google Scholar] [CrossRef]
- Liu, Y.; Liao, Y.; Lin, C.; Jia, Y.; Li, Z.; Yang, X. Object Tracking in Satellite Videos based on Correlation Filter with Multi-Feature Fusion and Motion Trajectory Compensation. Remote Sens. 2022, 14, 777. [Google Scholar] [CrossRef]
- Maharani, D.A.; Machbub, C.; Yulianti, L.; Rusmin, P.H. Deep Features Fusion for KCF-based Moving Object Tracking. J. Big Data 2023, 10, 136. [Google Scholar] [CrossRef]
- Panahi, R.; Gholampour, I.; Jamzad, M. Real time occlusion handling using Kalman Filter and mean-shift. In Proceedings of the 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP), Zanjan, Iran, 10–12 September 2013. [Google Scholar]
- Jeong, J.-M.; Yoon, T.-S.; Park, J.-B. Kalman filter based multiple objects detection-tracking algorithm robust to occlusion. In Proceedings of the SICE Annual Conference (SICE), Sapporo, Japan, 9–12 September 2014. [Google Scholar]
- Feng, Z.; Wang, P. A model adaptive updating kernel correlation filter tracker with deep CNN features. Eng. Appl. Artif. Intell. 2023, 123, 106250. [Google Scholar] [CrossRef]
- Sharma, U.; Gupta, N.; Verma, M. Prediction of compressive strength of GGBFS and Flyash-based geopolymer composite by linear regression, lasso regression, and ridge regression. Asian J. Civ. Eng. 2023, 24, 3399–3411. [Google Scholar] [CrossRef]
- Jing, Q.; Zhang, P.; Zhang, W.; Lei, W. An improved target tracking method based on extraction of corner points. In The Visual Computer; Springer: Berlin/Heidelberg, Germany, 2024; pp. 1–20. [Google Scholar] [CrossRef]
- S.Y. Research on Human Posture Recognition based on Infrared Image. Ph.D. Thesis, Shenyang Aerospace University, Shenyang, China, 8 March 2019.
- Yan, H.; Zhang, J.X.; Zhang, X. Injected infrared and visible image fusion via L1 decomposition model and guided filtering. IEEE Trans. Comput. Imaging 2022, 8, 162–173. [Google Scholar] [CrossRef]
- Yuan, Y.; Chu, J.; Leng, L.; Miao, J.; Kim, B.G. A scale-adaptive object-tracking algorithm with occlusion detection. EURASIP J. Image Video Process. 2020, 2020, 1–15. [Google Scholar] [CrossRef]
- H.W. Research on 3D Vehicle Target Detection and Tracking Algorithm in Traffic Scene based on LiDAR Point Cloud. Ph.D. Thesis, Chang’an University, Xi’an, China, 29 April 2022.
- Cui, Y.; Ren, H. Research on Visual Tracking Algorithm based on Peak Sidelobe Ratio. IEEE Access 2021, 9, 105318–105326. [Google Scholar] [CrossRef]
- Zhong, Y. Intrinsic Shape Signatures: A Shape Descriptor for 3D Object Recognition. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, Kyoto, Japan, 29 September–2 October 2009. [Google Scholar]
- Zhang, J.X.; Yang, T.; Chai, T. Neural network control of underactuated surface vehicles with prescribed trajectory tracking performance. IEEE Trans. Neural Netw. Learn. Syst. 2022, 35, 8026–8039. [Google Scholar] [CrossRef] [PubMed]
- Zhang, J.X.; Xu, K.D.; Wang, Q.G. Prescribed performance tracking control of time-delay nonlinear systems with output constraints. IEEE/CAA J. Autom. Sin. 2023, 11, 1557–1565. [Google Scholar] [CrossRef]
- Ramadan, H.S.; Becherif, M.; Claude, F. Extended Kalman Filter for Accurate State of Charge Estimation of Lithium-based Batteries: A Comparative Analysis. Int. J. Hydrogen Energy 2017, 42, 29033–29046. [Google Scholar] [CrossRef]
Algorithm | Kalman Filter | EKF | Proposed |
---|---|---|---|
Average CLE/m | 0.1509 | 0.1284 | 0.1182 |
Average algorithm speed per frame/ms | 34 | 45 | 51 |
Algorithm | Kalman Filter | EKF | Proposed |
---|---|---|---|
Average CLE/m | 0.1209 | 0.1084 | 0.0982 |
Average algorithm speed per frame/ms | 16 | 24 | 33 |
Algorithm | Kalman Filter | EKF | Proposed |
---|---|---|---|
Average CLE/m | 0.2125 | 0.1797 | 0.1542 |
Average algorithm speed per frame/ms | 18 | 27 | 39 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Xiao, B.; Wang, Y.; Huang, T.; Liu, X.; Xie, D.; Zhou, X.; Liu, Z.; Wang, C. Tracking Method of GM-APD LiDAR Based on Adaptive Fusion of Intensity Image and Point Cloud. Appl. Sci. 2024, 14, 7884. https://doi.org/10.3390/app14177884
Xiao B, Wang Y, Huang T, Liu X, Xie D, Zhou X, Liu Z, Wang C. Tracking Method of GM-APD LiDAR Based on Adaptive Fusion of Intensity Image and Point Cloud. Applied Sciences. 2024; 14(17):7884. https://doi.org/10.3390/app14177884
Chicago/Turabian StyleXiao, Bo, Yuchao Wang, Tingsheng Huang, Xuelian Liu, Da Xie, Xulang Zhou, Zhanwen Liu, and Chunyang Wang. 2024. "Tracking Method of GM-APD LiDAR Based on Adaptive Fusion of Intensity Image and Point Cloud" Applied Sciences 14, no. 17: 7884. https://doi.org/10.3390/app14177884
APA StyleXiao, B., Wang, Y., Huang, T., Liu, X., Xie, D., Zhou, X., Liu, Z., & Wang, C. (2024). Tracking Method of GM-APD LiDAR Based on Adaptive Fusion of Intensity Image and Point Cloud. Applied Sciences, 14(17), 7884. https://doi.org/10.3390/app14177884