Abstract
In recent years, many advanced visual object tracking algorithms have achieved significant performance improvements in daytime scenes. However, when these algorithms are applied at night on unmanned aerial vehicles, they often exhibit poor tracking accuracy due to the domain shift. Therefore, designing an effective and stable domain adaptation tracking framework is in great demand. Besides, as the complexity of the tracking task scene and a large number of samples, it is difficult to accurately characterize the feature differences. Moreover, the method should avoid excessive manual parameters. To solve above three challenges, this study proposes a metric-based domain alignment framework for nighttime object tracking of unmanned aerial vehicles. It achieves transfer learning from daytime to nighttime by introducing a multi-kernel Bures metric (MKB). MKB quantifies the distribution distance by calculating the difference between two domain covariance operators in the latent space. MKB also uses a linear combination of a series of kernel functions to accommodate complex samples of different scenes and categories, enhancing the ability of the metric to represent various sequences in the latent space. Besides, we introduce an alternating update mechanism to optimize the weights of kernels avoiding manual parameters. Experimental results demonstrate that the proposed method has significant advantages in improving tracking accuracy and robustness at nighttime.
This work was supported in part by the National Natural Science Foundation of China under Grant No. 62237001, 62202107, and 62176065, in part by the Guangdong Provincial National Science Foundation under Grant No. 2021A1515012017, in part by Science and Technology Planning Project of Guangdong Province, China, under Grant No. 2019B110210002, in part by the Guangdong Basic and Applied Basic Research Foundation under Grant No. 2021B1515120010, in part by Huangpu International Sci &Tech Cooperation Foundation of Guangzhou under Grant No. 2021GH12.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., Torr, P.H.S.: Fully-convolutional siamese networks for object tracking. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9914, pp. 850–865. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48881-3_56
Cao, Z., Fu, C., Ye, J., Li, B., Li, Y.: HiFT: hierarchical feature transformer for aerial tracking. In: IEEE International Conference on Computer Vision (ICCV) (2021)
Chen, Z., Zhong, B., Li, G., Zhang, S., Ji, R.: Siamese box adaptive network for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Diamond, S., Boyd, S.: CVXPY: a python-embedded modeling language for convex optimization. J. Mach. Learn. Res. (JMLR) 17(1), 2909–2913 (2016)
Fu, C., Cao, Z., Li, Y., Ye, J., Feng, C.: Siamese anchor proposal network for high-speed aerial tracking. In: IEEE International Conference on Robotics and Automation (ICRA). IEEE (2021)
Guo, D., Wang, J., Cui, Y., Wang, Z., Chen, S.: Siamcar: siamese fully convolutional classification and regression for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Guo, Q., Feng, W., Zhou, C., Huang, R., Wan, L., Wang, S.: Learning dynamic siamese network for visual object tracking. In: IEEE International Conference on Computer Vision (ICCV) (2017)
Huang, L., Zhao, X., Huang, K.: GOT-10k: a large high-diversity benchmark for generic object tracking in the wild. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 43(5), 1562–1577 (2021)
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., Yan, J.: SiamRPN++: evolution of siamese visual tracking with very deep networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2019)
Li, B., Fu, C., Ding, F., Ye, J., Lin, F.: Adtrack: target-aware dual filter learning for real-time anti-dark UAV tracking. In: IEEE International Conference on Robotics and Automation (ICRA) (2021)
Lukezic, A., Matas, J., Kristan, M.: D3S-a discriminative single shot segmentation tracker. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Russakovsky, O., et al.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. (IJCV) 115, 211–252 (2015)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: IEEE International Conference on Computer Vision (ICCV) (2017)
Sosnovik, I., Moskalev, A., Smeulders, A.W.: Scale equivariance improves siamese tracking. In: IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) (2021)
Wang, N., Zhou, W., Song, Y., Ma, C., Liu, W., Li, H.: Unsupervised deep representation learning for real-time tracking. Int. J. Comput. Vis. (IJCV) 129, 400–418 (2021)
Wang, R., Lu, J., Lu, Y., Nie, F., Li, X.: Discrete and parameter-free multiple kernel k-means. IEEE Trans. Image Process. (TIP) 31, 2796–2808 (2022)
Xu, Y., Wang, Z., Li, Z., Yuan, Y., Yu, G.: SiamFC++: towards robust and accurate visual tracking with target estimation guidelines. In: AAAI Conference on Artificial Intelligence (AAAI) (2020)
Yang, L., Liu, R., Zhang, D.D., Zhang, L.: Deep location-specific tracking. In: ACM International Conference on Multimedia (MM) (2017)
Ye, J., Fu, C., Cao, Z., An, S., Zheng, G.Z., Li, B.: Tracker meets night: a transformer enhancer for UAV tracking. IEEE Robot. Autom. Lett. (RA-L) 7, 3866–3873 (2022)
Ye, J., Fu, C., Zheng, G., Paudel, D.P., Chen, G.: Unsupervised domain adaptation for nighttime aerial tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2022)
Zhang, L., Gonzalez-Garcia, A., Weijer, J.v.d., Danelljan, M., Khan, F.S.: Learning the model update for siamese trackers. In: IEEE International Conference on Computer Vision (ICCV) (2019)
Zhang, Z., Wang, M., Nehorai, A.: Optimal transport in reproducing kernel hilbert spaces: theory and applications. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 42(7), 1741–1754 (2019)
Zhang, Z., Peng, H.: Deeper and wider siamese networks for real-time visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2019)
Zhang, Z., Peng, H., Fu, J., Li, B., Hu, W.: Ocean: object-aware anchor-free tracking. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12366, pp. 771–787. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58589-1_46
Zhu, Z., Wang, Q., Li, B., Wu, W., Yan, J., Hu, W.: Distractor-aware siamese networks for visual object tracking. In: European Conference on Computer Vision (ECCV) (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
He, Y., Kang, P., Hu, Q., Fang, X. (2024). MKB: Multi-Kernel Bures Metric for Nighttime Aerial Tracking. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14434. Springer, Singapore. https://doi.org/10.1007/978-981-99-8549-4_18
Download citation
DOI: https://doi.org/10.1007/978-981-99-8549-4_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8548-7
Online ISBN: 978-981-99-8549-4
eBook Packages: Computer ScienceComputer Science (R0)