Abstract
(Discriminative) Correlation Filter has been successfully applied to visual tracking and has advanced the field significantly in recent years. Correlation filter-based trackers consider visual tracking as a problem of matching the feature template of the object and candidate regions in the detection sample, in which correlation filter provides the means to calculate the similarities. In contrast, convolution filter is usually used for blurring, sharpening, embossing, edge detection, etc. in image processing. On the surface, correlation filter and convolution filter are usually used for different purposes. In this paper, however, we prove, for the first time, that correlation filter and convolution filter are equivalent in the sense that their minimum mean-square errors (MMSEs) in visual tracking are equal, under the condition that the optimal solutions exist and the ideal filter response is Gaussian and centrosymmetric. This result gives researchers the freedom to choose correlation or convolution in formulating their trackers. It also suggests that the explanation of the ideal response in terms of similarities is not essential.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amirian, S., Rasheed, K., Taha, T.R., Arabnia, H.R.: Automatic image and video caption generation with deep learning: a concise review and algorithmic overlap. IEEE Access 8, 218386–218400 (2020)
Bhat, G., Danelljan, M., Gool, L.V., Timofte, R.: Know your surroundings: Exploiting scene information for object tracking. In: ECCV, no. 23, pp. 205–221 (2020)
Bolme, D.S., Beveridge, J.R., Draper, B.A., Lui, Y.M.: Visual object tracking using adaptive correlation filters. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2544–2550. IEEE (2010)
Bota, S., Nedevschi, S.: Tracking multiple objects in urban traffic environments using dense stereo and optical flow. In: 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), pp. 791–796 (2011)
Chen, Z., Zhong, B., Li, G., Zhang, S., Ji, R.: Siamese box adaptive network for visual tracking. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6668–6677 (2020)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886–893 (2005)
Danelljan, M., Bhat, G., Khan, F.S., Felsberg, M.: Eco: efficient convolution operators for tracking. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6931–6939 (2017)
Danelljan, M., Gool, L.V., Timofte, R.: Probabilistic regression for visual tracking. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7183–7192 (2020)
Danelljan, M., Hager, G., Khan, F.S., Felsberg, M.: Learning spatially regularized correlation filters for visual tracking. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 4310–4318 (2015)
Danelljan, M., Khan, F.S., Felsberg, M., van de Weijer, J.: Adaptive color attributes for real-time visual tracking. In: CVPR ’14 Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014)
Danelljan, M., Robinson, A., Khan, F.S., Felsberg, M.: Beyond correlation filters: learning continuous convolution operators for visual tracking. In: 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands, 11–14 October 2016, vol. 9909, pp. 472–488 (2016)
Fu, C., Li, B., Ding, F., Lin, F., Lu, G.: Correlation filter for uav-based aerial tracking: a review and experimental evaluation. arXiv preprint arXiv:2010.06255 (2020)
Fu, C., Lin, F., Li, Y., Chen, G.: Correlation filter-based visual tracking for uav with online multi-feature learning. Remote Sens. 11(5), 549 (2019)
Galoogahi, H.K., Fagg, A., Lucey, S.: Learning background-aware correlation filters for visual tracking. In: 2017 IEEE International Conference on Computer Vision (ICCV) (2017)
Galoogahi, H.K., Sim, T., Lucey, S.: Multi-channel correlation filters. In: 2013 IEEE International Conference on Computer Vision, pp. 3072–3079 (2013)
He, Y., Fu, C., Lin, F., Li, Y., Lu, P.: Towards robust visual tracking for unmanned aerial vehicle with tri-attentional correlation filters. arXiv preprint arXiv:2008.00528 (2020)
Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)
Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels. In: ECCV’12 Proceedings of the 12th European conference on Computer Vision, vol. Part IV, pp. 702–715 (2012)
Hu, W., Xie, N., Li, L., Zeng, X., Maybank, S.: A survey on visual content-based video indexing and retrieval. Syst. Man Cybern. 41(6), 797–819 (2011)
Huang, Z., Fu, C., Li, Y., Lin, F., Lu, P.: Learning aberrance repressed correlation filters for real-time uav tracking. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 2891–2900 (2019)
Kart, U., Lukezic, A., Kristan, M., Kamarainen, J.K., Matas, J.: Object tracking by reconstruction with view-specific discriminative correlation filters. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1339–1348 (2019)
Khan, A., Sohail, A., Zahoora, U., Qureshi, A.S.: A survey of the recent architectures of deep convolutional neural networks. Artif. Intell. Rev. 53(8), 5455–5516 (2020). https://doi.org/10.1007/s10462-020-09825-6
Li, B., Wu, W., Wang, Q., Zhang, F., Xing, J., Yan, J.: Siamrpn++: evolution of siamese visual tracking with very deep networks. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4282–4291 (2019)
Li, B., Yan, J., Wu, W., Zhu, Z., Hu, X.: High performance visual tracking with siamese region proposal network. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8971–8980 (2018)
Li, F., Fu, C., Lin, F., Li, Y., Lu, P.: Training-set distillation for real-time uav object tracking. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 9715–9721 (2020)
Li, F., Tian, C., Zuo, W., Zhang, L., Yang, M.H.: Learning spatial-temporal regularized correlation filters for visual tracking. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4904–4913 (2018)
Li, P., Chen, B., Ouyang, W., Wang, D., Yang, X., Lu, H.: Gradnet: gradient-guided network for visual object tracking. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 6162–6171 (2019)
Li, S.W., Jiang, Q.B., Zhao, Q.J., Lu, L., Feng, Z.L.: Asymmetric discriminative correlation filters for visual tracking. Front. Inf. Technol. Electron. Eng. 21(10), 1467–1484 (2020)
Li, S., Liu, Y., Zhao, Q., Feng, Z.: Learning residue-aware correlation filters and refining scale estimates with the grabcut for real-time uav tracking (2021)
Li, Y., Fu, C., Ding, F., Huang, Z., Lu, G.: Autotrack: towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11923–11932 (2020)
Li, Y., Fu, C., Ding, F., Huang, Z., Pan, J.: Augmented memory for correlation filters in real-time uav tracking. arXiv preprint arXiv:1909.10989 (2019)
Li, Y., Fu, C., Huang, Z., Zhang, Y., Pan, J.: Keyfilter-aware real-time uav object tracking. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 193–199 (2020)
Lin, S., Garratt, M.A., Lambert, A.J.: Monocular vision-based real-time target recognition and tracking for autonomously landing an uav in a cluttered shipboard environment. Auton. Robots 41(4), 881–901 (2016)
Lukezic, A., Vojir, T., Zajc, L.C., Matas, J., Kristan, M.: Discriminative correlation filter with channel and spatial reliability. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4847–4856 (2017)
Ma, C., Huang, J.B., Yang, X., Yang, M.H.: Hierarchical convolutional features for visual tracking. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 3074–3082 (2015)
Mueller, M., Smith, N., Ghanem, B.: Context-aware correlation filter tracking. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1387–1395 (2017)
Olivares-Mendez, M., et al.: Towards an autonomous vision-based unmanned aerial system against wildlife poachers. Sensors 15, 31362–31391 (2015)
Pratt, W.K.: Introduction to Digital Image Processing (2013)
Sun, Y., Sun, C., Wang, D., He, Y., Lu, H.: Roi pooled correlation filters for visual tracking. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5783–5791 (2019)
Vanegas, F., Campbell, D., Roy, N., Gaston, K.J., Gonzalez, F.: Uav tracking and following a ground target under motion and localisation uncertainty. In: 2017 IEEE Aerospace Conference (2017)
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., Torr, P.H.: Fast online object tracking and segmentation: A unifying approach. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1328–1338 (2019)
Yin, Y., Wang, X., Xu, D., Liu, F., Wang, Y., Wu, W.: Robust visual detection-learning-tracking framework for autonomous aerial refueling of uavs. IEEE Trans. Instrum. Meas 65(3), 510–521 (2016)
Yu, Y., Xiong, Y., Huang, W., Scott, M.R.: Deformable siamese attention networks for visual object tracking. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6728–6737 (2020)
Yuan, C., Liu, Z., Zhang, Y.: Aerial images-based forest fire detection for firefighting using optical remote sensing techniques and unmanned aerial vehicles. J. Intell. Rob. Syst. 88, 635–654 (2017)
Zhao, Z.Q., Zheng, P., Xu, S.T., Wu, X.: Object detection with deep learning: a review. IEEE Trans. Neural Netw. 30(11), 3212–3232 (2019)
Acknowledgment
This work is supported by the National Natural Science Foundation of China (No. 61773270, 61971005, 62066042).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, S., Zhao, Q., Feng, Z., Lu, L. (2021). Equivalence of Correlation Filter and Convolution Filter in Visual Tracking. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12890. Springer, Cham. https://doi.org/10.1007/978-3-030-87361-5_51
Download citation
DOI: https://doi.org/10.1007/978-3-030-87361-5_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87360-8
Online ISBN: 978-3-030-87361-5
eBook Packages: Computer ScienceComputer Science (R0)