Abstract—An algorithm for tracking multiple objects using locally adaptive generalized filtering is proposed. The tracking algorithm is invariant to geometric transformations of objects, partial occlusion of objects, nonuniform illumination of scene, and additive noise in scene images. The proposed system utilizes generalized optimal correlation filters and a prediction scheme based on the kinematic model of objects motion. With the help of iterative training, the training system can be adapted to current scene changes. The performance of the proposed algorithm is compared with that of the state-of-the-art visual tracking algorithms on known databases in terms of commonly accepted quality metrics and processing time.
Similar content being viewed by others
REFERENCES
B. Karasulu and S. Korukoglu. Performance Evaluation Software: Moving Object Detection and Tracking in Videos (Springer-Verlag, New York, 2013).
S. Talmale and N. Janwe, “Object tracking in images and videos,” Int. J. Eng. Comp. Sci. 5 (1), 15482−15486 (2016).
B. V. K. Vijaya Kumar, J. A. Fernandez, A. Rodriguez, and V. N. Boddeti, “Recent advances in correlation filter theory and application,” Proc. SPIE 9094, 909404−13 (2014).
B. V. K. V. Kumar, A. Mahalanobis, and R. D. Juday, Correlation Pattern Recognition (Cambridge Univ. Press, New York, 2005).
A. W. M. Smeulders, D. M. Chu, R. Cucchiara, et al., “Visual tracking: An experimental survey,” IEEE Trans. Pattern Anal. Mach. Intell. 36, 1442−1468 (2014).
O. Akin, E. Erdem, A. Erdem, and K. Mikolajczyk, “Deformable part-based tracking by coupled global and local correlation filters,” J. Visual Commun. Image Representation 38 (Suppl. C), 763−774 (2016).
A. Ali, A. Jalil, J. Ahmed, et al., “Correlation, Kalman filter and adaptive fast mean shift based heuristic approach for robust visual tracking,” Signal, Image and Video Process. 9, 1567−1585 (2015).
J. F. Henriques, R. Caseiro, P. Martins, and J. Batista, “High-Speed Tracking with Kernelized Correlation Filters,” IEEE Trans. Pattern Analysis & Machine Intell. 37 (3), 583−596 (2015).
X. Li, Q. Liu, Z. He, et al., “A multi-view model for visual tracking via correlation filters,” Knowledge-Based Systems 113 (Suppl. C), 88−99 (2016).
Z. Li, J. Yang, J. Zha, et al., “Online visual tracking via correlation filter with convolutional networks,” in Visual Communications and Image Processing (VCIP 2016) (Proc. Meeting, Chengdu, China, Nov. 27−30,2016) (IEEE, New York, 2016), pp. 1−4.
F. Liu, T. Zhou, K. Fu, and J. Yang, “Robust visual tracking via constrained correlation filter coding,” Pattern Recogn. Lett. 84 (Suppl. C), 163−169 (2016).
F. Liu, T. Zhou, and J. Yang, “Geometric affine transformation estimation via correlation filter for visual tracking,” Neurocomputing 214 (Suppl. C), 109−120 (2016).
S. Jeong, G. Kim, and S. Lee, “Effective visual tracking using multi-block and scale space based on kernelized correlation filters,” Sensors 17, 433 (2017).
A. Bibi, M. Mueller, and B. Ghanem, “Target response adaptation for correlation filter tracking, in Computer Vision—ECCV 2016 (Proc. 14th Eur. Conf., Amsterdam, The Netherlands, Oct. 1−14,2016, Part VI) (Springer Int., Amsterdam, 2016), pp. 419−433.
E. Gundogdu, H. Ozkan, and A. A. Alatan, “Extending correlation filter-based visual tracking by treestructured ensemble and spatial windowing,” IEEE Trans. Image Process. 26, 5270−5283 (2017).
S. E. Ontiveros-Gallardo and V. Kober, “Objects tracking with adaptive correlation filters and Kalman filtering,” Proc. SPIE 9598, 95980 (2015).
V. H. Daz-Ramrez, K. Picos, and V. Kober, “Object tracking in nonuniform illumination using space-variant correlation filters,” in Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (Proc.18th Iberoamerican Congress, CIARP 2013, Havana, Cuba, Nov. 20−23, 2013, Part II) (Springer-Verlag, Berlin, 2013).
V. H. Diaz-Ramirez, K. Picos, and V. Kober, “Target tracking in nonuniform illumination conditions using locally adaptive correlation filters,” Opt. Commun. 323, 32−43 (2014).
V. H. Diaz-Ramirez, V. Contreras, V. Kober, and K. Picos, “Real-time tracking of multiple objects using adaptive correlation filters with complex constraints,” Opt. Commun. 309, 265−278 (2013).
N. Leopoldo, VictorH. Gaxiola, and J. J. T. Diaz-Ramirez, “Target tracking using interest point detection and correlation filtering,” Proc. SPIE 9217, 9217−8 (2014).
L. N. Gaxiola, V. H. Daz-Ramrez, J. J. Tapia, et al., “Robust face tracking with locally-adaptive correlation filtering,” in Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (Proc. 19th Iberoamerican Congress, CIARP 2014, Puerto Vallarta, Mexico, November 2−5,2014) (CIARP, 2014), pp. 925−932.
A. Cuevas, V. H. Diaz-Ramirez, V. Kober, and L. Trujillo, “Facial recognition using composite correlation filters designed with multiobjective combinatorial optimization,” Proc. SPIE 9217, 921710−8 (2014).
L. N. Gaxiola, V. H. Diaz-Ramirez, J. J. Tapia, and P. Garcia-Martinez, “Target tracking with dynamically adaptive correlation,” Opt. Commun. 365, 140−149 (2016).
A. Ruchay and V. Kober, “A correlation-based algorithm for recognition and tracking of partially occluded objects,” Proc. SPIE 9971, 99712 (2016).
A. Ruchay, V. Kober, and J. A. Gonzalez-Fraga, “Reliable recognition of partially occluded objects with correlation Filters,” Math. Problems Eng. 2018, 8284123 (2018).
P. M. Aguilar-Gonzalez and V. Kober, “Design of correlation filters for pattern recognition with disjoint reference image,” Opt. Eng. 50, 117201 (2011).
P. M. Aguilar-Gonzalez and V. Kober, “Design of correlation filters for pattern recognition using a noisy reference,” Opt. Commun. 285, 574−583 (2012).
E. M. Ramos-Michel and V. Kober, “Adaptive composite filters for pattern recognition in linearly degraded and noisy scenes,” Opt. Eng. 47, 047204−7 (2008).
P.-M. Lee and H.-Y. Chen, “Adjustable gamma correction circuit for Tft Lcd,” in Proc. IEEE Int. Symp. on Circuits and Systems, Kobe, Japan,2005 (IEEE, New York, 2005), pp. 780−783.
P. Gupta, Comprehensive Business Statistics (Laxmi Publ., 2005).
Y. Wu, J. Lim, and M. H. Yang, “Object tracking benchmark,” IEEE Trans. Pattern Analysis & Machine Intell. 37, 1834−1848 (2015).
T. Al-Asadi and A. Obaid, “Object detection and recognition by using enhanced speeded up robust feature,” Int. J. Comp. Sci. Network Security 16 (4), 66−71 (2016).
P. H. S. Torr, S. Hare, and A. Saffari, “Struck: Structured output tracking with kernels,” in Proc. IEEE Int. Conf. on Computer Vision (ICCV 2011), Barcelona, Spain, Nov. 2011 (IEEE, New York, 2011), pp. 263−270.
W. Zhong, “Robust object tracking via sparsity-based collaborative model,” in Proc. 2012 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR’12), Providence, RI, June 2012 (IEEE Computer Soc., Washington, 2012), pp. 1838−1845.
S. E. Ontiveros-Gallardo and V. Kober, “Correlation-based tracking using tunable training and Kalman prediction,” Proc. SPIE 9971, 997129−9 (2016).
Funding
This work was supported by the Russian Science Foundation, project no. 17-76-20045.
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated by E. Oborin
Rights and permissions
About this article
Cite this article
Kober, V.I., Ruchay, A.N. & Karnaukhov, V.N. Tracking Multiple Objects with Locally Adaptive Generalized Optimum Correlation Filters. J. Commun. Technol. Electron. 65, 716–724 (2020). https://doi.org/10.1134/S1064226920060169
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1064226920060169