short-paper

Application of Multi-Object Tracking with Siamese Track-RCNN to the Human in Events Dataset

Authors:

Joseph TigheAuthors Info & Claims

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

Pages 4625 - 4629

https://doi.org/10.1145/3394171.3416297

Published: 12 October 2020 Publication History

Get Access

Abstract

Multi-object tracking systems often consist of a combination of a detector, a short term linker, a re-identification feature extractor and a solver that takes the output from these separate components and makes a final prediction. Differently, this work aims to unify all these in a single tracking system. Towards this, we propose Siamese Track-RCNN, a two stage detect-and-track framework which consists of three functional branches: (1) the detection branch localizes object instances; (2) the Siamese-based track branch estimates the object motion and (3) the object re-identification branch re-activates the previously terminated tracks when they re-emerge. We used this design and apply it to the Human in Events dataset.

Supplementary Material

MP4 File (3394171.3416297.mp4)

This video presents our work about Multi-object tracking on Human In Events Challenge. We present the detailed network architecture of Siamese Track-RCNN, and then we present its quantitative and qualitative results on HIE Challenge dataset.

Download
77.37 MB

References

[1]

Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. 2017. Deformable convolutional networks. In ICCV.

Google Scholar

[2]

Piotr Dollar, Christian Wojek, Bernt Schiele, and Pietro Perona. 2011. Pedestrian detection: An evaluation of the state of the art. IEEE transactions on pattern analysis and machine intelligence, Vol. 34, 4 (2011), 743--761.

Google Scholar

[3]

Jules. Harvey, Adam. LaPlace. 2019. MegaPixels: Origins, Ethics, and Privacy Implications of Publicly Available Face Recognition Image Datasets. https://megapixels.cc/

Google Scholar

[4]

Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask r-cnn. In ICCV.

Google Scholar

[5]

David Held, Sebastian Thrun, and Silvio Savarese. 2016. Learning to track at 100 fps with deep regression networks. In ECCV.

Google Scholar

[6]

Tsung-Yi Lin, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. 2017. Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2117--2125.

Crossref

Google Scholar

[7]

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In ECCV.

Google Scholar

[8]

Weiyao Lin, Huabin Liu, Shizhan Liu, Yuxi Li, Guo-Jun Qi, Rui Qian, Tao Wang, Nicu Sebe, Ning Xu, Hongkai Xiong, and Mubarak Shah. 2020. Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events. arXiv preprint arXiv:2005.04490 (2020).

Google Scholar

[9]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In NeurIPS.

Google Scholar

[10]

Shuai Shao, Zijian Zhao, Boxun Li, Tete Xiao, Gang Yu, Xiangyu Zhang, and Jian Sun. 2018. CrowdHuman: A Benchmark for Detecting Human in a Crowd. arXiv preprint arXiv:1805.00123 (2018).

Google Scholar

[11]

Bing Shuai, Andrew G Berneshawi, Davide Modolo, and Joseph Tighe. 2020. Multi-Object Tracking with Siamese Track-RCNN. arXiv preprint arXiv:2004.07786 (2020).

Google Scholar

[12]

Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, and Xiaogang Wang. 2016. End-to-end deep learning for person search. arXiv preprint arXiv:1604.01850, Vol. 2, 2 (2016).

Google Scholar

[13]

Fisher Yu, Dequan Wang, Evan Shelhamer, and Trevor Darrell. 2018. Deep layer aggregation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2403--2412.

Crossref

Google Scholar

[14]

Liang Zheng, Hengheng Zhang, Shaoyan Sun, Manmohan Chandraker, Yi Yang, and Qi Tian. 2017. Person re-identification in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1367--1376.

Crossref

Google Scholar

Cited By

View all

Wang PWang YLi D(2024)DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objects2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610941(7397-7404)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610941
Du CLin CJin RChai BYao YSu S(2024)Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future DirectionsMultimedia Tools and Applications10.1007/s11042-023-17983-283:29(73151-73189)Online publication date: 9-Feb-2024
https://doi.org/10.1007/s11042-023-17983-2
Hyun JKang MWee DYeung D(2023)Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00483(4839-4848)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00483
Show More Cited By

Index Terms

Application of Multi-Object Tracking with Siamese Track-RCNN to the Human in Events Dataset
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking

Recommendations

Multi-object tracking with inter-feedback between detection and tracking

Multi-object tracking is an important but challenging task in computer vision. Tremendous investigations have been made on the topics, among which tracking-by-detection method first detects objects independently at each frame and then links the detected ...
Multi-object Tracking under Occlusion Using Dual-Mode Graph Embedding
ACPR '13: Proceedings of the 2013 2nd IAPR Asian Conference on Pattern Recognition

In this paper we address the problem of tracking multiple objects to know how objects are moving (e.g. occlusion relationships) while interacting with each other in a group, given models of their appearances that are learned online even when occlusion ...
The research of multi-object tracking algorithm using Kalman filtering method

Aiming at the tracking failure caused by occlusion between objects, interleaving or target drift in multi-object tracking process, and the new improved algorithm of occlusion prediction tracking based on Kalman filtering and spatiograms was proposed. By ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '20: Proceedings of the 28th ACM International Conference on Multimedia

October 2020

4889 pages

ISBN:9781450379885

DOI:10.1145/3394171

General Chairs:
Chang Wen Chen
Chinese University of Hong Kong, Shenzhen, China
,
Rita Cucchiara
UNIMORE, Italy
,
Xian-Sheng Hua
Alibaba Group, China
,
Program Chairs:
Guo-Jun Qi
Futurewei Technologies, USA
,
Elisa Ricci
UNITN & Fondazione Bruno Kessler, Italy
,
Zhengyou Zhang
Tencent, China
,
Roger Zimmermann
National University of Singapore, Singapore

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '20

Sponsor:

SIGMM

MM '20: The 28th ACM International Conference on Multimedia

October 12 - 16, 2020

WA, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
314
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang PWang YLi D(2024)DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objects2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610941(7397-7404)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610941
Du CLin CJin RChai BYao YSu S(2024)Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future DirectionsMultimedia Tools and Applications10.1007/s11042-023-17983-283:29(73151-73189)Online publication date: 9-Feb-2024
https://doi.org/10.1007/s11042-023-17983-2
Hyun JKang MWee DYeung D(2023)Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV56688.2023.00483(4839-4848)Online publication date: Jan-2023
https://doi.org/10.1109/WACV56688.2023.00483
Agrawal HHalder AChattopadhyay P(2023)A systematic survey on recent deep learning-based approaches to multi-object trackingMultimedia Tools and Applications10.1007/s11042-023-16910-983:12(36203-36259)Online publication date: 26-Sep-2023
https://doi.org/10.1007/s11042-023-16910-9
Liu YLi YXu DYang QTao W(2023)Adaptive Kalman Filter with power transformation for online multi-object trackingMultimedia Systems10.1007/s00530-023-01052-729:3(1231-1244)Online publication date: 23-Jan-2023
https://doi.org/10.1007/s00530-023-01052-7
Xu NLin WLu XWei YXu NLin WLu XWei Y(2023)HiEve Challenge on VOTVideo Object Tracking10.1007/978-3-031-44660-3_3(117-123)Online publication date: 5-Dec-2023
https://doi.org/10.1007/978-3-031-44660-3_3
Wang SSheng HYang DZhang YWu YWang S(2022)Extendable Multiple Nodes Recurrent Tracking Framework With RTU++IEEE Transactions on Image Processing10.1109/TIP.2022.319270631(5257-5271)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3192706
Liang CZhang ZZhou XLi BZhu SHu W(2022)Rethinking the Competition Between Detection and ReID in Multiobject TrackingIEEE Transactions on Image Processing10.1109/TIP.2022.316537631(3182-3196)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3165376
He YWei XHong XKe WGong Y(2022)Identity-Quantity Harmonic Multi-Object TrackingIEEE Transactions on Image Processing10.1109/TIP.2022.315428631(2201-2215)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3154286
Xie LHu MBai X(2022)Online Improved Vehicle Tracking Accuracy via Unsupervised Route Generation2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI)10.1109/ICTAI56018.2022.00121(788-792)Online publication date: Oct-2022
https://doi.org/10.1109/ICTAI56018.2022.00121
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multi-object tracking with inter-feedback between detection and tracking

Multi-object Tracking under Occlusion Using Dual-Mode Graph Embedding

The research of multi-object tracking algorithm using Kalman filtering method