Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3552437.3555692acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

A Person Re-identification Approach Focusing on the Occlusion Problem and Ranking Optimization

Published: 10 October 2022 Publication History

Abstract

Person re-identification (Re-ID) aims to re-identify people across multiple video frames captured at various time instants. With the advancement of deep neural networks and increasing demand of intelligent video surveillance, recent works have proposed many deep learning based approaches to address the task. However, many state-of-the-arts Re-ID methods are not robust enough and do not perform well on the Synergy Re-Identification dataset provided by the DeepSportRadar Player Re-Identification Challenge due to the severe occlusion problem. To better re-identify basketball players, we propose a person Re-ID approach that focuses on the occlusion problem and ranking optimization. Specifically, our proposed approach consists of two stages. In the first stage we extract the global features and local features of the input image by two branches respectively. In the second stage, we propose a ranking optimization method that consists of three steps: k-reciprocal re-ranking, metric fusion, and distance mapping. We conduct extensive experiments to show that our proposed approach can achieve superior performance compared with the state-of-the-art methods and we also experimentally evaluate the training tricks and ranking optimization methods of existing Re-ID methods. Our proposed method achieves $98.38%$ mAP and $99.57%$ rank-1 on the challenge set of the Synergy Re-Identification dataset, and with this method our team, Fiery Tyrannosaurus Warrior, won the second place in the DeepSportRadar Player Re-Identification Challenge. Furthermore, we provide some ideas for potentially achieving better performance on the Synergy Re-Identification dataset.

Supplementary Material

MP4 File (MMSports22-mmspor26.mp4)
Presentation Video of A Person Re-identification Approach Focusing on the Occlusion Problem and Ranking Optimization.

References

[1]
Song Bai, Xiang Bai, and Qi Tian. 2017. Scalable person re-identification on supervised smoothed manifold. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2530--2539.
[2]
Song Bai, Peng Tang, Philip HS Torr, and Longin Jan Latecki. 2019. Re-ranking via metric fusion for object retrieval and person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 740--749.
[3]
Song Bai, Zhichao Zhou, Jingdong Wang, Xiang Bai, Longin Jan Latecki, and Qi Tian. 2017. Ensemble diffusion for retrieval. In Proceedings of the IEEE International conference on computer vision. 774--783.
[4]
Arko Barman and Shishir K Shah. 2017. Shape: A novel graph theoretic algorithm for making consensus-based decisions in person re-identification systems. In Proceedings of the IEEE International Conference on Computer Vision. 1115--1124.
[5]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multiperson 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7291--7299.
[6]
Ondrej Chum, James Philbin, Josef Sivic, Michael Isard, and Andrew Zisserman. 2007. Total recall: Automatic query expansion with a generative feature model for object retrieval. In 2007 IEEE 11th International Conference on Computer Vision. IEEE, 1--8
[7]
Ekin D Cubuk, Barret Zoph, Dandelion Mane, Vijay Vasudevan, and Quoc V Le. 2018. Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501 (2018).
[8]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248--255.
[9]
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).
[10]
Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai, and Cewu Lu. 2017. Rmpe: Regional multi-person pose estimation. In Proceedings of the IEEE international conference on computer vision. 2334--2343.
[11]
Dengpan Fu, Dongdong Chen, Jianmin Bao, Hao Yang, Lu Yuan, Lei Zhang, Houqiang Li, and Dong Chen. 2021. Unsupervised pre-training for person reidentification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 14750--14759.
[12]
Shang Gao, Jingya Wang, Huchuan Lu, and Zimo Liu. 2020. Pose-guided visible part matching for occluded person reid. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11744--11752.
[13]
Jorge Garcia, Niki Martinel, Alfredo Gardel, Ignacio Bravo, Gian Luca Foresti, and Christian Micheloni. 2017. Discriminant context information analysis for post-ranking person re-identification. IEEE Transactions on Image Processing 26, 4 (2017), 1650--1665.
[14]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[15]
Lingxiao He, Xingyu Liao, Wu Liu, Xinchen Liu, Peng Cheng, and Tao Mei. 2020. Fastreid: A pytorch toolbox for general instance re-identification. arXiv preprint arXiv:2006.02631 (2020).
[16]
Shuting He, Hao Luo, Pichao Wang, Fan Wang, Hao Li, and Wei Jiang. 2021. Transreid: Transformer-based object re-identification. In Proceedings of the IEEE/CVF international conference on computer vision. 15013--15022.
[17]
Alexander Hermans, Lucas Beyer, and Bastian Leibe. 2017. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737 (2017).
[18]
Herve Jegou, Hedi Harzallah, and Cordelia Schmid. 2007. A contextual dissimilarity measure for accurate and efficient image search. In 2007 IEEE Conference on computer vision and pattern recognition. IEEE, 1--8.
[19]
Chuanchen Luo, Yuntao Chen, Naiyan Wang, and Zhaoxiang Zhang. 2019. Spectral feature transformation for person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision. 4976--4985.
[20]
Hao Luo, Youzhi Gu, Xingyu Liao, Shenqi Lai, and Wei Jiang. 2019. Bag of tricks and a strong baseline for deep person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. 0--0.
[21]
Hao Luo, Pichao Wang, Yi Xu, Feng Ding, Yanxin Zhou, Fan Wang, Hao Li, and Rong Jin. 2021. Self-Supervised Pre-Training for Transformer-Based Person Re-Identification. arXiv preprint arXiv:2111.12084 (2021).
[22]
Alejandro Newell, Zhiao Huang, and Jia Deng. 2017. Associative embedding: Endto-end learning for joint detection and grouping. Advances in neural information processing systems 30 (2017).
[23]
Danfeng Qin, Stephan Gammeter, Lukas Bossard, Till Quack, and Luc Van Gool. 2011. Hello neighbor: Accurate object retrieval with k-reciprocal nearest neighbors. In CVPR 2011. IEEE, 777--784.
[24]
M Saquib Sarfraz, Arne Schumann, Andreas Eberle, and Rainer Stiefelhagen. 2018. A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In Proceedings of the IEEE conference on computer vision and pattern recognition. 420--429.
[25]
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Shai Avidan, and Ying Wu. 2012. Object retrieval and localization with spatially-constrained similarity measure and k-nn re-ranking. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3013--3020.
[26]
Yifan Sun, Changmao Cheng, Yuhan Zhang, Chi Zhang, Liang Zheng, Zhongdao Wang, and Yichen Wei. 2020. Circle loss: A unified perspective of pair similarity optimization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6398--6407.
[27]
Guan'an Wang, Shuo Yang, Huanyu Liu, Zhicheng Wang, Yang Yang, Shuliang Wang, Gang Yu, Erjin Zhou, and Jian Sun. 2020. High-order information matters: Learning relation and topology for occluded person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 6449--6458.
[28]
Guanshuo Wang, Yufeng Yuan, Xiong Chen, Jiwei Li, and Xi Zhou. 2018. Learning discriminative features with multiple granularities for person re-identification. In Proceedings of the 26th ACM international conference on Multimedia. 274--282.
[29]
Mikoaj Wieczorek, Barbara Rychalska, and Jacek Dbrowski. 2021. On the unreasonable effectiveness of centroids in image retrieval. In International Conference on Neural Information Processing. Springer, 212--223.
[30]
Mang Ye, Chao Liang, Zheng Wang, Qingming Leng, and Jun Chen. 2015. Ranking optimization for person re-identification via similarity and dissimilarity. In Proceedings of the 23rd ACM international conference on Multimedia. 1239--1242.
[31]
Mang Ye, Chao Liang, Yi Yu, Zheng Wang, Qingming Leng, Chunxia Xiao, Jun Chen, and Ruimin Hu. 2016. Person reidentification via ranking aggregation of similarity pulling and dissimilarity pushing. IEEE Transactions on Multimedia 18, 12 (2016), 2553--2566.
[32]
Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, and Steven CH Hoi. 2021. Deep learning for person re-identification: A survey and outlook. IEEE transactions on pattern analysis and machine intelligence 44, 6 (2021), 2872--2893.
[33]
Xianghao Zang, Ge Li, Wei Gao, and Xiujun Shu. 2021. Learning to disentangle scenes for person re-identification. Image and Vision Computing 116 (2021), 104330.
[34]
Zhun Zhong, Liang Zheng, Donglin Cao, and Shaozi Li. 2017. Re-ranking person re-identification with k-reciprocal encoding. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1318--1327.
[35]
Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2020. Random erasing data augmentation. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 13001--13008

Cited By

View all

Index Terms

  1. A Person Re-identification Approach Focusing on the Occlusion Problem and Ranking Optimization

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MMSports '22: Proceedings of the 5th International ACM Workshop on Multimedia Content Analysis in Sports
    October 2022
    152 pages
    ISBN:9781450394888
    DOI:10.1145/3552437
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. challenge paper
    2. feature extraction
    3. player re-identification
    4. ranking optimization

    Qualifiers

    • Research-article

    Conference

    MM '22
    Sponsor:

    Acceptance Rates

    MMSports '22 Paper Acceptance Rate 17 of 26 submissions, 65%;
    Overall Acceptance Rate 29 of 49 submissions, 59%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 108
      Total Downloads
    • Downloads (Last 12 months)25
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 21 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media