A Perimeter Alert Surveillance system based on pedestrian detection and dual-threshold selection for local binocular ranging
Pages 451 - 457
Abstract
Perimeter alert surveillance is an early warning system used for monitoring the warning area and detecting pedestrians entering by mistake or abnormal behavior. It has a wide range of application scenarios. Computer vision based surveillance is an efficient and safe method. We propose an early warning system based on pedestrian detection and binocular ranging, which is able to detect approaching pedestrians from surveillance equipment and calculate the distance between pedestrians and photographing equipment. The model detects pedestrian candidate windows from the binocular image through YOLO network, and then uses the binocular algorithm to calculate the pedestrian distance. We calculate the local disparity map in the candidate window with the consideration of the real-time performance and the proportion of the candidate window in the whole image. At the same time, we propose a dual-threshold selection (DTS) algorithm, which divides the disparity map into foreground, middle ground and background. This helps remove background and occlusion interference in the foreground and background, and improve the accuracy of distance calculation.
References
[1]
Mina Etehadi Abari. 2018. A Novel Pedestrian Detection Method Based on Combination of LBP, HOG, and Haar-Like Features. In 2018 IEEE International Conference on Electro/Information Technology, EIT 2018, Rochester, MI, USA, May 3-5, 2018. IEEE, 55–66. https://doi.org/10.1109/EIT.2018.8500235
[2]
Cheng Chi, Shifeng Zhang, Junliang Xing, Zhen Lei, Stan Z. Li, and Xudong Zou. 2020. PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020. AAAI Press, 10639–10646.
[3]
N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), Vol. 1. 886–893 vol. 1. https://doi.org/10.1109/CVPR.2005.177
[4]
Alberto Garcia-Garcia, Sergio Orts-Escolano, Sergiu Oprea, Victor Villena-Martinez, and José García Rodríguez. 2017. A Review on Deep Learning Techniques Applied to Semantic Segmentation. CoRR abs/1704.06857(2017). arXiv:1704.06857http://arxiv.org/abs/1704.06857
[5]
Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2014. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[6]
Irtiza Hasan, Shengcai Liao, Jinpeng Li, Saad Ullah Akram, and Ling Shao. 2021. Generalizable Pedestrian Detection: The Elephant in the Room. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021. Computer Vision Foundation / IEEE, 11328–11337. https://openaccess.thecvf.com/content/CVPR2021/html/Hasan_Generalizable_Pedestrian_Detection_The_Elephant_in_the_Room_CVPR_2021_paper.html
[7]
Wei-Yen Hsu and Wen-Yen Lin. 2021. Ratio-and-Scale-Aware YOLO for Pedestrian Detection. IEEE Trans. Image Process. 30 (2021), 934–947. https://doi.org/10.1109/TIP.2020.3039574
[8]
Jiaojiao Li, Jiaji Wu, Yang You, and Gwanggil Jeon. 2020. Parallel binocular stereo-vision-based GPU accelerated pedestrian detection and distance computation. J. Real Time Image Process. 17, 3 (2020), 447–457. https://doi.org/10.1007/s11554-018-0783-y
[9]
Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In Computer Vision - ECCV 2014 - 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V(Lecture Notes in Computer Science, Vol. 8693), David J. Fleet, Tomás Pajdla, Bernt Schiele, and Tinne Tuytelaars (Eds.). Springer, 740–755. https://doi.org/10.1007/978-3-319-10602-1_48
[10]
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. 2020. Focal Loss for Dense Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 42, 2(2020), 318–327. https://doi.org/10.1109/TPAMI.2018.2858826
[11]
Nobuyuki Otsu. 1979. A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics 9, 1(1979), 62–66. https://doi.org/10.1109/TSMC.1979.4310076
[12]
Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. CoRR abs/1804.02767(2018). arXiv:1804.02767http://arxiv.org/abs/1804.02767
[13]
Florian Spiess, Lucas Reinhart, Norbert Strobel, Dennis Kaiser, Samuel Kounev, and Tobias Kaupp. 2021. People Detection with Depth Silhouettes and Convolutional Neural Networks on a Mobile Robot. Journal of Image and Graphics 9, 4 (2021).
[14]
Yuji Tsuduki and Hironobu Fujiyoshi. 2009. A Method for Visualizing Pedestrian Traffic Flow Using SIFT Feature Point Tracking. In Advances in Image and Video Technology, Third Pacific Rim Symposium, PSIVT 2009, Tokyo, Japan, January 13-16, 2009. Proceedings(Lecture Notes in Computer Science, Vol. 5414), Toshikazu Wada, Fay Huang, and Stephen Lin (Eds.). Springer, 25–36. https://doi.org/10.1007/978-3-540-92957-4_3
[15]
Shanshan Zhang, Rodrigo Benenson, and Bernt Schiele. 2017. CityPersons: A Diverse Dataset for Pedestrian Detection. In CVPR.
[16]
Shanshan Zhang, Jian Yang, and Bernt Schiele. 2018. Occluded Pedestrian Detection Through Guided Attention in CNNs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[17]
Qi Zhao, Boxue Zhang, Shuchang Lyu, Hong Zhang, Daniel Sun, Guoqiang Li, and Wenquan Feng. 2018. A CNN-SIFT Hybrid Pedestrian Navigation Method Based on First-Person Vision. Remote. Sens. 10, 8 (2018), 1229. https://doi.org/10.3390/rs10081229
Recommendations
Joint global-local information pedestrian detection algorithm for outdoor video surveillance
Our paper fully exploits global information to improve recognition performance.LBP extracted from image low-frequency part is used to suppress interference.Topology structure of human body is applied to LBP to make it discriminative.Our algorithm is ...
Consistency-Constancy Bi-Knowledge Learning for Pedestrian Detection in Night Surveillance
MM '21: Proceedings of the 29th ACM International Conference on MultimediaPedestrian detection in the night surveillance is a challenging yet not largely explored task. As the success of the detector in the daytime surveillance and the convenient acquisition of all-weather data, we learn knowledge from these data to benefit ...
Pedestrian detection aided by fusion of binocular information
In this paper, a pedestrian detection framework aided by the fusion of information between binocular vision is proposed. In this framework, we follow the intuition that a pedestrian has consistent appearance when observed from different viewpoints. A ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
March 2022
809 pages
ISBN:9781450396110
DOI:10.1145/3532213
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 July 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICCAI '22
ICCAI '22: 2022 8th International Conference on Computing and Artificial Intelligence
March 18 - 21, 2022
Tianjin, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 42Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format