Cited By
View all- Li XYu QAlzahrani BBarnawi AAlhindi AAlghazzawi DMiao Y(2021)Data Fusion for Intelligent Crowd Monitoring and Management Systems: A SurveyIEEE Access10.1109/ACCESS.2021.30606319(47069-47083)Online publication date: 2021
Development of Intelligent Human Flow Density Detection System based on Sensor Fusion
Pages 59 - 63
Abstract
Crowd counting and human flow estimation is the critical technique for modern sociality safety. In this study, the intelligent human flow density detection system based on sensor fusion technique are developed. The system includes three kinds of subsystems. The image subsystem employs SSD neural network and CSRNet to estimate human counting and crowd density map. The LiDAR subsystem uses Voxel Grid filter, RANSAC estimation, KD tree background subtraction and Kalman filter to detect and track human flow. Through using Image and LiDAR chessboard calibration algorithm, the extrinsic calibration parameters of the 3D-2D transformation matrix are estimated. The system can re-project distance information of point clouds to the image space and display the human density map in point cloud space. Three kinds of different crowd environmental conditions were selected to verify the performance of the proposed system. The results of experiment testify the proposed system achieved human counting and human flow detection in the scan field.
References
[1]
Saqib, M., et al., Crowd Counting in Low-Resolution Crowded Scenes Using Region-Based Deep Convolutional Neural Networks. IEEE Access, 2019. 7: 35317--35329.
[2]
Sindagi, V.A. and V.M. Patel, A survey of recent advances in CNN-based single image crowd counting and density estimation. Pattern Recognition Letters, 2018. 107: 3--16.
[3]
Liu, Y.a.S., Miaojing and Zhao, Qijun and Wang, Xiaofang, Point in, Box Out: Beyond Counting Persons in Crowds. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. June.
[4]
Chan, A.B. and N. Vasconcelos, Counting People With Low-Level Features and Bayesian Regression. IEEE Transactions on Image Processing, 2012. 21(4): 2160--2177.
[5]
Li, Y., X. Zhang, and D. Chen. CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes. IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018.
[6]
Zhang, W., et al. A SSD-based Crowded Pedestrian Detection Method. International Conference on Control, Automation and Information Sciences (ICCAIS). 2018.
[7]
Choi, W., et al. Fast Iterative Closest Point framework for 3D LIDAR data in intelligent vehicle. IEEE Intelligent Vehicles Symposium. 2012.
[8]
Maturana, D. and S. Scherer. VoxNet: A 3D Convolutional Neural Network for real-time object recognition. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2015.
[9]
Li, S., et al., Estimating Leaf Area Density of Individual Trees Using the Point Cloud Segmentation of Terrestrial LiDAR Data and a Voxel-Based Model. Remote Sensing, 2017. 9(11): 1202.
[10]
Pusztai, Z., I. Eichhardt, and L. Hajder, Accurate Calibration of Multi-LiDAR-Multi-Camera Systems. Sensors, 2018. 18(7): 2139.
[11]
Wang, W., K. Sakurada, and N. Kawaguchi, Reflectance Intensity Assisted Automatic and Accurate Extrinsic Calibration of 3D LiDAR and Panoramic Camera Using a Printed Chessboard. Remote Sensing, 2017. 9(8): 851.
Index Terms
- Development of Intelligent Human Flow Density Detection System based on Sensor Fusion
Recommendations
Fusion of color and infrared video for moving human detection
We approach the task of human silhouette extraction from color and thermal image sequences using automatic image registration. Image registration between color and thermal images is a challenging problem due to the difficulties associated with finding ...
Combining Intelligent Techniques for Sensor Fusion
Mobile robots rely on sensor data to build a representation of their environment. However, sensors usually provide incomplete, inconsistent or inaccurate information. Sensor fusion has been successfully employed to enhance the accuracy of sensor ...
Fusion of 2d and 3d sensor data for articulated body tracking
In this article, we present an approach for the fusion of 2d and 3d measurements for model-based person tracking, also known as Human Motion Capture. The applied body model is defined geometrically with generalized cylinders, and is set up ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2020
271 pages
ISBN:9781450376587
DOI:10.1145/3390557
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- The Hong Kong Polytechnic: The Hong Kong Polytechnic University
- Xi'an Jiaotong-Liverpool University: Xi'an Jiaotong-Liverpool University
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2020
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Xiamen University Tan Kah Kee College
Conference
ICIAI 2020
ICIAI 2020: 2020 the 4th International Conference on Innovation in Artificial Intelligence
May 8 - 11, 2020
Xiamen, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 79Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Sep 2024
Other Metrics
Citations
Cited By
View all- Li XYu QAlzahrani BBarnawi AAlhindi AAlghazzawi DMiao Y(2021)Data Fusion for Intelligent Crowd Monitoring and Management Systems: A SurveyIEEE Access10.1109/ACCESS.2021.30606319(47069-47083)Online publication date: 2021
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in