Detecting multiple moving objects for unusual crowd activities detection in video surveillance system
Pages 3789 - 3798
Abstract
Unusual crowd activity detection is a challenging problem in surveillance video applications because feature extraction is difficult process in crowded scenes. The main objective of this research work is to detect unusual crowd activities and to detect unusual splits of moving objects. Various methods have been employed to address these challenges. However, there is still a lack of appropriate handling of this problem due to frames having occlusion, noise, and congestion. This paper proposes a novel clustering approach to detect unusual crowd activities. The proposed method consists of five phases including foreground extraction, foreground enhancement, foreground estimation, clustering crowds, and the Unusual Crowd Activities (UCA) model. The UCA model can find unusual crowd activities and unusual splits of moving objects using the Laplacian Matrix formulation. Two public datasets viz. PETS 2009 and UMN dataset are used for evaluating the proposed methodology. To estimate the effectiveness of the proposed work, several unusual event detection methods are compared with the proposed work results. The experimental results revealed that the proposed method gives better results than the existing methods.
References
[1]
Chang C., Ansari R. and Khokhar A., Multiple object tracking with kernel particle filter, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1 (2005), 566–573.
[2]
Chang F., Chen C.J. and Lu C.J., A linear-time component labeling algorithm using contour tracing technique, Computer Vision and Image Understanding 93(2) (2004), 206–220.
[3]
Hampapur, L. Brown, J. Connell, A. Ekin, N. Haas, M. Lu, H. Merkl, S. Pankanti, A. Senior, C. Shu and Y.L. Tian, Smart video surveillance, IEEE Signal Processing Magazine 22(2) (2005), 38–51.
[4]
Haralick R.M., Stemberg S.R. and Zhuang X., Image analysis using mathematical morphology, IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9(4) (1987), 532–550.
[5]
Haritaoglu, D. Harwood and L.S. Davis, W4: Real-time surveillance of people and their activities, IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8) (2000), 809–830.
[6]
Asha Paul M., Kavitha J. and Jansi Rani P., Keyframe extraction techniques: A review, Recent Patents on Computer Science 11(1) (2018), 3–16.
[7]
Javed O. and Shah M., Tracking and Object Classification forAutomated Surveillance, 7th European Conference on Computer Vision, Lecture Notes in Computer Science 2353 (2002), 343–357.
[8]
Asha Paul M., Sampath Kumar K., Sagar Shrddha and Sreeji S., LWDS: lightweight DeepSeagrass technique for classifying seagrass from underwater images, Environmental Monitoring and Assessment 195(5) (2023), 1–11.
[9]
Lao W., Han J. and Peter H.N., Automatic video-based human motion analyzer for consumer surveillance system, IEEE Transactions on Consumer Electronics 55(2) (2009), 591–598.
[10]
Makris D. and Ellis T., Automatic learning of an activity-based semantic scene model, Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance (2003), 183–188.
[11]
Sedky M.H., Moniri M. and Chibelushi C.C., Classification of smart video surveillance systems for commercial applications, IEEE Conference on Advanced Video and Signal Based Surveillance (2005), 638–643.
[12]
Stauffer C. and Grimson W., Learning patterns of activity using real time tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8) (2000), 747–767.
[13]
Valera M. and Velastine S.A., A review of the state-of-art in distributed surveillance systems, IEE Intelligent Distributed Video Surveillance Systems (2006), 1–30.
[14]
Zhai Y., Yeary M.B., Cheng S. and Keharnavaz N., An object-tracking algorithm based on multiple-model particle filtering with state partitioning, IEEE Transactions on Instrumentation and Measurement 58(5) (2009), 1797–1809.
[15]
Zhang R., Zhang S. and Yu S., Moving objects detection method based on brightness distortion and chromaticity distortion, IEEE Transactions on Consumer Electronics 53(3) (2007), 1177–1185.
[16]
Kratz L., Nishino K., Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models, in: CVR’09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, FL, USA, pp. 1446–1453, 2009.
[17]
Kim J., Grauman K., Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates, in: CVR’09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Florida, USA, pp. 2921–2928. 2009.
[18]
Benezeth Y., Jodoin P., Saligrama V. and Rosenberger C., Abnormal events detection based on spatio-temporal co-occurrences, in: CVPR’09: IEEE Com- puter Society Conference on Computer Vision and Pattern Recognition, FL, USA, pp. 2458–2465, 2009.
[19]
Andrade E., Fisher R., Blunsden S., Detection of emergency events in crowded scenes, in: The Institution of Engineering and Technology Conference on Crime and Security, 2006, London, UK, pp. 528–533, 2006.
[20]
Yin J., Hu D., Yang Q., Spatio-temporal event detection using dynamic conditional random fields, in: IJCAI’09: Proceedings of 21st International Joint Conference on Artificial Intelligence, vol. 9, Los Angeles, USA, pp. 1321–1327, 2009.
[21]
Wu X., Ou Y., Qian H., Xu Y., A detection system for human abnormal behavior, in: IROS’05: IEEE/RSJ International Conference on Intelligent Robots and Systems, Alberta, Canada, pp. 1204–1208, 2005.
[22]
Wang S., Miao Z., Anomaly detection in crowd scene, in: ICS’10:10th IEEE International Conference on Signal Processing, Beijing, China, pp. 1220–1223, 2010.
[23]
Wu S., Moore B., Shah M., Chaotic invariants of lagrangian particle trajec- tories for anomaly detection in crowded scenes, in: CVR’10: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Florida, USA, pp. 2054–2060, 2010.
[24]
Direkoglu C., Abnormal crowd behavior detection using motion information images and convolutional neural networks, IEEE Access 8 (2020), 80408–80416.
[25]
Song H., Sun C., Wu X., Chen M. and Jia Y., Learning Normal Patterns via Adversarial Attention-Based Autoencoder for Abnormal Event Detection in Videos, in IEEE Transactions on Multimedia 22(8) (2020), 2138–2148.
[26]
Haidar Sharif Md., Lei Jiao and Christian W. Omlin, Deep Crowd Anomaly Detection by Fusing Reconstruction and Prediction Networks, MDPI, Electronics (2023), 1–41.
[27]
Rajasekaran G. and Raja Sekar J., Abnormal Crowd Behavior Detection Using Optimized Pyramidal Lucas-Kanade Technique, Intelligent Automation & Soft Computing (2023), 2439–2412.
[28]
Xie J.S., Guo L., Chen Y.B. and Z.L., The detection of unusual events in video based on Bayesian surprise model, in: ICISE’10: the 2nd International Conference on Information Science and Engineering, Hangzhou, China, pp. 4784–4788, 2010.
[29]
Chen D., Huang P., Dynamic human crowd modeling and its application to anomalous events detection, ICME’10: IEEE International Conference on Multimedia and Exo, 2010, Singapore, pp. 1582–1587, 2010.
[30]
Yong L., Dongjian H., Video-based detection of abnormal behavior in the examination room, in: IFITA’10: International Forum on Information Technology and Alications, vol. 3, Kunming, China, pp. 295–298, 2010.
[31]
Ihaddadene N., Djeraba C., Real-time crowd motion analysis, in: ICR’08: the 19th International Conference on Pattern Recognition, FL, USA, pp. 1–4, 2008.
[32]
Mehran R., Oyama A., Shah M., Abnormal crowd behavior detection using social force model, in: CVR’09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, FL, USA, pp. 935–942, 2009.
[33]
Sharif M., Ihaddadene N., Djeraba C., Crowd behaviour monitoring on the escalator exits, in: ICCIT’08: the 11th International Conference on Comuter and Information Technology, Venice, Italy, pp. 194–200, 2008.
[34]
Zhong Z., Ye W., Wang S., Yang M., Xu Y., Crowd energy and feature analysis, in: ICIT’07: IEEE International Conference on Integration Technology, Shenz-hen, China,144–150, 2007.
[35]
Lalit, Ruchika and Ravindra Kumar Purwar, Crowd Abnormality Detection Using Optical Flow and GLCM-Based Texture Features, JITR 15 (2022), 1–15.
[36]
Vennila T.J. and Balamurugan V., A rough set framework for multihuman tracking in surveillance video, in IEEE Sensors Journal 23(8) (2023), 8753–8760.
[37]
Elhoseny M., Multi-object Detection and Tracking (MODT) Machine Learning Model for Real-Time Video Surveillance Systems, Circuits Syst Signal Process 39 (2020), 611–630.
[38]
Vennila T.J. and Balamurugan V., A Stochastic Framework for Keyframe Extraction, 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE) 2020 (2020), 1–5.
[41]
Ren W., Li G., Chen J. and Liang H., Abnormal crowd behavior detection using behavior entropy model, in Proc. of the Int. Conf. on Wavelet Analysis and Pattern Recognition, Xi’an, China, pp. 212–221, 2012.
[42]
Gnouma M., Ejbali R. and Zaied M., Abnormal events’ detection in crowded scenes, Multimedia Tools andApplications 77(19) (2018), 24843–24864.
[43]
Ravanbakhsh M., Nabi M., Sangineto E., Marcenaro L. and Regazzonietal C., Abnormal event detection in videos using generative adversarial nets, in Proc. of the IEEE Int. Conf. on Image Processing (ICIP), Beijing, China, (2017), 1577–1581.
[44]
Cong Y., Yuan J. and Liu J., Abnormal event detection in crowded scenes using sparse representation, Pattern Recognition 46(7) (2013), 1851–1864.
Recommendations
A Review on Crowd Behavior Analysis Methods for Video Surveillance
ICTCS '16: Proceedings of the Second International Conference on Information and Communication Technology for Competitive StrategiesAbnormal Crowd Detection has become the most viral and active research topic in computer vision. There is need of automated tracking of the abnormalities in surveillance video sequence for the detection of abnormal events. These systems are mainly used ...
Detecting contextual anomalies of crowd motion in surveillance video
ICIP'09: Proceedings of the 16th IEEE international conference on Image processingMany works have been proposed on detecting individual anomalies in crowd scenes, i.e., human behaviors anomalous with respect to the rest of the behaviors. In this paper, we introduce a new concept of contextual anomaly into the field of crowd analysis, ...
Motion-based unusual event detection in human crowds
Analyzing human crowds is an important issue in video surveillance and is a challenging task due to their nature of non-rigid shapes. In this paper, optical flows are first estimated and then used for a clue to cluster human crowds into groups in ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2024 – IOS Press. All rights reserved.
Publisher
IOS Press
Netherlands
Publication History
Published: 14 February 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Jan 2025