The DARLENE XR platform for intelligent surveillance applications
Authors: 
Christos Ntoumanopoulos, Efstathia Martinopoulou, Iason Karakostas, Nikolaos Dimitriou, Dimitrios TzovarasAuthors Info & Claims
Pages 321 - 328
Abstract
Closed-circuit television (CCTV) systems play a significant role in the prevention and handling of criminal events. Although multiple cameras can reduce blind spots in surveillance areas, they tend to lack tools for automatic scene comprehension that could eliminate distractions and missed events. A novel intelligent surveillance system based on eXtended Reality (XR) and Computer Vision (CV) is developed to help analysts identify security incidents while improving their situational awareness by presenting them with a global representation of the area in VR. In addition, AR supervision and the ability to communicate with officers in the field, help headquarters to improve operational planning and simplify the coordination processes. The proposed platform offers real-time 3D human tracking and pose estimation in a virtual photo-realistic 3D environment equipped with a transparency layer that allows visibility in all premises of a building. In addition, informative visualizations overlay camera streams regarding 2D pose estimation, instance segmentation and activity recognition. The developed application has been tested in simulated security events, evaluating the provided functionalities.
References
[1]
Trevor Ainsworth. 2002. Buyer beware. Security Oz 19 (2002), 18–26.
[2]
Mohammed Mahmood Ali, Mohammed S. Qaseem, and Mohammed Hassan Shaji Khan. 2023. Survey of Surveillance of Suspicious Behavior from CCTV Video Recording. In Cyber Technologies and Emerging Sciences, Sudhanshu Maurya, Sateesh K. Peddoju, Badlishah Ahmad, and Ines Chihi (Eds.). Springer Nature Singapore, Singapore, 11–21.
[3]
Konstantinos C Apostolakis, Nikolaos Dimitriou, George Margetis, Stavroula Ntoa, Dimitrios Tzovaras, and Constantine Stephanidis. 2022. DARLENE–Improving situational awareness of European law enforcement agents through a combination of augmented reality and artificial intelligence solutions. Open Research Europe 1, 87 (2022), 87.
[4]
Saurabh Bhoite, Nagalakshmi Ravi, Kunal Giri, and Kunal Gupta. 2021. A CCTV Camera-Based Target Detection and Positioning UAV System. In 2021 Asian Conference on Innovation in Technology (ASIANCON). 1–6. https://doi.org/10.1109/ASIANCON51346.2021.9544830
[5]
Daniel Bolya, Chong Zhou, Fanyi Xiao, and Yong Jae Lee. 2019. Yolact: Real-time instance segmentation. In Proceedings of the IEEE/CVF international conference on computer vision. 9157–9166.
[6]
Polona Caserman, Miriam Cornel, Michelle Dieter, and Stefan Göbel. 2018. A Concept of a Training Environment for Police Using VR Game Technology: 4th Joint International Conference, JCSG 2018, Darmstadt, Germany, November 7-8, 2018, Proceedings. 175–181. https://doi.org/10.1007/978-3-030-02762-9_18
[7]
Aishwarya Chandel, SKS Yadav, AK Agarwal, Sudhakar Shukla, and Joyeeta Poddar. 2022. 3D Reconstruction of Heritage Site Using Terrestrial LiDAR Scanner (Tls): A Case Study of a Section of Gulistan-E-Iram, Lucknow. Sustainable Infrastructure Development (2022), 79–89.
[8]
Nikolaos Dimitriou, Georgios Kioumourtzis, A. Sideris, Georgios Stavropoulos, Evdoxia Taka, Nikolaos Zotos, George Leventakis, and Dimitrios Tzovaras. 2017. An Integrated Framework for the Timely Detection of Petty Crimes. 24–31. https://doi.org/10.1109/EISIC.2017.13
[9]
Achref Doula, Alejandro Guinea, and Max Mühlhäuser. 2022. VR-Surv: a VR-Based Privacy Preserving Surveillance System. 1–7. https://doi.org/10.1145/3491101.3519645
[10]
Liang Gong, Changyang Gong, Zhao Ma, Lujie Zhao, Zhenyu Wang, Xudong Li, Xiaolong Jing, Haozhe Yang, and Chengliang Liu. 2017. Real-time human-in-the-loop remote control for a life-size traffic police robot with multiple augmented reality aided display terminals. In 2017 2nd International Conference on Advanced Robotics and Mechatronics (ICARM). 420–425. https://doi.org/10.1109/ICARM.2017.8273199
[11]
Shaheryar Ehsan I Haque and Shahzad Saleem. 2020. Augmented reality based criminal investigation system (ARCRIME). In 2020 8th International Symposium on Digital Forensics and Security (ISDFS). 1–6. https://doi.org/10.1109/ISDFS49300.2020.9116204
[12]
Iason Karakostas, Vasileios Mygdalis, Anastasios Tefas, and Ioannis Pitas. 2021. Occlusion detection and drift-avoidance framework for 2D visual object tracking. Signal Processing: Image Communication 90 (2021), 116011.
[13]
Dohun Kim, Heegwang Kim, Yeongheon Mok, and Joonki Paik. 2021. Real-Time Surveillance System for Analyzing Abnormal Behavior of Pedestrians. Applied Sciences 11, 13 (2021). https://doi.org/10.3390/app11136153
[14]
Howard Meadows and George Frangou. 2020. Virtual Reality Rendered Video Precognition with Deep Learning for Crowd Management. 334–345. https://doi.org/10.1007/978-3-030-32520-6_27
[15]
Rama Moorthy, Vijeth Upadhya, Vidyesh V Holla, Sunil S Shetty, and Vinay Tantry. 2020. CNN based smart surveillance system: a smart IoT application post covid-19 era. In 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC). IEEE, 72–77.
[16]
Eric L. Piza, Brandon C. Welsh, David P. Farrington, and Amanda L. Thomas. 2019. CCTV surveillance for crime prevention. Criminology & Public Policy 18, 1 (2019), 135–159. https://doi.org/10.1111/1745-9133.12419 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/1745-9133.12419
[17]
Ayyoob Sharifi, Amir Reza Khavarian-Garmsir, and Rama Krishna Reddy Kummitha. 2021. Contributions of Smart City Solutions and Technologies to Resilience against the COVID-19 Pandemic: A Literature Review. Sustainability 13, 14 (2021). https://doi.org/10.3390/su13148018
[18]
Ke Sun, Bin Xiao, Dong Liu, and Jingdong Wang. 2019. Deep high-resolution representation learning for human pose estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 5693–5703.
[19]
Bin Xiao, Haiping Wu, and Yichen Wei. 2018. Simple baselines for human pose estimation and tracking. In Proceedings of the European conference on computer vision (ECCV). 466–481.
[20]
Qiao Yu, Long Hu, Bander Alzahrani, Ahmed Baranawi, Ahmed Alhindi, and Min Chen. 2021. Intelligent Visual-IoT-Enabled Real-Time 3D Visualization for Autonomous Crowd Management. IEEE Wireless Communications 28, 4 (2021), 34–41. https://doi.org/10.1109/MWC.021.2000497
[21]
Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Fucheng Weng, Zehuan Yuan, Ping Luo, Wenyu Liu, and Xinggang Wang. 2022. Bytetrack: Multi-object tracking by associating every detection box. In European Conference on Computer Vision. Springer, 1–21.
Index Terms
- The DARLENE XR platform for intelligent surveillance applications
Recommendations
Wide Area Seamless Surveillance Video System to Recognize and Track Moving Objects Based on Gigabit Network
AINA '13: Proceedings of the 2013 IEEE 27th International Conference on Advanced Information Networking and ApplicationsRecently, a surveillance system has been widely used for our circumstances for the purpose of observing volcano, tsunami, crime prevention, and so on. However, most of surveillance systems are consisted of handy cameras and mono-directional CCD cameras, ...
A real-time surveillance system with multi-object tracking
AbstractMulti-object detection and occlusion tracking in the computer vision field is an important research topic on the modern surveillance system. These studies largely rely on computer vision work. However, most algorithms are too complex and not ...
The concept of video surveillance system based on the principles of stereo vision
FRUCT '18: Proceedings of the 18th Conference of Open Innovations Association FRUCTThe novel concept of video surveillance systems based on principles of stereovision is described. Examples of existing CCTV systems, which use stereovision tools and techniques are presented. The proposed concept allows to estimate the 3D-coordinates of ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2023
797 pages
ISBN:9798400700699
DOI:10.1145/3594806
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Horizon 2020 research and innovation programme
Conference
PETRA '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 242Total Downloads
- Downloads (Last 12 months)234
- Downloads (Last 6 weeks)32
Reflects downloads up to 19 Sep 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in