Abstract
Over the past decade, the frequency of building disasters has been concerning. However, search and rescue operations often encounter challenges due to limited information, resulting in delays or inadequate assistance for occupants trapped inside the building. The importance of obtaining real-time occupancy information has been recognized and studied in the field of people counting. While various sensor studies have been proposed, using camera sensors to accurately count occupants in a building has been attempted. Nevertheless, even with highly accurate camera sensors, counting errors (i.e., miscounting) are unavoidable due to factors such as suboptimal accuracy and occlusion issues in single-camera setups as well as the miscounts occurred by the blind spots between multiple cameras. To overcome these limitations, this paper introduces a novel people counting method called the “Queue-Buffer Algorithm”, a multi-camera-based error-correction algorithm for real-time people counting that leverages contextual data to correct miscounts. By implementing this multi-camera people counting approach, the accuracy and efficiency of search and rescue operations can be significantly improved, leading to enhanced outcomes in terms of lives saved and timely evacuation.
Similar content being viewed by others
References
Ahmad J, Larijani H, Emmanuel R, Mannion M, Javed A (2021) Occupancy detection in non-residential buildings - A survey and novel privacy preserved occupancy monitoring solution. Applied Computing and Informatics 17(2):279–295, DOI: https://doi.org/10.1016/j.aci.2018.12.001
Amayri M, Arora A, Ploix S, Bandhyopadyay S, Ngo QD, Badarla VR (2016) Estimating occupancy in heterogeneous sensor environment. Energy and Buildings 129:46–58, DOI: https://doi.org/10.1016/j.enbuild.2016.07.026
Augello A, Ortolani M, Re GL, Gaglio S (2011) Sensor mining for user behavior profiling in intelligent environments. Springer 143–158, DOI: https://doi.org/10.1007/978-3-642-21384-7_10
Balaji B, Xu J, Nwokafor A, Gupta R, Agarwal Y (2013) Sentinel: Occupancy based HVAC actuation using existing wifi infrastructure within commercial buildings. SenSys 2013 - Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems, November 11–15, Roma, RM, Italy
Benezeth Y, Laurent H, Emile B, Rosenberger C (2011) Towards a sensor for detecting human presence and characterizing activity. Energy Build 43(2–3):305–314, DOI: https://doi.org/10.1016/j.enbuild.2010.09.014
Bochinski E, Senst T, Sikora T (2018) Extending IOU based multi-object tracking by visual information. Proceedings of AVSS 2018–2018 15th IEEE International Conference of Advanced Video and Signal-Based Surveillance, November 27–30, Auckland, New Zealand
Brackney LJ, Florita AR, Swindler AC, Polese LG, Brunemann GA (2012) Design and performance of an image processing occupancy sensor. Proceedings: The Second International Conference on Building Energy and Environment, August 1–4, Boulder, CO, USA
Chae SU, Kwon HS, Park SR, Cho WH, Kwon OS, Lee JS (2020) CCTV high-speed analysis algorithm for real-time monitoring of building access. Journal of the Korean Society of Hazard Mitigation 20(2):113–118, DOI: https://doi.org/10.9798/KOSHAM.2020.20.2.113 (in Korean)
Chen Z, Jiang C, Xie L (2018) Building occupancy estimation and detection: A review. Energy and Buildings 169:260–270, DOI: https://doi.org/10.1016/j.enbuild.2018.03.084
Choi S (2018) Facility-level interventions for controlling evacuees’ perceived risk and behaviors during fire evacuation. PhD Thesis, Seoul National University, Seoul, South Korea
Chun H, Park C, Chi S, Roh M, Susilawati C (2023) Developing an occupants count methodology in buildings using virtual lines of interest in a multi-camera Network. Journal of the Korean Society of Civil Engineers 43(5):667–674, DOI: https://doi.org/10.12652/Ksce.2023.43.5.0667
Conte G, De Marchi M, Nacc AA, Rana V, Sciuto D (2014) BlueSentinel: A first approach using iBeacon for an energy efficient occupancy detection system. BuildSys 2014 - Proceedings of the 1st ACM Conference on Embedded Systems for Energy-Efficient Buildings, November 3–6, Memphis, TN, USA
Cooper DC (2005) Search and rescue overview. Jones and Bartlett Publishers, Sudbury, MA, USA, 2–21
Dalton AB, Ellis CS (2003) Sensing user intention and context for energy management. Proceedings of HotOS IX: The 9th Workshop on Hot Topics in Operating Systems, May 18–21, Lihue, HI, USA
Dash N, Gladwin H (2007) Evacuation decision making and behavioral responses: Individual and household. Natural Hazards Review 8(3):69–77, DOI: https://doi.org/10.1061/(ASCE)1527-6988(2007)8:3(69)
Depatla S, Muralidharan A, Mostofi Y (2015) Occupancy estimation using only WiFi power measurements. IEEE Journal on Selected Areas in Communications 33(7):1381–1393, DOI: https://doi.org/10.1109/JSAC.2015.2430272
Di Domenico S, De Sanctis M, Cianca E, Bianchi G (2016) A trained-once crowd counting method using differential WiFi channel state information. WPA 2016 - Proceedings of the 3rd International Workshop on Physical Analytics, Co-Located with MobiSys 2016, June 26, Singapore, Singapore
Dittrich F, de Oliveira LE, Britto Jr AS, Koerich AL (2017) People counting in crowded and outdoor scenes using a hybrid multicamera approach. arXiv preprint arXiv:1704.00326, DOI: https://doi.org/10.48550/arXiv.1704.00326
Dshalalow JH (1997) Frontiers in queueing: Models and applications in science and engineering. CRC Press, Boca Raton, FL, USA, 1–463
e-Country Indicators (2018) Accident occurrence status. Retrieved June 1, 2020, http://www.index.go.kr/potal/main/EachDtlPageDetail.do?idx_cd=1632 (in Korean)
Filippoupolitis A, Oliff W, Loukas G (2017) Bluetooth low energy based occupancy detection for emergency management. Proceedings - 2016 15th International Conference on Ubiquitous Computing and Communications and 2016 8th International Symposium on Cyberspace and Security, December 14–16, Granada, Spain
Gao C, Li P, Zhang Y, Liu J, Wang L (2016) People counting based on head detection combining Adaboost and CNN in crowded surveillance environment. Neurocomputing 208(2016):108–116, DOI: https://doi.org/10.1016/j.newcom.2016.01.097
Gu F, Shaban K, Ghani N, Khan S, Rahnamay Naeini M, Hayat M, Assi C (2015) Survivable cloud network mapping for disaster recovery support. IEEE Transactions on Computers 64(8):2353–2366, DOI: https://doi.org/10.1109/TC.2014.2360542
Habib MF, Tornatore M, Dikbiyik F, Mukherjee B (2013) Disaster survivability in optical communication networks. Computer Communications 36(6):630–644, DOI: https://doi.org/10.1016/j.comcorn.2013.01.004
Han Z, Gao RX, Fan Z (2012) Occupancy and indoor environment quality sensing for smart buildings. Instrumentation and Measurement Technology Conference (I2MTC), May 13–16, Graz, Austria
Harle RK, Hopper A (2008) The potential for location-aware power management. Proceedings of the 10th International Conference on Ubiquitous Computing, September 21–24, Seoul, South Korea
Hashimoto K, Kawaguchi C, Matsueda S, Morinaka K, Yoshiike N (1998) People-counting system using multisensing application. Sensors and Actuators, A: Physical 66(1–3):50–55, DOI: https://doi.org/10.1016/S0924-4247(97)01715-9
Hay S, Rice A (2009) The case for apportionment. Proceedings of the First ACM Workshop on Embedded Sensing Systems for Energy-Efficiency in Buildings, 3 November 2009, Berkeley, CA, USA
Huang Q, Ge Z, Lu C (2016) Occupancy estimation in smart buildings using audio-processing techniques. arXiv:1602.08507, DOI: https://doi.org/10.48550/arXiv.1602.08507
Javed A, Larijani H, Ahmadinia A, Gibson D (2017) Smart random neural network controller for HVAC using cloud computing technology. IEEE Transactions on Industrial Informatics 13(1):351–360, DOI: https://doi.org/10.1109/TII.2016.2597746
Khan A, Nicholson J, Mellor S, Jackson D, Ladha K, Ladha C, Hand J, Clarke J, Olivier P, Plötz T (2014) Occupancy monitoring using environmental and context sensors and a hierarchical analysis framework. BuildSys 90–99, DOI: https://doi.org/10.1145/2674061.2674080
Kianoush S, Savazzi S, Rampa V, Nicoli M (2019) People counting by dense WiFi MIMO networks: Channel features and machine learning Algorithms. Sensors 19(16):1–16, DOI: https://doi.org/10.3390/s19163450
Korea Public Data Portal (2015) Accident occurrence status. Retrieved June 1, 2020, https://www.data.go.kr/dataset/15014225/fileData.do (in Korean)
Labeodan T, Aduda K, Zeiler W, Hoving F (2016) Experimental evaluation of the performance of chair sensors in an office space for occupancy detection and occupancy-driven control. Energy Build 111:195–206, DOI: https://doi.org/10.1016/j.enbuild.2015.11.054
Li N, Calis G, Becerik-Gerber B (2012) Measuring and monitoring occupancy with an RFID based system for demand-driven HVAC operations. Automation in Construction 24:89–99, DOI: https://doi.org/10.1016/j.autcon.2012.02.013
Liu D, Guan X, Du Y, Zhao Q (2013) Measuring indoor occupancy in intelligent buildings using the fusion of vision sensors. Measurement Science and Technology 24(7):074023, DOI: https://doi.org/10.1088/0957-0233/24/7/074023
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) SSD: Single shot MultiBox detector. Proceedings of Computer Vision-ECCV 2016: 14th European Conference, October 11–14, Amsterdam, Netherlands
Liu X, Tu P, Rittscher J, Perera A, Krahnstoever N (2005) Detecting and counting people in surveillance applications. IEEE Conference on Advanced Video and Signal Based Surveillance, September 15–16, Como, Italy
Melfi R, Rosenblum B, Nordman B, Christensen K (2011) Measuring building occupancy using existing network infrastructure. 2011 International Green Computing Conference and Workshops, July 25–28, Orlando, FL, USA
Mileti D, O’Brien P (1992) Warning during disaster: Normalizing Communicated risk. Social Problems 39(1):40–55, DOI: https://doi.org/10.2307/3096912
National Association for Search and Rescue (2018) Fundamentals of Search and Rescue - 2nd edition. Jones and Bartlett Learning, Burlington, MA, USA
Nordman B, Meier A (2004) Energy consumption of home information technology. Technical Report LBNL 53500, Energy Analysis Dept., Lawrence Berkeley Nat’l Laboratory, Berkeley, CA, USA
Pandharipande A, Caicedo D (2011) Daylight integrated illumination control of LED systems based on enhanced presence sensing. Energy Build 43(4):944–950, DOI: https://doi.org/10.1016/j.enbuild.2010.12.018
Park C (2021) Developing a multi-zone people counting methodology using surveillance cameras for search and rescue efforts during building disasters. MSc Thesis, Seoul National University, Seoul, South Korea
Peña-Mora F, Thomas J, Golparvar-Fard M, Aziz Z (2012) Supporting civil engineers during disaster response and recovery using a segway mobile workstation chariot. Journal of Computing in Civil Engineering 26(3):448–455, DOI: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000117
Philipose M, Consolvo S, Choudhury T, Fishkin K, Perkowitz M, Fox I, Kautz H, Patterson D (2004) Fast, detailed inference of diverse daily human activities. Demonstrations at Ubicomp, September 7–10, Nottingham, England
Rosebrock A (2018) OpenCV People Counter. Retrieved May 31, 2020, www.pyimagesearch.com/2018/08/13/opencv-people-counter/.
Ruiz-Ruiz AJ, Blunck H, Prentow TS, Stisen A, Kjaergaard MB (2014) Analysis methods for extracting knowledge from large-scale WiFi monitoring to inform building facility planning. 2014 IEEE International Conference on Pervasive Computing and Communications, March 24–28, Budapest, Hungary
Ryan D, Denman S, Fookes C, Sridharan S (2014) Scene invariant multi camera crowd counting. Pattern Recognition Letters 44:98–112, DOI: https://doi.org/10.1016/j.patrec.2013.10.002
Shen W, Newsham G, Gunay B (2017) Leveraging existing occupancy-related data for optimal control of commercial office buildings: A review. Advanced Engineering Informatics 33:230–242, DOI: https://doi.org/10.1016/j.aei.2016.12.008
Shih O, Rowe A (2015) Occupancy estimation using ultrasonic chirps. ACM/IEEE 6th International Conference on Cyber-Physical Systems, April 14–16, Seattle, WA, USA
Wu S, Clements-Croome D (2007) Understanding the indoor environment through mining sensory data—a case study. Energy Build 39:1183–1191, DOI: https://doi.org/10.1016/j.enbuild.2006.07.011
Yang J, Santamouris M, Lee SE (2016) Review of occupancy sensing systems and occupancy modeling methodologies for the application in institutional buildings. Energy and Buildings 121:344–349, DOI: https://doi.org/10.1016/j.enbuild.2015.12.019
Yu SI, Yang Y, Hauptmann A (2013) Harry potter’s marauder’s map: Localizing and tracking multiple persons-of-interest by nonnegative discretization. Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, June 23–28, Portland, OR, USA
Zhen ZN, Jia QS, Song C, Guan X (2008) An indoor localization algorithm for lighting control using RFID. Energy 2030 Conference, ENERGY 2008, November 17–18, Atlanta, GA, USA
Acknowledgments
This work was supported by Seoul National University Research Grant in 2021 and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. RS-2023-00241758).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Park, C., Chun, H. & Chi, S. Multi-Camera People Counting Using a Queue-Buffer Algorithm for Effective Search and Rescue in Building Disasters. KSCE J Civ Eng 28, 2132–2146 (2024). https://doi.org/10.1007/s12205-024-1705-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-024-1705-0