research-article

A Novel Privacy-Preserving Approach for Physical Distancing Measurement Using Thermal Sensor Array

Authors:

Abdallah Naser,

Junpei ZhongAuthors Info & Claims

PETRA '21: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference

Pages 81 - 85

https://doi.org/10.1145/3453892.3453903

Published: 29 June 2021 Publication History

Abstract

Physical distancing measurements are accepted to be critical strategies to slow the spread of COVID-19 disease. Most of the recent works to measure the physical distancing between people aims for easy-to-deploy systems such as contact tracing applications to speed up the deployment process. However, these systems, which rely heavily on the Bluetooth proximity sensor, tend to have serious performance and reliability issues. This paper proposes and explores using Thermal Sensor Array (TSA) towards physical distancing measurement. Distance estimation is achieved through using a multilayer perceptron (MLP) artificial neural network to measure the sensor-to-human distance and then to compute the physical distancing accordingly. Based on the conducted experimental work, the proposed sensor-to-human distance estimator’s median overall error is ± 0.2m for unseen testing data.

References

[1]

Maya Aghaei, Matteo Bustreo, Yiming Wang, Gianluca Bailo, Pietro Morerio, and Alessio Del Bue. 2020. Single Image Human Proxemics Estimation for Visual Social Distancing. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2785–2795.

[2]

Sizhen Bian, Vitor F Rey, Junaid Younas, and Paul Lukowicz. 2019. Wrist-Worn Capacitive Sensor for Activity and Physical Collaboration Recognition. In 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 261–266.

[3]

Sizhen Bian, Bo Zhou, Hymalai Bello, and Paul Lukowicz. 2020. A wearable magnetic field based proximity sensing system for monitoring COVID-19 social distancing. In Proceedings of the 2020 International Symposium on Wearable Computers. 22–26.

Digital Library

[4]

Sizhen Bian, Bo Zhou, and Paul Lukowicz. 2020. Social distance monitor with a wearable magnetic field proximity sensor. Sensors 20, 18 (2020), 5101.

[5]

Zhangjie Chen, Ya Wang, and Hanwei Liu. 2018. Unobtrusive sensor-based occupancy facing direction detection and tracking using advanced machine learning algorithms. IEEE Sensors Journal 18, 15 (2018), 6360–6368.

[6]

Yoav Freund and Robert E Schapire. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences 55, 1 (1997), 119–139.

Digital Library

[7]

Hossein Gorji, Markus Arnoldini, David F Jenny, Wolf-Dietrich Hardt, and Patrick Jenny. 2020. STeCC: Smart Testing with Contact Counting Enhances Covid-19 Mitigation by Bluetooth App Based Contact Tracing. medRxiv (2020).

[8]

Henk Heijmans. 1999. Introduction to connected operators. Nonlinear filters for image processing(1999), 207–235.

[9]

Peter Hevesi, Sebastian Wille, Gerald Pirkl, Norbert Wehn, and Paul Lukowicz. 2014. Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 141–145.

Digital Library

[10]

Md Asgar Hossain and Md Mukit. 2015. A real-time face to camera distance measurement algorithm using object classification. In 2015 International Conference on Computer and Information Engineering (ICCIE). IEEE, 107–110.

[11]

Wolfram Kawohl and Carlos Nordt. 2020. COVID-19, unemployment, and suicide. The Lancet Psychiatry 7, 5 (2020), 389–390.

[12]

Jürgen Kemper and Daniel Hauschildt. 2010. Passive infrared localization with a probability hypothesis density filter. In 2010 7th Workshop on Positioning, Navigation and Communication. IEEE, 68–76.

[13]

Rinkal Keniya and Ninad Mehendale. 2020. Real-Time Social Distancing Detector Using Socialdistancingnet-19 Deep Learning Network. Available at SSRN 3669311(2020).

[14]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).

[15]

Masato Kuki, Hiroshi Nakajima, Naoki Tsuchiya, and Yutaka Hata. 2012. Human movement trajectory recording for home alone by thermopile array sensor. In 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2042–2047.

[16]

Youjun Lu, Jikai Huang, and Pengfei Zheng. 2015. A CFD–DEM study of bubble dynamics in fluidized bed using flood fill method. Chemical Engineering Journal 274 (2015), 123–131.

[17]

Namya Malik. 2020. Social Distancing Sensor: Devices that Use Ultrasound and Radio Frequency Communication to Facilitate Social Distancing. (2020).

[18]

Scott McLachlan, Peter Lucas, Kudakwashe Dube, Graham A Hitman, Magda Osman, Evangelia Kyrimi, Martin Neil, and Norman E Fenton. 2020. Bluetooth Smartphone Apps: Are they the most private and effective solution for COVID-19 contact tracing?arXiv preprint arXiv:2005.06621(2020).

[19]

Abdallah Naser, Ahmad Lotfi, and Junpei Zhong. 2020. Adaptive Thermal Sensor Array Placement for Human Segmentation and Occupancy Estimation. IEEE Sensors Journal(2020).

[20]

Abdallah Naser, Ahmad Lotfi, Junpei Zhong, and Jun He. 2020. Heat-map based occupancy estimation using adaptive boosting. In 2020 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, Glasgow, United Kingdom, 1–7.

Digital Library

[21]

Abdallah Naser, Ahmad Lotfi, Junpei Zhong, and Jun He. 2020. Human activity of daily living recognition in presence of an animal pet using thermal sensor array. In Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 1–6.

Digital Library

[22]

Hock M Ng. 2013. Human localization and activity detection using thermopile sensors. In 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 337–338.

[23]

Johan A Oldekop, Rory Horner, David Hulme, Roshan Adhikari, Bina Agarwal, Matthew Alford, Oliver Bakewell, Nicola Banks, Stephanie Barrientos, Tanja Bastia, and others. 2020. COVID-19 and the case for global development. World Development 134(2020), 105044.

[24]

Narinder Singh Punn, Sanjay Kumar Sonbhadra, and Sonali Agarwal. 2020. Monitoring COVID-19 social distancing with person detection and tracking via fine-tuned YOLO v3 and Deepsort techniques. arXiv preprint arXiv:2005.01385(2020).

[25]

Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234–241.

[26]

S Sapna, A Tamilarasi, M Pravin Kumar, and others. 2012. Backpropagation learning algorithm based on Levenberg Marquardt Algorithm. Comp Sci Inform Technol (CS and IT) 2 (2012), 393–398.

[27]

Adarsh Jagan Sathyamoorthy, Utsav Patel, Yash Ajay Savle, Moumita Paul, and Dinesh Manocha. 2020. COVID-robot: Monitoring social distancing constraints in crowded scenarios. arXiv preprint arXiv:2008.06585(2020).

[28]

Manish Shukla, Sachin Lodha, Gautam Shroff, Ramesh Raskar, and others. 2020. Privacy Guidelines for Contact Tracing Applications. arXiv preprint arXiv:2004.13328(2020).

[29]

Spencer Woody, Mauricio Garcia Tec, Maytal Dahan, Kelly Gaither, Michael Lachmann, Spencer Fox, Lauren Ancel Meyers, and James G Scott. 2020. Projections for first-wave COVID-19 deaths across the US using social-distancing measures derived from mobile phones. medRxiv (2020).

[30]

Dongfang Yang, Ekim Yurtsever, Vishnu Renganathan, Keith A Redmill, and Ümit Özgüner. 2020. A vision-based social distancing and critical density detection system for covid-19. arXiv preprint arXiv:2007.03578(2020), 24–25.

[31]

Jingyi Zhang, Jianxin Chen, Qingyu Lin, and Liming Cheng. 2019. Moving Object Distance Estimation Method Based on Target Extraction with a Stereo Camera. In 2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC). IEEE, 572–577.

Cited By

Yang MYang BShi H(2024)Occluded Multi-Human Target Segmentation in Dynamic Indoor Scenes Based on Thermopile Array SensorIEEE Sensors Journal10.1109/JSEN.2024.336841224:7(9462-9471)Online publication date: 1-Apr-2024
https://doi.org/10.1109/JSEN.2024.3368412
Naser ALotfi AMwanje MZhong J(2023)Privacy-Preserving, Thermal Vision With Human in the Loop Fall Detection Alert SystemIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.320302153:1(164-175)Online publication date: Feb-2023
https://doi.org/10.1109/THMS.2022.3203021
Chen ZWang MWang Y(2023)Improving Indoor Occupancy Detection Accuracy of the SLEEPIR Sensor Using LSTM ModelsIEEE Sensors Journal10.1109/JSEN.2023.328756523:15(17794-17802)Online publication date: 1-Aug-2023
https://doi.org/10.1109/JSEN.2023.3287565
Show More Cited By

Recommendations

Towards human distance estimation using a thermal sensor array
Abstract
Human distance estimation is essential in many vital applications, specifically, in human localisation-based systems, such as independent living for older adults applications, and making places safe through preventing the transmission of ...
Determination of thermal efficiency of air ETSC-PCM using artificial neural network technique
Abstract
In this study, the thermal efficiency of an air-type vacuum tube combined phase-change material solar collector (air ETSC-PCM) was tested to establish a theoretical mathematical model of thermal efficiency through linear approximation. Various ...
A Human Thermal Comfort Level Estimating Method Using Thermal Image and Sensor Data
iiWAS2021: The 23rd International Conference on Information Integration and Web Intelligence

Recently, it has become a trend to construct a thermal environment with human thermal comfort. The advantage of human thermal comfort is that we could adjust the environment through the thermal sensation of human. Since human thermal comfort is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '21: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference

June 2021

593 pages

ISBN:9781450387927

DOI:10.1145/3453892

Conference Chair:
Fillia Makedon

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PETRA '21

PETRA '21: The 14th PErvasive Technologies Related to Assistive Environments Conference

June 29 - July 2, 2021

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
102
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang MYang BShi H(2024)Occluded Multi-Human Target Segmentation in Dynamic Indoor Scenes Based on Thermopile Array SensorIEEE Sensors Journal10.1109/JSEN.2024.336841224:7(9462-9471)Online publication date: 1-Apr-2024
https://doi.org/10.1109/JSEN.2024.3368412
Naser ALotfi AMwanje MZhong J(2023)Privacy-Preserving, Thermal Vision With Human in the Loop Fall Detection Alert SystemIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.320302153:1(164-175)Online publication date: Feb-2023
https://doi.org/10.1109/THMS.2022.3203021
Chen ZWang MWang Y(2023)Improving Indoor Occupancy Detection Accuracy of the SLEEPIR Sensor Using LSTM ModelsIEEE Sensors Journal10.1109/JSEN.2023.328756523:15(17794-17802)Online publication date: 1-Aug-2023
https://doi.org/10.1109/JSEN.2023.3287565
Mohmed GHeynes XNaser ASun WHardy KGrundy SLu C(2023)Modelling daily plant growth response to environmental conditions in Chinese solar greenhouse using Bayesian neural networkScientific Reports10.1038/s41598-023-30846-y13:1Online publication date: 16-Mar-2023
https://doi.org/10.1038/s41598-023-30846-y
Naser ALotfi AZhong J(2022)Calibration of Low-Resolution Thermal Imaging for Human Monitoring ApplicationsIEEE Sensors Letters10.1109/LSENS.2022.31559366:3(1-4)Online publication date: Mar-2022
https://doi.org/10.1109/LSENS.2022.3155936
Altaf MAhn JKhan DKim M(2022)Usage of IR Sensors in the HVAC Systems, Vehicle and Manufacturing Industries: A ReviewIEEE Sensors Journal10.1109/JSEN.2022.316619022:10(9164-9176)Online publication date: 15-May-2022
https://doi.org/10.1109/JSEN.2022.3166190
Naser ALotfi AZhong J(2022)Multiple Thermal Sensor Array Fusion Toward Enabling Privacy-Preserving Human Monitoring ApplicationsIEEE Internet of Things Journal10.1109/JIOT.2022.31505669:17(16677-16688)Online publication date: 1-Sep-2022
https://doi.org/10.1109/JIOT.2022.3150566
Majeed AHwang S(2021)A Comprehensive Analysis of Privacy Protection Techniques Developed for COVID-19 PandemicIEEE Access10.1109/ACCESS.2021.31306109(164159-164187)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3130610

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents