Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

AeroSense: Sensing Aerosol Emissions from Indoor Human Activities

Published: 15 May 2024 Publication History

Abstract

The types of human activities occupants are engaged in within indoor spaces significantly contribute to the spread of airborne diseases through emitting aerosol particles. Today, ubiquitous computing technologies can inform users of common atmosphere pollutants for indoor air quality. However, they remain uninformed of the rate of aerosol generated directly from human respiratory activities, a fundamental parameter impacting the risk of airborne transmission. In this paper, we present AeroSense, a novel privacy-preserving approach using audio sensing to accurately predict the rate of aerosol generated from detecting the kinds of human respiratory activities and determining the loudness of these activities. Our system adopts a privacy-first as a key design choice; thus, it only extracts audio features that cannot be reconstructed into human audible signals using two omnidirectional microphone arrays. We employ a combination of binary classifiers using the Random Forest algorithm to detect simultaneous occurrences of activities with an average recall of 85%. It determines the level of all detected activities by estimating the distance between the microphone and the activity source. This level estimation technique yields an average of 7.74% error. Additionally, we developed a lightweight mask detection classifier to detect mask-wearing, which yields a recall score of 75%. These intermediary outputs are critical predictors needed for AeroSense to estimate the amounts of aerosol generated from an active human source. Our model to predict aerosol is a Random Forest regression model, which yields 2.34 MSE and 0.73 r2 value. We demonstrate the accuracy of AeroSense by validating our results in a cleanroom setup and using advanced microbiological technology. We present results on the efficacy of AeroSense in natural settings through controlled and in-the-wild experiments. The ability to estimate aerosol emissions from detected human activities is part of a more extensive indoor air system integration, which can capture the rate of aerosol dissipation and inform users of airborne transmission risks in real time.

References

[1]
Environmental Protection Agency. Indoor Air Quality - What are the trends in indoor air quality and their effects on human health? https://www.epa.gov/report-environment/indoor-air-quality. Online; accessed 14 November 2021.
[2]
World Health Organization. Roadmap to improve and ensure good indoor ventilation in the context of covid-19. 2021.
[3]
Centers for Disease Control, Prevention, et al. Ventilation in schools and childcare programs. how to use cdc building recommendations in your setting, 2021.
[4]
Reopening of schools and universities. https://www.ashrae.org/technical-resources/reopening-of-schools-and-universities. Online; accessed 23 January 2022.
[5]
Kristin L Andrejko, Jake M Pry, Jennifer F Myers, Nozomi Fukui, Jennifer L DeGuzman, John Openshaw, James P Watt, Joseph A Lewnard, Seema Jain, California COVID, et al. Effectiveness of face mask or respirator use in indoor public settings for prevention of sars-cov-2 infection---california, february-december 2021. Morbidity and Mortality Weekly Report, 71(6):212, 2022.
[6]
Condensation particle counter 3775. https://tsi.com/discontinued-products/condensation-particle-counter-3775/. Online; accessed 1 May 2023.
[7]
Justin Morgenstern. Aerosols, droplets, and airborne spread: Everything you could possibly want to know. First10EM blog, 6, 2020.
[8]
Forsad Al Hossain, Andrew A Lover, George A Corey, Nicholas G Reich, and Tauhidur Rahman. Flusense: a contactless syndromic surveillance platform for influenza-like illness in hospital waiting areas. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4(1):1-28, 2020.
[9]
Sima Asadi, Anthony S Wexler, Christopher D Cappa, Santiago Barreda, Nicole M Bouvier, and William D Ristenpart. Effect of voicing and articulation manner on aerosol particle emission during human speech. PloS one, 15(1):e0227699, 2020.
[10]
Sima Asadi, Anthony S Wexler, Christopher D Cappa, Santiago Barreda, Nicole M Bouvier, and William D Ristenpart. Aerosol emission and superemission during human speech increase with voice loudness. Scientific reports, 9(1):1-10, 2019.
[11]
Bhawana Chhaglani, Camellia Zakaria, Jeremy Gummeson, and Prashant Shenoy. Breatheasy: Exploring the potential of acoustic sensing for healthy indoor environments. In Proceedings of the 1st International Workshop on Advances in Environmental Sensing Systems for Smart Cities, pages 25-30, 2023.
[12]
Sima Asadi, Christopher D Cappa, Santiago Barreda, Anthony S Wexler, Nicole M Bouvier, and William D Ristenpart. Efficacy of masks and face coverings in controlling outward aerosol particle emission from expiratory activities. Scientific reports, 10(1):1-13, 2020.
[13]
Khuong An Nguyen and Zhiyuan Luo. Cover your cough: Detection of respiratory events with confidence using a smartwatch. In Conformal and Probabilistic Prediction and Applications, pages 114--131. PMLR, 2018.
[14]
Mostafa M Mohamed, Mina A Nessiem, Anton Batliner, Christian Bergler, Simone Hantke, Maximilian Schmitt, Alice Baird, Adria Mallol-Ragolta, Vincent Karas, Shahin Amiriparian, et al. Face mask recognition from audio: The masc database and an overview on the mask challenge. Pattern Recognition, 122:108361, 2022.
[15]
Valentyn Stadnytskyi, Christina E Bax, Adriaan Bax, and Philip Anfinrud. The airborne lifetime of small speech droplets and their potential importance in sars-cov-2 transmission. Proceedings of the National Academy of Sciences, 117(22):11875-11877, 2020.
[16]
Shirun Ding, Zhen Wei Teo, Man Pun Wan, and Bing Feng Ng. Aerosols from speaking can linger in the air for up to nine hours. Building and Environment, 205:108239, 2021.
[17]
Bhawana Chhaglani, Camellia Zakaria, Adam Lechowicz, Jeremy Gummeson, and Prashant Shenoy. Flowsense: Monitoring airflow in building ventilation systems using audio sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(1):1-26, 2022.
[18]
Wei Wang, Jiayu Chen, and Tianzhen Hong. Occupancy prediction through machine learning and data fusion of environmental sensing and wi-fi sensing in buildings. Automation in Construction, 94:233-243, 2018.
[19]
Irvan B Arief-Ang, Flora D Salim, and Margaret Hamilton. Cd-hoc: indoor human occupancy counting using carbon dioxide sensor data. arXiv preprint arXiv:1706.05286, 2017.
[20]
Wolfgang Schade, Vladislav Reimer, Martin Seipenbusch, and Ulrike Willer. Experimental investigation of aerosol and co2 dispersion for evaluation of covid-19 infection risk in a concert hall. International Journal of Environmental Research and Public Health, 18(6):3037, 2021.
[21]
Jennifer L Cadnum, Heba Alhmidi, and Curtis J Donskey. Planes, trains, and automobiles: use of carbon dioxide monitoring to assess ventilation during travel. Pathogens and Immunity, 7(1):31, 2022.
[22]
SN Rudnick and Donald K Milton. Risk of indoor airborne infection transmission estimated from carbon dioxide concentration. Indoor air, 13(3):237-245, 2003.
[23]
Philip Wexler, Bruce D Anderson, Shayne C Gad, PJ Bert Hakkinen, Michael Kamrin, Ann De Peyster, Betty Locey, Carey Pope, Harihara M Mehendale, and Lee R Shugart. Encyclopedia of toxicology, volume 1. Academic Press, 2005.
[24]
Anikó Angyal, Zita Ferenczi, Manousos Manousakas, Enikő Furu, Zoltán Szoboszlai, Zsófia Török, Enikő Papp, Zita Szikszai, and Zsófia Kertész. Source identification of fine and coarse aerosol during smog episodes in debrecen, hungary. Air Quality, Atmosphere & Health, 14:1017-1032, 2021.
[25]
Zhe Peng, AL Pineda Rojas, Emilio Kropff, William Bahnfleth, Giorgio Buonanno, Stephanie J Dancer, Jarek Kurnitski, Yuguo Li, Marcel GLC Loomans, Linsey C Marr, et al. Practical indicators for risk of airborne transmission in shared indoor environments and their application to covid-19 outbreaks. Environmental science & technology, 56(2):1125-1137, 2022.
[26]
National Center for Immunization and Respiratory Diseases (NCIRD), Division of Viral Diseases. Scientific Brief: SARS-CoV-2 Transmission. https://www.cdc.gov/coronavirus/2019-ncov/science/science-briefs/sars-cov-2-transmission.html. Online; accessed 4 May 2023.
[27]
V Stadnytskyi, P Anfinrud, and A Bax. Breathing, speaking, coughing or sneezing: What drives transmission of sars-cov-2? Journal of Internal Medicine, 290(5):1010-1027, 2021.
[28]
Nicholas Good, Kristen M Fedak, Dan Goble, Amy Keisling, Christian L'Orange, Emily Morton, Rebecca Phillips, Ky Tanner, and John Volckens. Respiratory aerosol emissions from vocalization: Age and sex differences are explained by volume and exhaled co2. Environmental Science & Technology Letters, 8(12):1071-1076, 2021.
[29]
Justice Archer, Lauren P McCarthy, Henry E Symons, Natalie A Watson, Christopher M Orton, William J Browne, Joshua Harrison, Benjamin Moseley, Keir EJ Philip, James D Calder, et al. Comparing aerosol number and mass exhalation rates from children and adults during breathing, speaking and singing. Interface Focus, 12(2):20210078, 2022.
[30]
Sheng Zhang and Zhang Lin. Dilution-based evaluation of airborne infection risk-thorough expansion of wells-riley model. Building and Environment, 194:107674, 2021.
[31]
Martin Z Bazant and John WM Bush. A guideline to limit indoor airborne transmission of covid-19. Proceedings of the National Academy of Sciences, 118(17), 2021.
[32]
JP Duguid. The numbers and the sites of origin of the droplets expelled during expiratory activities. Edinburgh medical journal, 52(11):385, 1945.
[33]
Rajiv Dhand and Jie Li. Coughs and sneezes: their role in transmission of respiratory viral infections, including sars-cov-2. American journal of respiratory and critical care medicine, 202(5):651-659, 2020.
[34]
Dirk Mürbe, Martin Kriegel, Julia Lange, Lukas Schumann, Anne Hartmann, and Mario Fleischer. Aerosol emission of adolescents voices during speaking, singing and shouting. PLoS One, 16(2):e0246819, 2021.
[35]
Malin Alsved, Alexios Matamis, Ragnar Bohlin, Mattias Richter, P-E Bengtsson, C-J Fraenkel, Patrik Medstrand, and Jakob Löndahl. Exhaled respiratory particles during singing and talking. Aerosol Science and Technology, 54(11):1245-1248, 2020.
[36]
Tehya Stockman, Shengwei Zhu, Abhishek Kumar, Lingzhe Wang, Sameer Patel, James Weaver, Mark Spede, Donald K Milton, Jean Hertzberg, Darin Toohey, et al. Measurements and simulations of aerosol released while singing and playing wind instruments. ACS Environmental Au, 1(1):71-84, 2021.
[37]
Prateek Bahl, Charitha de Silva, Shovon Bhattacharjee, Haley Stone, Con Doolan, Abrar Ahmad Chughtai, and C Raina MacIntyre. Droplets and aerosols generated by singing and the risk of coronavirus disease 2019 for choirs. Clinical Infectious Diseases, 72(10):e639-e641, 2021.
[38]
FM Javed Mehedi Shamrat, Sovon Chakraborty, Md Masum Billah, Md Al Jubair, Md Saidul Islam, and Rumesh Ranjan. Face mask detection using convolutional neural network (cnn) to reduce the spread of covid-19. In 2021 5th international conference on trends in electronics and informatics (ICOEI), pages 1231--1237. IEEE, 2021.
[39]
Siyoung Lee, Junsoo Kim, Inyeol Yun, Geun Yeol Bae, Daegun Kim, Sangsik Park, Il-Min Yi, Wonkyu Moon, Yoonyoung Chung, and Kilwon Cho. An ultrathin conformable vibration-responsive electronic skin for quantitative vocal recognition. Nature communications, 10(1):1-11, 2019.
[40]
Jay Prakash, Zhijian Yang, Yu-Lin Wei, Haitham Hassanieh, and Romit Roy Choudhury. Earsense: earphones as a teeth activity sensor. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking, pages 1-13, 2020.
[41]
Duy Duong Nguyen, Patricia McCabe, Donna Thomas, Alison Purcell, Maree Doble, Daniel Novakovic, Antonia Chacon, and Catherine Madill. Acoustic voice characteristics with and without wearing a facemask. Scientific reports, 2021.
[42]
Eric C Larson, TienJui Lee, Sean Liu, Margaret Rosenfeld, and Shwetak N Patel. Accurate and privacy preserving cough sensing using a low-cost microphone. In Proceedings of the 13th international conference on Ubiquitous computing, pages 375-384, 2011.
[43]
Peter F Assmann and Quentin Summerfield. Modeling the perception of concurrent vowels: Vowels with different fundamental frequencies. The Journal of the Acoustical Society of America, 88(2):680-697, 1990.
[44]
T Schroth. New hepa/ulpa filters for clean-room technology. Filtration & separation, 33(3):245-244, 1996.
[45]
The inverse square law 1/r2 and the sound intensity. http://www.sengpielaudio.com/calculator-distance.htm. Online; accessed 16 December 2022.
[46]
Alan Y Gu, Yanzhe Zhu, Jing Li, and Michael R Hoffmann. Speech-generated aerosol settling times and viral viability can improve covid-19 transmission prediction. Environmental Science: Atmospheres, 2(1):34-45, 2022.
[47]
Logan Blue, Luis Vargas, and Patrick Traynor. Hello, is it me you're looking for? differentiating between human and electronic speakers for voice interface security. In Proceedings of the 11th ACM Conference on Security & Privacy in Wireless and Mobile Networks, pages 123-133, 2018.
[48]
Tomi Kinnunen, Md Sahidullah, Héctor Delgado, Massimiliano Todisco, Nicholas Evans, Junichi Yamagishi, and Kong Aik Lee. The asvspoof 2017 challenge: Assessing the limits of replay spoofing attack detection. 2017.
[49]
PM De Oliveira, LCC Mesquita, S Gkantonas, A Giusti, and E Mastorakos. Evolution of spray and aerosol from respiratory releases: theoretical estimates for insight on viral transmission. Proceedings of the Royal Society A, 477(2245):20200584, 2021.
[50]
Zu Puayen Tan, Lokesh Silwal, Surya P Bhatt, and Vrishank Raghav. Experimental characterization of speech aerosol dispersion dynamics. Scientific reports, 11(1):1-12, 2021.
[51]
Netatmo Smart Home Weather Station. https://www.netatmo.com/en-gb/weather. Online; accessed 16 December 2022.
[52]
Respeaker microphone array 2.0. https://wiki.seeedstudio.com/ReSpeaker_Mic_Array_v2.0/. Online; accessed 16 December 2022.
[53]
Brian McFee, Colin Raffel, Dawen Liang, Daniel P Ellis, Matt McVicar, Eric Battenberg, and Oriol Nieto. librosa: Audio and music signal analysis in python. In Proceedings of the 14th python in science conference, volume 8, pages 18-25, 2015.
[54]
Pauli Virtanen, Ralf Gommers, Travis E Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, et al. Scipy 1.0: fundamental algorithms for scientific computing in python. Nature methods, 17(3):261-272, 2020.
[55]
Respeaker microphone array v2.0. https://github.com/respeaker/usb_4_mic_array. Online; accessed 1 May 2023.
[56]
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. Scikit-learn: Machine learning in python. the Journal of machine Learning research, 12:2825-2830, 2011.
[57]
Jort F Gemmeke, Daniel PW Ellis, Dylan Freedman, Aren Jansen, Wade Lawrence, R Channing Moore, Manoj Plakal, and Marvin Ritter. Audio set: An ontology and human-labeled dataset for audio events. In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), pages 776--780. IEEE, 2017.
[58]
Ebrahim Nemati, Shibo Zhang, Tousif Ahmed, Md Mahbubur Rahman, Jilong Kuang, and Alex Gao. Coughbuddy: Multi-modal cough event detection using earbuds platform. In 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pages 1--4. IEEE, 2021.
[59]
Maxim Markitantov, Denis Dresvyanskiy, Danila Mamontov, Heysem Kaya, Wolfgang Minker, Alexey Karpov, et al. Ensembling end-to-end deep models for computational paralinguistics tasks: Compare 2020 mask and breathing sub-challenges. In INTERSPEECH, pages 2072-2076, 2020.
[60]
Terence E Taylor, Frank Keane, and Yaniv Zigel. A speech obfuscation system to preserve data privacy in 24-hour ambulatory cough monitoring. IEEE Journal of Selected Topics in Signal Processing, 16(2):188-196, 2021.
[61]
Feng Huang, Tan Lee, W Bastiaan Kleijn, and Ying-Yee Kong. A method of speech periodicity enhancement using transform-domain signal decomposition. Speech communication, 67:102-112, 2015.
[62]
Bishal Lamichhane, Ebrahim Nemati, Tousif Ahmed, Mahbubur Rahman, Jilong Kuang, and Alex Gao. A template matching based cough detection algorithm using imu data from earbuds. In 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), pages 01--04. IEEE, 2022.
[63]
Vimal Mollyn, Riku Arakawa, Mayank Goel, Chris Harrison, and Karan Ahuja. Imuposer: Full-body pose estimation using imus in phones, watches, and earbuds. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pages 1-12, 2023.
[64]
Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison. Ubicoustics: Plug-and-play acoustic activity recognition. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, pages 213-224, 2018.
[65]
M Pahar, IDS Miranda, AH Diacon, and T Niesler. Automatic non-invasive cough detection based on accelerometer and audio signals. corr abs/2109.00103 (2021).
[66]
Rishiraj Adhikary, Tanmay Srivastava, Prerna Khanna, Aabhas Asit Senapati, and Nipun Batra. Naqaab: towards health sensing and persuasion via masks. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pages 5-8, 2020.
[67]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. Contactless sleep apnea detection on smartphones. In Proceedings of the 13th annual international conference on mobile systems, applications, and services, pages 45-57, 2015.
[68]
Xiao Sun, Zongqing Lu, Wenjie Hu, and Guohong Cao. Symdetector: detecting sound-related respiratory symptoms using smartphones. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pages 97-108, 2015.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 2
May 2024
1330 pages
EISSN:2474-9567
DOI:10.1145/3665317
Issue’s Table of Contents
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2024
Published in IMWUT Volume 8, Issue 2

Check for updates

Author Tags

  1. Aerosol Sensing
  2. Audio Sensing
  3. Mobile Health
  4. Privacy

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 336
    Total Downloads
  • Downloads (Last 12 months)336
  • Downloads (Last 6 weeks)80
Reflects downloads up to 30 Sep 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media