research-article

Remote Breathing Rate Tracking in Stationary Position Using the Motion and Acoustic Sensors of Earables

Authors:

Md Mahbubur Rahman,

Ebrahim Nemati,

Mohsin Yusuf Ahmed,

Alex Jun GaoAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 325, Pages 1 - 22

https://doi.org/10.1145/3544548.3581265

Published: 19 April 2023 Publication History

Abstract

Breathing rate is critical for the user’s respiratory health and is hard to track outside the clinical context, requiring specialized devices. Earables could provide a convenient solution to track the breathing rate anywhere by leveraging the user’s breathing-related motion and sound captured through the earables’ motion sensors and microphones. However, small non-breathing head movements or background noises during the assessment affect the estimation accuracy. While noise filtering improves accuracy, it can discard valid measurements. This paper presents a multimodal approach to tracking the user’s breathing rate using a signal-processing-based algorithm on motion sensors and a lightweight machine-learning algorithm on acoustic sensors from the earables that balances the accuracy and data retention. A user study with 30 participants shows that the system can accurately calculate breathing rate (Mean Absolute Error < 2 breaths per minute) while retaining most breathing sessions (75%) performed in real-world settings. This work provides an essential direction for remote breathing rate monitoring.

Supplementary Material

MP4 File (3544548.3581265-talk-video.mp4)

Pre-recorded Video Presentation

Download
153.45 MB

References

[1]

Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart Homes That Monitor Breathing and Heart Rate. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 837–846. https://doi.org/10.1145/2702123.2702200

Digital Library

[2]

Tousif Ahmed, Md Mahbubur Rahman, Mohsin Yusuf Ahmed, Ebrahim Nemati, Minh Dinh, Nathan Folkman, Jilong Kuang, and Alex Gao. 2021. RRMonitor: A Resource-Aware End-to-End System for Continuous Monitoring of Respiration Rate Using Earbuds., 2463-2467 pages. https://doi.org/10.1109/EMBC46164.2021.9631109

[3]

Heba Aly and Moustafa Youssef. 2016. Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones. In IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications. 1–9. https://doi.org/10.1109/INFOCOM.2016.7524401

Digital Library

[4]

Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra Perez, and Jorge Luis Reyes Ortiz. 2013. A public domain dataset for human activity recognition using smartphones. In Proceedings of the 21th international European symposium on artificial neural networks, computational intelligence and machine learning. 437–442.

[5]

André Bestbier and Pieter R. Fourie. 2018. Development of a vital signs monitoring wireless ear probe. In 2018 3rd Biennial South African Biomedical Engineering Conference (SAIBMEC). 1–5. https://doi.org/10.1109/SAIBMEC.2018.8363196

[6]

Jason Boland, Elaine Boland, and David Brooks. 2013. Importance of the correct diagnosis of opioid-induced respiratory depression in adult cancer patients and titration of naloxone. Clinical medicine (London, England) 13 (04 2013), 149–51. https://doi.org/10.7861/clinmedicine.13-2-149

[7]

Data Bridge. 2021. Global Hearable Market – Industry Trends and Forecast to 2028. Retrieved Aug 2, 2021 from https://www.databridgemarketresearch.com/reports/global-hearable-market

[8]

Businesswire. 2020. Global Hearables Market (2019 to 2026) - by Products, Type, Connectivity Technology, and End-user. Retrieved Aug 2, 2021 from https://www.businesswire.com/news/home/20200818005423/en/Global-Hearables-Market-2019-to-2026—by-Products-Type-Connectivity-Technology-and-End-user—ResearchAndMarkets.com

[9]

Kayla-Jade Butkow, Ting Dang, Andrea Ferlini, Dong Ma, and Cecilia Mascolo. 2021. Motion-resilient Heart Rate Monitoring with In-ear Microphones. arxiv:2108.09393 [cs.HC]

[10]

Soujanya Chatterjee, Md Mahbubur Rahman, Tousif Ahmed, Nazir Saleheen, Ebrahim Nemati, Viswam Nathan, Korosh Vatanparvar, and Jilong Kuang. 2020. Assessing Severity of Pulmonary Obstruction from Respiration Phase-Based Wheeze-Sensing Using Mobile Sensors. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376444

Digital Library

[11]

Romit Roy Choudhury. 2021. Earable Computing: A New Area to Think About. In Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications (Virtual, United Kingdom) (HotMobile ’21). Association for Computing Machinery, New York, NY, USA, 147–153. https://doi.org/10.1145/3446382.3450216

Digital Library

[12]

Mary E Crocker, Shakir Hossen, Dina Goodman, Suzanne M Simkovich, Miles Kirby, Lisa M Thompson, Ghislaine Rosa, Sarada S Garg, Gurusamy Thangavel, Eric D McCollum, Jennifer Peel, Thomas Clasen, and William Checkley. 2020. Effects of high altitude on respiratory rate and oxygen saturation reference values in healthy infants and children younger than 2 years in four countries: a cross-sectional study. The Lancet Global Health 8 (3 2020), e362–e373. Issue 3. https://doi.org/10.1016/S2214-109X(19)30543-1

[13]

Consumer Technology Association (CTA). 2022. Performance Criteria and Testing Protocols for Breathing Parameters (CTA-2102). Retrieved Dec 2, 2022 from https://shop.cta.tech/collections/standards/products/performance-criteria-and-testing-protocols-for-breathing-parameters-cta-2102

[14]

Ruixuan Dai, Chenyang Lu, Michael Avidan, and Thomas Kannampallil. 2021. RespWatch: Robust Measurement of Respiratory Rate on Smartwatches with Photoplethysmography. In Proceedings of the International Conference on Internet-of-Things Design and Implementation (Charlottesvle, VA, USA) (IoTDI ’21). Association for Computing Machinery, New York, NY, USA, 208–220. https://doi.org/10.1145/3450268.3453531

Digital Library

[15]

Tin T. Dang, Khai Q. Nguyen Tran, Hoang M. Le, Khoa Tran, and Anh Dinh. 2018. A Tool Using Ultrasonic Sensor for Measuring Breathing Rate. In 6th International Conference on the Development of Biomedical Engineering in Vietnam (BME6), Toi Vo Van, Thanh An Nguyen Le, and Thang Nguyen Duc (Eds.). Springer Singapore, Singapore, 139–143.

[16]

Chendan Dou and Hao Huan. 2021. Full Respiration Rate Monitoring Exploiting Doppler Information with Commodity Wi-Fi Devices. Sensors 21, 10 (2021). https://www.mdpi.com/1424-8220/21/10/3505

[17]

John F Fieselmann, Michael S Hendryx, Charles M Helms, and Douglas S Wakefield. 1993. Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients. Journal of General Internal Medicine 8 (1993), 354–360. Issue 7. https://doi.org/10.1007/BF02600071

[18]

Tracy Flenady, Trudy Dwyer, and Judith Applegarth. 2017. Accurate respiratory rates count: So should you!, 45-47 pages. Issue 1. https://doi.org/10.1016/j.aenj.2016.12.003

[19]

Yang Gao, Wei Wang, Vir V. Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using Ear Canal Echo for Wearable Authentication. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 81 (sep 2019), 24 pages. https://doi.org/10.1145/3351239

Digital Library

[20]

Shkurta Gashi, Aaqib Saeed, Alessandra Vicini, Elena Di Lascio, and Silvia Santini. 2021. Hierarchical Classification and Transfer Learning to Recognize Head Gestures and Facial Expressions Using Earbuds. In Proceedings of the 2021 International Conference on Multimodal Interaction (Montréal, QC, Canada) (ICMI ’21). Association for Computing Machinery, New York, NY, USA, 168–176. https://doi.org/10.1145/3462244.3479921

Digital Library

[21]

Valentin Goverdovsky, Wilhelm von Rosenberg, Takashi Nakamura, David Looney, David Sharp, C. Papavassiliou, Mary Morrell, and Danilo Mandic. 2016. Hearables: Multimodal physiological in-ear sensing. Scientific Reports 7 (09 2016). https://doi.org/10.1038/s41598-017-06925-2

[22]

Mariel Grassmann, Elke Vlemincx, Andreas Von Leupoldt, Justin M. Mittelstädt, and Omer Van Den Bergh. 2016. Respiratory changes in response to cognitive load: A systematic review. https://doi.org/10.1155/2016/8146809

[23]

Yu Gu, Xiang Zhang, Zhi Liu, and Fuji Ren. 2019. WiFi-Based Real-Time Breathing and Heart Rate Monitoring during Sleep. In 2019 IEEE Global Communications Conference (GLOBECOM). 1–6. https://doi.org/10.1109/GLOBECOM38437.2019.9014297

Digital Library

[24]

Migyeong Gwak, Korosh Vatanparvar, Jilong Kuang, and Alex Gao. 2022. Motion- Based Respiratory Rate Estimation with Motion Artifact Removal Using Video of Face and Upper Body. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). 1961–1967. https://doi.org/10.1109/EMBC48229.2022.9871231

[25]

Unsoo Ha, Sohrab Madani, and Fadel Adib. 2021. WiStress: Contactless Stress Monitoring Using Wireless Signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 103 (Sept. 2021), 37 pages. https://doi.org/10.1145/3478121

Digital Library

[26]

M. A. Hall. 1998. Correlation-based Feature Subset Selection for Machine Learning. Ph. D. Dissertation. University of Waikato, Hamilton, New Zealand.

[27]

Tian Hao, Chongguang Bi, Guoliang Xing, Roxane Chan, and Linlin Tu. 2017. MindfulWatch: A Smartwatch-Based System For Real-Time Respiration Monitoring During Meditation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 57 (Sept. 2017), 19 pages. https://doi.org/10.1145/3130922

Digital Library

[28]

Javier Hernandez, Yin Li, James M. Rehg, and Rosalind W. Picard. 2014. BioGlass: Physiological parameter estimation using a head-mounted wearable device. In 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH). 55–58. https://doi.org/10.1109/MOBIHEALTH.2014.7015908

[29]

Javier Hernandez, Daniel McDuff, and Rosalind W Picard. 2015. Biowatch: estimation of heart and breathing rates from wrist motions. In 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). IEEE, 169–176.

[30]

Nick Hunn. 2014. Hearables – the new Wearables.Retrieved Oct 15, 2021 from https://www.wearable-technologies.com/2014/04/hearables-the-new-wearables/

[31]

Bashima Islam, Md Mahbubur Rahman, Tousif Ahmed, Mohsin Yusuf Ahmed, Md Mehedi Hasan, Viswam Nathan, Korosh Vatanparvar, Ebrahim Nemati, Jilong Kuang, and Jun Alex Gao. 2021. BreathTrack: Detecting Regular Breathing Phases from Unannotated Acoustic Data Captured by a Smartphone. 5, 3, Article 124 (Sept. 2021), 22 pages. https://doi.org/10.1145/3478123

Digital Library

[32]

Yincheng Jin, Yang Gao, Xiaotao Guo, Jun Wen, Zhengxiong Li, and Zhanpeng Jin. 2022. EarHealth: An Earphone-Based Acoustic Otoscope for Detection of Multiple Ear Diseases in Daily Life. In Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (Portland, Oregon) (MobiSys ’22). Association for Computing Machinery, New York, NY, USA, 397–408. https://doi.org/10.1145/3498361.3538935

Digital Library

[33]

Wall Street Journal. 2021. Apple Studying Potential of AirPods as Health Device.Retrieved Oct 15, 2021 from https://www.wsj.com/articles/apple-studying-potential-of-airpods-as-health-device-11634122800

[34]

Carol Kelly. 2018. Respiratory rate 1: why measurement and recording are crucial.Nursing Mirror 114, 4 (2 April 2018), 23–24.

[35]

Jochen Kempfle and Kristof Van Laerhoven. 2018. Respiration Rate Estimation with Depth Cameras: An Evaluation of Parameters. In Proceedings of the 5th International Workshop on Sensor-Based Activity Recognition and Interaction (Berlin, Germany) (iWOAR ’18). Association for Computing Machinery, New York, NY, USA, Article 4, 10 pages. https://doi.org/10.1145/3266157.3266208

Digital Library

[36]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).

[37]

Agni Kumar, Vikramjit Mitra, Carolyn Oliver, Adeeti Ullal, Matt Biddulph, and Irida Mance. 2021. Estimating Respiratory Rate From Breath Audio Obtained Through Wearable Microphones. https://arxiv.org/pdf/2107.14028.pdf

[38]

Bishal Lamichhane, Ebrahim Nemati, Tousif Ahmed, Mahbubur Rahman, Jilong Kuang, and Alex Gao. 2022. A Template Matching Based Cough Detection Algorithm Using IMU Data From Earbuds. In 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI). 01–04. https://doi.org/10.1109/BHI56158.2022.9926839

[39]

Daniyal Liaqat, Mohamed Abdalla, Pegah Abed-Esfahani, Moshe Gabel, Tatiana Son, Robert Wu, Andrea Gershon, Frank Rudzicz, and Eyal De Lara. 2019. WearBreathing: Real World Respiratory Rate Monitoring Using Smartwatches. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 2, Article 56 (June 2019), 22 pages. https://doi.org/10.1145/3328927

Digital Library

[40]

PneumaCare LIMITED.2016. Thora-3Di Model T-01 510(k) Premarket Notification.Retrieved Dec 2, 2022 from https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm?ID=K151940

[41]

Haipeng Liu, John Allen, Dingchang Zheng, and Fei Chen. 2019. Recent development of respiratory rate measurement technologies. Physiological Measurement 40, 7 (aug 2019), 07TR01. https://doi.org/10.1088/1361-6579/ab299e

[42]

Deborah Lupton. 2016. The quantified self. John Wiley & Sons.

[43]

Alexis Martin and Jérémie Voix. 2018. In-Ear Audio Wearable: Measurement of Heart and Breathing Rates for Health and Safety Monitoring. IEEE Transactions on Biomedical Engineering 65, 6 (2018), 1256–1263. https://doi.org/10.1109/TBME.2017.2720463

[44]

Yuri Masaoka and Ikuo Homma. 1997. Anxiety and respiratory patterns: their relationship during mental stress and physical load. International Journal of Psychophysiology 27, 2 (1997), 153–159.

[45]

Yuri Masaoka and Ikuo Homma. 1997. Anxiety and respiratory patterns: their relationship during mental stress and physical load., 153159 pages.

[46]

Carlo Massaroni, Andrea Nicolò, Emiliano Schena, and Massimo Sacchetti. 2020. Remote Respiratory Monitoring in the Time of COVID-19.Frontiers in physiology 11 (2020), 635. https://doi.org/10.3389/fphys.2020.00635

[47]

Se Dong Min, Jin Kwon Kim, Hang Sik Shin, Yong Hyeon Yun, Chung Keun Lee, and Myoungho Lee. 2010. Noncontact Respiration Rate Measurement System Using an Ultrasonic Proximity Sensor. IEEE Sensors Journal 10, 11 (2010), 1732–1739. https://doi.org/10.1109/JSEN.2010.2044239

[48]

Yunyoung Nam, Youngsun Kong, Bersain Reyes, Natasa Reljin, and Ki H. Chon. 2016. Monitoring of heart and breathing rates using dual cameras on a smartphone. PLoS ONE 11 (3 2016). Issue 3. https://doi.org/10.1371/journal.pone.0151013

[49]

Yunyoung Nam, Bersain A. Reyes, and Ki H. Chon. 2016. Estimation of Respiratory Rates Using the Built-in Microphone of a Smartphone or Headset. IEEE Journal of Biomedical and Health Informatics 20, 6(2016), 1493–1501. https://doi.org/10.1109/JBHI.2015.2480838

[50]

Aravind Natarajan, Hao Wei Su, Conor Heneghan, Leanna Blunt, Corey O’Connor, and Logan Niehaus. 2021. Measurement of respiratory rate using wearable devices and applications to COVID-19 detection. npj Digital Medicine 4 (12 2021). Issue 1. https://doi.org/10.1038/s41746-021-00493-6

[51]

Colver Ken Howe Ne, Jameel Muzaffar, Aakash Amlani, and Manohar Bance. 2021. Hearables, in-ear sensing devices for bio-signal acquisition: a narrative review. Expert Review of Medical Devices 18, sup1 (2021), 95–128. https://doi.org/10.1080/17434440.2021.2014321 34904507.

[52]

Ebrahim Nemati, Shibo Zhang, Tousif Ahmed, Md. Mahbubur Rahman, Jilong Kuang, and Alex Gao. 2021. CoughBuddy: Multi-Modal Cough Event Detection Using Earbuds Platform. In 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks (BSN). 1–4. https://doi.org/10.1109/BSN51625.2021.9507017

[53]

Andrea Nicolò, Samuele M. Marcora, and Massimo Sacchetti. 2016. Respiratory frequency is strongly associated with perceived exertion during time trials of different duration. Journal of Sports Sciences 34, 13 (2016), 1199–1206. https://doi.org/10.1080/02640414.2015.1102315 26503587.

[54]

Andrea Nicolò, Carlo Massaroni, and Louis Passfield. 2017. Respiratory Frequency during Exercise: The Neglected Physiological Measure. Frontiers in Physiology 8 (2017), 922. https://doi.org/10.3389/fphys.2017.00922

[55]

Andrea Nicolò, Carlo Massaroni, Emiliano Schena, and Massimo Sacchetti. 2020. The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise.Sensors (Basel, Switzerland) 20, 21 (Nov. 2020). https://doi.org/10.3390/s20216396

[56]

Jon Nordby. 2019. emlearn: Machine Learning inference engine for Microcontrollers and Embedded Devices. https://doi.org/10.5281/zenodo.2589394

[57]

Royal College of Physicians. 2017. National early warning score (NEWS): standardising the assessment of acute-illness severity in the NHS—report of a working party. Retrieved Oct 15, 2021 from https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2

[58]

Med Device Online. 2021. Meet Hearables, The Next Revolutionary Medical Devices.Retrieved Oct 15, 2021 from https://www.meddeviceonline.com/doc/meet-hearables-the-next-revolutionary-medical-devices-0001

[59]

Aleš Procházka, Martin Schätz, Oldřich Vyšata, and Martin Vališ. 2016. Microsoft Kinect Visual and Depth Sensors for Breathing and Heart Rate Analysis. Sensors 16, 7 (2016). https://www.mdpi.com/1424-8220/16/7/996

[60]

Md Mahbubur Rahman, Mohsin Yusuf Ahmed, Tousif Ahmed, Bashima Islam, Viswam Nathan, Korosh Vatanparvar, Ebrahim Nemati, Daniel McCaffrey, Jilong Kuang, and Jun Alex Gao. 2020. BreathEasy: Assessing Respiratory Diseases Using Mobile Multimodal Sensors. In Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20). Association for Computing Machinery, New York, NY, USA, 41–49. https://doi.org/10.1145/3382507.3418852

Digital Library

[61]

Md Mahbubur Rahman, Tousif Ahmed, Mohsin Yusuf Ahmed, Minh Dinh, Ebrahim Nemati, Jilong Kuang, and Jun Alex Gao. 2022. BreatheBuddy: Tracking Real-Time Breathing Exercises for Automated Biofeedback Using Commodity Earbuds. Proc. ACM Hum.-Comput. Interact. 6, MHCI, Article 213 (sep 2022), 18 pages. https://doi.org/10.1145/3546748

Digital Library

[62]

Md Mahbubur Rahman, Tousif Ahmed, Mohsin Yusuf Ahmed, Ebrahim Nemati, Minh Dinh, Nathan Folkman, Md Mehedi Hasan, Jilong Kuang, and Jun Alex Gao. 2021. Towards Motion-Aware Passive Resting Respiratory Rate Monitoring Using Earbuds. In 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks (BSN). 1–4. https://doi.org/10.1109/BSN51625.2021.9507016

[63]

Md. Mahbubur Rahman, Ebrahim Nemati, Viswam Nathan, and Jilong Kuang. 2020. InstantRR: Instantaneous Respiratory Rate Estimation on Context-Aware Mobile Devices. In 13th EAI International Conference on Body Area Networks, Chika Sugimoto, Hamed Farhadi, and Matti Hämäläinen (Eds.). Springer International Publishing, Cham, 267–281.

[64]

Tauhidur Rahman, Alexander T. Adams, Mi Zhang, Erin Cherry, Bobby Zhou, Huaishu Peng, and Tanzeem Choudhury. 2014. BodyBeat: A Mobile System for Sensing Non-Speech Body Sounds(MobiSys ’14). Association for Computing Machinery, New York, NY, USA, 2–13. https://doi.org/10.1145/2594368.2594386

Digital Library

[65]

Ruth Ravichandran, Elliot Saba, Ke-Yu Chen, Mayank Goel, Sidhant Gupta, and Shwetak N. Patel. 2015. WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home. In 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom). 131–139. https://doi.org/10.1109/PERCOM.2015.7146519

[66]

Tobias Röddiger, Christopher Clarke, Paula Breitling, Tim Schneegans, Haibin Zhao, Hans Gellersen, and Michael Beigl. 2022. Sensing with Earables: A Systematic Literature Review and Taxonomy of Phenomena. 6, 3, Article 135 (sep 2022), 57 pages. https://doi.org/10.1145/3550314

Digital Library

[67]

Tobias Röddiger, Daniel Wolffram, David Laubenstein, Matthias Budde, and Michael Beigl. 2019. Towards Respiration Rate Monitoring Using an In-Ear Headphone Inertial Measurement Unit. In Proceedings of the 1st International Workshop on Earable Computing (London, United Kingdom) (EarComp’19). Association for Computing Machinery, New York, NY, USA, 48–53. https://doi.org/10.1145/3345615.3361130

Digital Library

[68]

Sandy Rolfe. 2019. The importance of respiratory rate monitoring.British journal of nursing (Mark Allen Publishing) 28, 8 (April 2019), 504–508. https://doi.org/10.12968/bjon.2019.28.8.504 Place: England.

[69]

Chiara Romano, Emiliano Schena, Sergio Silvestri, and Carlo Massaroni. 2021. Non-contact respiratory monitoring using an RGB camera for real-world applications. Sensors 21 (8 2021). Issue 15. https://doi.org/10.3390/s21155126

[70]

J Brady Scott and Ramandeep Kaur. 2020. Monitoring Breathing Frequency, Pattern, and Effort. Respiratory Care 65, 6 (2020), 793–806. https://doi.org/10.4187/respcare.07439 arXiv:http://rc.rcjournal.com/content/65/6/793.full.pdf

[71]

D.M. Seath and G.D. Miller. 1946. The Relative Importance of High Temperature and High Humidity as Factors Influencing Respiration Rate, Body Temperature, and Pulse Rate of Dairy Cows. Journal of Dairy Science 29, 7 (1946), 465–472. https://doi.org/10.3168/jds.S0022-0302(46)92502-7

[72]

Ville-Pekka Seppä, Anna S. Pelkonen, Anne Kotaniemi-Syrjänen, Jari Viik, Mika J. Mäkelä, and L. Pekka Malmberg. 2016. Tidal flow variability measured by impedance pneumography relates to childhood asthma risk. European Respiratory Journal 47, 6 (2016), 1687–1696. https://doi.org/10.1183/13993003.00989-2015 arXiv:https://erj.ersjournals.com/content/47/6/1687.full.pdf

[73]

Pragya Sharma, Xiaonan Hui, Jianlin Zhou, Thomas B Conroy, and Edwin C Kan. 2020. Wearable radio-frequency sensing of respiratory rate, respiratory volume, and heart rate. npj Digital Medicine 3(2020), 98. Issue 1. https://doi.org/10.1038/s41746-020-0307-6

[74]

William M Suess, A Barney Alexander, Deborah D Smith, Helga W Sweeney, and Richard J Marion. 1980. The effects of psychological stress on respiration: a preliminary study of anxiety and hyperventilation. Psychophysiology 17, 6 (1980), 535–540.

[75]

Xiao Sun, Li Qiu, Yibo Wu, Yeming Tang, and Guohong Cao. 2017. SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch. Proc. ACM Interact. Mob. Wearable Ubiquitous Tech. 1, 3, Article 104 (Sept. 2017), 22 pages. https://doi.org/10.1145/3130969

Digital Library

[76]

Zephyr Technology. 2012. BioHarness 3.0. User Manual.Retrieved Aug 2, 2021 from https://www.zephyranywhere.com/media/download/bioharness3-user-manual.pdf

[77]

Michael J. Tipton, Abbi Harper, Julian F. R. Paton, and Joseph T. Costello. 2017. The human ventilatory response to stress: rate or depth?The Journal of Physiology 595, 17 (2017), 5729–5752. https://doi.org/10.1113/JP274596

[78]

Korosh Vatanparvar, Migyeong Gwak, Li Zhu, Jilong Kuang, and Alex Gao. 2022. Respiration Rate Estimation from Remote PPG via Camera in Presence of Non-Voluntary Artifacts. In 2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN). 1–4. https://doi.org/10.1109/BSN56160.2022.9928485

[79]

Elke Vlemincx, Joachim Taelman, Steven De Peuter, Ilse Van Diest, and Omer Van Den Bergh. 2011. Sigh rate and respiratory variability during mental load and sustained attention. Psychophysiology 48, 1 (2011), 117–120.

[80]

Sylvain Wallez. 2021 (accessed Jan, 2021). Savitzky Golay Filter. https://github.com/swallez/savitzky-golay-filter.

[81]

Xuyu Wang, Runze Huang, Chao Yang, and Shiwen Mao. 2021. Smartphone Sonar-Based Contact-Free Respiration Rate Monitoring. ACM Trans. Comput. Healthcare 2, 2, Article 15 (feb 2021), 26 pages. https://doi.org/10.1145/3436822

Digital Library

[82]

Yuntao Wang, Xiyuxing Zhang, Jay M. Chakalasiya, Xuhai Xu, Yu Jiang, Yuang Li, Shwetak Patel, and Yuanchun Shi. 2022. HearCough: Enabling continuous cough event detection on edge computing hearables. Methods 205(2022), 53–62. https://doi.org/10.1016/j.ymeth.2022.05.002

[83]

Zihan Wang, Tousif Ahmed, Md. Mahbubur Rahman, Mohsin Y Ahmed, Ebrahim Nemati, Jilong Kuang, and Alex Gao. 2022. Real-Time Breathing Phase Detection Using Earbuds Microphone. In 2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN). 1–4. https://doi.org/10.1109/BSN56160.2022.9928520

[84]

Stephen E Widen, Sara Båsjö, Claes Möller, and Kim Kähäri. 2017. Headphone listening habits and hearing thresholds in swedish adolescents.Noise & health 19, 88 (2017), 125–132. https://doi.org/10.4103/nah.NAH_65_16

[85]

Devy Widjaja, Michele Orini, Elke Vlemincx, and Sabine Van Huffel. 2013. Cardiorespiratory dynamic response to mental stress: A multivariate time-frequency analysis. Computational and Mathematical Methods in Medicine 2013 (2013). https://doi.org/10.1155/2013/451857

[86]

Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376836

Digital Library

[87]

Aina M. Yañez, Dolores Guerrero, Rigoberto Pérez de Alejo, Francisco Garcia-Rio, Jose Luis Alvarez-Sala, Miriam Calle-Rubio, Rosa Malo de Molina, Manuel Valle Falcones, Piedad Ussetti, Jaume Sauleda, Enrique Zamora García, Jose Miguel Rodríguez-González-Moro, Mercedes Franco Gay, Maties Torrent, and Alvar Agustí. 2012. Monitoring Breathing Rate at Home Allows Early Identification of COPD Exacerbations. Chest 142, 6 (2012), 1524–1529. https://doi.org/10.1378/chest.11-2728

[88]

Shibo Zhang, Ebrahim Nemati, Minh Dinh, Nathan Folkman, Tousif Ahmed, Mahbubur Rahman, Jilong Kuang, Nabil Alshurafa, and Alex Gao. 2022. Coughtrigger: Earbuds IMU Based Cough Detection Activator Using An Energy-Efficient Sensitivity-Prioritized Time Series Classifier. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1–5. https://doi.org/10.1109/ICASSP43922.2022.9746334

[89]

Fang Zhao, Meng Li, Yi Qian, and Joe Z. Tsien. 2013. Remote Measurements of Heart and Respiration Rates for Telemedicine. PLOS ONE 8, 10 (10 2013), 1–14. https://doi.org/10.1371/journal.pone.0071384

Cited By

Mehrban MVoix JBouserhal R(2024)Classification of Breathing Phase and Path with In-Ear MicrophonesSensors10.3390/s2420667924:20(6679)Online publication date: 17-Oct-2024
https://doi.org/10.3390/s24206679
Offerman CBourgeois JBozzon A(2024)Embedding caring into remote patient management systemsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685399(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685399
Le HLakshminarayanan RLi JMishra VIntille S(2024)Collecting Self-reported Physical Activity and Posture Data Using Audio-based Ecological Momentary AssessmentProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785848:3(1-35)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678584
Show More Cited By

Index Terms

Remote Breathing Rate Tracking in Stationary Position Using the Motion and Acoustic Sensors of Earables
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Empirical studies in ubiquitous and mobile computing
    2. Ubiquitous and mobile computing design and evaluation methods

Recommendations

Non-contact breathing rate monitoring in newborns: A review
Abstract
The neonatal period – the first 4 weeks of life – is the most critical time for a child's survival. Breathing rate is a vital indicator of the health condition and requires continuous monitoring in case of sickness or preterm birth. ...
Highlights
- Continuous Breathing monitoring is essential for neonates (newborns within a month).
Real-time robust estimation of breathing rate from PPG using commercial-grade smart devices: demo abstract
SenSys '20: Proceedings of the 18th Conference on Embedded Networked Sensor Systems

In this work, we present a solution for an accurate and real-time monitoring of breathing rate (BR) from photoplethysmogram (PPG) signal on both smartphone and smartwatch. Respiration induces multiple modulations in a PPG signal which are difficult to ...
BreathEasy: Assessing Respiratory Diseases Using Mobile Multimodal Sensors
ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

Mobil respiratory assessments using commodity smartphones and smartwatches are unmet needs for patient monitoring at home. In this paper, we show the feasibility of using multimodal sensors embedded in consumer mobile devices for non-invasive, low-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
864
Total Downloads

Downloads (Last 12 months)472
Downloads (Last 6 weeks)50

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mehrban MVoix JBouserhal R(2024)Classification of Breathing Phase and Path with In-Ear MicrophonesSensors10.3390/s2420667924:20(6679)Online publication date: 17-Oct-2024
https://doi.org/10.3390/s24206679
Offerman CBourgeois JBozzon A(2024)Embedding caring into remote patient management systemsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685399(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685399
Le HLakshminarayanan RLi JMishra VIntille S(2024)Collecting Self-reported Physical Activity and Posture Data Using Audio-based Ecological Momentary AssessmentProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785848:3(1-35)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678584
Xie WXu CGong YWang YLiu YZhang JZhang QZheng ZYang S(2024)DeepBreath: Breathing Exercise Assessment with a Depth CameraProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785198:3(1-26)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678519
Zhang XWang YHan YLiang CChatterjee ITang JYi XPatel SShi Y(2024)The EarSAVAS DatasetProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596168:2(1-26)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659616
Adhikary RSadeh MBatra NGoel M(2024)JoulesEyeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314227:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631422
Zhang DZhang XXie YZhang FYang HZhang D(2024)From Single-Point to Multi-Point Reflection Modeling: Robust Vital Signs Monitoring via mmWave SensingIEEE Transactions on Mobile Computing10.1109/TMC.2024.345031823:12(14959-14974)Online publication date: Dec-2024
https://doi.org/10.1109/TMC.2024.3450318
Zhao YMiao LXiao YSun P(2024)Research Progress of Flexible Piezoresistive Pressure Sensor: A ReviewIEEE Sensors Journal10.1109/JSEN.2024.344342324:20(31624-31644)Online publication date: 15-Oct-2024
https://doi.org/10.1109/JSEN.2024.3443423
Gwak MVatanparvar KZhu LRashid NAhmed MBae JKuang JGao A(2024)Multimodal Breathing Rate Estimation Using Facial Motion and RPPG From RGB CameraICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10446086(2046-2050)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10446086
Baciu VStiens Jda Silva B(2024)MLino bench: A comprehensive benchmarking tool for evaluating ML models on edge devicesJournal of Systems Architecture10.1016/j.sysarc.2024.103262155(103262)Online publication date: Oct-2024
https://doi.org/10.1016/j.sysarc.2024.103262
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents