Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

ECG-grained Cardiac Monitoring Using UWB Signals

Published: 11 January 2023 Publication History

Abstract

With the development of wireless sensing, researchers have proposed many contactless vital sign monitoring systems, which can be used to monitor respiration rates, heart rates, cardiac cycles and etc. However, these vital signs are ones of coarse granularity, so they are less helpful in the diagnosis of cardiovascular diseases (CVDs). Considering that electrocardiogram (ECG) is an important evidence base for the diagnoses of CVDs, we propose to generate ECGs from ultra-wideband (UWB) signals in a contactless manner as a fine-grained cardiac monitoring solution. Specifically, we analyze the properties of UWB signals containing heartbeats and respiration, and design two complementary heartbeat signal restoration methods to perfectly recover heartbeat signal variation. To establish the mapping between the mechanical activity of the heart sensed by UWB devices and the electrical activity of the heart recorded in ECGs, we construct a conditional generative adversarial network to encode the mapping between mechanical activity and electrical activity and propose a contrastive learning strategy to reduce the interference from noise in UWB signals. We build the corresponding cardiac monitoring system named RF-ECG and conduct extensive experiments using about 120,000 heartbeats from more than 40 participants. The experimental results show that the ECGs generated by RF-ECG have good performance in both ECG intervals and morphology compared with the ground truth. Moreover, diseases such as tachycardia/bradycardia, sinus arrhythmia, and premature contractions can be diagnosed from the ECGs generated by our RF-ECG.

References

[1]
2019. Pixel 4's Soli radar. https://www.androidcentral.com/how-does-googles-soli-chip-work.
[2]
2019. UWB radar in Iphone. https://www.computerworld.com/article/3490037/ultra-wideband-explained-and-why-its-in-the-iphone-11.html.
[3]
2021. Google Nest Hub. https://www.cnbc.com/2021/03/16/google-nest-hub-new-version-can-track-your-sleep-with-radar.html.
[4]
2022. ECG on Apple Watch. https://support.apple.com/en-us/HT208955.
[5]
2022. Heart Disease and Stroke Statistics. https://professional.heart.org/en/science-news/heart-disease-and-stroke-statistics-2022-update.
[6]
2022. Holter monitor. https://www.mayoclinic.org/tests-procedures/holter-monitor/about/pac-20385039.
[7]
2022. NeuroKit2. https://neuropsychology.github.io/NeuroKit/.
[8]
2022. Wellue portable ECG monitor. https://getwellue.com/products/duoek-hand-held-wearable-ekg-tracker.
[9]
Pia Addabbo, Mario Luca Bernardi, Filippo Biondi, Marta Cimitile, Carmine Clemente, and Danilo Orlando. 2020. Gait recognition using fmcw radar and temporal convolutional deep neural networks. In 2020 IEEE 7th International Workshop on Metrology for AeroSpace (MetroAeroSpace). IEEE, 171--175.
[10]
Pia Addabbo, Mario Luca Bernardi, Filippo Biondi, Marta Cimitile, Carmine Clemente, and Danilo Orlando. 2021. Temporal convolutional neural networks for radar micro-Doppler based gait recognition. Sensors 21, 2 (2021), 381.
[11]
Puput Dani Prasetyo Adi and Akio Kitagawa. 2020. A Study of LoRa Performance in Monitoring of Patient s SPO2 and Heart Rate based IoT. International Journal of Advanced Computer Science and Applications (IJACSA) 11, 2 (2020), 238--251.
[12]
Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D tracking via body radio reflections. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14). 317--329.
[13]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 837--846.
[14]
Ghita Amrani, Amina Adadi, Mohammed Berrada, Zouhayr Souirti, and Saïd Boujraf. 2021. EEG signal analysis using deep learning: A systematic literature review. In 2021 Fifth International Conference On Intelligent Computing in Data Sciences (ICDS). IEEE, 1--8.
[15]
Xueru Bai, Ye Hui, Li Wang, and Feng Zhou. 2019. Radar-based human gait recognition using dual-channel deep convolutional neural network. IEEE Transactions on Geoscience and Remote Sensing 57, 12 (2019), 9767--9778.
[16]
Francisco M Calisto, Alfredo Ferreira, Jacinto C Nascimento, and Daniel Gonçalves. 2017. Towards touch-based medical image diagnosis annotation. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 390--395.
[17]
Francisco Maria Calisto, Nuno Nunes, and Jacinto C Nascimento. 2020. BreastScreening: on the use of multi-modality in medical imaging diagnosis. In Proceedings of the international conference on advanced visual interfaces. 1--5.
[18]
Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, and Jacinto C Nascimento. 2021. Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification. International Journal of Human-Computer Studies 150 (2021), 102607.
[19]
Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, and Jacinto C Nascimento. 2022. BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions. Artificial Intelligence in Medicine 127 (2022), 102285.
[20]
Shan Wei Chen, Shir Li Wang, Xiu Zhi Qi, Suzani Mohamad Samuri, and Can Yang. 2022. Review of ECG detection and classification based on deep learning: Coherent taxonomy, motivation, open challenges and recommendations. Biomedical Signal Processing and Control 74 (2022), 103493.
[21]
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International conference on machine learning. PMLR, 1597--1607.
[22]
Robbin de Goederen, S Pu, M Silos Viu, Dan Doan, Sebastiaan Overeem, Wouter A Serdijn, Koen FM Joosten, Xi Long, and Jeroen Dudink. 2021. Radar-based sleep stage classification in children undergoing polysomnography: a pilot-study. Sleep Medicine 82 (2021), 1--8.
[23]
Wen Ding, Zhongping Cao, Jianxiong Zhang, Rihui Chen, Xuemei Guo, and Guoli Wang. 2021. Radar-Based 3D Human Skeleton Estimation by Kinematic Constrained Learning. IEEE Sensors Journal 21, 20 (2021), 23174--23184.
[24]
Hongchao Fang, Sicheng Wang, Meng Zhou, Jiayuan Ding, and Pengtao Xie. 2020. Cert: Contrastive self-supervised learning for language understanding. arXiv preprint arXiv:2005.12766 (2020).
[25]
Unsoo Ha, Salah Assana, and Fadel Adib. 2020. Contactless seismocardiography via deep learning radars. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[26]
Matti Hämäläinen, Lorenzo Mucchi, Stefano Caputo, Lorenzo Biotti, Lorenzo Ciani, Dania Marabissi, and Gabriele Patrizi. 2021. Ultra-wideband radar-based indoor activity monitoring for elderly care. Sensors 21, 9 (2021), 3158.
[27]
John Hampton and Joanna Hampton. 2019. The ECG made easy e-book. Elsevier Health Sciences.
[28]
Eiji Hayashi, Jaime Lien, Nicholas Gillian, Leonardo Giusti, Dave Weber, Jin Yamanaka, Lauren Bedal, and Ivan Poupyrev. 2021. RadarNet: Efficient gesture recognition technique utilizing a miniature radar sensor. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--14.
[29]
Paul A Heidenreich, Justin G Trogdon, Olga A Khavjou, Javed Butler, Kathleen Dracup, Michael D Ezekowitz, Eric Andrew Finkelstein, Yuling Hong, S Claiborne Johnston, Amit Khera, et al. 2011. Forecasting the future of cardiovascular disease in the United States: a policy statement from the American Heart Association. Circulation 123, 8 (2011), 933--944.
[30]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1125--1134.
[31]
Faiza Khan, Md Zakirul Alam Bhuiyan, Md Monirul Islam, Tian Wang, Aliuz Zaman, and Hai Tao. 2020. Wi-Fi signal analysis for heartbeat and metal detection: a comparative study of reliable contactless systems. In 2019 6th International Conference on Dependable Systems and Their Applications (DSA). IEEE, 81--90.
[32]
Yonggu Lee, Jun-Young Park, Yeon-Woo Choi, Hyun-Kyung Park, Seok-Hyun Cho, Sung Ho Cho, and Young-Hyo Lim. 2018. A novel non-contact heart rate monitor using impulse-radio ultra-wideband (IR-UWB) radar technology. Scientific reports 8, 1 (2018), 1--10.
[33]
Yee Siong Lee, Pubudu N Pathirana, Terry Caelli, and R Evans. 2013. Doppler radar in respiratory monitoring: Detection and analysis. In 2013 International Conference on Control, Automation and Information Sciences (ICCAIS). IEEE, 224--228.
[34]
Fangyu Li, Hui Chang, Min Jiang, and Yihuan Su. 2022. A Contrastive Learning Framework for ECG Anomaly Detection. In 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP). IEEE, 673--677.
[35]
Siheng Li, Zhi Wang, Fusang Zhang, and Beihong Jin. 2021. Fine-Grained Respiration Monitoring During Overnight Sleep Using IR-UWB Radar. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services. Springer, 84--101.
[36]
Yiran Li et al. 2019. Radar sensors for smart human activity detection and monitoring. Ph.D. Dissertation.
[37]
Sang Hoon Oh, SeungBong Lee, Sung Min Kim, and Jae Hoon Jeong. 2021. Development of a heart rate detection algorithm using a non-contact doppler radar via signal elimination. Biomedical Signal Processing and Control 64 (2021), 102314.
[38]
Aaron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018).
[39]
Jun-Young Park, Yonggu Lee, Yeon-Woo Choi, Ran Heo, Hyun-Kyung Park, Seok-Hyun Cho, Sung Ho Cho, and Young-Hyo Lim. 2019. Preclinical evaluation of a noncontact simultaneous monitoring method for respiration and carotid pulsation using impulse-radio ultra-wideband radar. Scientific reports 9, 1 (2019), 1--12.
[40]
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros. 2016. Context encoders: Feature learning by inpainting. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2536--2544.
[41]
Jian Pu and Hao Zhang. 2022. RF-Heartbeat: Robust and Contactless Heartbeat Monitoring Based on FMCW Radar. (2022).
[42]
Kun Qian, Chenshu Wu, Fu Xiao, Yue Zheng, Yi Zhang, Zheng Yang, and Yunhao Liu. 2018. Acousticcardiogram: Monitoring heartbeats using acoustic signals on smart devices. In IEEE INFOCOM 2018-IEEE conference on computer communications. IEEE, 1574--1582.
[43]
Pranav Rajpurkar, Awni Y Hannun, Masoumeh Haghpanahi, Codie Bourn, and Andrew Y Ng. 2017. Cardiologist-level arrhythmia detection with convolutional neural networks. arXiv preprint arXiv:1707.01836 (2017).
[44]
Giulia Sacco, Erika Pittella, Emanuele Piuzzi, and Stefano Pisa. 2018. A radar system for indoor human localization and breath monitoring. In 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 1--6.
[45]
Santu Sardar, BAG Ravi Sharan, Prabhat Kumar Rai, Gautam Kumar, Mohammed Zafar Ali Khan, and Amit K Mishra. 2018. Indoor localization system using commensal radar principle. In 2018 Progress in Electromagnetics Research Symposium (PIERS-Toyama). IEEE, 751--755.
[46]
Sven Schellenberger, Kilin Shi, Tobias Steigleder, Anke Malessa, Fabian Michler, Laura Hameyer, Nina Neumann, Fabian Lurz, Robert Weigel, Christoph Ostgathe, et al. 2020. A dataset of clinically recorded radar vital signs with synchronised reference sensor signals. Scientific data 7, 1 (2020), 1--11.
[47]
Arindam Sengupta, Feng Jin, Renyuan Zhang, and Siyang Cao. 2020. mm-Pose: Real-time human skeletal posture estimation using mmWave radars and CNNs. IEEE Sensors Journal 20, 17 (2020), 10032--10044.
[48]
Dejan Stepec and Danijel Skocaj. 2021. Unsupervised detection of cancerous regions in histology imagery using image-to-image translation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3785--3792.
[49]
Yuliang Sun, Tai Fei, Xibo Li, Alexander Warnecke, Ernst Warsitz, and Nils Pohl. 2020. Real-time radar-based gesture detection and recognition built in an edge-computing platform. IEEE Sensors Journal 20, 18 (2020), 10706--10716.
[50]
Amirtahà Taebi, Brian E Solar, Andrew J Bomar, Richard H Sandler, and Hansen A Mansy. 2019. Recent advances in seismocardiography. Vibration 2, 1 (2019), 64--86.
[51]
Tabassum Islam Toma and Sunwoong Choi. 2022. A Comparative Analysis of 2D Deep CNN Models for Arrhythmia Detection Using STFT-Based Long Duration ECG Spectrogram. In 2022 Thirteenth International Conference on Ubiquitous and Future Networks (ICUFN). 483--488. https://doi.org/10.1109/ICUFN55119.2022.9829574
[52]
Xuyu Wang, Chao Yang, and Shiwen Mao. 2017. PhaseBeat: Exploiting CSI phase data for vital sign monitoring with commodity WiFi devices. In 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS). IEEE, 1230--1239.
[53]
Peng Xia, Jie Hu, and Yinghong Peng. 2018. EMG-based estimation of limb movement using deep learning with recurrent convolutional neural networks. Artificial organs 42, 5 (2018), E67--E77.
[54]
Dae Hyeon Yim, Sung Ho Cho, and D Zheng. 2014. An equidistance multi-human detection algorithm based on noise level using mono-static IR-UWB radar system. In CRC Press. 131--134.
[55]
Fusang Zhang, Zhi Wang, Beihong Jin, Jie Xiong, and Daqing Zhang. 2020. Your smart speaker can" hear" your heartbeat! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--24.
[56]
Shujie Zhang, Tianyue Zheng, Zhe Chen, and Jun Luo. 2022. Can We Obtain Fine-grained Heartbeat Waveform via Contact-free RF-sensing?. In IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE, 1759--1768.

Cited By

View all
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • (2024)AirECG: Contactless Electrocardiogram for Cardiac Disease Monitoring via mmWave Sensing and Cross-domain Diffusion ModelProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785508:3(1-27)Online publication date: 9-Sep-2024
  • (2024)Exploring the Landscape of Ubiquitous In-home Health Monitoring: A Comprehensive SurveyACM Transactions on Computing for Healthcare10.1145/3670854Online publication date: 19-Jul-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 6, Issue 4
December 2022
1534 pages
EISSN:2474-9567
DOI:10.1145/3580286
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 January 2023
Published in IMWUT Volume 6, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Cardiac monitoring
  2. Contactless sensing
  3. Electrocardiogram
  4. UWB signals

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)587
  • Downloads (Last 6 weeks)76
Reflects downloads up to 19 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • (2024)AirECG: Contactless Electrocardiogram for Cardiac Disease Monitoring via mmWave Sensing and Cross-domain Diffusion ModelProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785508:3(1-27)Online publication date: 9-Sep-2024
  • (2024)Exploring the Landscape of Ubiquitous In-home Health Monitoring: A Comprehensive SurveyACM Transactions on Computing for Healthcare10.1145/3670854Online publication date: 19-Jul-2024
  • (2024)UWB-enabled Sensing for Fast and Effortless Blood Pressure MonitoringProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596178:2(1-26)Online publication date: 15-May-2024
  • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
  • (2024)BreathPro: Monitoring Breathing Mode during Running with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596078:2(1-25)Online publication date: 15-May-2024
  • (2024)ICY Interfaces: Exploration of Ice’s Ephemeral Features for Digital Game User ExperienceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660725(2107-2124)Online publication date: 1-Jul-2024
  • (2024)RFSpy: Eavesdropping on Online Conversations with Out-of-Vocabulary Words by Sensing Metal Coil Vibration of Headsets Leveraging RFIDProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661887(169-182)Online publication date: 3-Jun-2024
  • (2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
  • (2024)F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice InteractionProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661860(127-140)Online publication date: 3-Jun-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media