research-article

MultiCardioNet: : Interoperability between ECG and PPG biometrics

Authors:

Ruggero Donida Labati,

Vincenzo Piuri,

Francesco Rundo,

Fabio ScottiAuthors Info & Claims

Volume 175, Issue C

Pages 1 - 7

https://doi.org/10.1016/j.patrec.2023.09.009

Published: 01 November 2023 Publication History

Abstract

Compared to other well-known biometric technologies based on physiological traits (e.g., fingerprint, iris, and face), heart biometrics are more robust to presentation attacks and are particularly suitable for continuous/periodic recognition. Most studies on heart biometrics concern electrocardiogram (ECG) and photoplethysmogram (PPG). While the reported results are encouraging, to the best of our knowledge, no studies have been conducted on the interoperability between ECG and PPG biometrics. We present a novel method that is capable of performing single-domain and multiple-domain identity verifications for ECG and PPG signals, providing interoperability between the heterogeneous cardiac signals. Our method does not require the computation of any reference/fiducial point and uses a compact representation of the given signals. We propose MultiCardioNet, a novel Siamese neural network trained by using an ad hoc learning algorithm. MultiCardioNet computes a similarity score between two spectrogram-based representations of cardiac signals. Our learning algorithm iteratively computes a balanced subset of genuine and impostor pairs during the training epochs. We performed experiments on a dataset containing 1,008 pairs of ECG and PPG samples, obtaining accuracy comparable to that of the state-of-the-art methods for single-domain scenarios and demonstrating only a relatively small performance decrease in the multiple-domain scenario.

Graphical abstract

Display Omitted

Highlights

•

The first study on the interoperability between ECG and PPG biometrics, based on Siamese CNNs.

•

Novel CNNs for processing two-dimensional representations of PPG signals.

•

Ad-hoc algorithm for training Siamese CNNs, suitable for small-size datasets.

References

[1]

Marcel S., R. Millan J.D., Person authentication using brainwaves (EEG) and maximum a posteriori model adaptation, IEEE Trans. Pattern Anal. Mach. Intell. 29 (4) (2007) 743–752.

Digital Library

[2]

Panzino A., Orrù G., Marcialis G.L., Roli F., EEG personal recognition based on ‘qualified majority’ over signal patches, IET Biom. 11 (1) (2022) 63–78.

[3]

Rathore A.S., Li Z., Zhu W., Jin Z., Xu W., A survey on heart biometrics, ACM Comput. Surv. 53 (6) (2020).

[4]

Rattani A., Scheirer W.J., Ross A., Open set fingerprint spoof detection across novel fabrication materials, IEEE Trans. Inf. Forensics Secur. 10 (11) (2015) 2447–2460.

Digital Library

[5]

Lavrentyeva G., Kudashev O., Melnikov A., De Marsico M., Matveev Y., Interactive photo liveness for presentation attacks detection, in: Image Analysis and Recognition, Springer International Publishing, Cham, 2018, pp. 252–258.

[6]

R. Donida Labati, V. Piuri, R. Sassi, F. Scotti, G. Sforza, Adaptive ECG biometric recognition: a study on re-enrollment methods for QRS signals, in: Proc. of the IEEE Symposium on Computational Intelligence in Biometrics and Identity Management, 2014, pp. 30–37.

[7]

Pereira T.M.C., Conceição R.C., Sencadas V., Sebastião R., Biometric recognition: A systematic review on electrocardiogram data acquisition methods, Sensors 23 (3) (2023).

[8]

Castaneda D., Esparza A., Ghamari M., Soltanpur C., Nazeran H., A review on wearable photoplethysmography sensors and their potential future applications in health care, Int. J. Biosens. Bioelectron. 4 (2018) 195–202.

[9]

Uwaechia A.N., Ramli D.A., A comprehensive survey on ECG signals as new biometric modality for human authentication: Recent advances and future challenges, IEEE Access 9 (2021) 97760–97802.

[10]

Donida Labati R., Piuri V., Rundo F., Scotti F., Photoplethysmographic biometrics: A comprehensive survey, Pattern Recognit. Lett. 156 (2022) 119–125.

[11]

Donida Labati R., Muñoz E., Piuri V., Sassi R., Scotti F., Deep-ECG: Convolutional neural networks for ECG biometric recognition, Pattern Recognit. Lett. 126 (2019) 78–85.

[12]

Islam M.S., Alhichri H., Bazi Y., Ammour N., Alajlan N., Jomaa R.M., Heartprint: A dataset of multisession ECG signal with long interval captured from fingers for biometric recognition, Data 7 (10) (2022).

[13]

Biswas D., Everson L., Liu M., Panwar M., Verhoef B., Patki S., Kim C.H., Acharyya A., Van Hoof C., Konijnenburg M., Van Helleputte N., CorNET: Deep learning framework for PPG-based heart rate estimation and biometric identification in ambulant environment, IEEE Trans. Biomed. Circuits Syst. 13 (2) (2019) 282–291.

[14]

Chicco D., Siamese neural networks: An overview, in: Cartwright H. (Ed.), Artificial Neural Networks, Springer US, New York, NY, 2021, pp. 73–94.

[15]

Donida Labati R., Piuri V., Rundo F., Scotti F., Spampinato C., Biometric recognition of PPG cardiac signals using transformed spectrogram images, in: Pattern Recognition. ICPR Int. Workshops and Challenges, Springer Int. Publishing, Cham, 2021, pp. 244–257.

[16]

Samarati P., De Capitani di Vimercati S., Cloud security: Issues and concerns, in: Murugesan S., Bojanova I. (Eds.), Encyclopedia on Cloud Computing, Wiley, 2016.

[17]

W. Karlen, M. Turner, E. Cooke, G. Dumont, J.M. Ansermino, CapnoBase: Signal database and tools to collect, share and annotate respiratory signals, in: Annual Meeting of the Society for Technology in Anesthesia, West Palm Beach, 2010.

[18]

Zhang Z., Pi Z., Liu B., TROIKA: A general framework for heart rate monitoring using wrist-type photoplethysmographic signals during intensive physical exercise, IEEE Trans. Biomed. Eng. 62 (2) (2015) 522–531.

[19]

Merone M., Soda P., Sansone M., Sansone C., ECG databases for biometric systems: A systematic review, Expert Syst. Appl. 67 (2017) 189–202.

Digital Library

[20]

Tantawi M., Salem A., Tolba M.F., Fiducial based approach to ECG biometrics using limited fiducial points, in: Hassanien A.E., Tolba M.F., Taher Azar A. (Eds.), Advanced Machine Learning Technologies and Applications, Springer International Publishing, Cham, 2014, pp. 199–210.

[21]

Wang Y., Agrafioti F., Hatzinakos D., Plataniotis K.N., Analysis of human electrocardiogram for biometric recognition, EURASIP J. Adv. Signal Process. 2008 (1) (2008).

[22]

K.N. Plataniotis, D. Hatzinakos, J.K.M. Lee, ECG Biometric Recognition Without Fiducial Detection, in: 2006 Biometrics Symposium: Special Session on Research At the Biometric Consortium Conf., 2006, pp. 1–6.

[23]

Melzi P., Tolosana R., Vera-Rodriguez R., ECG biometric recognition: Review, system proposal, and benchmark evaluation, IEEE Access 11 (2023) 15555–15566.

[24]

Randazzo V., Cirrincione G., Pasero E., Shallow neural network for biometrics from the ECG-WATCH, in: Huang D.-S., Bevilacqua V., Hussain A. (Eds.), Intelligent Computing Theories and Application, Springer International Publishing, Cham, 2020, pp. 259–269.

[25]

Kim H., Phan T.Q., Hong W., Chun S.Y., Physiology-based augmented deep neural network frameworks for ECG biometrics with short ECG pulses considering varying heart rates, Pattern Recognit. Lett. 156 (2022) 1–6.

[26]

Hwang D.Y., Taha B., Lee D.S., Hatzinakos D., Evaluation of the time stability and uniqueness in PPG-based biometric system, IEEE Trans. Inf. Forensics Secur. 16 (2021) 116–130.

[27]

V. Jindal, J. Birjandtalab, M.B. Pouyan, M. Nourani, An adaptive deep learning approach for PPG-based identification, in: Proc. of the 38th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, 2016, pp. 6401–6404.

[28]

Byeon Y.-H., Kwak K.-C., Pre-configured deep convolutional neural networks with various time-frequency representations for biometrics from ECG signals, Appl. Sci. 9 (22) (2019).

[29]

Y. Byeon, S. Pan, K. Kwak, Ensemble Deep Learning Models for ECG-based Biometrics, in: Proc. of the Cybernetics Informatics, 2020, pp. 1–5.

[30]

Ciocoiu I.B., Cleju N., Off-person ECG biometrics using spatial representations and convolutional neural networks, IEEE Access 8 (2020) 218966–218981.

[31]

Hwang D.Y., Taha B., Lee D.S., Hatzinakos D., Evaluation of the time stability and uniqueness in PPG-based biometric system, IEEE Trans. Inf. Forensics Secur. 16 (2021) 116–130.

[32]

N. Karimian, Z. Guo, M. Tehranipoor, D. Forte, Human recognition from photoplethysmography (PPG) based on non-fiducial features, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2017, pp. 4636–4640.

[33]

A. Bonissi, R. Donida Labati, L. Perico, R. Sassi, F. Scotti, L. Sparagino, A preliminary study on continuous authentication methods for photoplethysmographic biometrics, in: Proc. of the IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications, 2013, pp. 28–33.

[34]

S.P.M. Namini, S. Rashidi, Implementation of artificial features in improvement of biometrics based PPG, in: Proc. of the 6th Int. Conf. on Computer and Knowledge Engineering, 2016, pp. 342–346.

[35]

E. Lee, A. Ho, Y. Wang, C. Huang, C. Lee, Cross-Domain Adaptation for Biometric Identification Using Photoplethysmogram, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2020, pp. 1289–1293.

[36]

Hwang D.Y., Taha B., Hatzinakos D., PBGAN: Learning PPG representations from GAN for time-stable and unique verification system, Trans. Inf. Forensics Secur. 16 (2021) 5124–5137.

[37]

S.Z. Fatemian, F. Agrafioti, D. Hatzinakos, HeartID: Cardiac biometric recognition, in: 2010 Fourth IEEE International Conf. on Biometrics: Theory, Applications and Systems, 2010, pp. 1–5.

[38]

Song C., Ji S., Face recognition method based on siamese networks under non-restricted conditions, IEEE Access 10 (2022) 40432–40444.

[39]

Solano J., Rivera E., Tengana L., López C., Flórez J., Ochoa M., A siamese neural network for scalable behavioral biometrics authentication, in: Applied Cryptography and Network Security Workshops, Springer International Publishing, Cham, 2022, pp. 515–535.

[40]

Ivanciu L., Ivanciu I.-A., Faragó P., Roman M., Hintea S., An ECG-based authentication system using siamese neural networks, J. Med. Biol. Eng. 41 (2021) 558–570.

[41]

Y. Zhao, J. Li, C. Liu, ECG identification fusion model based on siameseneural networks, in: Proc. of the 6th International Conf. on Biological Information and Biomedical Engineering, 2022, pp. 1–6.

[42]

C. Lin, A. Kumar, Multi-Siamese networks to accurately match contactless to contact-based fingerprint images, in: Proc. of the IEEE International Joint Conf. on Biometrics, 2017, pp. 277–285.

[43]

R. Miller, N.K. Banerjee, S. Banerjee, Using Siamese Neural Networks to Perform Cross-System Behavioral Authentication in Virtual Reality, in: Proc. of the IEEE Virtual Reality and 3D User Interfaces, 2021, pp. 140–149.

[44]

F. Schroff, D. Kalenichenko, J. Philbin, FaceNet: A Unified Embedding for Face Recognition and Clustering, in: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2015.

[45]

Jain A.K., Flynn P., Ross A.A., Handbook of Biometrics, first ed., Springer Publishing Company, Incorporated, 2010.

Index Terms

MultiCardioNet: Interoperability between ECG and PPG biometrics

Index terms have been assigned to the content through auto-classification.

Recommendations

Blood Pressure Estimation Neural Network using Large Kernel Convolutional Attention
ICDIP '23: Proceedings of the 15th International Conference on Digital Image Processing

We consider the problem of blood pressure estimation. Given a certain physiological signal of the human body, the goal is to estimate the blood pressure. Existing works in this area only use physiological signals and do not utilize personal information ...
HRV Assessment Using Finger-tip Photoplethysmography (PulseRate) as Compared to ECG on Healthy Subjects During Different Postures and Fixed Breathing Pattern
Abstract
Heart Rate Variability (HRV) is a well-known method to assess the human Autonomic Nervous System (ANS) functions. Currently, in the health care information system, HRV properties are very useful to provide medical and other vital signs of the ...
Improved Bivariate-VAR Model for Extraction of Respiratory Information from Artifact Corrupted ECG and PPG Signals
Abstract
In general in ICUs, operation theatres, post-operative critical care units, and even ambulatory monitors, the patients are continuously examined with ECG and pulse oximeters PPG. In these situations, where the ECG and/or PPG are afflicted by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Pattern Recognition Letters

Pattern Recognition Letters Volume 175, Issue C

Nov 2023

104 pages

ISSN:0167-8655

Issue’s Table of Contents

The Authors.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 November 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents