Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
Statistical Time-Series Analysis of Interferometric Coherence from Sentinel-1 Sensors for Landslide Detection and Early Warning
Next Article in Special Issue
What Is behind Changes in Resting Heart Rate and Heart Rate Variability? A Large-Scale Analysis of Longitudinal Measurements Acquired in Free-Living
Previous Article in Journal
Technical Proposal for Monitoring Thermal and Mechanical Stresses of a Runway Pavement
Previous Article in Special Issue
The Use of a Smartphone Application in Monitoring HRV during an Altitude Training Camp in Professional Female Cyclists: A Preliminary Study
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Wavelet Analysis and Self-Similarity of Photoplethysmography Signals for HRV Estimation and Quality Assessment

by
Alexander Neshitov
*,
Konstantin Tyapochkin
*,
Evgeniya Smorodnikova
and
Pavel Pravdin
Welltory Inc., 541 Jefferson, Suite 100, Redwood City, CA 94063, USA
*
Authors to whom correspondence should be addressed.
Sensors 2021, 21(20), 6798; https://doi.org/10.3390/s21206798
Submission received: 15 September 2021 / Revised: 1 October 2021 / Accepted: 6 October 2021 / Published: 13 October 2021
Figure 1
<p>Examples of PPG signals: (<b>a</b>) a clean signal with clearly visible peaks; (<b>b</b>) a noisy signal where peaks associated to cardiac cycles still can be recognized; (<b>c</b>) a corrupted signal where no accurate peak detection is possible.</p> ">
Figure 2
<p>Mexican hat wavelet function <math display="inline"><semantics> <mrow> <mi>y</mi> <mo>=</mo> <mi>ψ</mi> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> </semantics></math>.</p> ">
Figure 3
<p>Algorithm workflow.</p> ">
Figure 4
<p>The PPG signal (<b>top</b>) and its corresponding STFT spectrogram (<b>bottom</b>), part of the PPG signal of subject 01 in the TROIKA dataset. Heart rate frequency is growing from <math display="inline"><semantics> <mrow> <mn>1.2</mn> </mrow> </semantics></math> Hz to <math display="inline"><semantics> <mrow> <mn>1.9</mn> </mrow> </semantics></math> Hz.</p> ">
Figure 5
<p>Continuity filter highlighting curves with bounded rates of change; the horizontal length is adjusted to correspond to 10 s of time and the vertical length corresponds to a change in frequency of <math display="inline"><semantics> <mrow> <mn>0.3</mn> </mrow> </semantics></math> Hz.</p> ">
Figure 6
<p>Filtered spectrogram. Black lines show the curves consisting of local maxima in the spectrogram columns.</p> ">
Figure 7
<p>Scaled Mexican hat wavelet and its frequency spectrum for the smallest scale <math display="inline"><semantics> <msub> <mi>a</mi> <mn>1</mn> </msub> </semantics></math> and the largest scale <math display="inline"><semantics> <msub> <mi>a</mi> <mn>50</mn> </msub> </semantics></math> in the chosen scale range.</p> ">
Figure 8
<p>PPG signal, the corresponding scalogram computed with the Mexican hat wavelet for the scale range <math display="inline"><semantics> <mrow> <msub> <mi>a</mi> <mn>1</mn> </msub> <mo>,</mo> <mo>…</mo> <msub> <mi>a</mi> <mn>50</mn> </msub> </mrow> </semantics></math>, and the ridge lines in the scalogram. This signal is a part of the red channel PPG from subject 01 in the Welltory-PPG-dataset. The R peaks in the signal are detected as top points of the ridge lines chosen by the filtration Algorithm 3.</p> ">
Figure 9
<p>Part of the S3 signal of the PPG-DaLiA dataset.</p> ">
Figure 10
<p>Filtration of the RR intervals of <a href="#sensors-21-06798-f009" class="html-fig">Figure 9</a>. Green intervals are kept by the algorithm and red intervals are discarded.</p> ">
Figure 11
<p>PPG-DaLiA, Subject S3, interval 0 to 100 s.</p> ">
Versions Notes

Abstract

:
Peak-to-peak intervals in Photoplethysmography (PPG) can be used for heart rate variability (HRV) estimation if the PPG is collected from a healthy person at rest. Many factors, such as a person’s movements or hardware issues, can affect the signal quality and make some parts of the PPG signal unsuitable for reliable peak detection. Therefore, a robust HRV estimation algorithm should not only detect peaks, but also identify corrupted signal parts. We introduce such an algorithm in this paper. It uses continuous wavelet transform (CWT) for peak detection and a combination of features derived from CWT and metrics based on PPG signals’ self-similarity to identify corrupted parts. We tested the algorithm on three different datasets: a newly introduced Welltory-PPG-dataset containing PPG signals collected with smartphones using the Welltory app, and two publicly available PPG datasets: TROIKAand PPG-DaLiA. The algorithm demonstrated good accuracy in peak-to-peak intervals detection and HRV metric estimation.

1. Introduction

Heart rate variability (HRV) is the physiological phenomenon of variation in the time interval between heartbeats [1]. Typically, HRV is estimated using electrocardiography (ECG). R peaks, the upward deflections in ventricular depolarization complexes in ECG [2] are detected, and the distances between consecutive R peaks, called RR intervals, are analyzed. There is a substantial body of research that detects R peaks in ECG using various signal processing methods [3], as well as time series classification tools such as interval feature transformation [4].
Photoplethysmography (PPG) is a non-invasive and low-cost optical measurement technique that provides important information about the cardiovascular system [5,6]. PPG tracks blood volume changes in peripheral blood vessels by illuminating the skin and measuring changes in light absorption. In practice, PPG signals are often collected using wrist-worn devices with optical sensors, such as smartwatches [7,8], or using a smartphone camera attached to a user’s finger [9,10] (we will refer to such signals as smartphone PPG). PPG signals are used to estimate heart rate [7,8,10,11], as well as blood oxygen saturation, blood pressure [6,10], etc.
Research [12,13,14,15] shows that, if a PPG signal is collected from a healthy subject at rest, then the intervals between consecutive major peaks in PPG can serve as a substitute for RR intervals in ECG for various heart rate variability metrics. At the same time, PPG signals collected during or right after exercise or from a patient with cardiovascular disease can have peak-to-peak intervals that differ significantly from RR intervals in ECG and cannot be used for HRV estimation [12,15].
In practice, PPG signals collected in an uncontrolled environment often suffer from measurement artifacts that can corrupt sufficiently long parts of the signals and make these parts unsuitable for reliable peak detection. Figure 1 shows three common types of smartphone PPG signals that we encounter in practice:
While it is easy to perform well on signals like Figure 1a, a reliable algorithm must also distinguish corrupted parts like Figure 1c to exclude them from the analysis. For the signal parts such as Figure 1b, a reliable algorithm should choose peaks corresponding to cardiac cycles rather than the noise in the signal.
Several algorithms were developed for peak-to-peak interval detection in PPG using slope analysis [16,17], automatic multiscale peak detection [18,19], neural networks [20], adaptive threshold peak detection [21,22]. Existing algorithms filter out erroneous intervals using outlier detection based solely on the lengths of detected intervals. In our algorithm, we propose to analyze the signal during the detected intervals to estimate their reliability. A real-time algorithm for peak detection and signal quality estimation in smartphone PPG was proposed in [9]. As a real-time algorithm, it was restricted in computational complexity and the variety of methods that can be used. Therefore we propose a new offline algorithm that uses continuous wavelet transform (CWT).
CWT is a tool that provides a representation of a signal in the time-scale domain. It is used for time-frequency localization [23] and pattern matching [24]. CWT was successfully used for the analysis of ECG signals [25], electroencephalogram (EEG), and other time series data [26]. Peak detection using continuous or discrete wavelet transform was performed in various contexts in [24,27,28,29,30,31,32].
The main features of CWT that we use in the proposed algorithm are the ridge lines, i.e., curves consisting of points of local maxima at fixed scales in the time-scale domain. Using the correspondence between peaks in the signal and the ridge lines in CWT with the Mexican hat mother wavelet (see Section 2.3), our algorithm uses the ridge lines lengths to detect the peaks in PPG that correspond to the heartbeats. The algorithm also uses the shape of the ridge lines and signal self-similarity characteristics as features to identify corrupted parts in PPG signals. We describe the proposed algorithm in detail in Section 3.
We evaluate the accuracy of the proposed algorithm on three different publicly available datasets: Welltory-PPG-dataset, TROIKA [7] and PPG-DaLiA [8]. Note that, since PPG signals during exercise cannot be used for HRV estimation according to [12,15], for validation using TROIKA [7] and PPG-DaLiA [8] we only used parts of the signals that were collected before any labeled physical activity. Welltory-PPG-dataset is a new publicly available dataset that we introduce in this paper. It consists of smartphone PPG measurements with simultaneously collected ground truth RR intervals from the Polar H10 chest strap device. We introduce this dataset, since most publicly available PPG datasets (such as TROIKA [7] and PPG-DaLiA [8]) are collected using wrist-worn devices and are aimed at heart rate detection during physical activity, and the existing smartphone PPG dataset [33] consists of 10-second signals which are too short for a reliable HRV assessment. We describe the dataset structure and data collection process in Section 2.1.1.
While CWT is used for various signal types, including ECG, EEG, etc., it has not been used before for peak detection in PPG. In contrast with existing PPG analysis algorithms, our algorithm filters out unreliable peak-to-peak intervals by detecting corrupted parts in the signal. Our algorithm demonstrated good accuracy in basic HRV metrics on three publicly available datasets containing PPG from different sources. Thus, we conclude that the algorithm should generalize well to various PPG signals of different origins, be robust to signal corruption, and can be able to be used for reliable HRV estimation from PPG signals collected in an uncontrolled environment.
The paper is organized as follows. The datasets used for algorithm validation are described in Section 2.1. HRV metrics used for accuracy estimation are described in Section 2.2. Section 2.3 contains a discussion about CWT and the ridge lines. A detailed description of the proposed algorithm is given in Section 3. Section 4 contains tables with HRV metrics estimation errors on the used validation datasets. Section 5 provides additional discussion. It contains a justification of the methods used in the proposed algorithm, its limitations, and its comparison with previously developed algorithms. Moreover, it contains a justification of the choice of the ground truth labels in Welltory-PPG-dataset. Section 6 contains concluding remarks.

2. Materials and Methods

2.1. Datasets

2.1.1. Welltory-PPG-Dataset

This is a newly introduced dataset. It is publicly available at https://github.com/Welltory/welltory-ppg-dataset (accessed on 1 July 2021). The dataset consists of 21 records containing three time series: red, green, and blue channel PPG signals, and simultaneously collected RR intervals. RR intervals were collected using a Polar H10 chest strap and manually examined by an expert to ensure their accuracy. PPG data were obtained via a smartphone camera using the Welltory app. Signal lengths vary from 68 to 112 s.

Data Collection

Each participant put their index finger over a smartphone camera, which recorded a video. For each frame in the video stream, we record its capture time and three numbers: r, g, b, which are the average values of red, green, and blue components of the frame pixel colors. Each participant was simultaneously wearing the Polar H10 chest strap. After each measurement was complete, the RR intervals detected by the Polar device during the measurement were collected. Each dataset record consists of the following arrays:
  • Time: moments of camera frame capture times in milliseconds elapsed from the measurement start;
  • R, G, B: arrays of numbers r, g, b for all captured frames;
  • RR: sequence of RR intervals collected from the Polar device during the measurement.

Participants

Thirteen healthy volunteers between the ages of 25 and 35 participated in the data collection. Each participant made one or two measurements using their Android smartphone. All participants provided written informed consent for publication.

2.1.2. Previously Published PPG Datasets

In addition to Welltory-PPG-dataset, we used two publicly available datasets: TROIKA [7] and PPG-DaLiA [8] for algorithm validation. These datasets were introduced for heart rate estimation and contain simultaneous PPG and ECG signals and accelerometer readings collected during exercise and other labeled physical activity. Since PPG signals collected during exercise are unsuitable for HRV estimation [12,15], we used signal parts not labeled with physical activity. In TROIKA these parts are the initial 30-second chunks of the signals. In PPG-DaLiA these are the intervals that are labeled as “sitting”.

2.2. HRV Metrics

We use two basic metrics of heart rate variability: SDNN, and RMSSD. For a sequence of normal RR intervals r r 1 , , r r n , its SDNN is defined as the standard deviation:
SDNN ( r r 1 , , r r n ) = 1 n i = 1 n ( r r i r r ¯ ) 2 , r r ¯ = 1 n i = 1 n r r i .
RMSSD, the root mean square of the successive differences of RR intervals, is defined as
RMSSD ( r r 1 , , r r n ) = 1 n 1 i = 1 n 1 ( r r i + 1 r r i ) 2 .
The latter metric has a geometric interpretation in terms of the Poincaré plot of the sequence r r 1 , , r r n : for the distribution of pairs ( r r i , r r i + 1 ) of consecutive RR intervals, RMSSD is proportional to the standard deviation of the distance from the points ( x , y ) = ( r r i , r r i + 1 ) to the main diagonal x = y .

2.3. Continuous Wavelet Transform

For a mother wavelet function ψ ( t ) let ψ ( a , b ) denote its scaled and translated version:
ψ a , b ( t ) = 1 a ψ t b a
Here a > 0 is the scale parameter, and b R is the translation parameter. Then for a function x ( t ) , t R its continuous wavelet transform (CWT) is defined as [23] ([2.4]):
X w ( a , b ) = R x ( t ) ψ a , b ( t ) d t
The coefficients X w ( a , b ) show matching between the signal x ( t ) and the mother wavelet ψ dilated with scale a and centered at position b. In our algorithm we chose ψ to be the Mexican hat wavelet function. It is proportional to the second derivative of the Gaussian function and is defined as:
ψ ( t ) = 2 3 π 1 / 4 ( 1 t 2 ) e t 2 / 2
It exhibits typical features of a single peak (Figure 2):
We will say that ( a , b ) is a ridge point if the function t X w ( a , t ) has a local maximum at point t = b . For a fixed a the ridge points at scale a show the time instants where the signal x ( t ) most resembles the peak at scale a. We will consider continuous curves in the ( a , b ) -plane that consist of ridge points. Following [24], we will call such curves ridge lines. So ridge lines indicate the position of peaks in the signal at different scales. We discuss this in more detail in Section 3.3.1.

3. Proposed Algorithm

In this section, we describe the proposed algorithm. In the rest of the paper, we will refer to peaks in PPG that correspond to heartbeats as R peaks for brevity. Peak-to-peak intervals will be referred to as RR intervals. We will use the CWT of the PPG signal with the Mexican hat function as the mother wavelet as the main tool.
In the first step of the algorithm, we perform signal preprocessing that addresses the two most common problems: abrupt shifts, or steps in signals and signals becoming almost constant due to hardware issues. A detailed description of preprocessing steps is given in Section 3.1. Then we perform R peak detection. To detect R peaks in the signal, we will identify their corresponding ridge lines in the CWT. Our algorithm for R peak detection is based on two principles that must hold for non-corrupted PPG signals collected from healthy subjects at rest:
  • the R peaks correspond to longer ridge lines, i.e., lines that are present on a larger scale range (see Section 3.3 for more details).
  • PPG signals are almost periodic, so normal R peaks arise approximately at a frequency determined by the heart rate that varies gradually over time.
Therefore, we use a 2-step process for R peak detection. First, we estimate the heart rate from the PPG signal using the short-time Fourier transform spectrogram of the signal. Then, the algorithm uses the estimated heart rate as additional information to choose ridge lines corresponding to R peaks. Informally speaking, the algorithm chooses the most persistent ridge lines that arise in the CWT at a frequency corresponding to the estimated heart rate. Finally, the locations of R peaks are predicted as positions of the chosen ridge lines at the smallest scale. A detailed description of the R peak detection algorithm is given in Section 3.3.
After the R peaks are detected, we consider the corresponding RR intervals. We evaluate the quality of detected RR intervals to identify and discard RR intervals found in corrupted parts of the signal. Since a non-corrupted PPG signal is almost periodic, the quality estimation is based on two considerations:
  • A signal must have similar shapes inside detected RR intervals;
  • The ridge lines in CWT that define the edges of a RR interval must have similar shapes. In particular, the distances between them should be approximately the same on different scale levels.
We assign to each RR interval its quality score based on the principles above and then discard the RR intervals with quality scores below an automatically determined threshold. We give a detailed description of the quality score calculation and the choice of the quality threshold in Section 3.4.
Figure 3 shows the proposed algorithm workflow for a single channel PPG:
Once the algorithm finishes, we estimate the overall quality of the signal as the following ratio:
discarded ratio = n d i s c a r d e d n t o t a l
where n t o t a l is the total number of RR intervals detected by the R peaks detection part of the algorithm and n d i s c a r d e d is the number of detected RR intervals that were discarded by the filtration part of the algorithm.
In some cases, valleys in the PPG signals can be easier to locate than peaks. Thus, as a final step, we apply our algorithm to both the PPG signal and the negative of the PPG signal and obtain two sets of detected RR intervals. Then we choose the result that has the smallest discarded ratio as the algorithm output.
For a multi-channel PPG signal (e.g., smartphone PPG containing values in the red, green, and blue channels of the video frames captured by a smartphone camera), we choose the best channel as the one that has the smallest discarded ratio. Note that research [34] suggests that channels with shorter wavelength should have the best signal to motion ratio. We do not make an a priori choice of the channel to avoid issues with device-specific color representations.

3.1. Signal Preprocessing

Most smartphone cameras provide frames at a rate of 30 frames per second. To increase accuracy, we interpolate the signal to a uniformly sampled sequence with a sampling frequency f = 100 Hz, as the upsampling is necessary for accurate HRV estimation [17]. Most cameras produce red, green, and blue channel values in the standard range (0, 255). If the PPG signal is given in another range, we rescale it to the standard range. Signal preprocessing aims to identify the following common issues with the signal:
  • Step detection. In smartphone PPG signals, removing from or reapplying the finger to the camera results in abrupt steps in the signal. To detect such steps, we compute the running amplitude with a window length of 1 s. If the running amplitude exceeds 4 times the median of the running amplitude, a step in the signal is detected. The threshold value 4 was chosen empirically by examining a number of examples.
  • Constant signal detection. Sometimes the signal becomes constant if there are issues with color rendering in the frame or there is no finger over the camera at all. Analysis of examples shows that 0.1 is a reliable threshold value for running signal amplitude to detect a constant signal.
Parts of the signal labeled as having signal steps or constant signal are set to zero. Then, we split the signal into continuous chunks between the labeled parts and set the chunks shorter than 2 s to zero. For every remaining chunk, we remove the trend by subtracting the running average in 2 s windows and apply a low-pass filter with a 10 Hz threshold to avoid aliasing and remove high-frequency noise.

3.2. Heart Rate Estimation

In this subsection, we describe the algorithm for heart rate estimation from a PPG signal. Our approach is similar to the TROIKA [7] in that we are estimating heart rate by constructing a continuous curve consisting of peaks in the spectrogram columns. Our context is different from one in [7] in two aspects: firstly, we are interested in PPG collected at rest, so we expect motion artifacts associated with occasional movement, rather than intensive physical exercise considered in [7]. Secondly, we do not collect accelerometer data to estimate the subject’s movements. Therefore we use the following approach:
  • First we filter the spectrogram using a convolution with a 2d filter that highlights curves with a bounded rate of change;
  • We consider local maxima in the columns of the filtered spectrogram;
  • We find a rough estimate of heart rate frequency and construct a continuous curve consisting of local maxima that are closest to the estimate.
We describe our approach in detail below. Suppose that x n is a discrete signal obtained by a uniform sampling with frequency f from a function x ( t ) with a discrete step Δ t :
x n = x ( t n ) , t n = n Δ t , Δ t = 1 / f , n = 1 , 2 , N

3.2.1. Sliding Window Spectrogram

As a feature, we use the signal spectrogram computed with a sliding Dirichlet window of 5 s in length. The spectrogram is computed as the squared magnitude of the short time Fourier transform (STFT) for frequencies f k , k = 1 , 80 uniformly sampled between 0.5 and 3.3 Hz, with stride = 0.5 s:
S p e c t r o g r a m [ k , j ] = n = s j s j + 5 f x n e 2 π i f k t n Δ t 2 , s j = 0.5 * f * j
While peaks in a spectrum of a single window may be associated with measurement artifacts, the heart rate corresponds to a continuous curve in the spectrogram. An example of the spectrogram is given in Figure 4.
As we can see in Figure 4, the heart rate frequency in that example gradually grows from 1.2  Hz at the beginning to 1.9  Hz at the end. The curve is clearly seen for the first 30 s and, after that, it becomes smudged between 30 and 50. To simplify the curve detection we convolve the spectrogram with a 2d filter shown in Figure 5, which highlights continuously evolving curves on the spectrogram:

3.2.2. Local Maxima in the Spectrogram Columns

After the filtration, let us consider the points of local maxima in the columns of the spectrogram. We will construct the curve associated with heart rate frequency by following these points of local maxima in a continuous manner. To find the initial point on the curve, we need to choose between the local maxima in the first column of the spectrogram. In some cases, the point of the highest local maximum does not necessarily correspond to the actual heart rate. Therefore, we find a rough estimate of the heart rate and then choose the peak that is closest to this estimate. To find a rough estimate, we consider a bandpass filtration of the PPG signal with a narrow bandwidth and count the number of peaks and the number of zero crossings in the filtration. For more in detail, we use Algorithm 1. It takes i, an index of the spectrogram column as an input, and returns the frequency of a peak in the i-th spectrogram column, such that this frequency is the closest to the rough heart rate estimate.
Algorithm 1 Rough estimate of heart rate frequency in the i-th spectrogram column
1:
s = i -th column in spectrogram
2:
t _ s t a r t = 0.5 * i      ▹ start time of the i-th sliding window with stride 0.5 s
3:
t e s t _ l e n = min ( 10 , signal duration t _ s t a r t )
4:
x = part of the signal between t _ s t a r t and t _ s t a r t + t e s t _ l e n seconds
5:
f m a x = frequency corresponding to the maximum value of s
6:
if f m a x > 2 then
7:
     t h r e s h o l d = 2.5
8:
else if f m a x < 1 then
9:
     t h r e s h o l d = 1.5
10:
else
11:
     t h r e s h o l d = 2
12:
end if
13:
x s m = bandpass filtration of x with cutoff frequencies 0.1 and t h r e s h o l d
14:
n _ z e r o _ c r o s s = number of times x s m crosses the zero level
15:
n _ l o c _ m a x = number of local maxima in x s m
16:
u p p e r _ e s t i m a t e = 1 / t e s t _ l e n * n _ l o c _ m a x
17:
l o w e r _ e s t i m a t e = 1 / t e s t _ l e n * 0.5 * n _ z e r o _ c r o s s
18:
e s t i m a t e = 0.5 * ( l o w e r _ e s t i m a t e + u p p e r _ e s t i m a t e )
19:
F = frequencies corresponding to 3 highest peaks in s
20:
f h r = arg min f F | f e s t i m a t e |
  return f h r
Now we construct a curve in the spectrogram plane showing heart rate frequency during the measurement. First, we choose the initial frequency using Algorithm 1 for the 0-th column of the spectrogram. Then we construct the continuous curve following along local maxima in columns of the spectrogram. If at some step we cannot proceed continuously, then we perform Algorithm 1 again to find the point of local maximum in the spectrogram column that is closest to the rough estimate. Along the way, we apply exponential smoothing to the obtained curve for a more robust estimate. In more detail, we use the Algorithm 2:
Algorithm 2 Construction of the heart rate frequency curve
1:
n = number of columns in spectrogram
2:
hrf [ 0 ] = output of Algorithm 1 for the 0-th column
3:
fori in range(1, n) do
4:
     F = frequencies corresponding to 3 largest local maxima in the i-th column of spectrogram
5:
     f c l = arg min f F | f hrf [ i 1 ] |
6:
    if  | f c l hrf [ i 1 ] | < 0.1  then
7:
         hrf [ i ] = f c l
8:
    else
9:
         f n e x t = output of Algorithm 1 for the i-th column
10:
         hrf [ i ] = 0.95 hrf [ i 1 ] + 0.05 f n e x t
11:
    end if
12:
end for
Now let us demonstrate the work of Algorithm 2. Figure 6 shows the filtered version of the spectrogram of Figure 4, the curves consisting of local maxima in the columns, and the heart rate frequency curve constructed by Algorithm 2. It correctly identifies the heart rate frequency change during the measurement.

3.3. R Peak Detection

3.3.1. Signal Scalogram and Ridge Lines

Recall our notation for the signal x n that is uniformly sampled from function x ( t ) with frequency f:
x n = x ( t n ) , t n = n Δ t , Δ t = 1 / f , n = 1 , 2 , N
where variable t represents time measured in seconds. Let ψ denote the Mexican hat wavelet function given from Equation (5). Consider scales a k evenly spaced on a logarithmic scale:
a k = 0.05 ( 1.0376 ) k 1 , k = 1 , , 50
Define the scalogram of the signal x n as the finite sum approximation to the integral that defines CWT of the function x ( t ) in Equation (4):
S c a l o g r a m [ k , n ] = m = 1 N x m ψ a k , t n ( t m ) Δ t , n = 1 , , N , k = 1 , , 50
The chosen scales range from a 1 = 0.05 to a 50 = 0.3 . This range was chosen empirically to accurately reflect the position of R peaks on the smallest scale and provide enough smoothing to remove noisy peaks on the large scale.
So the scalogram is a discretization of the CWT, thus the rows of the scalogram represent similarities of the signal with a typical peak shape on the corresponding scales. The ridge lines in CWT will correspond to ridge lines in the ( k , n ) plane consisting of points of local maxima in the scalogram rows S c a l o g r a m [ k , : ] Note that convolution with the scaled wavelet performs bandpass filtration, with wider bandwidth for smaller scales and narrower bandwidth for larger scales, as we can see in Figure 7. Thus, we can consider rows of the scalogram as filtration, or smoothing of the initial signal, and the ridge lines indicate locations of peaks in the signal at different levels of smoothing. The R peaks in the signal are the more persistent peaks, which exist at different levels of smoothing, and therefore R peaks are tips of longer ridge lines that are present on a larger scale range. Figure 8 shows a typical example that illustrates this idea:
As we can see in Figure 8, there are more ridge lines in the upper part of the scalogram, corresponding to noisy peaks in the signal, but we are able to distinguish ridge lines that correspond to R-peaks by choosing the longer lines and using our previous estimates of heart rate as a heuristic that suggests how often the actual ridge lines are expected to appear on the scalogram plane. In the next section we will discuss in detail the Algorithm 3 that chooses the ridge lines that correspond to R peaks.

3.3.2. Choosing Ridge Lines Associated to R-Peaks

Recall that we defined scalogram in Equation (10) as a matrix of shape ( 50 , N ) For a ridge line c u r v e and a scale a k , k = 1 , , 50 denote by c u r v e [ a k ] the time coordinate of the point on c u r v e with scale level a k (if such a point exists):
For a given set of ridge lines c u r v e 1 , , c u r v e m sorted according to their top points c u r v e i [ a 1 ] define their RR intervals as the distances between the top points:
r r i = c u r v e i + 1 [ a 1 ] c u r v e i [ a 1 ]
We will use these RR intervals to determine which curves to choose. First, we choose all the ridge lines that stretch from the bottom to the top of the scalogram. These are the curves corresponding to the most persistent peaks in the signal that are likely to be R-peaks. Some of the remaining curves are added to the set of chosen curves based on the likelihood of observing the corresponding set of RR intervals given the previously estimated heart rate frequency.
We estimate the likelihood of a set of potential RR intervals as follows. According to [35], the length of RR intervals can be modeled as Inverse Gaussian distribution. In practice, the Inverse Gaussian distribution can be approximated by log-normal distribution [36], thus we may assume that logarithms of RR intervals are normally distributed, so the average log-likelihood of a set of RR intervals given the heart rate frequency is proportional to
estimated-likelihood ( r r , h r f ) = 1 k i = 1 k ( log ( r r i ) log ( e x p e c t e d _ r r i ) ) 2
where h r f = ( h r f 1 , , h r f k ) and h r f i the expected heart rate frequency during interval r r i , and e x p e c t e d _ r r i = 1 / h r f i is the expected length of RR interval. We use this estimate of likelihood to finally choose the ridge lines associated to R-peaks, as described in Algorithm 3:
Algorithm 3 Choosing ridge lines in the scalogram
1:
h r = estimated heart rate frequency given by Algorithm 2
2:
c h o s e n _ c u r v e s = ridge lines with lowest point below the scale level 0.244 and highest point over the scale level 0.069
3:
c a n d i d a t e _ c u r v e s = ridge lines with lowest point between the scale 0.244 and 0.069 and highest point over the scale level 0.069 .
4:
Sort c a n d i d a t e _ c u r v e s by the height of the lowest point in the increasing order
5:
for c u r v e in c a n d i d a t e _ c u r v e s  do
6:
     p r o p o s e d _ s e t = c h o s e n _ c u r v e s { c u r v e }
7:
     r r _ c u r r e n t = set of intervals between curves from c h o s e n _ c u r v e s
8:
     r r _ p r o p o s e d = set of intervals between curves from p r o p o s e d _ s e t
9:
     c u r r e n t _ l i k e l i h o o d = estimated-likelihood ( r r _ c u r r e n t , h r )
10:
     p r o p o s e d _ l i k e l i h o o d = estimated-likelihood ( r r _ p r o p o s e d , h r )
11:
    if  p r o p o s e d _ l i k e l i h o o d > c u r r e n t _ l i k e l i h o o d  then
12:
         c h o s e n _ c u r v e s = p r o p o s e d _ s e t
13:
    end if
14:
end for
15:
return c h o s e n _ c u r v e s

3.4. RR Intervals Filtration

PPG signals often contain corrupted parts where no accurate R-peak detection is possible, so these parts must be discarded to ensure robust HRV estimation. To identify such parts we use the following method. After we have detected RR intervals, we assign to each detected interval a number between 0 and 1 (its quality) that reflects the likelihood that the found interval is accurate and reliable. Then a quality threshold is determined and the RR intervals with the quality below the threshold are discarded.
To develop a quality estimate, we use the following principles:
  • Parts of the signal inside the neighbor intervals must have similar shapes and amplitudes;
  • The distance between ridge lines defining the neighbor R-peaks must be approximately the same on different resolution levels.
Let us consider the example shown in Figure 9 to illustrate the principles above:
As we can see, in the corrupted part of the signal starting from 35 s, the signal parts inside RR intervals often can be weakly correlated, their amplitudes can be significantly different, and also the corresponding ridge lines do not repeat the same shape, and they bend in different ways, so the distance between varies on different scale levels more than it does for ridge lines in non-corrupted part of the signal. In the following discussion, we will describe our algorithm that filters out the RR intervals in the corrupted parts of the signal. For the signal shown in Figure 9 it produces the result shown in Figure 10:
To define the quality of the RR intervals, we introduce two auxiliary quality measures: similarity-based quality and CWT-based quality. In the following discussion, we denote by σ ( x ) = 1 / ( 1 + exp ( x ) ) the sigmoid function.

3.4.1. Similarity-Based Quality

Let x = ( x 1 , , x n ) and y = ( y 1 , , y k ) be two signal chunks. Let x r and y r denote x and y resampled to vectors of size 50. Define the correlation similarity between x and y as the correlation coefficient between x r and y r , limited by 0 from below:
s c o r r ( x , y ) = max ( c o r r ( x r , y r ) , 0 )
Let a m p ( x ) = max ( x ) min ( x ) and a m p ( y ) = max ( y ) min ( y ) denote the amplitudes of signals x and y. Suppose that a m p ( x ) is greater than a m p ( y ) and denote their quotient by r a m p = a m p ( x ) / a m p ( y ) . Define the amplitude similarity as
s a m p ( x , y ) = σ ( 2 ( 3.5 r a m p ) )
The formula (14) is chosen empirically to assign low values to pairs of signals where amplitudes are different by 4 times and more. Finally, define the similarity score between x and y as the geometric mean of its correlation similarity and amplitude similarity:
s s i m ( x , y ) = s c o r r ( x , y ) s a m p ( x , y )
Now, if r r 1 , , r r n is a sequence of detected RR intervals with R-peaks located at indices k 1 , , k n + 1 , then the similarity quality of the i-th RR interval r r i is defined as the geometric mean of its similarities with the neighbor RR intervals (using a single neighbor for i = 1 or i = n ):
q s i m ( r r i ) = s i s i + 1 , s i = s s i m ( x [ k i 1 : k i ] , x [ k i : k i + 1 ] ) , i = 2 , n 1

3.4.2. CWT-Based Quality

Suppose that c u r v e 1 and c u r v e 2 are two ridge lines. Consider a sequence r r [ f k ] = | c u r v e 1 [ f k ] c u r v e 2 [ f k ] | for all 1 k 50 where both c u r v e 1 [ f k ] and c u r v e 2 [ f k ] are defined. Let
r r s t d ( c u r v e 1 , c u r v e 2 ) = std ( r r [ f k ] ) / f 1000
be the standard deviation of distances between points on c u r v e 1 and c u r v e 2 measured in milliseconds. Now suppose that ends of some r r i intervals were detected using curves c u r v e 1 and c u r v e 2 in the scalogram. Then we define the CWT-based quality of the interval r r i as
q C W T ( r r i ) = σ ( ( r r s t d ( c u r v e 1 , c u r v e 2 ) 50 ) / 5 )

3.4.3. Filtration

Suppose r r 1 , , r r n is the sequence of detected RR intervals. Define the quality of each of the RR intervals as the product of similarity- and CWT-based quality:
q ( r r i ) = q s i m ( r r i ) q C W T ( r r i )
Now we filter intervals by quality using an automatically determined threshold as follows:
  • Select all intervals r r i with quality q ( r r i ) greater than 0.8
  • Sort the qualities of the selected intervals in descending order. Denote the resulting sequence by
    q 1 q 2 q n
  • Set the quality threshold as q i 0 where the index i 0 maximizes the product i q i :
    q c u t o f f = q i 0 , i 0 = arg max i = 1 , , n i q i
The initial rigid threshold of 0.8 is chosen empirically based on a number of signals examined. The final choice of the threshold value allows us to cut off the intervals that have substantially smaller quality than the rest of the intervals while trying to maximize the number of remaining intervals.

3.4.4. Outlier Detection

In addition to quality-based filtration, we apply outlier detection in the sequence of RR intervals based on their lengths. We use the following algorithm similar to one introduced in [37]. Suppose that r r 1 , , r r n is the sequence of detected RR intervals lengths. We then mark certain RR intervals as outliers and discard them from the final answer using Algorithm 4:
Algorithm 4 Algorithm to check if the i-th interval in r r 1 , , r r n is an outlier
1:
p 10 , m , p 90 = 10-, 50-, and 90-percentile of [ r r i 13 , r r i + 13 ]
2:
r r m a x = m a x ( r r i , r r i + 1 )
3:
r r m i n = m i n ( r r i , r r i + 1 )
4:
if ( r r m i n < m i n ( m 50 , p 10 0.2 * a m p ) )
5:
   and ( r r m a x > m a x ( m + 50 , p 90 + 0.2 * a m p ) )
6:
   and ( p 10 < ( r r m a x + r r m i n ) / 2 < p 90 )  then
7:
    mark r r i and r r i + 1 as outliers
8:
end if
9:
if r r i < m * 0.7 and r r i + 1 < m * 0.7 and p 10 < r r i + r r i + 1 < p 90  then
10:
    mark r r i and r r i + 1 as outliers
11:
end if
12:
if r r i > 1.6 * m then
13:
    mark r r i as an outlier
14:
end if
15:
if r r i < m i n ( 0.7 * m , p 10 ) then
16:
    mark r r i as an outlier
17:
end if

4. Results

We tested our algorithm’s accuracy on three datasets: Welltory-PPG-dataset, TROIKA, and PPG-DaLiA, using two HRV metrics: SDNN defined by Equation (1) and RMSSD defined by Equation (2). For each PPG signal and a sequence of reference RR intervals, we compute the following quantities:
  • Discarded ratio: ratio of the number of RR intervals that were discarded by the filtration part of the algorithm to the total number of RR intervals detected by the algorithm peak detection part, cf. Equation (6).
  • SDNN ae (RMSSD ae): the absolute error of estimation of SDNN (RMSSD), i.e., the difference between SDNN (RMSSD) derived from the sequence of intervals detected by the algorithm in PPG, and SDNN (RMSSD) derived from the sequence of reference RR intervals.
  • RR mae: the mean absolute error in RR interval detection, i.e., the mean absolute difference between an interval detected by the algorithm and the corresponding reference RR interval.
The values of SDNN ae, RMSSD ae, RR mae are given in milliseconds. Table 1 shows the error values for samples in Welltory-PPG-dataset:
Recall that the TROIKA dataset contains PPG from subjects during treadmill exercises with simultaneous ECG. To verify the accuracy of our algorithm, we chose parts of the PPG data collected in the first 30 s of each PPG signal when the subjects were at rest according to the dataset description. Reference RR intervals were derived from ECG signals using a simple algorithm detecting local maxima of a given minimum height and manually verified for accuracy. Table 2 shows the error values for samples in the TROIKA dataset:
The PPG-DaLiA dataset contains simultaneous PPG and ECG signals during annotated physical activity. For our analysis, we used parts of the signals with activity marked as “sitting”. This gives a signal of approximately 10 minutes for each subject. As in the previous dataset, reference RR intervals were derived from ECG signals using a simple algorithm detecting local maxima of given minimal height and manually verified for accuracy. For each subject, we cut the signal into non-overlapping 100-second segments. For each segment, we applied our algorithm and calculated the discarded ratio, SDNN ae, RMSSD ae, and RR mae metrics. The mean values of the calculated errors per subject are presented in Table 3. Note that the ECG readings for subjects 8 and 12 contain ectopic beats. Those beats were excluded from calculations of reference SDNN and RMSSD values.

5. Discussion

5.1. Justification of the Ground Truth RR Intervals Source in Welltory-PPG-Dataset

The Polar H10 device was chosen as a source of ground truth labels since it uses ECG for RR interval detection and has demonstrated good accuracy in several studies [38,39,40,41]. In particular, the study [38] reports that the difference between ECG RR intervals and Polar H10 RR intervals has a mean of 0.1 ms and limits of agreement of 2.3 ms at rest, and therefore recommends it as the “gold standard for RR interval assessments”. Chest strap devices were also used as a source of ground truth RR intervals in a number of research papers [42,43]. Additionally, the collected RR intervals in the Welltory-PPG-dataset were manually examined by an expert to ensure their accuracy.

5.2. Justification of the Chosen Methods

5.2.1. Signal Preprocessing

We chose the simple preprocessing procedure of Section 3.1 to avoid most basic signal issues such as vanished signal and abrupt shift. Since CWT with Mexican hat wavelet does not require baseline removal [24], this simple preprocessing is sufficient and also allows us to avoid signal distortion with more extensive preprocessing.

5.2.2. Heart Rate Estimation

Non-stationarities in the PPG signals are relatively moderate, as the heart rate changes gradually for healthy individuals at rest. Therefore STFT provides an adequate estimate of the time-frequency presentation of the signal and allows us to estimate the moving average heart rate.

5.2.3. Wavelet Based Peak Detection

We chose the Mexican hat function as the mother wavelet due to its good time–space resolution [44]. Other commonly used wavelets such as Morlet can provide a better resolution in the frequency-space, however, they show a less accurate localization in the time-domain and therefore reduce accuracy in peak detection. Note that the Mexican hat wavelet is broad in frequency, which can create difficulties when CWT is used for time–frequency localization, however, for the task of peak detection, it is more important to provide good localization in the time domain.
The scale range for the CWT from 0.05 to 0.3 is chosen empirically. The smallest scale 0.05 provides enough small-scale details of the initial signal, and decreasing the smallest scale does not give any accuracy improvements of R-peak detection.

5.3. Relation to Previous Work

In the heart rate detection part, we estimated heart rate by constructing a continuous curve consisting of peaks in the spectrogram. This approach is similar to one used in [7]. The difference is that in our context we do not expect heavy motion artifacts, as the data are collected at rest, and we do not have access to accelerometer data to filter out the motion impact. However, as we expect our PPG signals to be collected in an uncontrolled environment, we also do not have an initialization period as in [7], where we can safely choose the location of the highest peak in the periodogram as the heart rate estimate. Instead, we use a rough estimate using counting of peaks and zero crossings in a sufficiently smooth approximation to the signal as a prior estimate and then choose peaks in the periodogram that are closest to the prior estimate.
Ridge lines in the CWT with the Mexican hat mother wavelet were also used for peak detection in [24]. The novelty in our approach is that we use the length of the ridge lines as a feature to choose the right peaks, rather than the signal-to-noise ratio used in [24]. Another difference is that in our context we can use almost-periodicity of PPG signals as a heuristic when choosing the ridge lines. Moreover, in our approach we use the similarity in the ridge lines shapes to estimate the PPG signal quality.

5.4. Accuracy Comparison with Other Algorithms

Among the variety of algorithms proposed for automatic heart rate variability estimation from PPG [13,14,17,19,20,22] only [20] was tested on publicly available data. The algorithm of [20] was tested on the TROIKA dataset, reporting sufficiently large errors in HRV metric estimations (with SDNN error on average 37.29 and standard deviation of 59.67 ms). However, the test was run on entire signals, including treadmill exercise, where inter-beat intervals derived from PPG (even if detected correctly) cannot be used as substitutes of RR intervals for HRV estimation as shown in [12,15]. Therefore it is not possible to directly compare the results of our algorithm with the results reported in [20].

5.5. Limitations

To give more insight into algorithm accuracy, let us consider a typical example where SDNN of the algorithm-detected RR intervals is slightly different from reference intervals’ SDNN. The signal shown in Figure 11 is the first 100 s segment from subject S 3 in the PPG-DaLiAdataset:
In the example of Figure 11 the heart rate was decreasing during the first 20 seconds. At the same time, the first 20 seconds of PPG contained a lot of noise and were discarded by the algorithm (the red region on the plot). As a result, the PPG-derived SDNN of 96.66 shows the estimate of the SDNN during the last 80 seconds of the measurement, rather than the whole signal. The reference RR intervals SDNN during the last 80 seconds are 100.80 , and due to the non-stationarity of the signal, it is slightly smaller than the whole signal reference SDNN of 136.98 .
This example demonstrates one limitation of our algorithm: as the algorithm detects RR intervals in non-corrupted parts of the PPG signal, in the case when the characteristics change slightly over time (as heart rate in the previous example), the HRV estimation produced by the algorithm will be accurate for the non-corrupted interval but may slightly differ from the overall HRV estimates.

5.6. Directions for Future Research

The Empirical Wavelet Transform [45] (EWT) is an adaptive method that was successfully applied for EEG signals [46]. As a direction for future research, it would be interesting to see if EWT can be used instead of CWT to improve algorithm accuracy or execution speed.

6. Conclusions

We propose an algorithm that can accurately detect peak-to-peak intervals in PPG signals and identify corrupted parts in the signal where such detection is not possible. These requirements are necessary for the algorithm to be suitable for automatic analysis of PPG signals collected in an uncontrolled environment. The algorithm was tested on three publicly available datasets with PPG signals from different sources. The algorithm is able to recognize corrupted parts of PPG signals and the detected intervals provide accurate estimates for the most common HRV metrics: for SDNN, the mean absolute error is 4.07 ms on the Welltory-PPG-dataset, 6.86 ms on the TROIKA dataset and 7.85 ms on the PPG-DaLiAdataset; for RMSSD, it is 6.32 ms on the Welltory-PPG-dataset, 12.3 ms on the TROIKA dataset and on 6.09 ms on the PPG-DaLiAdataset. Therefore, we conclude that the algorithm performs well on various PPG signals; it can be used to automatically analyze PPG signals obtained in an uncontrolled environment; for PPG collected from healthy subjects at rest, the detected intervals can be used for accurate and reliable estimates of basic HRV metrics. The algorithm cannot be used for HRV estimation from PPG signals collected during or right after exercise since, in that case, the PPG signal does not contain sufficient information [12,15].

Author Contributions

Conceptualization, A.N., K.T., E.S., P.P.; methodology, A.N., K.T.; software, A.N., K.T.; validation, A.N., K.T.; formal analysis, A.N., K.T.; investigation, A.N., K.T.; resources, E.S., P.P.; data curation, K.T.; writing—original draft preparation, A.N., K.T.; writing—review and editing, A.N., K.T.; visualization, A.N., K.T.; supervision, E.S., P.P.; project administration, E.S., P.P. funding acquisition, E.S., P.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Welltory Inc.

Informed Consent Statement

Written informed consent for publication was obtained from all volunteers participated in data collection for Welltory-PPG-dataset.

Data Availability Statement

The newly introduced Welltory-PPG-dataset is publicly available at https://github.com/Welltory/welltory-ppg-dataset (accessed on 1 July 2021). Other datasets used in this paper are PPG-DaLiA [8] available at https://archive.ics.uci.edu/ml/datasets/PPG-DaLiA (accessed on 1 July 2021) and TROIKA [7] available at https://sites.google.com/site/researchbyzhang/ieeespcup2015 (accessed on 1 July 2021).

Acknowledgments

Authors would like to thank all the participants for taking part in data collection for the Welltory-PPG-dataset. We would especially like to thank Elizaveta Morozova for her help with the organization of the study. We would also like to thank Marina Kovaleva for valuable discussions and Asya Paloni and Julia Harryson for helping with manuscript preparation.

Conflicts of Interest

The authors of this study have paid consulting agreements with Welltory Inc. The company that provided the data for this study is an interested party when it comes to the results of this research. Special official confirmation was obtained from the company, which confirms that the data provided fully match the description of the data and were not specially selected in any way other than in accordance with the selection criteria described in this publication.

Abbreviations

The following abbreviations are used in this manuscript:
PPGPhotoplethysmography
ECGElectrocardiography
EEGElectroencephalography
RR intervalsIntervals between consecutive R peaks
STFTShort-time Fourier transform
CWTContinuous wavelet transform
HRVHeart rate variability
SDNNStandard deviation of RR intervals, cf. Equation (1)
RMSSDRoot mean square of the successive differences of RR intervals, cf. Equation (2)
MAEMean absolute error

References

  1. Londhe, A.; Atulkar, M. Heart Rate Variability: A Methodological Survey. In Proceedings of the 2019 International Conference on Intelligent Sustainable Systems (ICISS), Palladam, India, 21–22 February 2019; pp. 57–63. [Google Scholar] [CrossRef]
  2. Wasilewski, J.; Poloński, L. An Introduction to ECG Interpretation. In ECG Signal Processing, Classification and Interpretation; Gacek, A., Pedrycz, W., Eds.; Springer: London, UK, 2012; pp. 1–20. [Google Scholar] [CrossRef]
  3. Yadav, A.; Grover, N. A Review of R Peak Detection Techniques of Electrocardiogram (ECG). J. Eng. Technol. 2017, 8. Available online: https://journal.utem.edu.my/index.php/jet/article/view/1946 (accessed on 5 October 2021).
  4. Yan, L.; Liu, Y.; Liu, Y. Interval Feature Transformation for Time Series Classification Using Perceptually Important Points. Appl. Sci. 2020, 10, 5428. [Google Scholar] [CrossRef]
  5. Kamal, A.A.; Harness, J.B.; Irving, G.; Mearns, A.J. Skin photoplethysmography–A review. Comput. Methods Programs Biomed. 1989, 4, 257–269. [Google Scholar] [CrossRef]
  6. Allen, J. Photoplethysmography and its application in clinical physiological measurement. Physiol. Meas. 2007, 28, R1–R39. [Google Scholar] [CrossRef] [Green Version]
  7. Zhang, Z.; Pi, Z.; Liu, B. TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise. IEEE Trans. Biomed. Eng. 2015, 62, 522–531. [Google Scholar] [CrossRef] [Green Version]
  8. Reiss, A.; Indlekofer, I.; Schmidt, P.; Van Laerhoven, K. Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks. Sensors 2019, 19, 3079. [Google Scholar] [CrossRef] [Green Version]
  9. Tyapochkin, K.; Smorodnikova, E.; Pravdin, P. Smartphone PPG: Signal Processing, Quality Assessment, and Impact on HRV Parameters. In Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 23–27 July 2019; pp. 4237–4240. [Google Scholar] [CrossRef]
  10. Němcová, A.; Jordanova, I.; Varecka, M.; Smisek, R.; Maršánová, L.; Smital, L.; Vitek, M. Monitoring of heart rate, blood oxygen saturation, and blood pressure using a smartphone. Biomed. Signal Process. Control 2020, 59, 101928. [Google Scholar] [CrossRef]
  11. Koenig, N.; Seeck, A.; Eckstein, J.; Mainka, A.; Huebner, T.; Voss, A.; Weber, S. Validation of a New Heart Rate Measurement Algorithm for Fingertip Recording of Video Signals with Smartphones. Telemed. e-Health 2016, 22, 631–636. [Google Scholar] [CrossRef]
  12. Kageyama, T.; KABUTO, M.; Kaneko, T.; Nishikido, N. Accuracy of Pulse Rate Variability Parameters Obtained from Finger Plethysmogram: A Comparison with Heart Rate Variability Parameters Obtained from ECG. J. Occup. Health 1997, 39, 154–155. [Google Scholar] [CrossRef]
  13. Giardino, N.; Edelberg, R. Comparison of Finger Plethysmograph to ECG in the Measurement of Heart Rate Variability. Psychophysiology 2002, 39, 246–253. [Google Scholar] [CrossRef]
  14. Lin, W.H.; Wu, D.; Li, Y.; Zhang, H. Comparison of Heart Rate Variability from PPG with That from ECG. In The International Conference on Health Informatics. IFMBE Proceedings; Zhang, Y.T., Ed.; Springer: Cham, Switzerland, 2014; Volume 42. [Google Scholar] [CrossRef]
  15. Pinheiro, N.; Couceiro, R.; Henriques, J.; Muehlsteff, J.; Quintal, I.; Gonçalves, L.; de Carvalho, P. Can PPG Be Used for HRV Analysis? In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 2945–2949. [Google Scholar] [CrossRef]
  16. Altini, M.; Amft, O. HRV4Training: Large-scale longitudinal training load analysis in unconstrained free-living settings using a smartphone application. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 2610–2613. [Google Scholar] [CrossRef]
  17. Plews, D.; Scott, B.; Altini, M.; Wood, M.; Kilding, A.; Laursen, P. Comparison of Heart Rate Variability Recording With Smart Phone Photoplethysmographic, Polar H7 Chest Strap and Electrocardiogram Methods. Int. J. Sport. Physiol. Perform. 2017, 12, 1324–1328. [Google Scholar] [CrossRef]
  18. Scholkmann, F.; Boss, J.; Wolf, M. An Efficient Algorithm for Automatic Peak Detection in Noisy Periodic and Quasi-Periodic Signals. Algorithms 2012, 5, 588–603. [Google Scholar] [CrossRef] [Green Version]
  19. Alwosheel, A.; Alasaad, A.; Alqaraawi, A. Heart rate variability estimation in Photoplethysmography signals using Bayesian learning approach. Healthc. Technol. Lett. 2016, 3, 136–142. [Google Scholar] [CrossRef] [Green Version]
  20. Wittenberg, T.; Koch, R.; Pfeiffer, N.; Lang, N.; Struck, M.; Amft, O.; Eskofier, B. Evaluation of HRV estimation algorithms from PPG data using neural networks. Curr. Dir. Biomed. Eng. 2020, 6, 505–509. [Google Scholar] [CrossRef]
  21. Guede-Fernandez, F.; Ferrer-Mileo, V.; Ramos-Castro, J.; Fernández-Chimeno, M.; García-González, M. Real Time Heart Rate Variability Assessment from Android Smartphone Camera Photoplethysmography: Postural and Device Influences. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; Volume 2015, pp. 7332–7335. [Google Scholar] [CrossRef]
  22. Guede-Fernández, F.; Ferrer-Mileo, V.; Mateu-Mateus, M.; Ramos-Castro, J.; García-González, M.; Fernández-Chimeno, M. A photoplethysmography smartphone-based method for heart rate variability assessment: Device model and breathing influences. Biomed. Signal Process. Control 2020, 57, 101717. [Google Scholar] [CrossRef]
  23. Daubechies, I. Ten Lectures on Wavelets; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 1992. [Google Scholar]
  24. Du, P.; Kibbe, W.; Lin, S. Improved peak detection in mass spectrum by incorporating continuous wavelet transform-based pattern matching. Bioinformatics 2006, 22, 2059–2065. [Google Scholar] [CrossRef] [Green Version]
  25. Addison, P. Wavelet transforms and the ECG: A review. Physiol. Meas. 2005, 26, R155–R199. [Google Scholar] [CrossRef] [Green Version]
  26. Ghaderpour, E.; Pagiatakis, S.; Hassan, Q. A Survey on Change Detection and Time Series Analysis with Applications. Appl. Sci. 2021, 11, 6141. [Google Scholar] [CrossRef]
  27. Li, C.; Zheng, C.; Tai, C. Detection of ECG characteristic points using wavelet transform. IEEE Trans. Biomed. Eng. 1995, 42, 21–28. [Google Scholar] [CrossRef]
  28. Kadambe, S.; Murray, R.; Boudreaux-Bartels, G. Wavelet transform-based QRS complex detector. IEEE Trans. Biomed. Eng. 1999, 46, 838–848. [Google Scholar] [CrossRef]
  29. Coombes, K.; Tsavachidis, S.; Morris, J.; Baggerly, K.; Hung, M.C.; Kuerer, H. Data Acquired from Surface-Enhanced Laser Desorption and Ionization by Denoising Spectra with the Undecimated Discrete Wavelet Transform. Proteomics 2005, 5, 4107–4117. [Google Scholar] [CrossRef]
  30. Nenadic, Z.; Burdick, J. Spike Detection Using the Continuous Wavelet Transform. IEEE Trans. Biomed. Eng. 2005, 52, 74–87. [Google Scholar] [CrossRef] [Green Version]
  31. Wee, A.; Grayden, D.; Zhu, Y.; Petkovic, K.; Smith, D. A continuous wavelet transform algorithm for peak detection. Electrophoresis 2008, 29, 4215–4225. [Google Scholar] [CrossRef]
  32. Gregoire, J.; Dale, D.; van Dover, R. A wavelet transform algorithm for peak detection and application to powder X-ray diffraction data. Rev. Sci. Instrum. 2011, 82, 015105. [Google Scholar] [CrossRef] [Green Version]
  33. Nemcova, A.; Smisek, R.; Vargova, E.; Maršánová, L.; Vitek, M.; Smital, L. Brno University of Technology Smartphone PPG Database (BUT PPG) (version 1.0.0). PhysioNet 2021. [Google Scholar] [CrossRef]
  34. Zhang, Y.; Song, S.; Vullings, R.; Biswas, D.; Simoes-Capela, N.; Helleputte, N.; Van Hoof, C.; Groenendaal, W. Motion Artifact Reduction for Wrist-Worn Photoplethysmograph Sensors Based on Different Wavelengths. Sensors 2019, 19, 673. [Google Scholar] [CrossRef] [Green Version]
  35. Barbieri, R.; Matten, E.; Alabi, A.; Brown, E. A point-process model of human heartbeat intervals: New definitions of heart rate and heart rate variability. Am. J. Physiol. Heart Circ. Physiol. 2005, 288, H424–H435. [Google Scholar] [CrossRef] [Green Version]
  36. Takagi, K.; Kumagai, S.; Matsunaga, c.; Kusaka, Y. Application of inverse Gaussian distribution to occupational exposure data. Ann. Occup. Hyg. 1997, 41, 505–514. [Google Scholar] [CrossRef]
  37. Vila, X.; Palacios Ortega, F.; Presedo, J.; Fernandez-Delgado, M.; Félix, P.; Barro, S. Time-frequency analysis of heart-rate variability. IEEE Eng. Med. Biol. Mag. 1997, 16, 119–126. [Google Scholar] [CrossRef]
  38. Gilgen-Ammann, R.; Schweizer, T.; Wyss, T. RR interval signal quality of a heart rate monitor and an ECG Holter at rest and during exercise. Eur. J. Appl. Physiol. 2019, 119, 1525–1532. [Google Scholar] [CrossRef]
  39. Hinde, K.; White, G.; Armstrong, N. Wearable Devices Suitable for Monitoring Twenty Four Hour Heart Rate Variability in Military Populations. Sensors 2021, 21, 1061. [Google Scholar] [CrossRef]
  40. Pereira, R.D.A.; Alves, J.L.D.B.; Silva, J.H.D.C.; Costa, M.D.S.; Silva, A.S. Validity of a Smartphone Application and Chest Strap for Recording RR Intervals at Rest in Athletes. Int. J. Sports Physiol. Perform. 2020, 15, 896–899. [Google Scholar] [CrossRef]
  41. Speer, K.; Semple, S.; Naumovski, N.; McKune, A. Measuring Heart Rate Variability Using Commercially Available Devices in Healthy Children: A Validity and Reliability Study. Eur. J. Investig. Health Psychol. Educ. 2020, 10, 390–404. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Hernando, D.; Roca, S.; Sancho, J.; Alesanco, A.; Bailón, R. Validation of the Apple Watch for Heart Rate Variability Measurements during Relax and Mental Stress in Healthy Subjects. Sensors 2018, 18, 2619. [Google Scholar] [CrossRef] [Green Version]
  43. Greve, M.; Kviesis-Kipge, E.; Rubenis, O.; Rubins, U.; Mevcnika, V.; Grabovskis, A.; Marcinkevivcs, Z. Comparison of Pulse Rate Variability Derived from Digital Photoplethysmography over the Temporal Artery with the Heart Rate Variability Derived from a Polar Heart Rate Monitor. In Proceedings of the 7th conference of European Study Group on Cardiovascular Oscillations (2012), Kazimierz Dolny, Poland, 22–25 April 2012; pp. 1–3. [Google Scholar]
  44. Torrence, C.; Compo, G. A Practical Guide to Wavelet Analysis. Bull. Am. Meteorol. Soc. 1998, 79, 61–78. [Google Scholar] [CrossRef] [Green Version]
  45. Gilles, J. Empirical Wavelet Transform. IEEE Trans. Signal Process. 2013, 61, 3999–4010. [Google Scholar] [CrossRef]
  46. Bhattacharyya, A.; Sharma, M.; Pachori, R.; Sircar, P.; Acharya, U.R. A novel approach for automated detection of focal EEG signals using empirical wavelet transform. Neural Comput. Appl. 2018, 29, 47–57. [Google Scholar] [CrossRef]
Figure 1. Examples of PPG signals: (a) a clean signal with clearly visible peaks; (b) a noisy signal where peaks associated to cardiac cycles still can be recognized; (c) a corrupted signal where no accurate peak detection is possible.
Figure 1. Examples of PPG signals: (a) a clean signal with clearly visible peaks; (b) a noisy signal where peaks associated to cardiac cycles still can be recognized; (c) a corrupted signal where no accurate peak detection is possible.
Sensors 21 06798 g001
Figure 2. Mexican hat wavelet function y = ψ ( t ) .
Figure 2. Mexican hat wavelet function y = ψ ( t ) .
Sensors 21 06798 g002
Figure 3. Algorithm workflow.
Figure 3. Algorithm workflow.
Sensors 21 06798 g003
Figure 4. The PPG signal (top) and its corresponding STFT spectrogram (bottom), part of the PPG signal of subject 01 in the TROIKA dataset. Heart rate frequency is growing from 1.2 Hz to 1.9 Hz.
Figure 4. The PPG signal (top) and its corresponding STFT spectrogram (bottom), part of the PPG signal of subject 01 in the TROIKA dataset. Heart rate frequency is growing from 1.2 Hz to 1.9 Hz.
Sensors 21 06798 g004
Figure 5. Continuity filter highlighting curves with bounded rates of change; the horizontal length is adjusted to correspond to 10 s of time and the vertical length corresponds to a change in frequency of 0.3 Hz.
Figure 5. Continuity filter highlighting curves with bounded rates of change; the horizontal length is adjusted to correspond to 10 s of time and the vertical length corresponds to a change in frequency of 0.3 Hz.
Sensors 21 06798 g005
Figure 6. Filtered spectrogram. Black lines show the curves consisting of local maxima in the spectrogram columns.
Figure 6. Filtered spectrogram. Black lines show the curves consisting of local maxima in the spectrogram columns.
Sensors 21 06798 g006
Figure 7. Scaled Mexican hat wavelet and its frequency spectrum for the smallest scale a 1 and the largest scale a 50 in the chosen scale range.
Figure 7. Scaled Mexican hat wavelet and its frequency spectrum for the smallest scale a 1 and the largest scale a 50 in the chosen scale range.
Sensors 21 06798 g007
Figure 8. PPG signal, the corresponding scalogram computed with the Mexican hat wavelet for the scale range a 1 , a 50 , and the ridge lines in the scalogram. This signal is a part of the red channel PPG from subject 01 in the Welltory-PPG-dataset. The R peaks in the signal are detected as top points of the ridge lines chosen by the filtration Algorithm 3.
Figure 8. PPG signal, the corresponding scalogram computed with the Mexican hat wavelet for the scale range a 1 , a 50 , and the ridge lines in the scalogram. This signal is a part of the red channel PPG from subject 01 in the Welltory-PPG-dataset. The R peaks in the signal are detected as top points of the ridge lines chosen by the filtration Algorithm 3.
Sensors 21 06798 g008
Figure 9. Part of the S3 signal of the PPG-DaLiA dataset.
Figure 9. Part of the S3 signal of the PPG-DaLiA dataset.
Sensors 21 06798 g009
Figure 10. Filtration of the RR intervals of Figure 9. Green intervals are kept by the algorithm and red intervals are discarded.
Figure 10. Filtration of the RR intervals of Figure 9. Green intervals are kept by the algorithm and red intervals are discarded.
Sensors 21 06798 g010
Figure 11. PPG-DaLiA, Subject S3, interval 0 to 100 s.
Figure 11. PPG-DaLiA, Subject S3, interval 0 to 100 s.
Sensors 21 06798 g011
Table 1. Algorithm performance on the Welltory-PPG-dataset.
Table 1. Algorithm performance on the Welltory-PPG-dataset.
SubjectDiscarded RatioSDNN ae (ms)RMSSD ae (ms)RR mae (ms)
010.7623.6834.05824.667
020.1212.7846.97710.436
030.5404.6043.8027.043
040.0926.5275.2426.586
050.0502.5733.1614.509
060.0301.8314.9135.320
070.70011.07611.6589.733
080.1652.1164.70212.906
090.0891.4956.86313.255
100.4468.96510.7785.657
110.4009.28512.6198.095
120.4490.38911.73911.492
130.2654.25713.56311.773
140.2674.8946.7437.258
150.1271.3391.7957.053
160.0005.0404.9006.990
170.0511.5833.1456.477
180.0300.2621.8548.374
190.1866.48510.31110.649
200.0960.7173.7538.784
210.1115.5050.1924.379
mean0.2374.0676.3229.116
Table 2. Algorithm performance on the TROIKA dataset.
Table 2. Algorithm performance on the TROIKA dataset.
SubjectDiscarded RatioSDNN ae (ms)RMSSD ae (ms)RR mae (ms)
010.1670.4893.6927.667
020.80519.85123.39410.625
030.6884.25811.2246.267
040.6595.7210.4509.214
050.3962.7866.6255.250
060.3892.1990.42210.545
070.2342.1841.8109.611
080.28216.93821.81415.679
090.1000.63111.7689.694
100.54813.89632.18619.286
110.3646.5208.6928.857
120.3066.89725.57014.029
mean0.4116.86412.30410.560
Table 3. Algorithm performance on the PPG-DaLiA dataset.
Table 3. Algorithm performance on the PPG-DaLiA dataset.
SubjectDiscarded RatioSDNN ae (ms)RMSSD ae (ms)RR mae (ms)
010.1415.5087.8317.998
020.2297.5002.7916.902
030.24616.1394.5068.054
040.4399.1815.9108.245
050.2152.0720.5955.187
060.1472.2321.2175.313
070.0839.09211.2388.294
080.60119.15715.35315.151
090.3874.4808.26712.926
100.1503.8195.4069.754
110.2155.8784.8946.480
120.34818.95510.4837.594
130.0534.4123.1534.876
140.0883.6334.5146.883
150.1095.6885.1758.135
mean0.2307.8506.0898.120
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Neshitov, A.; Tyapochkin, K.; Smorodnikova, E.; Pravdin, P. Wavelet Analysis and Self-Similarity of Photoplethysmography Signals for HRV Estimation and Quality Assessment. Sensors 2021, 21, 6798. https://doi.org/10.3390/s21206798

AMA Style

Neshitov A, Tyapochkin K, Smorodnikova E, Pravdin P. Wavelet Analysis and Self-Similarity of Photoplethysmography Signals for HRV Estimation and Quality Assessment. Sensors. 2021; 21(20):6798. https://doi.org/10.3390/s21206798

Chicago/Turabian Style

Neshitov, Alexander, Konstantin Tyapochkin, Evgeniya Smorodnikova, and Pavel Pravdin. 2021. "Wavelet Analysis and Self-Similarity of Photoplethysmography Signals for HRV Estimation and Quality Assessment" Sensors 21, no. 20: 6798. https://doi.org/10.3390/s21206798

APA Style

Neshitov, A., Tyapochkin, K., Smorodnikova, E., & Pravdin, P. (2021). Wavelet Analysis and Self-Similarity of Photoplethysmography Signals for HRV Estimation and Quality Assessment. Sensors, 21(20), 6798. https://doi.org/10.3390/s21206798

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop