Open AccessArticle

Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs)

Daniel P. Howsmon

Faye Cameron

¹,

Nihat Baysal

¹,

Trang T. Ly

^2,†,

Gregory P. Forlenza

³,

David M. Maahs

^3,‡,

Bruce A. Buckingham

²,

Juergen Hahn

^1,4

and

B. Wayne Bequette

^1,*

Department of Chemical & Biological Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, USA

Stanford University School of Medicine, Stanford, CA 94305, USA

Barbara Davis Center for Childhood Diabetes, University of Colorado Denver, Aurora, CO 80045, USA

⁴

Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, USA

Author to whom correspondence should be addressed.

^†

Current address: Insulet Corporation, Billerica, MA 01821, USA

^‡

Current address: Stanford University School of Medicine, Stanford, CA 94305, USA

Sensors 2017, 17(1), 161; https://doi.org/10.3390/s17010161

Submission received: 3 November 2016 / Revised: 5 January 2017 / Accepted: 8 January 2017 / Published: 15 January 2017

(This article belongs to the Special Issue Glucose Sensors: Revolution in Diabetes Management 2016)

Download

Browse Figures

Versions Notes

Abstract

Reliable continuous glucose monitoring (CGM) enables a variety of advanced technology for the treatment of type 1 diabetes. In addition to artificial pancreas algorithms that use CGM to automate continuous subcutaneous insulin infusion (CSII), CGM can also inform fault detection algorithms that alert patients to problems in CGM or CSII. Losses in infusion set actuation (LISAs) can adversely affect clinical outcomes, resulting in hyperglycemia due to impaired insulin delivery. Prolonged hyperglycemia may lead to diabetic ketoacidosis—a serious metabolic complication in type 1 diabetes. Therefore, an algorithm for the detection of LISAs based on CGM and CSII signals was developed to improve patient safety. The LISA detection algorithm is trained retrospectively on data from 62 infusion set insertions from 20 patients. The algorithm collects glucose and insulin data, and computes relevant fault metrics over two different sliding windows; an alarm sounds when these fault metrics are exceeded. With the chosen algorithm parameters, the LISA detection strategy achieved a sensitivity of 71.8% and issued 0.28 false positives per day on the training data. Validation on two independent data sets confirmed that similar performance is seen on data that was not used for training. The developed algorithm is able to effectively alert patients to possible infusion set failures in open-loop scenarios, with limited evidence of its extension to closed-loop scenarios.

Keywords:

type 1 diabetes; fault detection; continuous subcutaneous insulin infusion; sensor-augmented pump

1. Introduction

Improvement in care for patients living with type 1 diabetes is currently tied to emerging external medical device technology, including continuous glucose monitors and insulin infusion pumps, seeking movement towards closed-loop artificial pancreas systems [1,2]. Since a goal of these devices is to reduce adverse events due to glucose excursions, artificial pancreas systems are often designed with patient safety rather than tight control as the highest priority. However, artificial pancreas systems still require patient involvement when changing sensors, choosing infusion set sites, and diagnosing potential problems. One major potential problem with any artificial pancreas system is the loss of the infusion set’s ability to actuate the system. Faulty actuation occurs for a number of reasons, including dislodged catheters, insulin leakage or lipohypertrophy at the infusion set site, and mechanical failure of the infusion set. Additional hazards associated with continuous subcutaneous insulin infusion are presented in [3,4]. Alarming a patient when a faulty infusion set is detected has the potential to mitigate or prevent the resulting hyperglycemic glucose excursions.

Fault detection strategies can be first classified into hardware- or analytically-redundant approaches. Hardware redundancy involves incorporating extra hardware for the sole purpose of detecting a particular fault. In the case of pressure-induced sensor attenuations (PISAs) [5], two continuous glucose monitors (CGMs) can be worn, and PISAs can be detected by directly comparing the outputs of these two sensors. Figure 1 illustrates how such an approach can be developed. Analytically-redundant approaches instead compare the data with a human’s understanding of that data. The interested reader is referred to [6] for an overview of fault detection systems based on analytical redundancy. In the context of infusion set faults, analytical redundancy is usually incorporated by either comparing the CGM signal with a model-derived glucose signal or analyzing characteristics of input (administered insulin) and output (glucose) signals.

Despite their promise to improve the safety of both open-loop and closed-loop insulin infusion strategies, there have only been a few strategies to detect losses in infusion set actuation (LISAs) proposed in the scientific literature, and even fewer evaluated on patient data. Kovács et al. transformed the Bergman Minimal Model (BMM) into an input-affine, linear parameter-varying space, and infusion set faults were detected via an unknown input filter [7]; however, the methodology was not evaluated on real patient data. A robust control strategy based on the Hovorka Model was formulated by Vega-Hernandez et al. [8,9], but again, the strategy was not evaluated on real patient data. The BMM was also used in an Unscented Kalman Filter framework and applied retrospectively to data from an intravenous glucose tolerance test [10]. A classifier based on multivariate statistical analysis was trained on simulated data from the UVa/Padova simulator [11,12]. A fault detection scheme requiring CGM and carbohydrate intake data based on modal interval analysis was applied to a modified BMM [13], and the fault detection algorithm was tested against the UVa/Padova simulator. Another approach [14,15] identified black-box state-space models, and these models were again evaluated on in silico data from the UVa/Padova simulator. A comparison of three different strategies was given by Baysal et al. [16], and the algorithms were finally evaluated on patient data. Cescon et al. [17] also evaluated infusion set failure algorithms on clinical data as opposed to simulated faults, but tried to anticipate—as opposed to detect—failures. Furthermore, these authors assumed that the patient will respond to every alarm by changing the infusion set, and they report a sensitivity and specificity of 55% and 66%, respectively.

Incomplete knowledge about the various causes of LISAs and their probabilities of occurrence creates much uncertainty around modeling sources of LISAs necessary in simulation studies. One of the main advantages of this work is the evaluation of the proposed LISA detection algorithm on substantial amounts of clinical data rather than simulated scenarios. Furthermore, the simplicity of the algorithm eases integration with artificial pancreas systems, requiring negligible computational resources.

2. Materials and Methods

This section defines the criteria for determining an infusion set failure, and follows with a discussion of the data and training procedure used in algorithm development. Illustrations are provided to demonstrate the core concepts of the proposed approach.

2.1. Notation

In the derivations that follow, k represents time in minutes,

L W

represents the length of the long window,

S W

represents the length of the short window,

{\bar{x}}_{i | j}

represents the average of quantity x in a window from time j to time i, and

Δ x_{k}

represents the quantity

x_{k} - x_{k - 1}

2.2. Algorithm Development

Insufficient insulin administration leads to elevated glucose levels. However, patients differ in their level of control, and fault detection algorithms should be robust to this inter-patient variability. Furthermore, patients may improve or degrade their level of control over time, leading to intra-patient variability. To account for the different levels of control and the possibility that an individual’s control may change over time, the fault detection algorithm makes use of the average glucose reading over a long time horizon,

{\bar{CGM}}_{k | k - L W}

. This long-term CGM average provides a patient-specific baseline level of control. The average glucose in a shorter time horizon,

{\bar{CGM}}_{k | k - S W}

, is used to capture only the most recent history of a patient’s glucose levels, and describes his/her current level of control. If

{\bar{CGM}}_{k | k - S W}

is greater than

{\bar{CGM}}_{k | k - L W}

, the area between these two curves

{AUC}_{k}

is accumulated in the glucose fault metric (GFM). However, if

{\bar{CGM}}_{k | k - S W}

falls below

{\bar{CGM}}_{k | k - L W}

, the GFM resets to a value of 0. Formally, the glucose metric can be described by:

\begin{matrix} {AUC}_{k} & = ({\bar{CGM}}_{k | k - S W} - {\bar{CGM}}_{k | k - L W}) \cdot Δ t_{k} \\ {GFM}_{k} & = \{\begin{matrix} {GFM}_{k - 1} + {AUC}_{k} & if \frac{{\bar{CGM}}_{k | k - S W}}{{\bar{CGM}}_{k | k - L W}} > 1 \\ 0 & otherwise \end{matrix} \end{matrix}

(1)

To eliminate false positives, an alarm is only issued if the number and slope of glucose readings in the short time window are above certain thresholds. An illustration of the calculation of the GFM is presented in Figure 2.

Elevated glucose levels alone are not indicative of an infusion set failure. Indeed, some glucose excursions are definitely caused by meals. However, many patients do not choose to use the meal bolus calculators provided on their insulin infusion pumps, and some artificial pancreas algorithms do not require meal information for successful operation [18,19]. In an effort to make this algorithm as widely applicable as possible, meal information is not incorporated, but an additional insulin fault metric (IFM) is proposed. Insulin-on-board is a well-established metric in the diabetes community that describes a pharmacodynamic bound on the current plasma insulin levels [20]. Insulin-on-board can be described by passing the administered insulin through a first-order filter. However, since insulin must first travel through the subcutaneous compartment before it can affect a patient’s blood glucose levels, the administered insulin is passed through a second-order filter to obtain the plasma insulin estimate (PIE). The PIE then estimates the amount of active insulin in the blood, rather than the total amount of insulin injected in the body. PIE at time k is obtained from the linear system.

\begin{matrix} [\begin{matrix} x_{k + 1}^{1} \\ x_{k + 1}^{2} \end{matrix}] & = [\begin{matrix} 0.98 & 0.02 \\ 0 & 0.98 \end{matrix}] [\begin{matrix} x_{k}^{1} \\ x_{k}^{2} \end{matrix}] + [\begin{matrix} 0 \\ 1 \end{matrix}] {Insulin}_{k} \\ {PIE}_{k} & = [\begin{matrix} 1 & 0 \end{matrix}] [\begin{matrix} x_{k}^{1} \\ x_{k}^{2} \end{matrix}] \end{matrix}

(2)

A one-minute sample time is used here, since insulin boluses and basal changes can occur at shorter time scales than the five minutes between most commercial CGM measurements. The variable

{Insulin}_{k}

is calculated by summing the total bolus insulin and the current basal rate in units per minute. This approach [21] and similar approaches [22] have been used in artificial pancreas systems. The average PIE in the short window

{\bar{PIE}}_{k | k - S W}

is compared to that in the long window

{\bar{PIE}}_{k | k - L W}

. Since individual insulin requirements vary, this comparison is normalized by

{\bar{PIE}}_{k | k - L W}

. Then, IFM is given by:

{IFM}_{k} = \frac{{\bar{PIE}}_{k | k - S W} - {\bar{PIE}}_{k | k - L W}}{{\bar{PIE}}_{k | k - L W}} = \frac{{\bar{PIE}}_{k | k - S W}}{{\bar{PIE}}_{k | k - L W}} - 1

(3)

An example illustrating the function of the IFM is presented in Figure 3.

With the GFM and IFM defined, it is now possible to derive criteria for issuing an infusion set failure alarm that is independent of a patient’s specific level of control and insulin requirements. Thresholds are placed on the allowable GFM, IFM, and CGM slope in the short window. Exceeding all three of these thresholds simultaneously signals an alarm.

2.3. Training and Validation Data

Three different data sets were used to evaluate the performance of the LISA detection algorithm. The data set T1 used to train the system was taken from a study investigating the effect of infusing insulin in lipohypertrophic sites [23]. Failure dynamics were independent of the lipohypertrophy status of the infusion site [23]; therefore, all data were combined for training. Once the parameter set was determined from the training set, this algorithm was tested on completely independent data sets from one study V1 investigating Teflon versus steel infusion sets [24] and a different study V2 investigating the use of hyaluronidase for influencing the subcutaneous insulin pharmacokinetics [25]. Since hyaluronidase alters insulin pharmacokinetics, only the control group in V2 (no hyaluronidase administered) was used for validation. Testing on data independent from the training set ensures that the developed algorithm generalizes well to new patient data, and is not simply fit to the specific data used in algorithm generation. Additional details of the different data sets are described in Table 1.

2.4. Performance Evaluation

All data sets were obtained from studies that clinically detected infusion set failures; however, the exact time of these infusion set failures is not known, since these failures were not induced. Therefore, the start of the failure was selected retrospectively by a team of engineers and clinicians, and was generally determined to coincide with the most previous trough in the CGM data, as done previously [16]. Although this uncertainty in the true start time of a fault is a limitation of this approach, this drawback was deemed favorable to creating faults in a simulation environment that makes considerable assumptions as to glucose–insulin dynamics and the dynamics of LISAs. The uncertainty in the true start of an infusion set fault coupled with the more realistic scenario of a patient responding to an alarm event rather than each serial data point prompted the evaluation of the algorithm based on alarm events rather than individual data points. Sensitivity was calculated based on whether or not an alarm sounded between the estimated start time and the clinically detected fault, and false positives were also evaluated on an event basis. Since true negatives and therefore specificity cannot be determined in this framework, parameters in the LISA algorithm were chosen to maximize sensitivity and minimize the number of false positives per day in a pseudo-receiver operating characteristic curve (pROC) curve. This analysis based on alarm events follows previous performance evaluation procedures used for the detection of infusion set failures [16].

3. Results and Discussion

A parameter set consisting of the (1) long time window length; (2) short time window length; (3) GFM threshold; (4) IFM threshold; and (5) glucose slope threshold was determined via the pROC curve. The parameter set with metrics closest to the upper left corner was chosen for future analysis. Figure 4 displays the pROC curve, and Table 2 lists the parameter ranges investigated and the chosen parameter values. The “⋯” in Table 2 indicate a continuation of the previous step size until the end value is reached. All combinations of the parameters listed in Table 2 were investigated and plotted in Figure 4. With the chosen values, the algorithm was able to achieve a 71.8% sensitivity with 0.28 false positives per day. It is important to note that the LISA detection algorithm sent alerts at fairly high glucose levels (Table 1), indicating that the LISA detection algorithm will not completely prevent hyperglycemia following an infusion set failure. However, since these failures were detected earlier by the algorithm than by the patients, LISA-induced hyperglycemia will likely be mitigated if the LISA detection algorithm were implemented in real-time.

Once suitable parameters were obtained from analysis of the training set, the LISA detection algorithm was validated against V1 and V2. Failure characteristics were independent of the infusion set material; therefore, all infusion sets in V1 were evaluated as a single group. Table 1 summarizes the performance of the algorithm in these validation studies. Since the validation results closely resembled the training results, the algorithm generalizes to new data sets well.

Additionally, the validation results of V1 obtained the same sensitivity with fewer false positives per day than the algorithms tested by Baysal et al. [16] that were trained on this data. These previous algorithms are described briefly as: (1) the multivariate statistical analysis (MSA) decomposes fault metrics via principal components and compares the magnitude of the first principal component and the glucose slope in a two hour window to determine a fault; (2) the model-based analysis (MBA) uses an interactive multiple model approach to simulate one case when insulin is fully ineffective and one case where insulin is fully effective, and these predictions are combined in a Bayesian probabilistic environment; and (3) the Threshold approach simply alarms only when the glucose level reaches 305 mg/dL, and will not issue a subsequent alarm for at least six hours to reduce false positives. The comparison results are highlighted in Table 3. One important observation in any of the algorithms tested on data set V1 is that the sensitivity is 73%. One explanation for this result is the fact that faults are quickly addressed by the clinical staff in these studies rather than allowing the possibly faulty conditions to continue for a longer portion of time. Indeed, the missed faults had an average duration or 4.9 h, whereas the detected faults had an average duration of 10.6 h. Presumably, these missed detections would be eventually detected, but patients cannot be subjected to these clinically unsafe conditions for ethical reasons.

One inherent assumption of the LISA detection algorithm is the pharmacokinetic profile of insulin. When hyaluronidase was administered to decrease the time to peak insulin effect, the LISA detection algorithm only achieved a sensitivity of 44.4% and issued 0.33 FP/day, differing markedly from the performance when hyaluronidase was not administered. Therefore, this algorithm should be retrained with a new insulin pharmacokinetic profile if the injected insulin differs significantly from the assumed profile.

Although the algorithm issued fewer false positives than previous approaches, patients may experience alarm fatigue with the current system. However, the largest source of false positives was attributed to under-bolused meals, since—for all patients that provided meal information—80.2% of false positives occurred within two hours of a meal (the median time since the previous meal was 63 min). Furthermore, the median glucose reading when a false alarm occurred was 292 mg/dL across all data sets. Thus, the false positives may improve clinical outcomes by alerting patients to scenarios of hyperglycemia requiring more insulin delivery. Furthermore, incorporating meal information is an important future direction to reduce false positives for patients who wish to provide this information to a fault detection algorithm.

Although this algorithm was developed for use in the presence of meals, the algorithm performs similarly when the fault occurs during the night time where only basal insulin is administered. Across all data sets, there were three cases of infusion set failure at night, and all three of these cases were correctly detected by the algorithm with similar mean glucose and time to detection as reported in Table 1. These results are a promising indication that the LISA detection algorithm can correctly identify faults overnight; however, algorithms specific to detecting faults in the absence of meals may perform better in this scenario [14].

The algorithm was developed on open-loop data to improve the current level of care; however, future commercial artificial pancreas devices will need to focus on fault detection and intra-patient variability more than in current clinical trials. Therefore, the algorithm was then evaluated on ten infusion sets from a closed-loop study at a diabetes camp [26]. The algorithm successfully detected the two infusion sets in the study and issued 0.32 false positives per day. These results suggest that the algorithm may extend into closed-loop scenarios with similar performance. Since this closed-loop data set is rather limited, ongoing studies are under investigation as to the performance of this LISA detection algorithm in online, closed-loop scenarios.

4. Conclusions

Diabetes technology seeks to improve clinical outcomes and reduce patient burden. Although this increase in a patient’s quality of life is advantageous under everyday scenarios, it can also lead to a decreased awareness toward adverse events as systems become more automated. Therefore, future devices will need to incorporate fault detection strategies to a greater degree than the current state-of-the-art. The algorithm developed herein was able to detect infusion set failures in open-loop scenarios, and may extend to closed-loop scenarios with similar performance. Detecting adverse actuator faults will improve the safety and performance of artificial pancreas devices by alerting patients to check—and possibly replace—their infusion sets.

Acknowledgments

This work was supported by the Juvenile Diabetes Research Foundation (JDRF 17-2013-471) and the National Institutes of Health (1RO1DK102188-01). The authors would like to thank Eyal Dassau from Harvard University; Lauren Huyett from the University of California, Santa Barbara; Eric Mauritzen and Arnold Mandell from the University of California, San Diego; and Steve Patek from the University of Virginia for many fruitful discussions on algorithm development and extensions to online and closed-loop scenarios.

Author Contributions

B.A.B., D.M.M., G.P.F., T.T.L. collected patient data at their respective institutions. D.P.H., F.C., N.B., J.H. and B.W.B. conceived and designed the algorithm; D.P.H. implemented and refined the algorithm; All authors analyzed the data; D.P.H. wrote the paper.

Conflicts of Interest

T.T.L. has since become the Vice President and Medical Director of Insulet Corporation. G.P.F. is a consultant for Abbott Diabetes Care and receives research support from Medtronic, Dexcom, Animas, Tandem, Bigfoot and Insulet. D.M.M. is on the advisory board for Insulet, is a consultant for Abbott Diabetes Care and receives research support from Medtronic, Roche and Dexcom. B.A.B. is a consultant for Dexcom and has received research support from Dexcom and Roche. B.W.B has served as a consultant for BD. All other authors declare no conflict of interest as it pertains to this work.

Abbreviations

The following abbreviations are used in this manuscript:

CGM	continuous glucose monitoring
CSII	continuous subcutaneous insulin infusion
LISA	loss in infusion set actuation
PISA	pressure-induced sensor attenuation
BMM	Bergman minimal model
GFM	glucose fault metric
PIE	plasma insulin estimate
IFM	insulin fault metric
FP	false positive
pROC	pseudo-receiver operating characteristic curve
MSA	multivariate statistical analysis
MBA	model-based analysis

References

Bequette, B.W. Challenges and recent progress in the development of a closed-loop artificial pancreas. Annu. Rev. Control 2012, 36, 255–266. [Google Scholar] [CrossRef] [PubMed]
Peyser, T.; Dassau, E.; Breton, M.; Skyler, J.S. The artificial pancreas: Current status and future prospects in the management of diabetes. Ann. N. Y. Acad. Sci. 2014, 1311, 102–123. [Google Scholar] [CrossRef] [PubMed]
Guilhem, I.; Leguerrier, A.; Lecordier, F.; Poirier, J.; Maugendre, D. Technical risks with subcutaneous insulin infusion. Diabetes Metab. 2006, 32, 279–284. [Google Scholar] [CrossRef]
Zhang, Y.; Jones, P.L.; Jetley, R. A hazard analysis for a generic insulin infusion pump. J. Diabetes Sci. Technol. 2010, 4, 263–283. [Google Scholar] [CrossRef] [PubMed]
Baysal, N.; Cameron, F.; Buckingham, B.A.; Wilson, D.M.; Chase, H.P.; Maahs, D.M.; Bequette, B.W. A Novel Method to Detect Pressure-Induced Sensor Attenuations (PISA) in an Artificial Pancreas. J. Diabetes Sci. Technol. 2014, 8, 1091–1096. [Google Scholar] [CrossRef] [PubMed]
Dai, X.; Gao, Z. From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis. IEEE Trans. Ind. Inform. 2013, 9, 2226–2238. [Google Scholar] [CrossRef]
Kovács, L.; Kulcsár, B.; Bokor, J.; Benyó, Z. LPV fault detection of glucose-insulin system. In Proceedings of the 14th Mediterranean Conference on Control and Automation, Ancona, Italy, 28–30 June 2006.
Vega-Hernandez, O.; Campos-Cornejo, F.; Campos-Delgado, D.U.; Espinoza-Trejo, D. Increasing security in an artificial pancreas: Diagnosis of actuator faults. In Proceedings of the 2009 Pan American Health Care Exchanges, Mexico City, Mexico, 16–20 March 2009; pp. 137–142.
Vega-Hernandez, O.; Campos-Delgado, D.; Espinoza-Trejo, D. Actuator fault tolerant control for an artificial pancreas. In Proceedings of the 6th International Conference on Electrical Engineering, Computing Science and Automatic Control, Toluca, Mexico, 10–13 November 2009.
Eberle, C.; Ament, C. The Unscented Kalman Filter estimates the plasma insulin from glucose measurement. Biosystems 2011, 103, 67–72. [Google Scholar] [CrossRef] [PubMed]
Rojas, R.; Garcia-Gabin, W.; Bequette, B.W. Mean glucose slope—Principal component analysis classification to detect insulin infusion set failure. In Proceedings of the 18th IFAC World Congress, Milan, Italy, 29 August–3 September 2011.
Rojas, R.; Garcia-Gabin, W.; Bequette, B. Multivariate statistical analysis to detect insulin infusion set failure. In Proceedings of the American Control Conference (ACC), San Francisco, CA, USA, 29 June–1 July 2011.
Herrero, P.; Calm, R.; Vehi, J.; Armengol, J.; Georgiou, P.; Oliver, N.; Tomazou, C. Robust Fault Detection System for Insulin Pump Therapy Using Continuous Glucose Monitoring. J. Diabetes Sci. Technol. 2012, 6, 1131–1141. [Google Scholar] [CrossRef] [PubMed]
Facchinetti, A.; Favero, S.; Sparacino, G.; Cobelli, C. An Online Failure Detection Method of the Glucose Sensor-Insulin Pump System: Improved Overnight Safety of Type-1 Diabetic Subjects. IEEE Trans. Biomed. Eng. 2013, 60, 406–416. [Google Scholar] [CrossRef] [PubMed]
Del Favero, S.; Monaro, M.; Facchinetti, A.; Tagliavini, A.; Sparacino, G.; Cobelli, C. Real-time detection of glucose sensor and insulin pump faults in an artificial pancreas. In Proceedings of the International Federation of Automatic Control World Congress, Cape Town, South Africa, 24–29 August 2014.
Baysal, N.; Cameron, F.; Buckingham, B.A.; Wilson, D.M.; Bequette, B.W. Detecting sensor and insulin infusion set anomalies in an artificial pancreas. In Proceedings of the American Control Conference (ACC), Washington, DC, USA, 17–19 June 2013.
Cescon, M.; DeSalvo, D.J.; Ly, T.T.; Maahs, D.M.; Messer, L.H.; Buckingham, B.A.; Doyle, F.J., III; Dassau, E. Early Detection of Infusion Set Failure During Insulin Pump Therapy in Type 1 Diabetes. J. Diabetes Sci. Technol. 2016, 10, 1268–1276. [Google Scholar] [CrossRef] [PubMed]
Cameron, F.; Bequette, B.W.; Wilson, D.M.; Buckingham, B.A.; Lee, H.; Niemeyer, G. A closed-loop artificial pancreas based on risk management. J. Diabetes Sci. Technol. 2011, 5, 368–379. [Google Scholar] [CrossRef] [PubMed]
Cameron, F.; Niemeyer, G.; Wilson, D.M.; Bequette, B.W.; Benassi, K.S.; Clinton, P.; Buckingham, B.A. Inpatient Trial of an Artificial Pancreas Based on Multiple Model Probabilistic Predictive Control with Repeated Large Unannounced Meals. Diabetes Technol. Ther. 2014, 16, 728–734. [Google Scholar] [CrossRef] [PubMed]
Bequette, B.W. Glucose Clamp Algorithms and Insulin Time-Action Profiles. J. Diabetes Sci. Technol. 2009, 3, 1005–1013. [Google Scholar] [CrossRef] [PubMed]
Cameron, F.; Niemeyer, G.; Bequette, B.W. Extended multiple model prediction with application to blood glucose regulation. J. Process Control 2012, 22, 1422–1432. [Google Scholar] [CrossRef]
Steil, G.M.; Palerm, C.C.; Kurtz, N.; Voskanyan, G.; Roy, A.; Paz, S.; Kandeel, F.R. The Effect of Insulin Feedback on Closed Loop Glucose Control. J. Clin. Endocrinol. Metab. 2011, 96, 1402–1408. [Google Scholar] [CrossRef] [PubMed]
Ly, T.T.; Maahs, D.M.; Messer, L.; DeSalvo, D.; Payne, S.; Clinton, P.; Block, J.; Buckingham, B.A. Duration of Infusion Set Survival in Lipohypertrophy versus Nonlipohypertrophied Tissue in Patients with Type 1 Diabetes; Diabetes Technology and Therapeutics: Paris, France, 2015. [Google Scholar]
Patel, P.J.; Benasi, K.; Ferrari, G.; Evans, M.G.; Shanmugham, S.; Wilson, D.M.; Buckingham, B.A. Randomized Trial of Infusion Set Function: Steel Versus Teflon. Diabetes Technol. Ther. 2013, 16, 15–19. [Google Scholar] [CrossRef] [PubMed]
DeSalvo, D.J.; Ly, T.T.; Maahs, D.M.; Messer, L.H.; Pyle, L.; Wadwa, P.; Westfall, E.; Hanes, S.; Buckingham, B.A. Duration of Infusion Set Survival with Hyaluronidase Injected at Insulin Pump Infusion Site; Diabetes: Boston, MA, USA, 2015. [Google Scholar]
Ly, T.T.; Chernavvsky, D.; Satin-Smith, M.; Desalvo, D.J.; Shanmugham, S.; Keith-Hynes, P.; Breton, M.D.; Buckingham, B.A. Closed-Loop Control with DIAS vs. Sensor-Augmented Pump Therapy in Adolescents and Young Adults with Type 1 Diabetes at Camp (99-L). Ned. Tijdschr. Natuurkd. 2013, 13, 55–56. [Google Scholar] [CrossRef]

Figure 1. Illustration of continuous glucose monitor (CGM) sensor fault detection based on hardware redundancy. In this example, (A) a patient wears two CGM sensors at different locations, and (B) these signals are compared to generate a residual. A potential fault detection scheme based on hardware redundancy would analyze the residual for fault signatures; in this case, a simple threshold at ±20 mg/dL was used.

Figure 2. Illustration of the glucose fault metric (

GFM

) calculation for

L W = 24

h and

S W = 1

h. (A) The length of the horizontal lines corresponding to

{\bar{CGM}}_{k | k - L W}

and

{\bar{CGM}}_{k | k - S W}

indicate the length of time of long window (

L W

) and short window (

S W

), respectively; (B) averages are computed for each new data point. The marked points correspond to the horizontal bars in the top figure; (C) when

{\bar{CGM}}_{k | k - S W} < {\bar{CGM}}_{k | k - L W}

GFM = 0

. However, when

{\bar{CGM}}_{k | k - S W} > {\bar{CGM}}_{k | k - L W}

, the area between these two curves accumulates in

GFM

Figure 2. Illustration of the glucose fault metric (

GFM

) calculation for

L W = 24

h and

S W = 1

h. (A) The length of the horizontal lines corresponding to

{\bar{CGM}}_{k | k - L W}

and

{\bar{CGM}}_{k | k - S W}

indicate the length of time of long window (

L W

) and short window (

S W

), respectively; (B) averages are computed for each new data point. The marked points correspond to the horizontal bars in the top figure; (C) when

{\bar{CGM}}_{k | k - S W} < {\bar{CGM}}_{k | k - L W}

GFM = 0

. However, when

{\bar{CGM}}_{k | k - S W} > {\bar{CGM}}_{k | k - L W}

, the area between these two curves accumulates in

GFM

Figure 3. Illustration of the insulin fault metric (

IFM

) calculation for

L W = 24

h and

S W = 1

h. (A) The patient’s glucose level is given over time. Time points with retrospective alarms are shaded in red; (B) the basal and bolus insulin administration is passed to a second-order filter to determine the plasma insulin estimate (

PIE

); (C) the

IFM

calculated from the given insulin profile.

Figure 3. Illustration of the insulin fault metric (

IFM

) calculation for

L W = 24

h and

S W = 1

PIE

); (C) the

IFM

calculated from the given insulin profile.

Figure 4. The pROC generated from the performance of different algorithm parameter sets on T1. The marker for the chosen parameter set is enlarged and highlighted in red.

Table 1. Data set characteristics and algorithm performance. FP: false positive.

**Table 1.** Data set characteristics and algorithm performance. FP: false positive.
	T1	V1	V2
Reference	[23]	[24]	[25]
Number of patients	20	18	13
Number of infusion sets	62	49	22
Total patient days	352.7	275.7	106.9
Number of infusion set failures	23	15	10
Algorithm Sensitivity	71.8%	73.3%	71.4%
Algorithm FP/day	0.28	0.27	0.28
Algorithm Median Minutes to Detect	262	210	280
Algorithm Glucose at Detection (mg/dL)	289	300	264

Table 2. Parameter ranges tested in algorithm development and the selected values from the pseudo-receiver-operating characteristic (pROC) analysis.

**Table 2.** Parameter ranges tested in algorithm development and the selected values from the pseudo-receiver-operating characteristic (pROC) analysis.
Parameter Name	Units	Parameter Range	Selection
$L W$	h	${6, 12, \dots, 36}$	24
$S W$	h	${5 / 60, 0.5, 1, \dots, 6}$	1
$GFM$ threshold	(mg/dL)·min	${50, 75, \dots, 400}$	100
$IFM$ threshold	unitless	${0, 0.05, \dots, 1}$	0.4
Glucose Slope threshold	(mg/dL)·min	${0, 0.05, \dots, 2}$	0.3

Table 3. Data set characteristics and algorithm performance. MBA: model-based analysis; MSA: multivariate statistical analysis.

**Table 3.** Data set characteristics and algorithm performance. MBA: model-based analysis; MSA: multivariate statistical analysis.
Algorithm Name	LISA	MBA	MSA	Threshold
Reference	—	[16]	[16]	[16]
Sensitivity	73%	73%	73%	73%
FP/day	0.27	0.43	0.36	0.33
Median Minutes to Detect	210	181	240	225
Detection Glucose (mg/dL)	300	277	315	313
Validation Results?	✓	✗	✗	✗

© 2017 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/).

Share and Cite

MDPI and ACS Style

Howsmon, D.P.; Cameron, F.; Baysal, N.; Ly, T.T.; Forlenza, G.P.; Maahs, D.M.; Buckingham, B.A.; Hahn, J.; Bequette, B.W. Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs). Sensors 2017, 17, 161. https://doi.org/10.3390/s17010161

AMA Style

Howsmon DP, Cameron F, Baysal N, Ly TT, Forlenza GP, Maahs DM, Buckingham BA, Hahn J, Bequette BW. Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs). Sensors. 2017; 17(1):161. https://doi.org/10.3390/s17010161

Chicago/Turabian Style

Howsmon, Daniel P., Faye Cameron, Nihat Baysal, Trang T. Ly, Gregory P. Forlenza, David M. Maahs, Bruce A. Buckingham, Juergen Hahn, and B. Wayne Bequette. 2017. "Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs)" Sensors 17, no. 1: 161. https://doi.org/10.3390/s17010161

APA Style

Howsmon, D. P., Cameron, F., Baysal, N., Ly, T. T., Forlenza, G. P., Maahs, D. M., Buckingham, B. A., Hahn, J., & Bequette, B. W. (2017). Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs). Sensors, 17(1), 161. https://doi.org/10.3390/s17010161

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

Continuous Glucose Monitoring Enables the Detection of Losses in Infusion Set Actuation (LISAs)

Abstract

1. Introduction

2. Materials and Methods

2.1. Notation

2.2. Algorithm Development

2.3. Training and Validation Data

2.4. Performance Evaluation

3. Results and Discussion

4. Conclusions

Acknowledgments

Author Contributions

Conflicts of Interest

Abbreviations

References

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI