Abstract
Background
Referral of patients with heart failure (HF) who are at high mortality risk for specialist evaluation is recommended. Yet, most tools for identifying such patients are difficult to implement in electronic health record (EHR) systems.Objective
To assess the performance and ease of implementation of Machine learning Assessment of RisK and EaRly mortality in Heart Failure (MARKER-HF), a machine-learning model that uses structured data that is readily available in the EHR, and compare it with two commonly used risk scores: the Seattle Heart Failure Model (SHFM) and Meta-Analysis Global Group in Chronic (MAGGIC) Heart Failure Risk Score.Design
Retrospective, cohort study.Participants
Data from 6764 adults with HF were abstracted from EHRs at a large integrated health system from 1/1/10 to 12/31/19.Main measures
One-year survival from time of first cardiology or primary care visit was estimated using MARKER-HF, SHFM, and MAGGIC. Discrimination was measured by the area under the receiver operating curve (AUC). Calibration was assessed graphically.Key results
Compared to MARKER-HF, both SHFM and MAGGIC required a considerably larger amount of data engineering and imputation to generate risk score estimates. MARKER-HF, SHFM, and MAGGIC exhibited similar discriminations with AUCs of 0.70 (0.69-0.73), 0.71 (0.69-0.72), and 0.71 (95% CI 0.70-0.73), respectively. All three scores showed good calibration across the full risk spectrum.Conclusions
These findings suggest that MARKER-HF, which uses readily available clinical and lab measurements in the EHR and required less imputation and data engineering than SHFM and MAGGIC, is an easier tool to identify high-risk patients in ambulatory clinics who could benefit from referral to a HF specialist.References
Articles referenced by this article (42)
A machine-learning based bio-psycho-social model for the prediction of non-obstructive and obstructive coronary artery disease.
Clin Res Cardiol, (9):1263-1277 2023
MED: 37004526
Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies.
Eur Heart J, (19):1404-1413 2012
MED: 23095984
A machine-learning-based prediction of non-home discharge among acute heart failure patients.
Clin Res Cardiol, (4):522-532 2023
MED: 37131097
Validation of the MAGGIC (Meta-Analysis Global Group in Chronic Heart Failure) heart failure risk score and the effect of adding natriuretic peptide for predicting mortality after discharge in hospitalized patients with heart failure.
PLoS One, (11):e0206380 2018
MED: 30485284
Evaluating risk prediction models for adults with heart failure: A systematic literature review.
PLoS One, (1):e0224135 2020
MED: 31940350
Validation of the Seattle Heart Failure Model in a community-based heart failure population and enhancement by adding B-type natriuretic peptide.
Am J Cardiol, (4):697-700 2007
MED: 17697831
Applying the Seattle Heart Failure Model in the Office Setting in the Era of Electronic Medical Records.
Circ J, (3):724-731 2018
MED: 29343672
The false hope of current approaches to explainable artificial intelligence in health care.
Lancet Digit Health, (11):e745-e750 2021
MED: 34711379
A Review of Challenges and Opportunities in Machine Learning for Health.
AMIA Jt Summits Transl Sci Proc, 191-200 2020
MED: 32477638
A machine learning risk score predicts mortality across the spectrum of left ventricular ejection fraction.
Eur J Heart Fail, (6):995-999 2021
MED: 33724626
Show 10 more references (10 of 42)
Similar Articles
To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.
Funding
Funders who supported this work.
AHRQ HHS (1)
Grant ID: K12 HS026385
Agency for Healthcare Research and Quality (1)
Grant ID: K12HS026385
NCATS NIH HHS (2)
Grant ID: UL1 TR001422
Grant ID: UL1TR001422
NHLBI NIH HHS (2)
Grant ID: K23HL155970
Grant ID: K23 HL155970
National Center for Advancing Translational Sciences (1)
Grant ID: UL1TR001422
National Heart, Lung, and Blood Institute (1)
Grant ID: K23HL155970