Prediction of Atrial Fibrillation 10–Year Risk with Optimal Survival Tree Models

Abstract

BACKGROUND

Atrial fibrillation (AF) is the most common cardiac rhythm disorder in adults and old subjects with an estimated global prevalence of 35 million cases worldwide and increasing incidence in the next decades [1]. Traditional AF risk scores – Framingham, ARIC, CHARGE‑AF, CHA₂DS₂-VASc and SAAFE [2–6] – reach C-statistics around 0.75-0.80. Recently, there has been a growing interest in applying machine learning (ML) techniques to develop predictive models for AF. Many of these models have pushed discrimination performance a little higher, sacrificing interpretability, since the “black-box” nature of the employed algorithms [7].

OBJECTIVE

To build and internally validate an interpretable model that predicts the 10–year probability of AF-free survival, using the recently proposed Optimal Survival Tree (OST) algorithm [8].

METHODS

Data analyzed came from the Catanzaro Atrial Fibrillation project [9], an observational prospective cohort study that included outpatients enrolled from January 1998 to December 2018, referred to the University Hospital of Catanzaro - Italy, for cardiac clinical evaluation.

Patients with end-stage renal disease, active malignancy, thyroid dysfunction, cardiomyopathy, rheumatic and non-rheumatic valvular heart disease, or prosthetic valves, were excluded as well as those with previous acute myocardial infarction or stroke.

Predictors included in the analyses were: i) Demographic and anthropometric measures: age, sex, BMI, waist circumference; ii) Medical history: hypertension, diabetes, heart failure, vascular disease, COPD, previous TIA, CHA₂DS₂‑VASc components; iii) Laboratory measures: fasting glucose, total/HDL/LDL cholesterol, triglycerides, eGFR; Imaging derived variables: Left Atrial Volume index (LAVi), Left Ventricular Mass index, Carotid Intima-Media thickness. Time-to-first AF diagnosis was right-censored at 10 years.

The OST model was benchmarked against three established tree-based algorithms: survival CART, survival conditional-inference trees (cTree) and random survival forests (RF).

The models were trained on a randomly selected subset of patients (70%) and their predictive performances were subsequently evaluated and compared on the remaining 30%. A 5-fold cross-validation based grid search was used to tune the models’ hyper-parameters. Discrimination (time-dependent AUC), accuracy (Brier score, integrated Brier score, Index of Prediction Accuracy – IPA) and calibration (Integrated Calibration Index - ICI, E₅₀, E₉₀) were assessed .

RESULTS

A total of 4114 patients were selected (mean age 59.06 ± 11.73, 48.1% Females). During a mean follow-up of 59 ± 19 months, AF occurred in 533 patients (13%). At baseline, AF patients showed on average a worse clinical profile in terms of anthropometric measures (BMI and Waist circumference), renal function (eGFR), cardiovascular risk factors (Diabetes, Hypertension, Heart failure, previous TIA), CHA₂DS₂-VASc score and echocardiographic parameters.

The final OST model (Figure 1) relied on only four variables - LAVi, Glucose, Age, and CHA₂DS₂-VASc - creating six leaves that collapsed into four clinically meaningful risk profiles: i) Very-low risk: Either LAVi ≤ 34 mL/m², glucose ≤ 97 mg/dL, CHA₂DS₂-VASc ≤ 2, or same LAVi, Glucose > 97, and age ≤ 71 y (n = 2082, expected AF-free survival 115-118 mo); ii) Low risk: Same LAVi/glucose but CHA₂DS₂-VASc  > 2 (n = 213, 106 mo); iii) Moderate risk: Either LAVi ≤ 34 with higher glucose and age > 71 y or LAVi 34-39 (n = 399, 87-89 mo); iv) High risk: LAVi ≥ 40 (n = 186, 56 mo).

On the test cohort OST achieved AUCs of 0.856 and 0.794 and Brier scores of 0.086 and 0.134 at 5 and 10 years, respectively, slightly outperforming CART (5/10-y AUC 0.849/0.764; Brier 0.096/0.137) and cTree (0.846/0.766; 0.096/0.156), and trailing RF in the 5-year (0.894, 0.083), but not the 10–year prediction (0.804, 0.131). Calibration metrics favored OST over RF at both horizons.

CONCLUSIONS

A parsimonious, easily explainable four-variable OST predicted 10–year AF risk almost as accurately as RF yet with superior calibration and bedside transparency. Adding a single echocardiographic measure (LAVi) to routine clinical data may enable personalized AF screening and targeted prevention. External validation in independent, multicentre cohorts is required to confirm the model’s generalisability and to support its adoption in routine clinical practice.