Recalibration of a Non-Laboratory-Based Risk Model to Estimate Pre-Diabetes/Diabetes Mellitus Risk in Primary Care in Hong Kong

Abstract

<h3>Introduction/Objectives:</h3><p>A non-laboratory-based pre-diabetes/diabetes mellitus (pre-DM/DM) risk prediction model developed from the Hong Kong Chinese population showed good external discrimination in a primary care (PC) population, but the estimated risk level was significantly lower than the observed incidence, indicating poor calibration. This study explored whether recalibrating/updating methods could improve the model’s accuracy in estimating individuals’ risks in PC.</p><h3>Methods:</h3><p>We performed a secondary analysis on the model’s predictors and blood test results of 919 Chinese adults with no prior DM diagnosis recruited from PC clinics from April 2021 to January 2022 in HK. The dataset was randomly split in half into a training set and a test set. The model was recalibrated/updated based on a seven-step methodology, including model recalibrating, revising and extending methods. The primary outcome was the calibration of the recalibrated/updated models, indicated by calibration plots. The models’ discrimination, indicated by the area under the receiver operating characteristic curves (AUC-ROC), was also evaluated.</p><h3>Results:</h3><p>Recalibrating the model’s regression constant, with no change to the predictors’ coefficients, improved the model’s accuracy (calibration plot intercept: −0.01, slope: 0.69). More extensive methods could not improve any further. All recalibrated/updated models had similar AUC-ROCs to the original model.</p><h3>Conclusion:</h3><p>The simple recalibration method can adapt the HK Chinese pre-DM/DM model to PC populations with different pre-test probabilities. The recalibrated model can be used as a first-step screening tool and as a measure to monitor changes in pre-DM/DM risks over time or after interventions.</p>