Development and validation of a machine learning ASA-score to identify candidates for comprehensive preoperative screening and risk stratification

The ASA physical status (ASA-PS) is determined by an anesthesia provider or surgeon to communicate co-morbidities relevant to perioperative risk. Assigning an ASA-PS is a clinical decision and there is substantial provider-dependent variability. We developed and externally validated a machine learning-derived algorithm to determine ASA-PS (ML-PS) based on data available in the medical record. Retrospective multicenter hospital registry study. University-affiliated hospital networks. Patients who received anesthesia at Beth Israel Deaconess Medical Center (Boston, MA, training [n = 361,602] and internal validation cohorts [n = 90,400]) and Montefiore Medical Center (Bronx, NY, external validation cohort [n = 254,412]). The ML-PS was created using a supervised random forest model with 35 preoperatively available variables. Its predictive ability for 30-day mortality, postoperative ICU admission, and adverse discharge were determined by logistic regression. The anesthesiologist ASA-PS and ML-PS were in agreement in 57.2% of the cases (moderate inter-rater agreement). Compared with anesthesiologist rating, ML-PS assigned more patients into extreme ASA-PS (I and IV), (p