PREDICT-TBI: Comparison of Physician Predictions with the IMPACT Model to Predict 6-Month Functional Outcome in Traumatic Brain Injury

Background Predicting functional outcome in critically ill patients with traumatic brain injury (TBI) strongly influences end-of-life decisions and information for surrogate decision makers. Despite well-validated prognostic models, clinicians most often rely on their subjective perception of prognosis. In this study, we aimed to compare physicians’ predictions with the International Mission on Prognosis and Analysis of Clinical Trials in TBI (IMPACT) prognostic model for predicting an unfavorable functional outcome at 6 months after moderate or severe TBI. Methods PREDICT-TBI is a prospective study of patients with moderate to severe TBI. Patients were admitted to a neurocritical care unit and were excluded if they died or had withdrawal of life-sustaining treatments within the first 24 h. In a paired study design, we compared the accuracy of physician prediction on day 1 with the prediction of the IMPACT model as two diagnostic tests in predicting unfavorable outcome 6 months after TBI. Unfavorable outcome was assessed by the Glasgow Outcome Scale from 1 to 3 by using a structured telephone interview. The primary end point was the difference between the discrimination ability of the physician and the IMPACT model assessed by the area under the curve. Results Of the 93 patients with inclusion and exclusion criteria, 80 patients reached the primary end point. At 6 months, 29 patients (36%) had unfavorable outcome. A total of 31 clinicians participated in the study. Physicians’ predictions showed an area under the curve of 0.79 (95% confidence interval 0.68–0.89), against 0.80 (95% confidence interval 0.69–0.91) for the laboratory IMPACT model, with no statistical difference ( p = 0.88). Both approaches were well calibrated. Agreement between physicians was moderate (κ = 0.56). Lack of experience was not associated with prediction accuracy ( p = 0.58). Conclusions Predictions made by physicians for functional outcome were overall moderately accurate, and no statistical difference was found with the IMPACT models, possibly due to a lack of power. The significant variability between physician assessments suggests prediction could be improved through peer reviewing, with the support of the IMPACT models, to provide a realistic expectation of outcome to families and guide discussions about end-of-life decisions.