Clinical judgment is a cornerstone for validating and using clinical prediction rules: a head-to-head study on ambulation outcomes for spinal cord injured patients

Study design Retrospective comparative study. Objective Clinical prediction rules (CPRs) are an effervescent topic in the medical literature. Recovering ambulation after a traumatic spinal cord injury (tSCI) is a priority for patients and multiple CPRs have been proposed for predicting ambulation outcomes. Our objective is to confront clinical judgment to an established CPR developed for patients with tSCI. Settings Level one trauma center specialized in tSCI and its affiliated rehabilitation center. Method In this retrospective comparative study, six physicians had to predict the ambulation outcome of 68 patients after a tSCI based on information from the acute hospitalization. Ambulation was also predicted according to the CPR of van Middendorp (CPR-vM). The success rate of the CPR-vM and clinicians to predict ambulation was compared using criteria of 5% for defining clinical significance, and a level of statistical significance of 0.05 for bilateral McNemar tests. Results There was no statistical difference between the overall performance of physicians (success rate of 79%) and of the CPR-vM (81%) for predicting ambulation. The differences between the CPR-vM and physicians varied clinically and significantly with the level of experience, clinical setting, and field of expertise. Conclusion Confronting CPRs with the judgment of a group of clinicians should be an integral part of the design and validation of CPRs. Head-to-head comparison of CPRs with clinicians is also a cornerstone for defining the optimal strategy for translation into the clinical practice, and for defining which clinician and specific clinical context would benefit from using the CPR.