Prediction accuracy of common prognostic scoring systems for metastatic spine disease

Study Design. A prospective multicenter cohort study. Objective. To assess the clinical accuracy of six commonly cited prognostic scoring systems for patients with spinal metastases. Summary of Background Data. There are presently several available methods for the estimation of prognosis in metastatic spinal disease, but none are universally accepted by surgeons for clinical use. These scoring systems have not been rigorously tested and validated in large datasets to see if they are reliable enough to inform day-To-day patient management decisions. We tested these scoring systems in a large cohort of patients. A total of 1469 patients were recruited into a secure internet database, and prospectively collected data were analyzed to assess the accuracy of published prognostic scoring systems. Methods. We assessed six prognostic scoring systems, described by the first authors Tomita, Tokuhashi, Bauer, van der Linden, Rades, and Bollen. Kaplan-Meier survival estimates were created for different patient subgroups as described in the original publications. Harrell's C-statistic was calculated for the survival estimates, to assess the concordance between estimated and actual survival. Results. All the prognostic scoring systems tested were able to categorize patients into separate prognostic groups with different overall survivals. However none of the scores were able to achieve ''good concordance'' as assessed by Harrell's C-statistic. The score of Bollen and colleagues was found to be the most accurate, with a Harrell's C-statistic of 0.66. Conclusion. No prognostic scoring system was found to have a good predictive value. The scores of Bollen and Tomita were the most effective with Harrell's C-statistic of 0.66 and 0.65, respectively. Prognostic scoring systems are calculated using data from previous years, and are subject to inaccuracies as treatments advance in the interim. We suggest that other methods of assessing prognosis should be explored, such as prognostic risk calculation.