TY - JOUR
T1 - Simplified risk prediction indices do not accurately predict 30-day death or readmission after discharge following colorectal surgery
AU - Brauer, David G.
AU - Lyons, Sarah A.
AU - Keller, Matthew R.
AU - Mutch, Matthew G.
AU - Colditz, Graham A.
AU - Glasgow, Sean C.
N1 - Funding Information:
Supported in part by a National Cancer Institute National Research Service Award to the Department of Surgery at Washington University School of Medicine (T32 CA009621), the Foundation for Barnes-Jewish Hospital, and the Washington University Center for Administrative Data Research and the Institute of Clinical and Translational Sciences, which are supported in part by the National Center for Advancing Translational Sciences of the National Institutes of Health (UL1 TR000448), the Agency for Healthcare Research and Quality (R24 HS19455), and the National Cancer Institute at the National Institutes of Health (KM1CA156708). The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.We thank Margie Olsen, PhD, MPH, Professor of Medicine in the Department of Medicine and Director of the Center for Administrative Data Research at Washington University, St. Louis, MO, for her invaluable guidance in data collection, analysis, and interpretation. We also thank the Alvin J. Siteman Cancer Center at Washington University School of Medicine and Barnes-Jewish Hospital, St. Louis, MO, for use of the Biostatistics Shared Resource, which provided analytic support services supported in part by a National Cancer Institute Cancer Center Support Grant (P30 CA091842).
Funding Information:
We thank Margie Olsen, PhD, MPH, Professor of Medicine in the Department of Medicine and Director of the Center for Administrative Data Research at Washington University, St. Louis, MO, for her invaluable guidance in data collection, analysis, and interpretation. We also thank the Alvin J. Siteman Cancer Center at Washington University School of Medicine and Barnes-Jewish Hospital, St. Louis, MO, for use of the Biostatistics Shared Resource, which provided analytic support services supported in part by a National Cancer Institute Cancer Center Support Grant (P30 CA091842).
Funding Information:
Supported in part by a National Cancer Institute National Research Service Award to the Department of Surgery at Washington University School of Medicine (T32 CA009621), the Foundation for Barnes-Jewish Hospital, and the Washington University Center for Administrative Data Research and the Institute of Clinical and Translational Sciences, which are supported in part by the National Center for Advancing Translational Sciences of the National Institutes of Health (UL1 TR000448), the Agency for Healthcare Research and Quality (R24 HS19455), and the National Cancer Institute at the National Institutes of Health (KM1CA156708). The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.We thank Margie Olsen, PhD, MPH, Professor of Medicine in the Department of Medicine and Director of the Center for Administrative Data Research at Washington University, St. Louis, MO, for her invaluable guidance in data collection, analysis, and interpretation. We also thank the Alvin J. Siteman Cancer Center at Washington University School of Medicine and Barnes-Jewish Hospital, St. Louis, MO, for use of the Biostatistics Shared Resource, which provided analytic support services supported in part by a National Cancer Institute Cancer Center Support Grant (P30 CA091842). Supported in part by a National Cancer Institute National Research Service Award to the Department of Surgery at Washington University School of Medicine (T32 CA009621), the Foundation for Barnes-Jewish Hospital, and the Washington University Center for Administrative Data Research and the Institute of Clinical and Translational Sciences, which are supported in part by the National Center for Advancing Translational Sciences of the National Institutes of Health (UL1 TR000448), the Agency for Healthcare Research and Quality (R24 HS19455), and the National Cancer Institute at the National Institutes of Health (KM1CA156708). The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Publisher Copyright:
© 2018
PY - 2019/5
Y1 - 2019/5
N2 - Background: Risk-prediction indices are one category of the many tools implemented to guide efforts to decrease readmissions. However, using fied models to predict a complex process can prove challenging. In addition, no risk-prediction index has been developed for patients undergoing colorectal surgery. Therefore, we evaluated the performance of a widely utilized simplified index developed at the hospital level - LACE (length of stay, acute admission, Charlson comorbidity index score, and emergency department visits) and developed and evaluated a novel index in predicting readmissions in this patient population. Methods: Using a retrospective split-sample cohort, patients discharged after colorectal surgery were identified within the inpatient databases of the Healthcare Cost and Utilization Project for the states of New York, California, and Florida (2006–2014). The primary outcome was death or readmission within 30 days after discharge. Multivariable logistic regression models incorporated patient comorbidities, postoperative complications, and hospitalization details, and were evaluated using the C statistic. Results: A total of 440,742 patients met eligibility criteria. The rate of death or readmission within 30 days after discharge was 14.0% (n = 61,757). When applied to surgical patients, the LACE index demonstrated a poor model fit (C = 0.631). The model fit improved significantly—but remained poor (C = 0.654; P < .001)—with the addition of the following variables, which are known to be associated with readmission after colorectal surgery: age, indication for surgery, and creation of a new ostomy. A novel, simplified model also yielded a poor model fit (C = 0.660). Conclusion: Postdischarge death or readmission after colorectal surgery is not accurately modeled using existing, modified, or novel simplified risk prediction models. Payers and providers must ensure that quality improvement efforts applying simplified models to complex processes, such as readmissions following colorectal surgery, may not be appropriate, and that models reflect the relevant patient population.
AB - Background: Risk-prediction indices are one category of the many tools implemented to guide efforts to decrease readmissions. However, using fied models to predict a complex process can prove challenging. In addition, no risk-prediction index has been developed for patients undergoing colorectal surgery. Therefore, we evaluated the performance of a widely utilized simplified index developed at the hospital level - LACE (length of stay, acute admission, Charlson comorbidity index score, and emergency department visits) and developed and evaluated a novel index in predicting readmissions in this patient population. Methods: Using a retrospective split-sample cohort, patients discharged after colorectal surgery were identified within the inpatient databases of the Healthcare Cost and Utilization Project for the states of New York, California, and Florida (2006–2014). The primary outcome was death or readmission within 30 days after discharge. Multivariable logistic regression models incorporated patient comorbidities, postoperative complications, and hospitalization details, and were evaluated using the C statistic. Results: A total of 440,742 patients met eligibility criteria. The rate of death or readmission within 30 days after discharge was 14.0% (n = 61,757). When applied to surgical patients, the LACE index demonstrated a poor model fit (C = 0.631). The model fit improved significantly—but remained poor (C = 0.654; P < .001)—with the addition of the following variables, which are known to be associated with readmission after colorectal surgery: age, indication for surgery, and creation of a new ostomy. A novel, simplified model also yielded a poor model fit (C = 0.660). Conclusion: Postdischarge death or readmission after colorectal surgery is not accurately modeled using existing, modified, or novel simplified risk prediction models. Payers and providers must ensure that quality improvement efforts applying simplified models to complex processes, such as readmissions following colorectal surgery, may not be appropriate, and that models reflect the relevant patient population.
UR - http://www.scopus.com/inward/record.url?scp=85060639992&partnerID=8YFLogxK
U2 - 10.1016/j.surg.2018.12.007
DO - 10.1016/j.surg.2018.12.007
M3 - Article
C2 - 30709587
AN - SCOPUS:85060639992
SN - 0039-6060
VL - 165
SP - 882
EP - 888
JO - Surgery
JF - Surgery
IS - 5
ER -