TY - JOUR
T1 - Association of surgical care improvement project infection-related process measure compliance with risk-adjusted outcomes
T2 - Implications for quality measurement
AU - Ingraham, Angela M.
AU - Cohen, Mark E.
AU - Bilimoria, Karl Y.
AU - Dimick, Justin B.
AU - Richards, Karen E.
AU - Raval, Mehul V.
AU - Fleisher, Lee A.
AU - Hall, Bruce L.
AU - Ko, Clifford Y.
N1 - Funding Information:
Disclosure Information: Nothing to disclose. Drs Ingraham and Raval are supported by the Clinical Scholar in Residence Program at the American College of Surgeons . Dr Raval is supported by the John Gray Research Fellowship and the Daniel F and Ada L Rice Foundation . Dr Bilimoria is supported by a Priority Grant from Northwestern University . Dr Hall is supported by the Center for Health Policy, Washington University St Louis .
PY - 2010/12
Y1 - 2010/12
N2 - Background Facility-level process measure adherence is being publicly reported. However, the association between measure adherence and surgical outcomes is not well-established. Our objective was to determine the degree to which Surgical Care Improvement Project (SCIP) process measures are associated with American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) risk-adjusted outcomes. Study Design This cross-sectional study included hospitals participating in the ACS NSQIP and SCIP (n = 200). ACS NSQIP outcomes (30-day overall morbidity, serious morbidity, surgical site infections [SSI], and mortality) and adherence to SCIP SSI-related process measures (from the Hospital Compare database) were collected from January 1, 2008, through December 31, 2008. Hospital-level correlation coefficients between compliance with 4 process measures (ie, antibiotic administration within 1 hour before incision [SCIP-1]; appropriate antibiotic prophylaxis [SCIP-2]; antibiotic discontinuation within 24 hours after surgery [SCIP-3]; and appropriate hair removal [SCIP 6]) and 4 risk-adjusted outcomes were calculated. Regression analyses estimated the contribution of process measure adherence to risk-adjusted outcomes. Results Of 211 ACS NSQIP hospitals, 95% had data reported by Hospital Compare. Depending on the measure, hospital-level compliance ranged from 60% to 100%. Of the 16 correlations, 15 demonstrated nonsignificant associations with risk-adjusted outcomes. The exception was the relationship between SCIP-2 and SSI (p = 0.004). SCIP-1 demonstrated an intriguing but nonsignificant relationship with SSI (p = 0.08) and overall morbidity (p = 0.08). Although adherence to SCIP-2 was a significant predictor of risk-adjusted SSI (p < 0.0001) and overall morbidity (p < 0.0001), inclusion of compliance for SCIP-1 and SCIP-2 caused only slight improvement in model quality. Conclusions Better adherence to infection-related process measures over the observed range was not significantly associated with better outcomes with one exception. Different measures of quality might be needed for surgical infection.
AB - Background Facility-level process measure adherence is being publicly reported. However, the association between measure adherence and surgical outcomes is not well-established. Our objective was to determine the degree to which Surgical Care Improvement Project (SCIP) process measures are associated with American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) risk-adjusted outcomes. Study Design This cross-sectional study included hospitals participating in the ACS NSQIP and SCIP (n = 200). ACS NSQIP outcomes (30-day overall morbidity, serious morbidity, surgical site infections [SSI], and mortality) and adherence to SCIP SSI-related process measures (from the Hospital Compare database) were collected from January 1, 2008, through December 31, 2008. Hospital-level correlation coefficients between compliance with 4 process measures (ie, antibiotic administration within 1 hour before incision [SCIP-1]; appropriate antibiotic prophylaxis [SCIP-2]; antibiotic discontinuation within 24 hours after surgery [SCIP-3]; and appropriate hair removal [SCIP 6]) and 4 risk-adjusted outcomes were calculated. Regression analyses estimated the contribution of process measure adherence to risk-adjusted outcomes. Results Of 211 ACS NSQIP hospitals, 95% had data reported by Hospital Compare. Depending on the measure, hospital-level compliance ranged from 60% to 100%. Of the 16 correlations, 15 demonstrated nonsignificant associations with risk-adjusted outcomes. The exception was the relationship between SCIP-2 and SSI (p = 0.004). SCIP-1 demonstrated an intriguing but nonsignificant relationship with SSI (p = 0.08) and overall morbidity (p = 0.08). Although adherence to SCIP-2 was a significant predictor of risk-adjusted SSI (p < 0.0001) and overall morbidity (p < 0.0001), inclusion of compliance for SCIP-1 and SCIP-2 caused only slight improvement in model quality. Conclusions Better adherence to infection-related process measures over the observed range was not significantly associated with better outcomes with one exception. Different measures of quality might be needed for surgical infection.
UR - http://www.scopus.com/inward/record.url?scp=78649516571&partnerID=8YFLogxK
U2 - 10.1016/j.jamcollsurg.2010.09.006
DO - 10.1016/j.jamcollsurg.2010.09.006
M3 - Article
C2 - 21109157
AN - SCOPUS:78649516571
SN - 1072-7515
VL - 211
SP - 705
EP - 714
JO - Journal of the American College of Surgeons
JF - Journal of the American College of Surgeons
IS - 6
ER -