The influence of decreasing variable collection burden on hospital-level risk-adjustment

Background: Risk-adjustment is a key feature of the American College of Surgeons National Surgical Quality Improvement Program-Pediatric (NSQIP-Ped). Risk-adjusted model variables require meticulous collection and periodic assessment. This study presents a method for eliminating superfluous variables using the congenital malformation (CM) predictor variable as an example. Methods: This retrospective cohort study used NSQIP-Ped data from January 1st to December 31st, 2019 from 141 hospitals to compare six risk-adjusted mortality and morbidity outcome models with and without CM as a predictor. Model performance was compared using C-index and Hosmer-Lemeshow (HL) statistics. Hospital-level performance was assessed by comparing changes in outlier statuses, adjusted quartile ranks, and overall hospital performance statuses between models with and without CM inclusion. Lastly, Pearson correlation analysis was performed on log-transformed ORs between models. Results: Model performance was similar with removal of CM as a predictor. The difference between C-index statistics was minimal (≤ 0.002). Graphical representations of model HL-statistics with and without CM showed considerable overlap and only one model attained significance, indicating minimally decreased performance (P = 0.058 with CM; P = 0.044 without CM). Regarding hospital-level performance, minimal changes in the number and list of hospitals assigned to each outlier status, adjusted quartile rank, and overall hospital performance status were observed when CM was removed. Strong correlation between log-transformed ORs was observed (r ≥ 0.993). Conclusions: Removal of CM from NSQIP-Ped has minimal effect on risk-adjusted outcome modelling. Similar efforts may help balance optimal data collection burdens without sacrificing highly valued risk-adjustment in the future. Level of evidence: Level II prognosis study.