Does the ranking of surgeons in a publicly available online platform correlate with objective outcomes?

J Neurosurg. 2017 Aug;127(2):353-359. doi: 10.3171/2016.8.JNS16583. Epub 2016 Nov 11.

Abstract

OBJECTIVE The accuracy of public reporting in health care, especially from private vendors, remains an issue of debate. The authors investigated the association of the publicly reported physician complication rates in an online platform with real-world adverse outcomes of the same physicians for patients undergoing posterior lumbar fusion. METHODS The authors performed a cohort study involving physicians performing posterior lumbar fusions between 2009 and 2013 who were registered in the Statewide Planning and Research Cooperative System database. This cohort was merged with publicly available data over the same time period from ProPublica, a private company. Mixed-effects multivariable regression models were used to investigate the association of publicly available complication rates with the rate of discharge to a rehabilitation facility, length of stay, mortality, and hospitalization charges for the same surgeons. RESULTS During the selected study period, there were 8,457 patients in New York State who underwent posterior lumbar fusion performed by the 56 surgeons represented in the ProPublica Surgeon Scorecard over the same time period. Using a mixed-effects multivariable regression model, the authors demonstrated that publicly reported physician-level complication rates were not associated with the rate of discharge to a rehabilitation facility (OR 0.97, 95% CI 0.72-1.31), length of stay (adjusted difference -0.1, 95% CI -0.5 to 0.2), mortality (OR 0.87, 95% CI 0.49-1.55), and hospitalization charges (adjusted difference $18,735, 95% CI -$59,177 to $96,647). Similarly, no association was observed when utilizing propensity score-adjusted models, and when restricting the cohort to a predefined subgroup of Medicare patients. CONCLUSIONS After merging a comprehensive all-payer posterior lumbar fusion cohort in New York State with data from the ProPublica Surgeon Scorecard over the same time period, the authors observed no association of publicly available physician complication rates with objective outcomes.

Keywords: LOS = length of stay; ProPublica Surgeon Scorecard; SPARCS; SPARCS = Statewide Planning and Research Cooperative System; Statewide Planning and Research Cooperative System; outcomes; posterior lumbar fusion; public reporting.

MeSH terms

  • Clinical Competence / standards*
  • Consumer Health Information*
  • Humans
  • Internet*
  • Neurosurgeons / classification*
  • Neurosurgical Procedures / standards*
  • New York
  • Spinal Fusion / standards
  • Treatment Outcome*