Evaluating health care performance: strengths and limitations of multilevel analysis

Biom J. 2007 Aug;49(5):707-18. doi: 10.1002/bimj.200610350.

Abstract

An increasing number of health services researchers are using multilevel analysis for evaluating health care performance. This method has the distinct advantage of accounting for within-provider correlation among patients. Alternatively, in a similar manner, estimators based on cluster sampling can also adjust for within-provider correlation. Cluster sampling methods do not require assumptions about error distribution as multilevel analysis does. To our knowledge, no comparison has been made between multilevel analysis and cluster sampling estimators in evaluating health care performance using either a simulated or real dataset. In this paper, we compare the cluster sampling estimators to multilevel estimators in evaluating screening mammography performance using Medicare claims data. We also discuss the strengths and limitations of multilevel analysis in profiling health care providers with small caseloads.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Benchmarking / methods*
  • Breast Neoplasms / diagnostic imaging*
  • Breast Neoplasms / epidemiology*
  • Computer Simulation
  • Data Interpretation, Statistical*
  • Humans
  • Mammography / methods*
  • Multivariate Analysis*
  • Observer Variation
  • Quality Assurance, Health Care / methods*