What's wrong with Bonferroni adjustments

TV Perneger - Bmj, 1998 - bmj.com
TV Perneger
Bmj, 1998bmj.com
When more than one statistical test is performed in analysing the data from a clinical study,
some statisticians and journal editors demand that a more stringent criterion be used for
“statistical significance” than the conventional P< 0.05. 1 Many well meaning researchers,
eager for methodological rigour, comply without fully grasping what is at stake. Recently,
adjustments for multiple tests (or Bonferroni adjustments) have found their way into
introductory texts on medical statistics, which has increased their apparent legitimacy. This …
When more than one statistical test is performed in analysing the data from a clinical study, some statisticians and journal editors demand that a more stringent criterion be used for “statistical significance” than the conventional P< 0.05. 1 Many well meaning researchers, eager for methodological rigour, comply without fully grasping what is at stake. Recently, adjustments for multiple tests (or Bonferroni adjustments) have found their way into introductory texts on medical statistics, which has increased their apparent legitimacy. This paper advances the view, widely held by epidemiologists, that Bonferroni adjustments are, at best, unnecessary and, at worst, deleterious to sound statistical inference.
bmj.com