Measuring inconsistency in meta-analyses

JPT Higgins, SG Thompson, JJ Deeks, DG Altman - Bmj, 2003 - bmj.com
Bmj, 2003bmj.com
Systematic reviews and meta-analyses can provide convincing and reliable evidence
relevant to many aspects of medicine and health care. 1 Their value is especially clear when
the results of the studies they include show clinically important effects of similar magnitude.
However, the conclusions are less clear when the included studies have differing results. In
an attempt to establish whether studies are consistent, reports of meta-analyses commonly
present a statistical test of heterogeneity. The test seeks to determine whether there are …
Systematic reviews and meta-analyses can provide convincing and reliable evidence relevant to many aspects of medicine and health care. 1 Their value is especially clear when the results of the studies they include show clinically important effects of similar magnitude. However, the conclusions are less clear when the included studies have differing results. In an attempt to establish whether studies are consistent, reports of meta-analyses commonly present a statistical test of heterogeneity. The test seeks to determine whether there are genuine differences underlying the results of the studies (heterogeneity), or whether the variation in findings is compatible with chance alone (homogeneity). However, the test is susceptible to the number of trials included in the meta-analysis. We have developed a new quantity, I 2, which we believe gives a better measure of the consistency between trials in a meta-analysis.
bmj.com