W. G. Cochran’s Q statistic was introduced in 1937 to test for equality of means under heteroscedasticity. Today, the use of Q is widespread in tests for homogeneity of effects in meta-analysis, but often these effects (such as risk differences and odds ratios) are not normally distributed. It is common to assume that Q follows a chi-square distribution, but it has long been known that this asymptotic distribution for Q is not accurate for moderate sample sizes. In this paper, the effect and weight for an individual study may depend on two parameters: the effect and a nuisance parameter. We present expansions for the first two moments of Q without any normality assumptions. Our expansions will have wide applicability in testing for homogeneity in meta-analysis. As an important example, we present a homogeneity test when the effects are the differences of risks between treatment and control arms of the several studies—a test which is substantially more accurate than that currently used. In this situation, we approximate the distribution of Q with a gamma distribution. We provide the results of simulations to verify the accuracy of our proposal and an example of a meta-analysis of medical data. Copyright © 2012 John Wiley & Sons, Ltd.