Meta-Analysis Without Normality: Estimating the True Effect Distribution with Penalized Gaussian Mixtures

2026-04-30

AI Summary

Traditional random-effects meta-analysis assumes that the true effects follow a normal distribution—a simplification that often fails under substantial heterogeneity, particularly when the underlying distribution is skewed or multimodal, leading to misleading inferences. This work proposes a penalized Gaussian mixture (PGM) framework that flexibly models non-normal effect distributions without requiring prespecified parametric forms, while automatically reducing to the standard normal model when supported by the data. The method provides, for the first time, a robust nonparametric estimate of the full probability density function of true effects, integrating density regularization, adaptive model selection, and extensive simulation validation. It substantially improves accuracy in estimating tail probabilities and density shapes under non-normality, without sacrificing efficiency in normal settings. Empirical analysis of environmental education data demonstrates its capacity to uncover complex heterogeneity structures and its practical advantages over conventional approaches.

Abstract

Standard random-effects meta-analysis relies heavily on the assumption that the underlying true effects are normally distributed. In the social sciences, where evidence synthesis increasingly involves large, highly heterogeneous datasets, this assumption is often restrictive and unjustified. Misspecification of the random-effects distribution prevents the detection of asymmetry or multimodality, potentially leading to erroneous conclusions regarding the prevalence of adverse effects or the existence of specific subgroups. This paper introduces a Penalized Gaussian Mixture (PGM) framework designed to recover the entire probability density function of true effects without enforcing a rigid parametric shape. The method adapts to different non-normal scenarios, including skewed and multimodal distributions, while reducing to the normal case when supported by the data. A simulation study demonstrates that in large, highly heterogeneous meta-analyses, PGM yields substantially more accurate estimates of tail probabilities and the density function than standard methods when normality is violated, without substantially compromising efficiency under normality. An empirical application to environmental education data illustrates the practical utility of the method. The proposed framework provides researchers with a robust tool to move beyond simple summary statistics and characterize the complex nature of the true effect distribution in the real world.

Problem

• meta-analysis
• non-normality
• random-effects distribution
• heterogeneity
• effect distribution

Innovation

• Penalized Gaussian Mixture
• meta-analysis
• non-normality
• effect distribution
• heterogeneity