Getting it right: Methods for risk ratios and risk differences cluster randomized trials with a small number of clusters

📅 2025-11-28
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
In cluster-randomized trials (CRTs) with few clusters (<30–40), conventional inference for hazard ratios (HRs) and risk differences (RDs) often inflates Type I error rates. To address this, we systematically evaluate the finite-sample performance of generalized estimating equations (GEE) with binomial, Poisson, and Gaussian working models, combined with bias-corrected standard errors—including Kauermann–Carroll (KC), Morel–Bokossa–Neuhaus (MBN), Morel–Dai (MD), and average (AVG)—and t-distribution–based inference. Our study fills a critical methodological gap in robust HR/RD estimation for small- to moderate-cluster CRTs. It demonstrates substantial improvements in Type I error control and statistical power under challenging conditions: rare outcomes, small cluster sizes, high intracluster correlation, and highly variable cluster sizes. The findings yield directly implementable, evidence-based analytical recommendations for practitioners conducting CRTs with limited numbers of clusters.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: CausalityIntelligent Robots: State Estimation

Application Category

Security and Privacy: Large-scale security measurementsEconomics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAIWeb Mining and Content Analysis: Robustness and generalizability of Web mining methods
📝 Abstract
Most cluster randomized trials (CRTs) randomize fewer than 30-40 clusters in total. When performing inference for such ``small'' CRTs, it is important to use methods that appropriately account for the small sample size. When the generalized estimating equations (GEE) approach is used for analysis of ``small'' CRTs, the robust variance estimator from GEE is biased downward and therefore bias-corrected standard errors should be used. Moreover, in order to avoid inflated Type I error, an appropriate bias-corrected standard error should be paired with the t- rather than Z-statistic when making inference about a single-parameter intervention effect. Although several bias-correction methods (including Kauermann and Carroll (KC), Mancl and DeRouen (MD), Morel, Bokossa, and Neerchal (MBN), and the average of KC and MD (AVG)) have been evaluated for inference for odds ratios, their finite-sample behavior in ``small'' CRTs with few clusters has not been thoroughly investigated for risk ratios and risk differences. The current article aims to fill the gap by including analysis via binomial, Poisson and Gaussian models and for a broad spectrum of scenarios. Analysis is via binomial and Poisson models (using log and identity link for risk and differences measures, respectively). We additionally explore the use of Gaussian models with identity link for risk differences and adopt the "modified" approach for analysis with misspecified Poisson and Gaussian models. We consider a broad spectrum of scenarios including for rare outcomes, small cluster sizes, high intracluster correlations (ICCs), and high coefficients of variation (CVs) of cluster size.
Problem

Research questions and friction points this paper is trying to address.

Evaluating bias-corrected methods for risk ratios in small cluster trials
Assessing statistical accuracy for risk differences with few clusters
Investigating finite-sample performance under rare outcomes and high ICCs
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uses bias-corrected GEE standard errors
Employs t-statistics for small cluster trials
Tests binomial Poisson Gaussian model scenarios
🔎 Similar Papers
2024-09-01arXiv.orgCitations: 4
💼 Related Jobs
No related jobs found.
S
Shifeng Sun
Department of Biostatistics and Bioinformatics, Duke University, Duke Global Health Institute, Durham, North Carolina, USA
X
Xueqi Wang
Department of Biostatistics, Yale School of Public Health, Yale University, New Haven, Connecticut, USA
Z
Zhuoran Hou
Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, USA
E
Elizabeth L. Turner
Department of Biostatistics and Bioinformatics, Duke University, Duke Global Health Institute, Durham, North Carolina, USA