🤖 AI Summary
Conventional covariate adjustment in randomized controlled trials (RCTs) often suffers from suboptimal efficiency due to inflexible, pre-specified modeling assumptions.
Method: We propose a prespecified yet data-adaptive machine learning framework for RCT analysis. It introduces the first adaptive targeted maximum likelihood estimation (TMLE) strategy that integrates sample splitting with cross-validated variance minimization—enabling data-driven model selection while strictly adhering to the pre-specified statistical analysis plan (SAP). Rigorous validation employs adaptive pre-specification, plasmode simulation, and parametric simulation.
Contribution/Results: Applied to primary endpoint analyses of eight published clinical trials (2022–2024), our method significantly improves precision in marginal treatment effect estimation. It supports real-time, global remote unblinding and robust implementation, establishing a new paradigm for RCT analysis that is prespecifiable, reproducible, and statistically efficient.
📝 Abstract
Covariate adjustment is an approach to improve the precision of trial analyses by adjusting for baseline variables that are prognostic of the primary endpoint. Motivated by the SEARCH Universal HIV Test-and-Treat Trial (2013-2017), we tell our story of developing, evaluating, and implementing a machine learning-based approach for covariate adjustment. We provide the rationale for as well as the practical concerns with such an approach for estimating marginal effects. Using schematics, we illustrate our procedure: targeted machine learning estimation (TMLE) with Adaptive Pre-specification. Briefly, sample-splitting is used to data-adaptively select the combination of estimators of the outcome regression (i.e., the conditional expectation of the outcome given the trial arm and covariates) and known propensity score (i.e., the conditional probability of being randomized to the intervention given the covariates) that minimizes the cross-validated variance estimate and, thereby, maximizes empirical efficiency. We discuss our approach for evaluating finite sample performance with parametric and plasmode simulations, pre-specifying the Statistical Analysis Plan, and unblinding in real-time on video conference with our colleagues from around the world. We present the results from applying our approach in the primary, pre-specified analysis of 8 recently published trials (2022-2024). We conclude with practical recommendations and an invitation to implement our approach in the primary analysis of your next trial.