Optimal Multi-way Decision Trees for Stratified Sampling in Online Controlled Experiments

📅 2026-09-19
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
该研究通过使用最优多路决策树进行分层抽样,以提高在线对照实验的统计功效而不增加样本量。
📝 Abstract
Online controlled experiments, or A/B tests, are widely used to estimate causal effects on digital platforms. A central challenge is to improve experimental sensitivity, or statistical power, without increasing the experimental sample size. Stratified sampling is a classical variance reduction technique; however, its effectiveness depends critically on how the strata are constructed. We thus propose an optimization-based stratification framework for stratified sampling using optimal multi-way decision trees. Our method, called Optimal Multi-way Stratification Trees (OMST), formulates stratification as a path-selection problem over a feature graph. The selected paths define interpretable stratification rules and are optimized using an exact variance-minimizing binary optimization formulation under continuous proportional allocation and a Neyman-type optimal allocation. We incorporate supervised optimal binning to generate outcome-relevant candidate splits for numerical features. Furthermore, we introduce reduction procedures for redundant candidate paths and assignment constraints, substantially reducing the optimization problem size. Experiments on both a real-world and a simulated dataset demonstrate that OMST achieves comparable or superior variance reduction to existing methods while maintaining shallow and interpretable stratification trees.
Problem

Research questions and friction points this paper is trying to address.

online controlled experiments
statistical power
stratified sampling
variance reduction
Innovation

Methods, ideas, or system contributions that make the work stand out.

Optimal Multi-way Decision Trees
Stratified Sampling
Variance Reduction
Continuous Proportional Allocation
Supervised Optimal Binning
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
T
Tomoka Takei
University of Tsukuba, Tsukuba-shi, Ibaraki 305-8573, Japan
S
Shunnosuke Ikeda
University of Tsukuba, Tsukuba-shi, Ibaraki 305-8573, Japan
Y
Yuichi Takano
University of Tsukuba, Tsukuba-shi, Ibaraki 305-8573, Japan