Improving the Predictive Performance of Bootstrap Aggregating by Dirichlet Resampling

📅 2026-09-18
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
通过引入Dirichlet重采样方法改进Bootstrap聚合,减少树间相关性而不削弱单棵树性能,从而提高随机森林预测效果。
📝 Abstract
We revisit Breiman's observation that reducing inter-tree correlation without weakening individual trees can improve random forests. Building on this principle, we introduce two variants: Dirichlet-Multinomial Bagging Random Forest (DM) and Dirichlet-Weighted Random Forest (DW). Both modulate sample reweighting via a concentration parameter $α>0$. We provide a simple theoretical criterion that clarifies when these variants behave indistinguishably from standard random forests, and we use it to guide a lightweight tuning strategy. In a controlled evaluation on public classification benchmarks, DM and DW are consistently competitive and often stronger than other random-forest (RF) baselines, with negligible additional runtime.
Problem

Research questions and friction points this paper is trying to address.

Bootstrap Aggregating
Dirichlet Resampling
Random Forests
Inter-tree Correlation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Dirichlet Resampling
Inter-tree Correlation
Random Forests
Concentration Parameter
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Q
Quoc Viet Le
Department of Statistics, University of Wisconsin–Madison
J
Joonha Park
Department of Mathematics, University of Kansas