🤖 AI Summary
Class imbalance significantly degrades classification performance, yet a unified theoretical framework has been lacking. This work proposes the first model-agnostic, geometrically interpretable three-parameter theory—characterized by the imbalance ratio η, dimensionality ratio κ, and class separability Δ—to analytically derive the closed-form Bayes error under a Gaussian generative model. The framework elucidates the mechanism of decision boundary shift and systematically identifies four distinct performance degradation regimes. Theoretical predictions align closely with empirical results on high-dimensional genomic data: when log(η) > Δ√κ, minority-class recall drops sharply while precision rises asymmetrically, and both F1 score and PR-AUC degrade in accordance with the proposed mechanism, thereby validating the framework’s predictive power and broad applicability.
📝 Abstract
Class imbalance significantly degrades classification performance, yet its effects are rarely analyzed from a unified theoretical perspective. We propose a principled framework based on three fundamental scales: the imbalance coefficient $\eta$, the sample--dimension ratio $\kappa$, and the intrinsic separability $\Delta$. Starting from the Gaussian Bayes classifier, we derive closed-form Bayes errors and show how imbalance shifts the discriminant boundary, yielding a deterioration slope that predicts four regimes: Normal, Mild, Extreme, and Catastrophic. Using a balanced high-dimensional genomic dataset, we vary only $\eta$ while keeping $\kappa$ and $\Delta$ fixed. Across parametric and non-parametric models, empirical degradation closely follows theoretical predictions: minority Recall collapses once $\log(\eta)$ exceeds $\Delta\sqrt{\kappa}$, Precision increases asymmetrically, and F1-score and PR-AUC decline in line with the predicted regimes. These results show that the triplet $(\eta,\kappa,\Delta)$ provides a model-agnostic, geometrically grounded explanation of imbalance-induced deterioration.