🤖 AI Summary
This work investigates how to reliably infer the accuracy of clustering structures from the suboptimality of clustering objective functions, particularly in challenging scenarios involving cluster imbalance and ambiguous boundaries. To this end, the authors introduce a geometric framework termed the “clustering condition number,” which quantitatively links objective values to classification error across a broad class of loss functions, independent of any specific algorithm. Through geometric analysis, local margin theory, and non-asymptotic error bounds, the framework reveals a fundamental trade-off between robustness and sensitivity to cluster imbalance. It provides deterministic, non-asymptotic guarantees for structure recovery: small suboptimality necessarily implies low misclassification rates, with errors concentrated near cluster boundaries, and exact recovery of cluster cores becomes possible under strengthened local margin conditions.
📝 Abstract
We develop a geometric framework that links objective accuracy to structural recovery in prototype-based clustering. The analysis is algorithm-agnostic and applies to a broad class of admissible loss functions. We define a clustering condition number that compares within-cluster scale to the minimum loss increase required to move a point across a cluster boundary. When this quantity is small, any solution with a small suboptimality gap must also have a small misclassification error relative to a benchmark partition. The framework also clarifies a fundamental trade-off between robustness and sensitivity to cluster imbalance, leading to sharp phase transitions for exact recovery under different objectives. The guarantees are deterministic and non-asymptotic, and they separate the role of algorithmic accuracy from the intrinsic geometric difficulty of the instance. We further show that errors concentrate near cluster boundaries and that sufficiently deep cluster cores are recovered exactly under strengthened local margins. Together, these results provide a geometric principle for interpreting low objective values as reliable evidence of meaningful clustering structure.