🤖 AI Summary
This study systematically evaluates the practical utility of Kolmogorov–Arnold Networks (KANs) relative to Multilayer Perceptrons (MLPs) for structured data classification tasks. Under unified preprocessing, architectural design, and hyperparameter settings, a standardized comparison is conducted across twelve publicly available datasets encompassing binary, multiclass, multilabel, and ordinal classification scenarios. Performance is assessed using accuracy, F1 scores, hypothesis testing, and Cohen’s d effect sizes. Results demonstrate that KANs significantly outperform MLPs on most tasks, with a moderate average effect size (d = −0.46), albeit at the cost of higher computational overhead and parameter count. This work presents the first rigorous empirical comparison between KANs and MLPs across diverse structured classification tasks and offers practical guidelines for architecture selection based on accuracy requirements and resource constraints.
📝 Abstract
This study presents an empirical benchmarking comparison between Kolmogorov-Arnold Networks (KANs) and Multi-Layer Perceptrons (MLPs) on structured tabular classification tasks. Motivated by the growing interest in KANs as an alternative function-approximating architecture, we evaluate their out-of-the-box performance on twelve publicly available datasets spanning binary, multiclass, multilabel, and ordinal problems. Both models were trained under standardized preprocessing, architecture, and fixed hyperparameter settings, with performance assessed using test accuracy and F1-Score, paired hypothesis testing, and effect size analysis. Results show that KANs statistically outperform MLPs in binary and multiclass domains and achieve a significant aggregate advantage across all datasets. However, the observed medium effect size (d = -0.46) raises an important cost-benefit consideration: while KANs offer superior generalization through adaptive spline-based mappings, this advantage comes with substantially higher parameter and computational complexity relative to the MLP baseline. These findings suggest KANs are the preferred choice for high-precision applications, while MLPs remain a robust and efficient option for resource-constrained environments. Future work should extend this analysis to additional data modalities to further refine these architectural selection criteria.