Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

📅 2023-06-09
🏛️ arXiv.org
📈 Citations: 4
Influential: 0
📄 PDF
🤖 AI Summary
To address the insufficient robustness of multiclass classification arising from feature uncertainty, this paper proposes the Robust Two-Parameter Margin Support Vector Machine (TPMSVM). TPMSVM is the first to integrate robust optimization into the two-parameter margin SVM framework: it models input perturbations via a norm-bounded uncertainty set and derives a tractable convex quadratic programming formulation. The method supports both linear and kernel-based multiclass classification and introduces two theoretically sound, discriminative decision functions. Extensive experiments on multiple real-world benchmark datasets demonstrate that TPMSVM significantly outperforms conventional multiclass SVMs and state-of-the-art twin SVM variants in classification accuracy, noise resilience, and generalization stability. The approach thus achieves a rigorous theoretical foundation while maintaining strong practical effectiveness.
📝 Abstract
In this paper, we present novel Twin Parametric Margin Support Vector Machine (TPMSVM) models to tackle the problem of multiclass classification. We explore the cases of linear and nonlinear classifiers and propose two possible alternatives for the final decision function. Since real-world observations are plagued by measurement errors and noise, data uncertainties need to be considered in the optimization models. For this reason, we construct bounded-by-norm uncertainty sets around each sample and derive the robust counterpart of deterministic models by means of robust optimization techniques. Finally, we test the proposed TPMSVM methodology on real-world datasets, showing the good performance of the approach.
Problem

Research questions and friction points this paper is trying to address.

Develop robust multiclass Twin Parametric Margin SVM for uncertain features
Handle data perturbations via bounded-norm uncertainty sets
Provide linear and kernel classifiers with tractable robust formulations
Innovation

Methods, ideas, or system contributions that make the work stand out.

Novel Twin Parametric Margin SVM models
Robust optimization with bounded uncertainty sets
Linear and kernel-induced classifiers for flexibility
🔎 Similar Papers
No similar papers found.
R
R. Leone
School of Science and Technology, University of Camerino, Via Madonna delle Carceri 9, Camerino 62032, Italy
Francesca Maggioni
Francesca Maggioni
Full Professor of Operations Research and Optimization, University of Bergamo (ITALY)
Stochastic ProgrammingOperations ResearchMachine LearningTransportation and Logistics
A
Andrea Spinelli
Department of Management, Information and Production Engineering, University of Bergamo, Viale G. Marconi 5, Dalmine 24044, Italy