A Dual-Norm Support Vector Machine: Integrating L1 and L∞ Slack Penalties for Robust and Sparse Classification

This paper presents a novel support vector machine (SVM) classification approach that simultaneously accounts for both overall and extreme misclassification errors via a dual-norm regularization strategy. Traditional SVMs minimize the L1-norm of slack variables to control global misclassification, while least squares SVM (LSSVM) minimizes the sum of squared errors. In contrast, our method preserves the classical L1-norm penalty to maintain overall classification fidelity and incorporates an additional L∞-norm term to penalize the largest slack variable, thereby constraining the worst-case margin violation. This composite objective yields a more robust and generalizable classifier, particularly effective when occasional large deviations disproportionately affect decision boundaries. The resulting optimization problem minimizes a regularized objective combining the model norm, the sum of slack variables, and the maximum slack variable, with two hyperparameters, C1 and C2, balancing global error against extremal robustness. By formulating the problem under convex constraints, the optimization remains tractable and guarantees a globally optimal solution. Experimental evaluations on benchmark datasets demonstrate that the proposed method achieves comparable or superior classification accuracy while reducing the impact of outliers and maintaining a sparse model structure. These results underscore the advantage of jointly enforcing L1 and L∞ penalties, providing an effective mechanism to balance average performance with worst-case error sensitivity in support vector classification.

• Publication year

  2025

• Venue

  Processes

• Publication date

  2025-09-06

• Fields of study

  Not labeled

• Identifiers
  DOI 10.3390/pr13092858
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Improving SVM performance through data reduction and misclassification analysis with linear programming

  2025cited by this paper
• Generalized Adaptive Huber Loss Driven Robust Twin Support Vector Machine Learning Framework for Pattern Classification

  2025cited by this paper
• Multi-task Support Vector Machine Classifier with Generalized Huber Loss

  2024cited by this paper
• Distributionally robust chance-constrained kernel-based support vector machine

  2024cited by this paper
• Support vector machine classification of patients with depression based on resting-state electroencephalography

  2024cited by this paper
• A distance-based kernel for classification via Support Vector Machines

  2024cited by this paper
• Sparse least-squares Universum twin bounded support vector machine with adaptive Lp-norms and feature selection

  2024cited by this paper
• Sparse and robust support vector machine with capped squared loss for large-scale pattern classification

  2024cited by this paper
• Capped L2, p-Norm Metric Based on Robust Twin Support Vector Machine with Welsch Loss

  2023cited by this paper
• RoBoSS: A Robust, Bounded, Sparse, and Smooth Loss Function for Supervised Learning

  2023cited by this paper
• Robust support vector machine classifier with truncated loss function by gradient algorithm

  2022cited by this paper
• Robust and Distributionally Robust Optimization Models for Linear Support Vector Machine

  2022cited by this paper
• Distributionally robust joint chance-constrained support vector machines

  2022cited by this paper
• Fast truncated Huber loss SVM for large scale classification

  2022cited by this paper
• Capped L2, p-norm metric based robust least squares twin support vector machine for pattern classification

  2021cited by this paper
• Robust Support Vector Machine Training via Convex Outlier Ablation

  2006cited by this paper
• Core Vector Machines: Fast SVM Training on Very Large Data Sets

  2005cited by this paper
• Maximum Margin Clustering

  2004cited by this paper
• 1-norm Support Vector Machines

  2003cited by this paper
• Support vector machines: hype or hallelujah?

  2000cited by this paper
• Least Squares Support Vector Machine Classifiers

  1999cited by this paper
• Support-Vector Networks

  1995cited by this paper
• A training algorithm for optimal margin classifiers

  1992cited by this paper
• Least Squares Support Vector Machines

  year unknowncited by this paper

• No citing papers are available for this paper.