Laplacian Support Vector Machines Trained in the Primal

In the last few years, due to the growing ubiquity of unlabeled data, much effort has been spent by the machine learning community to develop better understanding and improve the quality of classifiers exploiting unlabeled data. Following the manifold regularization approach, Laplacian Support Vector Machines (LapSVMs) have shown the state of the art performance in semi-supervised classification. In this paper we present two strategies to solve the primal LapSVM problem, in order to overcome some issues of the original dual formulation. In particular, training a LapSVM in the primal can be efficiently performed with preconditioned conjugate gradient. We speed up training by using an early stopping strategy based on the prediction on unlabeled data or, if available, on labeled validation examples. This allows the algorithm to quickly compute approximate solutions with roughly the same classification accuracy as the optimal ones, considerably reducing the training time. The computational complexity of the training algorithm is reduced from O(n3) to O(kn2), where n is the combined number of labeled and unlabeled examples and k is empirically evaluated to be significantly smaller than n. Due to its simplicity, training LapSVM in the primal can be the starting point for additional enhancements of the original LapSVM formulation, such as those for dealing with large data sets. We present an extensive experimental evaluation on real world data showing the benefits of the proposed approach.

• Publication year

  2009

• Venue

  Journal of machine learning research

• Publication date

  2009-09-29

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.5555/1953048.2021038arXiv 0909.5422
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Semi-Supervised Learning

  2019cited by this paper
• Introduction to Semi-Supervised Learning

  2009cited by this paper
• WITCH: A NEW APPROACH TO WEB SPAM DETECTION

  2008cited by this paper
• Optimization Techniques for Semi-Supervised Support Vector Machines

  2008cited by this paper
• Trust Region Newton Method for Logistic Regression

  2008cited by this paper
• An RKHS for multi-view learning and manifold co-regularization

  2008influential reference
• Trust region Newton methods for large-scale logistic regression

  2007cited by this paper
• Large-scale RLSC learning without agony

  2007cited by this paper
• Training a Support Vector Machine in the Primal

  2007influential reference
• On semi-supervised kernel methods

  2007cited by this paper
• Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples

  2006influential reference
• Training linear SVMs in linear time

  2006cited by this paper
• Large-Scale Sparsified Manifold Regularization

  2006cited by this paper
• Building Support Vector Machines with Reduced Classifier Complexity

  2006cited by this paper
• Towards a theoretical foundation for Laplacian-based manifold methods

  2005cited by this paper
• Optimization approaches for semi-supervised learning

  2005cited by this paper
• Working Set Selection Using Second Order Information for Training Support Vector Machines

  2005cited by this paper
• Beyond the point cloud: from transductive to semi-supervised learning

  2005cited by this paper
• A Modified Finite Newton Method for Fast Solution of Large Scale Linear SVMs

  2005cited by this paper
• Low Rank Updates for the Cholesky Decomposition

  2004cited by this paper
• Transductive Learning via Spectral Graph Partitioning

  2003cited by this paper
• Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions

  2003cited by this paper
• A finite newton method for classification

  2002cited by this paper
• Cluster Kernels for Semi-Supervised Learning

  2002cited by this paper
• Using Manifold Stucture for Partially Labeled Classification

  2002cited by this paper
• The Nature of Statistical Learning Theory

  2000cited by this paper
• Transductive Inference for Text Classification using Support Vector Machines

  1999cited by this paper
• An Introduction to the Conjugate Gradient Method Without the Agonizing Pain

  1994influential reference
• Mathematical Programming manuscript No. (will be inserted by the editor) Pegasos: Primal Estimated sub-GrAdient SOlver for SVM

  year unknowncited by this paper
• c ○ 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. Training Invariant Support Vector Machines

  year unknowncited by this paper

• GULSTSVM: A fusion of graph information and universum learning in twin SVM

  2026cites this paper
• An accuracy-privacy optimization framework considering user’s privacy requirements for data stream mining

  2025cites this paper
• A New Manifold Learning Based Algorithm LapRegOSVM for Wine NIRS Classification

  2025cites this paper
• Robust feature enhanced deep kernel support vector machine via low rank representation and clustering

  2025cites this paper
• Semi supervised K–SVCR for multi-class classification

  2024cites this paper
• Semi-supervised learning with Deep Laplacian Support Vector Machine

  2024cites this paper
• A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networks

  2024cites this paper
• Machine learning classification approaches to optimize ROP and TOB using drilling and geomechanical parameters in a carbonate reservoir

  2024cites this paper
• Mixed-Integer Linear Optimization for Semi-Supervised Optimal Classification Trees

  2024cites this paper
• Diffusion-based Semi-supervised Spectral Algorithm for Regression on Manifolds

  2024influential citation
• Conditional Generative Adversarial Net based Feature Extraction along with Scalable Weakly Supervised Clustering for Facial Expression Classification

  2024cites this paper
• SeDPGK: Semi-supervised software defect prediction with graph representation learning and knowledge distillation

  2024cites this paper
• Exploring Kernel Machines and Support Vector Machines: Principles, Techniques, and Future Directions

  2024cites this paper
• An Improved Semi-Supervised Learning Algorithm Used for Classification Prediction

  2024cites this paper
• A semi-supervised multiscale generalized-VAE framework for one-class classification

  2024cites this paper
• Mixed-integer linear optimization for cardinality-constrained random forests

  2024cites this paper
• Estimating Average Vehicle Mileage for Various Vehicle Classes Using Polynomial Models in Deep Classifiers

  2024cites this paper
• A new perspective on optimizers: leveraging moreau-yosida approximation in gradient-based learning

  2024cites this paper
• Semi-supervised learning using constrained laplacian regularized least squares

  2024cites this paper
• Efficient graph-based spectral techniques for data with few labeled samples

  2023cites this paper
• Multiclass Laplacian support vector machine with functional analysis of variance decomposition

  2023cites this paper
• A generalized adaptive robust distance metric driven smooth regularization learning framework for pattern recognition

  2023cites this paper
• Improving SVM Performance for Type II Diabetes Prediction with an Improved Non-Linear Kernel: Insights from the PIMA Dataset

  2023cites this paper
• Local Discriminative Embedding Broad Learning System With Graph Convolutional for Hyperspectral Image Classification

  2023cites this paper
• LORD: Leveraging Open-Set Recognition with Unknown Data

  2023cites this paper
• Identification of coal structures by semi-supervised learning based on limited labeled logging data

  2023cites this paper
• Persistent Laplacian-enhanced algorithm for scarcely labeled data classification

  2023cites this paper
• STOCHASTIC SMOOTHING ACCELERATED GRADIENT METHOD FOR NONSMOOTH CONVEX COMPOSITE OPTIMIZATION

  2023cites this paper
• Similarity graph-based max-flow and duality approaches for semi-supervised data classification and image segmentation

  2023cites this paper
• Driving Style Feature Extraction and Recognition Based on Hyperdimensional Computing and Semi-Supervised Twin Projection Vector Machine

  2023cites this paper
• Laplacian generalized elastic net Lp-norm nonparallel support vector machine for semi-supervised classification

  2023cites this paper
• Mixed-integer quadratic optimization and iterative clustering techniques for semi-supervised support vector machines

  2023cites this paper
• Laplacian Twin Support Vector Machine With Pinball Loss for Semi-Supervised Classification

  2023cites this paper
• Robust and Uncertainty-Aware VAE (RU-VAE) for One-Class Classification

  2022cites this paper
• Lagrangian Regularized Twin Extreme Learning Machine for Supervised and Semi-Supervised Classification

  2022cites this paper
• A Semi-supervised Generalized VAE Framework for Abnormality Detection using One-Class Classification

  2022cites this paper
• Exploring Latent Sparse Graph for Large-Scale Semi-supervised Learning

  2022cites this paper
• LP-MLTSVM: Laplacian Multi-Label Twin Support Vector Machine for Semi-Supervised Classification

  2022cites this paper
• A Framework for Distributed Semi-supervised Learning Using Single-layer Feedforward Networks

  2022cites this paper
• Enhanced semi‐supervised ensemble machine learning approach for earthwork construction simulation activity sequence automatically updating driven by weather data

  2022cites this paper
• Prototype Regularized Manifold Regularization Technique for Semi-Supervised Online Extreme Learning Machine

  2022cites this paper
• Understanding, Exploiting and Improving Inter-view Relationships

  2022cites this paper
• Modelling New Crop Disease Indices for Crop Species Classification using Restructured Convolution Neural Network on hyperspectral Satellite images

  2022cites this paper
• Laplacian Lp norm least squares twin support vector machine

  2022cites this paper
• A kernel-free Laplacian quadratic surface optimal margin distribution machine with application to credit risk assessment

  2022cites this paper
• Laplacian large margin distribution machine for semi-supervised classification

  2021influential citation
• Texture feature extraction and optimization of facial expression based on weakly supervised clustering

  2021cites this paper
• Mini-batch stochastic Nesterov's smoothing method for constrained convex stochastic composite optimization

  2021cites this paper
• Segment-based CO2 Emission Evaluations from Passenger Cars based on Deep Learning Techniques

  2021cites this paper
• Generalized Variant Support Vector Machine

  2021cites this paper
• Interpretable Semisupervised Classification Method Under Multiple Smoothness Assumptions With Application to Lithology Identification

  2021cites this paper
• A semi-supervised linear-nonlinear prediction system for tumbler strength of iron ore sintering process with imbalanced data in multiple working modes

  2021cites this paper
• Transfer of semi-supervised broad learning system in electroencephalography signal classification

  2021influential citation
• Semi-Supervised Multi-Modal Clustering and Classification with Incomplete Modalities

  2021cites this paper
• A Laplacian SVM Based Semi‐Supervised Classification Using Multi‐Local Linear Model

  2021cites this paper
• Hessian Semisupervised Scatter Regularized Classification Model With Geometric and Discriminative Information for Nonlinear Process

  2021cites this paper
• Robust Vehicle Classification Based on Deep Features Learning

  2021cites this paper
• An Integrated Deep Network for Cancer Survival Prediction Using Omics Data

  2021cites this paper
• On Regularization Based Twin Support Vector Regression with Huber Loss

  2021cites this paper
• Learning performance of LapSVM based on Markov subsampling

  2021cites this paper
• Diffusion bank networks and capital flows

  2021cites this paper
• A survey on data‐efficient algorithms in big data era

  2021cites this paper
• Acoustic emission and machine learning for in situ monitoring of a gold–copper ore weakening by electric pulse

  2021influential citation
• Multiscale laplacian learning

  2021cites this paper
• MKEL: Multiple Kernel Ensemble Learning via Unified Ensemble Loss for Image Classification

  2021influential citation
• Adaptive Laplacian Support Vector Machine for Semi-supervised Learning

  2021cites this paper
• Extreme semi-supervised learning for multiclass classification

  2020cites this paper
• Semi-supervised learning for lithology identification using Laplacian support vector machine

  2020cites this paper
• Domain Knowledge Alleviates Adversarial Attacks in Multi-Label Classifiers

  2020cites this paper
• Kernelized Constrained Gaussian Fields and Harmonic Functions for Semi-supervised Learning

  2020cites this paper
• Introduction

  2020cites this paper
• Fisher-regularized supervised and semi-supervised extreme learning machine

  2020cites this paper
• Classifying Limited Resource Data Using Semi-supervised SVM

  2020cites this paper
• Artificial Intelligence for Monitoring and Control of Metal Additive Manufacturing

  2020cites this paper
• Regularized correntropy criterion based semi-supervised ELM

  2020cites this paper
• A Review on Driver Distraction Detection Methods

  2020cites this paper
• Correntropy induced loss based sparse robust graph regularized extreme learning machine for cancer classification

  2020cites this paper
• Multi-view semi-supervised least squares twin support vector machines with manifold-preserving graph reduction

  2020cites this paper
• General multi-view semi-supervised least squares support vector machines with multi-manifold regularization

  2020cites this paper
• A semisupervised classifier based on piecewise linear regression model using gated linear network

  2020cites this paper
• Deep Lagrangian Constraint-based Propagation in Graph Neural Networks

  2020cites this paper
• Fast Semisupervised Learning With Bipartite Graph for Large-Scale Data

  2020influential citation
• Adversarial Autoencoder and Multi-Task Semi-Supervised Learning for Multi-stage Process

  2020influential citation
• Deep Constraint-Based Propagation in Graph Neural Networks

  2020cites this paper
• Laplacian Support Vector Machine for Vibration-Based Robotic Terrain Classification

  2020cites this paper
• Neural network with multiple connection weights

  2020cites this paper
• Regularization on a rapidly varying manifold

  2020cites this paper
• Supervised and semi-supervised twin parametric-margin regularized extreme learning machine

  2020cites this paper
• Semisupervised learning based on nuclear norm regularization

  2020cites this paper
• Can Domain Knowledge Alleviate Adversarial Attacks in Multi-Label Classifiers?

  2020influential citation
• Theoretical basis of machine learning

  2020cites this paper
• Fracture identification by semi-supervised learning using conventional logs in tight sandstones of Ordos Basin, China

  2020cites this paper
• Semi-Supervised Robust Mixture Models in RKHS for Abnormality Detection in Medical Images

  2020influential citation
• Mining Functionally Related Genes with Semi-Supervised Learning

  2020cites this paper
• SAR image processing based on similarity measures and discriminant feature learning

  2020cites this paper
• Intelligently modeling, detecting, and scheduling elephant flows in software defined energy cloud: A survey

  2020cites this paper
• A semi-supervised Laplacian extreme learning machine and feature fusion with CNN for industrial superheat identification

  2020cites this paper
• Semi-supervised Learning Algorithm Based on Linear Lie Group for Imbalanced Multi-class Classification

  2020cites this paper
• Metric-Based Semi-Supervised Regression

  2020cites this paper
• Multiple Kernel Learning via Ensemble Artifice in Reproducing Kernel Hilbert Space

  2020cites this paper