Statistical Learning Theory

A machine learning system, in general, learns from the environment, but statistical machine learning programs (systems) learn from the data. This chapter presents techniques for statistical machine learning using Support Vector Machines (SVM) to recognize the patterns and classify them, predicting structured objects using SVM, k-nearest neighbor method for classification, and Naive Bayes classifiers. The artificial neural networks are presented with brief introduction to error-correction rules, Boltzmann learning, Hebbian rule, competitive learning rule, and deep learning. The instance-based learning is treated in details with its algorithm and learning task. The chapter concludes with a summary, and a set of practice exercises.

• Publication year

  2021

• Venue

  Technometrics

• Publication date

  2021-10-31

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1080/00401706.1999.10485951
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The Nature of Statistical Learning Theory

  2000cited by this paper
• Artificial Neural Networks: A Tutorial

  1996cited by this paper
• The basic ideas in neural networks

  1994cited by this paper
• A training algorithm for optimal margin classifiers

  1992cited by this paper
• Surveys in Combinatorics, 1989: On the method of bounded differences

  1989cited by this paper
• Necessary and Sufficient Conditions for the Uniform Convergence of Means to their Expectations

  1982cited by this paper
• A Branch and Bound Algorithm for Computing k-Nearest Neighbors

  1975cited by this paper
• On the Density of Families of Sets

  1972cited by this paper
• Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities

  1971cited by this paper
• A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations

  1952cited by this paper

• Environment-Conditioned Tail Reweighting for Total Variation Invariant Risk Minimization

  2026influential citation
• Bayesian Learning of (n,p) Reaction Cross Sections with Quantified Uncertainties

  2026cites this paper
• Uniform error bounds for quantized dynamical models

  2026cites this paper
• Impact of Different Kernels on Breast Cancer Severity Prediction Using Support Vector Machine

  2026cites this paper
• Adversarial Attack Resilient ML-Assisted Golden Free Approach for Hardware Trojan Detection

  2026cites this paper
• Integrating optimization and machine learning for estimating water resistivity and saturation in shaley sand reservoirs

  2026cites this paper
• AI-Driven Analysis of Saltwater Intrusion Vulnerability

  2026cites this paper
• Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities

  2026cites this paper
• Learning to Trust Experience: A Monitor-Trust-Regulator Framework for Learning under Unobservable Feedback Reliability

  2026cites this paper
• Estimation of the pan evaporation coefficient in semi-arid climate conditions via machines learning models

  2026cites this paper
• Sensitivity of hydrological machine learning prediction accuracy to information quantity and quality

  2026cites this paper
• Reproducing Kernel Hilbert Spaces and entropy Kolmogorov numbers on compact Lie Groups

  2026cites this paper
• Exploiting Class-agnostic Visual Prior for Few-shot Keypoint Detection

  2026cites this paper
• Interpretable Optimized Support Vector Machines for Predicting the Coal Gross Calorific Value Based on Ultimate Analysis for Energy Systems

  2026influential citation
• Local Duality for Sparse Support Vector Machines

  2026influential citation
• Robust Domain Generalization under Divergent Marginal and Conditional Distributions

  2026cites this paper
• The bliss of dimensionality: how an unsupervised criterion identifies optimal low-resolution representations of high-dimensional datasets

  2026cites this paper
• Testable Learning of General Halfspaces under Massart Noise

  2026cites this paper
• Negatives-Dominant Contrastive Learning for Generalization in Imbalanced Domains

  2026cites this paper
• Nowcasting CO2 emissions in Bangladesh: a machine learning approach

  2026cites this paper
• Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD

  2026cites this paper
• Interpreting and forecasting crop-specific irrigation water productivity in an arid irrigated area using explainable machine learning and scenario simulation

  2026cites this paper
• Hybrid Neural Networks vs. Econometric Models for Fresh Durian Export Value Forecasting: A Comparative Analysis

  2026cites this paper
• Leave-One-Out Prediction for General Hypothesis Classes

  2026cites this paper
• Pegasus: A Universal Framework for Scalable Deep Learning Inference on the Dataplane

  2025cites this paper
• On the Robust Nonparametric Regression Estimate in the Single Functional Index Model

  2025cites this paper
• Prognostics of internal short circuit in lithium-ion batteries — Literature survey and performance evaluation

  2025cites this paper
• Kernel Ridge Regression for conformer ensembles made easy with Structured Orthogonal Random Features

  2025cites this paper
• Statistical Estimation of Mean-Field Equilibria in a Class of Discounted Mean-Field Games

  2025influential citation
• Latent Diffusion Model Based Denoising Receiver for 6G Semantic Communication: From Stochastic Differential Theory to Application

  2025cites this paper
• FEDTAIL: Federated Long-Tailed Domain Generalization with Sharpness-Guided Gradient Matching

  2025cites this paper
• Rethinking Confidence Scores and Thresholds in Pseudolabeling-based SSL

  2025cites this paper
• Constructing Ensembles: A Diversity-Driven Approach with Correlation and Q-Statistics

  2025cites this paper
• Comparative assessment of classical and machine learning approaches for rainfall data restoration

  2025cites this paper
• Generalization Bounds and Stopping Rules for Learning with Self-Selected Data

  2025cites this paper
• Machine learning approach for estimating durability of modified bituminous mixes under wet-dry cycle condition

  2025cites this paper
• Generative AI-Driven Data Augmentation for Robust Virtual Metrology: GANs, VAEs, and Diffusion Models

  2025cites this paper
• Robust Multi-State EEG Cognitive Classification via Optimized Time-Domain Features and CatBoost

  2025cites this paper
• Benchmarking Pre-Trained Time Series Models for Electricity Price Forecasting

  2025cites this paper
• Automated Cancer Detection and Classification

  2025cites this paper
• Evaluation framework for Image Segmentation Algorithms

  2025cites this paper
• Mineral Prospectivity Modeling of Graphite Deposits and Occurrences in Canada

  2025cites this paper
• SVM-Based Approach For Human Face Detection And Recognition

  2025influential citation
• Class-Conditional Distribution Balancing for Group Robust Classification

  2025influential citation
• Research on inverter fan fouling faults diagnosis based on SVM

  2025cites this paper
• FrogDogNet: Fourier Frequency Retained Visual Prompt Output Guidance for Domain Generalization of CLIP in Remote Sensing

  2025cites this paper
• Risk Analysis and Design Against Adversarial Actions

  2025cites this paper
• SPARK: Simple and Parameter-Free Knowledge Embedding With Fuzzy Cognitive Maps for Class Incremental Learning

  2025cites this paper
• Fine-Grained Bias Exploration and Mitigation for Group-Robust Classification

  2025cites this paper
• Direct Density Ratio Optimization: A Statistically Consistent Approach to Aligning Large Language Models

  2025cites this paper
• Evaluating the Technology Acceptance of MundoCRA: A Virtual Learning Environment for Primary Education

  2025cites this paper
• Machine Learning Approached for Sophisticated Relay to Mitigate Blackouts in Power System

  2025cites this paper
• Robust Bayesian regression model in Bernstein form

  2025cites this paper
• Machine Learning-Driven Cost Prediction in Intermodal Logistics: A Case Study of Porto Romano

  2025cites this paper
• High-frequency-based multi-spectral attention for domain generalization

  2025influential citation
• Multiclass threshold-based classification and model evaluation

  2025cites this paper
• Review of methods for online power-distribution reconstruction

  2025cites this paper
• Comparing the Effectiveness of Machine Learning and Deep Learning Models in Student Credit Scoring: A Case Study in Vietnam

  2025cites this paper
• Sequential Sample Average Majorization–Minimization

  2025influential citation
• Adapting to Linear Separable Subsets with Large-Margin in Differentially Private Learning

  2025cites this paper
• Usage of the dwarf mongoose optimization-based ANFIS on the static strength of seasonally frozen soils

  2025cites this paper
• Electrocardiogram sequences data analytics and classification using unsupervised and supervised machine learning algorithms

  2025cites this paper
• Short-Term Predictions of Global Horizontal Irradiance Using Recurrent Neural Networks, Support Vector Regression, Gradient Boosting Random Forest and Advanced Stacking Ensemble Approaches

  2025cites this paper
• Glivenko-Cantelli for $f$-divergence

  2025cites this paper
• Fair Text Classification via Transferable Representations

  2025cites this paper
• One-Shot Polarization-Based Material Classification with Optimal Illumination

  2025cites this paper
• The Detection of Saccadic Eye Movements and Per-Eye Comparisons using Virtual Reality Eye Tracking Devices

  2025cites this paper
• Enhancing Price-To-Win Targeting with Value-Base Pricing: A Bayesian Network Approach

  2025cites this paper
• Short-Term Forecasting of Wind Power Plant Generation Based on Machine Learning Models

  2025cites this paper
• Verifying Classification with Limited Disclosure

  2025cites this paper
• AMC: Adaptive Learning Rate Adjustment Based on Model Complexity

  2025cites this paper
• An L2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$L_2$$\end{document} regularization reduced quadratic surface supp

  2025influential citation
• Forecasting Turkey’s Air Cargo Tonnage: A Comparative Analysis of Statistical Techniques and Machine Learning Methods

  2025cites this paper
• ExoMiner++: Enhanced Transit Classification and a New Vetting Catalog for 2-minute TESS Data

  2025cites this paper
• TP-ML: A Machine-Learning-Based Tool to Identify Threonine Proteases Using Sequence-Derived Optimal Features

  2025cites this paper
• MATS: An Audio Language Model under Text-only Supervision

  2025cites this paper
• Trustworthy AI: Safety, Bias, and Privacy -- A Survey

  2025cites this paper
• Machine Learning with Evolutionary Parameter Tuning for Singing Registers Classification

  2025cites this paper
• Domain generalization and punch mark classification

  2025cites this paper
• Generalization Bounds for Equivariant Networks on Markov Data

  2025cites this paper
• Unknown Support Prototype Set for Open Set Recognition

  2025cites this paper
• Recursive Estimation for Dynamical Systems with Measurement Bias, Outliers and Constraints

  2025cites this paper
• Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching

  2025cites this paper
• Automatic Focusing Remote Laser-Induced Breakdown Spectroscopy Analysis of Trace Elements in Steel Using Support Vector Machine Regression

  2025cites this paper
• Assessing Machine Learning Models on Temporal and Multi‐Sensor Data for Mapping Flooded Areas

  2025cites this paper
• Test-Time Domain Generalization via Universe Learning: A Multi-Graph Matching Approach for Medical Image Segmentation

  2025cites this paper
• Prediction and Explainable Analysis of Molecular Weight Distribution of Polystyrene Based on Machine Learning and SHAP

  2025cites this paper
• Deep Learning-Based River Flow Forecasting with MLPs: Comparative Exploratory Analysis Applied to the Tejo and the Mondego Rivers

  2025cites this paper
• From black box AI to XAI in neuro-oncology: a survey on MRI-based tumor detection

  2025cites this paper
• Entropy difference-based EEG channel selection technique for automated detection of ADHD

  2025cites this paper
• Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling

  2025cites this paper
• Unsupervised Classification of English Words Based on Phonological Information: Discovery of Germanic and Latinate Clusters

  2025cites this paper
• On the Convergence of Irregular Sampling in Reproducing Kernel Hilbert Spaces

  2025cites this paper
• Challenges and Opportunities for Statistics in the Era of Data Science

  2025cites this paper
• Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environments

  2025influential citation
• Molecular Similarity in Machine Learning of Energies in Chemical Reaction Networks

  2025cites this paper
• Detection of Agricultural Terraces Platforms Using Machine Learning from Orthophotos and LiDAR-Based Digital Terrain Model: A Case Study in Roya Valley of Southeast France

  2025cites this paper
• Categorical and geometric methods in statistical, manifold, and machine learning

  2025influential citation
• Rainfall thresholds of debris flows built with assistance of artificial intelligence in a small catchment

  2025cites this paper
• Robust Reward Alignment via Hypothesis Space Batch Cutting

  2025influential citation