The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network

No abstract is available for this paper.

• Publication year

  1998

• Venue

  IEEE Transactions on Information Theory

• Publication date

  1998-03-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1109/18.661502
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• What Size Neural Network Gives Optimal Generalization? Convergence Properties of Backpropagation

  1998cited by this paper
• IEEE TRANSACTIONS ON INFORMATION THEORY

  1998cited by this paper
• Prediction, Learning, Uniform Convergence, and Scale-Sensitive Dimensions

  1998cited by this paper
• Structural Risk Minimization Over Data-Dependent Hierarchies

  1998influential reference
• Boosting the margin: A new explanation for the effectiveness of voting methods

  1997cited by this paper
• A decision-theoretic generalization of on-line learning and an application to boosting

  1997cited by this paper
• Covering numbers for real-valued function classes

  1997cited by this paper
• A Data-Dependent Skeleton Estimate and a Scale-Sensitive Dimension for Classification

  1997influential reference
• For Valid Generalization the Size of the Weights is More Important than the Size of the Network

  1996cited by this paper
• A Probabilistic Theory of Pattern Recognition

  1996cited by this paper
• A data-dependent skeleton estimate for learning

  1996cited by this paper
• Experiments with a New Boosting Algorithm

  1996cited by this paper
• A framework for structural risk minimisation

  1996cited by this paper
• Asymptotic distribution of the errors in scalar and vector quantizers

  1996cited by this paper
• Polynomial bounds for VC dimension of sigmoidal neural networks

  1995cited by this paper
• Characterizations of Learnability for Classes of {0, ..., n}-Valued Functions

  1995cited by this paper
• A Generalization of Sauer's Lemma

  1995cited by this paper
• Approximation and Learning of Convex Superpositions

  1995cited by this paper
• Function Learning from Interpolation

  1994cited by this paper
• Introduction to the theory of neural computation

  1994cited by this paper
• Probability Inequalities for Sums of Bounded Random Variables

  1994cited by this paper
• Bounding the Vapnik-Chervonenkis Dimension of Concept Classes Parameterized by Real Numbers

  1993cited by this paper
• A Result of Vapnik with Applications

  1993cited by this paper
• Scale-sensitive dimensions, uniform convergence, and learnability

  1993cited by this paper
• Universal approximation bounds for superpositions of a sigmoidal function

  1993cited by this paper
• Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications

  1992cited by this paper
• Feedforward Nets for Interpolation and Classification

  1992cited by this paper
• A training algorithm for optimal margin classifiers

  1992cited by this paper
• Automatic Capacity Tuning of Very Large VC-Dimension Classifiers

  1992cited by this paper
• A Simple Lemma on Greedy Approximation in Hilbert Space and Convergence Rates for Projection Pursuit Regression and Neural Network Training

  1992cited by this paper
• Efficient distribution-free learning of probabilistic concepts

  1990cited by this paper
• Learnability and the Vapnik-Chervonenkis dimension

  1989cited by this paper
• What Size Net Gives Valid Generalization?

  1989cited by this paper
• A general lower bound on the number of examples needed for learning

  1988cited by this paper
• Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities

  1971cited by this paper
• Approximation of Functions

  1965cited by this paper
• ON CONVERGENCE OF STOCHASTIC PROCESSES

  1962cited by this paper
• Entropy and "-capacity of sets in func-tional spaces

  1961cited by this paper
• Eecient Agnostic Learning of Neural Networks with Bounded Fan-in

  year unknowncited by this paper

• Penalizing Localized Dirichlet Energies in Low Rank Tensor Products

  2026cites this paper
• Theory of Structural Learning

  2026cites this paper
• Machine learning-based prediction of shear strength in interior beam-column joints

  2025cites this paper
• Machine Learning-Guided Design of Rhenium Tricarbonyl Complexes for Next-Generation Antibiotics

  2025cites this paper
• On the Upper Bounds of Number of Linear Regions and Generalization Error of Deep Convolutional Neural Networks

  2025cites this paper
• Probing a theoretical framework for a Photonic Extreme Learning Machine

  2025cites this paper
• Multisource and Hidden Source-Based Knowledge Transfer for Solving Dynamic Multiobjective Optimization Problems

  2025cites this paper
• Speeding Up CTR Prediction Models with Extreme Learning Machines

  2025cites this paper
• Support vector decision making

  2025cites this paper
• Comparative Analysis of ELM-Based Blind Image Quality Assessment with K-Fold Cross-Validation

  2025cites this paper
• A Novel Mechanism-Data Dual-Driven Fault Detection Model for Autonomous Ship Gearboxes

  2025cites this paper
• Tri-perspective Multi-view Classification

  2025cites this paper
• The generalization error of max-margin linear classifiers: Benign overfitting and high dimensional asymptotics in the overparametrized regime

  2025cites this paper
• Skin Cancer Detection and Classification Using Extreme Learning Machine

  2025cites this paper
• Asymptotic generalization error in the online learning of linearized two-layer neural networks

  2025cites this paper
• Extreme Learning Machines for the Heart Health Classification

  2025cites this paper
• The Geometry of ReLU Networks through the ReLU Transition Graph

  2025cites this paper
• Flexible Estimation of the Heterogeneous Non-Parametric Component in a Relative Survival Cure Model

  2025cites this paper
• Generalization Error Analysis for Selective State-Space Models Through the Lens of Attention

  2025cites this paper
• Adaptively Point-weighting Curriculum Learning

  2025cites this paper
• Informed Machine Learning: Excess risk and generalization

  2025cites this paper
• Time Series Pattern Matching Technique for Low-Energy Arrhythmia Classification in Implantable Cardiac Devices

  2024cites this paper
• Asymptotic generalization errors in the online learning of random feature models

  2024cites this paper
• Multivariate Time Series Forecasting By Graph Attention Networks With Theoretical Guarantees

  2024cites this paper
• Sequential Domain-Adaptation Extreme Learning Machine (ELM) Combined with Principle Component Analysis (PCA) for Process Fault Diagnosis

  2024cites this paper
• Learning to Guide Particle Search for Dynamic Multiobjective Optimization

  2024cites this paper
• Perceptual-based features for blind image quality assessment using extreme learning machine for biodiversity monitoring

  2024cites this paper
• A regularized orthogonal activated inverse-learning neural network for regression and classification with outliers

  2024cites this paper
• Reliability and Interpretability in Science and Deep Learning

  2024cites this paper
• Toward Cross-Dataset Finger Vein Recognition With Single-Source Data

  2024cites this paper
• Extreme Learning Machines for Fast Training of Click-Through Rate Prediction Models

  2024cites this paper
• Selective ensemble of doubly weighted fuzzy extreme learning machine for tumor classification

  2024cites this paper
• Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design

  2024influential citation
• Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression

  2024cites this paper
• Estimating the joint shear strength of exterior beam–column joints using artificial neural networks via experimental results

  2024cites this paper
• Extreme learning machine with incremental hidden layers

  2024cites this paper
• Evolutionary extreme learning machine based on an improved MOPSO algorithm

  2024cites this paper
• Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization

  2024cites this paper
• A Unified Multi-Class Feature Selection Framework for Microarray Data

  2023influential citation
• An extreme learning machine algorithm for semi-supervised classification of unbalanced data streams with concept drift

  2023cites this paper
• Extreme Learning Machine-based Genetic Algorithm for the facility location problem with distributed demands on network edges

  2023cites this paper
• An Enhanced Deep Learning Neural Network for the Detection and Identification of Android Malware

  2023cites this paper
• Battery State of Health Estimation Using Indirect Health Features of Temperature

  2023cites this paper
• Information Gain and Uniform Generalization Bounds for Neural Kernel Models

  2023cites this paper
• Toward Robust and Efficient Musculoskeletal Modeling Using Distributed Physics-Informed Deep Learning

  2023cites this paper
• Learning half-spaces on general infinite spaces equipped with a distance function

  2023cites this paper
• Delve Into Neural Activations: Toward Understanding Dying Neurons

  2023cites this paper
• Fault diagnosis method for transformer based on NCA and CapSA-RELM

  2023cites this paper
• Improving extreme learning machine model using deep learning feature extraction and grey wolf optimizer: Application to image classification

  2023cites this paper
• A Deep Neural Network Regularization Measure: The Class-Based Decorrelation Method

  2023cites this paper
• Subsampled Randomized Hadamard Transformation-based Ensemble Extreme Learning Machine for Human Activity Recognition

  2023cites this paper
• To grok or not to grok: Disentangling generalization and memorization on corrupted algorithmic datasets

  2023cites this paper
• To understand double descent, we need to understand VC theory

  2023cites this paper
• Evaluation of Liquefaction Potential of Soil Using Soft Computing Techniques

  2023cites this paper
• Hybrid unorganized machines to estimate the number of hospital admissions caused by PM $$_{10}$$ 10 concentration

  2023cites this paper
• A Hybrid Intelligent Modeling approach for predicting the solar thermal panel energy production

  2023cites this paper
• PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization

  2023cites this paper
• Adaptive Model Pruning and Personalization for Federated Learning Over Wireless Networks

  2023cites this paper
• The gap between theoretical computational theories and application models

  2023cites this paper
• ELM parameter estimation in view of maximum likelihood

  2023cites this paper
• Handwritten Digit Detection and Prototyping on Field Programmable Gate Array (FPGA)

  2023cites this paper
• Multi-Layer Neural Networks as Trainable Ladders of Hilbert Spaces

  2023cites this paper
• Evaluation of Extreme Learning Machines for Detecting Heart Diseases

  2023cites this paper
• Soft ascent-descent as a stable and flexible alternative to flooding

  2023cites this paper
• Federated Learning under Covariate Shifts with Generalization Guarantees

  2023cites this paper
• Double handed dynamic Turkish Sign Language recognition using Leap Motion with meta learning approach

  2023cites this paper
• Analysis of the Relative Entropy Asymmetry in the Regularization of Empirical Risk Minimization

  2023cites this paper
• Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space

  2023influential citation
• Gas path diagnosis method for gas turbine fusing performance analysis models and extreme learning machine

  2023cites this paper
• Learning broad learning system with controllable sparsity through L0 regularization

  2023cites this paper
• Estimating Flyrock Distance Induced Due to Mine Blasting by Extreme Learning Machine Coupled with an Equilibrium Optimizer

  2023cites this paper
• An integrated machine learning-based approach to identifying controlling factors of unconventional shale productivity

  2023cites this paper
• Liver Cancer Classification Using Single Pass Neural Networks Based on Ultrasound Images: A Review

  2023cites this paper
• Online Learning for the Random Feature Model in the Student-Teacher Framework

  2023cites this paper
• Broad Minimax Probability Learning System and its Application in Regression Modeling

  2023cites this paper
• AN ENHANCED DIFFERENTIAL EVOLUTION ALGORITHM WITH ADAPTIVE WEIGHT BOUNDS FOR EFFICIENT TRAINING OF NEURAL NETWORKS

  2023cites this paper
• Adaptive Federated Pruning in Hierarchical Wireless Networks

  2023cites this paper
• Online-to-PAC Conversions: Generalization Bounds via Regret Analysis

  2023cites this paper
• Computation and Communication Efficient Federated Learning over Wireless Networks

  2023cites this paper
• A comprehensive review of extreme learning machine on medical imaging

  2023cites this paper
• Nonparametric regression with modified ReLU networks

  2022cites this paper
• Beam Selection for RIS-Enabled Terahertz Multi-User MIMO Systems via Multi-Task Learning

  2022cites this paper
• SAFNet: A deep spatial attention network with classifier fusion for breast cancer detection

  2022cites this paper
• Toward Robust and Accurate Device-Free Localization in Cluttered Environments With Commodity WiFi Devices

  2022cites this paper
• The Effect of Manifold Entanglement and Intrinsic Dimensionality on Learning

  2022cites this paper
• Estimation of longitudinal aerodynamic parameters using recurrent neural network

  2022cites this paper
• Statistical Guarantees for Approximate Stationary Points of Simple Neural Networks

  2022cites this paper
• Ensemble wind speed prediction system based on envelope decomposition method and fuzzy inference evaluation of predictability

  2022cites this paper
• Differentially Private Learning with Margin Guarantees

  2022cites this paper
• Building Robust Ensembles via Margin Boosting

  2022influential citation
• Flat minima generalize for low-rank matrix recovery

  2022cites this paper
• On the Generalization Mystery in Deep Learning

  2022cites this paper
• Stability of regularized empirical risk minimization

  2022cites this paper
• Generalization Bounds via Convex Analysis

  2022cites this paper
• Surface electromyography classification using extreme learning machines and echo state networks

  2022cites this paper
• Spatiotemporal forecasting for dengue, chikungunya fever and Zika using machine learning and artificial expert committees based on meta-heuristics

  2022cites this paper
• Interpolation Problem on Outlier Contaminated Seismogram Using Extreme Learning Machine

  2022cites this paper
• Horizontal progressive and longitudinal leapfrogging fuzzy classification with feature activity adjustment

  2022cites this paper
• Adversarial robustness of sparse local Lipschitz predictors

  2022cites this paper
• Adult Skeletal Age-at-Death Estimation through Deep Random Neural Networks: A New Method and Its Computational Analysis

  2022cites this paper