Risk bounds for model selection via penalization

No abstract is available for this paper.

• Publication year

  1999

• Venue

  Probability Theory and Related Fields

• Publication date

  1999-02-28

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1007/S004400050210
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Statistical Decision Rules and Optimal Inference

  2000cited by this paper
• Model selection for regression on a fixed design

  2000influential reference
• Minimum contrast estimators on sieves: exponential bounds and rates of convergence

  1998influential reference
• Minimax estimation via wavelet shrinkage

  1998cited by this paper
• Fitting Equations to Data

  1998cited by this paper
• From Model Selection to Adaptive Estimation

  1997influential reference
• Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors

  1997cited by this paper
• New concentration inequalities in product spaces

  1996influential reference
• Random Approximants and Neural Networks

  1996cited by this paper
• Minimum complexity regression estimation with weakly dependent observations

  1996cited by this paper
• Density estimation by wavelet thresholding

  1996cited by this paper
• Isoperimetry and Gaussian analysis

  1996cited by this paper
• Adapting to Unknown Smoothness via Wavelet Shrinkage

  1995influential reference
• Sphere Packing Numbers for Subsets of the Boolean n-Cube with Bounded Vapnik-Chervonenkis Dimension

  1995influential reference
• Wavelet Shrinkage: Asymptopia?

  1995cited by this paper
• Sup-norm approximation bounds for networks through probabilistic methods

  1995cited by this paper
• Ideal spatial adaptation by wavelet shrinkage

  1994cited by this paper
• Minimax risk overlp-balls forlp-error

  1994cited by this paper
• Ideal denoising in an orthonormal basis chosen from a library of bases

  1994influential reference
• An asymptotic property of model selection criteria

  1994cited by this paper
• Sharper Bounds for Gaussian and Empirical Processes

  1994cited by this paper
• Convergence rates for single hidden layer feedforward networks

  1994cited by this paper
• The Use of Polynomial Splines and Their Tensor Products in Multivariate Function Estimation

  1994cited by this paper
• Degree of Approximation Results for Feedforward Networks Approximating Unknown Mappings and Their Derivatives

  1994cited by this paper
• Universal approximation bounds for superpositions of a sigmoidal function

  1993influential reference
• Hinging hyperplanes for regression, classification, and function approximation

  1993cited by this paper
• Adaptive Spline Estimates for Nonparametric Regression Models

  1993influential reference
• Minimax theory of image reconstruction

  1993cited by this paper
• Rates of convergence for minimum contrast estimators

  1993cited by this paper
• Asymptotically minimax adaptive estimation. II: Schemes without optimal adaptation: adaptive estimators

  1993cited by this paper
• Estimating the density support and its functionals

  1993cited by this paper
• Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates

  1992cited by this paper
• Estimation d'une densité de probabilité par méthode d'ondelettes

  1992cited by this paper
• A Simple Lemma on Greedy Approximation in Hilbert Space and Convergence Rates for Projection Pursuit Regression and Neural Network Training

  1992cited by this paper
• Convergence Rates of Approximation by Translates

  1992cited by this paper
• Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications

  1992cited by this paper
• APPROXIMATION OF DENSITY FUNCTIONS BY SEQUENCES OF EXPONENTIAL FAMILIES

  1991cited by this paper
• Minimum complexity density estimation

  1991influential reference
• Asymptotic Optimality of the $C_p$-Test for the Orthogonal Series Estimation of Regression

  1991cited by this paper
• Estimating a Regression Function

  1990cited by this paper
• Large-Sample Inference for Log-Spline Models

  1990cited by this paper
• The volume of convex bodies and Banach space geometry

  1989cited by this paper
• Approximation of Least Squares Regression on Nested Subspaces

  1988cited by this paper
• Cross—validation and the smoothing of orthogonal series density estimators

  1987influential reference
• Asymptotic Optimality for $C_p, C_L$, Cross-Validation and Generalized Cross-Validation: Discrete Index Set

  1987cited by this paper
• On estimating a density using Hellinger distance and some other strange facts

  1986influential reference
• Nonparametric Estimation of a Density of Unknown Smoothness

  1986cited by this paper
• Asymptotic Methods In Statistical Decision Theory

  1986cited by this paper
• New Ways to Prove Central Limit Theorems

  1985cited by this paper
• A Sieve Method for the Spectral Density

  1985cited by this paper
• An Asymptotically Optimal Window Selection Rule for Kernel Density Estimates

  1984cited by this paper
• Approximation dans les espaces métriques et théorie de l'estimation

  1983influential reference
• A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH

  1983cited by this paper
• Deux remarques sur l'estimation

  1983cited by this paper
• Large Sample Optimality of Least Squares Cross-Validation in Density Estimation

  1983influential reference
• On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method

  1982cited by this paper
• An optimal selection of regression variables

  1981cited by this paper
• Spline Functions: Basic Theory

  1981cited by this paper
• Multidimensional Spline Approximation

  1980cited by this paper
• Modeling By Shortest Data Description*

  1978cited by this paper
• Estimating the Dimension of a Model

  1978cited by this paper
• Central Limit Theorems for Empirical Measures

  1978cited by this paper
• Convergence of Estimates Under Dimensionality Restrictions

  1973cited by this paper
• Fitting Equations to Data.

  1973cited by this paper
• Information Theory and an Extension of the Maximum Likelihood Principle

  1973influential reference
• Introduction to Fourier Analysis on Euclidean Spaces.

  1971cited by this paper
• Information Theory and Reliable Communication

  1968cited by this paper
• The behavior of maximum likelihood estimates under nonstandard conditions

  1967cited by this paper
• PIECEWISE-POLYNOMIAL APPROXIMATIONS OF FUNCTIONS OF THE CLASSES $ W_{p}^{\alpha}$

  1967cited by this paper
• A Course of Modern Analysis

  year unknowncited by this paper

• The Hellinger bounds on the Kullback–Leibler divergence and the Bernstein norm

  2026influential citation
• Fast variable selection under ℓ0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\ell _0$$\end{document} regularization

  2026cites this paper
• Some recent developments on functional data analysis

  2025cites this paper
• Adaptive Density Estimation Using Projection Kernels and Penalized Comparison to Overfitting

  2025cites this paper
• Concentration inequalities and cut-off phenomena for penalized model selection within a basic Rademacher framework

  2025cites this paper
• Mallows-type model averaging: Non-asymptotic analysis and all-subset combination

  2025cites this paper
• Optimal Recovery Meets Minimax Estimation

  2025cites this paper
• A nonparametric Bayesian analysis of independent and identically distributed observations of covariate-driven Poisson processes

  2025influential citation
• Minimax rates of convergence for the nonparametric estimation of the diffusion coefficient from time-homogeneous SDE paths

  2025cites this paper
• A model-based approach to density estimation in sup-norm

  2025influential citation
• Adaptive Nonparametric Estimation via Kernel Transport on Group Orbits: Oracle Inequalities and Minimax Rates

  2025cites this paper
• Non parametric estimation of the jump coefficient of a diffusion with jumps

  2025cites this paper
• Introducing RobustiPy: An efficient next generation multiversal library with model selection, averaging, resampling, and explainable artificial intelligence

  2025cites this paper
• Interrogating the inflation-corruption nexus for Sub-Saharan African (SSA) countries: The case of Ghana

  2025cites this paper
• Privately Learning Smooth Distributions on the Hypercube by Projections

  2024cites this paper
• Variable importance based interaction modelling with an application on initial spread of COVID-19 in China

  2024cites this paper
• The performance of restricted AIC for irregular histogram models

  2024cites this paper
• Estimating Double Sparse Structures Over ℓu(ℓq) -Balls: Minimax Rates and Phase Transition

  2024cites this paper
• Hermite regression estimation in noisy convolution model

  2024cites this paper
• Heavy-tailed Bayesian nonparametric adaptation

  2024cites this paper
• DirMixE: Harnessing Test Agnostic Long-Tail Recognition With Hierarchical Label Vartiations

  2024cites this paper
• Quadratic functional estimation from observations with multiplicative measurement error

  2024influential citation
• Nonparametric spectral density estimation under local differential privacy

  2024cites this paper
• To understand double descent, we need to understand VC theory

  2023cites this paper
• Generalization in diffusion models arises from geometry-adaptive harmonic representation

  2023cites this paper
• Understanding best subset selection: A tale of two c(omplex)ities

  2023cites this paper
• PanIC: Consistent information criteria for general model selection problems

  2023cites this paper
• On Optimality of Mallows Model Averaging

  2023influential citation
• Multiplicative deconvolution under unknown error distribution

  2023cites this paper
• Inconsistency of cross-validation for structure learning in Gaussian graphical models

  2023cites this paper
• Tale of two c(omplex)ities

  2023cites this paper
• Variable selection in linear regression models: Choosing the best subset is not always the best choice

  2023cites this paper
• Convergence Rates of a Class of Multivariate Density Estimation Methods Based on Adaptive Partitioning

  2023influential citation
• Information criteria for model selection

  2023cites this paper
• Robust statistical signal processing in semi-Markov nonparametric regression models

  2023cites this paper
• Density estimation under local differential privacy and Hellinger loss

  2023cites this paper
• Nonparametric multiple regression by projection on non-compactly supported bases

  2023cites this paper
• Nonparametric estimation of the diffusion coefficient from i.i.d. S.D.E. paths

  2023influential citation
• A proof of consistency and model-selection optimality on the empirical Bayes method

  2022cites this paper
• Minimax Rates for High-dimensional Double Sparse Structure over $\ell_u(\ell_q)$-balls

  2022cites this paper
• of the Bernoulli Society for Mathematical Statistics and Probability Volume Twenty Eight Number Two May 2022

  2022cites this paper
• L0-Regularized Learning for High-Dimensional Additive Hazards Regression

  2022cites this paper
• Adaptive nonparametric estimation in the functional linear model with functional output

  2022cites this paper
• Estimating a regression function in exponential families by model selection

  2022influential citation
• Sequential nonparametric estimation of controlled multivariate regression

  2022cites this paper
• Adaptive and efficient estimation in the Gaussian sequence model

  2022cites this paper
• A cross-validation framework for signal denoising with applications to trend filtering, dyadic CART and beyond

  2022cites this paper
• Minimax Rates for High-dimensional Double Sparse Structure over ℓ q -balls

  2022cites this paper
• Estimating a density, a hazard rate, and a transition intensity via the ρ-estimation method

  2021cites this paper
• Topologically penalized regression on manifolds

  2021cites this paper
• When Choosing the Best Subset Is Not the Best Choice

  2021cites this paper
• The Linear Functional Strategy for Maneuvers Identification Using Elastic Template Matching

  2021cites this paper
• Estimator Selection

  2021cites this paper
• Robust High-Dimensional Regression with Coefficient Thresholding and Its Application to Imaging Data Analysis

  2021cites this paper
• Modality Agnostic Model for Spatial Resolution in Mass Spectrometry Imaging: Application to MALDI MSI Data.

  2021cites this paper
• Data-driven aggregation in circular deconvolution

  2021influential citation
• On robust learning in the canonical change point problem under heavy tailed errors in finite and growing dimensions

  2021cites this paper
• of the Bernoulli Society for Mathematical Statistics and Probability Volume Twenty Seven Number Four November 2021

  2021cites this paper
• Fundamental Limits in Model Selection for Modern Data Analysis

  2021cites this paper
• Drift estimation on non compact support for diffusion models

  2021influential citation
• Oracle posterior contraction rates under hierarchical priors

  2021cites this paper
• Gibbs posterior inference on a Levy density under discrete sampling

  2021influential citation
• MODEL SELECTION FOR REGRESSION ON A RANDOM

  2021cites this paper
• Graph signal denoising using $t$-shrinkage priors

  2020cites this paper
• Sequential Estimation for Non‐parametric Autoregressive Models

  2020cites this paper
• A Look at Robustness and Stability of 1-versus 0-Regularization : Discussion of Papers by Bertsimas et al . and Hastie et al .

  2020cites this paper
• Inconsistency of Classical Penalized Likelihood Approaches under Endogeneity

  2020influential citation
• The Art of BART: Minimax Optimality over Nonhomogeneous Smoothness in High Dimension

  2020influential citation
• SET STRUCTURED GLOBAL EMPIRICAL RISK MINIMIZERS ARE RATE OPTIMAL IN GENERAL DIMENSIONS

  2020cites this paper
• Adaptive density estimation on bounded domains under mixing conditions

  2020cites this paper
• Measure Theoretic Approach to Nonuniform Learnability

  2020cites this paper
• On Statistical Efficiency in Learning

  2020cites this paper
• The art of BART: On flexibility of Bayesian forests

  2020influential citation
• Convergence Rates of Empirical Bayes Posterior Distributions: A Variational Perspective

  2020cites this paper
• When is best subset selection the "best"?

  2020cites this paper
• Bayesian context trees: Modelling and exact inference for discrete time series

  2020cites this paper
• Domain Adaptive Bootstrap Aggregating

  2020cites this paper
• Discussion on: Sparse regression: Scalable algorithms and empirical performance & Best Subset, Forward Stepwise, or Lasso? Analysis and recommendations based on extensive comparisons

  2020cites this paper
• Best subset selection is robust against design dependence

  2020cites this paper
• Adaptive spectral density estimation by model selection under local differential privacy

  2020cites this paper
• On Suboptimality of Least Squares with Application to Estimation of Convex Bodies

  2020cites this paper
• Robust feature screening procedures for single and mixed types of data

  2020cites this paper
• High-throughput and efficient multilocus genome-wide association study on longitudinal outcomes

  2020cites this paper
• An adaptive wavelet packet denoising algorithm for enhanced active acoustic damage detection from wind turbine blades

  2020cites this paper
• Statistical inference in high-dimensional matrix models

  2020cites this paper
• ncHMR detector: a computational framework to systematically reveal non-classical functions of histone modification regulators

  2020cites this paper
• Non-asymptotic oracle inequalities for the Lasso in high-dimensional mixture of experts

  2020cites this paper
• Data-driven aggregation in non-parametric density estimation on the real line

  2020cites this paper
• On a Phase Transition in General Order Spline Regression

  2020cites this paper
• Minimax bounds for Besov classes in density estimation

  2020cites this paper
• VARIABLE SELECTION AND ESTIMATION IN MULTIVARIATE FUNCTIONAL LINEAR REGRESSION VIA THE LASSO

  2019influential citation
• Nonparametric Statistics

  2019cites this paper
• Sharp adaptive estimation in sup-norm for d-dimensional Hölder classes

  2019influential citation
• Optimal estimation of variance in nonparametric regression with random design

  2019cites this paper
• Lasso in infinite dimension: application to variable selection in functional multivariate linear regression

  2019cites this paper
• Phylogenetic trees and networks can serve as powerful and complementary approaches for analysis of genomic data.

  2019cites this paper
• Regression function estimation as a partly inverse problem

  2019cites this paper
• A Count-sketch to Reduce Memory Consumption when Training a Model with Gradient Descent

  2019cites this paper
• Regression function estimation on non compact support in an heteroscesdastic model

  2019cites this paper
• Supervised Learning

  2019cites this paper