Sure independence screening in generalized linear models with NP-dimensionality

Ultrahigh dimensional variable selection plays an increasingly important role in contemporary scientific discoveries and statistical research. Among others, Fan and Lv (2008) propose an independent screening framework by ranking the marginal correlations. They showed that the correlation ranking procedure possesses a sure independence screening property within the context of the linear model with Gaussian covariates and responses. In this paper, we propose a more general version of the independent learning with ranking the maximum marginal likelihood estimates or the maximum marginal likelihood itself in generalized linear models. We show that the proposed methods, with Fan and Lv (2008) as a very special case, also possess the sure screening property with vanishing false selection rate. The conditions under which that the independence learning possesses a sure screening is surprisingly simple. This justifies the applicability of such a simple method in a wide spectrum. We quantify explicitly the extent to which the dimensionality can be reduced by independence screening, which depends on the interactions of the covariance matrix of covariates and true parameters. Simulation studies are used to illustrate the utility of the proposed approaches. In addition, we � Supported in part by Grant NSF grants DMS-0714554 and DMS-0704337. The bulk of the work was conducted when Rui Song was a postdoctoral research fellow at Princeton University. The authors would like to thank the associate editor and two referees for their constructive comments that improve the presentation and the results of the paper. AMS 2000 subject classifications: Primary 68Q32, 62J12; secondary 62E99, 60F10

• Publication year

  2009

• Venue

  Annals of Statistics

• Publication date

  2009-03-30

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1214/10-AOS798arXiv 0903.5255
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Tilting methods for assessing the influence of components in a classifier

  2009cited by this paper
• Using Generalized Correlation to Effect Variable Selection in Very High Dimensional Problems

  2009cited by this paper
• Ultrahigh Dimensional Feature Selection: Beyond The Linear Model

  2009cited by this paper
• One-step Sparse Estimates in Nonconcave Penalized Likelihood Models.

  2008cited by this paper
• HIGH-DIMENSIONAL GENERALIZED LINEAR MODELS AND THE LASSO

  2008cited by this paper
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models

  2008cited by this paper
• Sure independence screening for ultrahigh dimensional feature space Discussion

  2008influential reference
• Maximum likelihood estimation in semiparametric regression models with censored data

  2007cited by this paper
• High Dimensional Classification Using Features Annealed Independence Rules.

  2007cited by this paper
• High-dimensional Classification Using Features Annealed Independence Rules 1

  2007cited by this paper
• Sure independence screening for ultrahigh dimensional feature space

  2006influential reference
• The Adaptive Lasso and Its Oracle Properties

  2006cited by this paper
• The Dantzig selector: Statistical estimation when P is much larger than n

  2005influential reference
• Persistence in high-dimensional linear predictor selection and the virtue of overparametrization

  2004influential reference
• Robust Inference for Univariate Proportional Hazards Frailty Regression Models

  2004cited by this paper
• M-estimation using penalties or sieves

  2002cited by this paper
• Mathematical Statistics: Basic Ideas and Selected Topics (vol. 1, 2nd ed.)

  2002cited by this paper
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

  2001cited by this paper
• About the constants in Talagrand's concentration inequalities for empirical processes

  2000cited by this paper
• Weak Convergence and Empirical Processes: With Applications to Statistics

  1996cited by this paper
• Regression Shrinkage and Selection via the Lasso

  1996cited by this paper
• Probability Inequalities for Sums of Bounded Random Variables

  1994cited by this paper
• A Statistical View of Some Chemometrics Regression Tools

  1993cited by this paper
• Probability in Banach Spaces: Isoperimetry and Processes

  1991influential reference
• Asymptotic inference in discrete response models

  1986cited by this paper
• Correction: Consistency and Asymptotic Normality of the Maximum Likelihood Estimator in Generalized Linear Models

  1985cited by this paper
• Maximum Likelihood Estimation of Misspecified Models

  1982cited by this paper
• An Analysis of Transformations Revisited

  1981influential reference
• Projection Pursuit Regression

  1981cited by this paper
• Mathematical Statistics: Basic Ideas and Selected Topics

  1977cited by this paper
• Regression models and life tables (with discussion

  1972cited by this paper
• An Analysis of Transformations

  1964cited by this paper
• Regression Models and Life-Tables

  year unknowncited by this paper

• Feature Screening for High-Dimensional Data with Measurement Errors using Adjusted Martingale Difference Correlation

  2026cites this paper
• Categorical distance correlation under general encodings and its application to high-dimensional feature screening

  2026cites this paper
• Inference on the Significance of Modalities in Multimodal Generalized Linear Models

  2026influential citation
• Model-free feature screening for ultrahigh dimensional data with responses missing not at random

  2026cites this paper
• A novel martingale difference correlation via data splitting with applications in feature screening

  2026cites this paper
• Optimal response-free Poisson subsampling for generalized linear models in increasing dimension

  2025cites this paper
• Robust group inference for ultrahigh-dimensional linear regression models

  2025cites this paper
• Strong oracle guarantees for partial penalized tests of high-dimensional generalized linear models

  2025cites this paper
• Two-stage subsampling variable selection for sparse high-dimensional generalized linear models

  2025influential citation
• A more efficient method for large-sample model-free feature screening via multi-armed bandits

  2025cites this paper
• Ultra-high-dimensional independence screening in additive models with latent responses

  2025cites this paper
• Robust feature screening via Grothendieck’s correlation with FDR control

  2025cites this paper
• A model-free Screening procedure

  2025cites this paper
• Comparing Variable Selection and Model Averaging Methods for Logistic Regression

  2025cites this paper
• Sure Independence Screening for Ultrahigh-Dimensional Additive Model with Multivariate Response

  2025cites this paper
• Some Useful Techniques for High-Dimensional Statistics

  2025cites this paper
• BRBVS: An R Package for Bivariate Variable selection in Copula Survival Model(s) domain

  2025cites this paper
• Communication-Efficient Pilot Estimation for Non-Randomly Distributed Data in Diverging Dimensions

  2025cites this paper
• AIoT: Artificial Intelligence and the Internet of Things for Monitoring and Prognosis of Systems and Structures

  2025cites this paper
• Ridge partial correlation screening for ultrahigh-dimensional data

  2025cites this paper
• Communication‐Efficient Feature Screening for Ultrahigh‐Dimensional Data Under Quantile Regression

  2025cites this paper
• Environmental drivers of soil organic carbon in the Australian rangelands

  2025cites this paper
• Sparse Robust Weighted Expectile Screening for Ultra-High-Dimensional Data

  2025cites this paper
• Testing with the one component partial least squares and the marginal maximum likelihood estimators

  2025cites this paper
• posis: Command for the sure-independence-screening Neyman orthogonal estimator

  2025cites this paper
• A High Dimensional Omnibus Regression Test

  2025cites this paper
• Distributed Feature Screening via Inverse Regression

  2025cites this paper
• Model-free feature screening for massive high-dimensional imbalanced classification data via a fused inverse probability weighted absolute filter

  2025cites this paper
• StaRQR-K: False Discovery Rate Controlled Regional Quantile Regression

  2025cites this paper
• Class-Specific Joint Feature Screening in Ultrahigh-Dimensional Mixture Regression

  2025cites this paper
• High-dimensional biomarker identification for interpretable disease prediction via machine learning models

  2025cites this paper
• A Two-Stage Feature Screening Framework for Ultrahigh-Dimensional Survival Data

  2025cites this paper
• Feature pre-selection for the development of epigenetic biomarkers

  2024cites this paper
• Asymptotic confidence interval for R2 in multiple linear regression

  2024influential citation
• Penalized Lq-likelihood estimator and its influence function in generalized linear models

  2024cites this paper
• Reluctant Interaction Modeling in Generalized Linear Models

  2024influential citation
• On the properties of distance covariance for categorical data: Robustness, sure screening, and approximate null distributions

  2024cites this paper
• One component partial least squares, high dimensional regression, data splitting, and the multitude of models

  2024cites this paper
• Large-scale metric objects filtering for binary classification with application to abnormal brain connectivity detection

  2024cites this paper
• Score Tests With Incomplete Covariates and High-Dimensional Auxiliary Variables

  2024cites this paper
• Time‐varying dynamic Bayesian network learning for an fMRI study of emotion processing

  2024cites this paper
• Maximal cliques-based hybrid high-dimensional feature selection with interaction screening for regression

  2024cites this paper
• Model free feature screening for large scale and ultrahigh dimensional survival data

  2024cites this paper
• High-dimensional Biomarker Identification for Scalable and Interpretable Disease Prediction via Machine Learning Models

  2024cites this paper
• Variable screening for covariate dependent extreme value index estimation

  2024cites this paper
• Model-free feature screening based on Hellinger distance for ultrahigh dimensional data

  2024cites this paper
• netQDA: Local Network-Guided High-Dimensioanl Quadratic Discriminant Analysis

  2024cites this paper
• Data-driven random projection and screening for high-dimensional generalized linear models

  2024cites this paper
• Feature screening filter for high dimensional survival data in the reproducing kernel Hilbert space

  2024cites this paper
• Adaptive sufficient sparse clustering by controlling false discovery

  2024cites this paper
• Variable selection in modelling clustered data via within‐cluster resampling

  2024influential citation
• Distributed variable screening for generalized linear models

  2024cites this paper
• Decorrelated forward regression for high dimensional data analysis

  2024cites this paper
• Profiled Transfer Learning for High Dimensional Linear Model

  2024cites this paper
• spar: Sparse Projected Averaged Regression in R

  2024influential citation
• VSOLassoBag: a variable-selection oriented LASSO bagging algorithm for biomarker discovery in omic-based translational research.

  2023cites this paper
• Signal-noise ratio of genetic associations and statistical power of SNP-set tests

  2023cites this paper
• Ultra-High Dimensional Feature Selection and Mean Estimation under Missing at Random

  2023cites this paper
• Screening Methods for Classification Based on Non-parametric Bayesian Tests

  2023cites this paper
• A new feature screening method for ultra-high-dimensional survival data based on projection correlation

  2023cites this paper
• An Ensemble Method for Feature Screening

  2023cites this paper
• Distributed smoothed rank regression with heterogeneous errors for massive data

  2023cites this paper
• Support vector machine in ultrahigh-dimensional feature space

  2023cites this paper
• Variables selection using L0 penalty

  2023cites this paper
• Semi-Distance Correlation and Its Applications

  2023cites this paper
• Adaptive Fusion of Radiomics and Deep Features for Lung Adenocarcinoma Subtype Recognition

  2023cites this paper
• Deep survival forests with feature screening

  2023cites this paper
• The concordance filter: an adaptive model-free feature screening procedure

  2023cites this paper
• Screening rules and information criteria-based analysis of gene expression data

  2023cites this paper
• A Gene Selection Method Considering Measurement Errors

  2023cites this paper
• Wasserstein filter for variable screening in binary classification in the reproducing kernel Hilbert space

  2023cites this paper
• Feature screening for multiple responses

  2023cites this paper
• Overview of High-Dimensional Measurement Error Regression Models

  2023cites this paper
• Quantile forward regression for high-dimensional survival data

  2023cites this paper
• Screening properties of trend tests in genetic association studies

  2023cites this paper
• VARIABLE SCREENING VIA TRUNCATED COMMON FACTORS FOR HIGH-DIMENSIONAL DATA WITH MULTICOLLINEARITY

  2023cites this paper
• Quasi-Newton Updating for Large-Scale Distributed Learning

  2023influential citation
• Best-Subset Selection in Generalized Linear Models: A Fast and Consistent Algorithm via Splicing Technique

  2023cites this paper
• PENALIZED REGRESSION FOR MULTIPLE TYPES OF MANY FEATURES WITH MISSING DATA.

  2023cites this paper
• A New Model-Free Feature Screening Procedure for Ultrahigh-Dimensional Interval-Censored Failure Time Data

  2023cites this paper
• A dynamic screening algorithm for hierarchical binary marketing data

  2023influential citation
• Modeling Categorical Variables by Mutual Information Decomposition

  2023cites this paper
• Hybrid Hard-Soft Screening for High-dimensional Latent Class Analysis

  2023influential citation
• High-dimensional Multi-class Classification with Presence-only Data

  2023cites this paper
• Sure Joint Screening for High Dimensional Cox's Proportional Hazards Model Under the Case-Cohort Design

  2023cites this paper
• Quantile-Adaptive Sufficient Variable Screening by Controlling False Discovery

  2023cites this paper
• Discrete-time competing-risks regression with or without penalization.

  2023cites this paper
• Model-free screening procedure for ultrahigh-dimensional survival data based on Hilbert-Schmidt independence criterion

  2023cites this paper
• Feature Screening and Error Variance Estimation for Ultrahigh-Dimensional Linear Model with Measurement Errors

  2023cites this paper
• Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency

  2023cites this paper
• Debiased lasso after sample splitting for estimation and inference in high‐dimensional generalized linear models

  2023cites this paper
• Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

  2023cites this paper
• Deep neural networks for nonparametric interaction models with diverging dimension

  2023cites this paper
• A model-free feature selection technique of feature screening and random forest based recursive feature elimination

  2023cites this paper
• A note of feature screening via a rank‐based coefficient of correlation

  2023influential citation
• Grouped feature screening for ultrahigh-dimensional classification via Gini distance correlation

  2023cites this paper
• Model‐free conditional screening for ultrahigh‐dimensional survival data via conditional distance correlation

  2022cites this paper
• Robust Distance Correlation for Variable Screening

  2022cites this paper
• A Flexibly Conditional Screening Approach via a Nonparametric Quantile Partial Correlation

  2022cites this paper
• Ranking Inferences Based on the Top Choice of Multiway Comparisons

  2022cites this paper