Using principal components for estimating logistic regression with high-dimensional multicollinear data

The logistic regression model is used to predict a binary response variable in terms of a set of explicative ones. The estimation of the model parameters is not too accurate and their interpretation in terms of odds ratios may be erroneous, when there is multicollinearity (high dependence) among the predictors. Other important problem is the great number of explicative variables usually needed to explain the response. In order to improve the estimation of the logistic model parameters under multicollinearity and to reduce the dimension of the problem with continuous covariates, it is proposed to use as covariates of the logistic model a reduced set of optimum principal components of the original predictors. Finally, the performance of the proposed principal component logistic regression model is analyzed by developing a simulation study where different methods for selecting the optimum principal components are compared.

• Publication year

  2006

• Venue

  Computational Statistics & Data Analysis

• Publication date

  2006-04-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1016/j.csda.2005.03.011
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• PLS generalised linear regression

  2005influential reference
• Generalized Linear Models

  2002cited by this paper
• Applied Logistic Regression

  2002influential reference
• Two goodness‐of‐fit tests for logistic regression models with continuous covariates

  2002cited by this paper
• Regression methods for high dimensional multicollinear data

  2000influential reference
• Improved PLS algorithms

  1997cited by this paper
• A comparison of goodness-of-fit tests for the logistic regression model.

  1997cited by this paper
• Modern Regression Methods

  1996influential reference
• Statistical Factor Analysis and Related Methods: Theory and Applications

  1995cited by this paper
• A continuum of principal component generalized linear regressions

  1992cited by this paper
• A User's Guide to Principal Components.

  1991cited by this paper
• Principal component estimation for generalized linear regression

  1990cited by this paper
• Logistic disease incidence models and case-control studies

  1979cited by this paper
• An Analytic Variable Selection Technique for Principal Component Regression

  1977cited by this paper
• Biased Estimation in Regression: An Evaluation Using Mean Squared Error

  1977influential reference
• The analysis and selection of variables in linear regression

  1976cited by this paper
• Nonlinear Iterative Partial Least Squares (NIPALS) Modelling: Some Current Developments

  1973cited by this paper
• Principal Components Regression in Exploratory Statistical Research

  1965cited by this paper

• RICR: ridge-guided independent component regression for handling high-dimensional multicollinear data

  2026cites this paper
• Deep Learning-Based Death Prediction Model for Chronic Kidney Disease

  2025cites this paper
• Dietary Fluoride Exposure During Early Childhood and Its Association with Dental Fluorosis in a Sample of Mexican Adolescents

  2025cites this paper
• Intellectual Capital and Startup Survival in Global Accelerator Programs

  2025cites this paper
• LASSO Regression Analysis: Applications in Dyslipidemia and Cardiovascular Disease Research

  2025cites this paper
• Temporary Absence of Warming in the Northern Weddell Sea Validates Expected Responses of Antarctic Seals to Sea Ice Change

  2025cites this paper
• Empty pelvis syndrome as a cause of major morbidity after pelvic exenteration: validation of a core data set

  2025cites this paper
• Relationship of long-term air pollution exposure with chronic obstructive pulmonary disease: an Italian multicentre observational study

  2025cites this paper
• Applicability of Machine Learning and Mathematical Equations to the Prediction of Total Organic Carbon in Cambrian Shale, Sichuan Basin, China

  2025cites this paper
• Intellectual Capital in Global Accelerator Programs: An Empirical Analysis of Survival Probabilities in Emerging Countries

  2025influential citation
• Using independent components for estimating logistic regression with high-dimensional multicollinear data: Simulation and application

  2025influential citation
• A Financial Brain Scan of the LLM

  2025cites this paper
• Modeling Experimental Designs Including Longitudinal Data and a Functional Covariate

  2025cites this paper
• Can we identify stroke sub-type without imaging? A multidimensional analysis.

  2025cites this paper
• Expanding cryospheric landform inventories – quantitative approaches for underestimated periglacial block- and talus slopes in the Dry Andes of Argentina

  2025cites this paper
• Penalized estimation in parametric frailty model

  2024cites this paper
• Thermal Comfort in Open Public Spaces – A Critical Review in Indian Context

  2024cites this paper
• Development of a robust parallel and multi-composite machine learning model for improved diagnosis of Alzheimer's disease: correlation with dementia-associated drug usage and AT(N) protein biomarkers

  2024cites this paper
• Financial Risk Management Early-Warning Model for Chinese Enterprises

  2024cites this paper
• Logistic regression models for elastic shape of curves based on tangent representations

  2024cites this paper
• Principal Component Regression to Study the Impact of Economic Factors on Disadvantaged Communities

  2024cites this paper
• Handling Multicollinearity and Outliers in Logistic Regression Using the Robust Kibria-Lukman Estimator

  2024cites this paper
• CONWAY-MAXWELL-POISSON PROFILE MONITORING WITH RK-SHEWHART CONTROL CHART: A COMPARATIVE STUDY

  2024cites this paper
• Detecting shifts in Conway–Maxwell–Poisson profile with deviance residual-based CUSUM and EWMA charts under multicollinearity

  2023cites this paper
• Biased proportional hazard regression estimator in the existence of collinearity

  2023cites this paper
• Systematic review of class imbalance problems in manufacturing

  2023cites this paper
• Fusion regression methods with repeated functional data

  2023influential citation
• Evaluating Classical and Artificial Intelligence Methods for Credit Risk Analysis

  2023cites this paper
• Classification and prediction of the chemical composition of glass based on grey and principal component Logistic regression

  2023cites this paper
• Relationship of long-term air pollution exposure with asthma and rhinitis in Italy: an innovative multipollutant approach.

  2023cites this paper
• Determining an Adequate Number of Principal Components

  2023cites this paper
• Trend of risk and correlates of under-five child undernutrition in Bangladesh: an analysis based on Bangladesh Demographic and Health Survey data, 2007–2017/2018

  2023cites this paper
• Deviance residual-based Shewhart control chart for monitoring Conway-Maxwell-Poisson profile under the r-k class estimator

  2023influential citation
• Effects of Air Pollution Exposure during Preconception and Pregnancy on Gestational Diabetes Mellitus

  2023cites this paper
• Forecasting Canadian Age-Specific Mortality Rates: Application of Functional Time Series Analysis

  2023cites this paper
• Multinomial Principal Component Logistic Regression on Shape Data

  2022cites this paper
• A statistical learning framework for predicting left ventricular ejection fraction based on glutathione peroxidase-3 level in ischemic heart disease

  2022cites this paper
• Principal component ridge type estimator for the inverse Gaussian regression model

  2022influential citation
• Estimation of spatial-functional based-line logit model for multivariate longitudinal data

  2022cites this paper
• Corporate finance risk prediction based on LightGBM

  2022cites this paper
• Landscape heterogeneity, basis risk and the feasibility of index insurance: An analysis of rice in upland regions of Southeast Asia

  2022cites this paper
• A general restricted estimator in binary logistic regression in the presence of multicollinearity

  2022cites this paper
• Performance of binary prediction models in high-correlation low-dimensional settings: a comparison of methods

  2022cites this paper
• Brood sex ratio variation in a colonial raptor, the Eleonora's falcon, Falco eleonorae

  2022cites this paper
• Spatial heterogeneity of environmental factors related to the invasion of Hypochaeris radicata in South Korea

  2022cites this paper
• Some Modified Kibria-Lukman Estimators for the Gamma Regression Model

  2022influential citation
• Dawoud–Kibria Estimator for the Logistic Regression Model: Method, Simulation and Application

  2022cites this paper
• Export development of Taiwanese food and beverage processing SMEs: A test of a DOI model

  2022cites this paper
• An improved ridge type estimator for logistic regression

  2022cites this paper
• Quantifying herbivory in heterogenous environments: Methodological considerations for more accurate metrics

  2022cites this paper
• A regression-based three-phase approach to assess outdoor thermal comfort in informal micro-entrepreneurial settings in tropical Mumbai

  2021cites this paper
• Home range size, space use and resource selection of griffon vultures in an insular environment

  2021cites this paper
• Using Model Selection Criteria to Choose the Number of Principal Components

  2021cites this paper
• Some r – k class proportional hazard regression models in the presence of collinearity: an evidence from Indian infant mortality

  2021cites this paper
• Binary disease prediction using tail quantiles of the distribution of continuous biomarkers

  2021cites this paper
• Factors Affecting Small-Scale Fishers Adaptation toward the Impacts of Climate Change: Reflections from South Eastern Bangladeshi Fishers

  2021cites this paper
• Using the right tool for the job: the difference between unsupervised and supervised analyses of multivariate ecological data

  2021cites this paper
• Soundscape Perceptions and Preferences for Different Groups of Users in Urban Recreational Forest Parks

  2021cites this paper
• Modeling go-around occurrence using principal component logistic regression

  2021cites this paper
• Comparing methods addressing multi-collinearity when developing prediction models

  2021cites this paper
• Mind the gap: A quantitative analysis to bridge the attitude-behaviour gap among adolescents in terms of plastic consumption

  2020influential citation
• Educational tourism and experiential learning: students’ perceptions of field trips

  2020cites this paper
• A statistical model for evaluating the patient satisfaction

  2020cites this paper
• Particle swarm optimization based ridge logistic estimator

  2020cites this paper
• Robust neural networks with random weights based on generalized M-estimation and PLS for imperfect industrial data modeling

  2020cites this paper
• Impactos regionales del cambio climático y de los cambios de uso del suelo sobre el riesgo de extinción de anuros en los andes de Colombia

  2020cites this paper
• MEIRLOP: improving score-based motif enrichment by incorporating sequence bias covariates

  2020influential citation
• A new alternative estimation method for Liu-type logistic estimator via particle swarm optimization: an application to data of collapse of Turkish commercial banks during the Asian financial crisis

  2020cites this paper
• Fishers’ perceptions and adaptation on climate change in northeastern Taiwan

  2020cites this paper
• On the stochastic restricted Liu estimator in logistic regression model

  2020cites this paper
• A new kind of stochastic restricted biased estimator for logistic regression model

  2020cites this paper
• Underlying Driving Forces of Forest Cover Changes Due to the Implementation of Preservation Policies in Iranian Northern Zagros Forests

  2020cites this paper
• Coronary Heart Disease Diagnosis Through Self-Organizing Map and Fuzzy Support Vector Machine with Incremental Updates

  2020cites this paper
• Exploring Factors Affecting the Yellow-Light Running Behavior of Electric Bike Riders at Urban Intersections in China

  2020cites this paper
• Optimal stochastic restricted logistic estimator

  2019cites this paper
• Clustering acoustic emission signals by mixing two stages dimension reduction and nonparametric approaches

  2019cites this paper
• Identification of outlying and influential data with principal components regression estimation in binary logistic regression

  2019cites this paper
• Logistic Liu Estimator under stochastic linear restrictions

  2019cites this paper
• Modified almost unbiased Liu estimator in logistic regression

  2019influential citation
• Application of statistical techniques to proportional loss data: Evaluating the predictive accuracy of physical vulnerability to hazardous hydro-meteorological events.

  2019cites this paper
• Retrieving shallow stream bathymetry from UAV-assisted RGB imagery using a geospatial regression method

  2019cites this paper
• Statistical approaches for finding the immigrant women’s political participation in 2015 local elections and 2017 national elections

  2019cites this paper
• Optimal stochastic restricted logistic estimator

  2019cites this paper
• An Improved Model for Imperfect Facial Recognition using Python-Open CV

  2019cites this paper
• Factors influencing dairy farmers’ adoption of best management grazing practices

  2018cites this paper
• Experiments on Deep Face Recognition Using Partial Faces

  2018cites this paper
• Determinants of default in p2p lending: the Mexican case

  2018cites this paper
• Factors underlying farmers' intentions to adopt best practices: The case of paddock based grazing systems

  2018cites this paper
• Exploring unobserved household living conditions in multilevel choice modeling: An application to contraceptive adoption by Indian women

  2018cites this paper
• Fertilizer Adoption by Smallholders in the Brazilian Amazon: Farm-level Evidence

  2018cites this paper
• Breast Cancer Prediction Using Bayesian Logistic Regression

  2018cites this paper
• Successful performance in socially oriented ventures stemming from international accelerator programs: A comparative study between OECD and developing countries.

  2018cites this paper
• Supervised and Ensemble Classification of Multivariate Functional Data: Applications to Lupus Diagnosis

  2018cites this paper
• Difference scores between single-task and dual-task gait measures are better than clinical measures for detection of fall-risk in community-dwelling older adults.

  2018cites this paper
• Functional logistic regression: a comparison of three methods

  2018cites this paper
• A New Stochastic Restricted Liu Estimator for the Logistic Regression Model

  2018cites this paper
• A first-order approximated jackknifed ridge estimator in binary logistic regression

  2018cites this paper
• Multivariate geostatistical modeling of the spatial sediment distribution in a large scale drainage basin, Upper Rhone, Switzerland

  2018cites this paper
• Performance of the almost unbiased ridge-type principal component estimator in logistic regression model

  2018cites this paper
• Regional-scale controls on the spatial activity of rockfalls (Turtmann Valley, Swiss Alps) — A multivariate modeling approach

  2017cites this paper