Model-based clustering via linear cluster-weighted models

A novel family of twelve mixture models with random covariates, nested in the linear t cluster-weighted model (CWM), is introduced for model-based clustering. The linear t CWM was recently presented as a robust alternative to the better known linear Gaussian CWM. The proposed family of models provides a unified framework that also includes the linear Gaussian CWM as a special case. Maximum likelihood parameter estimation is carried out within the EM framework, and both the BIC and the ICL are used for model selection. A simple and effective hierarchical-random initialization is also proposed for the EM algorithm. The novel model-based clustering technique is illustrated in some applications to real data. Finally, a simulation study for evaluating the performance of the BIC and the ICL is presented.

• Publication year

  2012

• Venue

  Computational Statistics & Data Analysis

• Publication date

  2012-06-18

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1016/j.csda.2013.02.012arXiv 1206.3974
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• On comparing partitions

  2015cited by this paper
• Cluster-weighted t\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t$$\end{document}-factor analyzers for robust model-

  2015cited by this paper
• R: A language and environment for statistical computing.

  2014cited by this paper
• Museum and monument attendance and tourism flow: a time series analysis approach

  2013cited by this paper
• Clustering gene expression time course data using mixtures of multivariate t-distributions

  2012cited by this paper
• mclust Version 4 for R : Normal Mixture Modeling for Model-Based Clustering , Classification , and Density Estimation

  2012cited by this paper
• Local Statistical Modeling via a Cluster-Weighted Approach with Elliptical Distributions

  2012influential reference
• Clustering and classification via cluster-weighted factor analyzers

  2012cited by this paper
• Flexible Mixture Modeling with the Polynomial Gaussian Cluster-Weighted Model

  2012cited by this paper
• Finite mixtures of unimodal beta and gamma densities and the \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k$$\end{d

  2012cited by this paper
• Mixtures of common t-factor analyzers for clustering high-dimensional microarray data

  2011cited by this paper
• Model-based classification via mixtures of multivariate t-distributions

  2011cited by this paper
• Extending mixtures of multivariate t-factor analyzers

  2011cited by this paper
• On Model-Based Clustering, Classification, and Discriminant Analysis

  2011influential reference
• Model-based clustering of microarray expression data via latent Gaussian mixture models

  2010cited by this paper
• Model‐based clustering of longitudinal data

  2010cited by this paper
• Model-based classification using latent Gaussian mixture models

  2010influential reference
• Constrained monotone EM algorithms for mixtures of multivariate t distributions

  2010cited by this paper
• Robust fuzzy clustering using mixtures of Student's-t distributions

  2008cited by this paper
• Parsimonious Gaussian mixture models

  2008cited by this paper
• Finite Mixture and Markov Switching Models

  2006cited by this paper
• FlexMix: A general framework for finite mixture models and latent class regression in R

  2004cited by this paper
• Robust clustering by deterministic agglomeration EM of mixtures of multivariate t-distributions

  2002cited by this paper
• Model-Based Clustering, Discriminant Analysis, and Density Estimation

  2002cited by this paper
• Concomitant variables in finite mixture models

  2002cited by this paper
• Cluster-Weighted Modeling: Probabilistic Time Series Prediction, Characterization, and Synthesis

  2001cited by this paper
• Identifiablity of Models for Clusterwise Linear Regression

  2000cited by this paper
• Finite Mixture Models

  2000influential reference
• Assessing a Mixture Model for Clustering with the Integrated Completed Likelihood

  2000cited by this paper
• Probabilistic characterization and synthesis of complex driven systems

  2000cited by this paper
• Robust mixture modelling using the t distribution

  2000cited by this paper
• How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis

  1998cited by this paper
• Detecting features in spatial point processes with clutter via model-based clustering

  1998influential reference
• Parameter expansion to accelerate EM: The PX-EM algorithm

  1998cited by this paper
• Practical Bayesian Density Estimation Using Mixtures of Normals

  1997cited by this paper
• A First Course in Multivariate Statistics

  1997cited by this paper
• Nonlinear Inference and Cluster‐Weighted Modeling

  1997influential reference
• Parameter expansion to accelerate EM : The PX-EM algorithm

  1997cited by this paper
• ML Estimation of the Multivariate t Distribution and the EM Algorithm

  1997influential reference
• The EM Algorithm—an Old Folk‐song Sung to a Fast New Tune

  1997cited by this paper
• Bayes factors

  1995cited by this paper
• A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion

  1995cited by this paper
• The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family

  1994cited by this paper
• A curious likelihood identity for the multivariate t-distribution

  1994influential reference
• Consistent estimation of a mixing distribution

  1992cited by this paper
• Monographs on statistics and applied probability

  1990cited by this paper
• Mixture models : inference and applications to clustering

  1989cited by this paper
• Robust Statistical Modeling Using the t Distribution

  1989cited by this paper
• Statistical analysis of finite mixture distributions

  1986influential reference
• Finite Mixture Distributions

  1982cited by this paper
• Finite Mixture Distributions

  1981cited by this paper
• Robust Locally Weighted Regression and Smoothing Scatterplots

  1979cited by this paper
• Estimating the Dimension of a Model

  1978cited by this paper
• Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper

  1977cited by this paper
• Bayesian and Non-Bayesian Analysis of the Regression Model with Multivariate Student- t Error Terms

  1976cited by this paper
• A multivariate study of variation in two species of rock crab of the genus Leptograpsus

  1974cited by this paper
• XXV.—On Bernoulli's Numerical Solution of Algebraic Equations

  year unknowninfluential reference

• Copula-based mixtures of regression models for multivariate response data

  2026cites this paper
• Model-based clustering using a new mixture of circular regressions

  2026cites this paper
• FunCWM: Functional Cluster-Weighted Models and Their Applications to Climatological Functional Data

  2026cites this paper
• FCWFA: Functional Cluster-Weighted Factor Analyzers

  2026cites this paper
• Uncovering mortality patterns and hospital effects in COVID-19 heart failure patients: a novel multilevel logistic cluster-weighted modeling approach.

  2025cites this paper
• Incremental Seeded EM Algorithm for Clusterwise Linear Regression

  2025cites this paper
• Cluster-weighted modeling of lifetime hierarchical data for profiling COVID-19 heart failure patients

  2025cites this paper
• Parsimonious Seemingly Unrelated Contaminated Normal Cluster-Weighted Models

  2024cites this paper
• Robust mixture of regression models using the symmetric α-stable distribution

  2024cites this paper
• Uncover mortality patterns and hospital effects in COVID-19 heart failure patients: a novel Multilevel logistic cluster-weighted modeling approach

  2024cites this paper
• Latent heterogeneity in COVID‐19 hospitalisations: a cluster‐weighted approach to analyse mortality

  2024cites this paper
• Cluster-weighted modeling with measurement error in covariates

  2024cites this paper
• Cluster weighted model based on TSNE algorithm for high-dimensional data

  2023cites this paper
• Imbalanced Mixed Linear Regression

  2023cites this paper
• Flexible mixture regression with the generalized hyperbolic distribution

  2023cites this paper
• Global Convergence of Online Identification for Mixed Linear Regression

  2023cites this paper
• Predictors with measurement error in mixtures of polynomial regressions

  2022cites this paper
• Merging Components in Linear Gaussian Cluster-Weighted Models

  2022cites this paper
• Graphical and Computational Tools to Guide Parameter Choice for the Cluster Weighted Robust Model

  2022cites this paper
• Robust mixture regression modeling based on the normal mean-variance mixture distributions

  2022cites this paper
• Multinomial Cluster-Weighted Models for High-Dimensional Data

  2022cites this paper
• Revitalizing the multivariate elliptical leptokurtic-normal distribution and its application in model-based clustering

  2022cites this paper
• Methods and Applications of Clusterwise Linear Regression: A Survey and Comparison

  2022cites this paper
• Extending finite mixtures of nonlinear mixed-effects models with covariate-dependent mixing weights

  2022cites this paper
• Finite mixture model of hidden Markov regression with covariate dependence

  2022cites this paper
• Multivariate cluster-weighted models based on seemingly unrelated linear regression

  2022cites this paper
• Matrix Normal Cluster-Weighted Models

  2021cites this paper
• Multivariate cluster weighted models using skewed distributions

  2021cites this paper
• Model-based clustering via skewed matrix-variate cluster-weighted models

  2021cites this paper
• Weighted Clusterwise Linear Regression based on adaptive quadratic form distance

  2021cites this paper
• Cluster Weighted Model Based on TSNE algorithm for High-Dimensional Data

  2021cites this paper
• Parsimonious mixture‐of‐experts based on mean mixture of multivariate normal distributions

  2021cites this paper
• Estimating the Covariance Matrix of the Maximum Likelihood Estimator Under Linear Cluster-Weighted Models

  2021cites this paper
• Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition

  2020cites this paper
• A Random-covariate Approach for Distal Outcome Prediction with Latent Class Analysis

  2020cites this paper
• Extending finite mixtures of t linear mixed-effects models with concomitant covariates

  2020cites this paper
• Robust fitting of mixture models using weighted complete estimating equations

  2020cites this paper
• Pseudo-stochastic EM for sub-Gaussian α-stable mixture models

  2020cites this paper
• Approximations of conditional probability density functions in Lebesgue spaces via mixture of experts models

  2020cites this paper
• The multivariate tail-inflated normal distribution and its application in finance

  2020cites this paper
• A note on the consistency of the maximum likelihood estimator under multivariate linear cluster-weighted models

  2020cites this paper
• Mixtures of multivariate contaminated normal regression models

  2020cites this paper
• Approximation results regarding the multiple-output Gaussian gated mixture of linear experts model

  2019cites this paper
• On the Use of the Sub-Gaussian $$\alpha $$α-Stable Distribution in the Cluster-Weighted Model

  2019cites this paper
• Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition

  2019cites this paper
• Multivariate hidden Markov regression models: random covariates and heavy-tailed distributions

  2019cites this paper
• Supervised Fuzzy Partitioning

  2018cites this paper
• Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership

  2018cites this paper
• Living Arrangements of the Elderly in China and Their Depressions

  2018cites this paper
• flexCWM: A Flexible Framework for Cluster-Weighted Models

  2018cites this paper
• Mixture of multivariate t nonlinear mixed models for multiple longitudinal data with heterogeneity and missing values

  2018cites this paper
• Cluster-weighted latent class modeling

  2018cites this paper
• Modeling frequency and severity of claims with the zero-inflated generalized cluster-weighted models

  2018cites this paper
• Multivariate generalized hidden Markov regression models with random covariates: Physical exercise in an elderly population

  2018influential citation
• The robust EM-type algorithms for log-concave mixtures of regression models

  2017cites this paper
• The effect of ISM absorption on stellar activity measurements and its relevance for exoplanet studies

  2017cites this paper
• Model-based time-varying clustering of multivariate longitudinal data with covariates and outliers

  2017cites this paper
• The multivariate leptokurtic‐normal distribution and its application in model‐based clustering

  2017cites this paper
• A Universal Approximation Theorem for Gaussian-Gated Mixture of Experts Models

  2017cites this paper
• Modeling Return to Education in Heterogeneous Populations: An Application to Italy

  2017cites this paper
• Robust Clustering in Regression Analysis via the Contaminated Gaussian Cluster-Weighted Model

  2017cites this paper
• Mixtures of multivariate contaminated normal regression models

  2017cites this paper
• Approximation results regarding the multiple-output mixture of linear experts model

  2017cites this paper
• Selecting the Quantity of Models in Mixture Regression

  2016cites this paper
• Decision boundaries for mixtures of regressions

  2016cites this paper
• Hypothesis Testing for Mixture Model Selection

  2016cites this paper
• Multilevel cluster-weighted models for the evaluation of hospitals

  2016cites this paper
• Robust estimation of mixtures of regressions with random covariates, via trimming and constraints

  2016cites this paper
• Multilevel cluster-weighted models for the evaluation of hospitals

  2016cites this paper
• Algorithms for Generalized Cluster-wise Linear Regression

  2016cites this paper
• Algorithms for Generalized Clusterwise Linear Regression

  2016cites this paper
• Mixtures of quantile regressions

  2016cites this paper
• A fuzzy approach to robust regression clustering

  2016cites this paper
• Laplace mixture of linear experts

  2016cites this paper
• Model-Based Clustering

  2016cites this paper
• Finite mixtures of censored Poisson regression models

  2016cites this paper
• Erratum to: The Generalized Linear Mixed Cluster-Weighted Model

  2015cites this paper
• Clustering bivariate mixed-type data via the cluster-weighted model

  2015cites this paper
• A BIMODAL CORRELATION BETWEEN HOST STAR CHROMOSPHERIC EMISSION AND THE SURFACE GRAVITY OF HOT JUPITERS

  2015cites this paper
• A Fast Iteration Method for Mixture Regression Problem

  2015influential citation
• Robust estimation of mixtures of regressions with random covariates, via trimming and constraints

  2015cites this paper
• Maximum likelihood estimation of Gaussian mixture models without matrix operations

  2015cites this paper
• The Generalized Linear Mixed Cluster-Weighted Model

  2015cites this paper
• Cluster-weighted t\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$t$$\end{document}-factor analyzers for robust model-

  2015cites this paper
• Parsimonious Generalized Linear Gaussian Cluster-Weighted Models

  2015cites this paper
• Title Mixtures of quantile regressions

  2014influential citation
• Hypothesis Testing for Parsimonious Gaussian Mixture Models

  2014cites this paper
• Multivariate Response and Parsimony for Gaussian Cluster-Weighted Models

  2014cites this paper
• Robust Clustering in Regression Analysis via the Contaminated Gaussian Cluster-Weighted Model

  2014cites this paper
• The 2nd special issue on advances in mixture models

  2014cites this paper
• Cluster-Weighted Multilevel Models for the evaluation of healthcare structures∗

  2013cites this paper
• Clustering and classification via cluster-weighted factor analyzers

  2012cites this paper
• Generalized Linear Gaussian Cluster-Weighted Modeling

  2012influential citation
• Flexible Mixture Modeling with the Polynomial Gaussian Cluster-Weighted Model

  2012cites this paper
• The EM algorithm for mixture regression with missing covariates

  year unknowncites this paper