Model Selection and Estimation of a Finite Shifted-Scaled Dirichlet Mixture Model

This paper proposes an unsupervised learning algorithm for a finite mixture model of shifted-scaled Dirichlet distributions. Maximum likelihood and Newton raphson approaches are used for parameters estimation. In this research work, we address the flexibility challenge of the Dirichlet distribution by having another set of parameters for the location (beside the Scale parameter) that add functional probability models. This paper evaluates the capability of the discussed model to perform the categorization using both synthetic and real data related to the medical science to help in selecting wart treatment method, in the business field to detect the reasons behind employees' absenteeism, and the writer identification application to define the author of off-line handwritten documents. We also compare the model performance against scaled Dirichlet, the classic Dirichlet, and Gaussian mixture models. Finally, experimental results are presented on the selected datasets. Besides, we apply the minimum message length to determine the optimal number of the components found within each dataset.

• Publication year

  2018

• Venue

  International Conference on Machine Learning and Applications

• Publication date

  2018-12-01

• Fields of study

  Medicine, Business, Computer Science

• Identifiers
  DOI 10.1109/ICMLA.2018.00112
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Predicting Defect-Prone Software Modules Using Shifted-Scaled Dirichlet Distribution

  2018cited by this paper
• Unsupervised Feature Learning for Writer Identification and Writer Retrieval

  2017cited by this paper
• Intralesional immunotherapy compared to cryotherapy in the treatment of warts

  2017cited by this paper
• An expert system for selecting wart treatment method

  2017cited by this paper
• Junction detection in handwritten documents and its application to writer identification

  2015cited by this paper
• Initializing the EM Algorithm for Data Clustering and Sub-population Detection

  2015cited by this paper
• Offline Text-Independent Writer Identification Based on Scale Invariant Feature Transform

  2014cited by this paper
• Variational learning of a Dirichlet process of generalized Dirichlet distributions for simultaneous clustering and feature selection

  2013cited by this paper
• Finite asymmetric generalized Gaussian mixture models learning for infrared object detection

  2013cited by this paper
• KHATT: Arabic Offline Handwritten Text Database

  2012influential reference
• Positive vectors clustering using inverted Dirichlet finite mixture models

  2012cited by this paper
• Estimating a Dirichlet distribution

  2012cited by this paper
• A countably infinite mixture model for clustering and feature selection

  2012cited by this paper
• A finite mixture model for simultaneous high-dimensional clustering, localized feature selection and outlier rejection

  2012cited by this paper
• Count Data Modeling and Classification Using Finite Mixtures of Distributions

  2011cited by this paper
• Bayesian hybrid generative discriminative learning based on finite Liouville mixture models

  2011cited by this paper
• Calculating Determinants of Block Matrices

  2011cited by this paper
• A Model-Based Approach for Discrete Data Clustering and Feature Weighting Using MAP and Stochastic Complexity

  2009cited by this paper
• Data Mining techniques for the detection of fraudulent financial statements

  2007cited by this paper
• High-Dimensional Unsupervised Selection and Estimation of a Finite Generalized Dirichlet Mixture Model Based on Minimum Message Length

  2007cited by this paper
• Traffic classification using clustering algorithms

  2006cited by this paper
• Simplicial geometry for compositional data

  2006cited by this paper
• Unsupervised selection of a finite Dirichlet mixture model: an MML-based approach

  2006cited by this paper
• On Fitting Finite Dirichlet Mixture Using ECM and MML

  2005cited by this paper
• Maximum Likelihood Estimation of Dirichlet Distribution Parameters

  2005cited by this paper
• Using unsupervised learning of a finite Dirichlet mixture model to improve pattern recognition applications

  2005cited by this paper
• Writer identification using edge-based directional features

  2003influential reference
• Unsupervised Learning of Finite Mixture Models

  2002cited by this paper
• The IAM-database: an English sentence database for offline handwriting recognition

  2002influential reference
• Visual categorization with bags of keypoints

  2002cited by this paper
• IFN/ENIT: database of handwritten arabic words

  2002cited by this paper
• Finding overlapping components with MML

  2000cited by this paper
• MML clustering of multi-state, Poisson, von Mises circular and Gaussian distributions

  2000cited by this paper
• Ockham's Razor and Bayesian Analysis

  1992cited by this paper
• Maximum likelihood estimation of dirichlet distributions

  1989cited by this paper
• Estimation and Inference by Compact Coding

  1987cited by this paper
• Modeling By Shortest Data Description*

  1978cited by this paper
• Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper

  1977cited by this paper
• A new look at the statistical model identification

  1974cited by this paper
• THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS

  1936cited by this paper

• Sentiment Analysis Using Smoothed Probabilistic-Based Models

  2023cites this paper
• A Fully Bayesian Inference with Gibbs Sampling for Finite and Infinite Discrete Exponential Mixture Models

  2022influential citation
• Bayesian Learning of Shifted-Scaled Dirichlet Mixture Models and Its Application to Early COVID-19 Detection in Chest X-ray Images

  2021influential citation
• Discriminative Learning Approach Based on Flexible Mixture Model for Medical Data Categorization and Recognition

  2021cites this paper
• Nonparametric learning approach based on infinite flexible mixture model and its application to medical data analysis

  2021influential citation
• Distributions on the Simplex Revisited

  2021cites this paper
• Proportional data modeling via selection and estimation of a finite mixture of scaled Dirichlet distributions

  2020cites this paper
• A Distribution-based Regression for Real-time COVID-19 Cases Detection from Chest X-ray and CT Images

  2020cites this paper
• Probabilistic Modeling for Frequency Vectors Using a Flexible Shifted-Scaled Dirichlet Distribution Prior

  2020cites this paper
• Probabilistic Features on Simplex Manifold in Predictive Data Modelling

  2020cites this paper
• Online Clustering for Estimating Occupancy in an Office Setting

  2019cites this paper
• Data Clustering Using Online Variational Learning of Finite Scaled Dirichlet Mixture Models

  2019cites this paper