Prediction by Empirical Similarity via Categorical Regressors

A quantifier of similarity is generally a type of score that assigns a numerical value to a pair of sequences based on their proximity. Similarity measures play an important role in prediction problems with many applications, such as statistical learning, data mining, biostatistics, finance and others. Based on observed data, where a response variable of interest is assumed to be associated with some regressors, it is possible to make response predictions using a weighted average of observed response variables, where the weights depend on the similarity of the regressors. In this work, we propose a parametric regression model for continuous response based on empirical similarities for the case where the regressors are represented by categories. We apply the proposed method to predict tooth length growth in guinea pigs based on Vitamin C supplements considering three different dosage levels and two delivery methods. The inferential procedure is performed through maximum likelihood and least squares estimation under two types of similarity functions and two distance metrics. The empirical results show that the method yields accurate models with low dimension facilitating the parameters’ interpretation.

• Publication year

  2019

• Venue

  Machine Learning and Knowledge Extraction

• Publication date

  2019-05-15

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.3390/MAKE1020038
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Taxing Pensions in Japan

  2019cited by this paper
• A Methodology for Automatised Outlier Detection in High-Dimensional Datasets: An Application to Euro Area Banks’ Supervisory Data

  2018cited by this paper
• Regularized regression for categorical data

  2016cited by this paper
• On coding effects in regularized categorical regression

  2016cited by this paper
• Entity Embeddings of Categorical Variables

  2016cited by this paper
• Statistical Learning with Sparsity: The Lasso and Generalizations

  2015cited by this paper
• Plug-in Bandwidth Selection for Kernel Density Estimation with Discrete Data

  2015cited by this paper
• Forecasting volatility with empirical similarity and Google Trends

  2015cited by this paper
• NORMING RATES AND LIMIT THEORY FOR SOME TIME‐VARYING COEFFICIENT AUTOREGRESSIONS

  2014cited by this paper
• Statistical Models

  2014cited by this paper
• R: A language and environment for statistical computing.

  2014cited by this paper
• Additive Regression Splines With Irrelevant Categorical and Continuous Regressors

  2013cited by this paper
• A similarity‐based approach to time‐varying coefficient non‐stationary autoregression

  2012cited by this paper
• The crs Package: Nonparametric Regression Splines for Continuous and Categorical Predictors

  2012cited by this paper
• Nonparametric regression with discrete covariate and missing values

  2011cited by this paper
• A similarity-based approach to prediction

  2011cited by this paper
• On the definition of objective probabilities by empirical similarity

  2009cited by this paper
• ASYMPTOTIC THEORY FOR EMPIRICAL SIMILARITY MODELS

  2009influential reference
• Estimating Average Treatment Effects with Continuous and Discrete Covariates: The Case of Swan-Ganz Catheterization

  2008cited by this paper
• All of Nonparametric Statistics

  2007cited by this paper
• Empirical Similarity

  2006influential reference
• Probabilities as Similarity-Weighted Frequencies

  2005cited by this paper
• Nonparametric estimation of regression functions with both categorical and continuous data

  2004cited by this paper
• Rule-Based and Case-Based Reasoning in Housing Prices

  2004influential reference
• Axiomatization of an exponential similarity function

  2004cited by this paper
• Nonparametric estimation of distributions with categorical and continuous data

  2003cited by this paper
• Inductive Inference: An Axiomatic Approach

  2003cited by this paper
• A theory of case-based decisions

  2001cited by this paper
• Violin plots : A box plot-density trace synergism

  1998cited by this paper
• A Probabilistic Theory of Pattern Recognition

  1996cited by this paper
• Nonparametric and Semiparametric Estimation with Discrete Regressors

  1995cited by this paper
• Case-Based Decision Theory

  1995cited by this paper
• Multivariate Density Estimation, Theory, Practice and Visualization

  1992cited by this paper
• Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties

  1989cited by this paper
• Density Estimation for Statistics and Data Analysis

  1987cited by this paper
• Multivariate binary discrimination by the kernel method

  1976cited by this paper
• Nearest neighbor pattern classification

  1967cited by this paper
• On Estimation of a Probability Density Function and Mode

  1962cited by this paper
• Remarks on Some Nonparametric Estimates of a Density Function

  1956cited by this paper
• An approximation to the density function

  1954cited by this paper
• The growth of the odontoblasts of the incisor tooth as a criterion of the vitamin C intake of the guinea pig.

  1947cited by this paper

• An approach to automatically remove negatively coded Do Not Know/No Answer values in some Stata datasets

  2024cites this paper
• Similarity-Based Predictive Models: Sensitivity Analysis and a Biological Application with Multi-Attributes

  2023influential citation
• PCDM and PCDM4MP: New Pairwise Correlation-Based Data Mining Tools for Parallel Processing of Large Tabular Datasets

  2022cites this paper
• MEM and MEM4PP: New Tools Supporting the Parallel Generation of Critical Metrics in the Evaluation of Statistical Models

  2022cites this paper
• Do Randomized Algorithms Improve the Efficiency of Minimal Learning Machine?

  2020cites this paper