Hierarchical Compound Poisson Factorization

Non-negative matrix factorization models based on a hierarchical Gamma-Poisson structure capture user and item behavior effectively in extremely sparse data sets, making them the ideal choice for collaborative filtering applications. Hierarchical Poisson factorization (HPF) in particular has proved successful for scalable recommendation systems with extreme sparsity. HPF, however, suffers from a tight coupling of sparsity model (absence of a rating) and response model (the value of the rating), which limits the expressiveness of the latter. Here, we introduce hierarchical compound Poisson factorization (HCPF) that has the favorable Gamma-Poisson structure and scalability of HPF to high-dimensional extremely sparse matrices. More importantly, HCPF decouples the sparsity model from the response model, allowing us to choose the most suitable distribution for the response. HCPF can capture binary, non-negative discrete, non-negative continuous, and zero-inflated continuous responses. We compare HCPF with HPF on nine discrete and three continuous data sets and conclude that HCPF captures the relationship between sparsity and response better than HPF.

• Publication year

  2016

• Venue

  International Conference on Machine Learning

• Publication date

  2016-04-13

• Fields of study

  Mathematics, Computer Science

• Identifiers
  arXiv 1604.03853
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Missing data

  2019cited by this paper
• The MovieLens Datasets: History and Context

  2016cited by this paper
• Deep Neural Nets as a Method for Quantitative Structure-Activity Relationships

  2015cited by this paper
• Learning the beta-Divergence in Tweedie Compound Poisson Matrix Factorization Models

  2013cited by this paper
• From amateurs to connoisseurs: modeling the evolution of user expertise through online reviews

  2013cited by this paper
• Transcriptome and genome sequencing uncovers functional variation in humans

  2013cited by this paper
• Scalable Recommendation with Poisson Factorization

  2013influential reference
• Stochastic variational inference

  2012cited by this paper
• Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction

  2012cited by this paper
• The Million Song Dataset

  2011cited by this paper
• Probabilistic factor models for web site recommendation

  2011cited by this paper
• Algorithms for Nonnegative Matrix Factorization with the β-Divergence

  2010cited by this paper
• Bayesian Inference for Nonnegative Matrix Factorisation Models

  2009cited by this paper
• Collaborative prediction and ranking with non-random missing data

  2009cited by this paper
• Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music Analysis

  2009cited by this paper
• Lessons from the Netflix prize challenge

  2007cited by this paper
• Collaborative Filtering and the Missing at Random Assumption

  2007cited by this paper
• On the sum of independent zero-truncated Poisson random variables

  2006cited by this paper
• GaP: a factor model for discrete data

  2004cited by this paper
• Document clustering based on non-negative matrix factorization

  2003cited by this paper
• Learning the parts of objects by non-negative matrix factorization

  1999cited by this paper
• The Theory of Dispersion Models

  1997cited by this paper
• LIII. On lines and planes of closest fit to systems of points in space

  1901cited by this paper

• Joint species distribution modeling of abundance data through latent variable barcodes

  2024cites this paper
• Bayesian Analysis of Generalized Hierarchical Indian Buffet Processes for Within and Across Group Sharing of Latent Features

  2023cites this paper
• BAYESIAN ANALYSIS OF GENERALIZED HIERARCHICAL INDIAN BUFFET PROCESSES FOR WITHIN AND ACROSS GROUP SHARING OF LATENT FEATURES BY LANCELOT

  2023cites this paper
• Evolutionary Poisson Factorization Based Multiple Trust Relationships

  2022influential citation
• Posterior distributions for Hierarchical Spike and Slab Indian Buffet processes

  2021cites this paper
• A Comparative Study of Gamma Markov Chains for Temporal Non-Negative Matrix Factorization

  2021cites this paper
• Neural content-aware collaborative filtering for cold-start music recommendation

  2021cites this paper
• Evolutionary Social Poisson Factorizationfor Temporal Recommendation

  2021cites this paper
• DeepLTRS: A deep latent recommender system based on user ratings and reviews

  2021cites this paper
• Hierarchical Negative Binomial Factorization for Recommender Systems on Implicit Feedback

  2021influential citation
• A Comparative Study of Temporal Non-Negative Matrix Factorization with Gamma Markov Chains

  2020cites this paper
• Ordinal Non-negative Matrix Factorization for Recommendation

  2020cites this paper
• Neural Poisson Factorization

  2020cites this paper
• Missing rating imputation based on product reviews via deep latent variable models

  2020cites this paper
• Leveraging the Structure of Musical Preference in Content-Aware Music Recommendation

  2020cites this paper
• Matrix factorization of large scale data using multistage matrix factorization

  2020cites this paper
• D EEP LTRS: A D EEP L ATENT R ECOMMENDER S YS - TEM BASED ON U SER R ATINGS AND R EVIEWS

  2020cites this paper
• Binary Component Decomposition Part I: The Positive-Semidefinite Case

  2019cites this paper
• Binary component decomposition Part II: The asymmetric case

  2019cites this paper
• Prior specification via prior predictive matching: Poisson matrix factorization and beyond

  2019influential citation
• Prior Specification for Bayesian Matrix Factorization via Prior Predictive Matching

  2019influential citation
• Recommendation from Raw Data with Adaptive Compound Poisson Factorization

  2019influential citation
• Allocative Poisson Factorization for Computational Social Science

  2019cites this paper
• Gamma-Poisson Dynamic Matrix Factorization Embedded with Metadata Influence

  2018influential citation
• Metadata-dependent Infinite Poisson Factorization for Efficiently Modelling Sparse and Large Matrices in Recommendation

  2018cites this paper
• Negative Binomial Matrix Factorization for Recommender Systems

  2018cites this paper
• A Poisson Gamma Probabilistic Model for Latent Node-Group Memberships in Dynamic Networks

  2018cites this paper
• Coupled Compound Poisson Factorization

  2017cites this paper
• Integrating Exponential Dispersion Models to Latent Structures

  2017influential citation
• Dynamic Collaborative Filtering With Compound Poisson Factorization

  2016influential citation
• Poisson-Gamma dynamical systems

  2016cites this paper
• AdaCluster : Adaptive Clustering for Heterogeneous Data

  2015cites this paper
• Clustering with Beta Divergences

  2015cites this paper
• A Comparative Study of Gamma Markov Chains for Temporal Non-Negative Factorization

  year unknowncites this paper