Bayesian inference is attractive for its coherence and good frequentist properties. However, eliciting a honest prior may be difficult and a common practice is to take an empirical Bayes approach, using some empirical estimate of the prior hyperparameters. Despite not rigorous, the underlying idea is that, for sufficiently large sample size, empirical Bayes leads to similar inferential answers as a proper Bayesian inference. However, precise mathematical results seem missing. In this work, we give more rigorous results in terms of merging of Bayesian and empirical Bayesian posterior distributions. We study two notions of merging: Bayesian weak merging and frequentist merging in total variation. We also show that, under regularity conditions, empirical Bayes asymptotically gives an oracle selection of the prior hyperparameters. Examples include empirical Bayes density estimation with Dirichlet process mixtures.
Bayes and empirical Bayes : Do they merge?
Sonia Petrone,J. Rousseau,Catia Scricciolo
Published 2012 in Biometrika
ABSTRACT
PUBLICATION RECORD
- Publication year
2012
- Venue
Biometrika
- Publication date
2012-04-06
- Fields of study
Mathematics
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-37 of 37 references · Page 1 of 1
CITED BY
Showing 1-76 of 76 citing papers · Page 1 of 1