Measures of Bayesian learning and identifiability in hierarchical models

Yang Xie, Bradley P. Carlin

Research output: Contribution to journalArticlepeer-review

19 Scopus citations

Abstract

Identifiability has long been an important concept in classical statistical estimation. Historically, Bayesians have been less interested in the concept since, strictly speaking, any parameter having a proper prior distribution also has a proper posterior, and is thus estimable. However, the larger statistical community's recent move toward more Bayesian thinking is largely fueled by an interest in Markov chain Monte Carlo-based analyses using vague or even improper priors. As such, Bayesians have been forced to think more carefully about what has been learned about the parameters of interest (given the data so far), or what could possibly be learned (given an infinite amount of data). In this paper, we propose measures of Bayesian learning based on differences in precision and Kullback-Leibler divergence. After investigating them in the context of some familiar Gaussian linear hierarchical models, we consider their use in a more challenging setting involving two sets of random effects (traditional and spatially arranged), only the sum of which is identified by the data. We illustrate this latter model with an example from periodontal data analysis, where the spatial aspect arises from the proximity of various measurements taken in the mouth. Our results suggest our measures behave sensibly and may be useful in even more complicated (e.g., non-Gaussian) model settings.

Original languageEnglish (US)
Pages (from-to)3458-3477
Number of pages20
JournalJournal of Statistical Planning and Inference
Volume136
Issue number10
DOIs
StatePublished - Oct 1 2006

Keywords

  • Conditionally autoregressive (CAR) model
  • Markov chain Monte Carlo (MCMC)
  • Nonidentifiability
  • Noninformativity
  • Spatial statistics

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Measures of Bayesian learning and identifiability in hierarchical models'. Together they form a unique fingerprint.

Cite this