TY - JOUR

T1 - Estimating bayesian credible intervals

AU - Eberly, Lynn E.

AU - Casella, George

PY - 2003/3/1

Y1 - 2003/3/1

N2 - Under a Bayesian approach to a hierarchical model, quantile or interval estimation is often used to summarize the posterior distribution of a parameter. When using an Markov Chain Monte Carlo algorithm such as the Gibbs sampler to generate a sample from the posterior (marginal) of interest, calculations are often easier when done on a per-iteration (conditional) basis. Final estimators which are taken as a combination of values across iterations are often called "Rao-Blackwellized" and result in estimators with good variance properties. Such an approach is not yet used in the calculation of credible intervals. We derive here a weighted-average estimator of the endpoints of a credible interval which mimics this Rao-Blackwellized construction. We compare it to other alternatives including a naïve average estimator, the usual order statistics estimator, and an estimator based on density estimation. We obtain theorems showing when there is convergence to the true interval and discuss Central Limit Theorems for these estimators. Simulations for two hierarchical modeling scenarios (count data and continuous data) illustrate their numerical behaviors. An animal epidemiology example is included. The proposed estimator offers the smallest standard errors of the estimators studied, sometimes by several orders of magnitude, but can have a small bias.

AB - Under a Bayesian approach to a hierarchical model, quantile or interval estimation is often used to summarize the posterior distribution of a parameter. When using an Markov Chain Monte Carlo algorithm such as the Gibbs sampler to generate a sample from the posterior (marginal) of interest, calculations are often easier when done on a per-iteration (conditional) basis. Final estimators which are taken as a combination of values across iterations are often called "Rao-Blackwellized" and result in estimators with good variance properties. Such an approach is not yet used in the calculation of credible intervals. We derive here a weighted-average estimator of the endpoints of a credible interval which mimics this Rao-Blackwellized construction. We compare it to other alternatives including a naïve average estimator, the usual order statistics estimator, and an estimator based on density estimation. We obtain theorems showing when there is convergence to the true interval and discuss Central Limit Theorems for these estimators. Simulations for two hierarchical modeling scenarios (count data and continuous data) illustrate their numerical behaviors. An animal epidemiology example is included. The proposed estimator offers the smallest standard errors of the estimators studied, sometimes by several orders of magnitude, but can have a small bias.

KW - Central Limit Theorem

KW - Gibbs sampler

KW - Quantile estimation

KW - Rao-Blackwell theorem

KW - Tail probabilities

UR - http://www.scopus.com/inward/record.url?scp=0037337738&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037337738&partnerID=8YFLogxK

U2 - 10.1016/S0378-3758(02)00327-0

DO - 10.1016/S0378-3758(02)00327-0

M3 - Article

AN - SCOPUS:0037337738

VL - 112

SP - 115

EP - 132

JO - Journal of Statistical Planning and Inference

JF - Journal of Statistical Planning and Inference

SN - 0378-3758

IS - 1-2

ER -