Bayesian measures of model complexity and fit
TL;DR: In this paper, the authors consider the problem of comparing complex hierarchical models in which the number of parameters is not clearly defined and derive a measure pD for the effective number in a model as the difference between the posterior mean of the deviances and the deviance at the posterior means of the parameters of interest, which is related to other information criteria and has an approximate decision theoretic justification.
read more
Abstract: Summary. We consider the problem of comparing complex hierarchical models in which the number of parameters is not clearly defined. Using an information theoretic argument we derive a measure pD for the effective number of parameters in a model as the difference between the posterior mean of the deviance and the deviance at the posterior means of the parameters of interest. In general pD approximately corresponds to the trace of the product of Fisher's information and the posterior covariance, which in normal models is the trace of the ‘hat’ matrix projecting observations onto fitted values. Its properties in exponential families are explored. The posterior mean deviance is suggested as a Bayesian measure of fit or adequacy, and the contributions of individual observations to the fit and complexity can give rise to a diagnostic plot of deviance residuals against leverages. Adding pD to the posterior mean deviance gives a deviance information criterion for comparing models, which is related to other information criteria and has an approximate decision theoretic justification. The procedure is illustrated in some examples, and comparisons are drawn with alternative Bayesian and classical proposals. Throughout it is emphasized that the quantities required are trivial to compute in a Markov chain Monte Carlo analysis.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Nonlinear regression modeling of nutrient loads in streams: A Bayesian approach
TL;DR: In this paper, a Bayesian nonlinear regression modeling method is introduced and compared with the conventional least squares method for modeling nutrient loads in stream networks, which is used to better model spatial correlation in river basin hydrology and land use for improving the model as a forecasting tool.
A multivariate spatial crash frequency model for identifying sites with promise based on crash types
TL;DR: This study responds to the need for more precise statistical output and proposes a multivariate spatial model for simultaneously modeling crash frequencies for different crash types and found that the multivariate correlation plays a stronger role than the spatial correlation when modelingCrash frequencies in terms of different crash type.
79
Financial literacy and household finances: A Bayesian two-part latent variable modeling approach
TL;DR: Wang et al. as discussed by the authors proposed a Bayesian two-part latent variable model (TPLVM) to investigate the impacts of financial literacy on both sides of the household balance sheet, namely, household debt (secured and unsecured debt) and assets (housing assets and non-housing financial assets) by using a national sample from the China Household Finance Survey (CHFS).
79
Bayesian system identification of a nonlinear dynamical system using a novel variant of Simulated Annealing
TL;DR: This work details the Bayesian identification of a nonlinear dynamical system using a novel MCMC algorithm: ‘Data Annealing’, which allows the Markov chain to easily clear ‘local traps’ in the target distribution.
79
Using hospitalization for ambulatory care sensitive conditions to measure access to primary health care: an application of spatial structural equation modeling
Monir Hossain,James N. Laditka +1 more
TL;DR: This work applied the confirmatory factor analysis approach, using the Bayesian paradigm, to identify the spatial distribution of latent factors associated with access to primary health care, as measured by hospitalizations for ambulatory care sensitive conditions in South Carolina.
References
A new look at the statistical model identification
TL;DR: In this article, a new estimate minimum information theoretical criterion estimate (MAICE) is introduced for the purpose of statistical identification, which is free from the ambiguities inherent in the application of conventional hypothesis testing procedure.
•Book
Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach
Kenneth P. Burnham,David E. Anderson +1 more
- 19 Jun 2013
TL;DR: The second edition of this book is unique in that it focuses on methods for making formal statistical inference from all the models in an a priori set (Multi-Model Inference).
45.1K
Estimating the Dimension of a Model
TL;DR: In this paper, the problem of selecting one of a number of models of different dimensions is treated by finding its Bayes solution, and evaluating the leading terms of its asymptotic expansion.
Estimating the dimension of a model
Gideon Schwarz
- 01 Jan 2005
TL;DR: In this paper, the problem of selecting one of a number of models of different dimensions is treated by finding its Bayes solution, and evaluating the leading terms of its asymptotic expansion.
40.6K
•Proceedings Article
Information Theory and an Extention of the Maximum Likelihood Principle
H. Akaike
- 01 Jan 1973
TL;DR: The classical maximum likelihood principle can be considered to be a method of asymptotic realization of an optimum estimate with respect to a very general information theoretic criterion to provide answers to many practical problems of statistical model fitting.
20.2K