Bayesian Model Averaging: A Tutorial
TL;DR: Bayesian model averaging (BMA) provides a coherent mechanism for ac- counting for this model uncertainty and provides improved out-of- sample predictive performance.
read more
Abstract: Standard statistical practice ignores model uncertainty. Data analysts typically select a model from some class of models and then proceed as if the selected model had generated the data. This approach ignores the uncertainty in model selection, leading to over-confident inferences and decisions that are more risky than one thinks they are. Bayesian model averaging (BMA)provides a coherent mechanism for accounting for this model uncertainty. Several methods for implementing BMA have recently emerged. We discuss these methods and present a number of examples.In these examples, BMA provides improved out-of-sample predictive performance. We also provide a catalogue of currently available BMA software.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Multimodel Inference Understanding AIC and BIC in Model Selection
TL;DR: Various facets of such multimodel inference are presented here, particularly methods of model averaging, which can be derived as a non-Bayesian result.
10.7K
Bayesian Model Averaging: A Tutorial
TL;DR: Bayesian model averaging (BMA) provides a coherent mechanism for ac- counting for this model uncertainty and provides improved out-of- sample predictive performance.
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
TL;DR: A unified approach is proposed that makes it possible for researchers to preprocess data with matching and then to apply the best parametric techniques they would have used anyway and this procedure makes parametric models produce more accurate and considerably less model-dependent causal inferences.
Model Selection and Model Averaging in Phylogenetics: Advantages of Akaike Information Criterion and Bayesian Approaches Over Likelihood Ratio Tests
David Posada,Thomas R. Buckley +1 more
TL;DR: It is argued that the most commonly implemented model selection approach, the hierarchical likelihood ratio test, is not the optimal strategy for model selection in phylogenetics, and that approaches like the Akaike Information Criterion (AIC) and Bayesian methods offer important advantages.
4K
Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
TL;DR: In this article, leave-one-out cross-validation (LOO) and the widely applicable information criterion (WAIC) are used to estimate pointwise out-of-sample prediction accuracy from a fitted Bayesian model using the log-likelihood evaluated at the posterior simulations of the parameter values.
References
Uncertainty, Policy Analysis and Statistics
TL;DR: The types of uncertainty, current methods as tools for characterizing and characterizing them, and the types of tradeoffs that analysts must make in applying statistical methods in problems are described and the bias introduced into deliberations are examined.
Robust Likelihood Calculation for Time Series
TL;DR: In this article, the authors propose a method for computing the likelihoods of a time series under many submodels, each of which assumes a patch of outliers or level shifts.
Birth Defects Registered by Double Sampling: A Bayesian Approach Incorporating Covariates and Model Uncertainty
TL;DR: In this article, the authors developed a Bayesian approach that allows for error in both registries, including covariates (here, the age of the mother) and explicitly accounts for our lack of knowledge about the complexity of the relationships between the variables considered.
On the Accuracy of Meta-learning for Scalable Data Mining
Philip K. Chan,Salvatore J. Stolfo +1 more
- 01 Jan 1997
TL;DR: This paper focussed primarily on issues related to the accuracy and efficacy of meta-learning as ageneral strategy, demonstrating that meta- learning is technically feasible in wide-area, network computing environments.