Multilevel Delayed Acceptance MCMC
TL;DR: A novel Markov chain Monte Carlo method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution is developed and shows that the algorithm satisfies detailed balance, hence is ergodic for the target distribution.
read more
Abstract: We develop a novel Markov chain Monte Carlo (MCMC) method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution. Broadly, the method rewrites the Multilevel MCMC approach of Dodwell et al. (2015) in terms of the Delayed Acceptance (DA) MCMC of Christen&Fox (2005). In particular, DA is extended to use a hierarchy of models of arbitrary depth, and allow subchains of arbitrary length. We show that the algorithm satisfies detailed balance, hence is ergodic for the target distribution. Furthermore, multilevel variance reduction is derived that exploits the multiple levels and subchains, and an adaptive multilevel correction to coarse-level biases is developed. Three numerical examples of Bayesian inverse problems are presented that demonstrate the advantages of these novel methods. The software and examples are available in PyMC3.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Where to drill next? A dual-weighted approach to adaptive optimal design of groundwater surveys
01 Jun 2022
TL;DR: In this paper , a dual-weighted approach was proposed to find the optimal location of the next monitoring well in a 2D groundwater flow model, based on Bayesian optimization and goal-oriented error estimation.
7
Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
TL;DR: In this paper , a multilevel Markov chain Monte Carlo (ML-MCMC) algorithm based on independent Metropolis-Hastings proposals for Bayesian inverse problems is presented.
Lowering the Entry Bar to HPC-Scale Uncertainty Quantification
Linus Seelinger,Anne Reinarz,Jean-Pierre Benezech,Mikkel B. Lykkegaard,Lorenzo Tamellini,Robert Scheichl +5 more
TL;DR: In this paper , the authors propose a parallel software architecture based on UM-Bridge, a universal interface for linking uncertainty quantification and models, which can be used to scale even prototype-grade UQ applications to high performance resources.
3
A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics
Arun Hegde,Elan Weiss,Wolfgang Windl,Habib N. Najm,Cosmin Safta +4 more
TL;DR: A Bayesian calibration framework with embedded model error is proposed for molecular dynamics modeling of metallic alloys, leveraging sparse Gaussian process surrogates and multilevel Markov chain Monte Carlo methods to efficiently sample the posterior distribution and improve model diagnostics.
1
Assessing State-Dependent Crime Patterns in the USA: A Markov Chain Approach
TL;DR: In this paper , the Markov Chain model is used to assess state-dependent crime patterns in the USA, and the transitions between these states simulate the shifts in crime rates, yielding state dependent crime patterns.
References
Equation of state calculations by fast computing machines
TL;DR: In this article, a modified Monte Carlo integration over configuration space is used to investigate the properties of a two-dimensional rigid-sphere system with a set of interacting individual molecules, and the results are compared to free volume equations of state and a four-term virial coefficient expansion.
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
Stuart Geman,Donald Geman +1 more
TL;DR: The analogy between images and statistical mechanics systems is made and the analogous operation under the posterior distribution yields the maximum a posteriori (MAP) estimate of the image given the degraded observations, creating a highly parallel ``relaxation'' algorithm for MAP estimation.
Monte Carlo Sampling Methods Using Markov Chains and Their Applications
TL;DR: A generalization of the sampling method introduced by Metropolis et al. as mentioned in this paper is presented along with an exposition of the relevant theory, techniques of application and methods and difficulties of assessing the error in Monte Carlo estimates.
17.1K
Gaussian processes in machine learning
TL;DR: In this paper, the authors give a basic introduction to Gaussian Process regression models and present the simple equations for incorporating training data and examine how to learn the hyperparameters using the marginal likelihood.
Gaussian processes for machine learning
Carl E. Rasmussen,Christopher K. I. Williams +1 more
- 23 Nov 2005
TL;DR: The book provides a long-needed, systematic and unified treatment of theoretical and practical aspects of GPs in machine learning, targeted at researchers and students in machine learning and applied statistics.
4.6K