Journal Article10.48550/arXiv.2301.11040
Random Grid Neural Processes for Parametric Partial Differential Equations
Arnaud Vadeboncoeur,Ieva Kazlauskaite,Y. Papandreou,Fehmi Cirak,Mark Girolami,O. D. Akyildiz +5 more
8
TL;DR: In this paper , a grid-invariant convolutional neural network (GICNets) is proposed to solve forward and inverse problems for parametric PDEs in a way that leads to the construction of Gaussian process models of solution fields.
read more
Abstract: We introduce a new class of spatially stochastic physics and data informed deep latent models for parametric partial differential equations (PDEs) which operate through scalable variational neural processes. We achieve this by assigning probability measures to the spatial domain, which allows us to treat collocation grids probabilistically as random variables to be marginalised out. Adapting this spatial statistics view, we solve forward and inverse problems for parametric PDEs in a way that leads to the construction of Gaussian process models of solution fields. The implementation of these random grids poses a unique set of challenges for inverse physics informed deep learning frameworks and we propose a new architecture called Grid Invariant Convolutional Networks (GICNets) to overcome these challenges. We further show how to incorporate noisy data in a principled manner into our physics informed model to improve predictions for problems where data may be available but whose measurement location does not coincide with any fixed mesh or grid. The proposed method is tested on a nonlinear Poisson problem, Burgers equation, and Navier-Stokes equations, and we provide extensive numerical comparisons. We demonstrate significant computational advantages over current physics informed neural learning methods for parametric PDEs while improving the predictive capabilities and flexibility of these models.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Fully probabilistic deep models for forward and inverse problems in parametric PDEs
TL;DR: The proposed methodology does not require any independent PDE solves and is physics-informed at training time, allowing the real-time solution of PDE forward and inverse problems after training, while outputting coherent uncertainty estimates.
Generating synthetic data for neural operators
TL;DR: This paper proposes a new approach to generating synthetic functional training data that does not require solving a PDE numerically, and considers $(f_j, u_j)_{j=1}^N$ as supervised training data for learning the underlying inverse problem $f \rightarrow u$.
3
Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
Matthaios Chatzopoulos,Phaedon‐Stelios Koutsourelakis +1 more
- 29 May 2024
TL;DR: Physics-Aware Neural Implicit Solvers (PANIS) learn surrogates for parametrized PDEs with applications in heterogeneous media, enabling generalization and probabilistic uncertainty quantification.
$\Phi$-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilation
Alex Glyn-Davies,Deniz Akyildiz,Mark Girolami +2 more
- 30 Sep 2022
TL;DR: In this article , a variational autoencoder (VAE) is used to encode unstructured data streams into time-evolving physical systems described by differential equations, where the mapping from data-space to model-space is unknown.
1
R\'enyi Neural Processes
Xuesong Wang,He Zhu,Edwin V. Bonilla +2 more
- 24 May 2024
TL;DR: R\'enyi Neural Processes (RNPs) alleviate the impact of misspecified priors in Neural Processes by employing the R\'enyi divergence instead of the standard KL divergence. This results in a tighter bound of the marginal likelihood and improved performance on various tasks.
References
•Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
- 01 Jan 2015
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
138.5K
•Proceedings Article
Auto-Encoding Variational Bayes
Diederik P. Kingma,Max Welling +1 more
- 01 Jan 2014
TL;DR: A stochastic variational inference and learning algorithm that scales to large datasets and, under some mild differentiability conditions, even works in the intractable case is introduced.
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
TL;DR: In this article, the authors introduce physics-informed neural networks, which are trained to solve supervised learning tasks while respecting any given laws of physics described by general nonlinear partial differential equations.
11.6K
Gaussian Processes For Machine Learning
Tanja Hueber
- 01 Jan 2016
TL;DR: The gaussian processes for machine learning is universally compatible with any devices to read, and is available in the digital library an online access to it is set as public so you can get it instantly.
10K
Gaussian processes in machine learning
TL;DR: In this paper, the authors give a basic introduction to Gaussian Process regression models and present the simple equations for incorporating training data and examine how to learn the hyperparameters using the marginal likelihood.