-
Long-term accuracy of numerical approximations of SPDEs with the stochastic Navier-Stokes equations as a paradigm
Authors:
Nathan E. Glatt-Holtz,
Cecilia F. Mondaini
Abstract:
This work introduces a general framework for establishing the long time accuracy for approximations of Markovian dynamical systems on separable Banach spaces. Our results illuminate the role that a certain uniformity in Wasserstein contraction rates for the approximating dynamics bears on long time accuracy estimates. In particular, our approach yields weak consistency bounds on $\mathbb{R}^+$ whi…
▽ More
This work introduces a general framework for establishing the long time accuracy for approximations of Markovian dynamical systems on separable Banach spaces. Our results illuminate the role that a certain uniformity in Wasserstein contraction rates for the approximating dynamics bears on long time accuracy estimates. In particular, our approach yields weak consistency bounds on $\mathbb{R}^+$ while providing a means to sidestep** a commonly occurring situation where certain higher order moment bounds are unavailable for the approximating dynamics. Additionally, to facilitate the analytical core of our approach, we develop a refinement of certain `weak Harris theorems'. This extension expands the scope of applicability of such Wasserstein contraction estimates to a variety of interesting SPDE examples involving weaker dissipation or stronger nonlinearity than would be covered by the existing literature.
As a guiding and paradigmatic example, we apply our formalism to the stochastic 2D Navier-Stokes equations and to a semi-implicit in time and spectral Galerkin in space numerical approximation of this system. In the case of a numerical approximation, we establish quantitative estimates on the approximation of invariant measures as well as prove weak consistency on $\mathbb{R}^+$. To develop these numerical analysis results, we provide a refinement of $L^2_x$ accuracy bounds in comparison to the existing literature which are results of independent interest.
△ Less
Submitted 2 February, 2023;
originally announced February 2023.
-
Parallel MCMC Algorithms: Theoretical Foundations, Algorithm Design, Case Studies
Authors:
Nathan E. Glatt-Holtz,
Andrew J. Holbrook,
Justin A. Krometis,
Cecilia F. Mondaini
Abstract:
Parallel Markov Chain Monte Carlo (pMCMC) algorithms generate clouds of proposals at each step to efficiently resolve a target probability distribution. We build a rigorous foundational framework for pMCMC algorithms that situates these methods within a unified `extended phase space' measure-theoretic formalism. Drawing on our recent work that provides a comprehensive theory for reversible single…
▽ More
Parallel Markov Chain Monte Carlo (pMCMC) algorithms generate clouds of proposals at each step to efficiently resolve a target probability distribution. We build a rigorous foundational framework for pMCMC algorithms that situates these methods within a unified `extended phase space' measure-theoretic formalism. Drawing on our recent work that provides a comprehensive theory for reversible single proposal methods, we herein derive general criteria for multiproposal acceptance mechanisms which yield unbiased chains on general state spaces. Our formulation encompasses a variety of methodologies, including proposal cloud resampling and Hamiltonian methods, while providing a basis for the derivation of novel algorithms. In particular, we obtain a top-down picture for a class of methods arising from `conditionally independent' proposal structures. As an immediate application, we identify several new algorithms including a multiproposal version of the popular preconditioned Crank-Nicolson (pCN) sampler suitable for high- and infinite-dimensional target measures which are absolutely continuous with respect to a Gaussian base measure. To supplement our theoretical results, we carry out a selection of numerical case studies that evaluate the efficacy of these novel algorithms. First, noting that the true potential of pMCMC algorithms arises from their natural parallelizability, we provide a limited parallelization study using TensorFlow and a graphics processing unit to scale pMCMC algorithms that leverage as many as 100k proposals at each step. Second, we use our multiproposal pCN algorithm (mpCN) to resolve a selection of problems in Bayesian statistical inversion for partial differential equations motivated by fluid measurement. These examples provide preliminary evidence of the efficacy of mpCN for high-dimensional target distributions featuring complex geometries and multimodal structures.
△ Less
Submitted 10 September, 2022;
originally announced September 2022.
-
On the accept-reject mechanism for Metropolis-Hastings algorithms
Authors:
Nathan E. Glatt-Holtz,
Justin A. Krometis,
Cecilia F. Mondaini
Abstract:
This work develops a powerful and versatile framework for determining acceptance ratios in Metropolis-Hastings type Markov kernels widely used in statistical sampling problems. Our approach allows us to derive new classes of kernels which unify random walk or diffusion-type sampling methods with more complicated "extended phase space" algorithms based around ideas from Hamiltonian dynamics. Our st…
▽ More
This work develops a powerful and versatile framework for determining acceptance ratios in Metropolis-Hastings type Markov kernels widely used in statistical sampling problems. Our approach allows us to derive new classes of kernels which unify random walk or diffusion-type sampling methods with more complicated "extended phase space" algorithms based around ideas from Hamiltonian dynamics. Our starting point is an abstract result developed in the generality of measurable state spaces that addresses proposal kernels that possess a certain involution structure. Note that, while this underlying proposal structure suggests a scope which includes Hamiltonian-type kernels, we demonstrate that our abstract result is, in an appropriate sense, equivalent to an earlier general state space setting developed in [Tierney, Annals of Applied Probability, 1998] where the connection to Hamiltonian methods was more obscure. Altogether, the theoretical unity and reach of our main result provides a basis for deriving novel sampling algorithms while laying bare important relationships between existing methods.
△ Less
Submitted 19 July, 2021; v1 submitted 9 November, 2020;
originally announced November 2020.
-
Mixing Rates for Hamiltonian Monte Carlo Algorithms in Finite and Infinite Dimensions
Authors:
Nathan E. Glatt-Holtz,
Cecilia F. Mondaini
Abstract:
We establish the geometric ergodicity of the preconditioned Hamiltonian Monte Carlo (HMC) algorithm defined on an infinite-dimensional Hilbert space, as developed in [Beskos et al., Stochastic Process. Appl., 2011]. This algorithm can be used as a basis to sample from certain classes of target measures which are absolutely continuous with respect to a Gaussian measure. Our work addresses an open q…
▽ More
We establish the geometric ergodicity of the preconditioned Hamiltonian Monte Carlo (HMC) algorithm defined on an infinite-dimensional Hilbert space, as developed in [Beskos et al., Stochastic Process. Appl., 2011]. This algorithm can be used as a basis to sample from certain classes of target measures which are absolutely continuous with respect to a Gaussian measure. Our work addresses an open question posed in [Beskos et al., Stochastic Process. Appl., 2011], and provides an alternative to a recent proof based on exact coupling techniques given in arXiv:1909.07962. The approach here establishes convergence in a suitable Wasserstein distance by using the weak Harris theorem together with a generalized coupling argument. We also show that a law of large numbers and central limit theorem can be derived as a consequence of our main convergence result. Moreover, our approach yields a novel proof of mixing rates for the classical finite-dimensional HMC algorithm. As such, the methodology we develop provides a flexible framework to tackle the rigorous convergence of other Markov Chain Monte Carlo algorithms. Additionally, we show that the scope of our result includes certain measures that arise in the Bayesian approach to inverse PDE problems, cf. [Stuart, Acta Numer., 2010]. Particularly, we verify all of the required assumptions for a certain class of inverse problems involving the recovery of a divergence free vector field from a passive scalar, arXiv:1808.01084v3.
△ Less
Submitted 17 March, 2020;
originally announced March 2020.
-
Uniform in time error estimates for fully discrete numerical schemes of a data assimilation algorithm
Authors:
Hussain A. Ibdah,
Cecilia F. Mondaini,
Edriss S. Titi
Abstract:
We consider fully discrete numerical schemes for a downscaling data assimilation algorithm aimed at approximating the velocity field of the 2D Navier-Stokes equations corresponding to given coarse mesh observational measurements. The time discretization is done by considering semi- and fully-implicit Euler schemes, and the spatial discretization is based on a spectral Galerkin method. The two full…
▽ More
We consider fully discrete numerical schemes for a downscaling data assimilation algorithm aimed at approximating the velocity field of the 2D Navier-Stokes equations corresponding to given coarse mesh observational measurements. The time discretization is done by considering semi- and fully-implicit Euler schemes, and the spatial discretization is based on a spectral Galerkin method. The two fully discrete algorithms are shown to be unconditionally stable, with respect to the size of the time step, number of time steps and the number of Galerkin modes. Moreover, explicit, uniform in time error estimates between the fully discrete solution and the reference solution corresponding to the observational coarse mesh measurements are obtained, in both the $L^2$ and $H^1$ norms. Notably, the two-dimensional Navier-Stokes equations, subject to the no-slip Dirichlet or periodic boundary conditions, are used in this work as a paradigm. The complete analysis that is presented here can be extended to other two- and three-dimensional dissipative systems under the assumption of global existence and uniqueness.
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
-
Downscaling data assimilation algorithm with applications to statistical solutions of the Navier-Stokes equations
Authors:
Animikh Biswas,
Ciprian Foias,
Cecilia F. Mondaini,
Edriss S. Titi
Abstract:
Based on a previously introduced downscaling data assimilation algorithm, which employs a nudging term to synchronize the coarse mesh spatial scales, we construct a determining map for recovering the full trajectories from their corresponding coarse mesh spatial trajectories, and investigate its properties. This map is then used to develop a downscaling data assimilation scheme for statistical sol…
▽ More
Based on a previously introduced downscaling data assimilation algorithm, which employs a nudging term to synchronize the coarse mesh spatial scales, we construct a determining map for recovering the full trajectories from their corresponding coarse mesh spatial trajectories, and investigate its properties. This map is then used to develop a downscaling data assimilation scheme for statistical solutions of the two-dimensional Navier-Stokes equations, where the coarse mesh spatial statistics of the system is obtained from discrete spatial measurements. As a corollary, we deduce that statistical solutions for the Navier-Stokes equations are determined by their coarse mesh spatial distributions. Notably, we present our results in the context of the Navier-Stokes equations; however, the tools are general enough to be implemented for other dissipative evolution equations.
△ Less
Submitted 3 January, 2018; v1 submitted 10 November, 2017;
originally announced November 2017.
-
Postprocessing Galerkin method applied to a data assimilation algorithm: a uniform in time error estimate
Authors:
Cecilia F. Mondaini,
Edriss S. Titi
Abstract:
We apply the Postprocessing Galerkin method to a recently introduced continuous data assimilation (downscaling) algorithm for obtaining a numerical approximation of the solution of the two-dimensional Navier-Stokes equations corresponding to given measurements from a coarse spatial mesh. Under suitable conditions on the relaxation (nudging) parameter, the resolution of the coarse spatial mesh and…
▽ More
We apply the Postprocessing Galerkin method to a recently introduced continuous data assimilation (downscaling) algorithm for obtaining a numerical approximation of the solution of the two-dimensional Navier-Stokes equations corresponding to given measurements from a coarse spatial mesh. Under suitable conditions on the relaxation (nudging) parameter, the resolution of the coarse spatial mesh and the resolution of the numerical scheme, we obtain uniform in time estimates for the error between the numerical approximation given by the Postprocessing Galerkin method and the reference solution corresponding to the measurements. Our results are valid for a large class of interpolant operators, including low Fourier modes and local averages over finite volume elements. Notably, we use here the 2D Navier-Stokes equations as a paradigm, but our results apply equally to other evolution equations, such as the Boussinesq system of Benard convection and other oceanic and atmospheric circulation models.
△ Less
Submitted 21 December, 2016;
originally announced December 2016.
-
A discrete data assimilation scheme for the solutions of the 2D Navier-Stokes equations and their statistics
Authors:
Ciprian Foias,
Cecilia F. Mondaini,
Edriss S. Titi
Abstract:
We adapt a previously introduced continuous in time data assimilation (downscaling) algorithm for the 2D Navier-Stokes equations to the more realistic case when the measurements are obtained discretely in time and may be contaminated by systematic errors. Our algorithm is designed to work with a general class of observables, such as low Fourier modes and local spatial averages over finite volume e…
▽ More
We adapt a previously introduced continuous in time data assimilation (downscaling) algorithm for the 2D Navier-Stokes equations to the more realistic case when the measurements are obtained discretely in time and may be contaminated by systematic errors. Our algorithm is designed to work with a general class of observables, such as low Fourier modes and local spatial averages over finite volume elements. Under suitable conditions on the relaxation (nudging) parameter, the spatial mesh resolution and the time step between successive measurements, we obtain an asymptotic in time estimate of the difference between the approximating solution and the unknown reference solution corresponding to the measurements, in an appropriate norm, which shows exponential convergence up to a term which depends on the size of the errors. A stationary statistical analysis of our discrete data assimilation algorithm is also provided.
△ Less
Submitted 21 May, 2016; v1 submitted 18 February, 2016;
originally announced February 2016.
-
Abstract Framework for the Theory of Statistical Solutions
Authors:
Anne C. Bronzi,
Cecilia F. Mondaini,
Ricardo M. S. Rosa
Abstract:
An abstract framework for the theory of statistical solutions is developed for general evolution equations, extending the theory initially developed for the three-dimensional incompressible Navier-Stokes equations. The motivation for this concept is to model the evolution of uncertainties on the initial conditions for systems which have global solutions that are not known to be unique. Both concep…
▽ More
An abstract framework for the theory of statistical solutions is developed for general evolution equations, extending the theory initially developed for the three-dimensional incompressible Navier-Stokes equations. The motivation for this concept is to model the evolution of uncertainties on the initial conditions for systems which have global solutions that are not known to be unique. Both concepts of statistical solution in trajectory space and in phase space are given, and the corresponding results of existence of statistical solution for the associated initial value problems are proved. The wide applicability of the theory is illustrated with the very incompressible Navier-Stokes equations, a reaction-diffusion equation, and a nonlinear wave equation, all displaying the property of global existence of weak solutions without a known result of global uniqueness.
△ Less
Submitted 9 September, 2015; v1 submitted 23 March, 2015;
originally announced March 2015.
