-
Efficient Risk Estimation for the Credit Valuation Adjustment
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali,
Jonathan Spence
Abstract:
The valuation of over-the-counter derivatives is subject to a series of valuation adjustments known as xVA, which pose additional risks for financial institutions. Associated risk measures, such as the value-at-risk of an underlying valuation adjustment, play an important role in managing these risks. Monte Carlo methods are often regarded as inefficient for computing such measures. As an example,…
▽ More
The valuation of over-the-counter derivatives is subject to a series of valuation adjustments known as xVA, which pose additional risks for financial institutions. Associated risk measures, such as the value-at-risk of an underlying valuation adjustment, play an important role in managing these risks. Monte Carlo methods are often regarded as inefficient for computing such measures. As an example, we consider the value-at-risk of the Credit Valuation Adjustment (CVA-VaR), which can be expressed using a triple nested expectation. Traditional Monte Carlo methods are often inefficient at handling several nested expectations. Utilising recent developments in multilevel nested simulation for probabilities, we construct a hierarchical estimator of the CVA-VaR which reduces the computational complexity by 3 orders of magnitude compared to standard Monte Carlo.
△ Less
Submitted 23 May, 2024; v1 submitted 14 January, 2023;
originally announced January 2023.
-
MLMC techniques for discontinuous functions
Authors:
Michael B Giles
Abstract:
The Multilevel Monte Carlo (MLMC) approach usually works well when estimating the expected value of a quantity which is a Lipschitz function of intermediate quantities, but if it is a discontinuous function it can lead to a much slower decay in the variance of the MLMC correction. This article reviews the literature on techniques which can be used to overcome this challenge in a variety of differe…
▽ More
The Multilevel Monte Carlo (MLMC) approach usually works well when estimating the expected value of a quantity which is a Lipschitz function of intermediate quantities, but if it is a discontinuous function it can lead to a much slower decay in the variance of the MLMC correction. This article reviews the literature on techniques which can be used to overcome this challenge in a variety of different contexts, and discusses recent developments using either a branching diffusion or adaptive sampling.
△ Less
Submitted 4 September, 2023; v1 submitted 7 January, 2023;
originally announced January 2023.
-
Multilevel Path Branching for Digital Options
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
We propose a new Monte Carlo-based estimator for digital options with assets modelled by a stochastic differential equation (SDE). The new estimator is based on repeated path splitting and relies on the correlation of approximate paths of the underlying SDE that share parts of a Brownian path. Combining this new estimator with Multilevel Monte Carlo (MLMC) leads to an estimator with a computationa…
▽ More
We propose a new Monte Carlo-based estimator for digital options with assets modelled by a stochastic differential equation (SDE). The new estimator is based on repeated path splitting and relies on the correlation of approximate paths of the underlying SDE that share parts of a Brownian path. Combining this new estimator with Multilevel Monte Carlo (MLMC) leads to an estimator with a computational complexity that is similar to the complexity of a MLMC estimator when applied to options with Lipschitz payoffs.
This preprint includes detailed calculations and proofs (in grey colour) which are not peer-reviewed and not included in the published article.
△ Less
Submitted 18 June, 2024; v1 submitted 7 September, 2022;
originally announced September 2022.
-
Effects of round-to-nearest and stochastic rounding in the numerical solution of the heat equation in low precision
Authors:
Matteo Croci,
Michael B. Giles
Abstract:
Motivated by the advent of machine learning, the last few years have seen the return of hardware-supported low-precision computing. Computations with fewer digits are faster and more memory and energy efficient, but can be extremely susceptible to rounding errors. As shown by recent studies into reduced-precision climate simulations, an application that can largely benefit from the advantages of l…
▽ More
Motivated by the advent of machine learning, the last few years have seen the return of hardware-supported low-precision computing. Computations with fewer digits are faster and more memory and energy efficient, but can be extremely susceptible to rounding errors. As shown by recent studies into reduced-precision climate simulations, an application that can largely benefit from the advantages of low-precision computing is the numerical solution of partial differential equations (PDEs). However, a careful implementation and rounding error analysis are required to ensure that sensible results can still be obtained.
In this paper we study the accumulation of rounding errors in the solution of the heat equation, a proxy for parabolic PDEs, via Runge-Kutta finite difference methods using round-to-nearest (RtN) and stochastic rounding (SR). We demonstrate how to implement the scheme to reduce rounding errors and we derive \emph{a priori} estimates for local and global rounding errors. Let $u$ be the unit roundoff. While the worst-case local errors are $O(u)$ with respect to the discretization parameters (mesh size and timestep), the RtN and SR error behavior is substantially different. In fact, the RtN solution always stagnates for small enough $Δt$, and until stagnation the global error grows like $O(uΔt^{-1})$. In contrast, we show that the leading-order errors introduced by SR are zero-mean, independent in space and mean-independent in time, making SR resilient to stagnation and rounding error accumulation. In fact, we prove that for SR the global rounding errors are only $O(uΔt^{-1/4})$ in 1D and are essentially bounded (up to logarithmic factors) in higher dimensions.
△ Less
Submitted 28 March, 2022; v1 submitted 30 October, 2020;
originally announced October 2020.
-
Sub-sampling and other considerations for efficient risk estimation in large portfolios
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different risk scenarios and (b) evaluating the loss of the portfolio is expensive and the cost increases with its size. In this work, we look at applying Multilevel Monte…
▽ More
Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different risk scenarios and (b) evaluating the loss of the portfolio is expensive and the cost increases with its size. In this work, we look at applying Multilevel Monte Carlo (MLMC) with adaptive inner sampling to this problem and discuss several practical considerations. In particular, we discuss a sub-sampling strategy whose computational complexity does not increase with the size of the portfolio. We also discuss several control variates that significantly improve the efficiency of MLMC in our setting.
△ Less
Submitted 5 April, 2022; v1 submitted 11 December, 2019;
originally announced December 2019.
-
Multilevel quasi Monte Carlo methods for elliptic PDEs with random field coefficients via fast white noise sampling
Authors:
M. Croci,
M. B. Giles,
P. E. Farrell
Abstract:
When solving partial differential equations with random fields as coefficients the efficient sampling of random field realisations can be challenging. In this paper we focus on the fast sampling of Gaussian fields using quasi-random points in a finite element and multilevel quasi Monte Carlo (MLQMC) setting. Our method uses the SPDE approach of Lindgren et al.~combined with a new fast algorithm fo…
▽ More
When solving partial differential equations with random fields as coefficients the efficient sampling of random field realisations can be challenging. In this paper we focus on the fast sampling of Gaussian fields using quasi-random points in a finite element and multilevel quasi Monte Carlo (MLQMC) setting. Our method uses the SPDE approach of Lindgren et al.~combined with a new fast algorithm for white noise sampling which is taylored to (ML)QMC. We express white noise as a wavelet series expansion that we divide in two parts. The first part is sampled using quasi-random points and contains a finite number of terms in order of decaying importance to ensure good QMC convergence. The second part is a correction term which is sampled using standard pseudo-random numbers. We show how the sampling of both terms can be performed in linear time and memory complexity in the number of mesh cells via a supermesh construction, yielding an overall linear cost. Furthermore, our technique can be used to enforce the MLQMC coupling even in the case of non-nested mesh hierarchies. We demonstrate the efficacy of our method with numerical experiments.
△ Less
Submitted 1 June, 2021; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Generalised multilevel Picard approximations
Authors:
Michael B. Giles,
Arnulf Jentzen,
Timo Welti
Abstract:
It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). In particular, most of the numerical approximation schemes studied in the scientific literature suffer under the curse of dimensionality in the sense that the number of computational operations needed to compute an approximation with an error of size at…
▽ More
It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). In particular, most of the numerical approximation schemes studied in the scientific literature suffer under the curse of dimensionality in the sense that the number of computational operations needed to compute an approximation with an error of size at most $ \varepsilon > 0 $ grows at least exponentially in the PDE dimension $ d \in \mathbb{N} $ or in the reciprocal of $ \varepsilon $. Recently, so-called full-history recursive multilevel Picard (MLP) approximation methods have been introduced to tackle the problem of approximately solving high-dimensional PDEs. MLP approximation methods currently are, to the best of our knowledge, the only methods for parabolic semi-linear PDEs with general time horizons and general initial conditions for which there is a rigorous proof that they are indeed able to beat the curse of dimensionality. The main purpose of this work is to investigate MLP approximation methods in more depth, to reveal more clearly how these methods can overcome the curse of dimensionality, and to propose a generalised class of MLP approximation schemes, which covers previously analysed MLP approximation schemes as special cases. In particular, we develop an abstract framework in which this class of generalised MLP approximations can be formulated and analysed and, thereafter, apply this abstract framework to derive a computational complexity result for suitable MLP approximations for semi-linear heat equations. These resulting MLP approximations for semi-linear heat equations essentially are generalisations of previously introduced MLP approximations for semi-linear heat equations.
△ Less
Submitted 8 November, 2019;
originally announced November 2019.
-
Multilevel Monte Carlo estimation of the expected value of sample information
Authors:
Tomohiko Hironaka,
Michael B. Giles,
Takashi Goda,
Howard Thom
Abstract:
We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable $Y$ and an inner conditional expectation with respect to the other random variable $θ$. Altho…
▽ More
We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable $Y$ and an inner conditional expectation with respect to the other random variable $θ$. Although the nested (Markov chain) Monte Carlo estimator has been often used in this context, a root-mean-square accuracy of $\varepsilon$ is achieved notoriously at a cost of $O(\varepsilon^{-2-1/α})$, where $α$ denotes the order of convergence of the bias and is typically between $1/2$ and $1$. In this article we propose a novel efficient Monte Carlo estimator of EVSI by applying a multilevel Monte Carlo (MLMC) method. Instead of fixing the number of inner samples for $θ$ as done in the nested Monte Carlo estimator, we consider a geometric progression on the number of inner samples, which yields a hierarchy of estimators on the inner conditional expectation with increasing approximation levels. Based on an elementary telesco** sum, our MLMC estimator is given by a sum of the Monte Carlo estimates of the differences between successive approximation levels on the inner conditional expectation. We show, under a set of assumptions on decision and information models, that successive approximation levels are tightly coupled, which directly proves that our MLMC estimator improves the necessary computational cost to optimal $O(\varepsilon^{-2})$. Numerical experiments confirm the considerable computational savings as compared to the nested Monte Carlo estimator.
△ Less
Submitted 17 August, 2020; v1 submitted 2 September, 2019;
originally announced September 2019.
-
An Adaptive Random Bit Multilevel Algorithm for SDEs
Authors:
Michael B. Giles,
Mario Hefter,
Lukas Mayer,
Klaus Ritter
Abstract:
We study the approximation of expectations $\operatorname{E}(f(X))$ for solutions $X$ of stochastic differential equations and functionals $f$ on the path space by means of Monte Carlo algorithms that only use random bits instead of random numbers. We construct an adaptive random bit multilevel algorithm, which is based on the Euler scheme, the Lévy-Ciesielski representation of the Brownian motion…
▽ More
We study the approximation of expectations $\operatorname{E}(f(X))$ for solutions $X$ of stochastic differential equations and functionals $f$ on the path space by means of Monte Carlo algorithms that only use random bits instead of random numbers. We construct an adaptive random bit multilevel algorithm, which is based on the Euler scheme, the Lévy-Ciesielski representation of the Brownian motion, and asymptotically optimal random bit approximations of the standard normal distribution. We numerically compare this algorithm with the adaptive classical multilevel Euler algorithm for a geometric Brownian motion, an Ornstein-Uhlenbeck process, and a Cox-Ingersoll-Ross process.
△ Less
Submitted 28 February, 2019; v1 submitted 26 February, 2019;
originally announced February 2019.
-
Random Bit Multilevel Algorithms for Stochastic Differential Equations
Authors:
Michael B. Giles,
Mario Hefter,
Lukas Mayer,
Klaus Ritter
Abstract:
We study the approximation of expectations $\E(f(X))$ for solutions $X$ of SDEs and functionals $f \colon C([0,1],\R^r) \to \R$ by means of restricted Monte Carlo algorithms that may only use random bits instead of random numbers. We consider the worst case setting for functionals $f$ from the Lipschitz class w.r.t.\ the supremum norm. We construct a random bit multilevel Euler algorithm and estab…
▽ More
We study the approximation of expectations $\E(f(X))$ for solutions $X$ of SDEs and functionals $f \colon C([0,1],\R^r) \to \R$ by means of restricted Monte Carlo algorithms that may only use random bits instead of random numbers. We consider the worst case setting for functionals $f$ from the Lipschitz class w.r.t.\ the supremum norm. We construct a random bit multilevel Euler algorithm and establish upper bounds for its error and cost. Furthermore, we derive matching lower bounds, up to a logarithmic factor, that are valid for all random bit Monte Carlo algorithms, and we show that, for the given quadrature problem, random bit Monte Carlo algorithms are at least almost as powerful as general randomized algorithms.
△ Less
Submitted 18 January, 2019; v1 submitted 31 August, 2018;
originally announced August 2018.
-
Multilevel Monte Carlo Method for Ergodic SDEs without Contractivity
Authors:
Wei Fang,
Michael B. Giles
Abstract:
This paper proposes a new multilevel Monte Carlo (MLMC) method for the ergodic SDEs which do not satisfy the contractivity condition. By introducing the change of measure technique, we simulate the path with contractivity and add the Radon-Nykodim derivative to the estimator. We can show the strong error of the path is uniformly bounded with respect to $T.$ Moreover, the variance of the new level…
▽ More
This paper proposes a new multilevel Monte Carlo (MLMC) method for the ergodic SDEs which do not satisfy the contractivity condition. By introducing the change of measure technique, we simulate the path with contractivity and add the Radon-Nykodim derivative to the estimator. We can show the strong error of the path is uniformly bounded with respect to $T.$ Moreover, the variance of the new level estimators increase linearly in $T,$ which is a great reduction compared with the exponential increase in standard MLMC. Then the total computational cost is reduced to $O(\varepsilon^{-2}|\log \varepsilon|^{2})$ from $O(\varepsilon^{-3}|\log \varepsilon|)$ of the standard Monte Carlo method. Numerical experiments support our analysis.
△ Less
Submitted 10 December, 2018; v1 submitted 15 March, 2018;
originally announced March 2018.
-
Efficient white noise sampling and coupling for multilevel Monte Carlo with non-nested meshes
Authors:
Matteo Croci,
Michael B. Giles,
Marie E. Rognes,
Patrick E. Farrell
Abstract:
When solving stochastic partial differential equations (SPDEs) driven by additive spatial white noise, the efficient sampling of white noise realizations can be challenging. Here, we present a new sampling technique that can be used to efficiently compute white noise samples in a finite element method and multilevel Monte Carlo (MLMC) setting. The key idea is to exploit the finite element matrix a…
▽ More
When solving stochastic partial differential equations (SPDEs) driven by additive spatial white noise, the efficient sampling of white noise realizations can be challenging. Here, we present a new sampling technique that can be used to efficiently compute white noise samples in a finite element method and multilevel Monte Carlo (MLMC) setting. The key idea is to exploit the finite element matrix assembly procedure and factorize each local mass matrix independently, hence avoiding the factorization of a large matrix. Moreover, in a MLMC framework, the white noise samples must be coupled between subsequent levels. We show how our technique can be used to enforce this coupling even in the case of non-nested mesh hierarchies. We demonstrate the efficacy of our method with numerical experiments. We observe optimal convergence rates for the finite element solution of the elliptic SPDEs of interest in 2D and 3D and we show convergence of the sampled field covariances. In a MLMC setting, a good coupling is enforced and the telesco** sum is respected.
△ Less
Submitted 14 September, 2018; v1 submitted 13 March, 2018;
originally announced March 2018.
-
Multilevel nested simulation for efficient risk estimation
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
We investigate the problem of computing a nested expectation of the form $\mathbb{P}[\mathbb{E}[X|Y] \!\geq\!0]\!=\!\mathbb{E}[\textrm{H}(\mathbb{E}[X|Y])]$ where $\textrm{H}$ is the Heaviside function. This nested expectation appears, for example, when estimating the probability of a large loss from a financial portfolio. We present a method that combines the idea of using Multilevel Monte Carlo…
▽ More
We investigate the problem of computing a nested expectation of the form $\mathbb{P}[\mathbb{E}[X|Y] \!\geq\!0]\!=\!\mathbb{E}[\textrm{H}(\mathbb{E}[X|Y])]$ where $\textrm{H}$ is the Heaviside function. This nested expectation appears, for example, when estimating the probability of a large loss from a financial portfolio. We present a method that combines the idea of using Multilevel Monte Carlo (MLMC) for nested expectations with the idea of adaptively selecting the number of samples in the approximation of the inner expectation, as proposed by (Broadie et al., 2011). We propose and analyse an algorithm that adaptively selects the number of inner samples on each MLMC level and prove that the resulting MLMC method with adaptive sampling has an $\mathcal{O}\left( \varepsilon^{-2}|\log\varepsilon|^2 \right)$ complexity to achieve a root mean-squared error $\varepsilon$. The theoretical analysis is verified by numerical experiments on a simple model problem. We also present a stochastic root-finding algorithm that, combined with our adaptive methods, can be used to compute other risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR), with the latter being achieved with $\mathcal{O}\left(\varepsilon^{-2}\right)$ complexity.
△ Less
Submitted 14 February, 2019; v1 submitted 14 February, 2018;
originally announced February 2018.
-
Combining sparse grids, multilevel MC and QMC for elliptic PDEs with random coefficients
Authors:
Michael B. Giles,
Frances Y. Kuo,
Ian H. Sloan
Abstract:
Building on previous research which generalized multilevel Monte Carlo methods using either sparse grids or Quasi-Monte Carlo methods, this paper considers the combination of all these ideas applied to elliptic PDEs with finite-dimensional uncertainty in the coefficients. It shows the potential for the computational cost to achieve an $O(\varepsilon)$ r.m.s. accuracy to be $O(\varepsilon^{-r})$ wi…
▽ More
Building on previous research which generalized multilevel Monte Carlo methods using either sparse grids or Quasi-Monte Carlo methods, this paper considers the combination of all these ideas applied to elliptic PDEs with finite-dimensional uncertainty in the coefficients. It shows the potential for the computational cost to achieve an $O(\varepsilon)$ r.m.s. accuracy to be $O(\varepsilon^{-r})$ with $r<2$, independently of the spatial dimension of the PDE.
△ Less
Submitted 7 November, 2017;
originally announced November 2017.
-
Multilevel estimation of expected exit times and other functionals of stopped diffusions
Authors:
Michael B. Giles,
Francisco Bernal
Abstract:
This paper proposes and analyses a new multilevel Monte Carlo method for the estimation of mean exit times for multi-dimensional Brownian diffusions, and associated functionals which correspond to solutions to high-dimensional parabolic PDEs through the Feynman-Kac formula. In particular, it is proved that the complexity to achieve an $\varepsilon$ root-mean-square error is…
▽ More
This paper proposes and analyses a new multilevel Monte Carlo method for the estimation of mean exit times for multi-dimensional Brownian diffusions, and associated functionals which correspond to solutions to high-dimensional parabolic PDEs through the Feynman-Kac formula. In particular, it is proved that the complexity to achieve an $\varepsilon$ root-mean-square error is $O(\varepsilon^{-2}\, |\!\log \varepsilon|^3)$.
△ Less
Submitted 1 September, 2018; v1 submitted 20 October, 2017;
originally announced October 2017.
-
Beyond 16GB: Out-of-Core Stencil Computations
Authors:
Istvan Z Reguly,
Gihan R Mudalige,
Michael B Giles
Abstract:
Stencil computations are a key class of applications, widely used in the scientific computing community, and a class that has particularly benefited from performance improvements on architectures with high memory bandwidth. Unfortunately, such architectures come with a limited amount of fast memory, which is limiting the size of the problems that can be efficiently solved. In this paper, we addres…
▽ More
Stencil computations are a key class of applications, widely used in the scientific computing community, and a class that has particularly benefited from performance improvements on architectures with high memory bandwidth. Unfortunately, such architectures come with a limited amount of fast memory, which is limiting the size of the problems that can be efficiently solved. In this paper, we address this challenge by applying the well-known cache-blocking tiling technique to large scale stencil codes implemented using the OPS domain specific language, such as CloverLeaf 2D, CloverLeaf 3D, and OpenSBLI. We introduce a number of techniques and optimisations to help manage data resident in fast memory, and minimise data movement. Evaluating our work on Intel's Knights Landing Platform as well as NVIDIA P100 GPUs, we demonstrate that it is possible to solve 3 times larger problems than the on-chip memory size with at most 15\% loss in efficiency
△ Less
Submitted 26 October, 2017; v1 submitted 7 September, 2017;
originally announced September 2017.
-
Decision-making under uncertainty: using MLMC for efficient estimation of EVPPI
Authors:
Michael B. Giles,
Takashi Goda
Abstract:
In this paper we develop a very efficient approach to the Monte Carlo estimation of the expected value of partial perfect information (EVPPI) that measures the average benefit of knowing the value of a subset of uncertain parameters involved in a decision model. The calculation of EVPPI is inherently a nested expectation problem, with an outer expectation with respect to one random variable $X$ an…
▽ More
In this paper we develop a very efficient approach to the Monte Carlo estimation of the expected value of partial perfect information (EVPPI) that measures the average benefit of knowing the value of a subset of uncertain parameters involved in a decision model. The calculation of EVPPI is inherently a nested expectation problem, with an outer expectation with respect to one random variable $X$ and an inner conditional expectation with respect to the other random variable $Y$. We tackle this problem by using a Multilevel Monte Carlo (MLMC) method (Giles 2008) in which the number of inner samples for $Y$ increases geometrically with level, so that the accuracy of estimating the inner conditional expectation improves and the cost also increases with level. We construct an antithetic MLMC estimator and provide sufficient assumptions on a decision model under which the antithetic property of the estimator is well exploited, and consequently a root-mean-square accuracy of $\varepsilon$ can be achieved at a cost of $O(\varepsilon^{-2})$. Numerical results confirm the considerable computational savings compared to the standard, nested Monte Carlo method for some simple testcases and a more realistic medical application.
△ Less
Submitted 19 March, 2018; v1 submitted 18 August, 2017;
originally announced August 2017.
-
Random Bit Quadrature and Approximation of Distributions on Hilbert Spaces
Authors:
Michael B. Giles,
Mario Hefter,
Lukas Mayer,
Klaus Ritter
Abstract:
We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms, which may only use random bits instead of random numbers. We determine the asymptotics (in some cases sharp up to multiplicative constants, in the other cases shar…
▽ More
We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms, which may only use random bits instead of random numbers. We determine the asymptotics (in some cases sharp up to multiplicative constants, in the other cases sharp up to logarithmic factors) of the corresponding $n$-th minimal error in terms of the decay of the eigenvalues of the covariance operator of $X$. It turns out that, within the margins from above, restricted Monte Carlo algorithms are not inferior to arbitrary Monte Carlo algorithms, and suitable random bit multilevel algorithms are optimal. The analysis of this problem leads to a variant of the quantization problem, namely, the optimal approximation of probability measures on $H$ by uniform distributions supported by a given, finite number of points. We determine the asymptotics (up to multiplicative constants) of the error of the best approximation for the one-dimensional standard normal distribution, for Gaussian measures as above, and for scalar autonomous SDEs.
△ Less
Submitted 14 February, 2018; v1 submitted 18 July, 2017;
originally announced July 2017.
-
Adaptive Multilevel Monte Carlo Approximation of Distribution Functions
Authors:
Mike B. Giles,
Tigran Nagapetyan,
Klaus Ritter
Abstract:
We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an asymptotic analysis of the error and the cost of the algorithm. Furthermore we construct an adaptive version of the algorithm that does not require any a priori…
▽ More
We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an asymptotic analysis of the error and the cost of the algorithm. Furthermore we construct an adaptive version of the algorithm that does not require any a priori knowledge on weak or strong convergence rates. We apply the adaptive algorithm to smooth path-independent and path-dependent functionals and to stopped exit times of SDEs.
△ Less
Submitted 21 June, 2017;
originally announced June 2017.
-
Loop Tiling in Large-Scale Stencil Codes at Run-time with OPS
Authors:
Istvan Z Reguly,
Gihan R Mudalige,
Mike B Giles
Abstract:
The key common bottleneck in most stencil codes is data movement, and prior research has shown that improving data locality through optimisations that schedule across loops do particularly well. However, in many large PDE applications it is not possible to apply such optimisations through compilers because there are many options, execution paths and data per grid point, many dependent on run-time…
▽ More
The key common bottleneck in most stencil codes is data movement, and prior research has shown that improving data locality through optimisations that schedule across loops do particularly well. However, in many large PDE applications it is not possible to apply such optimisations through compilers because there are many options, execution paths and data per grid point, many dependent on run-time parameters, and the code is distributed across different compilation units. In this paper, we adapt the data locality improving optimisation called iteration space slicing for use in large OPS applications both in shared-memory and distributed-memory systems, relying on run-time analysis and delayed execution. We evaluate our approach on a number of applications, observing speedups of 2$\times$ on the Cloverleaf 2D/3D proxy application, which contain 83/141 loops respectively, $3.5\times$ on the linear solver TeaLeaf, and $1.7\times$ on the compressible Navier-Stokes solver OpenSBLI. We demonstrate strong and weak scalability up to 4608 cores of CINECA's Marconi supercomputer. We also evaluate our algorithms on Intel's Knights Landing, demonstrating maintained throughput as the problem size grows beyond 16GB, and we do scaling studies up to 8704 cores. The approach is generally applicable to any stencil DSL that provides per loop data access information.
△ Less
Submitted 26 June, 2017; v1 submitted 3 April, 2017;
originally announced April 2017.
-
Adaptive Euler-Maruyama method for SDEs with non-globally Lipschitz drift: Part II, infinite time interval
Authors:
Wei Fang,
Michael B. Giles
Abstract:
This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of the ergodic SDEs with a drift which is not globally Lipschitz over an infinite time interval. If the timestep is bounded appropriately, we show not only the stability of the numerical solution and the standard strong convergence order, but also that the bound for moments and strong error of the numerical s…
▽ More
This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of the ergodic SDEs with a drift which is not globally Lipschitz over an infinite time interval. If the timestep is bounded appropriately, we show not only the stability of the numerical solution and the standard strong convergence order, but also that the bound for moments and strong error of the numerical solution are uniform in T, which allow us to introduce the adaptive multilevel Monte Carlo. Numerical experiments support our analysis.
△ Less
Submitted 20 March, 2017;
originally announced March 2017.
-
Multilevel Monte Carlo and Improved Timestep** Methods in Atmospheric Dispersion Modelling
Authors:
Grigoris Katsiolides,
Eike H. Müller,
Robert Scheichl,
Tony Shardlow,
Michael B. Giles,
David J. Thomson
Abstract:
A common way to simulate the transport and spread of pollutants in the atmosphere is via stochastic Lagrangian dispersion models. Mathematically, these models describe turbulent transport processes with stochastic differential equations (SDEs). The computational bottleneck is the Monte Carlo algorithm, which simulates the motion of a large number of model particles in a turbulent velocity field; f…
▽ More
A common way to simulate the transport and spread of pollutants in the atmosphere is via stochastic Lagrangian dispersion models. Mathematically, these models describe turbulent transport processes with stochastic differential equations (SDEs). The computational bottleneck is the Monte Carlo algorithm, which simulates the motion of a large number of model particles in a turbulent velocity field; for each particle, a trajectory is calculated with a numerical timestep** method. Choosing an efficient numerical method is particularly important in operational emergency-response applications, such as tracking radioactive clouds from nuclear accidents or predicting the impact of volcanic ash clouds on international aviation, where accurate and timely predictions are essential. In this paper, we investigate the application of the Multilevel Monte Carlo (MLMC) method to simulate the propagation of particles in a representative one-dimensional dispersion scenario in the atmospheric boundary layer. MLMC can be shown to result in asymptotically superior computational complexity and reduced computational cost when compared to the Standard Monte Carlo (StMC) method, which is currently used in atmospheric dispersion modelling. To reduce the absolute cost of the method also in the non-asymptotic regime, it is equally important to choose the best possible numerical timestep** method on each level. To investigate this, we also compare the standard symplectic Euler method, which is used in many operational models, with two improved timestep** algorithms based on SDE splitting methods.
△ Less
Submitted 20 September, 2017; v1 submitted 22 December, 2016;
originally announced December 2016.
-
Adaptive Euler-Maruyama Method for SDEs with Non-globally Lipschitz Drift: Part I, Finite Time Interval
Authors:
Wei Fang,
Michael Bryce Giles
Abstract:
This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of SDEs with a drift which is not globally Lipschitz. It is proved that if the timestep is bounded appropriately, then over a finite time interval the numerical approximation is stable, and the expected number of timesteps is finite. Furthermore, the order of strong convergence is the same as usual, i.e. orde…
▽ More
This paper proposes an adaptive timestep construction for an Euler-Maruyama approximation of SDEs with a drift which is not globally Lipschitz. It is proved that if the timestep is bounded appropriately, then over a finite time interval the numerical approximation is stable, and the expected number of timesteps is finite. Furthermore, the order of strong convergence is the same as usual, i.e. order one-half for SDEs with a non-uniform globally Lipschitz volatility, and order one for Langevin SDEs with unit volatility and a drift with sufficient smoothness. The analysis is supported by numerical experiments for a variety of SDEs.
△ Less
Submitted 26 September, 2016;
originally announced September 2016.
-
Multilevel Monte Carlo methods for the approximation of invariant measures of stochastic differential equations
Authors:
Michael B. Giles,
Mateusz B. Majka,
Lukasz Szpruch,
Sebastian Vollmer,
Konstantinos Zygalakis
Abstract:
We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin equations with a strongly concave potential. We show that, when appropriate contracting couplings for the numerical integrators are available, one can obtain a…
▽ More
We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin equations with a strongly concave potential. We show that, when appropriate contracting couplings for the numerical integrators are available, one can obtain a uniform in time estimate of the MLMC variance in contrast to the majority of the results in the MLMC literature. As a consequence, a root mean square error of $\mathcal{O}(\varepsilon)$ is achieved with $\mathcal{O}(\varepsilon^{-2})$ complexity on par with Markov Chain Monte Carlo (MCMC) methods, which however can be computationally intensive when applied to large data sets. Finally, we present a multi-level version of the recently introduced Stochastic Gradient Langevin Dynamics (SGLD) method (Welling and Teh, 2011) built for large datasets applications. We show that this is the first stochastic gradient MCMC method with complexity $\mathcal{O}(\varepsilon^{-2}|\log {\varepsilon}|^{3})$, in contrast to the complexity $\mathcal{O}(\varepsilon^{-3})$ of currently available methods. Numerical experiments confirm our theoretical findings.
△ Less
Submitted 12 August, 2019; v1 submitted 4 May, 2016;
originally announced May 2016.
-
Extending the multi-level method for the simulation of stochastic biological systems
Authors:
Christopher Lester,
Ruth E. Baker,
Michael B. Giles,
Christian A. Yates
Abstract:
The multi-level method for discrete state systems, first introduced by Anderson and Higham [Multiscale Model. Simul. 10:146--179, 2012], is a highly efficient simulation technique that can be used to elucidate statistical characteristics of biochemical reaction networks. A single point estimator is produced in a cost-effective manner by combining a number of estimators of differing accuracy in a t…
▽ More
The multi-level method for discrete state systems, first introduced by Anderson and Higham [Multiscale Model. Simul. 10:146--179, 2012], is a highly efficient simulation technique that can be used to elucidate statistical characteristics of biochemical reaction networks. A single point estimator is produced in a cost-effective manner by combining a number of estimators of differing accuracy in a telesco** sum, and, as such, the method has the potential to revolutionise the field of stochastic simulation. The first term in the sum is calculated using an approximate simulation algorithm, and can be calculated quickly but is of significant bias. Subsequent terms successively correct this bias by combining estimators from approximate stochastic simulations algorithms of increasing accuracy, until a desired level of accuracy is reached.
In this paper we present several refinements of the multi-level method which render it easier to understand and implement, and also more efficient. Given the substantial and complex nature of the multi-level method, the first part of this work (Sections 2 - 5) is written as a tutorial, with the aim of providing a practical guide to its use. The second part (Sections 6 - 8) takes on a form akin to a research article, thereby providing the means for a deft implementation of the technique, and concludes with a discussion of a number of open problems.
△ Less
Submitted 19 May, 2016; v1 submitted 12 December, 2014;
originally announced December 2014.
-
An adaptive multi-level simulation algorithm for stochastic biological systems
Authors:
Christopher Lester,
Christian A. Yates,
Michael B. Giles,
Ruth E. Baker
Abstract:
Discrete-state, continuous-time Markov models are widely used in the modeling of biochemical reaction networks. Their complexity often precludes analytic solution, and we rely on stochastic simulation algorithms to estimate system statistics. The Gillespie algorithm is exact, but computationally costly as it simulates every single reaction. As such, approximate stochastic simulation algorithms suc…
▽ More
Discrete-state, continuous-time Markov models are widely used in the modeling of biochemical reaction networks. Their complexity often precludes analytic solution, and we rely on stochastic simulation algorithms to estimate system statistics. The Gillespie algorithm is exact, but computationally costly as it simulates every single reaction. As such, approximate stochastic simulation algorithms such as the tau-leap algorithm are often used. Potentially computationally more efficient, the system statistics generated suffer from significant bias unless tau is relatively small, in which case the computational time can be comparable to that of the Gillespie algorithm. The multi-level method (Anderson and Higham, Multiscale Model. Simul. 2012) tackles this problem. A base estimator is computed using many (cheap) sample paths at low accuracy. The bias inherent in this estimator is then reduced using a number of corrections. Each correction term is estimated using a collection of paired sample paths where one path of each pair is generated at a higher accuracy compared to the other (and so more expensive). By sharing random variables between these paired paths the variance of each correction estimator can be reduced. This renders the multi-level method very efficient as only a relatively small number of paired paths are required to calculate each correction term. In the original multi-level method, each sample path is simulated using the tau-leap algorithm with a fixed value of $τ$. This approach can result in poor performance when the reaction activity of a system changes substantially over the timescale of interest. By introducing a novel, adaptive time-step** approach where $τ$ is chosen according to the stochastic behaviour of each sample path we extend the applicability of the multi-level method to such cases. We demonstrate the efficiency of our method using a number of examples.
△ Less
Submitted 12 December, 2014; v1 submitted 5 September, 2014;
originally announced September 2014.
-
A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations
Authors:
Ferran Vidal-Codina,
Ngoc-Cuong Nguyen,
Mike B. Giles,
Jaime Peraire
Abstract:
We present a model and variance reduction method for the fast and reliable computation of statistical outputs of stochastic elliptic partial differential equations. Our method consists of three main ingredients: (1) the hybridizable discontinuous Galerkin (HDG) discretization of elliptic partial differential equations (PDEs), which allows us to obtain high-order accurate solutions of the governing…
▽ More
We present a model and variance reduction method for the fast and reliable computation of statistical outputs of stochastic elliptic partial differential equations. Our method consists of three main ingredients: (1) the hybridizable discontinuous Galerkin (HDG) discretization of elliptic partial differential equations (PDEs), which allows us to obtain high-order accurate solutions of the governing PDE; (2) the reduced basis method for a new HDG discretization of the underlying PDE to enable real-time solution of the parameterized PDE in the presence of stochastic parameters; and (3) a multilevel variance reduction method that exploits the statistical correlation among the different reduced basis approximations and the high-fidelity HDG discretization to accelerate the convergence of the Monte Carlo simulations. The multilevel variance reduction method provides efficient computation of the statistical outputs by shifting most of the computational burden from the high-fidelity
HDG approximation to the reduced basis approximations. Furthermore, we develop \textit{a posteriori} error estimates for our approximations of the statistical outputs. Based on these error estimates, we propose an algorithm for optimally choosing both the dimensions of the reduced basis approximations and the sizes of Monte Carlo samples to achieve a given error tolerance. We provide numerical examples to demonstrate the performance of the proposed method.
△ Less
Submitted 6 April, 2015; v1 submitted 2 September, 2014;
originally announced September 2014.
-
Acceleration of a Full-scale Industrial CFD Application with OP2
Authors:
István Z. Reguly,
Gihan R. Mudalige,
Carlo Bertolli,
Michael B. Giles,
Adam Betts,
Paul H. J. Kelly,
David Radford
Abstract:
Hydra is a full-scale industrial CFD application used for the design of turbomachinery at Rolls Royce plc. It consists of over 300 parallel loops with a code base exceeding 50K lines and is capable of performing complex simulations over highly detailed unstructured mesh geometries. Unlike simpler structured-mesh applications, which feature high speed-ups when accelerated by modern processor archit…
▽ More
Hydra is a full-scale industrial CFD application used for the design of turbomachinery at Rolls Royce plc. It consists of over 300 parallel loops with a code base exceeding 50K lines and is capable of performing complex simulations over highly detailed unstructured mesh geometries. Unlike simpler structured-mesh applications, which feature high speed-ups when accelerated by modern processor architectures, such as multi-core and many-core processor systems, Hydra presents major challenges in data organization and movement that need to be overcome for continued high performance on emerging platforms. We present research in achieving this goal through the OP2 domain-specific high-level framework. OP2 targets the domain of unstructured mesh problems and follows the design of an active library using source-to-source translation and compilation to generate multiple parallel implementations from a single high-level application source for execution on a range of back-end hardware platforms. We chart the conversion of Hydra from its original hand-tuned production version to one that utilizes OP2, and map out the key difficulties encountered in the process. To our knowledge this research presents the first application of such a high-level framework to a full scale production code. Specifically we show (1) how different parallel implementations can be achieved with an active library framework, even for a highly complicated industrial application such as Hydra, and (2) how different optimizations targeting contrasting parallel architectures can be applied to the whole application, seamlessly, reducing developer effort and increasing code longevity. Performance results demonstrate that not only the same runtime performance as that of the hand-tuned original production code could be achieved, but it can be significantly improved on conventional processor systems. Additionally, we achieve further...
△ Less
Submitted 27 March, 2014;
originally announced March 2014.
-
Multilevel Monte Carlo methods
Authors:
Michael B. Giles
Abstract:
The author's presentation of multilevel Monte Carlo path simulation at the MCQMC 2006 conference stimulated a lot of research into multilevel Monte Carlo methods. This paper reviews the progress since then, emphasising the simplicity, flexibility and generality of the multilevel Monte Carlo approach. It also offers a few original ideas and suggests areas for future research.
The author's presentation of multilevel Monte Carlo path simulation at the MCQMC 2006 conference stimulated a lot of research into multilevel Monte Carlo methods. This paper reviews the progress since then, emphasising the simplicity, flexibility and generality of the multilevel Monte Carlo approach. It also offers a few original ideas and suggests areas for future research.
△ Less
Submitted 19 April, 2013;
originally announced April 2013.
-
Analysis of multilevel Monte Carlo path simulation using the Milstein discretisation
Authors:
Michael B. Giles,
Kristian Debrabant,
Andreas Rößler
Abstract:
The multilevel Monte Carlo path simulation method introduced by Giles ({\it Operations Research}, 56(3):607-617, 2008) exploits strong convergence properties to improve the computational complexity by combining simulations with different levels of resolution. In this paper we analyse its efficiency when using the Milstein discretisation; this has an improved order of strong convergence compared to…
▽ More
The multilevel Monte Carlo path simulation method introduced by Giles ({\it Operations Research}, 56(3):607-617, 2008) exploits strong convergence properties to improve the computational complexity by combining simulations with different levels of resolution. In this paper we analyse its efficiency when using the Milstein discretisation; this has an improved order of strong convergence compared to the standard Euler-Maruyama method, and it is proved that this leads to an improved order of convergence of the variance of the multilevel estimator. Numerical results are also given for basket options to illustrate the relevance of the analysis.
△ Less
Submitted 8 June, 2019; v1 submitted 19 February, 2013;
originally announced February 2013.
-
Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients
Authors:
A. L. Teckentrup,
R. Scheichl,
M. B. Giles,
E. Ullmann
Abstract:
We consider the application of multilevel Monte Carlo methods to elliptic PDEs with random coefficients. We focus on models of the random coefficient that lack uniform ellipticity and boundedness with respect to the random parameter, and that only have limited spatial regularity. We extend the finite element error analysis for this type of equation, carried out recently by Charrier, Scheichl and T…
▽ More
We consider the application of multilevel Monte Carlo methods to elliptic PDEs with random coefficients. We focus on models of the random coefficient that lack uniform ellipticity and boundedness with respect to the random parameter, and that only have limited spatial regularity. We extend the finite element error analysis for this type of equation, carried out recently by Charrier, Scheichl and Teckentrup, to more difficult problems, posed on non--smooth domains and with discontinuities in the coefficient. For this wider class of model problem, we prove convergence of the multilevel Monte Carlo algorithm for estimating any bounded, linear functional and any continuously Fréchet differentiable non--linear functional of the solution. We further improve the performance of the multilevel estimator by introducing level dependent truncations of the Karhunen--Loève expansion of the random coefficient. Numerical results complete the paper.
△ Less
Submitted 16 April, 2012;
originally announced April 2012.
-
Stochastic finite differences and multilevel Monte Carlo for a class of SPDEs in finance
Authors:
Michael B. Giles,
Christoph Reisinger
Abstract:
In this article, we propose a Milstein finite difference scheme for a stochastic partial differential equation (SPDE) describing a large particle system. We show, by means of Fourier analysis, that the discretisation on an unbounded domain is convergent of first order in the timestep and second order in the spatial grid size, and that the discretisation is stable with respect to boundary data. Num…
▽ More
In this article, we propose a Milstein finite difference scheme for a stochastic partial differential equation (SPDE) describing a large particle system. We show, by means of Fourier analysis, that the discretisation on an unbounded domain is convergent of first order in the timestep and second order in the spatial grid size, and that the discretisation is stable with respect to boundary data. Numerical experiments clearly indicate that the same convergence order also holds for boundary-value problems. Multilevel path simulation, previously used for SDEs, is shown to give substantial complexity gains compared to a standard discretisation of the SPDE or direct simulation of the particle system. We derive complexity bounds and illustrate the results by an application to basket credit derivatives.
△ Less
Submitted 6 April, 2012;
originally announced April 2012.
-
Antithetic multilevel Monte Carlo estimation for multi-dimensional SDEs without Lévy area simulation
Authors:
Michael B. Giles,
Lukasz Szpruch
Abstract:
In this paper we introduce a new multilevel Monte Carlo (MLMC) estimator for multi-dimensional SDEs driven by Brownian motions. Giles has previously shown that if we combine a numerical approximation with strong order of convergence $O(Δt)$ with MLMC we can reduce the computational complexity to estimate expected values of functionals of SDE solutions with a root-mean-square error of $ε$ from…
▽ More
In this paper we introduce a new multilevel Monte Carlo (MLMC) estimator for multi-dimensional SDEs driven by Brownian motions. Giles has previously shown that if we combine a numerical approximation with strong order of convergence $O(Δt)$ with MLMC we can reduce the computational complexity to estimate expected values of functionals of SDE solutions with a root-mean-square error of $ε$ from $O(ε^{-3})$ to $O(ε^{-2})$. However, in general, to obtain a rate of strong convergence higher than $O(Δt^{1/2})$ requires simulation, or approximation, of Lévy areas. In this paper, through the construction of a suitable antithetic multilevel correction estimator, we are able to avoid the simulation of Lévy areas and still achieve an $O(Δt^2)$ multilevel correction variance for smooth payoffs, and almost an $O(Δt^{3/2})$ variance for piecewise smooth payoffs, even though there is only $O(Δt^{1/2})$ strong convergence. This results in an $O(ε^{-2})$ complexity for estimating the value of European and Asian put and call options.
△ Less
Submitted 16 May, 2014; v1 submitted 28 February, 2012;
originally announced February 2012.
-
The computation of Greeks with multilevel Monte Carlo
Authors:
Sylvestre Burgos,
M. B. Giles
Abstract:
We study the use of the multilevel Monte Carlo technique in the context of the calculation of Greeks. The pathwise sensitivity analysis differentiates the path evolution and reduces the payoff's smoothness. This leads to new challenges: the inapplicability of pathwise sensitivities to non-Lipschitz payoffs often makes the use of naive algorithms impossible. These challenges can be addressed in thr…
▽ More
We study the use of the multilevel Monte Carlo technique in the context of the calculation of Greeks. The pathwise sensitivity analysis differentiates the path evolution and reduces the payoff's smoothness. This leads to new challenges: the inapplicability of pathwise sensitivities to non-Lipschitz payoffs often makes the use of naive algorithms impossible. These challenges can be addressed in three different ways: payoff smoothing using conditional expectations of the payoff before maturity; approximating the previous technique with path splitting for the final timestep; using of a hybrid combination of pathwise sensitivity and the Likelihood Ratio Method. We investigate the strengths and weaknesses of these alternatives in different multilevel Monte Carlo settings.
△ Less
Submitted 7 February, 2011;
originally announced February 2011.
-
On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods
Authors:
Anthony Lee,
Christopher Yau,
Michael B. Giles,
Arnaud Doucet,
Christopher C. Holmes
Abstract:
We present a case-study on the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods. Graphics cards, containing multiple Graphics Processing Units (GPUs), are self-contained parallel computational devices that can be housed in conventional desktop and laptop computers. For certain classes of Monte Carlo algorithms they offer massively parallel simula…
▽ More
We present a case-study on the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods. Graphics cards, containing multiple Graphics Processing Units (GPUs), are self-contained parallel computational devices that can be housed in conventional desktop and laptop computers. For certain classes of Monte Carlo algorithms they offer massively parallel simulation, with the added advantage over conventional distributed multi-core processors that they are cheap, easily accessible, easy to maintain, easy to code, dedicated local devices with low power consumption. On a canonical set of stochastic simulation examples including population-based Markov chain Monte Carlo methods and Sequential Monte Carlo methods, we find speedups from 35 to 500 fold over conventional single-threaded computer code. Our findings suggest that GPUs have the potential to facilitate the growth of statistical modelling into complex data rich domains through the availability of cheap and accessible many-core computation. We believe the speedup we observe should motivate wider use of parallelizable simulation methods and greater methodological attention to their design.
△ Less
Submitted 15 July, 2009; v1 submitted 14 May, 2009;
originally announced May 2009.
