-
Nested Multilevel Monte Carlo with Biased and Antithetic Sampling
Authors:
Abdul-Lateef Haji-Ali,
Jonathan Spence
Abstract:
We consider the problem of estimating a nested structure of two expectations taking the form $U_0 = E[\max\{U_1(Y), π(Y)\}]$, where $U_1(Y) = E[X\ |\ Y]$. Terms of this form arise in financial risk estimation and option pricing. When $U_1(Y)$ requires approximation, but exact samples of $X$ and $Y$ are available, an antithetic multilevel Monte Carlo (MLMC) approach has been well-studied in the lit…
▽ More
We consider the problem of estimating a nested structure of two expectations taking the form $U_0 = E[\max\{U_1(Y), π(Y)\}]$, where $U_1(Y) = E[X\ |\ Y]$. Terms of this form arise in financial risk estimation and option pricing. When $U_1(Y)$ requires approximation, but exact samples of $X$ and $Y$ are available, an antithetic multilevel Monte Carlo (MLMC) approach has been well-studied in the literature. Under general conditions, the antithetic MLMC estimator obtains a root mean squared error $\varepsilon$ with order $\varepsilon^{-2}$ cost. If, additionally, $X$ and $Y$ require approximate sampling, careful balancing of the various aspects of approximation is required to avoid a significant computational burden. Under strong convergence criteria on approximations to $X$ and $Y$, randomised multilevel Monte Carlo techniques can be used to construct unbiased Monte Carlo estimates of $U_1$, which can be paired with an antithetic MLMC estimate of $U_0$ to recover order $\varepsilon^{-2}$ computational cost. In this work, we instead consider biased multilevel approximations of $U_1(Y)$, which require less strict assumptions on the approximate samples of $X$. Extensions to the method consider an approximate and antithetic sampling of $Y$. Analysis shows the resulting estimator has order $\varepsilon^{-2}$ asymptotic cost under the conditions required by randomised MLMC and order $\varepsilon^{-2}|\log\varepsilon|^3$ cost under more general assumptions.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
Multi-index Importance Sampling for McKean-Vlasov Stochastic Differential Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This work introduces a novel approach that combines the multi-index Monte Carlo (MC) method with importance sampling (IS) to estimate rare event quantities expressed as an expectation of a smooth observable of solutions to a broad class of McKean-Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator, previously introduced in our works (Ben Rached et al.,…
▽ More
This work introduces a novel approach that combines the multi-index Monte Carlo (MC) method with importance sampling (IS) to estimate rare event quantities expressed as an expectation of a smooth observable of solutions to a broad class of McKean-Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator, previously introduced in our works (Ben Rached et al., 2022a,b), to the multi-index setting. We formulate a new multi-index DLMC estimator and conduct a comprehensive cost-error analysis, leading to improved complexity results. To address rare events, an importance sampling scheme is applied using stochastic optimal control of the single level DLMC estimator. This combination of IS and multi-index DLMC not only reduces computational complexity by two orders but also significantly decreases the associated constant compared to vanilla MC. The effectiveness of the proposed multi-index DLMC estimator is demonstrated using the Kuramoto model from statistical physics. The results confirm a reduced complexity from $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ for the single level DLMC estimator (Ben Rached et al., 2022a) to $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-2} (\log \mathrm{TOL}_{\mathrm{r}}^{-1})^2)$ for the considered example, while ensuring accurate estimation of rare event quantities within the prescribed relative error tolerance $\mathrm{TOL}_\mathrm{r}$.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Efficient Risk Estimation for the Credit Valuation Adjustment
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali,
Jonathan Spence
Abstract:
The valuation of over-the-counter derivatives is subject to a series of valuation adjustments known as xVA, which pose additional risks for financial institutions. Associated risk measures, such as the value-at-risk of an underlying valuation adjustment, play an important role in managing these risks. Monte Carlo methods are often regarded as inefficient for computing such measures. As an example,…
▽ More
The valuation of over-the-counter derivatives is subject to a series of valuation adjustments known as xVA, which pose additional risks for financial institutions. Associated risk measures, such as the value-at-risk of an underlying valuation adjustment, play an important role in managing these risks. Monte Carlo methods are often regarded as inefficient for computing such measures. As an example, we consider the value-at-risk of the Credit Valuation Adjustment (CVA-VaR), which can be expressed using a triple nested expectation. Traditional Monte Carlo methods are often inefficient at handling several nested expectations. Utilising recent developments in multilevel nested simulation for probabilities, we construct a hierarchical estimator of the CVA-VaR which reduces the computational complexity by 3 orders of magnitude compared to standard Monte Carlo.
△ Less
Submitted 23 May, 2024; v1 submitted 14 January, 2023;
originally announced January 2023.
-
Multilevel Path Branching for Digital Options
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
We propose a new Monte Carlo-based estimator for digital options with assets modelled by a stochastic differential equation (SDE). The new estimator is based on repeated path splitting and relies on the correlation of approximate paths of the underlying SDE that share parts of a Brownian path. Combining this new estimator with Multilevel Monte Carlo (MLMC) leads to an estimator with a computationa…
▽ More
We propose a new Monte Carlo-based estimator for digital options with assets modelled by a stochastic differential equation (SDE). The new estimator is based on repeated path splitting and relies on the correlation of approximate paths of the underlying SDE that share parts of a Brownian path. Combining this new estimator with Multilevel Monte Carlo (MLMC) leads to an estimator with a computational complexity that is similar to the complexity of a MLMC estimator when applied to options with Lipschitz payoffs.
This preprint includes detailed calculations and proofs (in grey colour) which are not peer-reviewed and not included in the published article.
△ Less
Submitted 18 June, 2024; v1 submitted 7 September, 2022;
originally announced September 2022.
-
Multilevel Importance Sampling for Rare Events Associated With the McKean--Vlasov Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This work combines multilevel Monte Carlo (MLMC) with importance sampling to estimate rare-event quantities that can be expressed as the expectation of a Lipschitz observable of the solution to a broad class of McKean--Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator introduced in this context in (Ben Rached et al., 2023) to the multilevel setting. W…
▽ More
This work combines multilevel Monte Carlo (MLMC) with importance sampling to estimate rare-event quantities that can be expressed as the expectation of a Lipschitz observable of the solution to a broad class of McKean--Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator introduced in this context in (Ben Rached et al., 2023) to the multilevel setting. We formulate a novel multilevel DLMC estimator and perform a comprehensive cost-error analysis yielding new and improved complexity results. Crucially, we devise an antithetic sampler to estimate level differences guaranteeing reduced computational complexity for the multilevel DLMC estimator compared with the single-level DLMC estimator. To address rare events, we apply the importance sampling scheme, obtained via stochastic optimal control in (Ben Rached et al., 2023), over all levels of the multilevel DLMC estimator. Combining importance sampling and multilevel DLMC reduces computational complexity by one order and drastically reduces the associated constant compared to the single-level DLMC estimator without importance sampling. We illustrate the effectiveness of the proposed multilevel DLMC estimator on the Kuramoto model from statistical physics with Lipschitz observables, confirming the reduced complexity from $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ for the single-level DLMC estimator to $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-3})$ while providing a feasible estimate of rare-event quantities up to prescribed relative error tolerance $\mathrm{TOL}_{\mathrm{r}}$.
△ Less
Submitted 8 April, 2024; v1 submitted 5 August, 2022;
originally announced August 2022.
-
Double-Loop Importance Sampling for McKean--Vlasov Stochastic Differential Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This paper investigates Monte Carlo (MC) methods to estimate probabilities of rare events associated with solutions to the $d$-dimensional McKean-Vlasov stochastic differential equation (MV-SDE). MV-SDEs are usually approximated using a stochastic interacting $P$-particle system, which is a set of $P$ coupled $d$-dimensional stochastic differential equations (SDEs). Importance sampling (IS) is a c…
▽ More
This paper investigates Monte Carlo (MC) methods to estimate probabilities of rare events associated with solutions to the $d$-dimensional McKean-Vlasov stochastic differential equation (MV-SDE). MV-SDEs are usually approximated using a stochastic interacting $P$-particle system, which is a set of $P$ coupled $d$-dimensional stochastic differential equations (SDEs). Importance sampling (IS) is a common technique for reducing high relative variance of MC estimators of rare-event probabilities. We first derive a zero-variance IS change of measure for the quantity of interest by using stochastic optimal control theory. However, when this change of measure is applied to stochastic particle systems, it yields a $P \times d$-dimensional partial differential control equation (PDE), which is computationally expensive to solve. To address this issue, we use the decoupling approach introduced in [dos Reis et al., 2023], generating a $d$-dimensional control PDE for a zero-variance estimator of the decoupled SDE. Based on this approach, we develop a computationally efficient double loop MC (DLMC) estimator. We conduct a comprehensive numerical error and work analysis of the DLMC estimator. As a result, we show optimal complexity of $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ with a significantly reduced constant to achieve a prescribed relative error tolerance $\mathrm{TOL}_{\mathrm{r}}$. Subsequently, we propose an adaptive DLMC method combined with IS to numerically estimate rare-event probabilities, substantially reducing relative variance and computational runtimes required to achieve a given $\mathrm{TOL}_{\mathrm{r}}$ compared with standard MC estimators in the absence of IS. Numerical experiments are performed on the Kuramoto model from statistical physics.
△ Less
Submitted 22 October, 2023; v1 submitted 14 July, 2022;
originally announced July 2022.
-
State-dependent Importance Sampling for Estimating Expectations of Functionals of Sums of Independent Random Variables
Authors:
Eya Ben Amar,
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Raúl Tempone
Abstract:
Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive Monte Carlo simulation is an alternative approach. However, this method requires numerous samples for rare event problems. Therefore, it is paramount to use varianc…
▽ More
Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive Monte Carlo simulation is an alternative approach. However, this method requires numerous samples for rare event problems. Therefore, it is paramount to use variance reduction techniques to develop fast and efficient estimation methods. In this work, we use importance sampling (IS), known for its efficiency in requiring fewer computations to achieve the same accuracy requirements. We propose a state-dependent IS scheme based on a stochastic optimal control formulation, where the control is dependent on state and time. We aim to calculate rare event quantities that could be written as an expectation of a functional of the sums of independent RVs. The proposed algorithm is generic and can be applied without restrictions on the univariate distributions of RVs or the functional applied to the sum. We apply this approach to the log-normal distribution to compute the left tail and cumulative distribution of the ratio of independent RVs. For each case, we numerically demonstrate that the proposed state-dependent IS algorithm compares favorably to most well-known estimators dealing with similar problems.
△ Less
Submitted 26 October, 2022; v1 submitted 4 January, 2022;
originally announced January 2022.
-
Adaptive Multilevel Monte Carlo for Probabilities
Authors:
Abdul-Lateef Haji-Ali,
Jonathan Spence,
Aretha Teckentrup
Abstract:
We consider the numerical approximation of $\mathbb{P}[G\in Ω]$ where the $d$-dimensional random variable $G$ cannot be sampled directly, but there is a hierarchy of increasingly accurate approximations $\{G_\ell\}_{\ell\in\mathbb{N}}$ which can be sampled. The cost of standard Monte Carlo estimation scales poorly with accuracy in this setup since it compounds the approximation and sampling cost.…
▽ More
We consider the numerical approximation of $\mathbb{P}[G\in Ω]$ where the $d$-dimensional random variable $G$ cannot be sampled directly, but there is a hierarchy of increasingly accurate approximations $\{G_\ell\}_{\ell\in\mathbb{N}}$ which can be sampled. The cost of standard Monte Carlo estimation scales poorly with accuracy in this setup since it compounds the approximation and sampling cost. A direct application of Multilevel Monte Carlo improves this cost scaling slightly, but returns sub-optimal computational complexities since estimation of the probability involves a discontinuous functional of $G_\ell$. We propose a general adaptive framework which is able to return the MLMC complexities seen for smooth or Lipschitz functionals of $G_\ell$. Our assumptions and numerical analysis are kept general allowing the methods to be used for a wide class of problems. We present numerical experiments on nested simulation for risk estimation, where $G = \mathbb{E}[X|Y]$ is approximated by an inner Monte Carlo estimate. Further experiments are given for digital option pricing, involving an approximation of a $d$-dimensional SDE.
△ Less
Submitted 19 July, 2021;
originally announced July 2021.
-
Efficient Importance Sampling for Large Sums of Independent and Identically Distributed Random Variables
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Gerardo Rubino,
Raul Tempone
Abstract:
We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq γ)$, via importance sampling (IS). We are particularly interested in the rare event regime when $N$ is large and/or $γ$ is small. The exponential twisting is a popular technique for similar problems that…
▽ More
We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq γ)$, via importance sampling (IS). We are particularly interested in the rare event regime when $N$ is large and/or $γ$ is small. The exponential twisting is a popular technique for similar problems that, in most cases, compares favorably to other estimators. However, it has some limitations: i) it assumes the knowledge of the moment generating function of $X_i$ and ii) sampling under the new IS PDF is not straightforward and might be expensive. The aim of this work is to propose an alternative IS PDF that approximately yields, for certain classes of distributions and in the rare event regime, at least the same performance as the exponential twisting technique and, at the same time, does not introduce serious limitations. The first class includes distributions whose probability density functions (PDFs) are asymptotically equivalent, as $x \rightarrow 0$, to $bx^{p}$, for $p>-1$ and $b>0$. For this class of distributions, the Gamma IS PDF with appropriately chosen parameters retrieves approximately, in the rare event regime corresponding to small values of $γ$ and/or large values of $N$, the same performance of the estimator based on the use of the exponential twisting technique. In the second class, we consider the Log-normal setting, whose PDF at zero vanishes faster than any polynomial, and we show numerically that a Gamma IS PDF with optimized parameters clearly outperforms the exponential twisting IS PDF. Numerical experiments validate the efficiency of the proposed estimator in delivering a highly accurate estimate in the regime of large $N$ and/or small $γ$.
△ Less
Submitted 1 October, 2021; v1 submitted 23 January, 2021;
originally announced January 2021.
-
A simple approach to proving the existence, uniqueness, and strong and weak convergence rates for a broad class of McKean--Vlasov equations
Authors:
Abdul-Lateef Haji-Ali,
Håkon Hoel,
Raúl Tempone
Abstract:
By employing a system of interacting stochastic particles as an approximation of the McKean--Vlasov equation and utilizing classical stochastic analysis tools, namely Itô's formula and Kolmogorov--Chentsov continuity theorem, we prove the existence and uniqueness of strong solutions for a broad class of McKean--Vlasov equations. Considering an increasing number of particles in the approximating st…
▽ More
By employing a system of interacting stochastic particles as an approximation of the McKean--Vlasov equation and utilizing classical stochastic analysis tools, namely Itô's formula and Kolmogorov--Chentsov continuity theorem, we prove the existence and uniqueness of strong solutions for a broad class of McKean--Vlasov equations. Considering an increasing number of particles in the approximating stochastic particle system, we also prove the $L^p$ strong convergence rate and derive the weak convergence rates using the Kolmogorov backward equation and variations of the stochastic particle system. Our convergence rates were verified by numerical experiments which also indicate that the assumptions made here and in the literature can be relaxed.
△ Less
Submitted 4 January, 2021;
originally announced January 2021.
-
Sub-sampling and other considerations for efficient risk estimation in large portfolios
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different risk scenarios and (b) evaluating the loss of the portfolio is expensive and the cost increases with its size. In this work, we look at applying Multilevel Monte…
▽ More
Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different risk scenarios and (b) evaluating the loss of the portfolio is expensive and the cost increases with its size. In this work, we look at applying Multilevel Monte Carlo (MLMC) with adaptive inner sampling to this problem and discuss several practical considerations. In particular, we discuss a sub-sampling strategy whose computational complexity does not increase with the size of the portfolio. We also discuss several control variates that significantly improve the efficiency of MLMC in our setting.
△ Less
Submitted 5 April, 2022; v1 submitted 11 December, 2019;
originally announced December 2019.
-
Multilevel nested simulation for efficient risk estimation
Authors:
Michael B. Giles,
Abdul-Lateef Haji-Ali
Abstract:
We investigate the problem of computing a nested expectation of the form $\mathbb{P}[\mathbb{E}[X|Y] \!\geq\!0]\!=\!\mathbb{E}[\textrm{H}(\mathbb{E}[X|Y])]$ where $\textrm{H}$ is the Heaviside function. This nested expectation appears, for example, when estimating the probability of a large loss from a financial portfolio. We present a method that combines the idea of using Multilevel Monte Carlo…
▽ More
We investigate the problem of computing a nested expectation of the form $\mathbb{P}[\mathbb{E}[X|Y] \!\geq\!0]\!=\!\mathbb{E}[\textrm{H}(\mathbb{E}[X|Y])]$ where $\textrm{H}$ is the Heaviside function. This nested expectation appears, for example, when estimating the probability of a large loss from a financial portfolio. We present a method that combines the idea of using Multilevel Monte Carlo (MLMC) for nested expectations with the idea of adaptively selecting the number of samples in the approximation of the inner expectation, as proposed by (Broadie et al., 2011). We propose and analyse an algorithm that adaptively selects the number of inner samples on each MLMC level and prove that the resulting MLMC method with adaptive sampling has an $\mathcal{O}\left( \varepsilon^{-2}|\log\varepsilon|^2 \right)$ complexity to achieve a root mean-squared error $\varepsilon$. The theoretical analysis is verified by numerical experiments on a simple model problem. We also present a stochastic root-finding algorithm that, combined with our adaptive methods, can be used to compute other risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR), with the latter being achieved with $\mathcal{O}\left(\varepsilon^{-2}\right)$ complexity.
△ Less
Submitted 14 February, 2019; v1 submitted 14 February, 2018;
originally announced February 2018.
-
Multilevel weighted least squares polynomial approximation
Authors:
Abdul-Lateef Haji-Ali,
Fabio Nobile,
Raúl Tempone,
Sören Wolfers
Abstract:
Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required to achieve quasi-optimal approximation in a given polynomial subspace scales, up to a logarithmic factor, linearly in the dimension of this space. However, in m…
▽ More
Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required to achieve quasi-optimal approximation in a given polynomial subspace scales, up to a logarithmic factor, linearly in the dimension of this space. However, in many applications, the computation of samples includes a numerical discretization error. Thus, obtaining polynomial approximations with a single level method can become prohibitively expensive, as it requires a sufficiently large number of samples, each computed with a sufficiently small discretization error. As a solution to this problem, we propose a multilevel method that utilizes samples computed with different accuracies and is able to match the accuracy of single-level approximations with reduced computational cost. We derive complexity bounds under certain assumptions about polynomial approximability and sample work. Furthermore, we propose an adaptive algorithm for situations where such assumptions cannot be verified a priori. Finally, we provide an efficient algorithm for the sampling from optimal distributions and an analysis of computationally favorable alternative distributions. Numerical experiments underscore the practical applicability of our method.
△ Less
Submitted 8 October, 2017; v1 submitted 30 June, 2017;
originally announced July 2017.
-
Multilevel and Multi-index Monte Carlo methods for the McKean-Vlasov equation
Authors:
Abdul-Lateef Haji-Ali,
Raul Tempone
Abstract:
We address the approximation of functionals depending on a system of particles, described by stochastic differential equations (SDEs), in the mean-field limit when the number of particles approaches infinity. This problem is equivalent to estimating the weak solution of the limiting McKean-Vlasov SDE. To that end, our approach uses systems with finite numbers of particles and a time-step** schem…
▽ More
We address the approximation of functionals depending on a system of particles, described by stochastic differential equations (SDEs), in the mean-field limit when the number of particles approaches infinity. This problem is equivalent to estimating the weak solution of the limiting McKean-Vlasov SDE. To that end, our approach uses systems with finite numbers of particles and a time-step** scheme. In this case, there are two discretization parameters: the number of time steps and the number of particles. Based on these two parameters, we consider different variants of the Monte Carlo and Multilevel Monte Carlo (MLMC) methods and show that, in the best case, the optimal work complexity of MLMC, to estimate the functional in one typical setting with an error tolerance of $\mathrm{TOL}$, is $\mathcal O\left({\mathrm{TOL}^{-3}}\right)$ when using the partitioning estimator and the Milstein time-step** scheme. We also consider a method that uses the recent Multi-index Monte Carlo method and show an improved work complexity in the same typical setting of $\mathcal O\left(\mathrm{TOL}^{-2}\log(\mathrm{TOL}^{-1})^2\right)$. Our numerical experiments are carried out on the so-called Kuramoto model, a system of coupled oscillators.
△ Less
Submitted 1 May, 2017; v1 submitted 31 October, 2016;
originally announced October 2016.
-
Multi-index Stochastic Collocation convergence rates for random PDEs with parametric regularity
Authors:
Abdul-Lateef Haji-Ali,
Fabio Nobile,
Lorenzo Tamellini,
Raul Tempone
Abstract:
We analyze the recent Multi-index Stochastic Collocation (MISC) method for computing statistics of the solution of a partial differential equation (PDEs) with random data, where the random coefficient is parametrized by means of a countable sequence of terms in a suitable expansion. MISC is a combination technique based on mixed differences of spatial approximations and quadratures over the space…
▽ More
We analyze the recent Multi-index Stochastic Collocation (MISC) method for computing statistics of the solution of a partial differential equation (PDEs) with random data, where the random coefficient is parametrized by means of a countable sequence of terms in a suitable expansion. MISC is a combination technique based on mixed differences of spatial approximations and quadratures over the space of random data and, naturally, the error analysis uses the joint regularity of the solution with respect to both the variables in the physical domain and parametric variables. In MISC, the number of problem solutions performed at each discretization level is not determined by balancing the spatial and stochastic components of the error, but rather by suitably extending the knapsack-problem approach employed in the construction of the quasi-optimal sparse-grids and Multi-index Monte Carlo methods. We use a greedy optimization procedure to select the most effective mixed differences to include in the MISC estimator. We apply our theoretical estimates to a linear elliptic PDEs in which the log-diffusion coefficient is modeled as a random field, with a covariance similar to a Matérn model, whose realizations have spatial regularity determined by a scalar parameter. We conduct a complexity analysis based on a summability argument showing algebraic rates of convergence with respect to the overall computational work. The rate of convergence depends on the smoothness parameter, the physical dimensionality and the efficiency of the linear solver. Numerical experiments show the effectiveness of MISC in this infinite-dimensional setting compared with the Multi-index Monte Carlo method and compare the convergence rate against the rates predicted in our theoretical analysis.
△ Less
Submitted 21 July, 2016; v1 submitted 17 November, 2015;
originally announced November 2015.
-
Novel results for the anisotropic sparse grid quadrature
Authors:
Abdul-Lateef Haji-Ali,
Helmut Harbrecht,
Michael Peters,
Markus Siebenmorgen
Abstract:
This article is dedicated to the anisotropic sparse grid quadrature for functions which are analytically extendable into an anisotropic tensor product domain. Taking into account this anisotropy, we end up with a dimension independent error versus cost estimate of the proposed quadrature. In addition, we provide a novel and improved estimate for the cardinality of the underlying anisotropic index…
▽ More
This article is dedicated to the anisotropic sparse grid quadrature for functions which are analytically extendable into an anisotropic tensor product domain. Taking into account this anisotropy, we end up with a dimension independent error versus cost estimate of the proposed quadrature. In addition, we provide a novel and improved estimate for the cardinality of the underlying anisotropic index set. To validate the theoretical findings, we present several examples ranging from simple quadrature problems to diffusion problems on random domains. These examples demonstrate the remarkable convergence behaviour of the anisotropic sparse grid quadrature in applications.
△ Less
Submitted 9 February, 2018; v1 submitted 18 September, 2015;
originally announced September 2015.
-
Multi-Index Stochastic Collocation for random PDEs
Authors:
Abdul-Lateef Haji-Ali,
Fabio Nobile,
Lorenzo Tamellini,
Raul Tempone
Abstract:
In this work we introduce the Multi-Index Stochastic Collocation method (MISC) for computing statistics of the solution of a PDE with random data. MISC is a combination technique based on mixed differences of spatial approximations and quadratures over the space of random data. We propose an optimization procedure to select the most effective mixed differences to include in the MISC estimator: suc…
▽ More
In this work we introduce the Multi-Index Stochastic Collocation method (MISC) for computing statistics of the solution of a PDE with random data. MISC is a combination technique based on mixed differences of spatial approximations and quadratures over the space of random data. We propose an optimization procedure to select the most effective mixed differences to include in the MISC estimator: such optimization is a crucial step and allows us to build a method that, provided with sufficient solution regularity, is potentially more effective than other multi-level collocation methods already available in literature. We then provide a complexity analysis that assumes decay rates of product type for such mixed differences, showing that in the optimal case the convergence rate of MISC is only dictated by the convergence of the deterministic solver applied to a one dimensional problem. We show the effectiveness of MISC with some computational tests, comparing it with other related methods available in the literature, such as the Multi-Index and Multilevel Monte Carlo, Multilevel Stochastic Collocation, Quasi Optimal Stochastic Collocation and Sparse Composite Collocation methods.
△ Less
Submitted 21 July, 2016; v1 submitted 29 August, 2015;
originally announced August 2015.
-
Multi-Index Monte Carlo: When Sparsity Meets Sampling
Authors:
Abdul-Lateef Haji-Ali,
Fabio Nobile,
Raul Tempone
Abstract:
We propose and analyze a novel Multi-Index Monte Carlo (MIMC) method for weak approximation of stochastic models that are described in terms of differential equations either driven by random measures or with random coefficients. The MIMC method is both a stochastic version of the combination technique introduced by Zenger, Griebel and collaborators and an extension of the Multilevel Monte Carlo (M…
▽ More
We propose and analyze a novel Multi-Index Monte Carlo (MIMC) method for weak approximation of stochastic models that are described in terms of differential equations either driven by random measures or with random coefficients. The MIMC method is both a stochastic version of the combination technique introduced by Zenger, Griebel and collaborators and an extension of the Multilevel Monte Carlo (MLMC) method first described by Heinrich and Giles. Inspired by Giles's seminal work, we use in MIMC high-order mixed differences instead of using first-order differences as in MLMC to reduce the variance of the hierarchical differences dramatically. This in turn yields new and improved complexity results, which are natural generalizations of Giles's MLMC analysis and which increase the domain of the problem parameters for which we achieve the optimal convergence, $\mathcal{O}(\text{TOL}^{-2}).$ Moreover, in MIMC, the rate of increase of required memory with respect to $\text{TOL}$ is independent of the number of directions up to a logarithmic term which allows far more accurate solutions to be calculated for higher dimensions than what is possible when using MLMC.
We motivate the setting of MIMC by first focusing on a simple full tensor index set. We then propose a systematic construction of optimal sets of indices for MIMC based on properly defined profits that in turn depend on the average cost per sample and the corresponding weak error and variance. Under standard assumptions on the convergence rates of the weak error, variance and work per sample, the optimal index set turns out to be the total degree (TD) type. In some cases, using optimal index sets, MIMC achieves a better rate for the computational complexity than the corresponding rate when using full tensor index sets...
△ Less
Submitted 25 March, 2015; v1 submitted 15 May, 2014;
originally announced May 2014.
-
A Continuation Multilevel Monte Carlo algorithm
Authors:
Nathan Collier,
Abdul-Lateef Haji-Ali,
Fabio Nobile,
Erik von Schwerin,
Raul Tempone
Abstract:
We propose a novel Continuation Multi Level Monte Carlo (CMLMC) algorithm for weak approximation of stochastic models. The CMLMC algorithm solves the given approximation problem for a sequence of decreasing tolerances, ending when the required error tolerance is satisfied. CMLMC assumes discretization hierarchies that are defined a priori for each level and are geometrically refined across levels.…
▽ More
We propose a novel Continuation Multi Level Monte Carlo (CMLMC) algorithm for weak approximation of stochastic models. The CMLMC algorithm solves the given approximation problem for a sequence of decreasing tolerances, ending when the required error tolerance is satisfied. CMLMC assumes discretization hierarchies that are defined a priori for each level and are geometrically refined across levels. The actual choice of computational work across levels is based on parametric models for the average cost per sample and the corresponding weak and strong errors. These parameters are calibrated using Bayesian estimation, taking particular notice of the deepest levels of the discretization hierarchy, where only few realizations are available to produce the estimates. The resulting CMLMC estimator exhibits a non-trivial splitting between bias and statistical contributions. We also show the asymptotic normality of the statistical error in the MLMC estimator and justify in this way our error estimate that allows prescribing both required accuracy and confidence in the final result. Numerical results substantiate the above results and illustrate the corresponding computational savings in examples that are described in terms of differential equations either driven by random measures or with random coefficients.
△ Less
Submitted 1 July, 2014; v1 submitted 11 February, 2014;
originally announced February 2014.
