-
One-dimensional quasi-uniform Kronecker sequences
Authors:
Takashi Goda
Abstract:
In this short note, we prove that the one-dimensional Kronecker sequence $iα\bmod 1, i=0,1,2,\ldots,$ is quasi-uniform if and only if $α$ is a badly approximable number. Our elementary proof relies on a result on the three-gap theorem for Kronecker sequences due to Halton (1965).
In this short note, we prove that the one-dimensional Kronecker sequence $iα\bmod 1, i=0,1,2,\ldots,$ is quasi-uniform if and only if $α$ is a badly approximable number. Our elementary proof relies on a result on the three-gap theorem for Kronecker sequences due to Halton (1965).
△ Less
Submitted 25 June, 2024; v1 submitted 25 April, 2024;
originally announced April 2024.
-
A randomized lattice rule without component-by-component construction
Authors:
Takashi Goda
Abstract:
We study the multivariate integration problem for periodic functions from the weighted Korobov space in the randomized setting. We introduce a new randomized rank-1 lattice rule with a randomly chosen number of points, which avoids the need for component-by-component construction in the search for good generating vectors while still achieving nearly the optimal rate of the randomized error. Our id…
▽ More
We study the multivariate integration problem for periodic functions from the weighted Korobov space in the randomized setting. We introduce a new randomized rank-1 lattice rule with a randomly chosen number of points, which avoids the need for component-by-component construction in the search for good generating vectors while still achieving nearly the optimal rate of the randomized error. Our idea is to exploit the fact that at least half of the possible generating vectors yield nearly the optimal rate of the worst-case error in the deterministic setting. By randomly choosing generating vectors $r$ times and comparing their corresponding worst-case errors, one can find one generating vector with a desired worst-case error bound with a very high probability, and the (small) failure probability can be controlled by increasing $r$ logarithmically as a function of the number of points. Numerical experiments are conducted to support our theoretical findings.
△ Less
Submitted 6 June, 2024; v1 submitted 5 March, 2024;
originally announced March 2024.
-
How sharp are error bounds? --lower bounds on quadrature worst-case errors for analytic functions
Authors:
Takashi Goda,
Yoshihito Kazashi,
Ken'ichiro Tanaka
Abstract:
Numerical integration over the real line for analytic functions is studied. Our main focus is on the sharpness of the error bounds. We first derive two general lower estimates for the worst-case integration error, and then apply these to establish lower bounds for various quadrature rules. These bounds turn out to be either novel or improve upon existing results, leading to lower bounds that close…
▽ More
Numerical integration over the real line for analytic functions is studied. Our main focus is on the sharpness of the error bounds. We first derive two general lower estimates for the worst-case integration error, and then apply these to establish lower bounds for various quadrature rules. These bounds turn out to be either novel or improve upon existing results, leading to lower bounds that closely match upper bounds for various formulas. Specifically, for the suitably truncated trapezoidal rule, we improve upon general lower bounds on the worst-case error obtained by Sugihara [\textit{Numer. Math.}, 75 (1997), pp.~379--395] and provide exceptionally sharp lower bounds apart from a polynomial factor, in particular show that the worst-case error for the trapezoidal rule by Sugihara is not improvable more than a polynomial factor. Additionally, our research reveals a discrepancy between the error decay of the trapezoidal rule and Sugihara's lower bound for general numerical integration rules, introducing a new open problem. Moreover, Gauss--Hermite quadrature is proven sub-optimal under the decay conditions on integrands we consider, a result not deducible from upper-bound arguments alone. Furthermore, to establish the near-optimality of the suitably scaled Gauss--Legendre and Clenshaw--Curtis quadratures, we generalize a recent result of Trefethen [\textit{SIAM Rev.}, 64 (2022), pp.~132--150] for the upper error bounds in terms of the decay conditions.
△ Less
Submitted 13 January, 2024;
originally announced January 2024.
-
The Sobol' sequence is not quasi-uniform in dimension 2
Authors:
Takashi Goda
Abstract:
Are common quasi-Monte Carlo sequences quasi-uniform? While this question remains widely open, in this short note, we prove that the two-dimensional Sobol' sequence is not quasi-uniform. This result partially answers an unsolved problem of Sobol' and Shukhman (2007) in a negative manner.
Are common quasi-Monte Carlo sequences quasi-uniform? While this question remains widely open, in this short note, we prove that the two-dimensional Sobol' sequence is not quasi-uniform. This result partially answers an unsolved problem of Sobol' and Shukhman (2007) in a negative manner.
△ Less
Submitted 22 January, 2024; v1 submitted 9 November, 2023;
originally announced November 2023.
-
Estimating nested expectations without inner conditional sampling and application to value of information analysis
Authors:
Tomohiko Hironaka,
Takashi Goda
Abstract:
Motivated by various computational applications, we investigate the problem of estimating nested expectations. Building upon recent work by the authors, we propose a novel Monte Carlo estimator for nested expectations, inspired by sparse grid quadrature, that does not require sampling from inner conditional distributions. Theoretical analysis establishes an upper bound on the mean squared error of…
▽ More
Motivated by various computational applications, we investigate the problem of estimating nested expectations. Building upon recent work by the authors, we propose a novel Monte Carlo estimator for nested expectations, inspired by sparse grid quadrature, that does not require sampling from inner conditional distributions. Theoretical analysis establishes an upper bound on the mean squared error of our estimator under mild assumptions on the problem, demonstrating its efficiency for cases with low-dimensional outer variables. We illustrate the effectiveness of our estimator through its application to problems related to value of information analysis, with moderate dimensionality. Overall, our method presents a promising approach to efficiently estimate nested expectations in practical computational settings.
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
Strong tractability for multivariate integration in a subspace of the Wiener algebra
Authors:
Takashi Goda
Abstract:
Building upon recent work by the author, we prove that multivariate integration in the following subspace of the Wiener algebra over $[0,1)^d$ is strongly polynomially tractable: \[ F_d:=\left\{ f\in C([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^{d}}|\hat{f}(\boldsymbol{k})|\max\left(\mathrm{width}(\mathrm{supp}(\boldsymbol{k})),\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_…
▽ More
Building upon recent work by the author, we prove that multivariate integration in the following subspace of the Wiener algebra over $[0,1)^d$ is strongly polynomially tractable: \[ F_d:=\left\{ f\in C([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^{d}}|\hat{f}(\boldsymbol{k})|\max\left(\mathrm{width}(\mathrm{supp}(\boldsymbol{k})),\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right)<\infty \right\},\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$, $\mathrm{supp}(\boldsymbol{k}):=\{j\in \{1,\ldots,d\}\mid k_j\neq 0\}$, and $\mathrm{width}: 2^{\{1,\ldots,d\}}\to \{1,\ldots,d\}$ being defined by \[ \mathrm{width}(u):=\max_{j\in u}j-\min_{j\in u}j+1,\] for non-empty subset $u\subseteq \{1,\ldots,d\}$ and $\mathrm{width}(\emptyset):=1$. Strong polynomial tractability is achieved by an explicit quasi-Monte Carlo rule using a multiset union of Korobov's $p$-sets. We also show that, if we replace $\mathrm{width}(\mathrm{supp}(\boldsymbol{k}))$ with 1 for all $\boldsymbol{k}\in \mathbb{Z}^d$ in the above definition of norm, multivariate integration is polynomially tractable but not strongly polynomially tractable.
△ Less
Submitted 2 June, 2023;
originally announced June 2023.
-
Effects of gluon kinematics and the Sudakov form factor on the dipole amplitude
Authors:
Tomoki Goda,
Krzysztof Kutak,
Sebastian Sapeta
Abstract:
We investigate effects of exact gluon kinematics on the parameters of the Golec-Biernat-Wüsthoff, and Bartels-Golec-Biernat-Kowalski saturation models. The resulting fits show some differences, particularly, in the normalization of the dipole cross section $σ_0$. The refitted models are used for the dijet production process in DIS to investigate effects of the Sudakov form factor at Electron Ion C…
▽ More
We investigate effects of exact gluon kinematics on the parameters of the Golec-Biernat-Wüsthoff, and Bartels-Golec-Biernat-Kowalski saturation models. The resulting fits show some differences, particularly, in the normalization of the dipole cross section $σ_0$. The refitted models are used for the dijet production process in DIS to investigate effects of the Sudakov form factor at Electron Ion Collider energies.
△ Less
Submitted 29 May, 2023; v1 submitted 23 May, 2023;
originally announced May 2023.
-
Randomizing the trapezoidal rule gives the optimal RMSE rate in Gaussian Sobolev spaces
Authors:
Takashi Goda,
Yoshihito Kazashi,
Yuya Suzuki
Abstract:
Randomized quadratures for integrating functions in Sobolev spaces of order $α\ge 1$, where the integrability condition is with respect to the Gaussian measure, are considered. In this function space, the optimal rate for the worst-case root-mean-squared error (RMSE) is established. Here, optimality is for a general class of quadratures, in which adaptive non-linear algorithms with a possibly vary…
▽ More
Randomized quadratures for integrating functions in Sobolev spaces of order $α\ge 1$, where the integrability condition is with respect to the Gaussian measure, are considered. In this function space, the optimal rate for the worst-case root-mean-squared error (RMSE) is established. Here, optimality is for a general class of quadratures, in which adaptive non-linear algorithms with a possibly varying number of function evaluations are also allowed. The optimal rate is given by showing matching bounds. First, a lower bound on the worst-case RMSE of $O(n^{-α-1/2})$ is proven, where $n$ denotes an upper bound on the expected number of function evaluations. It turns out that a suitably randomized trapezoidal rule attains this rate, up to a logarithmic factor. A practical error estimator for this trapezoidal rule is also presented. Numerical results support our theory.
△ Less
Submitted 19 July, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Sudakov effects and the dipole amplitude
Authors:
Tomoki Goda,
Krzysztof Kutak,
Sebastian Sapeta
Abstract:
In this study we incorporate the Sudakov form factor into the dipole factorization formula, where the hard scale of the former is provided by the photon virtuality $Q^2$. We obtain a general formula which we then apply to the well-known GBW and BGK saturation models. Parameters of the above Sudakov-improved models are successfully fitted to the $F_2$ data from HERA. We observe, in particular, that…
▽ More
In this study we incorporate the Sudakov form factor into the dipole factorization formula, where the hard scale of the former is provided by the photon virtuality $Q^2$. We obtain a general formula which we then apply to the well-known GBW and BGK saturation models. Parameters of the above Sudakov-improved models are successfully fitted to the $F_2$ data from HERA. We observe, in particular, that inclusion of the Sudakov factor on top of the GBW model improves description of data at large $Q^2$.
△ Less
Submitted 26 January, 2023; v1 submitted 28 October, 2022;
originally announced October 2022.
-
Polynomial tractability for integration in an unweighted function space with absolutely convergent Fourier series
Authors:
Takashi Goda
Abstract:
In this note, we prove that the following function space with absolutely convergent Fourier series \[ F_d:=\left\{ f\in L^2([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^d}|\hat{f}(\boldsymbol{k})| \max\left(1,\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right) <\infty \right\}\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$ and…
▽ More
In this note, we prove that the following function space with absolutely convergent Fourier series \[ F_d:=\left\{ f\in L^2([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^d}|\hat{f}(\boldsymbol{k})| \max\left(1,\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right) <\infty \right\}\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$ and $\mathrm{supp}(\boldsymbol{k}):=\{j\in \{1,\ldots,d\}\mid k_j\neq 0\}$ is polynomially tractable for multivariate integration in the worst-case setting. Here polynomial tractability means that the minimum number of function evaluations required to make the worst-case error less than or equal to a tolerance $\varepsilon$ grows only polynomially with respect to $\varepsilon^{-1}$ and $d$. It is important to remark that the function space $F_d$ is unweighted, that is, all variables contribute equally to the norm of functions. Our tractability result is in contrast to those for most of the unweighted integration problems studied in the literature, in which polynomial tractability does not hold and the problem suffers from the curse of dimensionality. Our proof is constructive in the sense that we provide an explicit quasi-Monte Carlo rule that attains a desired worst-case error bound.
△ Less
Submitted 3 February, 2023; v1 submitted 12 October, 2022;
originally announced October 2022.
-
A universal median quasi-Monte Carlo integration
Authors:
Takashi Goda,
Kosuke Suzuki,
Makoto Matsumoto
Abstract:
We study quasi-Monte Carlo (QMC) integration over the multi-dimensional unit cube in several weighted function spaces with different smoothness classes. We consider approximating the integral of a function by the median of several integral estimates under independent and random choices of the underlying QMC point sets (either linearly scrambled digital nets or infinite-precision polynomial lattice…
▽ More
We study quasi-Monte Carlo (QMC) integration over the multi-dimensional unit cube in several weighted function spaces with different smoothness classes. We consider approximating the integral of a function by the median of several integral estimates under independent and random choices of the underlying QMC point sets (either linearly scrambled digital nets or infinite-precision polynomial lattice point sets). Even though our approach does not require any information on the smoothness and weights of a target function space as an input, we can prove a probabilistic upper bound on the worst-case error for the respective weighted function space, where the failure probability converges to 0 exponentially fast as the number of estimates increases. Our obtained rates of convergence are nearly optimal for function spaces with finite smoothness, and we can attain a dimension-independent super-polynomial convergence for a class of infinitely differentiable functions. This implies that our median-based QMC rule is universal in the sense that it does not need to be adjusted to the smoothness and the weights of the function spaces and yet exhibits the nearly optimal rate of convergence. Numerical experiments support our theoretical results.
△ Less
Submitted 26 September, 2023; v1 submitted 27 September, 2022;
originally announced September 2022.
-
Improved bounds on the gain coefficients for digital nets in prime power base
Authors:
Takashi Goda,
Kosuke Suzuki
Abstract:
We study randomized quasi-Monte Carlo integration by scrambled nets. The scrambled net quadrature has long gained its popularity because it is an unbiased estimator of the true integral, allows for a practical error estimation, achieves a high order decay of the variance for smooth functions, and works even for $L^p$-functions with any $p\geq 1$. The variance of the scrambled net quadrature for…
▽ More
We study randomized quasi-Monte Carlo integration by scrambled nets. The scrambled net quadrature has long gained its popularity because it is an unbiased estimator of the true integral, allows for a practical error estimation, achieves a high order decay of the variance for smooth functions, and works even for $L^p$-functions with any $p\geq 1$. The variance of the scrambled net quadrature for $L^2$-functions can be evaluated through the set of the so-called gain coefficients.
In this paper, based on the system of Walsh functions and the concept of dual nets, we provide improved upper bounds on the gain coefficients for digital nets in general prime power base. Our results explain the known bound by Owen (1997) for Faure sequences, the recently improved bound by Pan and Owen (2021) for digital nets in base 2 (including Sobol' sequences as a special case), and their finding that all the nonzero gain coefficients for digital nets in base 2 must be powers of two, all in a unified way.
△ Less
Submitted 21 November, 2022; v1 submitted 11 July, 2022;
originally announced July 2022.
-
Constructing unbiased gradient estimators with finite variance for conditional stochastic optimization
Authors:
Takashi Goda,
Wataru Kitade
Abstract:
We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random variable and an inner conditional expectation with respect to the other random variable. The gradient of such a parametric nested expectation is again expressed as…
▽ More
We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random variable and an inner conditional expectation with respect to the other random variable. The gradient of such a parametric nested expectation is again expressed as a nested expectation, which makes it hard for the standard nested Monte Carlo estimator to be unbiased. In this paper, we show under some conditions that a multilevel Monte Carlo gradient estimator is unbiased and has finite variance and finite expected computational cost, so that the standard theory from stochastic optimization for a parametric (non-nested) expectation directly applies. We also discuss a special case for which yet another unbiased gradient estimator with finite variance and cost can be constructed.
△ Less
Submitted 12 September, 2022; v1 submitted 4 June, 2022;
originally announced June 2022.
-
Sub-optimality of Gauss--Hermite quadrature and optimality of the trapezoidal rule for functions with finite smoothness
Authors:
Yoshihito Kazashi,
Yuya Suzuki,
Takashi Goda
Abstract:
The sub-optimality of Gauss--Hermite quadrature and the optimality of the trapezoidal rule are proved in the weighted Sobolev spaces of square integrable functions of order $α$, where the optimality is in the sense of worst-case error. For Gauss--Hermite quadrature, we obtain matching lower and upper bounds, which turn out to be merely of the order $n^{-α/2}$ with $n$ function evaluations, althoug…
▽ More
The sub-optimality of Gauss--Hermite quadrature and the optimality of the trapezoidal rule are proved in the weighted Sobolev spaces of square integrable functions of order $α$, where the optimality is in the sense of worst-case error. For Gauss--Hermite quadrature, we obtain matching lower and upper bounds, which turn out to be merely of the order $n^{-α/2}$ with $n$ function evaluations, although the optimal rate for the best possible linear quadrature is known to be $n^{-α}$. Our proof of the lower bound exploits the structure of the Gauss--Hermite nodes; the bound is independent of the quadrature weights, and changing the Gauss--Hermite weights cannot improve the rate $n^{-α/2}$. In contrast, we show that a suitably truncated trapezoidal rule achieves the optimal rate up to a logarithmic factor.
△ Less
Submitted 13 January, 2023; v1 submitted 23 February, 2022;
originally announced February 2022.
-
Construction-free median quasi-Monte Carlo rules for function spaces with unspecified smoothness and general weights
Authors:
Takashi Goda,
Pierre L'Ecuyer
Abstract:
We study quasi-Monte Carlo (QMC) integration of smooth functions defined over the multi-dimensional unit cube. Inspired by a recent work of Pan and Owen, we study a new construction-free median QMC rule which can exploit the smoothness and the weights of function spaces adaptively. For weighted Korobov spaces, we draw a sample of $r$ independent generating vectors of rank-1 lattice rules, compute…
▽ More
We study quasi-Monte Carlo (QMC) integration of smooth functions defined over the multi-dimensional unit cube. Inspired by a recent work of Pan and Owen, we study a new construction-free median QMC rule which can exploit the smoothness and the weights of function spaces adaptively. For weighted Korobov spaces, we draw a sample of $r$ independent generating vectors of rank-1 lattice rules, compute the integral estimate for each, and approximate the true integral by the median of these $r$ estimates. For weighted Sobolev spaces, we use the same approach but with the rank-1 lattice rules replaced by high-order polynomial lattice rules. A major advantage over the existing approaches is that we do not need to construct good generating vectors by a computer search algorithm, while our median QMC rule achieves almost the optimal worst-case error rate for the respective function space with any smoothness and weights, with a probability that converges to 1 exponentially fast as $r$ increases. Numerical experiments illustrate and support our theoretical findings.
△ Less
Submitted 27 April, 2022; v1 submitted 23 January, 2022;
originally announced January 2022.
-
An efficient estimation of nested expectations without conditional sampling
Authors:
Tomohiko Hironaka,
Takashi Goda
Abstract:
Estimating nested expectations is an important task in computational mathematics and statistics. In this paper we propose a new Monte Carlo method using post-stratification to estimate nested expectations efficiently without taking samples of the inner random variable from the conditional distribution given the outer random variable. This property provides the advantage over many existing methods…
▽ More
Estimating nested expectations is an important task in computational mathematics and statistics. In this paper we propose a new Monte Carlo method using post-stratification to estimate nested expectations efficiently without taking samples of the inner random variable from the conditional distribution given the outer random variable. This property provides the advantage over many existing methods that it enables us to estimate nested expectations only with a dataset on the pair of the inner and outer variables drawn from the joint distribution. We show an upper bound on the mean squared error of the proposed method under some assumptions. Numerical experiments are conducted to compare our proposed method with several existing methods (nested Monte Carlo method, multilevel Monte Carlo method, and regression-based method), and we see that our proposed method is superior to the compared methods in terms of efficiency and applicability.
△ Less
Submitted 21 June, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Component-by-component construction of randomized rank-1 lattice rules achieving almost the optimal randomized error rate
Authors:
Josef Dick,
Takashi Goda,
Kosuke Suzuki
Abstract:
We study a randomized quadrature algorithm to approximate the integral of periodic functions defined over the high-dimensional unit cube. Recent work by Kritzer, Kuo, Nuyens and Ullrich (2019) shows that rank-1 lattice rules with a randomly chosen number of points and good generating vector achieve almost the optimal order of the randomized error in weighted Korobov spaces, and moreover, that the…
▽ More
We study a randomized quadrature algorithm to approximate the integral of periodic functions defined over the high-dimensional unit cube. Recent work by Kritzer, Kuo, Nuyens and Ullrich (2019) shows that rank-1 lattice rules with a randomly chosen number of points and good generating vector achieve almost the optimal order of the randomized error in weighted Korobov spaces, and moreover, that the error is bounded independently of the dimension if the weight parameters, $γ_j$, satisfy the summability condition $\sum_{j=1}^{\infty}γ_j^{1/α}<\infty$, where $α$ is a smoothness parameter. The argument is based on the existence result that at least half of the possible generating vectors yield almost the optimal order of the worst-case error in the same function spaces.
In this paper we provide a component-by-component construction algorithm of such randomized rank-1 lattice rules, without any need to check whether the constructed generating vectors satisfy a desired worst-case error bound. Similarly to the above-mentioned work, we prove that our algorithm achieves almost the optimal order of the randomized error and that the error bound is independent of the dimension if the same condition $\sum_{j=1}^{\infty}γ_j^{1/α}<\infty$ holds. We also provide analogous results for tent-transformed lattice rules for weighted half-period cosine spaces and for polynomial lattice rules in weighted Walsh spaces, respectively.
△ Less
Submitted 22 March, 2022; v1 submitted 23 September, 2021;
originally announced September 2021.
-
A note on concatenation of quasi-Monte Carlo and plain Monte Carlo rules in high dimensions
Authors:
Takashi Goda
Abstract:
In this note, we study a concatenation of quasi-Monte Carlo and plain Monte Carlo rules for high-dimensional numerical integration in weighted function spaces. In particular, we consider approximating the integral of periodic functions defined over the $s$-dimensional unit cube by using rank-1 lattice point sets only for the first $d\, (<s)$ coordinates and random points for the remaining $s-d$ co…
▽ More
In this note, we study a concatenation of quasi-Monte Carlo and plain Monte Carlo rules for high-dimensional numerical integration in weighted function spaces. In particular, we consider approximating the integral of periodic functions defined over the $s$-dimensional unit cube by using rank-1 lattice point sets only for the first $d\, (<s)$ coordinates and random points for the remaining $s-d$ coordinates. We prove that, by exploiting a decay of the weights of function spaces, almost the optimal order of the mean squared worst-case error is achieved by such a concatenated quadrature rule as long as $d$ scales at most linearly with the number of points. This result might be useful for numerical integration in extremely high dimensions, such as partial differential equations with random coefficients for which even the standard fast component-by-component algorithm is considered computationally expensive.
△ Less
Submitted 7 January, 2022; v1 submitted 23 June, 2021;
originally announced June 2021.
-
A simple algorithm for global sensitivity analysis with Shapley effects
Authors:
Takashi Goda
Abstract:
Global sensitivity analysis aims at measuring the relative importance of different variables or groups of variables for the variability of a quantity of interest. Among several sensitivity indices, so-called Shapley effects have recently gained popularity mainly because the Shapley effects for all the individual variables are summed up to the overall variance, which gives a better interpretability…
▽ More
Global sensitivity analysis aims at measuring the relative importance of different variables or groups of variables for the variability of a quantity of interest. Among several sensitivity indices, so-called Shapley effects have recently gained popularity mainly because the Shapley effects for all the individual variables are summed up to the overall variance, which gives a better interpretability than the classical sensitivity indices called main effects and total effects. In this paper, assuming that all the input variables are independent, we introduce a quite simple Monte Carlo algorithm to estimate the Shapley effects for all the individual variables simultaneously, which drastically simplifies the existing algorithms proposed in the literature. We present a short Matlab implementation of our algorithm and show some numerical results. A possible extension to the case where the input variables are dependent is also discussed.
△ Less
Submitted 25 April, 2021; v1 submitted 2 September, 2020;
originally announced September 2020.
-
Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designs
Authors:
Takashi Goda,
Tomohiko Hironaka,
Wataru Kitade,
Adam Foster
Abstract:
In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to experimental design parameters is given by a nested expectation, for which the standard Monte Carlo method using a fixed number of inner samples yields a biased estimat…
▽ More
In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to experimental design parameters is given by a nested expectation, for which the standard Monte Carlo method using a fixed number of inner samples yields a biased estimator. In this paper, applying the idea of randomized multilevel Monte Carlo (MLMC) methods, we introduce an unbiased Monte Carlo estimator for the gradient of the expected information gain with finite expected squared $\ell_2$-norm and finite expected computational cost per sample. Our unbiased estimator can be combined well with stochastic gradient descent algorithms, which results in our proposal of an optimization algorithm to search for an optimal Bayesian experimental design. Numerical experiments confirm that our proposed algorithm works well not only for a simple test problem but also for a more realistic pharmacokinetic problem.
△ Less
Submitted 28 July, 2021; v1 submitted 17 May, 2020;
originally announced May 2020.
-
Toeplitz Monte Carlo
Authors:
Josef Dick,
Takashi Goda,
Hiroya Murata
Abstract:
Motivated mainly by applications to partial differential equations with random coefficients, we introduce a new class of Monte Carlo estimators, called Toeplitz Monte Carlo (TMC) estimator for approximating the integral of a multivariate function with respect to the direct product of an identical univariate probability measure. The TMC estimator generates a sequence $x_1,x_2,\ldots$ of i.i.d. samp…
▽ More
Motivated mainly by applications to partial differential equations with random coefficients, we introduce a new class of Monte Carlo estimators, called Toeplitz Monte Carlo (TMC) estimator for approximating the integral of a multivariate function with respect to the direct product of an identical univariate probability measure. The TMC estimator generates a sequence $x_1,x_2,\ldots$ of i.i.d. samples for one random variable, and then uses $(x_{n+s-1},x_{n+s-2}\ldots,x_n)$ with $n=1,2,\ldots$ as quadrature points, where $s$ denotes the dimension. Although consecutive points have some dependency, the concatenation of all quadrature nodes is represented by a Toeplitz matrix, which allows for a fast matrix-vector multiplication. In this paper we study the variance of the TMC estimator and its dependence on the dimension $s$. Numerical experiments confirm the considerable efficiency improvement over the standard Monte Carlo estimator for applications to partial differential equations with random coefficients, particularly when the dimension $s$ is large.
△ Less
Submitted 4 September, 2020; v1 submitted 8 March, 2020;
originally announced March 2020.
-
Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling
Authors:
Kei Ishikawa,
Takashi Goda
Abstract:
In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic objectives because the existing debiasing techniques are computationally costly to apply. To overcome this issue, we apply an MLMC sampling technique to construct l…
▽ More
In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic objectives because the existing debiasing techniques are computationally costly to apply. To overcome this issue, we apply an MLMC sampling technique to construct low-variance unbiased estimators both for the model evidence and its gradient. In the theoretical analysis, we show that the computational cost required for our proposed MLMC estimator to estimate the model evidence or its gradient with a given accuracy is an order of magnitude smaller than those of the previously known estimators. Our numerical experiments confirm considerable computational savings compared to the conventional estimators. Combining our MLMC estimator with gradient-based stochastic optimization results in a new scalable, efficient, debiased inference algorithm for Bayesian statistical models.
△ Less
Submitted 24 February, 2021; v1 submitted 14 January, 2020;
originally announced January 2020.
-
Stability of lattice rules and polynomial lattice rules constructed by the component-by-component algorithm
Authors:
Josef Dick,
Takashi Goda
Abstract:
We study quasi-Monte Carlo (QMC) methods for numerical integration of multivariate functions defined over the high-dimensional unit cube. Lattice rules and polynomial lattice rules, which are special classes of QMC methods, have been intensively studied and the so-called component-by-component (CBC) algorithm has been well-established to construct rules which achieve the almost optimal rate of con…
▽ More
We study quasi-Monte Carlo (QMC) methods for numerical integration of multivariate functions defined over the high-dimensional unit cube. Lattice rules and polynomial lattice rules, which are special classes of QMC methods, have been intensively studied and the so-called component-by-component (CBC) algorithm has been well-established to construct rules which achieve the almost optimal rate of convergence with good tractability properties for given smoothness and set of weights. Since the CBC algorithm constructs rules for given smoothness and weights, not much is known when such rules are used for function classes with different smoothness and/or weights.
In this paper we prove that a lattice rule constructed by the CBC algorithm for the weighted Korobov space with given smoothness and weights achieves the almost optimal rate of convergence with good tractability properties for general classes of smoothness and weights which satisfy some summability conditions. Such a stability result also can be shown for polynomial lattice rules in weighted Walsh spaces. We further give bounds on the weighted star discrepancy and discuss the tractability properties for these QMC rules. The results are comparable to those obtained for Halton, Sobol and Niederreiter sequences.
△ Less
Submitted 1 May, 2020; v1 submitted 23 December, 2019;
originally announced December 2019.
-
Multilevel Monte Carlo estimation of log marginal likelihood
Authors:
Takashi Goda,
Kei Ishikawa
Abstract:
In this short note we provide an unbiased multilevel Monte Carlo estimator of the log marginal likelihood and discuss its application to variational Bayes.
In this short note we provide an unbiased multilevel Monte Carlo estimator of the log marginal likelihood and discuss its application to variational Bayes.
△ Less
Submitted 23 December, 2019;
originally announced December 2019.
-
Multilevel Monte Carlo estimation of the expected value of sample information
Authors:
Tomohiko Hironaka,
Michael B. Giles,
Takashi Goda,
Howard Thom
Abstract:
We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable $Y$ and an inner conditional expectation with respect to the other random variable $θ$. Altho…
▽ More
We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable $Y$ and an inner conditional expectation with respect to the other random variable $θ$. Although the nested (Markov chain) Monte Carlo estimator has been often used in this context, a root-mean-square accuracy of $\varepsilon$ is achieved notoriously at a cost of $O(\varepsilon^{-2-1/α})$, where $α$ denotes the order of convergence of the bias and is typically between $1/2$ and $1$. In this article we propose a novel efficient Monte Carlo estimator of EVSI by applying a multilevel Monte Carlo (MLMC) method. Instead of fixing the number of inner samples for $θ$ as done in the nested Monte Carlo estimator, we consider a geometric progression on the number of inner samples, which yields a hierarchy of estimators on the inner conditional expectation with increasing approximation levels. Based on an elementary telesco** sum, our MLMC estimator is given by a sum of the Monte Carlo estimates of the differences between successive approximation levels on the inner conditional expectation. We show, under a set of assumptions on decision and information models, that successive approximation levels are tightly coupled, which directly proves that our MLMC estimator improves the necessary computational cost to optimal $O(\varepsilon^{-2})$. Numerical experiments confirm the considerable computational savings as compared to the nested Monte Carlo estimator.
△ Less
Submitted 17 August, 2020; v1 submitted 2 September, 2019;
originally announced September 2019.
-
Recent advances in higher order quasi-Monte Carlo methods
Authors:
Takashi Goda,
Kosuke Suzuki
Abstract:
In this article we review some of recent results on higher order quasi-Monte Carlo (HoQMC) methods. After a seminal work by Dick (2007, 2008) who originally introduced the concept of HoQMC, there have been significant theoretical progresses on HoQMC in terms of discrepancy as well as multivariate numerical integration. Moreover, several successful and promising applications of HoQMC to partial dif…
▽ More
In this article we review some of recent results on higher order quasi-Monte Carlo (HoQMC) methods. After a seminal work by Dick (2007, 2008) who originally introduced the concept of HoQMC, there have been significant theoretical progresses on HoQMC in terms of discrepancy as well as multivariate numerical integration. Moreover, several successful and promising applications of HoQMC to partial differential equations with random coefficients and Bayesian estimation/inversion problems have been reported recently. In this article we start with standard quasi-Monte Carlo methods based on digital nets and sequences in the sense of Niederreiter, and then move onto their higher order version due to Dick. The Walsh analysis of smooth functions plays a crucial role in develo** the theory of HoQMC, and the aim of this article is to provide a unified picture on how the Walsh analysis enables recent developments of HoQMC both for discrepancy and numerical integration.
△ Less
Submitted 29 March, 2019;
originally announced March 2019.
-
Multilevel Monte Carlo estimation of expected information gains
Authors:
Takashi Goda,
Tomohiko Hironaka,
Takeru Iwamoto
Abstract:
The expected information gain is an important quality criterion of Bayesian experimental designs, which measures how much the information entropy about uncertain quantity of interest $θ$ is reduced on average by collecting relevant data $Y$. However, estimating the expected information gain has been considered computationally challenging since it is defined as a nested expectation with an outer ex…
▽ More
The expected information gain is an important quality criterion of Bayesian experimental designs, which measures how much the information entropy about uncertain quantity of interest $θ$ is reduced on average by collecting relevant data $Y$. However, estimating the expected information gain has been considered computationally challenging since it is defined as a nested expectation with an outer expectation with respect to $Y$ and an inner expectation with respect to $θ$. In fact, the standard, nested Monte Carlo method requires a total computational cost of $O(\varepsilon^{-3})$ to achieve a root-mean-square accuracy of $\varepsilon$. In this paper we develop an efficient algorithm to estimate the expected information gain by applying a multilevel Monte Carlo (MLMC) method. To be precise, we introduce an antithetic MLMC estimator for the expected information gain and provide a sufficient condition on the data model under which the antithetic property of the MLMC estimator is well exploited such that optimal complexity of $O(\varepsilon^{-2})$ is achieved. Furthermore, we discuss how to incorporate importance sampling techniques within the MLMC estimator to avoid arithmetic underflow. Numerical experiments show the considerable computational cost savings compared to the nested Monte Carlo method for a simple test case and a more realistic pharmacokinetic model.
△ Less
Submitted 5 December, 2019; v1 submitted 19 November, 2018;
originally announced November 2018.
-
Richardson extrapolation allows truncation of higher order digital nets and sequences
Authors:
Takashi Goda
Abstract:
We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of convergence for numerical integration and can be constructed by the fast component-by-component search algorithm with smaller computational costs as compared to int…
▽ More
We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of convergence for numerical integration and can be constructed by the fast component-by-component search algorithm with smaller computational costs as compared to interlaced polynomial lattice rules. In this paper we prove that, instead of polynomial lattice point sets, truncated higher order digital nets and sequences can be used within the same algorithmic framework to explicitly construct good quadrature rules achieving the almost optimal rate of convergence. The major advantage of our new approach compared to original higher order digital nets is that we can significantly reduce the precision of points, i.e., the number of digits necessary to describe each quadrature node. This finding has a practically useful implication when either the number of points or the smoothness parameter is so large that original higher order digital nets require more than the available finite-precision floating point representations.
△ Less
Submitted 9 January, 2019; v1 submitted 23 May, 2018;
originally announced May 2018.
-
Lattice rules in non-periodic subspaces of Sobolev spaces
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
We investigate quasi-Monte Carlo (QMC) integration over the $s$-dimensional unit cube based on rank-1 lattice point sets in weighted non-periodic Sobolev spaces $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$ and their subspaces of high order smoothness $α>1$, where $\boldsymbolγ$ denotes a set of the weights. A recent paper by Dick, Nuyens and Pillichshammer has studied QMC integration in half…
▽ More
We investigate quasi-Monte Carlo (QMC) integration over the $s$-dimensional unit cube based on rank-1 lattice point sets in weighted non-periodic Sobolev spaces $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$ and their subspaces of high order smoothness $α>1$, where $\boldsymbolγ$ denotes a set of the weights. A recent paper by Dick, Nuyens and Pillichshammer has studied QMC integration in half-period cosine spaces with smoothness parameter $α>1/2$ consisting of non-periodic smooth functions, denoted by $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{cos}})$, and also in the sum of half-period cosine spaces and Korobov spaces with common parameter $α$, denoted by $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$. Motivated by the results shown there, we first study embeddings and norm equivalences on those function spaces. In particular, for an integer $α$, we provide their corresponding norm-equivalent subspaces of $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$. This implies that $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$ is strictly smaller than $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$ as sets for $α\geq 2$, which solves an open problem by Dick, Nuyens and Pillichshammer. Then we study the worst-case error of tent-transformed lattice rules in $\mathcal{H}(K_{2,\boldsymbolγ,s}^{\mathrm{sob}})$ and also the worst-case error of symmetrized lattice rules in an intermediate space between $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{kor}+\mathrm{cos}})$ and $\mathcal{H}(K_{α,\boldsymbolγ,s}^{\mathrm{sob}})$. We show that the almost optimal rate of convergence can be achieved for both cases, while a weak dependence of the worst-case error bound on the dimension can be obtained for the former case.
△ Less
Submitted 14 August, 2018; v1 submitted 7 December, 2017;
originally announced December 2017.
-
Decision-making under uncertainty: using MLMC for efficient estimation of EVPPI
Authors:
Michael B. Giles,
Takashi Goda
Abstract:
In this paper we develop a very efficient approach to the Monte Carlo estimation of the expected value of partial perfect information (EVPPI) that measures the average benefit of knowing the value of a subset of uncertain parameters involved in a decision model. The calculation of EVPPI is inherently a nested expectation problem, with an outer expectation with respect to one random variable $X$ an…
▽ More
In this paper we develop a very efficient approach to the Monte Carlo estimation of the expected value of partial perfect information (EVPPI) that measures the average benefit of knowing the value of a subset of uncertain parameters involved in a decision model. The calculation of EVPPI is inherently a nested expectation problem, with an outer expectation with respect to one random variable $X$ and an inner conditional expectation with respect to the other random variable $Y$. We tackle this problem by using a Multilevel Monte Carlo (MLMC) method (Giles 2008) in which the number of inner samples for $Y$ increases geometrically with level, so that the accuracy of estimating the inner conditional expectation improves and the cost also increases with level. We construct an antithetic MLMC estimator and provide sufficient assumptions on a decision model under which the antithetic property of the estimator is well exploited, and consequently a root-mean-square accuracy of $\varepsilon$ can be achieved at a cost of $O(\varepsilon^{-2})$. Numerical results confirm the considerable computational savings compared to the standard, nested Monte Carlo method for some simple testcases and a more realistic medical application.
△ Less
Submitted 19 March, 2018; v1 submitted 18 August, 2017;
originally announced August 2017.
-
Richardson extrapolation of polynomial lattice rules
Authors:
Josef Dick,
Takashi Goda,
Takehito Yoshiki
Abstract:
We study multivariate numerical integration of smooth functions in weighted Sobolev spaces with dominating mixed smoothness $α\geq 2$ defined over the $s$-dimensional unit cube. We propose a new quasi-Monte Carlo (QMC)-based quadrature rule, named \emph{extrapolated polynomial lattice rule}, which achieves the almost optimal rate of convergence. Extrapolated polynomial lattice rules are constructe…
▽ More
We study multivariate numerical integration of smooth functions in weighted Sobolev spaces with dominating mixed smoothness $α\geq 2$ defined over the $s$-dimensional unit cube. We propose a new quasi-Monte Carlo (QMC)-based quadrature rule, named \emph{extrapolated polynomial lattice rule}, which achieves the almost optimal rate of convergence. Extrapolated polynomial lattice rules are constructed in two steps: i) construction of classical polynomial lattice rules over $\mathbb{F}_b$ with $α$ consecutive sizes of nodes, $b^{m-α+1},\ldots,b^{m}$, and ii) recursive application of Richardson extrapolation to a chain of $α$ approximate values of the integral obtained by consecutive polynomial lattice rules.
We prove the existence of good extrapolated polynomial lattice rules achieving the almost optimal order of convergence of the worst-case error in Sobolev spaces with general weights. Then, by restricting to product weights, we show that such good extrapolated polynomial lattice rules can be constructed by the fast component-by-component algorithm under a computable quality criterion. The required total construction cost is of order $(s+α)N\log N$, which improves the currently known result for interlaced polynomial lattice rule, that is of order $sαN\log N$. We also study the dependence of the worst-case error bound on the dimension.
A big advantage of our method compared to interlaced polynomial lattice rules is that the fast QMC matrix vector method can be used in this setting, while still achieving the same rate of convergence. Such a method was previously not known.
Numerical experiments for test integrands support our theoretical result.
△ Less
Submitted 26 October, 2018; v1 submitted 13 July, 2017;
originally announced July 2017.
-
Quasi-Monte Carlo integration for twice differentiable functions over a triangle
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
We study quasi-Monte Carlo integration for twice differentiable functions defined over a triangle. We provide an explicit construction of infinite sequences of points including one by Basu and Owen (2015) as a special case, which achieves the integration error of order $N^{-1}(\log N)^3$ for any $N\geq 2$. Since a lower bound of order $N^{-1}$ on the integration error holds for any linear quadratu…
▽ More
We study quasi-Monte Carlo integration for twice differentiable functions defined over a triangle. We provide an explicit construction of infinite sequences of points including one by Basu and Owen (2015) as a special case, which achieves the integration error of order $N^{-1}(\log N)^3$ for any $N\geq 2$. Since a lower bound of order $N^{-1}$ on the integration error holds for any linear quadrature rule, the upper bound we obtain is best possible apart from the $\log N$ factor. The major ingredient in our proof of the upper bound is the dyadic Walsh analysis of twice differentiable functions over a triangle under a suitable recursive partitioning.
△ Less
Submitted 30 January, 2017;
originally announced January 2017.
-
Computing the variance of a conditional expectation via non-nested Monte Carlo
Authors:
Takashi Goda
Abstract:
Computing the variance of a conditional expectation has often been of importance in uncertainty quantification. Sun et al. has introduced an unbiased nested Monte Carlo estimator, which they call $1\frac{1}{2}$-level simulation since the optimal inner-level sample size is bounded as the computational budget increases. In this letter we construct unbiased non-nested Monte Carlo estimators based on…
▽ More
Computing the variance of a conditional expectation has often been of importance in uncertainty quantification. Sun et al. has introduced an unbiased nested Monte Carlo estimator, which they call $1\frac{1}{2}$-level simulation since the optimal inner-level sample size is bounded as the computational budget increases. In this letter we construct unbiased non-nested Monte Carlo estimators based on the so-called pick-freeze scheme due to Sobol'. An extension of our approach to compute higher order moments of a conditional expectation is also discussed.
△ Less
Submitted 27 September, 2016; v1 submitted 18 May, 2016;
originally announced May 2016.
-
Unbiased Monte Carlo estimation for the expected value of partial perfect information
Authors:
Takashi Goda
Abstract:
The expected value of partial perfect information (EVPPI) denotes the value of eliminating uncertainty on a subset of unknown parameters involved in a decision model. The EVPPI can be regarded as a decision-theoretic sensitivity index, and has been widely used for identifying relatively important unknown parameters. It follows from Jensen's inequality, however, that the standard nested Monte Carlo…
▽ More
The expected value of partial perfect information (EVPPI) denotes the value of eliminating uncertainty on a subset of unknown parameters involved in a decision model. The EVPPI can be regarded as a decision-theoretic sensitivity index, and has been widely used for identifying relatively important unknown parameters. It follows from Jensen's inequality, however, that the standard nested Monte Carlo computation of the EVPPI results in biased estimates. In this paper we introduce two unbiased Monte Carlo estimators for the EVPPI based on multilevel Monte Carlo method, introduced by Heinrich (1998) and Giles (2008), and its extension by Rhee and Glynn (2012, 2015). Our unbiased estimators are simple and straightforward to implement, and thus are of highly practical use. Numerical experiments show that even the convergence behaviors of our unbiased estimators are superior to that of the standard nested Monte Carlo estimator.
△ Less
Submitted 4 April, 2016;
originally announced April 2016.
-
Optimal order quadrature error bounds for infinite-dimensional higher order digital sequences
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
Quasi-Monte Carlo (QMC) quadrature rules using higher order digital nets and sequences have been shown to achieve the almost optimal rate of convergence of the worst-case error in Sobolev spaces of arbitrary fixed smoothness $α\in \mathbb{N}$, $α\geq 2$. In a recent paper by the authors, it was proved that randomly-digitally-shifted order $2α$ digital nets in prime base $b$ achieve the best possib…
▽ More
Quasi-Monte Carlo (QMC) quadrature rules using higher order digital nets and sequences have been shown to achieve the almost optimal rate of convergence of the worst-case error in Sobolev spaces of arbitrary fixed smoothness $α\in \mathbb{N}$, $α\geq 2$. In a recent paper by the authors, it was proved that randomly-digitally-shifted order $2α$ digital nets in prime base $b$ achieve the best possible rate of convergence of the root mean square worst-case error of order $N^{-α}(\log N)^{(s-1)/2}$ for $N=b^m$, where $N$ and $s$ denote the number of points and the dimension, respectively, which implies the existence of an optimal order QMC rule. More recently, the authors provided an explicit construction of such an optimal order QMC rule by using Chen-Skriganov's digital nets in conjunction with Dick's digit interlacing composition. These results were for fixed number of points. In this paper we give a more general result on an explicit construction of optimal order QMC rules for arbitrary fixed smoothness $α\in \mathbb{N}$ including the endpoint case $α=1$. That is, we prove that the projection of any infinite-dimensional order $2α+1$ digital sequence in prime base $b$ onto the first $s$ coordinates achieves the best possible rate of convergence of the worst-case error of order $N^{-α}(\log N)^{(s-1)/2}$ for $N=b^m$. The explicit construction presented in this paper is not only easy to implement but also extensible in both $N$ and $s$.
△ Less
Submitted 21 November, 2016; v1 submitted 29 March, 2016;
originally announced March 2016.
-
Construction of interlaced polynomial lattice rules for infinitely differentiable functions
Authors:
Josef Dick,
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
We study multivariate integration over the $s$-dimensional unit cube in a weighted space of infinitely differentiable functions. It is known from a recent result by Suzuki that there exists a good quasi-Monte Carlo (QMC) rule which achieves a super-polynomial convergence of the worst-case error in this function space, and moreover, that this convergence behavior is independent of the dimension und…
▽ More
We study multivariate integration over the $s$-dimensional unit cube in a weighted space of infinitely differentiable functions. It is known from a recent result by Suzuki that there exists a good quasi-Monte Carlo (QMC) rule which achieves a super-polynomial convergence of the worst-case error in this function space, and moreover, that this convergence behavior is independent of the dimension under a certain condition on the weights.
In this paper we provide a constructive approach to finding a good QMC rule achieving such a dimension-independent super-polynomial convergence of the worst-case error. Specifically, we prove that interlaced polynomial lattice rules, with an interlacing factor chosen properly depending on the number of points $N$ and the weights, can be constructed using a fast component-by-component algorithm in at most $O(sN(\log N)^2)$ arithmetic operations to achieve a dimension-independent super-polynomial convergence. The key idea for the proof of the worst-case error bound is to use a variant of Jensen's inequality with a purposely-designed concave function.
△ Less
Submitted 13 December, 2016; v1 submitted 2 February, 2016;
originally announced February 2016.
-
An explicit construction of optimal order quasi-Monte Carlo rules for smooth integrands
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
In a recent paper by the authors, it is shown that there exists a quasi-Monte Carlo (QMC) rule which achieves the best possible rate of convergence for numerical integration in a reproducing kernel Hilbert space consisting of smooth functions. In this paper we provide an explicit construction of such an optimal order QMC rule. Our approach is to exploit both the decay and the sparsity of the Walsh…
▽ More
In a recent paper by the authors, it is shown that there exists a quasi-Monte Carlo (QMC) rule which achieves the best possible rate of convergence for numerical integration in a reproducing kernel Hilbert space consisting of smooth functions. In this paper we provide an explicit construction of such an optimal order QMC rule. Our approach is to exploit both the decay and the sparsity of the Walsh coefficients of the reproducing kernel simultaneously. This can be done by applying digit interlacing composition due to Dick to digital nets with large minimum Hamming and Niederreiter-Rosenbloom-Tsfasman metrics due to Chen and Skriganov. To our best knowledge, our construction gives the first QMC rule which achieves the best possible convergence in this function space.
△ Less
Submitted 25 January, 2016;
originally announced January 2016.
-
Quasi-Monte Carlo integration using digital nets with antithetics
Authors:
Takashi Goda
Abstract:
Antithetic sampling, which goes back to the classical work by Hammersley and Morton (1956), is one of the well-known variance reduction techniques for Monte Carlo integration. In this paper we investigate its application to digital nets over $\mathbb{Z}_b$ for quasi-Monte Carlo (QMC) integration, a deterministic counterpart of Monte Carlo, of functions defined over the $s$-dimensional unit cube. B…
▽ More
Antithetic sampling, which goes back to the classical work by Hammersley and Morton (1956), is one of the well-known variance reduction techniques for Monte Carlo integration. In this paper we investigate its application to digital nets over $\mathbb{Z}_b$ for quasi-Monte Carlo (QMC) integration, a deterministic counterpart of Monte Carlo, of functions defined over the $s$-dimensional unit cube. By looking at antithetic sampling as a geometric technique in a compact totally disconnected abelian group, we first generalize the notion of antithetic sampling from base $2$ to an arbitrary base $b\ge 2$. Then we analyze the QMC integration error of digital nets over $\mathbb{Z}_b$ with $b$-adic antithetics. Moreover, for a prime $b$, we prove the existence of good higher order polynomial lattice point sets with $b$-adic antithetics for QMC integration of smooth functions in weighted Sobolev spaces. Numerical experiments based on Sobol' point sets up to $s=100$ show that the rate of convergence can be improved for smooth integrands by using antithetic sampling technique, which is quite encouraging beyond the reach of our theoretical result and motivates future work to address.
△ Less
Submitted 20 January, 2016; v1 submitted 28 September, 2015;
originally announced September 2015.
-
Optimal order quasi-Monte Carlo integration in weighted Sobolev spaces of arbitrary smoothness
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
We investigate quasi-Monte Carlo integration using higher order digital nets in weighted Sobolev spaces of arbitrary fixed smoothness $α\in \mathbb{N}$, $α\ge 2$, defined over the $s$-dimensional unit cube. We prove that randomly digitally shifted order $β$ digital nets can achieve the convergence of the root mean square worst-case error of order $N^{-α}(\log N)^{(s-1)/2}$ when $β\ge 2α$. The expo…
▽ More
We investigate quasi-Monte Carlo integration using higher order digital nets in weighted Sobolev spaces of arbitrary fixed smoothness $α\in \mathbb{N}$, $α\ge 2$, defined over the $s$-dimensional unit cube. We prove that randomly digitally shifted order $β$ digital nets can achieve the convergence of the root mean square worst-case error of order $N^{-α}(\log N)^{(s-1)/2}$ when $β\ge 2α$. The exponent of the logarithmic term, i.e., $(s-1)/2$, is improved compared to the known result by Baldeaux and Dick, in which the exponent is $sα/2$. Our result implies the existence of a digitally shifted order $β$ digital net achieving the convergence of the worst-case error of order $N^{-α}(\log N)^{(s-1)/2}$, which matches a lower bound on the convergence rate of the worst-case error for any cubature rule using $N$ function evaluations and thus is best possible.
△ Less
Submitted 19 January, 2016; v1 submitted 26 August, 2015;
originally announced August 2015.
-
The $b$-adic symmetrization of digital nets for quasi-Monte Carlo integration
Authors:
Takashi Goda
Abstract:
The notion of symmetrization, also known as Davenport's reflection principle, is well known in the area of the discrepancy theory and quasi-Monte Carlo (QMC) integration. In this paper we consider applying a symmetrization technique to a certain class of QMC point sets called digital nets over $\mathbb{Z}_{b}$. Although symmetrization has been recognized as a geometric technique in the multi-dimen…
▽ More
The notion of symmetrization, also known as Davenport's reflection principle, is well known in the area of the discrepancy theory and quasi-Monte Carlo (QMC) integration. In this paper we consider applying a symmetrization technique to a certain class of QMC point sets called digital nets over $\mathbb{Z}_{b}$. Although symmetrization has been recognized as a geometric technique in the multi-dimensional unit cube, we give another look at symmetrization as a geometric technique in a compact totally disconnected abelian group with dyadic arithmetic operations. Based on this observation we generalize the notion of symmetrization from base 2 to an arbitrary base $b\in \mathbb{N}$, $b\ge 2$. Subsequently, we study the QMC integration error of symmetrized digital nets over $\mathbb{Z}_{b}$ in a reproducing kernel Hilbert space. The result can be applied to component-by-component construction or Korobov construction for finding good symmetrized (higher order) polynomial lattice rules which achieve high order convergence of the integration error for smooth integrands at the expense of an exponential growth of the number of points with the dimension. Moreover, we consider two-dimensional symmetrized Hammersley point sets in prime base $b$, and prove that the minimum Dick weight is large enough to achieve the best possible order of $L_p$ discrepancy for all $1\le p< \infty$.
△ Less
Submitted 19 October, 2015; v1 submitted 26 May, 2015;
originally announced May 2015.
-
The Mean Square Quasi-Monte Carlo Error for Digitally Shifted Digital Nets
Authors:
Takashi Goda,
Ryuichi Ohori,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
In this paper, we study randomized quasi-Monte Carlo (QMC) integration using digitally shifted digital nets. We express the mean square QMC error of the $n$-th discrete approximation $f_n$ of a function $f\colon[0,1)^s\to \mathbb{R}$ for digitally shifted digital nets in terms of the Walsh coefficients of $f$. We then apply a bound on the Walsh coefficients for sufficiently smooth integrands to ob…
▽ More
In this paper, we study randomized quasi-Monte Carlo (QMC) integration using digitally shifted digital nets. We express the mean square QMC error of the $n$-th discrete approximation $f_n$ of a function $f\colon[0,1)^s\to \mathbb{R}$ for digitally shifted digital nets in terms of the Walsh coefficients of $f$. We then apply a bound on the Walsh coefficients for sufficiently smooth integrands to obtain a quality measure called Walsh figure of merit for root mean square error, which satisfies a Koksma-Hlawka type inequality on the root mean square error. Through two types of experiments, we confirm that our quality measure is of use for finding digital nets which show good convergence behaviors of the root mean square error for smooth integrands.
△ Less
Submitted 2 December, 2014;
originally announced December 2014.
-
On the $L_p$ discrepancy of two-dimensional folded Hammersley point sets
Authors:
Takashi Goda
Abstract:
We give an explicit construction of two-dimensional point sets whose $L_p$ discrepancy is of best possible order for all $1\le p\le \infty$. It is provided by folding Hammersley point sets in base $b$ by means of the $b$-adic baker's transformation which has been introduced by Hickernell (2002) for $b=2$ and Goda, Suzuki and Yoshiki (2013) for arbitrary $b\in \mathbb{N}$, $b\ge 2$. We prove that b…
▽ More
We give an explicit construction of two-dimensional point sets whose $L_p$ discrepancy is of best possible order for all $1\le p\le \infty$. It is provided by folding Hammersley point sets in base $b$ by means of the $b$-adic baker's transformation which has been introduced by Hickernell (2002) for $b=2$ and Goda, Suzuki and Yoshiki (2013) for arbitrary $b\in \mathbb{N}$, $b\ge 2$. We prove that both the minimum Niederreiter-Rosenbloom-Tsfasman weight and the minimum Dick weight of folded Hammersley point sets are large enough to achieve the best possible order of $L_p$ discrepancy for all $1\le p\le \infty$.
△ Less
Submitted 30 September, 2014; v1 submitted 12 September, 2014;
originally announced September 2014.
-
Digital nets with infinite digit expansions and construction of folded digital nets for quasi-Monte Carlo integration
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
In this paper we study quasi-Monte Carlo integration of smooth functions using digital nets. We fold digital nets over $\mathbb{Z}_{b}$ by means of the $b$-adic tent transformation, which has recently been introduced by the authors, and employ such \emph{folded digital nets} as quadrature points. We first analyze the worst-case error of quasi-Monte Carlo rules using folded digital nets in reproduc…
▽ More
In this paper we study quasi-Monte Carlo integration of smooth functions using digital nets. We fold digital nets over $\mathbb{Z}_{b}$ by means of the $b$-adic tent transformation, which has recently been introduced by the authors, and employ such \emph{folded digital nets} as quadrature points. We first analyze the worst-case error of quasi-Monte Carlo rules using folded digital nets in reproducing kernel Hilbert spaces. Here we need to permit digital nets with "infinite digit expansions," which are beyond the scope of the classical definition of digital nets. We overcome this issue by considering the infinite product of cyclic groups and the characters on it. We then give an explicit means of constructing good folded digital nets as follows: we use higher order polynomial lattice point sets for digital nets and show that the component-by-component construction can find good \emph{folded higher order polynomial lattice rules} that achieve the optimal convergence rate of the worst-case error in certain Sobolev spaces of smoothness of arbitrarily high order.
△ Less
Submitted 23 July, 2015; v1 submitted 22 July, 2014;
originally announced July 2014.
-
The $b$-adic tent transformation for quasi-Monte Carlo integration using digital nets
Authors:
Takashi Goda,
Kosuke Suzuki,
Takehito Yoshiki
Abstract:
In this paper we investigate quasi-Monte Carlo (QMC) integration using digital nets over $\mathbb{Z}_b$ in reproducing kernel Hilbert spaces. The tent transformation, or the baker's transformation, was originally used for lattice rules by Hickernell (2002) to achieve higher order convergence of the integration error for smooth non-periodic integrands, and later, has been successfully applied to di…
▽ More
In this paper we investigate quasi-Monte Carlo (QMC) integration using digital nets over $\mathbb{Z}_b$ in reproducing kernel Hilbert spaces. The tent transformation, or the baker's transformation, was originally used for lattice rules by Hickernell (2002) to achieve higher order convergence of the integration error for smooth non-periodic integrands, and later, has been successfully applied to digital nets over $\mathbb{Z}_2$ by Cristea et al. (2007) and Goda (2014). The aim of this paper is to generalize the latter two results to digital nets over $\mathbb{Z}_b$ for an arbitrary prime $b$. For this purpose, we introduce the {\em $b$-adic tent transformation} for an arbitrary positive integer $b$ greater than 1, which is a generalization of the original (dyadic) tent transformation. Further, again for an arbitrary positive integer $b$ greater than 1, we analyze the mean square worst-case error of QMC rules using digital nets over $\mathbb{Z}_b$ which are randomly digitally shifted and then folded using the $b$-adic tent transformation in reproducing kernel Hilbert spaces. Using this result, for a prime $b$, we prove the existence of good higher order polynomial lattice rules over $\mathbb{Z}_b$ among the smaller number of candidates as compared to the result by Dick and Pillichshammer (2007), which achieve almost the optimal convergence rate of the mean square worst-case error in unanchored Sobolev spaces of smoothness of arbitrary high order.
△ Less
Submitted 22 November, 2014; v1 submitted 20 December, 2013;
originally announced December 2013.
-
Constructing good higher order polynomial lattice rules with modulus of reduced degree
Authors:
Takashi Goda
Abstract:
In this paper we investigate multivariate integration in weighted unanchored Sobolev spaces of smoothness of arbitrarily high order. As quadrature points we employ higher order polynomial lattice point sets over $\mathbb{F}_{2}$ which are randomly digitally shifted and then folded using the tent transformation. We first prove the existence of good higher order polynomial lattice rules which achiev…
▽ More
In this paper we investigate multivariate integration in weighted unanchored Sobolev spaces of smoothness of arbitrarily high order. As quadrature points we employ higher order polynomial lattice point sets over $\mathbb{F}_{2}$ which are randomly digitally shifted and then folded using the tent transformation. We first prove the existence of good higher order polynomial lattice rules which achieve the optimal rate of the mean square worst-case error, while reducing the required degree of modulus by half as compared to higher order polynomial lattice rules whose quadrature points are randomly digitally shifted but not folded using the tent transformation. Thus we are able to restrict the search space of generating vectors significantly. We then study the component-by-component construction as an explicit means of obtaining good higher order polynomial lattice rules. In a way analogous to [J. Baldeaux, J. Dick, G. Leobacher, D. Nuyens, F. Pillichshammer, Numer. Algorithms, 59 (2012) 403--431], we show how to calculate the quality criterion efficiently and how to obtain the fast component-by-component construction using the fast Fourier transform. Our result generalizes the previous result shown by [L.L. Cristea, J. Dick, G. Leobacher, F. Pillichshammer, Numer. Math., 105 (2007) 413--455], in which the degree of smoothness is fixed at 2 and classical polynomial lattice rules are considered.
△ Less
Submitted 1 October, 2014; v1 submitted 20 October, 2013;
originally announced October 2013.
-
Good interlaced polynomial lattice rules for numerical integration in weighted Walsh spaces
Authors:
Takashi Goda
Abstract:
Quadrature rules using higher order digital nets and sequences are known to exploit the smoothness of a function for numerical integration and to achieve an improved rate of convergence as compared to classical digital nets and sequences for smooth functions. A construction principle of higher order digital nets and sequences based on a digit interlacing function was introduced in [J. Dick, SIAM J…
▽ More
Quadrature rules using higher order digital nets and sequences are known to exploit the smoothness of a function for numerical integration and to achieve an improved rate of convergence as compared to classical digital nets and sequences for smooth functions. A construction principle of higher order digital nets and sequences based on a digit interlacing function was introduced in [J. Dick, SIAM J. Numer. Anal., 45 (2007) pp.~2141--2176], which interlaces classical digital nets or sequences whose number of components is a multiple of the dimension.
In this paper, we study the use of polynomial lattice point sets for interlaced components. We call quadrature rules using such point sets {\em interlaced polynomial lattice rules}. We consider weighted Walsh spaces containing smooth functions and derive two upper bounds on the worst-case error for interlaced polynomial lattice rules, both of which can be employed as a quality criterion for the construction of interlaced polynomial lattice rules. We investigate the component-by-component construction and the Korobov construction as a means of explicit constructions of good interlaced polynomial lattice rules that achieve the optimal rate of the worst-case error. Through this approach we are able to obtain a good dependence of the worst-case error bounds on the dimension under certain conditions on the weights, while significantly reducing the construction cost as compared to higher order polynomial lattice rules.
△ Less
Submitted 17 February, 2015; v1 submitted 19 June, 2013;
originally announced June 2013.
-
Fast construction of higher order digital nets for numerical integration in weighted Sobolev spaces
Authors:
Takashi Goda
Abstract:
Higher order digital nets are special classes of point sets for quasi-Monte Carlo rules which achieve the optimal convergence rate for numerical integration of smooth functions. An explicit construction of higher order digital nets was proposed by Dick, which is based on digitally interlacing in a certain way the components of classical digital nets whose number of components is a multiple $ds$ of…
▽ More
Higher order digital nets are special classes of point sets for quasi-Monte Carlo rules which achieve the optimal convergence rate for numerical integration of smooth functions. An explicit construction of higher order digital nets was proposed by Dick, which is based on digitally interlacing in a certain way the components of classical digital nets whose number of components is a multiple $ds$ of the dimension $s$. In this paper we give a fast computer search algorithm to find good classical digital nets suitable for interlaced components by using polynomial lattice point sets.
We consider certain weighted Sobolev spaces of smoothness of arbitrarily high order, and derive an upper bound on the mean square worst-case error for digitally shifted higher order digital nets. Employing this upper bound as a quality criterion, we prove that the component-by-component construction can be used efficiently to find good polynomial lattice point sets suitable for interlaced components. Through this approach we are able to get some tractability results under certain conditions on the weights. Fast construction using the fast Fourier transform requires the construction cost of $O(dsN \log N)$ operations using $O(N)$ memory, where $N$ is the number of points and $s$ is the dimension. This implies a significant reduction in the construction cost as compared to higher order polynomial lattice point sets. Numerical experiments confirm that the performance of our constructed point sets often outperforms those of higher order digital nets with Sobol' sequences and Niederreiter-Xing sequences used for interlaced components, indicating the usefulness of our algorithm.
△ Less
Submitted 7 August, 2014; v1 submitted 6 May, 2013;
originally announced May 2013.
-
Construction of interlaced scrambled polynomial lattice rules of arbitrary high order
Authors:
Takashi Goda,
Josef Dick
Abstract:
Higher order scrambled digital nets are randomized quasi-Monte Carlo rules which have recently been introduced in [J. Dick, Ann. Statist., 39 (2011), 1372--1398] and shown to achieve the optimal rate of convergence of the root mean square error for numerical integration of smooth functions defined on the $s$-dimensional unit cube. The key ingredient there is a digit interlacing function applied to…
▽ More
Higher order scrambled digital nets are randomized quasi-Monte Carlo rules which have recently been introduced in [J. Dick, Ann. Statist., 39 (2011), 1372--1398] and shown to achieve the optimal rate of convergence of the root mean square error for numerical integration of smooth functions defined on the $s$-dimensional unit cube. The key ingredient there is a digit interlacing function applied to the components of a randomly scrambled digital net whose number of components is $ds$, where the integer $d$ is the so-called interlacing factor. In this paper, we replace the randomly scrambled digital nets by randomly scrambled polynomial lattice point sets, which allows us to obtain a better dependence on the dimension while still achieving the optimal rate of convergence. Our results apply to Owen's full scrambling scheme as well as the simplifications studied by Hickernell, Matoušek and Owen. We consider weighted function spaces with general weights, whose elements have square integrable partial mixed derivatives of order up to $α\ge 1$, and derive an upper bound on the variance of the estimator for higher order scrambled polynomial lattice rules. Employing our obtained bound as a quality criterion, we prove that the component-by-component construction can be used to obtain explicit constructions of good polynomial lattice point sets. By first constructing classical polynomial lattice point sets in base $b$ and dimension $ds$, to which we then apply the interlacing scheme of order $d$, we obtain a construction cost of the algorithm of order $\mathcal{O}(dsmb^m)$ operations using $\mathcal{O}(b^m)$ memory in case of product weights, where $b^m$ is the number of points in the polynomial lattice point set.
△ Less
Submitted 5 August, 2014; v1 submitted 27 January, 2013;
originally announced January 2013.
-
On the separability of multivariate functions
Authors:
Takashi Goda
Abstract:
Separability of multivariate functions alleviates the difficulty in finding a minimum or maximum value of a function such that an optimal solution can be searched by solving several disjoint problems with lower dimensionalities. In most of practical problems, however, a function to be optimized is black-box and we hardly grasp its separability. In this study, we first describe a general separabili…
▽ More
Separability of multivariate functions alleviates the difficulty in finding a minimum or maximum value of a function such that an optimal solution can be searched by solving several disjoint problems with lower dimensionalities. In most of practical problems, however, a function to be optimized is black-box and we hardly grasp its separability. In this study, we first describe a general separability condition which a function defined over an arbitrary domain satisfies if and only if the function is separable with respect to given disjoint subsets of variables. By introducing an alternative separability condition, we propose a Monte Carlo-based algorithm to estimate the separability of a function defined over unit cube with respect to given disjoint subsets of variables. Moreover, we extend our algorithm to estimate the number of disjoint subsets and the disjoint subsets such that a function is separable with respect to them. Computational complexity of our extended algorithm is function-dependent and varies from linear to exponential in the dimension.
△ Less
Submitted 16 May, 2018; v1 submitted 24 January, 2013;
originally announced January 2013.
-
Construction of scrambled polynomial lattice rules over $\mathbb{F}_2$ with small mean square weighted $\mathcal{L}_2$ discrepancy
Authors:
Takashi Goda
Abstract:
The $\mathcal{L}_2$ discrepancy is one of several well-known quantitative measures for the equidistribution properties of point sets in the high-dimensional unit cube. The concept of weights was introduced by Sloan and Woźniakowski to take into account the relative importance of the discrepancy of lower dimensional projections. As known under the name of quasi-Monte Carlo methods, point sets with…
▽ More
The $\mathcal{L}_2$ discrepancy is one of several well-known quantitative measures for the equidistribution properties of point sets in the high-dimensional unit cube. The concept of weights was introduced by Sloan and Woźniakowski to take into account the relative importance of the discrepancy of lower dimensional projections. As known under the name of quasi-Monte Carlo methods, point sets with small weighted $\mathcal{L}_2$ discrepancy are useful in numerical integration. This study investigates the component-by-component construction of polynomial lattice rules over the finite field $\mathbb{F}_2$ whose scrambled point sets have small mean square weighted $\mathcal{L}_2$ discrepancy. An upper bound on this discrepancy is proved, which converges at almost the best possible rate of $N^{-2+δ}$ for all $δ>0$, where $N$ denotes the number of points. Numerical experiments confirm that the performance of our constructed polynomial lattice point sets is comparable or even superior to that of Sobol' sequences.
△ Less
Submitted 19 June, 2014; v1 submitted 17 January, 2013;
originally announced January 2013.