-
A Fast and Accurate Numerical Method for the Left Tail of Sums of Independent Random Variables
Authors:
Nadhir Ben Rached,
Håkon Hoel,
Johannes Vincent Meo
Abstract:
We present a flexible, deterministic numerical method for computing left-tail rare events of sums of non-negative, independent random variables. The method is based on iterative numerical integration of linear convolutions by means of Newtons-Cotes rules. The periodicity properties of convoluted densities combined with the Trapezoidal rule are exploited to produce a robust and efficient method, an…
▽ More
We present a flexible, deterministic numerical method for computing left-tail rare events of sums of non-negative, independent random variables. The method is based on iterative numerical integration of linear convolutions by means of Newtons-Cotes rules. The periodicity properties of convoluted densities combined with the Trapezoidal rule are exploited to produce a robust and efficient method, and the method is flexible in the sense that it can be applied to all kinds of non-negative continuous RVs. We present an error analysis and study the benefits of utilizing Newton-Cotes rules versus the fast Fourier transform (FFT) for numerical integration, showing that although there can be efficiency-benefits to using FFT, Newton-Cotes rules tend to preserve the relative error better, and indeed do so at an acceptable computational cost. Numerical studies on problems with both known and unknown rare-event probabilities showcase the method's performance and support our theoretical findings.
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
Importance sampling for rare event tracking within the ensemble Kalman filtering framework
Authors:
Nadhir Ben Rached,
Erik von Schwerin,
Gaukhar Shaimerdenova,
Raul Tempone
Abstract:
In this work we employ importance sampling (IS) techniques to track a small over-threshold probability of a running maximum associated with the solution of a stochastic differential equation (SDE) within the framework of ensemble Kalman filtering (EnKF). Between two observation times of the EnKF, we propose to use IS with respect to the initial condition of the SDE, IS with respect to the Wiener p…
▽ More
In this work we employ importance sampling (IS) techniques to track a small over-threshold probability of a running maximum associated with the solution of a stochastic differential equation (SDE) within the framework of ensemble Kalman filtering (EnKF). Between two observation times of the EnKF, we propose to use IS with respect to the initial condition of the SDE, IS with respect to the Wiener process via a stochastic optimal control formulation, and combined IS with respect to both initial condition and Wiener process. Both IS strategies require the approximation of the solution of Kolmogorov Backward equation (KBE) with boundary conditions. In multidimensional settings, we employ a Markovian projection dimension reduction technique to obtain an approximation of the solution of the KBE by just solving a one dimensional PDE. The proposed ideas are tested on two illustrative examples: Double Well SDE and Langevin dynamics, and showcase a significant variance reduction compared to the standard Monte Carlo method and another sampling-based IS technique, namely, multilevel cross entropy.
△ Less
Submitted 19 March, 2024;
originally announced March 2024.
-
Stochastic differential equations for performance analysis of wireless communication systems
Authors:
Eya Ben Amar,
Nadhir Ben Rached,
Raul Tempone,
Mohamed-Slim Alouini
Abstract:
This paper addresses the difficulty of characterizing the time-varying nature of fading channels. The current time-invariant models often fall short of capturing and tracking these dynamic characteristics. To overcome this limitation, we explore using of stochastic differential equations (SDEs) and Markovian projection to model signal envelope variations, considering scenarios involving Rayleigh,…
▽ More
This paper addresses the difficulty of characterizing the time-varying nature of fading channels. The current time-invariant models often fall short of capturing and tracking these dynamic characteristics. To overcome this limitation, we explore using of stochastic differential equations (SDEs) and Markovian projection to model signal envelope variations, considering scenarios involving Rayleigh, Rice, and Hoyt distributions. Furthermore, it is of practical interest to study the performance of channels modeled by SDEs. In this work, we investigate the fade duration metric, representing the time during which the signal remains below a specified threshold within a fixed time interval. We estimate the complementary cumulative distribution function (CCDF) of the fade duration using Monte Carlo simulations, and analyze the influence of system parameters on its behavior. Finally, we leverage importance sampling, a known variance-reduction technique, to estimate the tail of the CCDF efficiently.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
Multi-index Importance Sampling for McKean-Vlasov Stochastic Differential Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This work introduces a novel approach that combines the multi-index Monte Carlo (MC) method with importance sampling (IS) to estimate rare event quantities expressed as an expectation of a smooth observable of solutions to a broad class of McKean-Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator, previously introduced in our works (Ben Rached et al.,…
▽ More
This work introduces a novel approach that combines the multi-index Monte Carlo (MC) method with importance sampling (IS) to estimate rare event quantities expressed as an expectation of a smooth observable of solutions to a broad class of McKean-Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator, previously introduced in our works (Ben Rached et al., 2022a,b), to the multi-index setting. We formulate a new multi-index DLMC estimator and conduct a comprehensive cost-error analysis, leading to improved complexity results. To address rare events, an importance sampling scheme is applied using stochastic optimal control of the single level DLMC estimator. This combination of IS and multi-index DLMC not only reduces computational complexity by two orders but also significantly decreases the associated constant compared to vanilla MC. The effectiveness of the proposed multi-index DLMC estimator is demonstrated using the Kuramoto model from statistical physics. The results confirm a reduced complexity from $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ for the single level DLMC estimator (Ben Rached et al., 2022a) to $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-2} (\log \mathrm{TOL}_{\mathrm{r}}^{-1})^2)$ for the considered example, while ensuring accurate estimation of rare event quantities within the prescribed relative error tolerance $\mathrm{TOL}_\mathrm{r}$.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Automated Importance Sampling via Optimal Control for Stochastic Reaction Networks: A Markovian Projection-based Approach
Authors:
Chiheb Ben Hammouda,
Nadhir Ben Rached,
Raúl Tempone,
Sophia Wiechert
Abstract:
We propose a novel alternative approach to our previous work (Ben Hammouda et al., 2023) to improve the efficiency of Monte Carlo (MC) estimators for rare event probabilities for stochastic reaction networks (SRNs). In the same spirit of (Ben Hammouda et al., 2023), an efficient path-dependent measure change is derived based on a connection between determining optimal importance sampling (IS) para…
▽ More
We propose a novel alternative approach to our previous work (Ben Hammouda et al., 2023) to improve the efficiency of Monte Carlo (MC) estimators for rare event probabilities for stochastic reaction networks (SRNs). In the same spirit of (Ben Hammouda et al., 2023), an efficient path-dependent measure change is derived based on a connection between determining optimal importance sampling (IS) parameters within a class of probability measures and a stochastic optimal control formulation, corresponding to solving a variance minimization problem. In this work, we propose a novel approach to address the encountered curse of dimensionality by map** the problem to a significantly lower-dimensional space via a Markovian projection (MP) idea. The output of this model reduction technique is a low-dimensional SRN (potentially even one dimensional) that preserves the marginal distribution of the original high-dimensional SRN system. The dynamics of the projected process are obtained by solving a related optimization problem via a discrete $L^2$ regression. By solving the resulting projected Hamilton-Jacobi-Bellman (HJB) equations for the reduced-dimensional SRN, we obtain projected IS parameters, which are then mapped back to the original full-dimensional SRN system, resulting in an efficient IS-MC estimator for rare events probabilities of the full-dimensional SRN. Our analysis and numerical experiments reveal that the proposed MP-HJB-IS approach substantially reduces the MC estimator variance, resulting in a lower computational complexity in the rare event regime than standard MC estimators.
△ Less
Submitted 11 March, 2024; v1 submitted 5 June, 2023;
originally announced June 2023.
-
Multilevel Importance Sampling for Rare Events Associated With the McKean--Vlasov Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This work combines multilevel Monte Carlo (MLMC) with importance sampling to estimate rare-event quantities that can be expressed as the expectation of a Lipschitz observable of the solution to a broad class of McKean--Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator introduced in this context in (Ben Rached et al., 2023) to the multilevel setting. W…
▽ More
This work combines multilevel Monte Carlo (MLMC) with importance sampling to estimate rare-event quantities that can be expressed as the expectation of a Lipschitz observable of the solution to a broad class of McKean--Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator introduced in this context in (Ben Rached et al., 2023) to the multilevel setting. We formulate a novel multilevel DLMC estimator and perform a comprehensive cost-error analysis yielding new and improved complexity results. Crucially, we devise an antithetic sampler to estimate level differences guaranteeing reduced computational complexity for the multilevel DLMC estimator compared with the single-level DLMC estimator. To address rare events, we apply the importance sampling scheme, obtained via stochastic optimal control in (Ben Rached et al., 2023), over all levels of the multilevel DLMC estimator. Combining importance sampling and multilevel DLMC reduces computational complexity by one order and drastically reduces the associated constant compared to the single-level DLMC estimator without importance sampling. We illustrate the effectiveness of the proposed multilevel DLMC estimator on the Kuramoto model from statistical physics with Lipschitz observables, confirming the reduced complexity from $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ for the single-level DLMC estimator to $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-3})$ while providing a feasible estimate of rare-event quantities up to prescribed relative error tolerance $\mathrm{TOL}_{\mathrm{r}}$.
△ Less
Submitted 8 April, 2024; v1 submitted 5 August, 2022;
originally announced August 2022.
-
Double-Loop Importance Sampling for McKean--Vlasov Stochastic Differential Equation
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Shyam Mohan Subbiah Pillai,
Raúl Tempone
Abstract:
This paper investigates Monte Carlo (MC) methods to estimate probabilities of rare events associated with solutions to the $d$-dimensional McKean-Vlasov stochastic differential equation (MV-SDE). MV-SDEs are usually approximated using a stochastic interacting $P$-particle system, which is a set of $P$ coupled $d$-dimensional stochastic differential equations (SDEs). Importance sampling (IS) is a c…
▽ More
This paper investigates Monte Carlo (MC) methods to estimate probabilities of rare events associated with solutions to the $d$-dimensional McKean-Vlasov stochastic differential equation (MV-SDE). MV-SDEs are usually approximated using a stochastic interacting $P$-particle system, which is a set of $P$ coupled $d$-dimensional stochastic differential equations (SDEs). Importance sampling (IS) is a common technique for reducing high relative variance of MC estimators of rare-event probabilities. We first derive a zero-variance IS change of measure for the quantity of interest by using stochastic optimal control theory. However, when this change of measure is applied to stochastic particle systems, it yields a $P \times d$-dimensional partial differential control equation (PDE), which is computationally expensive to solve. To address this issue, we use the decoupling approach introduced in [dos Reis et al., 2023], generating a $d$-dimensional control PDE for a zero-variance estimator of the decoupled SDE. Based on this approach, we develop a computationally efficient double loop MC (DLMC) estimator. We conduct a comprehensive numerical error and work analysis of the DLMC estimator. As a result, we show optimal complexity of $\mathcal{O}(\mathrm{TOL}_{\mathrm{r}}^{-4})$ with a significantly reduced constant to achieve a prescribed relative error tolerance $\mathrm{TOL}_{\mathrm{r}}$. Subsequently, we propose an adaptive DLMC method combined with IS to numerically estimate rare-event probabilities, substantially reducing relative variance and computational runtimes required to achieve a given $\mathrm{TOL}_{\mathrm{r}}$ compared with standard MC estimators in the absence of IS. Numerical experiments are performed on the Kuramoto model from statistical physics.
△ Less
Submitted 22 October, 2023; v1 submitted 14 July, 2022;
originally announced July 2022.
-
State-dependent Importance Sampling for Estimating Expectations of Functionals of Sums of Independent Random Variables
Authors:
Eya Ben Amar,
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Raúl Tempone
Abstract:
Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive Monte Carlo simulation is an alternative approach. However, this method requires numerous samples for rare event problems. Therefore, it is paramount to use varianc…
▽ More
Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive Monte Carlo simulation is an alternative approach. However, this method requires numerous samples for rare event problems. Therefore, it is paramount to use variance reduction techniques to develop fast and efficient estimation methods. In this work, we use importance sampling (IS), known for its efficiency in requiring fewer computations to achieve the same accuracy requirements. We propose a state-dependent IS scheme based on a stochastic optimal control formulation, where the control is dependent on state and time. We aim to calculate rare event quantities that could be written as an expectation of a functional of the sums of independent RVs. The proposed algorithm is generic and can be applied without restrictions on the univariate distributions of RVs or the functional applied to the sum. We apply this approach to the log-normal distribution to compute the left tail and cumulative distribution of the ratio of independent RVs. For each case, we numerically demonstrate that the proposed state-dependent IS algorithm compares favorably to most well-known estimators dealing with similar problems.
△ Less
Submitted 26 October, 2022; v1 submitted 4 January, 2022;
originally announced January 2022.
-
Learning-Based Importance Sampling via Stochastic Optimal Control for Stochastic Reaction Networks
Authors:
Chiheb Ben Hammouda,
Nadhir Ben Rached,
Raúl Tempone,
Sophia Wiechert
Abstract:
We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator efficiency based on an approximate tau-leap scheme. The crucial step in the IS framework is choosing an appropriate change of probability measure to achieve substan…
▽ More
We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator efficiency based on an approximate tau-leap scheme. The crucial step in the IS framework is choosing an appropriate change of probability measure to achieve substantial variance reduction. This task is typically challenging and often requires insights into the underlying problem. Therefore, we propose an automated approach to obtain a highly efficient path-dependent measure change based on an original connection in the stochastic reaction network context between finding optimal IS parameters within a class of probability measures and a stochastic optimal control formulation. Optimal IS parameters are obtained by solving a variance minimization problem. First, we derive an associated dynamic programming equation. Analytically solving this backward equation is challenging, hence we propose an approximate dynamic programming formulation to find near-optimal control parameters. To mitigate the curse of dimensionality, we propose a learning-based method to approximate the value function using a neural network, where the parameters are determined via a stochastic optimization algorithm. Our analysis and numerical experiments verify that the proposed learning-based IS approach substantially reduces MC estimator variance, resulting in a lower computational complexity in the rare event regime, compared with standard tau-leap MC estimators.
△ Less
Submitted 13 February, 2023; v1 submitted 27 October, 2021;
originally announced October 2021.
-
Efficient Importance Sampling for Large Sums of Independent and Identically Distributed Random Variables
Authors:
Nadhir Ben Rached,
Abdul-Lateef Haji-Ali,
Gerardo Rubino,
Raul Tempone
Abstract:
We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq γ)$, via importance sampling (IS). We are particularly interested in the rare event regime when $N$ is large and/or $γ$ is small. The exponential twisting is a popular technique for similar problems that…
▽ More
We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq γ)$, via importance sampling (IS). We are particularly interested in the rare event regime when $N$ is large and/or $γ$ is small. The exponential twisting is a popular technique for similar problems that, in most cases, compares favorably to other estimators. However, it has some limitations: i) it assumes the knowledge of the moment generating function of $X_i$ and ii) sampling under the new IS PDF is not straightforward and might be expensive. The aim of this work is to propose an alternative IS PDF that approximately yields, for certain classes of distributions and in the rare event regime, at least the same performance as the exponential twisting technique and, at the same time, does not introduce serious limitations. The first class includes distributions whose probability density functions (PDFs) are asymptotically equivalent, as $x \rightarrow 0$, to $bx^{p}$, for $p>-1$ and $b>0$. For this class of distributions, the Gamma IS PDF with appropriately chosen parameters retrieves approximately, in the rare event regime corresponding to small values of $γ$ and/or large values of $N$, the same performance of the estimator based on the use of the exponential twisting technique. In the second class, we consider the Log-normal setting, whose PDF at zero vanishes faster than any polynomial, and we show numerically that a Gamma IS PDF with optimized parameters clearly outperforms the exponential twisting IS PDF. Numerical experiments validate the efficiency of the proposed estimator in delivering a highly accurate estimate in the regime of large $N$ and/or small $γ$.
△ Less
Submitted 1 October, 2021; v1 submitted 23 January, 2021;
originally announced January 2021.
-
Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks
Authors:
Chiheb Ben Hammouda,
Nadhir Ben Rached,
Raul Tempone
Abstract:
The multilevel Monte Carlo (MLMC) method for continuous-time Markov chains, first introduced by Anderson and Higham (SIAM Multiscal Model. Simul. 10(1), 2012), is a highly efficient simulation technique that can be used to estimate various statistical quantities for stochastic reaction networks (SRNs), in particular for stochastic biological systems. Unfortunately, the robustness and performance o…
▽ More
The multilevel Monte Carlo (MLMC) method for continuous-time Markov chains, first introduced by Anderson and Higham (SIAM Multiscal Model. Simul. 10(1), 2012), is a highly efficient simulation technique that can be used to estimate various statistical quantities for stochastic reaction networks (SRNs), in particular for stochastic biological systems. Unfortunately, the robustness and performance of the multilevel method can be affected by the high kurtosis, a phenomenon observed at the deep levels of MLMC, which leads to inaccurate estimates of the sample variance. In this work, we address cases where the high-kurtosis phenomenon is due to \textit{catastrophic coupling (characteristic of pure jump processes where coupled consecutive paths are identical in most of the simulations, while differences only appear in a tiny proportion) and introduce a pathwise-dependent importance sampling (IS) technique that improves the robustness and efficiency of the multilevel method. Our theoretical results, along with the conducted numerical experiments, demonstrate that our proposed method significantly reduces the kurtosis of the deep levels of MLMC, and also improves the strong convergence rate from $β=1$ for the standard case (without IS), to $β=1+δ$, where $0<δ<1$ is a user-selected parameter in our IS algorithm. Due to the complexity theorem of MLMC, and given a pre-selected tolerance, $\text{TOL}$, this results in an improvement of the complexity from $\mathcal{O}\left(\text{TOL}^{-2} \log(\text{TOL})^2\right)$ in the standard case to $\mathcal{O}\left(\text{TOL}^{-2}\right)$, which is the optimal complexity of the MLMC estimator. We achieve all these improvements with a negligible additional cost since our IS algorithm is only applied a few times across each simulated path.
△ Less
Submitted 24 June, 2020; v1 submitted 14 November, 2019;
originally announced November 2019.
-
A Universal Splitting Estimator for the Performance Evaluation of Wireless Communications Systems
Authors:
Nadhir Ben Rached,
Daniel MacKinlay,
Zdravko Botev,
Raul Tempone,
Mohamed-Slim Alouini
Abstract:
We propose a unified rare-event estimator for the performance evaluation of wireless communication systems. The estimator is derived from the well-known multilevel splitting algorithm. In its original form, the splitting algorithm cannot be applied to the simulation and estimation of time-independent problems, because splitting requires an underlying continuous-time Markov process whose trajectori…
▽ More
We propose a unified rare-event estimator for the performance evaluation of wireless communication systems. The estimator is derived from the well-known multilevel splitting algorithm. In its original form, the splitting algorithm cannot be applied to the simulation and estimation of time-independent problems, because splitting requires an underlying continuous-time Markov process whose trajectories can be split. We tackle this problem by embedding the static problem of interest within a continuous-time Markov process, so that the target time-independent distribution becomes the distribution of the Markov process at a given time instant. The main feature of the proposed multilevel splitting algorithm is its large scope of applicability. For illustration, we show how the same algorithm can be applied to the problem of estimating the cumulative distribution function (CDF) of sums of random variables (RVs), the CDF of partial sums of ordered RVs, the CDF of ratios of RVs, and the CDF of weighted sums of Poisson RVs. We investigate the computational efficiency of the proposed estimator via a number of simulation studies and find that it compares favorably with existing estimators.
△ Less
Submitted 28 August, 2019;
originally announced August 2019.
-
An Accurate Sample Rejection Estimator for the Estimation of Outage Probability of EGC Receivers
Authors:
Nadhir Ben Rached,
Abla Kammoun,
Mohamed-Slim Alouini,
Raul Tempone
Abstract:
In this work, we evaluate the outage probability (OP) for L-branch equal gain combining (EGC) diversity receivers operating over fading channels, i.e. equivalently the cumulative distribution function (CDF) of the sum of the L channel envelopes. In general, closed form expressions of OP values are unobtainable. The use of Monte Carlo (MC) simulations is not considered a good alternative as it requ…
▽ More
In this work, we evaluate the outage probability (OP) for L-branch equal gain combining (EGC) diversity receivers operating over fading channels, i.e. equivalently the cumulative distribution function (CDF) of the sum of the L channel envelopes. In general, closed form expressions of OP values are unobtainable. The use of Monte Carlo (MC) simulations is not considered a good alternative as it requires a large number of samples for small values of OP, making MC simulations very expensive. In this paper, we use the concept of importance sampling (IS), being known to yield accurate estimates using fewer simulation runs. Our proposed IS scheme is essentially based on sample rejection where the IS probability density function (PDF) is the truncation of the underlying PDF over the L dimensional sphere. It assumes the knowledge of the CDF of the sum of the L channel gains in a closed-form expression. Such an assumption is not restrictive since it holds for various challenging fading models. We apply our approach to the case of independent Rayleigh, correlated Rayleigh, and independent and identically distributed Rice fading models. Next, we extend our approach to the interesting scenario of generalised selection combining receivers combined with EGC under the independent Rayleigh fading environment. For each case, we prove the desired bounded relative error property. Finally, we validate these theoretical results through some selected experiments.
△ Less
Submitted 13 March, 2019;
originally announced March 2019.
-
On the Sum of Order Statistics and Applications to Wireless Communication Systems Performances
Authors:
Nadhir Ben Rached,
Zdravko Botev,
Abla Kammoun,
Mohamed-Slim Alouini,
Raul Tempone
Abstract:
We consider the problem of evaluating the cumulative distribution function (CDF) of the sum of order statistics, which serves to compute outage probability (OP) values at the output of generalized selection combining receivers. Generally, closed-form expressions of the CDF of the sum of order statistics are unavailable for many practical distributions. Moreover, the naive Monte Carlo (MC) method r…
▽ More
We consider the problem of evaluating the cumulative distribution function (CDF) of the sum of order statistics, which serves to compute outage probability (OP) values at the output of generalized selection combining receivers. Generally, closed-form expressions of the CDF of the sum of order statistics are unavailable for many practical distributions. Moreover, the naive Monte Carlo (MC) method requires a substantial computational effort when the probability of interest is sufficiently small. In the region of small OP values, we propose instead two effective variance reduction techniques that yield a reliable estimate of the CDF with small computing cost. The first estimator, which can be viewed as an importance sampling estimator, has bounded relative error under a certain assumption that is shown to hold for most of the challenging distributions. An improvement of this estimator is then proposed for the Pareto and the Weibull cases. The second is a conditional MC estimator that achieves the bounded relative error property for the Generalized Gamma case and the logarithmic efficiency in the Log-normal case. Finally, the efficiency of these estimators is compared via various numerical experiments.
△ Less
Submitted 12 November, 2017;
originally announced November 2017.
-
On the Efficient Simulation of the Left-Tail of the Sum of Correlated Log-normal Variates
Authors:
Mohamed-Slim Alouini,
Nadhir Ben Rached,
Abla Kammoun,
Raul Tempone
Abstract:
The sum of Log-normal variates is encountered in many challenging applications such as in performance analysis of wireless communication systems and in financial engineering. Several approximation methods have been developed in the literature, the accuracy of which is not ensured in the tail regions. These regions are of primordial interest wherein small probability values have to be evaluated wit…
▽ More
The sum of Log-normal variates is encountered in many challenging applications such as in performance analysis of wireless communication systems and in financial engineering. Several approximation methods have been developed in the literature, the accuracy of which is not ensured in the tail regions. These regions are of primordial interest wherein small probability values have to be evaluated with high precision. Variance reduction techniques are known to yield accurate, yet efficient, estimates of small probability values. Most of the existing approaches, however, have considered the problem of estimating the right-tail of the sum of Log-normal random variables (RVS). In the present work, we consider instead the estimation of the left-tail of the sum of correlated Log-normal variates with Gaussian copula under a mild assumption on the covariance matrix. We propose an estimator combining an existing mean-shifting importance sampling approach with a control variate technique. The main result is that the proposed estimator has an asymptotically vanishing relative error which represents a major finding in the context of the left-tail simulation of the sum of Log-normal RVs. Finally, we assess by various simulation results the performances of the proposed estimator compared to existing estimators.
△ Less
Submitted 26 May, 2017; v1 submitted 22 May, 2017;
originally announced May 2017.
-
An Improved Hazard Rate Twisting Approach for the Statistic of the Sum of Subexponential Variates (Extended Version)
Authors:
Nadhir Ben Rached,
Abla Kammoun,
Mohamed-Slim Alouini,
Raul Tempone
Abstract:
In this letter, we present an improved hazard rate twisting technique for the estimation of the probability that a sum of independent but not necessarily identically distributed subexponential Random Variables (RVs) exceeds a given threshold. Instead of twisting all the components in the summation, we propose to twist only the RVs which have the biggest impact on the right-tail of the sum distribu…
▽ More
In this letter, we present an improved hazard rate twisting technique for the estimation of the probability that a sum of independent but not necessarily identically distributed subexponential Random Variables (RVs) exceeds a given threshold. Instead of twisting all the components in the summation, we propose to twist only the RVs which have the biggest impact on the right-tail of the sum distribution and keep the other RVs unchanged. A minmax approach is performed to determine the optimal twisting parameter which leads to an asymptotic optimality criterion. Moreover, we show through some selected simulation results that our proposed approach results in a variance reduction compared to the technique where all the components are twisted.
△ Less
Submitted 9 April, 2015; v1 submitted 16 November, 2014;
originally announced November 2014.
-
A Fast Simulation Method for the Sum of Subexponential Distributions
Authors:
Nadhir Ben Rached,
Fatma Benkhelifa,
Abla Kammoun,
Mohamed-Slim Alouini,
Raul Tempone
Abstract:
Estimating the probability that a sum of random variables (RVs) exceeds a given threshold is a well-known challenging problem. Closed-form expression of the sum distribution is usually intractable and presents an open problem. A crude Monte Carlo (MC) simulation is the standard technique for the estimation of this type of probability. However, this approach is computationally expensive especially…
▽ More
Estimating the probability that a sum of random variables (RVs) exceeds a given threshold is a well-known challenging problem. Closed-form expression of the sum distribution is usually intractable and presents an open problem. A crude Monte Carlo (MC) simulation is the standard technique for the estimation of this type of probability. However, this approach is computationally expensive especially when dealing with rare events (i.e events with very small probabilities). Importance Sampling (IS) is an alternative approach which effectively improves the computational efficiency of the MC simulation. In this paper, we develop a general framework based on IS approach for the efficient estimation of the probability that the sum of independent and not necessarily identically distributed heavy-tailed RVs exceeds a given threshold. The proposed IS approach is based on constructing a new sampling distribution by twisting the hazard rate of the original underlying distribution of each component in the summation. A minmax approach is carried out for the determination of the twisting parameter, for any given threshold. Moreover, using this minmax optimal choice, the estimation of the probability of interest is shown to be asymptotically optimal as the threshold goes to infinity. We also offer some selected simulation results illustrating first the efficiency of the proposed IS approach compared to the naive MC simulation. The near-optimality of the minmax approach is then numerically analyzed.
△ Less
Submitted 21 September, 2014; v1 submitted 18 June, 2014;
originally announced June 2014.
