-
Asymptotically Optimal Control of a Centralized Dynamic Matching Market with General Utilities
Authors:
Jose H. Blanchet,
Martin I. Reiman,
Viragh Shah,
Lawrence M. Wein,
Linjia Wu
Abstract:
We consider a matching market where buyers and sellers arrive according to independent Poisson processes at the same rate and independently abandon the market if not matched after an exponential amount of time with the same mean. In this centralized market, the utility for the system manager from matching any buyer and any seller is a general random variable. We consider a sequence of systems inde…
▽ More
We consider a matching market where buyers and sellers arrive according to independent Poisson processes at the same rate and independently abandon the market if not matched after an exponential amount of time with the same mean. In this centralized market, the utility for the system manager from matching any buyer and any seller is a general random variable. We consider a sequence of systems indexed by $n$ where the arrivals in the $n^{\mathrm{th}}$ system are sped up by a factor of $n$. We analyze two families of one-parameter policies: the population threshold policy immediately matches an arriving agent to its best available mate only if the number of mates in the system is above a threshold, and the utility threshold policy matches an arriving agent to its best available mate only if the corresponding utility is above a threshold. Using a fluid analysis of the two-dimensional Markov process of buyers and sellers, we show that when the matching utility distribution is light-tailed, the population threshold policy with threshold $\frac{n}{\ln n}$ is asymptotically optimal among all policies that make matches only at agent arrival epochs. In the heavy-tailed case, we characterize the optimal threshold level for both policies. We also study the utility threshold policy in an unbalanced matching market with heavy-tailed matching utilities and find that the buyers and sellers have the same asymptotically optimal utility threshold. We derive optimal thresholds when the matching utility distribution is exponential, uniform, Pareto, and correlated Pareto. We find that as the right tail of the matching utility distribution gets heavier, the threshold level of each policy (and hence market thickness) increases, as does the magnitude by which the utility threshold policy outperforms the population threshold policy.
△ Less
Submitted 10 June, 2021; v1 submitted 8 February, 2020;
originally announced February 2020.
-
Unbiased Multilevel Monte Carlo: Stochastic Optimization, Steady-state Simulation, Quantiles, and Other Applications
Authors:
Jose H. Blanchet,
Peter W. Glynn,
Yanan Pei
Abstract:
We present general principles for the design and analysis of unbiased Monte Carlo estimators in a wide range of settings. Our estimators posses finite work-normalized variance under mild regularity conditions. We apply our estimators to various settings of interest, including unbiased optimization in Sample Average Approximations, unbiased steady-state simulation of regenerative processes, quantil…
▽ More
We present general principles for the design and analysis of unbiased Monte Carlo estimators in a wide range of settings. Our estimators posses finite work-normalized variance under mild regularity conditions. We apply our estimators to various settings of interest, including unbiased optimization in Sample Average Approximations, unbiased steady-state simulation of regenerative processes, quantile estimation and nested simulation problems.
△ Less
Submitted 22 April, 2019;
originally announced April 2019.
-
Smoothed Variable Sample-size Accelerated Proximal Methods for Nonsmooth Stochastic Convex Programs
Authors:
Afrooz Jalilzadeh,
Uday V. Shanbhag,
Jose H. Blanchet,
Peter W. Glynn
Abstract:
We consider minimizing $f(x) = \mathbb{E}[f(x,ω)]$ when $f(x,ω)$ is possibly nonsmooth and either strongly convex or convex in $x$. (I) Strongly convex. When $f(x,ω)$ is $μ-$strongly convex in $x$, we propose a variable sample-size accelerated proximal scheme (VS-APM) and apply it on $f_η(x)$, the ($η$-)Moreau smoothed variant of $\mathbb{E}[f(x,ω)]$; we term such a scheme as (m-VS-APM). We consid…
▽ More
We consider minimizing $f(x) = \mathbb{E}[f(x,ω)]$ when $f(x,ω)$ is possibly nonsmooth and either strongly convex or convex in $x$. (I) Strongly convex. When $f(x,ω)$ is $μ-$strongly convex in $x$, we propose a variable sample-size accelerated proximal scheme (VS-APM) and apply it on $f_η(x)$, the ($η$-)Moreau smoothed variant of $\mathbb{E}[f(x,ω)]$; we term such a scheme as (m-VS-APM). We consider three settings. (a) Bounded domains. In this setting, VS-APM displays linear convergence in inexact gradient steps, each of which requires utilizing an inner (SSG) scheme. Specifically, mVS-APM achieves an optimal oracle complexity in SSG steps; (b) Unbounded domains. In this regime, under a weaker assumption of suitable state-dependent bounds on subgradients, an unaccelerated variant mVS-PM is linearly convergent; (c) Smooth ill-conditioned $f$. When $f$ is $L$-smooth and $κ= L/μ\ggg 1$, we employ mVS-APM where increasingly accurate gradients $\nabla_x f_η(x)$ are obtained by VS-APM. Notably, mVS-APM displays linear convergence and near-optimal complexity in inner proximal evaluations (upto a log factor) compared to VS-APM. But, unlike a direct application of VS-APM, this scheme is characterized by larger steplengths and better empirical behavior; (II) Convex. When $f(x,ω)$ is merely convex but smoothable, by suitable choices of the smoothing, steplength, and batch-size sequences, smoothed VS-APM (or sVS-APM) produces sequences for which expected sub-optimality diminishes at the rate of $\mathcal{O}(1/k)$ with an optimal oracle complexity of $\mathcal{O}(1/ε^2)$. Finally, sVS-APM and VS-APM produce sequences that converge almost surely to a solution of the original problem.
△ Less
Submitted 6 October, 2022; v1 submitted 1 March, 2018;
originally announced March 2018.
-
On Optimal Exact Simulation of Max-Stable and Related Random Fields
Authors:
Zhipeng Liu,
Jose H. Blanchet,
A. B. Dieker,
Thomas Mikosch
Abstract:
We consider the random field M(t)=\sup_{n\geq 1}\big\{-\log A_{n}+X_{n}(t)\big\}\,,\qquad t\in T\, for a set $T\subset \mathbb{R}^{m}$, where $(X_{n})$ is an iid sequence of centered Gaussian random fields on $T$ and $0<A_{1}<A_{2}<\cdots $ are the arrivals of a general renewal process on $(0,\infty )$, independent of $(X_{n})$. In particular, a large class of max-stable random fields with Gumbel…
▽ More
We consider the random field M(t)=\sup_{n\geq 1}\big\{-\log A_{n}+X_{n}(t)\big\}\,,\qquad t\in T\, for a set $T\subset \mathbb{R}^{m}$, where $(X_{n})$ is an iid sequence of centered Gaussian random fields on $T$ and $0<A_{1}<A_{2}<\cdots $ are the arrivals of a general renewal process on $(0,\infty )$, independent of $(X_{n})$. In particular, a large class of max-stable random fields with Gumbel marginals have such a representation. Assume that one needs $c\left( d\right) =c(\{t_{1},\ldots,t_{d}\})$ function evaluations to sample $X_{n}$ at $d$ locations $t_{1},\ldots ,t_{d}\in T$. We provide an algorithm which, for any $ε>0$, samples $M(t_{1}),\ldots ,M(t_{d})$ with complexity $o(c(d)\,d^{ε})$. Moreover, if $X_{n}$ has an a.s. converging series representation, then $M$ can be a.s. approximated with error $δ$ uniformly over $T$ and with complexity $O(1/(δ\log (1/δ))^{1/α})$, where $α$ relates to the Hölder continuity exponent of the process $X_{n}$ (so, if $X_{n}$ is Brownian motion, $α=1/2$).
△ Less
Submitted 24 March, 2018; v1 submitted 19 September, 2016;
originally announced September 2016.
-
Theoretical analysis of a Stochastic Approximation approach for computing Quasi-Stationary distributions of general state space Markov chains
Authors:
Jose H. Blanchet,
Peter Glynn,
Shuheng Zheng
Abstract:
An algorithm for estimating quasi-stationary distribution of finite state space Markov chains has been proven in a previous paper. Now this paper proves a similar algorithm that works for general state space Markov chains under very general assumptions.
An algorithm for estimating quasi-stationary distribution of finite state space Markov chains has been proven in a previous paper. Now this paper proves a similar algorithm that works for general state space Markov chains under very general assumptions.
△ Less
Submitted 2 March, 2015; v1 submitted 23 February, 2015;
originally announced February 2015.
-
Efficient Monte Carlo for high excursions of Gaussian random fields
Authors:
Robert J. Adler,
Jose H. Blanchet,
**gchen Liu
Abstract:
Our focus is on the design and analysis of efficient Monte Carlo methods for computing tail probabilities for the suprema of Gaussian random fields, along with conditional expectations of functionals of the fields given the existence of excursions above high levels, b. Naïve Monte Carlo takes an exponential, in b, computational cost to estimate these probabilities and conditional expectations for…
▽ More
Our focus is on the design and analysis of efficient Monte Carlo methods for computing tail probabilities for the suprema of Gaussian random fields, along with conditional expectations of functionals of the fields given the existence of excursions above high levels, b. Naïve Monte Carlo takes an exponential, in b, computational cost to estimate these probabilities and conditional expectations for a prescribed relative accuracy. In contrast, our Monte Carlo procedures achieve, at worst, polynomial complexity in b, assuming only that the mean and covariance functions are Hölder continuous. We also explain how to fine tune the construction of our procedures in the presence of additional regularity, such as homogeneity and smoothness, in order to further improve the efficiency.
△ Less
Submitted 8 October, 2012; v1 submitted 5 May, 2010;
originally announced May 2010.
-
Efficient importance sampling for binary contingency tables
Authors:
Jose H. Blanchet
Abstract:
Importance sampling has been reported to produce algorithms with excellent empirical performance in counting problems. However, the theoretical support for its efficiency in these applications has been very limited. In this paper, we propose a methodology that can be used to design efficient importance sampling algorithms for counting and test their efficiency rigorously. We apply our techniques…
▽ More
Importance sampling has been reported to produce algorithms with excellent empirical performance in counting problems. However, the theoretical support for its efficiency in these applications has been very limited. In this paper, we propose a methodology that can be used to design efficient importance sampling algorithms for counting and test their efficiency rigorously. We apply our techniques after transforming the problem into a rare-event simulation problem--thereby connecting complexity analysis of counting problems with efficiency in the context of rare-event simulation. As an illustration of our approach, we consider the problem of counting the number of binary tables with fixed column and row sums, $c_j$'s and $r_i$'s, respectively, and total marginal sums $d=\sum_jc_j$. Assuming that $\max_jc_j=o(d^{1/2})$, $\sum c_j^2=O(d)$ and the $r_j$'s are bounded, we show that a suitable importance sampling algorithm, proposed by Chen et al. [J. Amer. Statist. Assoc. 100 (2005) 109--120], requires $O(d^3\varepsilon^{-2}δ^{-1})$ operations to produce an estimate that has $\varepsilon$-relative error with probability $1-δ$. In addition, if $\max_jc_j=o(d^{1/4-δ_0})$ for some $δ_0>0$, the same coverage can be guaranteed with $O(d^3\varepsilon^{-2}\log(δ^{-1}))$ operations.
△ Less
Submitted 7 August, 2009;
originally announced August 2009.
