Showing 1–50 of 90 results for author: Budhiraja, A

Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models

Authors: Nisarg Patel, Mohith Kulkarni, Mihir Parmar, Aashna Budhiraja, Mutsumi Nakamura, Neeraj Varshney, Chitta Baral

Abstract: As Large Language Models (LLMs) continue to exhibit remarkable performance in natural language understanding tasks, there is a crucial need to measure their ability for human-like multi-step logical reasoning. Existing logical reasoning evaluation benchmarks often focus primarily on simplistic single-step or multi-step reasoning with a limited set of inference rules. Furthermore, the lack of datas… ▽ More As Large Language Models (LLMs) continue to exhibit remarkable performance in natural language understanding tasks, there is a crucial need to measure their ability for human-like multi-step logical reasoning. Existing logical reasoning evaluation benchmarks often focus primarily on simplistic single-step or multi-step reasoning with a limited set of inference rules. Furthermore, the lack of datasets for evaluating non-monotonic reasoning represents a crucial gap since it aligns more closely with human-like reasoning. To address these limitations, we propose Multi-LogiEval, a comprehensive evaluation dataset encompassing multi-step logical reasoning with various inference rules and depths. Multi-LogiEval covers three logic types--propositional, first-order, and non-monotonic--consisting of more than 30 inference rules and more than 60 of their combinations with various depths. Leveraging this dataset, we conduct evaluations on a range of LLMs including GPT-4, ChatGPT, Gemini-Pro, Yi, Orca, and Mistral, employing a zero-shot chain-of-thought. Experimental results show that there is a significant drop in the performance of LLMs as the reasoning steps/depth increases (average accuracy of ~68% at depth-1 to ~43% at depth-5). We further conduct a thorough investigation of reasoning chains generated by LLMs which reveals several important findings. We believe that Multi-LogiEval facilitates future research for evaluating and enhancing the logical reasoning ability of LLMs. Data is available at https://github.com/Mihir3009/Multi-LogiEval. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Comments: 23 Pages

Flocking under Fast and Large Jumps: Stability, Chaos, and Traveling Waves

Authors: Sayan Banerjee, Amarjit Budhiraja, Dilshad Imon

Abstract: We study a model for flocking given by a $n$-particle system under which each particle jumps forward by a random amount, independently sampled from a given distribution $θ$, with rate given by a non-increasing function $w$ of its signed distance from the system center of mass. This model was introduced in Balázs et. al. (2014) and some of its properties were studied for the case when $w$ is bounde… ▽ More We study a model for flocking given by a $n$-particle system under which each particle jumps forward by a random amount, independently sampled from a given distribution $θ$, with rate given by a non-increasing function $w$ of its signed distance from the system center of mass. This model was introduced in Balázs et. al. (2014) and some of its properties were studied for the case when $w$ is bounded. In the current work we are interested in the setting where $w$ is unbounded, and this feature results in a stochastic dynamical system for interacting particles with fast and large jumps for which little is available in the literature. We characterize the large $n$ limit (the so-called `fluid limit') of the empirical measure process associated with the system and prove a propagation of chaos result. Next, for the centered $n$-particle system, by constructing suitable Lyapunov functions, we establish existence and uniqueness of stationary distributions and study their tail properties. In the special case where $w$ is an exponential function and $θ$ is an exponential distribution, by establishing that all stationary solutions of the McKean-Vlasov equation must be the unique fixed point of the equation, we prove a propagation of chaos result at $t=\infty$ and establish convergence of the particle system, starting from stationarity, in the large $n$ limit, to a traveling wave solution of the McKean-Vlasov equation. The proof of this result may be of interest for other interacting particle systems where convexity properties or functional inequalities generally used for establishing such a result are not available. Our work answers several open problems posed in Balázs et. al. △ Less

Submitted 19 April, 2024; originally announced April 2024.

Comments: 52 pages

On Some Extensions of the Boué-Dupuis Variational Formula

Authors: A. Budhiraja

Abstract: The Boué-Dupuis variational formula gives a representation for log Laplace transforms of bounded measurable functions of a finite dimensional Brownian motion on a compact time interval as an infimum of a suitable cost over a collection of non-anticipative control processes. This variational formula has proved to be very useful in studying a variety of large deviation problems. In this article we c… ▽ More The Boué-Dupuis variational formula gives a representation for log Laplace transforms of bounded measurable functions of a finite dimensional Brownian motion on a compact time interval as an infimum of a suitable cost over a collection of non-anticipative control processes. This variational formula has proved to be very useful in studying a variety of large deviation problems. In this article we collect some extensions of this basic result that have appeared in disparate venues in studying a broad range of large deviation questions. Some of these results can be found in a unified way in the recent book (Budhiraja and Dupuis(2019)), while others, to date, have been scattered at various places in the literature. The latter category includes, in particular, variational representations, when the stochastic dynamical system of interest has in addition to a driving Lévy noise, another source of randomness, e.g. due to a random initial condition; when the functionals of interest depends on infinite-length paths of a Lévy process; when the noise process is a Gaussian process with long-range dependence, e.g. a fractional Brownian motion, etc. The goal of this survey article is to present these diverse variational formulas in a systematic manner. △ Less

Submitted 3 March, 2024; originally announced March 2024.

MSC Class: 60F10; 60H10; 60H15

Diffusion limits in the quarter plane and non-semimartingale reflected Brownian motion

Authors: Rami Atar, Amarjit Budhiraja

Abstract: We consider a continuous-time random walk in the quarter plane for which the transition intensities are constant on each of the four faces $(0,\infty)^2$, $F_1=\{0\}\times(0,\infty)$, $F_2=(0,\infty)\times\{0\}$ and $\{(0,0)\}$. We show that when rescaled diffusively it converges in law to a Brownian motion with oblique reflection direction $d^{(i)}$ on face $F_i$, $i=1,2$, defined via the Varadha… ▽ More We consider a continuous-time random walk in the quarter plane for which the transition intensities are constant on each of the four faces $(0,\infty)^2$, $F_1=\{0\}\times(0,\infty)$, $F_2=(0,\infty)\times\{0\}$ and $\{(0,0)\}$. We show that when rescaled diffusively it converges in law to a Brownian motion with oblique reflection direction $d^{(i)}$ on face $F_i$, $i=1,2$, defined via the Varadhan-Williams submartingale problem. A parameter denoted by $α$ was introduced in \cite{vw}, measuring the extent to which $d^{(i)}$ are inclined toward the origin. In the case of the quarter plane, $α$ takes values in $(-2,2)$, and it is known that the reflected Brownian motion is a semimartingale if and only if $α\in(-2,1)$. Convergence results via both the Skorohod map and the invariance principle for semimartingale reflected Brownian motion are known to hold in various settings in arbitrary dimension. In the case of the quarter plane, the invariance principle was proved for $α\in (-2,1)$ whereas for tools based on the Skorohod map to be applicable it is necessary (but not sufficient) that $α\in [-1,1)$. Another tool that has been used to prove convergence in general dimension is the extended Skorohod map, which in the case of the quarter plane provides convergence for $α=1$. This paper focuses on the range $α\in (1,2)$, where the Skorohod problem and the extended Skorohod problem do not possess a unique solution, the limit process is not a semimartingale, and convergence to reflected Brownian motion has not been shown before. The result has implications on the asymptotic analysis of two Markovian queueing models: The {\it generalized processor sharing model with parallelization slowdown}, and the {\it coupled processor model}. △ Less

Submitted 1 March, 2024; originally announced March 2024.

MSC Class: 60J65; 60B10; 60J55; 60J70

Simple Form Control Policies for Resource Sharing Networks with HGI Performance

Authors: Amarjit Budhiraja, Dane Johnson

Abstract: We consider a family of resource sharing networks, known as bandwidth sharing models, in heavy traffic with general service and interarrival times. These networks, introduced in Massoulie and Roberts (2000) as models for internet flows, have the feature that a typical job may require simultaneous processing by multiple resources in the network. We construct simple form threshold policies that asym… ▽ More We consider a family of resource sharing networks, known as bandwidth sharing models, in heavy traffic with general service and interarrival times. These networks, introduced in Massoulie and Roberts (2000) as models for internet flows, have the feature that a typical job may require simultaneous processing by multiple resources in the network. We construct simple form threshold policies that asymptotically achieve the Hierarchical Greedy Ideal (HGI) performance. This performance benchmark, which was introduced in Harrison et al. (2014), is characterized by the following two features: every resource works at full capacity whenever there is work for that resource in the system; total holding cost of jobs of each type at any instant is the minimum cost possible for the associated vector of workloads. The control policy we provide is explicit in terms of a finite collection of vectors which can be computed offline by solving a system of linear inequalities. Proof of convergence is based on path large deviation estimates for renewal processes, Lyapunov function constructions, and analyses of suitable sample path excursions. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: To be published in Annals of Applied Probability

MSC Class: 60K20; 68M20; 90B36 (Primary) 60J70 (Secondary)

Ergodic Control of Resource Sharing Networks: Lower Bound on Asymptotic Costs

Authors: Amarjit Budhiraja, Michael Conroy, Dane Johnson

Abstract: Dynamic capacity allocation control for resource sharing networks (RSN) is studied when the networks are in heavy traffic. The goal is to minimize an ergodic cost with a linear holding cost function. Our main result shows that the optimal cost associated with an associated Brownian control problem provides a lower bound for the asymptotic ergodic cost in the RSN for any sequence of control policie… ▽ More Dynamic capacity allocation control for resource sharing networks (RSN) is studied when the networks are in heavy traffic. The goal is to minimize an ergodic cost with a linear holding cost function. Our main result shows that the optimal cost associated with an associated Brownian control problem provides a lower bound for the asymptotic ergodic cost in the RSN for any sequence of control policies. A similar result for an infinite horizon discounted cost has been previously shown for general resource sharing networks and for general "unitary networks." The study of an ergodic cost criterion requires different ideas as bounds on ergodic costs only yield an estimate on the controls in a time-averaged sense which makes the time-rescaling ideas used in the infinite horizon discounted cost cases hard to implement. Proofs rely on working with a weaker topology on the space of controlled processes that is more amenable to an analysis for the ergodic cost. As a corollary of the main result, we show that control policies which achieve hierarchical greedy ideal performance for general RSN are asymptotically optimal for the ergodic cost when the underlying cost per unit time has certain monotonicity properties. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: Submitted to special issue of QUESTA on Reflected Brownian Motion and connected subjects

MSC Class: 60K25; 68M20; 90B22 (Primary) 60J70 (Secondary)

Fluctuations of the Atlas model from inhomogeneous stationary profiles

Authors: Sayan Banerjee, Amarjit Budhiraja, Peter Rudzis

Abstract: The infinite Atlas model describes the evolution of a countable collection of Brownian particles on the real line, where the lowest particle is given a drift of $γ\in [0,\infty)$. We study equilibrium fluctuations for the Atlas model when the system of particles starts from an inhomogeneous stationary profile with exponentially growing density. We show that the appropriately centered and scaled oc… ▽ More The infinite Atlas model describes the evolution of a countable collection of Brownian particles on the real line, where the lowest particle is given a drift of $γ\in [0,\infty)$. We study equilibrium fluctuations for the Atlas model when the system of particles starts from an inhomogeneous stationary profile with exponentially growing density. We show that the appropriately centered and scaled occupation measure of the particle positions, with suitable translations, viewed as a space-time random field, converges to a limit given by a certain stochastic partial differential equation (SPDE). The initial condition for this equation is given by a Brownian motion, the equation is driven by an additive space-time noise that is white in time and colored in space, and the linear operator governing the evolution is the infinitesimal generator of a geometric Brownian motion. We use this SPDE to also characterize the fluctuations of the ranked particle positions with a suitable centering and scaling. Our results describe the behavior of the particles in the bulk and one finds that the Gaussian process describing the asymptotic fluctuations has the same Hölder regularity as a fractional Brownian motion with Hurst parameter $1/4$. One finds that, unlike the setting of a homogeneous profile (Dembo and Tsai (2017)), the behavior on the lower edge of the particle system is very different from the bulk behavior and in fact the variance of the Gaussian limit diverges to $\infty$ as one approaches the lower edge. Indeed, our results show that, with the gaps between particles given by one of the inhomogeneous stationary distributions, the lowest particle, started from $0$, with a linear in time translation, converges in distribution to an explicit non-Gaussian limit as $t\to \infty$. △ Less

Submitted 6 October, 2023; originally announced October 2023.

Comments: 58 pages

MSC Class: 60J60; 60K35; 60J25; 60H10

Large Deviations for Empirical Measures of Self-Interacting Markov Chains

Authors: Amarjit Budhiraja, Adam Waterbury, Pavlos Zoubouloglou

Abstract: Let $Δ^o$ be a finite set and, for each probability measure $m$ on $Δ^o$, let $G(m)$ be a transition probability kernel on $Δ^o$. Fix $x_0 \in Δ^o$ and consider the chain $\{X_n, \; n \in \mathbb{N}_0\}$ of $Δ^o$-valued random variables such that $X_0=x$, and given $X_0, \ldots , X_n$, the conditional distribution of $X_{n+1}$ is $G(L^{n+1})(X_n, \cdot)$, where… ▽ More Let $Δ^o$ be a finite set and, for each probability measure $m$ on $Δ^o$, let $G(m)$ be a transition probability kernel on $Δ^o$. Fix $x_0 \in Δ^o$ and consider the chain $\{X_n, \; n \in \mathbb{N}_0\}$ of $Δ^o$-valued random variables such that $X_0=x$, and given $X_0, \ldots , X_n$, the conditional distribution of $X_{n+1}$ is $G(L^{n+1})(X_n, \cdot)$, where $L^{n+1} = \frac{1}{n+1} \sum_{i=0}^{n} δ_{X_i}$ is the empirical measure at instant $n$. Under conditions on $G$ we establish a large deviation principle for the empirical measure sequence $\{L^n, \; n \in \mathbb{N}\}$. As one application of this result we obtain large deviation asymptotics for the Aldous-Flannery-Palacios (1988) approximation scheme for quasistationary distributions of irreducible finite state Markov chains. The conditions on $G$ cover various other models of reinforced stochastic evolutions as well, including certain vertex reinforced and edge reinforced random walks and a variant of the PageRank algorithm. The particular case where $G(m)$ does not depend on $m$ corresponds to the classical results of Donsker and Varadhan (1975) on large deviations of empirical measures of Markov processes. However, unlike this classical setting, for the general self-interacting models considered here, the rate function takes a very different form; it is typically non-convex and is given through a dynamical variational formula with an infinite horizon discounted objective function. △ Less

Submitted 10 April, 2023; v1 submitted 3 April, 2023; originally announced April 2023.

Comments: 54 pages

MSC Class: 60F10 (Primary) 93E03 (Secondary)

Load Balancing in Parallel Queues and Rank-based Diffusions

Authors: Sayan Banerjee, Amarjit Budhiraja, Benjamin Estevez

Abstract: Consider a system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue-length and the remainin… ▽ More Consider a system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue-length and the remaining jobs are routed uniformly at random. A particular case, referred to as the marginal join-the-shortest-queue (MJSQ) policy, is one in which the $O(\sqrt{n})$ jobs are routed using the join-the-shortest-queue (JSQ) policy. Our first result provides a heavy traffic approximation theorem for such queuing systems. It turns out that, unlike the JSQ system, there is no state space collapse in the setting of MJSQ (and for the more general rank-based routing schemes) and one obtains a novel diffusion limit which is the constrained analogue of the well studied Atlas model (and other rank-based diffusions) arising from mathematical finance. Next, we prove an interchange of limits result which shows that the steady state of the queuing system is well approximated by that of the limiting diffusion, given explicitly in terms of product laws of Exponential random variables. Using these results, we compute the time asymptotic total queue-length in the heavy traffic limit for the MJSQ system. We find the striking result that although in going from JSQ to MJSQ the communication cost is reduced by a factor of $\sqrt{n}$, the asymptotic total queue-length increases only by a constant factor which can be made arbitrarily close to one by increasing a MJSQ parameter. When the system is overloaded ($\upsilon<0$) we show that although the $K$-dimensional MJSQ system is unstable, the steady state difference between the maximum and minimum queue-lengths stays bounded in probability (in the heavy traffic parameter $n$). △ Less

Submitted 15 February, 2024; v1 submitted 20 February, 2023; originally announced February 2023.

Comments: 34 pages. To appear in Math. of Oper. Res

Long Time Behavior of Finite and Infinite Dimensional Reflected Brownian Motions

Authors: Sayan Banerjee, Amarjit Budhiraja

Abstract: This article presents a review of some old and new results on the long time behavior of reflected diffusions. First, we present a summary of prior results on construction, ergodicity and geometric ergodicity of reflected diffusions in the positive orthant $\mathbb{R}^d_+$, $d \in \mathbb{N}$. The geometric ergodicity results, although very general, usually give implicit convergence rates due to ab… ▽ More This article presents a review of some old and new results on the long time behavior of reflected diffusions. First, we present a summary of prior results on construction, ergodicity and geometric ergodicity of reflected diffusions in the positive orthant $\mathbb{R}^d_+$, $d \in \mathbb{N}$. The geometric ergodicity results, although very general, usually give implicit convergence rates due to abstract couplings and Lyapunov functions used in obtaining them. This leads us to some recent results on an important subclass of reflected Brownian motions (RBM) (constant drift and diffusion coefficients and oblique reflection at boundaries), known as the Harrison-Reiman class, where explicit rates of convergence are obtained as functions of the system parameters and underlying dimension. In addition, sufficient conditions on system parameters of the RBM are provided under which local convergence to stationarity holds at a `dimension-free' rate, that is, for any fixed $k \in \mathbb{N}$, the rate of convergence of the $k$-marginal to equilibrium does not depend on the dimension of the whole system. Finally, we study the long time behavior of infinite dimensional rank-based diffusions, including the well-studied infinite Atlas model. The gaps between the ordered particles evolve as infinite dimensional RBM and this gap process has uncountably many explicit product form stationary distributions. Sufficient conditions for initial configurations to lie in the weak domain of attraction of the various stationary distributions are provided. Finally, it is shown that, under conditions, all of these explicit stationary distributions are extremal (equivalently, ergodic) and, in some sense, the only product form invariant probability distributions. Proof techniques involve a pathwise analysis of RBM using explicit synchronous and mirror couplings and constructing Lyapunov functions. △ Less

Submitted 4 August, 2022; originally announced August 2022.

Extremal Invariant Distributions of Infinite Brownian Particle Systems with Rank Dependent Drifts

Authors: Sayan Banerjee, Amarjit Budhiraja

Abstract: Consider an infinite collection of particles on the real line moving according to independent Brownian motions and such that the $i$-th particle from the left gets the drift $g_{i-1}$. The case where $g_0=1$ and $g_{i}=0$ for all $i \in \mathbb{N}$ corresponds to the well studied infinite Atlas model. Under conditions on the drift vector $\mathbf{g} = (g_0, g_1, \ldots)'$ it is known that the Mark… ▽ More Consider an infinite collection of particles on the real line moving according to independent Brownian motions and such that the $i$-th particle from the left gets the drift $g_{i-1}$. The case where $g_0=1$ and $g_{i}=0$ for all $i \in \mathbb{N}$ corresponds to the well studied infinite Atlas model. Under conditions on the drift vector $\mathbf{g} = (g_0, g_1, \ldots)'$ it is known that the Markov process corresponding to the gap sequence of the associated ranked particles has a continuum of product form stationary distributions $\{π_a^{\mathbf{g}}, a \in S^{\mathbf{g}}\}$ where $S^{\mathbf{g}}$ is a semi-infinite interval of the real line. In this work we show that all of these stationary distributions are extremal and ergodic. We also prove that any product form stationary distribution of this Markov process that satisfies a mild integrability condition must be $π_a^{\mathbf{g}}$ for some $a \in S^{\mathbf{g}}$. These results are new even for the infinite Atlas model. The work makes progress on the open problem of characterizing all the extremal invariant distributions of general competing Brownian particle systems interacting through their relative ranks. Proofs rely on synchronous and mirror coupling of Brownian particles and properties of the intersection local times of the various particles in the infinite system. △ Less

Submitted 17 July, 2022; originally announced July 2022.

Comments: 24 pages

Large Deviations for Small Noise Diffusions Over Long Time

Authors: Amarjit Budhiraja, Pavlos Zoubouloglou

Abstract: We study two problems. First, we consider the large deviation behavior of empirical measures of certain diffusion processes as, simultaneously, the time horizon becomes large and noise becomes vanishingly small. The law of large numbers (LLN) of the empirical measure in this asymptotic regime is given by the unique equilibrium of the noiseless dynamics. Due to degeneracy of the noise in the limit,… ▽ More We study two problems. First, we consider the large deviation behavior of empirical measures of certain diffusion processes as, simultaneously, the time horizon becomes large and noise becomes vanishingly small. The law of large numbers (LLN) of the empirical measure in this asymptotic regime is given by the unique equilibrium of the noiseless dynamics. Due to degeneracy of the noise in the limit, the methods of Donsker and Varadhan (1976) are not directly applicable and new ideas are needed. Second, we study a system of slow-fast diffusions where both the slow and the fast components have vanishing noise on their natural time scales. This time the LLN is governed by a degenerate averaging principle in which local equilibria of the noiseless system obtained from the fast dynamics describe the asymptotic evolution of the slow component. We establish a large deviation principle that describes probabilities of divergence from this behavior. On the one hand our methods require stronger assumptions than the nondegenerate settings, while on the other hand the rate functions take simple and explicit forms that have striking differences from their nondegenerate counterparts. △ Less

Submitted 12 September, 2023; v1 submitted 15 July, 2022; originally announced July 2022.

Comments: 56 pages, 1 figure

Empirical Measure Large Deviations for Reinforced Chains on Finite Spaces

Authors: Amarjit Budhiraja, Adam Waterbury

Abstract: Let $A$ be a transition probability kernel on a finite state space $Δ^o =\{1, \ldots , d\}$ such that $A(x,y)>0$ for all $x,y \in Δ^o$. Consider a reinforced chain given as a sequence $\{X_n, \; n \in \mathbb{N}_0\}$ of $Δ^o$-valued random variables, defined recursively according to, $$L^n = \frac{1}{n}\sum_{i=0}^{n-1} δ_{X_i}, \;\; P(X_{n+1} \in \cdot \mid X_0, \ldots, X_n) = L^n A(\cdot).$$ We e… ▽ More Let $A$ be a transition probability kernel on a finite state space $Δ^o =\{1, \ldots , d\}$ such that $A(x,y)>0$ for all $x,y \in Δ^o$. Consider a reinforced chain given as a sequence $\{X_n, \; n \in \mathbb{N}_0\}$ of $Δ^o$-valued random variables, defined recursively according to, $$L^n = \frac{1}{n}\sum_{i=0}^{n-1} δ_{X_i}, \;\; P(X_{n+1} \in \cdot \mid X_0, \ldots, X_n) = L^n A(\cdot).$$ We establish a large deviation principle for $\{L^n\}$. The rate function takes a strikingly different form than the Donsker-Varadhan rate function associated with the empirical measure of the Markov chain with transition kernel $A$ and is described in terms of a novel deterministic infinite horizon discounted cost control problem with an associated linear controlled dynamics and a nonlinear running cost involving the relative entropy function. Proofs are based on an analysis of time-reversal of controlled dynamics in representations for log-transforms of exponential moments, and on weak convergence methods. △ Less

Submitted 18 May, 2022; originally announced May 2022.

MSC Class: 60F10 (Primary) 93E03 (Secondary)

The Inert Drift Atlas Model

Authors: Sayan Banerjee, Amarjit Budhiraja, Benjamin Estevez

Abstract: Consider a massive (inert) particle im**ed from above by N Brownian particles that are instantaneously reflected upon collision with the inert particle. The velocity of the inert particle increases due to the influence of an external Newtonian potential (e.g. gravitation) and decreases in proportion to the total local time of collisions with the Brownian particles. This system models a semi-… ▽ More Consider a massive (inert) particle im**ed from above by N Brownian particles that are instantaneously reflected upon collision with the inert particle. The velocity of the inert particle increases due to the influence of an external Newtonian potential (e.g. gravitation) and decreases in proportion to the total local time of collisions with the Brownian particles. This system models a semi-permeable membrane in a fluid having microscopic impurities (Knight (2001)). We study the long-time behavior of the process $(V,\mathbf{Z})$, where $V$ is the velocity of the inert particle and $\mathbf{Z}$ is the vector of gaps between successive particles ordered by their relative positions. The system is not hypoelliptic, not reversible, and has singular form interactions. Thus the study of stability behavior of the system requires new ideas. We show that this process has a unique stationary distribution that takes an explicit product form which is Gaussian in the velocity component and Exponential in the other components. We also show that convergence in total variation distance to the stationary distribution happens at an exponential rate. We further obtain certain law of large numbers results for the particle locations and intersection local times. △ Less

Submitted 23 November, 2022; v1 submitted 11 February, 2022; originally announced February 2022.

Comments: 55 pages, to appear in Communications in Mathematical Physics

MSC Class: 60J60; 60K35; 60J25; 60H10

Does Momentum Help? A Sample Complexity Analysis

Authors: Swetha Ganesh, Rohan Deb, Gugan Thoppe, Amarjit Budhiraja

Abstract: Stochastic Heavy Ball (SHB) and Nesterov's Accelerated Stochastic Gradient (ASG) are popular momentum methods in stochastic optimization. While benefits of such acceleration ideas in deterministic settings are well understood, their advantages in stochastic optimization is still unclear. In fact, in some specific instances, it is known that momentum does not help in the sample complexity sense. Ou… ▽ More Stochastic Heavy Ball (SHB) and Nesterov's Accelerated Stochastic Gradient (ASG) are popular momentum methods in stochastic optimization. While benefits of such acceleration ideas in deterministic settings are well understood, their advantages in stochastic optimization is still unclear. In fact, in some specific instances, it is known that momentum does not help in the sample complexity sense. Our work shows that a similar outcome actually holds for the whole of quadratic optimization. Specifically, we obtain a lower bound on the sample complexity of SHB and ASG for this family and show that the same bound can be achieved by the vanilla SGD. We note that there exist results claiming the superiority of momentum based methods in quadratic optimization, but these are based on one-sided or flawed analyses. △ Less

Submitted 11 July, 2022; v1 submitted 29 October, 2021; originally announced October 2021.

Revisiting SVD to generate powerful Node Embeddings for Recommendation Systems

Authors: Amar Budhiraja

Abstract: Graph Representation Learning (GRL) is an upcoming and promising area in recommendation systems. In this paper, we revisit the Singular Value Decomposition (SVD) of adjacency matrix for embedding generation of users and items and use a two-layer neural network on top of these embeddings to learn relevance between user-item pairs. Inspired by the success of higher-order learning in GRL, we further… ▽ More Graph Representation Learning (GRL) is an upcoming and promising area in recommendation systems. In this paper, we revisit the Singular Value Decomposition (SVD) of adjacency matrix for embedding generation of users and items and use a two-layer neural network on top of these embeddings to learn relevance between user-item pairs. Inspired by the success of higher-order learning in GRL, we further propose an extension of this method to include two-hop neighbors for SVD through the second order of the adjacency matrix and demonstrate improved performance compared with the simple SVD method which only uses one-hop neighbors. Empirical validation on three publicly available datasets of recommendation system demonstrates that the proposed methods, despite being simple, beat many state-of-the-art methods and for two of three datasets beats all of them up to a margin of 10%. Through our research, we want to shed light on the effectiveness of matrix factorization approaches, specifically SVD, in the deep learning era and show that these methods still contribute as important baselines in recommendation systems. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Comments: 7 pages, 3 figures, and 4 tables

Some Large Deviations Asymptotics in Small Noise Filtering Problems

Authors: Anugu Sumith Reddy, Amarjit Budhiraja, Amit Apte

Abstract: We consider nonlinear filters for diffusion processes when the observation and signal noises are small and of the same order. As the noise intensities approach zero, the nonlinear filter can be approximated by a certain variational problem that is closely related to Mortensen's optimization problem(1968). This approximation result can be made precise through a certain Laplace asymptotic formula. I… ▽ More We consider nonlinear filters for diffusion processes when the observation and signal noises are small and of the same order. As the noise intensities approach zero, the nonlinear filter can be approximated by a certain variational problem that is closely related to Mortensen's optimization problem(1968). This approximation result can be made precise through a certain Laplace asymptotic formula. In this work we study probabilities of deviations of true filtering estimates from that obtained by solving the variational problem. Our main result gives a large deviation principle for Laplace functionals whose typical asymptotic behavior is described by Mortensen-type variational problems. Proofs rely on stochastic control representations for positive functionals of Brownian motions and Laplace asymptotics of the Kallianpur-Striebel formula. △ Less

Submitted 10 June, 2021; originally announced June 2021.

Comments: 28 pages

MSC Class: 60F10; 60G35; 93E11

Domains of attraction of invariant distributions of the infinite Atlas model

Authors: Sayan Banerjee, Amarjit Budhiraja

Abstract: The infinite Atlas model describes a countable system of competing Brownian particles where the lowest particle gets a unit upward drift and the rest evolve as standard Brownian motions. The stochastic process of gaps between the particles in the infinite Atlas model does not have a unique stationary distribution and in fact for every $a \ge 0$,… ▽ More The infinite Atlas model describes a countable system of competing Brownian particles where the lowest particle gets a unit upward drift and the rest evolve as standard Brownian motions. The stochastic process of gaps between the particles in the infinite Atlas model does not have a unique stationary distribution and in fact for every $a \ge 0$, $π_a := \bigotimes_{i=1}^{\infty} \operatorname{Exp}(2 + ia)$ is a stationary measure for the gap process. We say that an initial distribution of gaps is in the weak domain of attraction of the stationary measure $π_a$ if the time averaged laws of the stochastic process of the gaps, when initialized using that distribution, converge to $π_a$ weakly in the large time limit. We provide general sufficient conditions on the initial gap distribution of the Atlas particles for it to lie in the weak domain of attraction of $π_a$ for each $a\ge 0$. The cases $a=0$ and $a>0$ are qualitatively different as is seen from the analysis and the sufficient conditions that we provide. Proofs are based on the analysis of synchronous couplings, namely, couplings of the ranked particle systems started from different initial configurations, but driven using the same set of Brownian motions. △ Less

Submitted 8 February, 2022; v1 submitted 18 March, 2021; originally announced March 2021.

Comments: 37 pages. To appear in Ann. Probab

Quasistationary Distributions and Ergodic Control Problems

Authors: Amarjit Budhiraja, Paul Dupuis, Pierre Nyquist, Guo-Jhen Wu

Abstract: We introduce and study the basic properties of two ergodic stochastic control problems associated with the quasistationary distribution (QSD) of a diffusion process $X$ relative to a bounded domain. The two problems are in some sense dual, with one defined in terms of the generator associated with $X$ and the other in terms of its adjoint. Besides proving wellposedness of the associated Hamilton-J… ▽ More We introduce and study the basic properties of two ergodic stochastic control problems associated with the quasistationary distribution (QSD) of a diffusion process $X$ relative to a bounded domain. The two problems are in some sense dual, with one defined in terms of the generator associated with $X$ and the other in terms of its adjoint. Besides proving wellposedness of the associated Hamilton-Jacobi-Bellman equations, we describe how they can be used to characterize important properties of the QSD. Of particular note is that the QSD itself can be identified, up to normalization, in terms of the cost potential of the control problem associated with the adjoint. △ Less

Submitted 27 February, 2021; originally announced March 2021.

MSC Class: 60F99; 60H10; 93E20

Approximating Quasi-Stationary Distributions with Interacting Reinforced Random Walks

Authors: Amarjit Budhiraja, Nicolas Fraiman, Adam Waterbury

Abstract: We propose two numerical schemes for approximating quasi-stationary distributions (QSD) of finite state Markov chains with absorbing states. Both schemes are described in terms of certain interacting chains in which the interaction is given in terms of the total time occupation measure of all particles in the system and has the impact of reinforcing transitions, in an appropriate fashion, to state… ▽ More We propose two numerical schemes for approximating quasi-stationary distributions (QSD) of finite state Markov chains with absorbing states. Both schemes are described in terms of certain interacting chains in which the interaction is given in terms of the total time occupation measure of all particles in the system and has the impact of reinforcing transitions, in an appropriate fashion, to states where the collection of particles has spent more time. The schemes can be viewed as combining the key features of the two basic simulation-based methods for approximating QSD originating from the works of Fleming and Viot (1979) and Aldous, Flannery and Palacios (1998), respectively. The key difference between the two schemes studied here is that in the first method one starts with $a(n)$ particles at time $0$ and number of particles stays constant over time whereas in the second method we start with one particle and at most one particle is added at each time instant in such a manner that there are $a(n)$ particles at time $n$. We prove almost sure convergence to the unique QSD and establish Central Limit Theorems for the two schemes under the key assumption that $a(n)=o(n)$. When $a(n)\sim n$, the fluctuation behavior is expected to be non-standard. Some exploratory numerical results are presented to illustrate the performance of the two approximation schemes. △ Less

Submitted 19 October, 2020; originally announced October 2020.

MSC Class: Primary 60J10; 34F05; Secondary 60F10; 92D25

Augmenting Molecular Images with Vector Representations as a Featurization Technique for Drug Classification

Authors: Daniel de Marchi, Amarjit Budhiraja

Abstract: One of the key steps in building deep learning systems for drug classification and generation is the choice of featurization for the molecules. Previous featurization methods have included molecular images, binary strings, graphs, and SMILES strings. This paper proposes the creation of molecular images captioned with binary vectors that encode information not contained in or easily understood from… ▽ More One of the key steps in building deep learning systems for drug classification and generation is the choice of featurization for the molecules. Previous featurization methods have included molecular images, binary strings, graphs, and SMILES strings. This paper proposes the creation of molecular images captioned with binary vectors that encode information not contained in or easily understood from a molecular image alone. Specifically, we use Morgan fingerprints, which encode higher level structural information, and MACCS keys, which encode yes or no questions about a molecules properties and structure. We tested our method on the HIV dataset published by the Pande lab, which consists of 41,127 molecules labeled by if they inhibit the HIV virus. Our final model achieved a state of the art AUC ROC on the HIV dataset, outperforming all other methods. Moreover, the model converged significantly faster than most other methods, requiring dramatically less computational power than unaugmented images. △ Less

Submitted 9 August, 2020; originally announced August 2020.

Journal ref: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Asymptotic Behavior of Stochastic Currents under Large Deviation Scaling with Mean Field Interaction and Vanishing Noise

Authors: Amarjit Budhiraja, Michael Conroy

Abstract: We study the large deviation behavior of a system of diffusing particles with a mean field interaction, described through a collection of stochastic differential equations, in which each particle is driven by a vanishing independent Brownian noise. An important object in the description of the asymptotic behavior, as the number of particles approach infinity and the noise intensity approaches zero… ▽ More We study the large deviation behavior of a system of diffusing particles with a mean field interaction, described through a collection of stochastic differential equations, in which each particle is driven by a vanishing independent Brownian noise. An important object in the description of the asymptotic behavior, as the number of particles approach infinity and the noise intensity approaches zero, is the stochastic current associated with the interacting particle system in the sense of Flandoli et al. (2005). We establish a joint large deviation principle (LDP) for the path empirical measure for the particle system and the associated stochastic currents in the simultaneous large particle and small noise limit. Our work extends recent results of Orrieri (2018), in which the diffusion coefficient is taken to be identity, to a setting of a state dependent and possibly degenerate noise with the mean field interaction influencing both the drift and diffusion coefficients, and allows for a stronger topology on the space of stochastic currents in the LDP. Proof techniques differ from Orrieri (2018) and rely on methods from stochastic control, theory of weak convergence, and representation formulas for Laplace functionals of Brownian motions. △ Less

Submitted 8 August, 2021; v1 submitted 25 July, 2020; originally announced July 2020.

Large deviation principles for stochastic dynamical systems with a fractional Brownian noise

Authors: Amarjit Budhiraja, Xiaoming Song

Abstract: We study small noise large deviation asymptotics for stochastic differential equations with a multiplicative noise given as a fractional Brownian motion $B^H$ with Hurst parameter $H>\frac12$. The solutions of the stochastic differential equations are defined pathwise under appropriate conditions on the coefficients. The ingredients in the proof of the large deviation principle, which include a va… ▽ More We study small noise large deviation asymptotics for stochastic differential equations with a multiplicative noise given as a fractional Brownian motion $B^H$ with Hurst parameter $H>\frac12$. The solutions of the stochastic differential equations are defined pathwise under appropriate conditions on the coefficients. The ingredients in the proof of the large deviation principle, which include a variational representation for nonnegative functionals of fractional Brownian motions and a general sufficient condition for a LDP for a collection of functionals of a fractional Brownian motions, have a broader applicability than the model considered here. △ Less

Submitted 17 June, 2020; v1 submitted 13 June, 2020; originally announced June 2020.

MSC Class: 60F10; 60H10; 60G22

Near Equilibrium Fluctuations for Supermarket Models with Growing Choices

Authors: Shankar Bhamidi, Amarjit Budhiraja, Miheer Dewaskar

Abstract: We consider the supermarket model in the usual Markovian setting where jobs arrive at rate $n λ_n$ for some $λ_n > 0$, with $n$ parallel servers each processing jobs in its queue at rate 1. An arriving job joins the shortest among $d_n \le n$ randomly selected service queues. We show that when $d_n \to \infty$ and $λ_n \to λ\in (0, \infty)$, under natural conditions on the initial queues, the stat… ▽ More We consider the supermarket model in the usual Markovian setting where jobs arrive at rate $n λ_n$ for some $λ_n > 0$, with $n$ parallel servers each processing jobs in its queue at rate 1. An arriving job joins the shortest among $d_n \le n$ randomly selected service queues. We show that when $d_n \to \infty$ and $λ_n \to λ\in (0, \infty)$, under natural conditions on the initial queues, the state occupancy process converges in probability, in a suitable path space, to the unique solution of an infinite system of constrained ordinary differential equations parametrized by $λ$. Our main interest is in the study of fluctuations of the state process about its near equilibrium state in the critical regime, namely when $λ_n \to 1$. Previous papers have considered the regime $\frac{d_n}{\sqrt{n}\log n} \to \infty$ while the objective of the current work is to develop diffusion approximations for the state occupancy process that allow for all possible rates of growth of $d_n$. In particular we consider the three canonical regimes (a) ${d_n}/{\sqrt{n}} \to 0$; (b) ${d_n}/{\sqrt{n}} \to c\in (0,\infty)$ and, (c) ${d_n}/{\sqrt{n}} \to \infty$. In all three regimes we show, by establishing suitable functional limit theorems, that (under conditions on $λ_n$) fluctuations of the state process about its near equilibrium are of order $n^{-1/2}$ and are governed asymptotically by a one dimensional Brownian motion. The forms of the limit processes in the three regimes are quite different; in the first case we get a linear diffusion; in the second case we get a diffusion with an exponential drift; and in the third case we obtain a reflected diffusion in a half space. In the special case ${d_n}/({\sqrt{n}\log n}) \to \infty$ our work gives alternative proofs for the universality results established by Mukherjee et al in 2018. △ Less

Submitted 5 June, 2020; originally announced June 2020.

Comments: 45 pages with a 4 page Appendix

MSC Class: 60K25; 68Q87

The State and Fate of Linguistic Diversity and Inclusion in the NLP World

Authors: Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, Monojit Choudhury

Abstract: Language technologies contribute to promoting multilingualism and linguistic diversity around the world. However, only a very small number of the over 7000 languages of the world are represented in the rapidly evolving language technologies and applications. In this paper we look at the relation between the types of languages, resources, and their representation in NLP conferences to understand th… ▽ More Language technologies contribute to promoting multilingualism and linguistic diversity around the world. However, only a very small number of the over 7000 languages of the world are represented in the rapidly evolving language technologies and applications. In this paper we look at the relation between the types of languages, resources, and their representation in NLP conferences to understand the trajectory that different languages have followed over time. Our quantitative investigation underlines the disparity between languages, especially in terms of their resources, and calls into question the "language agnostic" status of current models and systems. Through this paper, we attempt to convince the ACL community to prioritise the resolution of the predicaments highlighted here, so that no language is left behind. △ Less

Submitted 26 January, 2021; v1 submitted 20 April, 2020; originally announced April 2020.

Comments: Accepted at ACL 2020 (10 pages + 2 pages Appendix). P.J., S.S. and A.B. contributed equally

Large Deviations of the Entropy Production Rate for a Class of Gaussian Processes

Authors: Amarjit Budhiraja, Yong Chen, Lihu Xu

Abstract: We prove a large deviation principle (LDP) and a fluctuation theorem (FT) for the entropy production rate (EPR) of the following $d$ dimensional stochastic differential equation \begin{equation*} d X_{t}=AX_{t} d t+\sqrt{Q} d B_{t} \end{equation*} where $A$ is a real normal stable matrix, $Q$ is positive definite, and the matrices $A$ and $Q$ commute. The rate function for the EPR takes the follow… ▽ More We prove a large deviation principle (LDP) and a fluctuation theorem (FT) for the entropy production rate (EPR) of the following $d$ dimensional stochastic differential equation \begin{equation*} d X_{t}=AX_{t} d t+\sqrt{Q} d B_{t} \end{equation*} where $A$ is a real normal stable matrix, $Q$ is positive definite, and the matrices $A$ and $Q$ commute. The rate function for the EPR takes the following explicit form: \begin{equation*} I(x)=\left\{ \begin{array}{ll} x\frac{\sqrt{1+\ell_0(x)}-1}{2}+\frac 12\sum\limits_{k=1}^{d} \left(\sqrt{α_k^2- β_k^2\ell_0(x)}+α_k\right) , & x\ge 0 , \\ -x\frac{\sqrt{1+\ell_0(x)}+1}{2} +\frac 12\sum\limits_{k=1}^{d} \left(\sqrt{α_k^2- β_k^2\ell_0(x)}+α_k\right) , &x<0, \end{array} \right. \end{equation*} where $α_{k}\pm {\rm i} β_{k}$ are the eigenvalues of $A$, and $\ell_0(x)$ is the unique solution of the equation: \begin{align*} |x|={\sqrt{1+\ell}} \times \sum_{k=1}^{d} \frac{β_k^2}{\sqrt{α_k^2 -\ellβ_k^2} },\qquad -1 \le \ell< \min_{k=1,...,d}\{\frac{α_k^2}{β_k^2}\}. \end{align*} Simple closed form formulas for rate functions are rare and our work identifies an important class of large deviation problems where such formulas are available. The logarithmic moment generating function (the fluctuation function) $Λ$ associated with the LDP has a closed form (see it in the paper). The functions $Λ(λ)$ and $ I(x)$ satisfy the Cohen-Gallavotti symmetry properties. In particular, the functions $I$ and $Λ$ do not depend on the diffusion matrix $Q$, and are determined completely by the real and imaginary parts of the eigenvalues of $A$. Formally, the deterministic system with $Q=0$ has zero EPR and thus the model exhibits a phase transition in that the EPR changes discontinuously at $Q = 0$. △ Less

Submitted 22 May, 2020; v1 submitted 18 April, 2020; originally announced April 2020.

Comments: There are two reasons for replace the papers: 1. the title of the paper makes others misunderstand that the work is just a straightforward generalization of our work before; 2. the content in introduction is not comprehensive and does not indicate our main contributions, we have to make some big revisions to make this paper more readable

Heavy Traffic Scaling Limits for shortest remaining processing time queues with heavy tailed processing time distributions

Authors: Sayan Banerjee, Amarjit Budhiraja, Amber L. Puha

Abstract: We study a single server queue operating under the shortest remaining processing time (SRPT) scheduling policy; that is, the server preemptively serves the job with the shortest remaining processing time first. In this work we are interested in studying the asymptotic behavior of suitably scaled measure-valued state descriptors that describe the evolution of a sequence of SRPT queuing systems. Gro… ▽ More We study a single server queue operating under the shortest remaining processing time (SRPT) scheduling policy; that is, the server preemptively serves the job with the shortest remaining processing time first. In this work we are interested in studying the asymptotic behavior of suitably scaled measure-valued state descriptors that describe the evolution of a sequence of SRPT queuing systems. Gromoll, Kruk, and Puha (2011) have studied this problem under diffusive scaling. In the setting where the processing time distributions have unbounded support, under suitable conditions, they show that the diffusion scaled measures converge in distribution to the process that is identically zero. In Puha (2015) for the setting where the processing time distributions have unbounded support and light tails, a non-standard scaling of the queue length process is shown to give rise to a form of state space collapse that results in a nonzero limit. In the current work we consider the case where processing time distributions have finite second moments and regularly varying tails. We show that the measure valued process, under a non-standard scaling, converges in distribution in the space of paths of measures. In sharp contrast with previous results, there is no state space collapse. Nevertheless, the description of the limit is simple and given explicitly in terms of a certain $\mathbb{R}_+$ valued random field which is determined from a single Brownian motion. Along the way we establish convergence of suitably scaled workload and queue length processes. We also show that as the tail of the distribution of job processing times becomes lighter in an appropriate fashion, the difference between the limiting queue length process and the limiting workload process converges to zero, thereby approaching the behavior of state space collapse. △ Less

Submitted 8 August, 2021; v1 submitted 7 March, 2020; originally announced March 2020.

Comments: 64 pages, to appear in The Annals of Applied Probability

MSC Class: Primary 60K25; 60F17; Secondary 60G57; 60G60; 68M20

Journal ref: Annals of Applied Probability, 32:4, 2587-2651, 2022

Rich-Item Recommendations for Rich-Users: Exploiting Dynamic and Static Side Information

Authors: Amar Budhiraja, Gaurush Hiranandani, Darshak Chhatbar, Aditya Sinha, Navya Yarrabelly, Ayush Choure, Oluwasanmi Koyejo, Prateek Jain

Abstract: In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a general formulation for the problem that captures the complexities of modern real-world recommendations and generalizes many existing formulations. In our formul… ▽ More In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a general formulation for the problem that captures the complexities of modern real-world recommendations and generalizes many existing formulations. In our formulation, each user/document that requires a recommendation and each item or tag that is to be recommended, both are modeled by a set of static entities and a dynamic component. The relationships between entities are captured by several weighted bipartite graphs. To effectively exploit these complex interactions and learn the recommendation model, we propose MEDRES- a multiple graph-CNN based novel deep-learning architecture. MEDRES uses AL-GCN, a novel graph convolution network block, that harnesses strong representative features from the underlying graphs. Moreover, in order to capture highly heterogeneous engagement of different users with the system and constraints on the number of items to be recommended, we propose a novel ranking metric pAp@k along with a method to optimize the metric directly. We demonstrate effectiveness of our method on two benchmarks: a) citation data, b) Flickr data. In addition, we present two real-world case studies of our formulation and the MEDRES architecture. We show how our technique can be used to naturally model the message recommendation problem and the teams recommendation problem in the Microsoft Teams (MSTeams) product and demonstrate that it is 5-6% points more accurate than the production-grade models. △ Less

Submitted 26 July, 2020; v1 submitted 28 January, 2020; originally announced January 2020.

Comments: The first two authors contributed equally. 21 pages, 8 figures and 6 tables

Robust bounds and optimization at the large deviations scale for queueing models via Rényi divergence

Authors: Rami Atar, Amarjit Budhiraja, Paul Dupuis, Ruoyu Wu

Abstract: This paper develops tools to obtain robust probabilistic estimates for queueing models at the large deviations (LD) scale. These tools are based on the recently introduced robust Rényi bounds, which provide LD estimates (and more generally risk-sensitive (RS) cost estimates) that hold uniformly over an uncertainty class of models, provided that the class is defined in terms of Rényi divergence wit… ▽ More This paper develops tools to obtain robust probabilistic estimates for queueing models at the large deviations (LD) scale. These tools are based on the recently introduced robust Rényi bounds, which provide LD estimates (and more generally risk-sensitive (RS) cost estimates) that hold uniformly over an uncertainty class of models, provided that the class is defined in terms of Rényi divergence with respect to a reference model and that estimates are available for the reference model. One very attractive quality of the approach is that the class to which the estimates apply may consist of hard models, such as highly non-Markovian models and ones for which the LD principle is not available. Our treatment provides exact expressions as well as bounds on the Rényi divergence rate on families of marked point processes, including as a special case renewal processes. Another contribution is a general result that translates robust RS control problems, where robustness is formulated via Rényi divergence, to finite dimensional convex optimization problems, when the control set is a finite dimensional convex set. The implications to queueing are vast, as they apply in great generality. This is demonstrated on two non-Markovian queueing models. One is the multiclass single-server queue considered as a RS control problem, with scheduling as the control process and exponential weighted queue length as cost. The second is the many-server queue with reneging, with the probability of atypically large reneging count as performance criterion. As far as LD analysis is concerned, no robust estimates or non-Markovian treatment were previously available for either of these models. △ Less

Submitted 13 August, 2020; v1 submitted 7 January, 2020; originally announced January 2020.

Comments: 37 pages, 3 figures; Section of concluding remarks is added

MSC Class: 60F10; 60K25; 94A17

Rare event asymptotics for exploration processes for random graphs

Authors: Shankar Bhamidi, Amarjit Budhiraja, Paul Dupuis, Ruoyu Wu

Abstract: Much work in the study of large deviations for random graph models is focused on the dense regime where the theory of graphons has emerged as a principal tool. These tools do not give a good approach to large deviation problems for random graph models in the sparse regime. The aim of this paper is to study an approach for large deviation problems in this regime by establishing Large Deviation Prin… ▽ More Much work in the study of large deviations for random graph models is focused on the dense regime where the theory of graphons has emerged as a principal tool. These tools do not give a good approach to large deviation problems for random graph models in the sparse regime. The aim of this paper is to study an approach for large deviation problems in this regime by establishing Large Deviation Principles (LDP) on suitable path spaces for certain exploration processes of the associated random graph sequence. Our work focuses on the study of one particular class of random graph models, namely the configuration model; however the general approach of using exploration processes for studying large deviation properties of sparse random graph models has broader applicability. The goal is to study asymptotics of probabilities of non-typical behavior in the large network limit. The first key step for this is to establish a LDP for an exploration process associated with the configuration model. A suitable exploration process here turns out to be an infinite dimensional Markov process with transition probability rates that diminish to zero in certain parts of the state space. Large deviation properties of such Markovian models is challenging due to poor regularity behavior of the associated local rate functions. Next, using the rate function in the LDP for the exploration process we formulate a calculus of variations problem associated with the asymptotics of component degree distributions. The second key ingredient in our study is a careful analysis of the infinite dimensional Euler-Lagrange equations associated with this calculus of variations problem. Exact solutions are identified which then provide explicit formulas for decay rates of probabilities of non-typical component degree distributions and related quantities. Please see the paper for the complete abstract. △ Less

Submitted 3 July, 2020; v1 submitted 8 December, 2019; originally announced December 2019.

Comments: 62 pages. arXiv admin note: substantial text overlap with arXiv:1708.01832

MSC Class: 60F10; 60C05; 05C80; 90B15

Asymptotics of Quasi-Stationary Distributions of Small Noise Stochastic Dynamical Systems in Unbounded Domains

Authors: Amarjit Budhiraja, Nicolas Fraiman, Adam Waterbury

Abstract: We consider a collection of Markov chains that model the evolution of multitype biological populations. The state space of the chains is the positive orthant, and the boundary of the orthant is absorbing representing the extinction states of different population types. We are interested in the long-term behavior of the Markov chain away from extinction, under a small noise scaling. Under this scal… ▽ More We consider a collection of Markov chains that model the evolution of multitype biological populations. The state space of the chains is the positive orthant, and the boundary of the orthant is absorbing representing the extinction states of different population types. We are interested in the long-term behavior of the Markov chain away from extinction, under a small noise scaling. Under this scaling, the trajectory of the Markov process over any compact interval converges in distribution to the solution of an ordinary differential equation (ODE) evolving in the positive orthant. We study the asymptotic behavior of the quasi-stationary distributions (QSD) in this scaling regime. Our main result shows that the limit points of the QSD are supported on the union of interior attractors of the flow determined by the ODE. We also give lower bounds on expected extinction times which scale exponentially with the system size. Results of this type when the deterministic dynamical system obtained under the scaling limit is given by a discrete time evolution equation and the dynamics are essentially in a compact space (namely, the one step map is a bounded function) have been studied by Faure and Schreiber (2014). Our results extend these to a setting of an unbounded state space and continuous time dynamics. The proofs rely on uniform large deviation results for small noise stochastic dynamical systems and methods from the theory of dynamical systems. In general QSD for Markov chains with absorbing states and unbounded state spaces may not exist. We study one basic family of Binomial-Poisson models in the positive orthant where one can use Lyapunov function methods to establish existence of QSD and also to argue the tightness of the QSD of the scaled sequence of Markov chains. The results from the first part are then used to characterize the support of limit points of this sequence of QSD. △ Less

Submitted 15 November, 2019; originally announced November 2019.

Comments: 39 pages

MSC Class: 60J10; 34F05; 60F10; 92D25

Empirical Measure and Small Noise Asymptotics under Large Deviation Scaling for Interacting Diffusions

Authors: Amarjit Budhiraja, Michael Conroy

Abstract: Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is common to all particles. The interaction between the particles is due to the common noise and also through the drift and diffusion coefficients that depend on the st… ▽ More Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is common to all particles. The interaction between the particles is due to the common noise and also through the drift and diffusion coefficients that depend on the state empirical measure. We study large deviation behavior of the empirical measure process which is governed by two types of scaling, one corresponding to mean field asymptotics and the other to the Freidlin-Wentzell small noise asymptotics. Different levels of intensity of the small common noise lead to different types of large deviation behavior, and we provide a precise characterization of the various regimes. We also study large deviation behavior of interacting particle systems approximating various types of Feynman-Kac functionals. Proofs are based on stochastic control representations for exponential functionals of Brownian motions and on uniqueness results for weak solutions of stochastic differential equations associated with controlled nonlinear Markov processes. △ Less

Submitted 28 December, 2020; v1 submitted 16 July, 2019; originally announced July 2019.

Many-Server Asymptotics for Join-the-Shortest-Queue: Large Deviations and Rare Events

Authors: Amarjit Budhiraja, Eric Friedlander, Ruoyu Wu

Abstract: The Join-the-Shortest-Queue routing policy is studied in an asymptotic regime where the number of processors $n$ scales with the arrival rate. A large deviation principle (LDP) for the occupancy process is established, as $n\to \infty$, in a suitable infinite-dimensional path space. Model features that present technical challenges include, Markovian dynamics with discontinuous statistics, a dimini… ▽ More The Join-the-Shortest-Queue routing policy is studied in an asymptotic regime where the number of processors $n$ scales with the arrival rate. A large deviation principle (LDP) for the occupancy process is established, as $n\to \infty$, in a suitable infinite-dimensional path space. Model features that present technical challenges include, Markovian dynamics with discontinuous statistics, a diminishing rate property of the transition probability rates, and an infinite-dimensional state space. The difficulty is in the proof of the Laplace lower bound which requires establishing the uniqueness of solutions of certain infinite-dimensional systems of controlled ordinary differential equations. The LDP gives information on the rate of decay of probabilities of various types of rare events associated with the system. We illustrate this by establishing explicit exponential decay rates for probabilities of long queues. In particular, denoting by $E_j^n(T)$ the event that there is at least one queue with $j$ or more jobs at some time instant over $[0,T]$, we show that, in the critical case, for large $n$ and $T$, $\mathbb{P}(E^n_j(T)) \approx \exp\left [-\frac{n (j-2)^2}{4T}\right].$ △ Less

Submitted 17 March, 2020; v1 submitted 9 April, 2019; originally announced April 2019.

Comments: 48 pages, 2 figures

MSC Class: 60F10; 90B15; 91B70; 60J75; 34H05

Large Deviations for the Single Server Queue and the Reneging Paradox

Authors: Rami Atar, Amarjit Budhiraja, Paul Dupuis, Ruoyu Wu

Abstract: For the M/M/1+M model at the law-of-large-numbers scale, the long run reneging count per unit time does not depend on the individual (i.e., per customer) reneging rate. This paradoxical statement has a simple proof. Less obvious is a large deviations analogue of this fact, stated as follows: The decay rate of the probability that the long run reneging count per unit time is atypically large or aty… ▽ More For the M/M/1+M model at the law-of-large-numbers scale, the long run reneging count per unit time does not depend on the individual (i.e., per customer) reneging rate. This paradoxical statement has a simple proof. Less obvious is a large deviations analogue of this fact, stated as follows: The decay rate of the probability that the long run reneging count per unit time is atypically large or atypically small does not depend on the individual reneging rate. In this paper, the sample path large deviations principle for the model is proved and the rate function is computed. Next, large time asymptotics for the reneging rate are studied for the case when the arrival rate exceeds the service rate. The key ingredient is a calculus of variations analysis of the variational problem associated with atypical reneging. A characterization of the aforementioned decay rate, given explicitly in terms of the arrival and service rate parameters of the model, is provided yielding a precise mathematical description of this paradoxical behavior. △ Less

Submitted 13 April, 2020; v1 submitted 15 March, 2019; originally announced March 2019.

Comments: 37 pages

MSC Class: 60F10; 60J27; 60K25

Minimization of a Class of Rare Event Probabilities and Buffer Probabilities of Exceedance

Authors: Amarjit Budhiraja, Shu Lu, Yang Yu, Quoc Tran-Dinh

Abstract: We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design parameters is very small, one needs to develop suitable accelerated Monte-Carlo methods for estimating the objective function of interest. One of the challenges in th… ▽ More We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design parameters is very small, one needs to develop suitable accelerated Monte-Carlo methods for estimating the objective function of interest. One of the challenges in the study is that simulating from exponential twists of the laws of the summands may be computationally demanding since these transformed laws may be non-standard and intractable. We consider a setting where the summands are given as a nonlinear functional of random variables that are more tractable for importance sampling in that the exponential twists of their distributions take a simpler form (than that for the original summands). We also study the closely related problem of estimating buffered probability of exceedance and provide the first rigorous results that relate the asymptotics of buffered probability and that of the ordinary probability under a large deviation scaling. The analogous minimization problem for buffered probability, under conditions, can be formulated as a convex optimization problem which makes it more tractable than the original optimization problem. We show that, under conditions, changes of measures that are asymptotically efficient (under the large deviation scaling) for estimating ordinary probability are also asymptotically efficient for estimating the buffered probability of exceedance. We embed the constructed importance sampling scheme in suitable gradient descent/ascent algorithms for solving the optimization problems of interest. Implementation of schemes for some examples is illustrated through computational experiments. △ Less

Submitted 20 February, 2019; originally announced February 2019.

MSC Class: 90C15; 65K10; 65C05; 60F10

Parameter and dimension dependence of convergence rates to stationarity for Reflecting Brownian Motions

Authors: Sayan Banerjee, Amarjit Budhiraja

Abstract: We obtain rates of convergence to stationarity in L^1-Wasserstein distance for a d-dimensional reflected Brownian motion (RBM) in the nonnegative orthant that are explicit in the dimension and the system parameters. The results are then applied to a class of RBMs considered in Blanchet-Chen (2016) and to rank-based diffusions including the Atlas model. In both cases, we obtain explicit rates and b… ▽ More We obtain rates of convergence to stationarity in L^1-Wasserstein distance for a d-dimensional reflected Brownian motion (RBM) in the nonnegative orthant that are explicit in the dimension and the system parameters. The results are then applied to a class of RBMs considered in Blanchet-Chen (2016) and to rank-based diffusions including the Atlas model. In both cases, we obtain explicit rates and bounds on relaxation times. In the first case we improve the relaxation time estimates of O(d^4(log d)^2) obtained in Blanchet-Chen (2016) to O((log d)^2). In the latter case, we give the first results on explicit parameter and dimension dependent rates under the Wasserstein distance. The proofs do not require an explicit form for the stationary measure or reversibility of the process with respect to this measure, and cover settings where these properties are not available. In the special case of the standard Atlas model, we obtain a bound on the relaxation time of O(d^6(log d)^2). △ Less

Submitted 3 December, 2019; v1 submitted 12 February, 2019; originally announced February 2019.

Comments: 24 pages. To appear in Ann. Appl. Prob

Distributed Assignment with Limited Communication for Multi-Robot Multi-Target Tracking

Authors: Yoonchang Sung, Ashish Kumar Budhiraja, Ryan K. Williams, Pratap Tokekar

Abstract: We study the problem of tracking multiple moving targets using a team of mobile robots. Each robot has a set of motion primitives to choose from in order to collectively maximize the number of targets tracked or the total quality of tracking. Our focus is on scenarios where communication is limited and the robots have limited time to share information with their neighbors. As a result, we seek dis… ▽ More We study the problem of tracking multiple moving targets using a team of mobile robots. Each robot has a set of motion primitives to choose from in order to collectively maximize the number of targets tracked or the total quality of tracking. Our focus is on scenarios where communication is limited and the robots have limited time to share information with their neighbors. As a result, we seek distributed algorithms that can find solutions in bounded amount of time. We present two algorithms: (1) a greedy algorithm that is guaranteed finds a $2$-approximation to the optimal (centralized) solution albeit requiring $|R|$ communication rounds in the worst-case, where $|R|$ denotes the number of robots; and (2) a local algorithm that finds a $\mathcal{O}\left((1+ε)(1+1/h)\right)$-approximation algorithm in $\mathcal{O}(h\log 1/ε)$ communication rounds. Here, $h$ and $ε$ are parameters that allow the user to trade-off the solution quality with communication time. In addition to theoretical results, we present empirical evaluation including comparisons with centralized optimal solutions. △ Less

Submitted 28 May, 2019; v1 submitted 22 December, 2018; originally announced December 2018.

Comments: 18 pages, 17 figures, Published in Autonomous Robots. arXiv admin note: text overlap with arXiv:1706.02245

Large Deviations from the Hydrodynamic Limit for a System with Nearest Neighbor Interactions

Authors: Sayan Banerjee, Amarjit Budhiraja, Michael Perlmutter

Abstract: We give a new proof of the large deviation principle from the hydrodynamic limit for the Ginzberg-Landau model studied in Donsker and Varadhan (1989) using techniques from the theory of stochastic control and weak convergence methods. The proof is based on characterizing subsequential hydrodynamic limits of controlled diffusions with nearest neighbor interaction that arise from a variational repre… ▽ More We give a new proof of the large deviation principle from the hydrodynamic limit for the Ginzberg-Landau model studied in Donsker and Varadhan (1989) using techniques from the theory of stochastic control and weak convergence methods. The proof is based on characterizing subsequential hydrodynamic limits of controlled diffusions with nearest neighbor interaction that arise from a variational representation of certain Laplace functionals. The approach taken here does not require superexponential probability estimates, estimation of exponential moments, or an analysis of eigenvalue problems, that are central ingredients in previous proofs. Instead, proof techniques are very similar to those used for the law of large number analysis, namely in the proof of convergence to the hydrodynamic limit (cf. Guo, Papanicolaou and Varadhan (1988)). Specifically, the key step in the proof is establishing suitable bounds on relative entropies and Dirichlet forms associated with certain controlled laws. This general approach has the promise to be applicable to other interacting particle systems as well and to the case of non-equilibrium starting configurations, and to infinite volume systems. △ Less

Submitted 25 March, 2018; originally announced March 2018.

Comments: 48 pages

Uniform large deviation principles for Banach space valued stochastic differential equations

Authors: Amarjit Budhiraja, Paul Dupuis, Michael Salins

Abstract: We prove a large deviation principle (LDP) for a general class of Banach space valued stochastic differential equations (SDE) that is uniform with respect to initial conditions in bounded subsets of the Banach space. A key step in the proof is showing that a uniform large deviation principle over compact sets is implied by a uniform over compact sets Laplace principle. Because bounded subsets of i… ▽ More We prove a large deviation principle (LDP) for a general class of Banach space valued stochastic differential equations (SDE) that is uniform with respect to initial conditions in bounded subsets of the Banach space. A key step in the proof is showing that a uniform large deviation principle over compact sets is implied by a uniform over compact sets Laplace principle. Because bounded subsets of infinite dimensional Banach spaces are in general not relatively compact in the norm topology, we embed the Banach space into its double dual and utilize the weak-$\star $ compactness of closed bounded sets in the double dual space. We prove that a modified version of our stochastic differential equation satisfies a uniform Laplace principle over weak-$\star $ compact sets and consequently a uniform over bounded sets large deviation principle. We then transfer this result back to the original equation using a contraction principle. The main motivation for this uniform LDP is to generalize results of Freidlin and Wentzell concerning the behavior of finite dimensional SDEs. Here we apply the uniform LDP to study the asymptotics of exit times from bounded sets of Banach space valued small noise SDE, including reaction diffusion equations with multiplicative noise and $2$-dimensional stochastic Navier-Stokes equations with multiplicative noise. △ Less

Submitted 1 March, 2018; originally announced March 2018.

MSC Class: 60F10; 60H15; 35R60

Supermarket Model on Graphs

Authors: Amarjit Budhiraja, Debankur Mukherjee, Ruoyu Wu

Abstract: We consider a variation of the supermarket model in which the servers can communicate with their neighbors and where the neighborhood relationships are described in terms of a suitable graph. Tasks with unit-exponential service time distributions arrive at each vertex as independent Poisson processes with rate $λ$, and each task is irrevocably assigned to the shortest queue among the one it first… ▽ More We consider a variation of the supermarket model in which the servers can communicate with their neighbors and where the neighborhood relationships are described in terms of a suitable graph. Tasks with unit-exponential service time distributions arrive at each vertex as independent Poisson processes with rate $λ$, and each task is irrevocably assigned to the shortest queue among the one it first appears and its $d-1$ randomly selected neighbors. This model has been extensively studied when the underlying graph is a clique in which case it reduces to the well known power-of-$d$ scheme. In particular, results of Mitzenmacher (1996) and Vvedenskaya et al. (1996) show that as the size of the clique gets large, the occupancy process associated with the queue-lengths at the various servers converges to a deterministic limit described by an infinite system of ordinary differential equations (ODE). In this work, we consider settings where the underlying graph need not be a clique and is allowed to be suitably sparse. We show that if the minimum degree approaches infinity (however slowly) as the number of servers $N$ approaches infinity, and the ratio between the maximum degree and the minimum degree in each connected component approaches 1 uniformly, the occupancy process converges to the same system of ODE as the classical supermarket model. In particular, the asymptotic behavior of the occupancy process is insensitive to the precise network topology. We also study the case where the graph sequence is random, with the $N$-th graph given as an Erdős-Rényi random graph on $N$ vertices with average degree $c(N)$. Annealed convergence of the occupancy process to the same deterministic limit is established under the condition $c(N)\to\infty$, and under a stronger condition $c(N)/\ln N\to\infty$, convergence (in probability) is shown for almost every realization of the random graph. △ Less

Submitted 12 September, 2018; v1 submitted 20 December, 2017; originally announced December 2017.

Comments: 32 pages

Journal ref: Ann. Appl. Probab. 29 3 (2019) 1740-1777

Control Policies Approaching HGI Performance in Heavy Traffic for Resource Sharing Networks

Authors: Amarjit Budhiraja, Dane Johnson

Abstract: We consider resource sharing networks of the form introduced in the work of Massoulié and Roberts(2000) as models for Internet flows. The goal is to study the open problem, formulated in Harrison et al. (2014), of constructing simple form rate allocation policies for broad families of resource sharing networks with associated costs converging to the Hierarchical Greedy Ideal performance in the hea… ▽ More We consider resource sharing networks of the form introduced in the work of Massoulié and Roberts(2000) as models for Internet flows. The goal is to study the open problem, formulated in Harrison et al. (2014), of constructing simple form rate allocation policies for broad families of resource sharing networks with associated costs converging to the Hierarchical Greedy Ideal performance in the heavy traffic limit. We consider two types of cost criteria, an infinite horizon discounted cost, and a long time average cost per unit time. We introduce a sequence of rate allocation control policies that are determined in terms of certain thresholds for the scaled queue length processes and prove that, under conditions, both type of costs associated with these policies converge in the heavy traffic limit to the corresponding HGI performance. The conditions needed for these results are satisfied by all the examples considered in Harrison et al. (2014). △ Less

Submitted 24 October, 2017; originally announced October 2017.

MSC Class: 60K25; 68M20; 90B36 (Primary) 60J70 (Secondary)

A numerical scheme for a mean field game in some queueing systems based on Markov chain approximation method

Authors: Erhan Bayraktar, Amarjit Budhiraja, Asaf Cohen

Abstract: We use the Markov chain approximation method to construct approximations for the solution of the mean field game (MFG) with reflecting barriers studied in Bayraktar, Budhiraja, and Cohen (2017). The MFG is formulated in terms of a controlled reflected diffusion with a cost function that depends on the reflection terms in addition to the standard variables: state, control, and the mean field term.… ▽ More We use the Markov chain approximation method to construct approximations for the solution of the mean field game (MFG) with reflecting barriers studied in Bayraktar, Budhiraja, and Cohen (2017). The MFG is formulated in terms of a controlled reflected diffusion with a cost function that depends on the reflection terms in addition to the standard variables: state, control, and the mean field term. This MFG arises from the asymptotic analysis of an $N$-player game for single server queues with strategic servers. By showing that our scheme is an almost contraction, we establish the convergence of this numerical scheme over a small time interval. △ Less

Submitted 27 August, 2018; v1 submitted 25 August, 2017; originally announced August 2017.

Comments: arXiv admin note: text overlap with arXiv:1605.09010

MSC Class: 65M12; 60K25; 91A13; 60K35; 93E20; 65M12; 60F17

Large Deviation Principle for the Exploration Process of the Configuration Model

Authors: Shankar Bhamidi, Amarjit Budhiraja, Paul Dupuis, Ruoyu Wu

Abstract: The configuration model is a sequence of random graphs constructed such that in the large network limit the degree distribution converges to a pre-specified probability distribution. The component structure of such random graphs can be obtained from an infinite dimensional Markov chain referred to as the exploration process. We establish a large deviation principle for the exploration process asso… ▽ More The configuration model is a sequence of random graphs constructed such that in the large network limit the degree distribution converges to a pre-specified probability distribution. The component structure of such random graphs can be obtained from an infinite dimensional Markov chain referred to as the exploration process. We establish a large deviation principle for the exploration process associated with the configuration model. Proofs rely on a representation of the exploration process as a system of stochastic differential equations driven by Poisson random measures and variational formulas for moments of nonnegative functionals of Poisson random measures. Uniqueness results for certain controlled systems of deterministic equations play a key role in the analysis. Applications of the large deviation results, for studying asymptotic behavior of the degree sequence in large components of the random graphs, are discussed. △ Less

Submitted 10 December, 2019; v1 submitted 5 August, 2017; originally announced August 2017.

Comments: 36 pages; this submission has now been replaced with new url arXiv:1912.04714 with new results

MSC Class: 60F10; 60C05; 05C80; 90B15

Diffusion Approximations for Load Balancing Mechanisms in Cloud Storage Systems

Authors: Amarjit Budhiraja, Eric Friedlander

Abstract: In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We study load balancing under the Batch Sampling routing scheme for a network of $n$ servers storing a set of files using the Maximum Distance Separable (MDS) code (cf. Li, Ramamoorthy, and Srikant (2016)). Specifically, each file is stored in equally sized pieces across $L$ servers s… ▽ More In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We study load balancing under the Batch Sampling routing scheme for a network of $n$ servers storing a set of files using the Maximum Distance Separable (MDS) code (cf. Li, Ramamoorthy, and Srikant (2016)). Specifically, each file is stored in equally sized pieces across $L$ servers such that any $k$ pieces can reconstruct the original file. When a request for a file is received, the dispatcher routes the job into the $k$-shortest queues among the $L$ for which the corresponding server contains a piece of the file being requested. We establish a law of large numbers and a central limit theorem as the system becomes large (i.e. $n\to\infty$). For the central limit theorem, the limit process take values in $\mathbf{\ell}_2$, the space of square summable sequences. Due to the large size of such systems, a direct analysis of the $n$-server system is frequently intractable. The law of large numbers and diffusion approximations established in this work provide practical tools with which to perform such analysis. The Power-of-$d$ routing scheme, also known as the supermarket model, is a special case of the model considered here. △ Less

Submitted 7 July, 2017; v1 submitted 29 June, 2017; originally announced June 2017.

Comments: 40 pages

MSC Class: 60K35; 60H30; 93E20 (Primary); 60J28; 60J70; 60K25; 91B70 (Secondary)

Distributed Simultaneous Action and Target Assignment for Multi-Robot Multi-Target Tracking

Authors: Yoonchang Sung, Ashish Kumar Budhiraja, Ryan K. Williams, Pratap Tokekar

Abstract: We study a multi-robot assignment problem for multi-target tracking. The proposed problem can be viewed as the mixed packing and covering problem. To deal with a limitation on both sensing and communication ranges, a distributed approach is taken into consideration. A local algorithm gives theoretical bounds on both the running time and approximation ratio to an optimal solution. We employ a local… ▽ More We study a multi-robot assignment problem for multi-target tracking. The proposed problem can be viewed as the mixed packing and covering problem. To deal with a limitation on both sensing and communication ranges, a distributed approach is taken into consideration. A local algorithm gives theoretical bounds on both the running time and approximation ratio to an optimal solution. We employ a local algorithm of max-min linear programs to solve the proposed task. Simulation result shows that a local algorithm is an effective solution to the multi-robot task allocation. △ Less

Submitted 6 November, 2018; v1 submitted 7 June, 2017; originally announced June 2017.

Comments: 6 pages, 9 figures, Published in IEEE International Conference on Robotics and Automation (ICRA), 2018

Large Deviations for Small Noise Diffusions in a Fast Markovian Environment

Authors: Amarjit Budhiraja, Paul Dupuis, Arnab Ganguly

Abstract: A large deviation principle is established for a two-scale stochastic system in which the slow component is a continuous process given by a small noise finite dimensional Itô stochastic differential equation, and the fast component is a finite state pure jump process. Previous works have considered settings where the coupling between the components is weak in a certain sense. In the current work w… ▽ More A large deviation principle is established for a two-scale stochastic system in which the slow component is a continuous process given by a small noise finite dimensional Itô stochastic differential equation, and the fast component is a finite state pure jump process. Previous works have considered settings where the coupling between the components is weak in a certain sense. In the current work we study a fully coupled system in which the drift and diffusion coefficient of the slow component and the jump intensity function and jump distribution of the fast process depend on the states of both components. In addition, the diffusion can be degenerate. Our proofs use certain stochastic control representations for expectations of exponential functionals of finite dimensional Brownian motions and Poisson random measures together with weak convergence arguments. A key challenge is in the proof of the large deviation lower bound where, due to the interplay between the degeneracy of the diffusion and the full dependence of the coefficients on the two components, the associated local rate function has poor regularity properties. △ Less

Submitted 8 May, 2017; originally announced May 2017.

Comments: 42 pages

MSC Class: Primary: 60F10; 60J75; 60J60; 60K37. Secondary: 60G35; 34C29

Algorithms for Routing of Unmanned Aerial Vehicles with Mobile Recharging Stations

Authors: Kevin Yu, Ashish Kumar Budhiraja, Pratap Tokekar

Abstract: We study the problem of planning a tour for an energy-limited Unmanned Aerial Vehicle (UAV) to visit a set of sites in the least amount of time. We envision scenarios where the UAV can be recharged along the way either by landing on stationary recharging stations or on Unmanned Ground Vehicles (UGVs) acting as mobile recharging stations. This leads to a new variant of the Traveling Salesperson Pro… ▽ More We study the problem of planning a tour for an energy-limited Unmanned Aerial Vehicle (UAV) to visit a set of sites in the least amount of time. We envision scenarios where the UAV can be recharged along the way either by landing on stationary recharging stations or on Unmanned Ground Vehicles (UGVs) acting as mobile recharging stations. This leads to a new variant of the Traveling Salesperson Problem (TSP) with mobile recharging stations. We present an algorithm that finds not only the order in which to visit the sites but also when and where to land on the charging stations to recharge. Our algorithm plans tours for the UGVs as well as determines best locations to place stationary charging stations. While the problems we study are NP-Hard, we present a practical solution using Generalized TSP that finds the optimal solution. If the UGVs are slower, the algorithm also finds the minimum number of UGVs required to support the UAV mission such that the UAV is not required to wait for the UGV. Our simulation results show that the running time is acceptable for reasonably sized instances in practice. △ Less

Submitted 18 September, 2017; v1 submitted 31 March, 2017; originally announced April 2017.

Comments: 7 pages, 14 figures, ICRA2018 under review

Algorithms for Visibility-Based Monitoring with Robot Teams

Authors: Pratap Tokekar, Ashish Kumar Budhiraja, Vijay Kumar

Abstract: We study the problem of planning paths for a team of robots for visually monitoring an environment. Our work is motivated by surveillance and persistent monitoring applications. We are given a set of target points in a polygonal environment that must be monitored using robots with cameras. The goal is to compute paths for all robots such that every target is visible from at least one path. In its… ▽ More We study the problem of planning paths for a team of robots for visually monitoring an environment. Our work is motivated by surveillance and persistent monitoring applications. We are given a set of target points in a polygonal environment that must be monitored using robots with cameras. The goal is to compute paths for all robots such that every target is visible from at least one path. In its general form, this problem is NP-hard as it generalizes the Art Gallery Problem and the Watchman Route Problem. We study two versions: (i) a geometric version in \emph{street polygons} for which we give a polynomial time $4$--approximation algorithm; and (ii) a general version for which we present a practical solution that finds the optimal solution in possibly exponential time. In addition to theoretical proofs, we also present results from simulation studies. △ Less

Submitted 9 December, 2016; originally announced December 2016.

Comments: 12 pages, 10 figures, submitted to IEEE Transactions on Robotics(TRO) and preliminary version of the paper was published in Intelligent Robots and Systems (IROS), 2015

Weakly interacting particle systems on inhomogeneous random graphs

Authors: Shankar Bhamidi, Amarjit Budhiraja, Ruoyu Wu

Abstract: We consider weakly interacting diffusions on time varying random graphs. The system consists of a large number of nodes in which the state of each node is governed by a diffusion process that is influenced by the neighboring nodes. The collection of neighbors of a given node changes dynamically over time and is determined through a time evolving random graph process. A law of large numbers and a p… ▽ More We consider weakly interacting diffusions on time varying random graphs. The system consists of a large number of nodes in which the state of each node is governed by a diffusion process that is influenced by the neighboring nodes. The collection of neighbors of a given node changes dynamically over time and is determined through a time evolving random graph process. A law of large numbers and a propagation of chaos result is established for a multi-type population setting where at each instant the interaction between nodes is given by an inhomogeneous random graph which may change over time. This result covers the setting in which the edge probabilities between any two nodes is allowed to decay to $0$ as the size of the system grows. A central limit theorem is established for the single-type population case under stronger conditions on the edge probability function. △ Less

Submitted 15 February, 2017; v1 submitted 2 December, 2016; originally announced December 2016.

Comments: 31 pages

Large Deviations for Brownian Particle Systems with Killing

Authors: Amarjit Budhiraja, Wai-Tong Louis Fan, Ruoyu Wu

Abstract: Particle approximations for certain nonlinear and nonlocal reaction-diffusion equations are studied using a system of Brownian motions with killing. The system is described by a collection of i.i.d. Brownian particles where each particle is killed independently at a rate determined by the empirical sub-probability measure of the states of the particles alive. A large deviation principle (LDP) for… ▽ More Particle approximations for certain nonlinear and nonlocal reaction-diffusion equations are studied using a system of Brownian motions with killing. The system is described by a collection of i.i.d. Brownian particles where each particle is killed independently at a rate determined by the empirical sub-probability measure of the states of the particles alive. A large deviation principle (LDP) for such sub-probability measure-valued processes is established. Along the way a convenient variational representation, which is of independent interest, for expectations of nonnegative functionals of Brownian motions together with an i.i.d. sequence of random variables is established. Proof of the LDP relies on this variational representation and weak convergence arguments. △ Less

Submitted 14 April, 2017; v1 submitted 10 September, 2016; originally announced September 2016.

Comments: v2: minor revisions, accepted by Journal of Theoretical Probability, 37 pages

MSC Class: 60F10; 60K35; 60B10; 93E20

Journal ref: Journal of Theoretical Probability. 1-40, 2016