-
Simultaneous Cutoff on the Multitype Configuration Model
Authors:
John Fernley,
Balázs Gerencsér
Abstract:
We find Gaussian cutoff profiles for the total variation distance to stationarity of a random walk on a multiplex network: a finite number of directed configuration models sharing a vertex set, each with its own bounded degree distribution and edge probability. Further we consider the minimal total variation distance over this space of possible doubly stochastic edge probabilities at each point in…
▽ More
We find Gaussian cutoff profiles for the total variation distance to stationarity of a random walk on a multiplex network: a finite number of directed configuration models sharing a vertex set, each with its own bounded degree distribution and edge probability. Further we consider the minimal total variation distance over this space of possible doubly stochastic edge probabilities at each point in time. Looking at all possible dynamics simultaneously on one realisation of the random graph, we find that this sequence of minimal distances converges in probability to the same cutoff profile as the chain with entropy maximising transition probabilities.
△ Less
Submitted 17 March, 2024;
originally announced March 2024.
-
Improved Mixing Rates of Directed Cycles with Additional Sparse Interconnections
Authors:
Balázs Gerencsér,
Julien M. Hendrickx
Abstract:
We analyze the absolute spectral gap of Markov chains on graphs obtained from a cycle of $n$ vertices and perturbed only at approximately $n^{1/ρ}$ random locations with an appropriate, possibly sparse, interconnection structure. Together with a strong asymmetry along the cycle, the gap of the resulting chain can be bounded inversely proportionally by the longest arc length (up to logarithmic fact…
▽ More
We analyze the absolute spectral gap of Markov chains on graphs obtained from a cycle of $n$ vertices and perturbed only at approximately $n^{1/ρ}$ random locations with an appropriate, possibly sparse, interconnection structure. Together with a strong asymmetry along the cycle, the gap of the resulting chain can be bounded inversely proportionally by the longest arc length (up to logarithmic factors) with high probability, providing a significant mixing speedup compared to the reversible version.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
Low complexity convergence rate bounds for the synchronous gossip subclass of push-sum algorithms
Authors:
Balázs Gerencsér,
Miklós Kornyik
Abstract:
We develop easily accessible quantities for bounding the almost sure exponential convergence rate of push-sum algorithms. We analyze the scenario of i.i.d. synchronous gossip, every agent communicating towards its single target at every step. Multiple bounding expressions are developed depending on the generality of the setup, all functions of the spectrum of the network. While the most general bo…
▽ More
We develop easily accessible quantities for bounding the almost sure exponential convergence rate of push-sum algorithms. We analyze the scenario of i.i.d. synchronous gossip, every agent communicating towards its single target at every step. Multiple bounding expressions are developed depending on the generality of the setup, all functions of the spectrum of the network. While the most general bound awaits further improvement, with more symmetries, close bounds can be established, as demonstrated by numerical simulations.
△ Less
Submitted 22 September, 2023; v1 submitted 12 July, 2023;
originally announced July 2023.
-
Cutoff for a class of auto-regressive models with vanishing additive noise
Authors:
Balázs Gerencsér,
Andrea Ottolini
Abstract:
We analyze the convergence rates for a family of auto-regressive Markov chains $(X^{(n)}_k)_{k\geq 0}$ on $\mathbb R^d$, where at each step a randomly chosen coordinate is replaced by a noisy damped weighted average of the others. The interest in the model comes from the connection with a certain Bayesian scheme introduced by de Finetti in the analysis of partially exchangeable data. Our main resu…
▽ More
We analyze the convergence rates for a family of auto-regressive Markov chains $(X^{(n)}_k)_{k\geq 0}$ on $\mathbb R^d$, where at each step a randomly chosen coordinate is replaced by a noisy damped weighted average of the others. The interest in the model comes from the connection with a certain Bayesian scheme introduced by de Finetti in the analysis of partially exchangeable data. Our main result shows that, when $n$ gets large (corresponding to a vanishing noise), a cutoff phenomenon occurs.
△ Less
Submitted 8 January, 2023; v1 submitted 3 September, 2022;
originally announced September 2022.
-
Fast synchronization of inhomogenous random automata
Authors:
Balázs Gerencsér,
Zsombor Várkonyi
Abstract:
We examine the reset threshold of randomly generated deterministic automata. We present a simple proof that an automaton with a random map** and two random permutation letters has a reset threshold of $\mathcal{O}\big( \sqrt{n \log^3 n} \big)$ with high probability, assuming only certain partial independence of the letters. Our observation is motivated by Nicaud (2014) providing a near-linear bo…
▽ More
We examine the reset threshold of randomly generated deterministic automata. We present a simple proof that an automaton with a random map** and two random permutation letters has a reset threshold of $\mathcal{O}\big( \sqrt{n \log^3 n} \big)$ with high probability, assuming only certain partial independence of the letters. Our observation is motivated by Nicaud (2014) providing a near-linear bound in the case of two random map** letters, among multiple other results. The upper bound for the latter case has been recently improved by the breakthrough work of Chapuy and Perarnau (2023) to $\mathcal{O}(\sqrt{n} \log n)$.
△ Less
Submitted 3 December, 2023; v1 submitted 10 June, 2022;
originally announced June 2022.
-
Trajectory Convergence from Coordinate-wise Decrease of General Energy Functions
Authors:
Julien M. Hendrickx,
Balázs Gerencsér
Abstract:
We consider arbitrary trajectories subject to a coordinate-wise energy decrease: the sign of the derivative of each entry is never the same as that of the corresponding entry of the gradient of some energy function. We show that this simple condition guarantees convergence to a point, to the minimum of the energy functions, or to a set where its Hessian has very specific properties. This extends a…
▽ More
We consider arbitrary trajectories subject to a coordinate-wise energy decrease: the sign of the derivative of each entry is never the same as that of the corresponding entry of the gradient of some energy function. We show that this simple condition guarantees convergence to a point, to the minimum of the energy functions, or to a set where its Hessian has very specific properties. This extends and strengthens recent results that were restricted to convex quadratic energy functions. We demonstrate the application of our result by using it to prove the convergence of a class of multi-agent systems subject to multiple uncertainties.
△ Less
Submitted 10 August, 2023; v1 submitted 7 March, 2022;
originally announced March 2022.
-
Computable convergence rate bound for ratio consensus algorithms
Authors:
Balázs Gerencsér
Abstract:
The objective of the paper is to establish a computable upper bound for the almost sure convergence rate for a class of ratio consensus algorithms defined via column-stochastic matrices. Our result extends the works of Iutzeler et al. (2013) on similar bounds that have been obtained in a more restrictive setup with limited conclusions. The present paper complements the results of Gerencsér and Ger…
▽ More
The objective of the paper is to establish a computable upper bound for the almost sure convergence rate for a class of ratio consensus algorithms defined via column-stochastic matrices. Our result extends the works of Iutzeler et al. (2013) on similar bounds that have been obtained in a more restrictive setup with limited conclusions. The present paper complements the results of Gerencsér and Gerencsér (2021), identifying the exact almost sure convergence rate of a wide class of ratio consensus algorithms in terms of a spectral gap, which is, however, not computable in general. The upper bound provided in the paper will be compared to the actual rate of almost sure convergence experimentally on a range of modulated random geographic graphs with random local interactions.
△ Less
Submitted 5 April, 2022; v1 submitted 10 April, 2021;
originally announced April 2021.
-
Rates of convergence for Gibbs sampling in the analysis of almost exchangeable data
Authors:
Balázs Gerencsér,
Andrea Ottolini
Abstract:
Motivated by de Finetti's representation theorem for almost exchangeable arrays, we want to sample $\mathbf p \in [0,1]^d$ from a distribution with density proportional to $\exp(-A^2\sum_{i<j}c_{ij}(p_i-p_j)^2)$, where $A$ is large and $c_{ij}$'s are non-negative weights. We analyze the rate of convergence of a coordinate Gibbs sampler used to simulate from these measures. We show that for every n…
▽ More
Motivated by de Finetti's representation theorem for almost exchangeable arrays, we want to sample $\mathbf p \in [0,1]^d$ from a distribution with density proportional to $\exp(-A^2\sum_{i<j}c_{ij}(p_i-p_j)^2)$, where $A$ is large and $c_{ij}$'s are non-negative weights. We analyze the rate of convergence of a coordinate Gibbs sampler used to simulate from these measures. We show that for every non-zero fixed matrix $C=(c_{ij})$, and large enough $A$, mixing happens in $Θ(A^2)$ steps in a suitable Wasserstein distance. The upper and lower bounds are explicit and depend on the matrix $C$ through few relevant spectral parameters.
△ Less
Submitted 21 December, 2020; v1 submitted 29 October, 2020;
originally announced October 2020.
-
Invariant measures for multidimensional fractional stochastic volatility models
Authors:
Balázs Gerencsér,
Miklós Rásonyi
Abstract:
We establish convergence to an invariant measure as time tends to infinity, for a large class of (possibly non-Markovian) stochastic volatility models. Our arguments are based on a novel coupling idea for Markov chains which also extends to Markov chains in random environments in an efficient way.
We establish convergence to an invariant measure as time tends to infinity, for a large class of (possibly non-Markovian) stochastic volatility models. Our arguments are based on a novel coupling idea for Markov chains which also extends to Markov chains in random environments in an efficient way.
△ Less
Submitted 27 August, 2021; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Poisson Equations, Lipschitz Continuity and Controlled Queues
Authors:
Algo Carè,
Balázs Csanád Csáji,
Balázs Gerencsér,
László Gerencsér,
Miklós Rásonyi
Abstract:
The objective of the paper is to revisit a key mathematical technology within the theory of stochastic approximation in a Markovian framework, elaborated in detail by Benveniste, Métivier, and Priouret (1990): the existence, uniqueness and Lipschitz continuity of the solutions of a parameter-dependent Poisson equation associated with a collection of Markov chains on general state spaces. The setup…
▽ More
The objective of the paper is to revisit a key mathematical technology within the theory of stochastic approximation in a Markovian framework, elaborated in detail by Benveniste, Métivier, and Priouret (1990): the existence, uniqueness and Lipschitz continuity of the solutions of a parameter-dependent Poisson equation associated with a collection of Markov chains on general state spaces. The setup and the methodology of our investigation is based on an elegant stability theory for Markov chains, developed by Hairer and Mattingly (2011). The paper provides a transparent analysis of parameter-dependent Poisson equations with convenient conditions. The validity of the proposed conditions is verified for a class of controlled queues.
△ Less
Submitted 13 November, 2022; v1 submitted 22 June, 2019;
originally announced June 2019.
-
Analysis of a non-reversible Markov chain speedup by a single edge
Authors:
Balázs Gerencsér
Abstract:
We present a Markov chain example where non-reversibility and an added edge jointly improve mixing time: when a random edge is added to a cycle of $n$ vertices and a Markov chain with a drift is introduced, we get mixing time of $O(n^{3/2})$ with probability bounded away from 0. If only one of the two modifications were performed, the mixing time would stay $Ω(n^2)$.
We present a Markov chain example where non-reversibility and an added edge jointly improve mixing time: when a random edge is added to a cycle of $n$ vertices and a Markov chain with a drift is introduced, we get mixing time of $O(n^{3/2})$ with probability bounded away from 0. If only one of the two modifications were performed, the mixing time would stay $Ω(n^2)$.
△ Less
Submitted 6 June, 2019; v1 submitted 8 May, 2019;
originally announced May 2019.
-
Trajectory convergence from coordinate-wise decrease of quadratic energy functions, and applications to platoons
Authors:
Julien M. Hendrickx,
Balazs Gerencser,
Baris Fidan
Abstract:
We consider trajectories where the sign of the derivative of each entry is opposite to that of the corresponding entry in the gradient of an energy function. We show that this condition guarantees convergence when the energy function is quadratic and positive definite and partly extend that result to some classes of positive semi-definite quadratic functions including those defined using a graph L…
▽ More
We consider trajectories where the sign of the derivative of each entry is opposite to that of the corresponding entry in the gradient of an energy function. We show that this condition guarantees convergence when the energy function is quadratic and positive definite and partly extend that result to some classes of positive semi-definite quadratic functions including those defined using a graph Laplacian. We show how this condition allows establishing the convergence of a platoon application in which it naturally appears, due to deadzones in the control laws designed to avoid instabilities caused by inconsistent measurements of the same distance by different agents.
△ Less
Submitted 10 June, 2019; v1 submitted 1 March, 2019;
originally announced March 2019.
-
Tight bounds on the convergence rate of generalized ratio consensus algorithms
Authors:
Balázs Gerencsér,
László Gerencsér
Abstract:
The problems discussed in this paper are motivated by general ratio consensus algorithms, introduced by Kempe, Dobra, and Gehrke (2003) in a simple form as the push-sum algorithm, later extended by Bénézit et al. (2010) under the name weighted gossip algorithm. We consider a communication protocol described by a strictly stationary, ergodic, sequentially primitive sequence of non-negative matrices…
▽ More
The problems discussed in this paper are motivated by general ratio consensus algorithms, introduced by Kempe, Dobra, and Gehrke (2003) in a simple form as the push-sum algorithm, later extended by Bénézit et al. (2010) under the name weighted gossip algorithm. We consider a communication protocol described by a strictly stationary, ergodic, sequentially primitive sequence of non-negative matrices, applied iteratively to a pair of fixed initial vectors, the components of which are called values and weights defined at the nodes of a network. The subject of ratio consensus problems is to study the asymptotic properties of ratios of values and weights at each node, expecting convergence to the same limit for all nodes. The main results of the paper provide upper bounds for the rate of the almost sure exponential convergence in terms of the spectral gap associated with the given sequence of random matrices. It will be shown that these upper bounds are sharp. Our results complement previous results of Picci and Taylor (2013) and Iutzeler, Ciblat and Hachem (2013).
△ Less
Submitted 15 May, 2020; v1 submitted 31 January, 2019;
originally announced January 2019.
-
On the ergodicity of certain Markov chains in random environments
Authors:
Balazs Gerencser,
Miklos Rasonyi
Abstract:
We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$. Convergence speed is estimated and an ergodic theorem is established for functionals of $X$.
Our hypotheses on $X$ combine the standard "small set" and "drift" co…
▽ More
We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$. Convergence speed is estimated and an ergodic theorem is established for functionals of $X$.
Our hypotheses on $X$ combine the standard "small set" and "drift" conditions for geometrically ergodic Markov chains with conditions on the growth rate of a certain "maximal process" of the random environment. We are able to cover a wide range of models that have heretofore been untractable. In particular, our results are pertinent to difference equations modulated by a stationary Gaussian process. Such equations arise in applications, for example, in discretized stochastic volatility models of mathematical finance.
△ Less
Submitted 26 July, 2019; v1 submitted 10 July, 2018;
originally announced July 2018.
-
An extension of the Plancherel measure
Authors:
Miklós Arató,
Villö Csiszár,
Balázs Gerencsér,
György Michaletzky,
Lídia Rejtö,
Gábor Székely,
Gábor Tusnády,
Katalin Varga
Abstract:
Given a distribution in the unite square and having iid sample from it the first question what a statistician might do to test the hypothesis that the sample is iid. For this purpose an extension of the Plancherel measure is introduced. Recent literature on asymptotic behavior of Plancherel measure is discussed with extension to the new set up. Models for random permutations are described and the…
▽ More
Given a distribution in the unite square and having iid sample from it the first question what a statistician might do to test the hypothesis that the sample is iid. For this purpose an extension of the Plancherel measure is introduced. Recent literature on asymptotic behavior of Plancherel measure is discussed with extension to the new set up. Models for random permutations are described and the power of different tests is compared.
△ Less
Submitted 17 May, 2018;
originally announced May 2018.
-
Acute sets of exponentially optimal size
Authors:
Balázs Gerencsér,
Viktor Harangi
Abstract:
We present a simple construction of an acute set of size $2^{d-1}+1$ in $\mathbb{R}^d$ for any dimension $d$. That is, we explicitly give $2^{d-1}+1$ points in the $d$-dimensional Euclidean space with the property that any three points form an acute triangle. It is known that the maximal number of such points is less than $2^d$. Our result significantly improves upon a recent construction, due to…
▽ More
We present a simple construction of an acute set of size $2^{d-1}+1$ in $\mathbb{R}^d$ for any dimension $d$. That is, we explicitly give $2^{d-1}+1$ points in the $d$-dimensional Euclidean space with the property that any three points form an acute triangle. It is known that the maximal number of such points is less than $2^d$. Our result significantly improves upon a recent construction, due to Dmitriy Zakharov, with size of order $\varphi^d$ where $\varphi = (1+\sqrt{5})/2 \approx 1.618$ is the golden ratio.
△ Less
Submitted 21 September, 2017; v1 submitted 11 September, 2017;
originally announced September 2017.
-
Mixing time of an unaligned Gibbs sampler on the square
Authors:
Balázs Gerencsér
Abstract:
The paper concerns a particular example of the Gibbs sampler and its mixing efficiency. Coordinates of a point are rerandomized in the unit square $[0,1]^2$ to approach a stationary distribution with density proportional to $\exp(-A^2(u-v)^2)$ for $(u,v)\in [0,1]^2$ with some large parameter $A$.
Diaconis conjectured the mixing time of this process to be $O(A^2)$ which we confirm in this paper.…
▽ More
The paper concerns a particular example of the Gibbs sampler and its mixing efficiency. Coordinates of a point are rerandomized in the unit square $[0,1]^2$ to approach a stationary distribution with density proportional to $\exp(-A^2(u-v)^2)$ for $(u,v)\in [0,1]^2$ with some large parameter $A$.
Diaconis conjectured the mixing time of this process to be $O(A^2)$ which we confirm in this paper. This improves on the currently known $O(\exp(A^2))$ estimate.
△ Less
Submitted 6 October, 2018; v1 submitted 27 June, 2017;
originally announced June 2017.
-
Entropy inequalities for factors of IID
Authors:
Ágnes Backhausz,
Balázs Gerencsér,
Viktor Harangi
Abstract:
This paper is concerned with certain invariant random processes (called factors of IID) on infinite trees. Given such a process, one can assign entropies to different finite subgraphs of the tree. There are linear inequalities between these entropies that hold for any factor of IID process (e.g. "edge versus vertex" or "star versus edge"). These inequalities turned out to be very useful: they have…
▽ More
This paper is concerned with certain invariant random processes (called factors of IID) on infinite trees. Given such a process, one can assign entropies to different finite subgraphs of the tree. There are linear inequalities between these entropies that hold for any factor of IID process (e.g. "edge versus vertex" or "star versus edge"). These inequalities turned out to be very useful: they have several applications already, the most recent one is the Backhausz-Szegedy result on the eigenvectors of random regular graphs.
We present new entropy inequalities in this paper. In fact, our approach provides a general "recipe" for how to find and prove such inequalities. Our key tool is a generalization of the edge-vertex inequality for a broader class of factor processes with fewer symmetries.
△ Less
Submitted 24 November, 2017; v1 submitted 15 June, 2017;
originally announced June 2017.
-
On the interplay between Babai and Cerny's conjectures
Authors:
François Gonze,
Vladimir Gusev,
Balázs Gerencsér,
Raphaël M. Jungers,
Mikhail V. Volkov
Abstract:
Motivated by the Babai conjecture and the Cerny conjecture, we study the reset thresholds of automata with the transition monoid equal to the full monoid of transformations of the state set. For automata with $n$ states in this class, we prove that the reset thresholds are upper-bounded by $2n^2-6n+5$ and can attain the value $\tfrac{n(n-1)}{2}$. In addition, we study diameters of the pair digraph…
▽ More
Motivated by the Babai conjecture and the Cerny conjecture, we study the reset thresholds of automata with the transition monoid equal to the full monoid of transformations of the state set. For automata with $n$ states in this class, we prove that the reset thresholds are upper-bounded by $2n^2-6n+5$ and can attain the value $\tfrac{n(n-1)}{2}$. In addition, we study diameters of the pair digraphs of permutation automata and construct $n$-state permutation automata with diameter $\tfrac{n^2}{4} + o(n^2)$.
△ Less
Submitted 6 August, 2017; v1 submitted 13 April, 2017;
originally announced April 2017.
-
Mutual information decay for factors of IID
Authors:
Balázs Gerencsér,
Viktor Harangi
Abstract:
This paper is concerned with factor of i.i.d. processes on the $d$-regular tree for $d \geq 3$. We study the mutual information of the values on two given vertices. If the vertices are neighbors (i.e., their distance is $1$), then a known inequality between the entropy of a vertex and the entropy of an edge provides an upper bound for the (normalized) mutual information. In this paper we obtain up…
▽ More
This paper is concerned with factor of i.i.d. processes on the $d$-regular tree for $d \geq 3$. We study the mutual information of the values on two given vertices. If the vertices are neighbors (i.e., their distance is $1$), then a known inequality between the entropy of a vertex and the entropy of an edge provides an upper bound for the (normalized) mutual information. In this paper we obtain upper bounds for vertices at an arbitrary distance $k$, of order $(d-1)^{-k/2}$. Although these bounds are sharp, we also show that an interesting phenomenon occurs here: for any fixed process the rate of decay of the mutual information is much faster, essentially of order $(d-1)^{-k}$.
△ Less
Submitted 24 July, 2017; v1 submitted 13 March, 2017;
originally announced March 2017.
-
Correlation bound for distant parts of factor of IID processes
Authors:
Ágnes Backhausz,
Balázs Gerencsér,
Viktor Harangi,
Máté Vizer
Abstract:
We study factor of i.i.d. processes on the $d$-regular tree for $d \geq 3$. We show that if such a process is restricted to two distant connected subgraphs of the tree, then the two parts are basically uncorrelated. More precisely, any functions of the two parts have correlation at most $k(d-1) / (\sqrt{d-1})^k$, where $k$ denotes the distance of the subgraphs. This result can be considered as a q…
▽ More
We study factor of i.i.d. processes on the $d$-regular tree for $d \geq 3$. We show that if such a process is restricted to two distant connected subgraphs of the tree, then the two parts are basically uncorrelated. More precisely, any functions of the two parts have correlation at most $k(d-1) / (\sqrt{d-1})^k$, where $k$ denotes the distance of the subgraphs. This result can be considered as a quantitative version of the fact that factor of i.i.d. processes have trivial 1-ended tails.
△ Less
Submitted 8 April, 2016; v1 submitted 28 March, 2016;
originally announced March 2016.
-
Primitive sets of nonnegative matrices and synchronizing automata
Authors:
Balázs Gerencsér,
Vladimir V. Gusev,
Raphaël M. Jungers
Abstract:
A set of nonnegative matrices $\mathcal{M}=\{M_1, M_2, \ldots, M_k\}$ is called primitive if there exist indices $i_1, i_2, \ldots, i_m$ such that $M_{i_1} M_{i_2} \ldots M_{i_m}$ is positive (i.e. has all its entries $>0$). The length of the shortest such product is called the exponent of $\mathcal{M}$. The concept of primitive sets of matrices comes up in a number of problems within control theo…
▽ More
A set of nonnegative matrices $\mathcal{M}=\{M_1, M_2, \ldots, M_k\}$ is called primitive if there exist indices $i_1, i_2, \ldots, i_m$ such that $M_{i_1} M_{i_2} \ldots M_{i_m}$ is positive (i.e. has all its entries $>0$). The length of the shortest such product is called the exponent of $\mathcal{M}$. The concept of primitive sets of matrices comes up in a number of problems within control theory, non-homogeneous Markov chains, automata theory etc. Recently, connections between synchronizing automata and primitive sets of matrices were established. In the present paper, we significantly strengthen these links by providing equivalence results, both in terms of combinatorial characterization, and computational aspects. We study the maximal exponent among all primitive sets of $n \times n$ matrices, which we denote by $\exp(n)$. We prove that $\lim_{n\rightarrow\infty} \tfrac{\log \exp(n)}{n} = \tfrac{\log 3}{3}$, and moreover, we establish that this bound leads to a resolution of the Černý problem for carefully synchronizing automata. We also study the set of matrices with no zero rows and columns, denoted by $\mathcal{NZ}$, due to its intriguing connections to the Černý conjecture and the recent generalization of Perron-Frobenius theory for this class. We characterize computational complexity of different problems related to the exponent of $\mathcal{NZ}$ matrix sets, and present a quadratic bound on the exponents of sets belonging to a special subclass. Namely, we show that the exponent of a set of matrices having total support is bounded by $2n^2 -5n +5$.
△ Less
Submitted 24 February, 2016;
originally announced February 2016.
-
Markov modeling of online inter-arrival times
Authors:
Corentin Vande Kerckhove,
Balázs Gerencsér,
Julien M. Hendrickx,
Vincent D. Blondel
Abstract:
In this paper, we investigate the arising communication patterns on social media, and in particular the series of events happening for a single user. While the distribution of inter-event times is often assimilated to power-law density functions, a debate persists on the nature of an underlying model that explains the observed distribution. In the present, we propose an intuitive explanation to un…
▽ More
In this paper, we investigate the arising communication patterns on social media, and in particular the series of events happening for a single user. While the distribution of inter-event times is often assimilated to power-law density functions, a debate persists on the nature of an underlying model that explains the observed distribution. In the present, we propose an intuitive explanation to understand the observed dependence of subsequent waiting times. Our contribution is twofold. The first idea consists of separating the short waiting times -- out of scope for power-law distributions -- from the long ones. The model is further enhanced by introducing a two-state Markovian process to incorporate memory.
△ Less
Submitted 7 December, 2018; v1 submitted 16 September, 2015;
originally announced September 2015.
-
Improved mixing rates of directed cycles by added connection
Authors:
Balázs Gerencsér,
Julien Hendrickx
Abstract:
We investigate the mixing rate of a Markov chain where a combination of long distance edges and non-reversibility is introduced: as a first step, we focus here on the following graphs: starting from the cycle graph, we select random nodes and add all edges connecting them. We prove a square factor improvement of the mixing rate compared to the reversible version of the Markov chain.
We investigate the mixing rate of a Markov chain where a combination of long distance edges and non-reversibility is introduced: as a first step, we focus here on the following graphs: starting from the cycle graph, we select random nodes and add all edges connecting them. We prove a square factor improvement of the mixing rate compared to the reversible version of the Markov chain.
△ Less
Submitted 10 February, 2018; v1 submitted 4 September, 2015;
originally announced September 2015.
-
Push sum with transmission failures
Authors:
Balázs Gerencsér,
Julien M. Hendrickx
Abstract:
The push-sum algorithm allows distributed computing of the average on a directed graph, and is particularly relevant when one is restricted to one-way and/or asynchronous communications. We investigate its behavior in the presence of unreliable communication channels where messages can be lost. We show that exponential convergence still holds and deduce fundamental properties that implicitly descr…
▽ More
The push-sum algorithm allows distributed computing of the average on a directed graph, and is particularly relevant when one is restricted to one-way and/or asynchronous communications. We investigate its behavior in the presence of unreliable communication channels where messages can be lost. We show that exponential convergence still holds and deduce fundamental properties that implicitly describe the distribution of the final value obtained. We analyze the error of the final common value we get for the essential case of two nodes, both theoretically and numerically. We provide performance comparison with a standard consensus algorithm.
△ Less
Submitted 31 May, 2017; v1 submitted 30 April, 2015;
originally announced April 2015.
-
Improved bound on the worst case complexity of Policy Iteration
Authors:
Romain Hollanders,
Balázs Gerencsér,
Jean-Charles Delvenne,
Raphaël M. Jungers
Abstract:
Solving Markov Decision Processes (MDPs) is a recurrent task in engineering. Even though it is known that solutions for minimizing the infinite horizon expected reward can be found in polynomial time using Linear Programming techniques, iterative methods like the Policy Iteration algorithm (PI) remain usually the most efficient in practice. This method is guaranteed to converge in a finite number…
▽ More
Solving Markov Decision Processes (MDPs) is a recurrent task in engineering. Even though it is known that solutions for minimizing the infinite horizon expected reward can be found in polynomial time using Linear Programming techniques, iterative methods like the Policy Iteration algorithm (PI) remain usually the most efficient in practice. This method is guaranteed to converge in a finite number of steps. Unfortunately, it is known that it may require an exponential number of steps in the size of the problem to converge. On the other hand, many open questions remain considering the actual worst case complexity. In this work, we provide the first improvement over the fifteen years old upper bound from Mansour & Singh (1999) by showing that PI requires at most k/(k-1)*k^n/n + o(k^n/n) iterations to converge, where n is the number of states of the MDP and k is the maximum number of actions per state. Perhaps more importantly, we also show that this bound is optimal for an important relaxation of the problem.
△ Less
Submitted 28 October, 2014;
originally announced October 2014.
-
A complexity analysis of Policy Iteration through combinatorial matrices arising from Unique Sink Orientations
Authors:
Romain Hollanders,
Balázs Gerencsér,
Jean-Charles Delvenne,
Raphaël M. Jungers
Abstract:
Unique Sink Orientations (USOs) are an appealing abstraction of several major optimization problems of applied mathematics such as for instance Linear Programming (LP), Markov Decision Processes (MDPs) or 2-player Turn Based Stochastic Games (2TBSGs). A polynomial time algorithm to find the sink of a USO would translate into a strongly polynomial time algorithm to solve the aforementioned problems…
▽ More
Unique Sink Orientations (USOs) are an appealing abstraction of several major optimization problems of applied mathematics such as for instance Linear Programming (LP), Markov Decision Processes (MDPs) or 2-player Turn Based Stochastic Games (2TBSGs). A polynomial time algorithm to find the sink of a USO would translate into a strongly polynomial time algorithm to solve the aforementioned problems---a major quest for all three cases. In addition, we may translate MDPs and 2TBSGs into the problem of finding the sink of an acyclic USO of a cube, which can be done using the well-known Policy Iteration algorithm (PI). The study of its complexity is the object of this work. Despite its exponential worst case complexity, the principle of PI is a powerful source of inspiration for other methods.
As our first contribution, we disprove Hansen and Zwick's conjecture claiming that the number of steps of PI should follow the Fibonacci sequence in the worst case. Our analysis relies on a new combinatorial formulation of the problem---the so-called Order-Regularity formulation (OR). Then, for our second contribution, we (exponentially) improve the $Ω(1.4142^n)$ lower bound on the number of steps of PI from Schurr and Szabó in the case of the OR formulation and obtain an $Ω(1.4269^n)$ bound.
△ Less
Submitted 9 January, 2015; v1 submitted 16 July, 2014;
originally announced July 2014.
-
Optimal one-dimensional coverage by unreliable sensors
Authors:
Paolo Frasca,
Federica Garin,
Balazs Gerencser,
Julien M. Hendrickx
Abstract:
This paper regards the problem of optimally placing unreliable sensors in a one-dimensional environment. We assume that sensors can fail with a certain probability and we minimize the expected maximum distance from any point in the environment to the closest active sensor. We provide a computational method to find the optimal placement and we estimate the relative quality of equispaced and random…
▽ More
This paper regards the problem of optimally placing unreliable sensors in a one-dimensional environment. We assume that sensors can fail with a certain probability and we minimize the expected maximum distance from any point in the environment to the closest active sensor. We provide a computational method to find the optimal placement and we estimate the relative quality of equispaced and random placements. We prove that the former is asymptotically equivalent to the optimal placement when the number of sensors goes to infinity, with a cost ratio converging to 1, while the cost of the latter remains strictly larger.
△ Less
Submitted 14 November, 2014; v1 submitted 30 April, 2014;
originally announced April 2014.
-
Mixing times of Markov chains on a cycle with additional long range connections
Authors:
Balázs Gerencsér
Abstract:
We develop Markov chain mixing time estimates for a class of Markov chains with restricted transitions. We assume transitions may occur along a cycle of $n$ nodes and on $n^γ$ additional edges, where $γ< 1$. We find that the mixing times of reversible Markov chains properly interpolate between the mixing times of the cycle with no added edges and of the cycle with $cn$ added edges (which is in tur…
▽ More
We develop Markov chain mixing time estimates for a class of Markov chains with restricted transitions. We assume transitions may occur along a cycle of $n$ nodes and on $n^γ$ additional edges, where $γ< 1$. We find that the mixing times of reversible Markov chains properly interpolate between the mixing times of the cycle with no added edges and of the cycle with $cn$ added edges (which is in turn a Small World Network model). In the case of non-reversible Markov-chains, a considerable gap remains between lower and upper bounds, but simulations give hope to experience a significant speedup compared to the reversible case.
△ Less
Submitted 25 June, 2015; v1 submitted 8 January, 2014;
originally announced January 2014.
-
Invariant Gaussian processes and independent sets on regular graphs of large girth
Authors:
Endre Csóka,
Balázs Gerencsér,
Viktor Harangi,
Bálint Virág
Abstract:
We prove that every 3-regular, n-vertex simple graph with sufficiently large girth contains an independent set of size at least 0.4361n. (The best known bound is 0.4352n.) In fact, computer simulation suggests that the bound our method provides is about 0.438n.
Our method uses invariant Gaussian processes on the d-regular tree that satisfy the eigenvector equation at each vertex for a certain ei…
▽ More
We prove that every 3-regular, n-vertex simple graph with sufficiently large girth contains an independent set of size at least 0.4361n. (The best known bound is 0.4352n.) In fact, computer simulation suggests that the bound our method provides is about 0.438n.
Our method uses invariant Gaussian processes on the d-regular tree that satisfy the eigenvector equation at each vertex for a certain eigenvalue λ. We show that such processes can be approximated by i.i.d. factors provided that $|λ| \leq 2\sqrt{d-1}$. We then use these approximations for $λ= -2\sqrt{d-1}$ to produce factor of i.i.d. independent sets on regular trees.
△ Less
Submitted 17 May, 2013;
originally announced May 2013.
