-
Persistence of iterated partial sums
Authors:
Amir Dembo,
Fuchang Gao
Abstract:
Let p_n denote the persistence probability that the first n iterated partial sums of integrable, zero-mean, i.i.d. random variables X_k, are negative. We show that p_n is bounded above up to universal constant by the square root of the expected absolute value of the empirical average of {X_k}. A converse bound holds whenever P(-X_1>t) is up to constant exp(-b t) for some b>0 or when P(-X_1>t) deca…
▽ More
Let p_n denote the persistence probability that the first n iterated partial sums of integrable, zero-mean, i.i.d. random variables X_k, are negative. We show that p_n is bounded above up to universal constant by the square root of the expected absolute value of the empirical average of {X_k}. A converse bound holds whenever P(-X_1>t) is up to constant exp(-b t) for some b>0 or when P(-X_1>t) decays super-exponentially in t. Consequently, for such random variables we have that p_n decays as n^{-1/4} if X_1 has finite second moment. In contrast, we show that for any 0 < c < 1/4 there exist integrable, zero-mean random variables for which the rate of decay of p_n is n^{-c}.
△ Less
Submitted 29 January, 2011;
originally announced January 2011.
-
Central limit theorem for biased random walk on multi-type Galton-Watson trees
Authors:
Amir Dembo,
Nike Sun
Abstract:
Let T be a rooted supercritical multi-type Galton-Watson (MGW) tree with types coming from a finite alphabet, conditioned to non-extinction. The lambda-biased random walk (X_t, t>=0) on T is the nearest-neighbor random walk which, when at a vertex v with d(v) offspring, moves closer to the root with probability lambda/[lambda+d(v)], and to each of the offspring with probability 1/[lambda+d(v)]. Th…
▽ More
Let T be a rooted supercritical multi-type Galton-Watson (MGW) tree with types coming from a finite alphabet, conditioned to non-extinction. The lambda-biased random walk (X_t, t>=0) on T is the nearest-neighbor random walk which, when at a vertex v with d(v) offspring, moves closer to the root with probability lambda/[lambda+d(v)], and to each of the offspring with probability 1/[lambda+d(v)]. This walk is recurrent for lambda>=rho and transient for 0<lambda<rho, with rho the Perron-Frobenius eigenvalue for the (assumed) irreducible matrix of expected offspring numbers. Subject to finite moments of order p>4 for the offspring distributions, we prove the following quenched CLT for lambda-biased random walk at the critical value lambda=rho: for almost every T, the process |X_{floor(nt)}|/sqrt{n} converges in law as n tends to infinity to a reflected Brownian motion rescaled by an explicit constant. This result was proved under some stronger assumptions by Peres-Zeitouni (2008) for single-type Galton-Watson trees. Following their approach, our proof is based on a new explicit description of a reversing measure for the walk from the point of view of the particle (generalizing the measure constructed in the single-type setting by Peres-Zeitouni), and the construction of appropriate harmonic coordinates. In carrying out this program we prove moment and conductance estimates for MGW trees, which may be of independent interest. In addition, we extend our construction of the reversing measure to a biased random walk with random environment (RWRE) on MGW trees, again at a critical value of the bias. We compare this result against a transience-recurrence criterion for the RWRE generalizing a result of Faraud (2011) for Galton-Watson trees.
△ Less
Submitted 6 May, 2012; v1 submitted 17 November, 2010;
originally announced November 2010.
-
Gibbs Measures and Phase Transitions on Sparse Random Graphs
Authors:
Amir Dembo,
Andrea Montanari
Abstract:
Many problems of interest in computer science and information theory can be phrased in terms of a probability distribution over discrete variables associated to the vertices of a large (but finite) sparse graph. In recent years, considerable progress has been achieved by viewing these distributions as Gibbs measures and applying to their study heuristic tools from statistical physics. We review…
▽ More
Many problems of interest in computer science and information theory can be phrased in terms of a probability distribution over discrete variables associated to the vertices of a large (but finite) sparse graph. In recent years, considerable progress has been achieved by viewing these distributions as Gibbs measures and applying to their study heuristic tools from statistical physics. We review this approach and provide some results towards a rigorous treatment of these problems.
△ Less
Submitted 28 October, 2009;
originally announced October 2009.
-
Spectral measure of heavy tailed band and covariance random matrices
Authors:
Serban Belinschi,
Amir Dembo,
Alice Guionnet
Abstract:
We study the asymptotic behavior of the appropriately scaled and possibly perturbed spectral measure $μ$ of large random real symmetric matrices with heavy tailed entries. Specifically, consider the N by N symmetric matrix $Y_N^σ$ whose (i,j) entry is $σ(i/N,j/N)X_{ij}$ where $(X_{ij}, 0<i<j+1<\infty)$ is an infinite array of i.i.d real variables with common distribution in the domain of attract…
▽ More
We study the asymptotic behavior of the appropriately scaled and possibly perturbed spectral measure $μ$ of large random real symmetric matrices with heavy tailed entries. Specifically, consider the N by N symmetric matrix $Y_N^σ$ whose (i,j) entry is $σ(i/N,j/N)X_{ij}$ where $(X_{ij}, 0<i<j+1<\infty)$ is an infinite array of i.i.d real variables with common distribution in the domain of attraction of an $α$-stable law, $0<α<2$, and $σ$ is a deterministic function. For a random diagonal $D_N$ independent of $Y_N^σ$ and with appropriate rescaling $a_N$, we prove that the distribution $μ$ of $a_N^{-1}Y_N^σ+ D_N$ converges in mean towards a limiting probability measure which we characterize. As a special case, we derive and analyze the almost sure limiting spectral density for empirical covariance matrices with heavy tailed entries.
△ Less
Submitted 4 February, 2009; v1 submitted 10 November, 2008;
originally announced November 2008.
-
Ising models on locally tree-like graphs
Authors:
Amir Dembo,
Andrea Montanari
Abstract:
We consider ferromagnetic Ising models on graphs that converge locally to trees. Examples include random regular graphs with bounded degree and uniformly random graphs with bounded average degree. We prove that the "cavity" prediction for the limiting free energy per spin is correct for any positive temperature and external field. Further, local marginals can be approximated by iterating a set of…
▽ More
We consider ferromagnetic Ising models on graphs that converge locally to trees. Examples include random regular graphs with bounded degree and uniformly random graphs with bounded average degree. We prove that the "cavity" prediction for the limiting free energy per spin is correct for any positive temperature and external field. Further, local marginals can be approximated by iterating a set of mean field (cavity) equations. Both results are achieved by proving the local convergence of the Boltzmann distribution on the original graph to the Boltzmann distribution on the appropriate infinite random tree.
△ Less
Submitted 27 September, 2010; v1 submitted 29 April, 2008;
originally announced April 2008.
-
Markovian perturbation, response and fluctuation dissipation theorem
Authors:
Amir Dembo,
Jean-Dominique Deuschel
Abstract:
We consider the Fluctuation Dissipation Theorem (FDT) of statistical physics from a mathematical perspective. We formalize the concept of "linear response function" in the general framework of Markov processes. We show that for processes out of equilibrium it depends not only on the given Markov process X(s) but also on the chosen perturbation of it. We characterize the set of all possible respo…
▽ More
We consider the Fluctuation Dissipation Theorem (FDT) of statistical physics from a mathematical perspective. We formalize the concept of "linear response function" in the general framework of Markov processes. We show that for processes out of equilibrium it depends not only on the given Markov process X(s) but also on the chosen perturbation of it. We characterize the set of all possible response functions for a given Markov process and show that at equilibrium they all satisfy the FDT. That is, if the initial measure is invariant for the given Markov semi-group, then for any pair of times s<t and nice functions f,g, the dissipation, that is, the derivative in s of the covariance of g(X(t)) and f(X(s)) equals the infinitesimal response at time t and direction g to any Markovian perturbation that alters the invariant measure of X(.) in the direction of f at time s. The same applies in the so called FDT regime near equilibrium, i.e. in the limit s going to infinity with t-s fixed, provided X(s) converges in law to an invariant measure for its dynamics. We provide the response function of two generic Markovian perturbations which we then compare and contrast for pure jump processes on a discrete space, for finite dimensional diffusion processes, and for stochastic spin systems.
△ Less
Submitted 16 February, 2010; v1 submitted 24 October, 2007;
originally announced October 2007.
-
Finite size scaling for the core of large random hypergraphs
Authors:
Amir Dembo,
Andrea Montanari
Abstract:
The (two) core of a hypergraph is the maximal collection of hyperedges within which no vertex appears only once. It is of importance in tasks such as efficiently solving a large linear system over GF[2], or iterative decoding of low-density parity-check codes used over the binary erasure channel. Similar structures emerge in a variety of NP-hard combinatorial optimization and decision problems,…
▽ More
The (two) core of a hypergraph is the maximal collection of hyperedges within which no vertex appears only once. It is of importance in tasks such as efficiently solving a large linear system over GF[2], or iterative decoding of low-density parity-check codes used over the binary erasure channel. Similar structures emerge in a variety of NP-hard combinatorial optimization and decision problems, from vertex cover to satisfiability. For a uniformly chosen random hypergraph of $m=nρ$ vertices and $n$ hyperedges, each consisting of the same fixed number $l\geq3$ of vertices, the size of the core exhibits for large $n$ a first-order phase transition, changing from $o(n)$ for $ρ>ρ_{\mathrm{c}}$ to a positive fraction of $n$ for $ρ<ρ_{\mathrm{c}}$, with a transition window size $Θ(n^{-1/2})$ around $ρ_{\mathrm{c}}>0$. Analyzing the corresponding ``leaf removal'' algorithm, we determine the associated finite-size scaling behavior. In particular, if $ρ$ is inside the scaling window (more precisely, $ρ=ρ_{\mathrm{c}}+rn^{-1/2}$), the probability of having a core of size $Θ(n)$ has a limit strictly between 0 and 1, and a leading correction of order $Θ(n^{-1/6})$. The correction admits a sharp characterization in terms of the distribution of a Brownian motion with quadratic shift, from which it inherits the scaling with $n$. This behavior is expected to be universal for a wide collection of combinatorial problems.
△ Less
Submitted 17 November, 2008; v1 submitted 31 January, 2007;
originally announced February 2007.
-
A Lower Bound on the Disconnection Time of a Discrete Cylinder
Authors:
Amir Dembo,
Alain-Sol Sznitman
Abstract:
We study the asymptotic behavior for large N of the disconnection time T_N of simple random walk on a discrete cylinder with base a d-dimensional discrete torus of side-length N. When d is sufficiently large, we are able to substantially improve the lower bounds obtained by the authors in a previous article when d is bigger or equal to 2. We show here that the laws of N^(2d)/T_N are tight.
We study the asymptotic behavior for large N of the disconnection time T_N of simple random walk on a discrete cylinder with base a d-dimensional discrete torus of side-length N. When d is sufficiently large, we are able to substantially improve the lower bounds obtained by the authors in a previous article when d is bigger or equal to 2. We show here that the laws of N^(2d)/T_N are tight.
△ Less
Submitted 28 July, 2008; v1 submitted 15 January, 2007;
originally announced January 2007.
-
Limiting dynamics for spherical models of spin glasses at high temperature
Authors:
Amir Dembo,
Alice Guionnet,
Christian Mazza
Abstract:
We analyze the coupled non-linear integro-differential equations whose solutions is the thermodynamical limit of the empirical correlation and response functions in the Langevin dynamics for spherical p-spin disordered mean-field models. We provide a mathematically rigorous derivation of their FDT solution (for the high temperature regime) and of certain key properties of this solution, which ar…
▽ More
We analyze the coupled non-linear integro-differential equations whose solutions is the thermodynamical limit of the empirical correlation and response functions in the Langevin dynamics for spherical p-spin disordered mean-field models. We provide a mathematically rigorous derivation of their FDT solution (for the high temperature regime) and of certain key properties of this solution, which are in agreement with earlier derivations based on physical grounds.
△ Less
Submitted 20 September, 2006;
originally announced September 2006.
-
Valleys and the maximum local time for random walk in random environment
Authors:
Amir Dembo,
Nina Gantert,
Yuval Peres,
Zhan Shi
Abstract:
Let $ξ(n, x)$ be the local time at $x$ for a recurrent one-dimensional random walk in random environment after $n$ steps, and consider the maximum $ξ^*(n) = \max_x ξ(n,x)$. It is known that $\limsup ξ^*(n)/n$ is a positive constant a.s. We prove that $\liminf_n (\log\log\log n)ξ^*(n)/n$ is a positive constant a.s.; this answers a question of P. Révész (1990). The proof is based on an analysis of…
▽ More
Let $ξ(n, x)$ be the local time at $x$ for a recurrent one-dimensional random walk in random environment after $n$ steps, and consider the maximum $ξ^*(n) = \max_x ξ(n,x)$. It is known that $\limsup ξ^*(n)/n$ is a positive constant a.s. We prove that $\liminf_n (\log\log\log n)ξ^*(n)/n$ is a positive constant a.s.; this answers a question of P. Révész (1990). The proof is based on an analysis of the {\em valleys /} in the environment, defined as the potential wells of record depth. In particular, we show that almost surely, at any time $n$ large enough, the random walker has spent almost all of its lifetime in the two deepest valleys of the environment it has encountered. We also prove a uniform exponential tail bound for the ratio of the expected total occupation time of a valley and the expected local time at its bottom.
△ Less
Submitted 9 March, 2006; v1 submitted 29 August, 2005;
originally announced August 2005.
-
How large a disc is covered by a random walk in n steps?
Authors:
Amir Dembo,
Yuval Peres,
Jay Rosen
Abstract:
We show that the largest disc covered by a simple random walk (SRW) on $\mathbb{Z}^2$ after n steps has radius n^{1/4+o(1)}, thus resolving an open problem of Révész [Random Walk in Random and Non-Random Environments (1990) World Scientific, Teaneck, NJ]. For any fixed $\ell$, the largest disc completely covered at least $\ell$ times by the SRW also has radius n^{1/4+o(1)}. However, the largest…
▽ More
We show that the largest disc covered by a simple random walk (SRW) on $\mathbb{Z}^2$ after n steps has radius n^{1/4+o(1)}, thus resolving an open problem of Révész [Random Walk in Random and Non-Random Environments (1990) World Scientific, Teaneck, NJ]. For any fixed $\ell$, the largest disc completely covered at least $\ell$ times by the SRW also has radius n^{1/4+o(1)}. However, the largest disc completely covered by each of $\ell$ independent simple random walks on $\mathbb{Z}^2$ after $n$ steps is only of radius $n^{1/(2+2\sqrt{\ell})+o(1)}$. We complement this by showing that the radius of the largest disc completely covered at least a fixed fraction $α$ of the maximum number of visits to any site during the first $n$ steps of the SRW on $\mathbb{Z}^2$, is $n^{(1-\sqrtα)/4+o(1)}$. We also show that almost surely, for infinitely many values of $n$ it takes about $n^{1/2+o(1)}$ steps after step n for the SRW to reach the first previously unvisited site (and the exponent 1/2 is sharp). This resolves a problem raised by Révész [Ann. Probab. 21 (1993) 318--328].
△ Less
Submitted 25 July, 2007; v1 submitted 8 March, 2005;
originally announced March 2005.
-
Cugliandolo-Kurchan equations for dynamics of Spin-Glasses
Authors:
Gerard Ben Arous,
Amir Dembo,
Alice Guionnet
Abstract:
We study the Langevin dynamics for the family of spherical $p$-spin disordered mean-field models and prove that in the limit of system size $N$ approaching infinity, the empirical state correlation and integrated response functions converge almost surely and uniformly in time, to the non-random unique strong solution of a pair of explicit non-linear integro-differential equations introduced by C…
▽ More
We study the Langevin dynamics for the family of spherical $p$-spin disordered mean-field models and prove that in the limit of system size $N$ approaching infinity, the empirical state correlation and integrated response functions converge almost surely and uniformly in time, to the non-random unique strong solution of a pair of explicit non-linear integro-differential equations introduced by Cugliandolo and Kurchan.
△ Less
Submitted 16 September, 2004;
originally announced September 2004.
-
Spectral measure of large random Hankel, Markov and Toeplitz matrices
Authors:
Włodzimierz Bryc,
Amir Dembo,
Tiefeng Jiang
Abstract:
We study the limiting spectral measure of large symmetric random matrices of linear algebraic structure. For Hankel and Toeplitz matrices generated by i.i.d. random variables $\{X_k\}$ of unit variance, and for symmetric Markov matrices generated by i.i.d. random variables $\{X_{ij}\}_{j>i}$ of zero mean and unit variance, scaling the eigenvalues by $\sqrt{n}$ we prove the almost sure, weak conv…
▽ More
We study the limiting spectral measure of large symmetric random matrices of linear algebraic structure. For Hankel and Toeplitz matrices generated by i.i.d. random variables $\{X_k\}$ of unit variance, and for symmetric Markov matrices generated by i.i.d. random variables $\{X_{ij}\}_{j>i}$ of zero mean and unit variance, scaling the eigenvalues by $\sqrt{n}$ we prove the almost sure, weak convergence of the spectral measures to universal, nonrandom, symmetric distributions $γ_H$, $γ_M$ and $γ_T$ of unbounded support. The moments of $γ_H$ and $γ_T$ are the sum of volumes of solids related to Eulerian numbers, whereas $γ_M$ has a bounded smooth density given by the free convolution of the semicircle and normal densities. For symmetric Markov matrices generated by i.i.d. random variables $\{X_{ij}\}_{j>i}$ of mean $m$ and finite variance, scaling the eigenvalues by ${n}$ we prove the almost sure, weak convergence of the spectral measures to the atomic measure at $-m$. If $m=0$, and the fourth moment is finite, we prove that the spectral norm of $\mathbf {M}_n$ scaled by $\sqrt{2n\log n}$ converges almost surely to 1.
△ Less
Submitted 27 February, 2006; v1 submitted 25 July, 2003;
originally announced July 2003.
-
A large-deviation theorem for tree-indexed Markov chains
Authors:
Amir Dembo,
Peter Morters,
Scott Sheffield
Abstract:
Given a finite typed rooted tree $T$ with $n$ vertices, the {\em empirical subtree measure} is the uniform measure on the $n$ typed subtrees of $T$ formed by taking all descendants of a single vertex. We prove a large deviation principle in $n$, with explicit rate function, for the empirical subtree measures of multitype Galton-Watson trees conditioned to have exactly $n$ vertices. In the proces…
▽ More
Given a finite typed rooted tree $T$ with $n$ vertices, the {\em empirical subtree measure} is the uniform measure on the $n$ typed subtrees of $T$ formed by taking all descendants of a single vertex. We prove a large deviation principle in $n$, with explicit rate function, for the empirical subtree measures of multitype Galton-Watson trees conditioned to have exactly $n$ vertices. In the process, we extend the notions of shift-invariance and specific relative entropy--as typically understood for Markov fields on deterministic graphs such as $\mathbb Z^d$--to Markov fields on random trees. We also develop single-generation empirical measure large deviation principles for a more general class of random trees including trees sampled uniformly from the set of all trees with $n$ vertices.
△ Less
Submitted 2 June, 2003;
originally announced June 2003.
-
Late points for random walks in two dimensions
Authors:
Amir Dembo,
Yuval Peres,
Jay Rosen,
Ofer Zeitouni
Abstract:
Let $\mathcal{T}_n(x)$ denote the time of first visit of a point $x$ on the lattice torus $\mathbb {Z}_n^2=\mathbb{Z}^2/n\mathbb{Z}^2$ by the simple random walk. The size of the set of $α$, $n$-late points $\mathcal{L}_n(α)=\{x\in \mathbb {Z}_n^2:\mathcal{T}_n(x)\geq α\frac{4}π(n\log n)^2\}$ is approximately $n^{2(1-α)}$, for $α\in (0,1)$ [$\mathcal{L}_n(α)$ is empty if $α>1$ and $n$ is large en…
▽ More
Let $\mathcal{T}_n(x)$ denote the time of first visit of a point $x$ on the lattice torus $\mathbb {Z}_n^2=\mathbb{Z}^2/n\mathbb{Z}^2$ by the simple random walk. The size of the set of $α$, $n$-late points $\mathcal{L}_n(α)=\{x\in \mathbb {Z}_n^2:\mathcal{T}_n(x)\geq α\frac{4}π(n\log n)^2\}$ is approximately $n^{2(1-α)}$, for $α\in (0,1)$ [$\mathcal{L}_n(α)$ is empty if $α>1$ and $n$ is large enough]. These sets have interesting clustering and fractal properties: we show that for $β\in (0,1)$, a disc of radius $n^β$ centered at nonrandom $x$ typically contains about $n^{2β(1-α/β^2)}$ points from $\mathcal{L}_n(α)$ (and is empty if $β<\sqrtα $), whereas choosing the center $x$ of the disc uniformly in $\mathcal{L}_n(α)$ boosts the typical number of $α, n$-late points in it to $n^{2β(1-α)}$. We also estimate the typical number of pairs of $α$, $n$-late points within distance $n^β$ of each other; this typical number can be significantly smaller than the expected number of such pairs, calculated by Brummelhuis and Hilhorst [Phys. A 176 (1991) 387--408]. On the other hand, our results show that the number of ordered pairs of late points within distance $n^β$ of each other is larger than what one might predict by multiplying the total number of late points, by the number of late points in a disc of radius $n^β$ centered at a typical late point.
△ Less
Submitted 27 February, 2006; v1 submitted 7 March, 2003;
originally announced March 2003.
-
Cover Times for Brownian Motion and Random Walks in Two Dimensions
Authors:
Amir Dembo,
Yuval Peres,
Jay Rosen,
Ofer Zeitouni
Abstract:
Let T(x,r) denote the first hitting time of the disc of radius r centered at x for Brownian motion on the two dimensional torus. We prove that sup_{x} T(x,r)/|log r|^2 --> 2/pi as r --> 0. The same applies to Brownian motion on any smooth, compact connected, two-dimensional, Riemannian manifold with unit area and no boundary. As a consequence, we prove a conjecture, due to Aldous (1989), that th…
▽ More
Let T(x,r) denote the first hitting time of the disc of radius r centered at x for Brownian motion on the two dimensional torus. We prove that sup_{x} T(x,r)/|log r|^2 --> 2/pi as r --> 0. The same applies to Brownian motion on any smooth, compact connected, two-dimensional, Riemannian manifold with unit area and no boundary. As a consequence, we prove a conjecture, due to Aldous (1989), that the number of steps it takes a simple random walk to cover all points of the lattice torus Z_n^2 is asymptotic to (2n log n)^2/pi. Determining these asymptotics is an essential step toward analyzing the fractal structure of the set of uncovered sites before coverage is complete; so far, this structure was only studied non-rigorously in the physics literature. We also establish a conjecture, due to Kesten and Revesz, that describes the asymptotics for the number of steps needed by simple random walk in Z^2 to cover the disc of radius n.
△ Less
Submitted 26 November, 2003; v1 submitted 26 July, 2001;
originally announced July 2001.
-
Aging properties of Sinai's model of random walk in random environment
Authors:
Amir Dembo,
Alice Guionnet,
Ofer Zeitouni
Abstract:
We study in this short note aging properties of Sinai's (nearest neighbour) random walk in random environment. With $\PP^o$ denoting the annealed law of the RWRE $X_n$, our main result is a full proof of the following statement due to P. Le Doussal, C. Monthus and D. S. Fisher:…
▽ More
We study in this short note aging properties of Sinai's (nearest neighbour) random walk in random environment. With $\PP^o$ denoting the annealed law of the RWRE $X_n$, our main result is a full proof of the following statement due to P. Le Doussal, C. Monthus and D. S. Fisher: $$\lim_{η\to0} \lim_{n\to\infty} \PP^o (\frac{|X_{n^h} - X_n|}{(\log n)^2} < η) = \frac{1}{h^2} [ {5/3} - {2/3} e^{-(h-1)} ]. $$
△ Less
Submitted 25 May, 2001;
originally announced May 2001.
-
Thick points for intersections of planar sample paths
Authors:
Amir Dembo,
Yuval peres,
Jay Rosen,
Ofer Zeitouni
Abstract:
Let $L_n^{X}(x)$ denote the number of visits to $x \in {\bf Z}^2$ of the simple planar random walk $X$, up till step $n$. Let $X'$ be another simple planar random walk independent of $X$. We show that for any $0<b<1/(2 π)$, there are $n^{1-2πb+o(1)}$ points $x \in {\bf Z}^2$ for which $L_n^{X}(x)L_n^{X'}(x)\geq b^2 (\log n)^4$. This is the discrete counterpart of our main result, that for any…
▽ More
Let $L_n^{X}(x)$ denote the number of visits to $x \in {\bf Z}^2$ of the simple planar random walk $X$, up till step $n$. Let $X'$ be another simple planar random walk independent of $X$. We show that for any $0<b<1/(2 π)$, there are $n^{1-2πb+o(1)}$ points $x \in {\bf Z}^2$ for which $L_n^{X}(x)L_n^{X'}(x)\geq b^2 (\log n)^4$. This is the discrete counterpart of our main result, that for any $a<1$, the Hausdorff dimension of the set of {\it thick intersection points} $x$ for which $\limsup_{r \to 0} {\mathcal I}(x,r)/(r^2|\log r|^4)=a^2$, is almost surely $2-2a$. Here ${\mathcal I}(x,r)$ is the projected intersection local time measure of the disc of radius $r$ centered at $x$ for two independent planar Brownian motions run till time 1. The proofs rely on a `multi-scale refinement' of the second moment method. In addition, we also consider analogous problems where we replace one of the Brownian motions by a transient stable process, or replace the disc of radius $r$ centered at $x$ by $x+rK$ for general sets $K$.
△ Less
Submitted 12 May, 2001;
originally announced May 2001.
-
Source Coding, Large Deviations, and Approximate Pattern Matching
Authors:
A. Dembo,
I. Kontoyiannis
Abstract:
We present a development of parts of rate-distortion theory and pattern- matching algorithms for lossy data compression, centered around a lossy version of the Asymptotic Equipartition Property (AEP). This treatment closely parallels the corresponding development in lossless compression, a point of view that was advanced in an important paper of Wyner and Ziv in 1989. In the lossless case we rev…
▽ More
We present a development of parts of rate-distortion theory and pattern- matching algorithms for lossy data compression, centered around a lossy version of the Asymptotic Equipartition Property (AEP). This treatment closely parallels the corresponding development in lossless compression, a point of view that was advanced in an important paper of Wyner and Ziv in 1989. In the lossless case we review how the AEP underlies the analysis of the Lempel-Ziv algorithm by viewing it as a random code and reducing it to the idealized Shannon code. This also provides information about the redundancy of the Lempel-Ziv algorithm and about the asymptotic behavior of several relevant quantities. In the lossy case we give various versions of the statement of the generalized AEP and we outline the general methodology of its proof via large deviations. Its relationship with Barron's generalized AEP is also discussed. The lossy AEP is applied to: (i) prove strengthened versions of Shannon's source coding theorem and universal coding theorems; (ii) characterize the performance of mismatched codebooks; (iii) analyze the performance of pattern- matching algorithms for lossy compression; (iv) determine the first order asymptotics of waiting times (with distortion) between stationary processes; (v) characterize the best achievable rate of weighted codebooks as an optimal sphere-covering exponent. We then present a refinement to the lossy AEP and use it to: (i) prove second order coding theorems; (ii) characterize which sources are easier to compress; (iii) determine the second order asymptotics of waiting times; (iv) determine the precise asymptotic behavior of longest match-lengths. Extensions to random fields are also given.
△ Less
Submitted 1 March, 2001;
originally announced March 2001.
-
Critical Behavior in Lossy Source Coding
Authors:
Amir Dembo,
Ioannis Kontoyiannis
Abstract:
The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to the optimal $R(D)$ bits/symbol is either $O(\sqrt{n})$ or $O(\log n)$. We show it is always $O(\sqrt{n})$, except for discrete, uniformly distributed sources.
The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to the optimal $R(D)$ bits/symbol is either $O(\sqrt{n})$ or $O(\log n)$. We show it is always $O(\sqrt{n})$, except for discrete, uniformly distributed sources.
△ Less
Submitted 1 September, 2000;
originally announced September 2000.
-
Random polynomials having few or no real zeros
Authors:
Amir Dembo,
Bjorn Poonen,
Qi-Man Shao,
Ofer Zeitouni
Abstract:
Consider a polynomial of large degree n whose coefficients are independent, identically distributed, nondegenerate random variables having zero mean and finite moments of all orders. We show that such a polynomial has exactly k real zeros with probability n^{-b+o(1)}$ as n --> infinity through integers of the same parity as the fixed integer k >= 0. In particular, the probability that a random p…
▽ More
Consider a polynomial of large degree n whose coefficients are independent, identically distributed, nondegenerate random variables having zero mean and finite moments of all orders. We show that such a polynomial has exactly k real zeros with probability n^{-b+o(1)}$ as n --> infinity through integers of the same parity as the fixed integer k >= 0. In particular, the probability that a random polynomial of large even degree n has no real zeros is n^{-b+o(1)}. The finite, positive constant b is characterized via the centered, stationary Gaussian process of correlation function sech(t/2). The value of b depends neither on k nor upon the specific law of the coefficients. Under an extra smoothness assumption about the law of the coefficients, with probability n^{-b+o(1)} one may specify also the approximate locations of the k zeros on the real line. The constant b is replaced by b/2 in case the i.i.d. coefficients have a nonzero mean.
△ Less
Submitted 15 June, 2000;
originally announced June 2000.