-
Central Limit Theorem for Bayesian Neural Network trained with Variational Inference
Authors:
Arnaud Descours,
Tom Huix,
Arnaud Guillin,
Manon Michel,
Éric Moulines,
Boris Nectoux
Abstract:
In this paper, we rigorously derive Central Limit Theorems (CLT) for Bayesian two-layerneural networks in the infinite-width limit and trained by variational inference on a regression task. The different networks are trained via different maximization schemes of the regularized evidence lower bound: (i) the idealized case with exact estimation of a multiple Gaussian integral from the reparametriza…
▽ More
In this paper, we rigorously derive Central Limit Theorems (CLT) for Bayesian two-layerneural networks in the infinite-width limit and trained by variational inference on a regression task. The different networks are trained via different maximization schemes of the regularized evidence lower bound: (i) the idealized case with exact estimation of a multiple Gaussian integral from the reparametrization trick, (ii) a minibatch scheme using Monte Carlo sampling, commonly known as Bayes-by-Backprop, and (iii) a computationally cheaper algorithm named Minimal VI. The latter was recently introduced by leveraging the information obtained at the level of the mean-field limit. Laws of large numbers are already rigorously proven for the three schemes that admits the same asymptotic limit. By deriving CLT, this work shows that the idealized and Bayes-by-Backprop schemes have similar fluctuation behavior, that is different from the Minimal VI one. Numerical experiments then illustrate that the Minimal VI scheme is still more efficient, in spite of bigger variances, thanks to its important gain in computational complexity.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Generalized Langevin and Nos{é}-Hoover processes absorbed at the boundary of a metastable domain
Authors:
Arnaud Guillin,
D I Lu,
Boris Nectoux,
Liming Wu
Abstract:
In this paper, we prove in a very weak regularity setting existence and uniqueness of quasi-stationary distributions as well as exponential convergence towards the quasi-stationary distribution for the generalized Langevin and the Nos{é}-Hoover processes, two processes which are widely used in molecular dynamics. The case of singular potentials is considered. With the techniques used in this work,…
▽ More
In this paper, we prove in a very weak regularity setting existence and uniqueness of quasi-stationary distributions as well as exponential convergence towards the quasi-stationary distribution for the generalized Langevin and the Nos{é}-Hoover processes, two processes which are widely used in molecular dynamics. The case of singular potentials is considered. With the techniques used in this work, we are also able to greatly improve existing results on quasi-stationary distributions for the kinetic Langevin process to a weak regularity setting.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Some remarks on the effect of the Random Batch Method on phase transition
Authors:
Arnaud Guillin,
Pierre Le Bris,
Pierre Monmarché
Abstract:
In this article, we focus on two toy models : the Curie-Weiss model and the system of $N$ particles in linear interactions in a double well confining potential. Both models, which have been extensively studied, describe a large system of particles with a mean-field limit that admits a phase transition. We are concerned with the numerical simulation of these particle systems. To deal with the quadr…
▽ More
In this article, we focus on two toy models : the Curie-Weiss model and the system of $N$ particles in linear interactions in a double well confining potential. Both models, which have been extensively studied, describe a large system of particles with a mean-field limit that admits a phase transition. We are concerned with the numerical simulation of these particle systems. To deal with the quadratic complexity of the numerical scheme, corresponding to the computation of the $O(N^2)$ interactions per time step, the Random Batch Method (RBM) has been suggested. It consists in randomly (and uniformly) dividing the particles into batches of size $p>1$, and computing the interactions only within each batch, thus reducing the numerical complexity to $O(Np)$ per time step. The convergence of this numerical method has been proved in other works.
This work is motivated by the observation that the RBM, via the random constructions of batches, artificially adds noise to the particle system. The goal of this article is to study the effect of this added noise on the phase transition of the nonlinear limit, and more precisely we study the effective dynamics of the two models to show how a phase transition may still be observed with the RBM but at a lower critical temperature.
△ Less
Submitted 3 August, 2023;
originally announced August 2023.
-
Law of Large Numbers for Bayesian two-layer Neural Network trained with Variational Inference
Authors:
Arnaud Descours,
Tom Huix,
Arnaud Guillin,
Manon Michel,
Éric Moulines,
Boris Nectoux
Abstract:
We provide a rigorous analysis of training by variational inference (VI) of Bayesian neural networks in the two-layer and infinite-width case. We consider a regression problem with a regularized evidence lower bound (ELBO) which is decomposed into the expected log-likelihood of the data and the Kullback-Leibler (KL) divergence between the a priori distribution and the variational posterior. With a…
▽ More
We provide a rigorous analysis of training by variational inference (VI) of Bayesian neural networks in the two-layer and infinite-width case. We consider a regression problem with a regularized evidence lower bound (ELBO) which is decomposed into the expected log-likelihood of the data and the Kullback-Leibler (KL) divergence between the a priori distribution and the variational posterior. With an appropriate weighting of the KL, we prove a law of large numbers for three different training schemes: (i) the idealized case with exact estimation of a multiple Gaussian integral from the reparametrization trick, (ii) a minibatch scheme using Monte Carlo sampling, commonly known as Bayes by Backprop, and (iii) a new and computationally cheaper algorithm which we introduce as Minimal VI. An important result is that all methods converge to the same mean-field limit. Finally, we illustrate our results numerically and discuss the need for the derivation of a central limit theorem.
△ Less
Submitted 10 July, 2023;
originally announced July 2023.
-
Necessary and sufficient symmetries in Event-Chain Monte Carlo with generalized flows and Application to hard dimers
Authors:
Tristan Guyon,
Arnaud Guillin,
Manon Michel
Abstract:
Event-Chain Monte Carlo methods generate continuous-time and non-reversible Markov processes which often display important accelerations compared to their reversible counterparts. However their generalization to any system may appear less straightforward. In this work, we build on the recent analytical characterization of such methods as generating Piecewise Deterministic Markov Processes (PDMP) t…
▽ More
Event-Chain Monte Carlo methods generate continuous-time and non-reversible Markov processes which often display important accelerations compared to their reversible counterparts. However their generalization to any system may appear less straightforward. In this work, we build on the recent analytical characterization of such methods as generating Piecewise Deterministic Markov Processes (PDMP) to clearly decipher the necessary symmetries the PDMP must obey from the sufficient ones which may prove to be too restrictive in a general setting. Thus, we derive a necessary rotational invariance of the probability flows and the minimum event rate, which identifies with the corresponding infinitesimal rejection rate. Such conditions always yield a correct ECMC scheme. We then generalize such results to the case of more general deterministic flows than the translational ones. In particular, we define two classes of interest of general flows, the ideal and uniform-ideal ones, which respectively suppresses or reduces the event rates. From there, we implement a complete non-reversible sampling of a systems of hard dimers, thanks to the introduction of rotational flows, which are uniform-ideal and shows a speed-up of up to ~3 compared to the state-of-the-art ECMC/Metropolis hybrid scheme.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
Jamming pair of general run-and-tumble particles: Exact results and universality classes
Authors:
Léo Hahn,
Arnaud Guillin,
Manon Michel
Abstract:
We consider a general system of two run-and-tumble particles interacting by hardcore jamming on the unidimensional torus. RTP are a paradigmatic active matter model, typically modeling the evolution of bacteria. By directly modeling the system at the continuous-space and -time level thanks to piecewise deterministic Markov processes (PDMP), we derive the conservation conditions which sets the inva…
▽ More
We consider a general system of two run-and-tumble particles interacting by hardcore jamming on the unidimensional torus. RTP are a paradigmatic active matter model, typically modeling the evolution of bacteria. By directly modeling the system at the continuous-space and -time level thanks to piecewise deterministic Markov processes (PDMP), we derive the conservation conditions which sets the invariant distribution and explicitly construct the two universality classes for the steady state, the detailed-jamming and the global-jamming classes. They respectively identify with the preservation or not of a detailed symmetry at the level of the dynamical internal states between probability flows entering and exiting jamming configurations. Thanks to a spectral analysis of the tumble kernel, we give explicit expressions for the invariant measure in the general case. The non-equilibrium features exhibited by the steady state includes positive mass for the jammed configurations and, for the global-jamming class, exponential decay and growth terms, potentially modulated by polynomial terms. Interestingly, we find that the invariant measure follows, away from jamming configurations, a catenary-like constraint, which results from the interplay between probability conservation and the dynamical skewness introduced by the jamming interactions, seen now as a boundary constraint. This work shows the powerful analytical approach PDMP provide for the study of the stationary behaviors of RTP sytems and motivates their future applications to larger systems, with the goal to derive microscopic conditions for motility-induced phase transitions.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
Fixed-kinetic Neural Hamiltonian Flows for enhanced interpretability and reduced complexity
Authors:
Vincent Souveton,
Arnaud Guillin,
Jens Jasche,
Guilhem Lavaux,
Manon Michel
Abstract:
Normalizing Flows (NF) are Generative models which are particularly robust and allow for exact sampling of the learned distribution. They however require the design of an invertible map**, whose Jacobian determinant has to be computable. Recently introduced, Neural Hamiltonian Flows (NHF) are based on Hamiltonian dynamics-based Flows, which are continuous, volume-preserving and invertible and th…
▽ More
Normalizing Flows (NF) are Generative models which are particularly robust and allow for exact sampling of the learned distribution. They however require the design of an invertible map**, whose Jacobian determinant has to be computable. Recently introduced, Neural Hamiltonian Flows (NHF) are based on Hamiltonian dynamics-based Flows, which are continuous, volume-preserving and invertible and thus make for natural candidates for robust NF architectures. In particular, their similarity to classical Mechanics could lead to easier interpretability of the learned map**. However, despite being Physics-inspired architectures, the originally introduced NHF architecture still poses a challenge to interpretability. For this reason, in this work, we introduce a fixed kinetic energy version of the NHF model. Inspired by physics, our approach improves interpretability and requires less parameters than previously proposed architectures. We then study the robustness of the NHF architectures to the choice of hyperparameters. We analyze the impact of the number of leapfrog steps, the integration time and the number of neurons per hidden layer, as well as the choice of prior distribution, on sampling a multimodal 2D mixture. The NHF architecture is robust to these choices, especially the fixed-kinetic energy model. Finally, we adapt NHF to the context of Bayesian inference and illustrate our method on sampling the posterior distribution of two cosmological parameters knowing type Ia supernovae observations.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
PDMP characterisation of event-chain Monte Carlo algorithms for particle systems
Authors:
Athina Monemvassitis,
Arnaud Guillin,
Manon Michel
Abstract:
Monte Carlo simulations of systems of particles such as hard spheres or soft spheres with singular kernels can display around a phase transition prohibitively long convergence times when using traditional Hasting-Metropolis reversible schemes. Efficient algorithms known as event-chain Monte Carlo were then developed to reach necessary accelerations. They are based on non-reversible continuous-time…
▽ More
Monte Carlo simulations of systems of particles such as hard spheres or soft spheres with singular kernels can display around a phase transition prohibitively long convergence times when using traditional Hasting-Metropolis reversible schemes. Efficient algorithms known as event-chain Monte Carlo were then developed to reach necessary accelerations. They are based on non-reversible continuous-time Markov processes. Proving invariance and ergodicity for such schemes cannot be done as for discrete-time schemes and a theoretical framework to do so was lacking, impeding the generalisation of ECMC algorithms to more sophisticated systems or processes. In this work, we characterize the Markov processes generated in ECMC as piecewise deterministic Markov processes. It first allows us to propose more general schemes, for instance regarding the direction refreshment. We then prove the invariance of the correct stationary distribution. Finally, we show the ergodicity of the processes in soft- and hard-sphere systems, with a density condition for the latter.
△ Less
Submitted 9 October, 2023; v1 submitted 23 August, 2022;
originally announced August 2022.
-
Law of large numbers and central limit theorem for wide two-layer neural networks: the mini-batch and noisy case
Authors:
Arnaud Descours,
Arnaud Guillin,
Manon Michel,
Boris Nectoux
Abstract:
In this work, we consider a wide two-layer neural network and study the behavior of its empirical weights under a dynamics set by a stochastic gradient descent along the quadratic loss with mini-batches and noise. Our goal is to prove a trajectorial law of large number as well as a central limit theorem for their evolution. When the noise is scaling as 1/N $β$ and 1/2 < $β$ $\le$ $\infty$, we rigo…
▽ More
In this work, we consider a wide two-layer neural network and study the behavior of its empirical weights under a dynamics set by a stochastic gradient descent along the quadratic loss with mini-batches and noise. Our goal is to prove a trajectorial law of large number as well as a central limit theorem for their evolution. When the noise is scaling as 1/N $β$ and 1/2 < $β$ $\le$ $\infty$, we rigorously derive and generalize the LLN obtained for example in [CRBVE20, MMM19, SS20b]. When 3/4 < $β$ $\le$ $\infty$, we also generalize the CLT (see also [SS20a]) and further exhibit the effect of mini-batching on the asymptotic variance which leads the fluctuations. The case $β$ = 3/4 is trickier and we give an example showing the divergence with time of the variance thus establishing the instability of the predictions of the neural network in this case. It is illustrated by simple numerical examples.
△ Less
Submitted 1 March, 2023; v1 submitted 26 July, 2022;
originally announced July 2022.
-
On systems of particles in singular repulsive interaction in dimension one : log and Riesz gas
Authors:
Arnaud Guillin,
Pierre Le Bris,
Pierre Monmarché
Abstract:
In this article, we prove the first quantitative uniform in time propagation of chaos for a class of systems of particles in singular repulsive interaction in dimension one that contains the Dyson Brownian motion. We start by establishing existence and uniqueness for the Riesz gases, before proving propagation of chaos with an original approach to the problem, namely coupling with a Cauchy sequenc…
▽ More
In this article, we prove the first quantitative uniform in time propagation of chaos for a class of systems of particles in singular repulsive interaction in dimension one that contains the Dyson Brownian motion. We start by establishing existence and uniqueness for the Riesz gases, before proving propagation of chaos with an original approach to the problem, namely coupling with a Cauchy sequence type argument. We also give a general argument to turn a result of weak propagation of chaos into a strong and uniform in time result using the long time behavior and some bounds on moments, in particular enabling us to get a uniform in time version of the result of Cépa-Lé**le.
△ Less
Submitted 22 April, 2022;
originally announced April 2022.
-
Sticky nonlinear SDEs and convergence of McKean-Vlasov equations without confinement
Authors:
Alain Durmus,
Andreas Eberle,
Arnaud Guillin,
Katharina Schuh
Abstract:
We develop a new approach to study the long time behaviour of solutions to nonlinear stochastic differential equations in the sense of McKean, as well as propagation of chaos for the corresponding mean-field particle system approximations. Our approach is based on a sticky coupling between two solutions to the equation. We show that the distance process between the two copies is dominated by a sol…
▽ More
We develop a new approach to study the long time behaviour of solutions to nonlinear stochastic differential equations in the sense of McKean, as well as propagation of chaos for the corresponding mean-field particle system approximations. Our approach is based on a sticky coupling between two solutions to the equation. We show that the distance process between the two copies is dominated by a solution to a one-dimensional nonlinear stochastic differential equation with a sticky boundary at zero. This new class of equations is then analyzed carefully. In particular, we show that the dominating equation has a phase transition. In the regime where the Dirac measure at zero is the only invariant probability measure, we prove exponential convergence to equilibrium both for the one-dimensional equation, and for the original nonlinear SDE. Similarly, propagation of chaos is shown by a componentwise sticky coupling and comparison with a system of one dimensional nonlinear SDEs with sticky boundaries at zero. The approach applies to equations without confinement potential and to interaction terms that are not of gradient type.
△ Less
Submitted 13 November, 2022; v1 submitted 19 January, 2022;
originally announced January 2022.
-
A journey with the integrated $γ$2 criterion and its weak forms
Authors:
Patrick Cattiaux,
Arnaud Guillin
Abstract:
As the title indicates this paper will describe several extensions and applications of the $Γ$2 integrated criterion introduced by M. Ledoux following ideas of B. Hellffer. We introduce general weak versions and show that they are equivalent to the weak Poincar{é} inequalities introduced by M. R{ö}ckner and F. Y. Wang. We also discuss special weak versions appropriate to the study of log-concave m…
▽ More
As the title indicates this paper will describe several extensions and applications of the $Γ$2 integrated criterion introduced by M. Ledoux following ideas of B. Hellffer. We introduce general weak versions and show that they are equivalent to the weak Poincar{é} inequalities introduced by M. R{ö}ckner and F. Y. Wang. We also discuss special weak versions appropriate to the study of log-concave measures and log-concave perturbations of product measures.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
Uniform in time propagation of chaos for the 2D vortex model and other singular stochastic systems
Authors:
Arnaud Guillin,
Pierre Le Bris,
Pierre Monmarché
Abstract:
In this article, we adapt the work of Jabin and Wang (2018) to show the first result of uniform in time propagation of chaos for a class of singular interaction kernels. In particular, our models contain the Biot-Savart kernel on the torus and thus the 2D vortex model.
In this article, we adapt the work of Jabin and Wang (2018) to show the first result of uniform in time propagation of chaos for a class of singular interaction kernels. In particular, our models contain the Biot-Savart kernel on the torus and thus the 2D vortex model.
△ Less
Submitted 4 October, 2023; v1 submitted 19 August, 2021;
originally announced August 2021.
-
Convergence rates for the Vlasov-Fokker-Planck equation and uniform in time propagation of chaos in non convex cases
Authors:
Arnaud Guillin,
Pierre Le Bris,
Pierre Monmarché
Abstract:
We prove the existence of a contraction rate for Vlasov-Fokker-Planck equation in Wasserstein distance, provided the interaction potential is (locally) Lipschitz continuous and the confining potential is both Lipschitz continuous and greater than a quadratic function, thus requiring no convexity conditions. Our strategy relies on coupling methods suggested by A. Eberle adapted to the kinetic setti…
▽ More
We prove the existence of a contraction rate for Vlasov-Fokker-Planck equation in Wasserstein distance, provided the interaction potential is (locally) Lipschitz continuous and the confining potential is both Lipschitz continuous and greater than a quadratic function, thus requiring no convexity conditions. Our strategy relies on coupling methods suggested by A. Eberle adapted to the kinetic setting enabling also to obtain uniform in time propagation of chaos in a non convex setting.
△ Less
Submitted 16 July, 2021; v1 submitted 19 May, 2021;
originally announced May 2021.
-
Discrete sticky couplings of functional autoregressive processes
Authors:
Alain Durmus,
Andreas Eberle,
Aurélien Enfroy,
Arnaud Guillin,
Pierre Monmarché
Abstract:
In this paper, we provide bounds in Wasserstein and total variation distances between the distributions of the successive iterates of two functional autoregressive processes with isotropic Gaussian noise of the form $Y_{k+1} = \mathrm{T}_γ(Y_k) + \sqrt{γσ^2} Z_{k+1}$ and $\tilde{Y}_{k+1} = \tilde{\mathrm{T}}_γ(\tilde{Y}_k) + \sqrt{γσ^2} \tilde{Z}_{k+1}$. More precisely, we give non-asymptotic boun…
▽ More
In this paper, we provide bounds in Wasserstein and total variation distances between the distributions of the successive iterates of two functional autoregressive processes with isotropic Gaussian noise of the form $Y_{k+1} = \mathrm{T}_γ(Y_k) + \sqrt{γσ^2} Z_{k+1}$ and $\tilde{Y}_{k+1} = \tilde{\mathrm{T}}_γ(\tilde{Y}_k) + \sqrt{γσ^2} \tilde{Z}_{k+1}$. More precisely, we give non-asymptotic bounds on $ρ(\mathcal{L}(Y_{k}),\mathcal{L}(\tilde{Y}_k))$, where $ρ$ is an appropriate weighted Wasserstein distance or a $V$-distance, uniformly in the parameter $γ$, and on $ρ(π_γ,\tildeπ_γ)$, where $π_γ$ and $\tildeπ_γ$ are the respective stationary measures of the two processes. The class of considered processes encompasses the Euler-Maruyama discretization of Langevin diffusions and its variants. The bounds we derive are of order $γ$ as $γ\to 0$. To obtain our results, we rely on the construction of a discrete sticky Markov chain $(W_k^{(γ)})_{k \in \mathbb{N}}$ which bounds the distance between an appropriate coupling of the two processes. We then establish stability and quantitative convergence results for this process uniformly on $γ$. In addition, we show that it converges in distribution to the continuous sticky process studied in previous work. Finally, we apply our result to Bayesian inference of ODE parameters and numerically illustrate them on two particular problems.
△ Less
Submitted 28 November, 2023; v1 submitted 14 April, 2021;
originally announced April 2021.
-
Functional inequalities for perturbed measures with applications to log-concave measures and to some Bayesian problems
Authors:
Patrick Cattiaux,
Arnaud Guillin
Abstract:
We study functional inequalities (Poincaré, Cheeger, log-Sobolev) for probability measures obtained as perturbations. Several explicit results for general measures as well as log-concave distributions are given.The initial goal of this work was to obtain explicit bounds on the constants in view of statistical applications for instance. These results are then applied to the Langevin Monte-Carlo me…
▽ More
We study functional inequalities (Poincaré, Cheeger, log-Sobolev) for probability measures obtained as perturbations. Several explicit results for general measures as well as log-concave distributions are given.The initial goal of this work was to obtain explicit bounds on the constants in view of statistical applications for instance. These results are then applied to the Langevin Monte-Carlo method used in statistics in order to compute Bayesian estimators.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Uniform long-time and propagation of chaos estimates for mean field kinetic particles in non-convex landscapes
Authors:
Arnaud Guillin,
Pierre Monmarché
Abstract:
Combining the results of [14] and [10], the trend to equilibrium in large time is studied for a large particle system associated to a Vlasov-Fokker-Planck equation. Under some conditions (that allow non-convex confining potentials) the convergence rate is proven to be independent from the number of particles. From this are derived uniform in time propagation of chaos estimates and an exponentially…
▽ More
Combining the results of [14] and [10], the trend to equilibrium in large time is studied for a large particle system associated to a Vlasov-Fokker-Planck equation. Under some conditions (that allow non-convex confining potentials) the convergence rate is proven to be independent from the number of particles. From this are derived uniform in time propagation of chaos estimates and an exponentially fast convergence for the nonlinear equation itself.
△ Less
Submitted 10 April, 2020; v1 submitted 2 March, 2020;
originally announced March 2020.
-
Self-improvement of the Bakry-Emery criterion for Poincar{é} inequalities and Wasserstein contraction using variable curvature bounds
Authors:
Patrick Cattiaux,
Max Fathi,
Arnaud Guillin
Abstract:
We study Poincar{é} inequalities and long-time behavior for diffusion processes on R^n under a variable curvature lower bound, in the sense of Bakry-Emery. We derive various estimates on the rate of convergence to equilibrium in L^1 optimal transport distance, as well as bounds on the constant in the Poincar{é} inequality in several situations of interest, including some where curvature may be neg…
▽ More
We study Poincar{é} inequalities and long-time behavior for diffusion processes on R^n under a variable curvature lower bound, in the sense of Bakry-Emery. We derive various estimates on the rate of convergence to equilibrium in L^1 optimal transport distance, as well as bounds on the constant in the Poincar{é} inequality in several situations of interest, including some where curvature may be negative. In particular, we prove a self-improvement of the Bakry-Emery estimate for Poincar{é} inequalities when curvature is positive but not constant.
△ Less
Submitted 21 February, 2020;
originally announced February 2020.
-
Poincar{é} and logarithmic sobolev inequalities for nearly radial measures
Authors:
Patrick Cattiaux,
Arnaud Guillin,
Liming Wu
Abstract:
If Poincar{é} inequality has been studied by Bobkov for radial measures, few is known about the logarithmic Sobolev inequalty in the radial case. We try to fill this gap here using different methods: Bobkov's argument and super-Poincar{é} inequalities, direct approach via L1-logarithmic Sobolev inequalities. We also give various examples where the obtained bounds are quite sharp. Recent bounds obt…
▽ More
If Poincar{é} inequality has been studied by Bobkov for radial measures, few is known about the logarithmic Sobolev inequalty in the radial case. We try to fill this gap here using different methods: Bobkov's argument and super-Poincar{é} inequalities, direct approach via L1-logarithmic Sobolev inequalities. We also give various examples where the obtained bounds are quite sharp. Recent bounds obtained by Lee-Vempala in the logconcave bounded case are refined for radial measures.
△ Less
Submitted 23 December, 2019;
originally announced December 2019.
-
The Kinetic Fokker-planck Equation With Mean Field Interaction
Authors:
Arnaud Guillin,
Wei Liu,
Liming Wu,
Chaoen Zhang
Abstract:
We study the long time behaviour of the kinetic Fokker-Planck equation with mean field interaction, whose limit is often called Vlasov-Fkker-Planck equation. We prove a uniform (in the number of particles) exponential convergence to equilibrium for the solutions in the weighted Sobolev space H 1 ($μ$) with a rate of convergence which is explicitly computable and independent of the number of partic…
▽ More
We study the long time behaviour of the kinetic Fokker-Planck equation with mean field interaction, whose limit is often called Vlasov-Fkker-Planck equation. We prove a uniform (in the number of particles) exponential convergence to equilibrium for the solutions in the weighted Sobolev space H 1 ($μ$) with a rate of convergence which is explicitly computable and independent of the number of particles. The originality of the proof relies on functional inequalities and hypocoercivity with Lyapunov type conditions, usually not suitable to provide adimensional results.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
Persistence in the Moran model with random switching
Authors:
Arnaud Guillin,
Arnaud Personne,
Edouard Strickler
Abstract:
The paper is devoted to the study of the asymptotic behaviour of Moran process in random environment, say random selection. In finite population, the Moran process may be degenerate in finite time, thus we will study its limiting process in large population which is a Piecewise Deterministic Markov Process, when the random selection is a Markov jump process. We will then study its long time behavi…
▽ More
The paper is devoted to the study of the asymptotic behaviour of Moran process in random environment, say random selection. In finite population, the Moran process may be degenerate in finite time, thus we will study its limiting process in large population which is a Piecewise Deterministic Markov Process, when the random selection is a Markov jump process. We will then study its long time behaviour via the stochastic persistence theory of Benaïm \cite{benaimpersistence}. It will enable us to show that persistence can occur, i.e. asymptotic coexistence of all species, when there are enough switching possibilities. This is true even if one species has never a predominant selection.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
Uniform Poincar{é} and logarithmic Sobolev inequalities for mean field particles systems
Authors:
Arnaud Guillin,
Wei Liu,
Liming Wu,
Chaoen Zhang
Abstract:
In this paper we establish some explicit and sharp estimates of the spectral gap and the log-Sobolev constant for mean field particles system, uniform in the number of particles, when the confinement potential have many local minimums. Our uniform log-Sobolev inequality, based on Zegarlinski's theorem for Gibbs measures, allows us to obtain the exponential convergence in entropy of the McKean-Vlas…
▽ More
In this paper we establish some explicit and sharp estimates of the spectral gap and the log-Sobolev constant for mean field particles system, uniform in the number of particles, when the confinement potential have many local minimums. Our uniform log-Sobolev inequality, based on Zegarlinski's theorem for Gibbs measures, allows us to obtain the exponential convergence in entropy of the McKean-Vlasov equation with an explicit rate constant, generalizing the result of [10] by means of the displacement convexity approach, or [19, 20] by Bakry-Emery technique or the recent [9] by dissipation of the Wasserstein distance.
△ Less
Submitted 16 September, 2019;
originally announced September 2019.
-
When Can The Discrete Moran Process May Bereplaced By Wright-fisher Diffusion?
Authors:
Gorgui Gackou,
A Guillin,
Arnaud Personne
Abstract:
The Moran discrete process and the Wright-Fisher modelare the most popular models in population genetics. It is common tounderstand the dynamics of these models to use an approximating diffusionprocess, called Wright-Fisher diffusion. Here, we give a quantitativelarge population limit of the error committed by using the approximationdiffusion in the presence of weak selection and weak immigrationi…
▽ More
The Moran discrete process and the Wright-Fisher modelare the most popular models in population genetics. It is common tounderstand the dynamics of these models to use an approximating diffusionprocess, called Wright-Fisher diffusion. Here, we give a quantitativelarge population limit of the error committed by using the approximationdiffusion in the presence of weak selection and weak immigrationin one dimension. The approach is robust enough to consider the casewhere selection and immigration are Markovian processes, with limitsjump or diffusion processes.
△ Less
Submitted 10 May, 2019;
originally announced May 2019.
-
On the Poincar{é} constant of log-concave measures
Authors:
Patrick Cattiaux,
Arnaud Guillin
Abstract:
The goal of this paper is to push forward the study of those properties of log-concave measures that help to estimate their Poincar{é} constant. First we revisit E. Milman's result [40] on the link between weak (Poincar{é} or concentration) inequalities and Cheeger's inequality in the logconcave cases, in particular extending localization ideas and a result of Latala, as well as providing a simple…
▽ More
The goal of this paper is to push forward the study of those properties of log-concave measures that help to estimate their Poincar{é} constant. First we revisit E. Milman's result [40] on the link between weak (Poincar{é} or concentration) inequalities and Cheeger's inequality in the logconcave cases, in particular extending localization ideas and a result of Latala, as well as providing a simpler proof of the nice Poincar{é} (dimensional) bound in the inconditional case. Then we prove alternative transference principle by concentration or using various distances (total variation, Wasserstein). A mollification procedure is also introduced enabling, in the logconcave case, to reduce to the case of the Poincar{é} inequality for the mollified measure. We finally complete the transference section by the comparison of various probability metrics (Fortet-Mourier, bounded-Lipschitz,...).
△ Less
Submitted 19 October, 2018;
originally announced October 2018.
-
On the Simpson index for the Moran process with random selection and immigration
Authors:
Arnaud Personne,
Arnaud Guillin,
Franck Jabot,
Arnaud Guillin
Abstract:
Moran or Wright-Fisher processes are probably the most well known model to study the evolution of a population under various effects. Our object of study will be the Simpson index which measures the level of diversity of the population, one of the key parameter for ecologists who study for example forest dynamics. Following ecological motivations, we will consider here the case where there are var…
▽ More
Moran or Wright-Fisher processes are probably the most well known model to study the evolution of a population under various effects. Our object of study will be the Simpson index which measures the level of diversity of the population, one of the key parameter for ecologists who study for example forest dynamics. Following ecological motivations, we will consider here the case where there are various species with fitness and immigration parameters being random processes (and thus time evolving). To measure biodiversity, ecologists generally use the Simpson index, who has no closed formula, except in the neutral (no selection) case via a backward approach, and which is difficult to evaluate even numerically when the population size is large. Our approach relies on the large population limit in the "weak" selection case, and thus to give a procedure which enable us to approximate, with controlled rate, the expectation of the Simpson index at fixed time. Our approach will be forward and valid for all time, which is the main difference with the historical approach of Kingman, or Krone-Neuhauser. We will also study the long time behaviour of the Wright-Fisher process in a simplified setting, allowing us to get a full picture for the approximation of the expectation of the Simpson index.
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
Piecewise Deterministic Markov Processes and their invariant measures
Authors:
Alain Durmus,
Arnaud Guillin,
Pierre Monmarché
Abstract:
Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which implies quantitative bounds on the total variation between the marginal distributions of the two processes. Finally two results are established regarding the inva…
▽ More
Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which implies quantitative bounds on the total variation between the marginal distributions of the two processes. Finally two results are established regarding the invariant measures of PDMPs. A practical condition to show that a probability measure is invariant for the associated PDMP semi-group is presented. In a second time, a bound on the invariant probability measures in $V$-norm of two PDMPs following the same differential flow is established. This last result is then applied to study the asymptotic bias of some non-exact PDMP MCMC methods.
△ Less
Submitted 2 August, 2021; v1 submitted 14 July, 2018;
originally announced July 2018.
-
Geometric ergodicity of the bouncy particle sampler
Authors:
Alain Durmus,
Arnaud Guillin,
Pierre Monmarché
Abstract:
The Bouncy Particle Sampler (BPS) is a Monte Carlo Markov Chain algorithm to sample from a target density known up to a multiplicative constant. This method is based on a kinetic piecewise deterministic Markov process for which the target measure is invariant. This paper deals with theoretical properties of BPS. First, we establish geometric ergodicity of the associated semi-group under weaker con…
▽ More
The Bouncy Particle Sampler (BPS) is a Monte Carlo Markov Chain algorithm to sample from a target density known up to a multiplicative constant. This method is based on a kinetic piecewise deterministic Markov process for which the target measure is invariant. This paper deals with theoretical properties of BPS. First, we establish geometric ergodicity of the associated semi-group under weaker conditions than in [10] both on the target distribution and the velocity probability distribution. This result is based on a new coupling of the process which gives a quantitative minorization condition and yields more insights on the convergence. In addition, we study on a toy model the dependency of the convergence rates on the dimension of the state space. Finally, we apply our results to the analysis of simulated annealing algorithms based on BPS.
△ Less
Submitted 15 November, 2019; v1 submitted 14 July, 2018;
originally announced July 2018.
-
An Elementary Approach To Uniform In Time Propagation Of Chaos
Authors:
Alain Durmus,
Andreas Eberle,
Arnaud Guillin,
Raphael Zimmer
Abstract:
Based on a coupling approach, we prove uniform in time propagation of chaos for weakly interacting mean-field particle systems with possibly non-convex confinement and interaction potentials. The approach is based on a combination of reflection and synchronous couplings applied to the individual particles. It provides explicit quantitative bounds that significantly extend previous results for the…
▽ More
Based on a coupling approach, we prove uniform in time propagation of chaos for weakly interacting mean-field particle systems with possibly non-convex confinement and interaction potentials. The approach is based on a combination of reflection and synchronous couplings applied to the individual particles. It provides explicit quantitative bounds that significantly extend previous results for the convex case.
△ Less
Submitted 29 May, 2018;
originally announced May 2018.
-
Entropic multipliers method for langevin diffusion and weighted log sobolev inequalities
Authors:
Patrick Cattiaux,
Arnaud Guillin,
Pierre Monmarché,
Chaoen Zhang
Abstract:
In his work about hypocercivity, Villani [18] considers in particular convergence to equilibrium for the kinetic Langevin process. While his convergence results in L 2 are given in a quite general setting, convergence in entropy requires some boundedness condition on the Hessian of the Hamiltonian. We will show here how to get rid of this assumption in the study of the hypocoercive entropic relaxa…
▽ More
In his work about hypocercivity, Villani [18] considers in particular convergence to equilibrium for the kinetic Langevin process. While his convergence results in L 2 are given in a quite general setting, convergence in entropy requires some boundedness condition on the Hessian of the Hamiltonian. We will show here how to get rid of this assumption in the study of the hypocoercive entropic relaxation to equilibrium for the Langevin diffusion. Our method relies on a generalization to entropy of the multipliers method and an adequate functional inequality. As a byproduct, we also give tractable conditions for this functional inequality, which is a particular instance of a weighted logarithmic Sobolev inequality, to hold.
△ Less
Submitted 3 August, 2017;
originally announced August 2017.
-
Couplings and quantitative contraction rates for Langevin dynamics
Authors:
Andreas Eberle,
Arnaud Guillin,
Raphael Zimmer
Abstract:
We introduce a new probabilistic approach to quantify convergence to equilibrium for (kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the associated kinetic Fokker-Planck equation, our approach is based on a specific combination of reflection and synchronous coupling of two solutions of the Langevin equation. It yields contractions in a particular Wasserstein…
▽ More
We introduce a new probabilistic approach to quantify convergence to equilibrium for (kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the associated kinetic Fokker-Planck equation, our approach is based on a specific combination of reflection and synchronous coupling of two solutions of the Langevin equation. It yields contractions in a particular Wasserstein distance, and it provides rather precise bounds for convergence to equilibrium at the borderline between the overdamped and the underdamped regime. In particular, we are able to recover kinetic behavior in terms of explicit lower bounds for the contraction rate. For example, for a rescaled double-well potential with local minima at distance $a$, we obtain a lower bound for the contraction rate of order $Ω(a^{-1})$ provided the friction coefficient is of order $Θ(a^{-1})$.
△ Less
Submitted 29 June, 2018; v1 submitted 5 March, 2017;
originally announced March 2017.
-
New sharp Gagliardo-Nirenberg-Sobolev inequalities and an improved Borell-Brascamp-Lieb inequality
Authors:
François Bolley,
Dario Cordero-Erausquin,
Yasuhiro Fujita,
Ivan Gentil,
Arnaud Guillin
Abstract:
We propose a new Borell-Brascamp-Lieb inequality which leads to novel sharp Euclidean inequalities such as Gagliardo-Nirenberg-Sobolev inequalities in R^n and in the half-space R^n\_+. This gives a new bridge between the geometric pont of view of the Brunn-Minkowski inequality and the functional point of view of the Sobolev type inequalities. In this way we unify, simplify and results by S. Bobkov…
▽ More
We propose a new Borell-Brascamp-Lieb inequality which leads to novel sharp Euclidean inequalities such as Gagliardo-Nirenberg-Sobolev inequalities in R^n and in the half-space R^n\_+. This gives a new bridge between the geometric pont of view of the Brunn-Minkowski inequality and the functional point of view of the Sobolev type inequalities. In this way we unify, simplify and results by S. Bobkov-M. Ledoux, M. del Pino-J. Dolbeault and B. Nazaret.
△ Less
Submitted 10 February, 2017;
originally announced February 2017.
-
Particles Systems and Numerical Schemes for Mean Reflected Stochastic Differential Equations
Authors:
Philippe Briand,
Paul-Éric Chaudru de Raynal,
Arnaud Guillin,
Céline Labart
Abstract:
This paper is devoted to the study of reflected Stochastic Differential Equations when the constraint is not on the paths of the solution but acts on the law of the solution. These reflected equations have been introduced recently by Briand, Elie and Hu (arXiv:1605.06301) in the context of risk measures. Our main objective is to provide an approximation of solutions to these reflected SDEs with th…
▽ More
This paper is devoted to the study of reflected Stochastic Differential Equations when the constraint is not on the paths of the solution but acts on the law of the solution. These reflected equations have been introduced recently by Briand, Elie and Hu (arXiv:1605.06301) in the context of risk measures. Our main objective is to provide an approximation of solutions to these reflected SDEs with the help of interacting particles systems. This approximation allows to design a numerical scheme for this kind of equations.
△ Less
Submitted 6 March, 2017; v1 submitted 20 December, 2016;
originally announced December 2016.
-
Moderate deviations for bipower variation of general function and Hayashi-Yoshida estimators
Authors:
Hacène Djellout,
Arnaud Guillin,
Hui Jiang,
Yacouba Samoura
Abstract:
We consider the moderate deviations behaviors for two (co-) volatility estima-tors: generalised bipower variation, Hayashi-Yoshida estimator. The results are obtained by using a new result about the moderate deviations principle for m-dependent random variables based on the Chen-Ledoux type condition. In the last decade there has been a considerable development of the asymptotic theory for process…
▽ More
We consider the moderate deviations behaviors for two (co-) volatility estima-tors: generalised bipower variation, Hayashi-Yoshida estimator. The results are obtained by using a new result about the moderate deviations principle for m-dependent random variables based on the Chen-Ledoux type condition. In the last decade there has been a considerable development of the asymptotic theory for processes observed at a high frequency. This was mainly motivated by financial applications , where the data, such as stock prices or currencies, are observed very frequently. As under the no-arbitrage assumptions price processes must follow a semimartingale, there was a need for probabilistic tools for functionals of semimartingales based on high frequency observations. Inspired by potential applications, probabilists started to develop limit theorems for semimartingales. Statisticians applied the asymptotic theory to analyze the path properties of discretely observed semimartingales: for the estimation of certain volatility functionals and realised jumps, or for performing various test procedures. We consider X t = (X 1,t , X 2,t) t$\in$[0,T ] a 2-dimensional semimartingale, defined on the filtred probability space ($Ω$, F , (F t) [0,T ] , P), of the form
△ Less
Submitted 3 February, 2017; v1 submitted 13 September, 2016;
originally announced September 2016.
-
Quantitative Harris type theorems for diffusions and McKean-Vlasov processes
Authors:
Andreas Eberle,
Arnaud Guillin,
Raphael Zimmer
Abstract:
We consider $\mathbb{R}^d$-valued diffusion processes of type
\begin{align*}
dX_t\ =\ b(X_t)dt\, +\, dB_t.
\end{align*} Assuming a geometric drift condition, we establish contractions of the transitions kernels in Kantorovich ($L^1$ Wasserstein) distances with explicit constants. Our results are in the spirit of Hairer and Mattingly's extension of Harris' Theorem. In particular, they do not…
▽ More
We consider $\mathbb{R}^d$-valued diffusion processes of type
\begin{align*}
dX_t\ =\ b(X_t)dt\, +\, dB_t.
\end{align*} Assuming a geometric drift condition, we establish contractions of the transitions kernels in Kantorovich ($L^1$ Wasserstein) distances with explicit constants. Our results are in the spirit of Hairer and Mattingly's extension of Harris' Theorem. In particular, they do not rely on a small set condition. Instead we combine Lyapunov functions with reflection coupling and concave distance functions. We retrieve constants that are explicit in parameters which can be computed with little effort from one-sided Lipschitz conditions for the drift coefficient and the growth of a chosen Lyapunov function. Consequences include exponential convergence in weighted total variation norms, gradient bounds, bounds for ergodic averages, and Kantorovich contractions for nonlinear McKean-Vlasov diffusions in the case of sufficiently weak but not necessarily bounded nonlinearities. We also establish quantitative bounds for sub-geometric ergodicity assuming a sub-geometric drift condition.
△ Less
Submitted 9 October, 2017; v1 submitted 20 June, 2016;
originally announced June 2016.
-
Optimal linear drift for the speed of convergence of an hypoelliptic diffusion
Authors:
Arnaud Guillin,
Pierre Monmarché
Abstract:
Among all generalized Ornstein-Uhlenbeck processes which sample the same invariant measure and for which the same amount of randomness (a $N$-dimensional Brownian motion) is injected in the system, we prove that the asymptotic rate of convergence is maximized by a non-reversible hypoelliptic one.
Among all generalized Ornstein-Uhlenbeck processes which sample the same invariant measure and for which the same amount of randomness (a $N$-dimensional Brownian motion) is injected in the system, we prove that the asymptotic rate of convergence is maximized by a non-reversible hypoelliptic one.
△ Less
Submitted 5 October, 2021; v1 submitted 25 April, 2016;
originally announced April 2016.
-
Hitting times, functional inequalities, lyapunov conditions and uniform ergodicity
Authors:
Patrick Cattiaux,
Arnaud Guillin
Abstract:
The use of Lyapunov conditions for proving functional inequalities was initiated in [5]. It was shown in [4, 30] that there is an equivalence between a Poincar{é} inequality, the existence of some Lyapunov function and the exponential integrability of hitting times. In the present paper, we close the scheme of the interplay between Lyapunov conditions and functional inequalities by $\bullet$ showi…
▽ More
The use of Lyapunov conditions for proving functional inequalities was initiated in [5]. It was shown in [4, 30] that there is an equivalence between a Poincar{é} inequality, the existence of some Lyapunov function and the exponential integrability of hitting times. In the present paper, we close the scheme of the interplay between Lyapunov conditions and functional inequalities by $\bullet$ showing that strong functional inequalities are equivalent to Lyapunov type conditions; $\bullet$ showing that these Lyapunov conditions are characterized by the finiteness of generalized exponential moments of hitting times. We also give some complement concerning the link between Lyapunov conditions and in-tegrability property of the invariant probability measure and as such transportation inequalities , and we show that some "unbounded Lyapunov conditions" can lead to uniform ergodicity, and coming down from infinity property.
△ Less
Submitted 21 April, 2016;
originally announced April 2016.
-
Equivalence between dimensional contractions in Wasserstein distance and the curvature-dimension condition
Authors:
François Bolley,
Ivan Gentil,
Arnaud Guillin,
Kazumasa Kuwada
Abstract:
The curvature-dimension condition is a generalization of the Bochner inequality to weighted Riemannian manifolds and general metric measure spaces. It is now known to be equivalent to evolution variational inequalities for the heat semigroup, and quadratic Wasserstein distance contraction properties at different times. On the other hand, in a compact Riemannian manifold, it implies a same-time Was…
▽ More
The curvature-dimension condition is a generalization of the Bochner inequality to weighted Riemannian manifolds and general metric measure spaces. It is now known to be equivalent to evolution variational inequalities for the heat semigroup, and quadratic Wasserstein distance contraction properties at different times. On the other hand, in a compact Riemannian manifold, it implies a same-time Wasserstein contraction property for this semigroup. In this work we generalize the latter result to metric measure spaces and more importantly prove the converse: contraction inequalities are equivalent to curvature-dimension conditions. Links with functional inequalities are also investigated.
△ Less
Submitted 27 October, 2015;
originally announced October 2015.
-
From a Kac-like particle system to the Landau equation for hard potentials and Maxwell molecules
Authors:
Nicolas Fournier,
Arnaud Guillin
Abstract:
We prove a quantitative result of convergence of a conservative stochastic particle system to the solution of the homogeneous Landau equation for hard potentials. There are two main difficulties: (i) the known stability results for this class of Landau equations concern regular solutions and seem difficult to extend to study the rate of convergence of some empirical measures; (ii) the conservative…
▽ More
We prove a quantitative result of convergence of a conservative stochastic particle system to the solution of the homogeneous Landau equation for hard potentials. There are two main difficulties: (i) the known stability results for this class of Landau equations concern regular solutions and seem difficult to extend to study the rate of convergence of some empirical measures; (ii) the conservativeness of the particle system is an obstacle for (approximate) independence. To overcome (i), we prove a new stability result for the Landau equation for hard potentials concerning very general measure solutions. Due to (ii), we have to couple, our particle system with some non independent nonlinear processes, of which the law solves, in some sense, the Landau equation. We then prove that these nonlinear processes are not so far from being independent. Using finally some ideas of Rousset [25], we show that in the case of Maxwell molecules, the convergence of the particle system is uniform in time.
△ Less
Submitted 5 October, 2015;
originally announced October 2015.
-
Dimensional improvements of the logarithmic Sobolev, Talagrand and Brascamp-Lieb inequalities
Authors:
François Bolley,
Ivan Gentil,
Arnaud Guillin
Abstract:
In this work we consider dimensional improvements of the logarithmic Sobolev, Talagrand and Brascamp-Lieb inequalities. For this we use optimal transport methods and the Borell-Brascamp-Lieb inequality. These refinements can be written as a deficit in the classical inequalities. They have the right scale with respect to the dimension. They lead to sharpened concentration properties as well as refi…
▽ More
In this work we consider dimensional improvements of the logarithmic Sobolev, Talagrand and Brascamp-Lieb inequalities. For this we use optimal transport methods and the Borell-Brascamp-Lieb inequality. These refinements can be written as a deficit in the classical inequalities. They have the right scale with respect to the dimension. They lead to sharpened concentration properties as well as refined contraction bounds, convergence to equilibrium and short time behaviour for the laws of solutions to stochastic differential equations.
△ Less
Submitted 15 March, 2017; v1 submitted 4 July, 2015;
originally announced July 2015.
-
Transportation cost-information and concentration inequalities for bifurcating Markov chains
Authors:
Siméon Valère Bitseki Penda,
Mikael Escobar-Bach,
Arnaud Guillin
Abstract:
We investigate the transportation cost-information inequalities for bifurcating Markov chains which are a class of processes indexed by binary tree. These processes provide models for cell growth when each individual in one generation gives birth to two offsprings in the next one. Transportation cost inequalities provide useful concentra-tion inequalities. We also study deviation inequalities for…
▽ More
We investigate the transportation cost-information inequalities for bifurcating Markov chains which are a class of processes indexed by binary tree. These processes provide models for cell growth when each individual in one generation gives birth to two offsprings in the next one. Transportation cost inequalities provide useful concentra-tion inequalities. We also study deviation inequalities for the empiri-cal means under relaxed assumptions on the Wasserstein contraction of the Markov kernels. Applications to bifurcating non linear autore-gressive processes are considered: deviation inequalities for pointwise estimates of the non linear leading functions.
△ Less
Submitted 27 January, 2015;
originally announced January 2015.
-
Large deviations of the realized (co-)volatility vector
Authors:
Hacène Djellout,
Arnaud Guillin,
Yacouba Samoura
Abstract:
Realized statistics based on high frequency returns have become very popular in financial economics. In recent years, different non-parametric estimators of the variation of a log-price process have appeared. These were developed by many authors and were motivated by the existence of complete records of price data. Among them are the realized quadratic (co-)variation which is perhaps the most wel…
▽ More
Realized statistics based on high frequency returns have become very popular in financial economics. In recent years, different non-parametric estimators of the variation of a log-price process have appeared. These were developed by many authors and were motivated by the existence of complete records of price data. Among them are the realized quadratic (co-)variation which is perhaps the most well known example, providing a consistent estimator of the integrated (co-)volatility when the logarithmic price process is continuous. Limit results such as the weak law of large numbers or the central limit theorem have been proved in different contexts. In this paper, we propose to study the large deviation properties of realized (co-)volatility (i.e., when the number of high frequency observations in a fixed time interval increases to infinity. More specifically, we consider a bivariate model with synchronous observation schemes and correlated Brownian motions of the following form: $dX\_{\ell,t} = σ\_{\ell,t}dB\_{\ell,t}+b\_{\ell}(t,ω)dt$ for $\ell=1,2$, where $X\_{\ell}$ denotes the log-price, we are concerned with the large deviation estimation of the vector $V\_t^n(X)=(Q\_{1,t}^n(X), Q\_{2,t}^n(X), C\_{t}^n(X))$ where $Q\_{\ell,t}^n(X)$ and $C\_{t}^n(X)$ represente the estimator of the quadratic variational processes $Q\_{\ell,t}=\int\_0^tσ\_{\ell,s}^2ds$ and the integrated covariance $C\_t=\int\_0^tσ\_{1,s}σ\_{2,s}ρ\_sds$ respectively, with $ρ\_t=cov(B\_{1,t}, B\_{2,t})$. Our main motivation is to improve upon the existing limit theorems. Our large deviations results can be used to evaluate and approximate tail probabilities of realized (co-)volatility. As an application we provide the large deviation for the standard dependence measures between the two assets returns such as the realized regression coefficients up to time $t$, or the realized correlation. Our study should contribute to the recent trend of research on the (co-)variance estimation problems, which are quite often discussed in high-frequency financial data analysis.
△ Less
Submitted 19 November, 2014;
originally announced November 2014.
-
On the rate of convergence in Wasserstein distance of the empirical measure
Authors:
Nicolas Fournier,
Arnaud Guillin
Abstract:
Let $μ_N$ be the empirical measure associated to a $N$-sample of a given probability distribution $μ$ on $\mathbb{R}^d$. We are interested in the rate of convergence of $μ_N$ to $μ$, when measured in the Wasserstein distance of order $p>0$. We provide some satisfying non-asymptotic $L^p$-bounds and concentration inequalities, for any values of $p>0$ and $d\geq 1$. We extend also the non asymptotic…
▽ More
Let $μ_N$ be the empirical measure associated to a $N$-sample of a given probability distribution $μ$ on $\mathbb{R}^d$. We are interested in the rate of convergence of $μ_N$ to $μ$, when measured in the Wasserstein distance of order $p>0$. We provide some satisfying non-asymptotic $L^p$-bounds and concentration inequalities, for any values of $p>0$ and $d\geq 1$. We extend also the non asymptotic $L^p$-bounds to stationary $ρ$-mixing sequences, Markov chains, and to some interacting particle systems.
△ Less
Submitted 7 December, 2013;
originally announced December 2013.
-
Non ultracontractive heat kernel bounds by Lyapunov conditions
Authors:
François Bolley,
Arnaud Guillin,
Xinyu Wang
Abstract:
Nash and Sobolev inequalities are known to be equivalent to ultracontractive properties of heat-like Markov semigroups, hence to uniform on-diagonal bounds on their kernel densities. In non ultracontractive settings, such bounds can not hold, and (necessarily weaker, non uniform) bounds on the semigroups can be derived by means of weighted Nash (or super-Poincaré) inequalities. The purpose of this…
▽ More
Nash and Sobolev inequalities are known to be equivalent to ultracontractive properties of heat-like Markov semigroups, hence to uniform on-diagonal bounds on their kernel densities. In non ultracontractive settings, such bounds can not hold, and (necessarily weaker, non uniform) bounds on the semigroups can be derived by means of weighted Nash (or super-Poincaré) inequalities. The purpose of this note is to show how to check these weighted Nash inequalities in concrete examples, in a very simple and general manner. We also deduce off-diagonal bounds for the Markov kernels of the semigroups, refining E. B. Davies' original argument.
△ Less
Submitted 25 July, 2014; v1 submitted 9 November, 2013;
originally announced November 2013.
-
Ornstein-Uhlenbeck pinball: I. Poincaré inequalities in a punctured domain
Authors:
Emmanuel Boissard,
Patrick Cattiaux,
Arnaud Guillin,
Laurent Miclo
Abstract:
In this paper we study the Poincaré constant for the Gaussian measure restricted to $D=\R^d - B(y,r)$ where $B(y,r)$ denotes the Euclidean ball with center $y$ and radius $r$, and $d\geq 2$. We also study the case of the $l^\infty$ ball (the hypercube). This is the first step in the study of the asymptotic behavior of a $d$-dimensional Ornstein-Uhlenbeck process in the presence of obstacles with e…
▽ More
In this paper we study the Poincaré constant for the Gaussian measure restricted to $D=\R^d - B(y,r)$ where $B(y,r)$ denotes the Euclidean ball with center $y$ and radius $r$, and $d\geq 2$. We also study the case of the $l^\infty$ ball (the hypercube). This is the first step in the study of the asymptotic behavior of a $d$-dimensional Ornstein-Uhlenbeck process in the presence of obstacles with elastic normal reflections (the Ornstein-Uhlenbeck pinball) we shall study in a companion paper.
△ Less
Submitted 4 September, 2013;
originally announced September 2013.
-
Dimensional contraction via Markov transportation distance
Authors:
François Bolley,
Ivan Gentil,
Arnaud Guillin
Abstract:
It is now well known that curvature conditions à la Bakry-Emery are equivalent to contraction properties of the heat semigroup with respect to the classical quadratic Wasserstein distance. However, this curvature condition may include a dimensional correction which up to now had not induced any strenghtening of this contraction. We first consider the simplest example of the Euclidean heat semigrou…
▽ More
It is now well known that curvature conditions à la Bakry-Emery are equivalent to contraction properties of the heat semigroup with respect to the classical quadratic Wasserstein distance. However, this curvature condition may include a dimensional correction which up to now had not induced any strenghtening of this contraction. We first consider the simplest example of the Euclidean heat semigroup, and prove that indeed it is so. To consider the case of a general Markov semigroup, we introduce a new distance between probability measures, based on the semigroup, and adapted to it. We prove that this Markov transportation distance satisfies the same properties for a general Markov semigroup as the Wasserstein distance does in the specific case of the Euclidean heat semigroup, namely dimensional contraction properties and Evolutional variational inequalities.
△ Less
Submitted 23 April, 2014; v1 submitted 6 April, 2013;
originally announced April 2013.
-
Semi Log-Concave Markov Diffusions
Authors:
Patrick Cattiaux,
Arnaud Guillin
Abstract:
In this paper we intend to give a comprehensive approach of functional inequalities for diffusion processes under some "curvature" assumptions. Our notion of curvature coincides with the usual $Γ_2$ curvature of Bakry and Emery in the case of a (reversible) drifted Brownian motion, but differs for more general diffusion processes. Our approach using simple coupling arguments together with classica…
▽ More
In this paper we intend to give a comprehensive approach of functional inequalities for diffusion processes under some "curvature" assumptions. Our notion of curvature coincides with the usual $Γ_2$ curvature of Bakry and Emery in the case of a (reversible) drifted Brownian motion, but differs for more general diffusion processes. Our approach using simple coupling arguments together with classical stochastic tools, allows us to obtain new results, to recover and to extend already known results, giving in many situations explicit (though non optimal) bounds. In particular, we show new results for gradient/semigroup commutation in the log concave case. Some new convergence to equilibrium in the granular media equation is also exhibited.
△ Less
Submitted 27 March, 2013;
originally announced March 2013.
-
Uniform convergence to equilibrium for granular media
Authors:
François Bolley,
Ivan Gentil,
Arnaud Guillin
Abstract:
We study the long time asymptotics of a nonlinear, nonlocal equation used in the modelling of granular media. We prove a uniform exponential convergence to equilibrium for degenerately convex and non convex interaction or confinement potentials, improving in particular results by J. A. Carrillo, R. J. McCann and C. Villani. The method is based on studying the dissipation of the Wasserstein distanc…
▽ More
We study the long time asymptotics of a nonlinear, nonlocal equation used in the modelling of granular media. We prove a uniform exponential convergence to equilibrium for degenerately convex and non convex interaction or confinement potentials, improving in particular results by J. A. Carrillo, R. J. McCann and C. Villani. The method is based on studying the dissipation of the Wasserstein distance between a solution and the steady state.
△ Less
Submitted 18 April, 2012;
originally announced April 2012.
-
Measure concentration through non-Lipschitz observables and functional inequalities
Authors:
Arnaud Guillin,
Aldéric Joulin
Abstract:
Non-Gaussian concentration estimates are obtained for invariant probability measures of reversible Markov processes. We show that the functional inequalities approach combined with a suitable Lyapunov condition allows us to circumvent the classical Lipschitz assumption of the observables. Our method is general and covers diffusions as well as pure-jump Markov processes on unbounded spaces.
Non-Gaussian concentration estimates are obtained for invariant probability measures of reversible Markov processes. We show that the functional inequalities approach combined with a suitable Lyapunov condition allows us to circumvent the classical Lipschitz assumption of the observables. Our method is general and covers diffusions as well as pure-jump Markov processes on unbounded spaces.
△ Less
Submitted 10 February, 2012;
originally announced February 2012.
-
Total variation estimates for the TCP process
Authors:
Jean-Baptiste Bardet,
Alejandra Christen,
Arnaud Guillin,
Florent Malrieu,
Pierre-André Zitt
Abstract:
The TCP window size process appears in the modeling of the famous Transmission Control Protocol used for data transmission over the Internet. This continuous time Markov process takes its values in [0, \infty), is ergodic and irreversible. The sample paths are piecewise linear deterministic and the whole randomness of the dynamics comes from the jump mechanism. The aim of the present paper is to p…
▽ More
The TCP window size process appears in the modeling of the famous Transmission Control Protocol used for data transmission over the Internet. This continuous time Markov process takes its values in [0, \infty), is ergodic and irreversible. The sample paths are piecewise linear deterministic and the whole randomness of the dynamics comes from the jump mechanism. The aim of the present paper is to provide quantitative estimates for the exponential convergence to equilibrium, in terms of the total variation and Wasserstein distances.
△ Less
Submitted 21 September, 2012; v1 submitted 29 December, 2011;
originally announced December 2011.
-
Deviation inequalities, Moderate deviations and some limit theorems for bifurcating Markov chains with application
Authors:
Valère Bitseki Penda,
Hacène Djellout,
Arnaud Guillin
Abstract:
First, under a geometric ergodicity assumption, we provide some limit theorems and some probability inequalities for the bifurcating Markov chains (BMC). The BMC model was introduced by Guyon to detect cellular aging from cell lineage, and our aim is thus to complete his asymptotic results. The deviation inequalities are then applied to derive first result on the moderate deviation principle (MDP)…
▽ More
First, under a geometric ergodicity assumption, we provide some limit theorems and some probability inequalities for the bifurcating Markov chains (BMC). The BMC model was introduced by Guyon to detect cellular aging from cell lineage, and our aim is thus to complete his asymptotic results. The deviation inequalities are then applied to derive first result on the moderate deviation principle (MDP) for a functional of the BMC with a restricted range of speed, but with a function which can be unbounded. Next, under a uniform geometric ergodicity assumption, we provide deviation inequalities for the BMC and apply them to derive a second result on the MDP for a bounded functional of the BMC with a larger range of speed. As statistical applications, we provide superexponential convergence in probability and deviation inequalities (for either the Gaussian setting or the bounded setting), and the MDP for least square estimators of the parameters of a first-order bifurcating autoregressive process.
△ Less
Submitted 17 January, 2014; v1 submitted 30 November, 2011;
originally announced November 2011.