Showing 1–49 of 49 results for author: Delarue, F

Itô's Formula for the Rearranged Stochastic Heat Equation

Authors: François Delarue, William R. P. Hammersley

Abstract: The purpose of this short note is to prove a convenient version of Itô's formula for the Rearranged Stochastic Heat Equation (RSHE) introduced by the two authors in a previous contribution. This equation is a penalised version of the standard Stochastic Heat Equation (SHE) on the circle subject to a coloured noise, whose solution is constrained to stay within the set of symmetric quantile function… ▽ More The purpose of this short note is to prove a convenient version of Itô's formula for the Rearranged Stochastic Heat Equation (RSHE) introduced by the two authors in a previous contribution. This equation is a penalised version of the standard Stochastic Heat Equation (SHE) on the circle subject to a coloured noise, whose solution is constrained to stay within the set of symmetric quantile functions by means of a reflection term. Here, we identity the generator of the solution when it is acting on functions defined on the space ${\mathcal P}_2({\mathbb R})$ (of one-dimensional probability measures with a finite second moment) that are assumed to be smooth in Lions' sense. In particular, we prove that the reflection term in the RSHE is orthogonal to the Lions (or Wasserstein) derivative of smooth functions defined on ${\mathcal P}_2({\mathbb R})$. The proof relies on non-trivial bounds for the gradient of the solution to the RSHE. △ Less

Submitted 10 June, 2024; originally announced June 2024.

MSC Class: 60H15; 60G57

Ergodicity of some stochastic Fokker-Planck equations with additive common noise

Authors: François Delarue, Etienne Tanré, Raphaël Maillet

Abstract: In this paper we consider stochastic Fokker-Planck Partial Differential Equations (PDEs), obtained as the mean-field limit of weakly interacting particle systems subjected to both independent (or idiosyncratic) and common Brownian noises. We provide sufficient conditions under which the deterministic counterpart of the Fokker-Planck equation, which corresponds to particle systems that are just sub… ▽ More In this paper we consider stochastic Fokker-Planck Partial Differential Equations (PDEs), obtained as the mean-field limit of weakly interacting particle systems subjected to both independent (or idiosyncratic) and common Brownian noises. We provide sufficient conditions under which the deterministic counterpart of the Fokker-Planck equation, which corresponds to particle systems that are just subjected to independent noises, has several invariant measures, but for which the stochastic version admits a unique invariant measure under the presence of the additive common noise. The very difficulty comes from the fact that the common noise is just of finite dimension while the state variable, which should be seen as the conditional marginal law of the system given the common noise, lives in a space of infinite dimension. In this context, our result holds true if, in addition to standard confining properties, the mean field interaction term forces the system to be attracted by its conditional mean given the common noise and the intensity of the idiosyncratic noise is small. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Rearranged Stochastic Heat Equation: Ergodicity and Related Gradient Descent on ${\mathcal P}({\mathbb R})$

Authors: François Delarue, William R. P. Hammersley

Abstract: This article provides a case study for a recently introduced diffusion in the space of probability measures over the reals, namely rearranged stochastic heat, which solves a stochastic partial differential equation valued in the set of symmetrised quantile functions over the unit circle. This contribution studies probability measure-valued flows perturbed by this noise with a special focus on grad… ▽ More This article provides a case study for a recently introduced diffusion in the space of probability measures over the reals, namely rearranged stochastic heat, which solves a stochastic partial differential equation valued in the set of symmetrised quantile functions over the unit circle. This contribution studies probability measure-valued flows perturbed by this noise with a special focus on gradient flows. This is done by introducing a drift to the rearranged stochastic heat equation by means of a vector field from the set of random variables over the unit circle into itself. When the flow is a gradient flow, the vector field may coincide with the Wasserstein derivative of a mean-field potential function. The resulting equation reads as a sort of McKean-Vlasov stochastic differential equation with an infinite dimensional common noise. This article provides conditions on the drift under which solutions exist uniquely for any time horizon and converge exponentially fast towards a unique equilibrium. When the drift derives from a potential, some metastability properties are obtained as the intensity of the noise is tuned to zero: it is shown that under a particular scaling regime, the gradient descent lingers near local minimizers for expected times of the same order as in the finite dimensional setting. △ Less

Submitted 10 June, 2024; v1 submitted 24 March, 2024; originally announced March 2024.

MSC Class: 60H15; 60G57; 37L40

Fourier Galerkin approximation of mean field control problems

Authors: François Delarue, Mattia Martini

Abstract: The purpose of this work is to provide a finite dimensional approximation of the solution to a mean field optimal control problem set on the $d$-dimensional torus. The approximation is obtained by means of a Fourier-Galerkin method, the main principle of which is to convolve probability measures on the torus by the Dirichlet kernel or, equivalently, to truncate the Fourier expansion of probability… ▽ More The purpose of this work is to provide a finite dimensional approximation of the solution to a mean field optimal control problem set on the $d$-dimensional torus. The approximation is obtained by means of a Fourier-Galerkin method, the main principle of which is to convolve probability measures on the torus by the Dirichlet kernel or, equivalently, to truncate the Fourier expansion of probability measures on the torus. However, this operation has the main feature not to leave the space of probability measures invariant, which drawback is know as \textit{Gibbs}' phenomenon. In spite of this, we manage to prove that, for initial conditions in the `interior' of the space of probability measures and for sufficiently large levels of truncation, the Fourier-Galerkin method induces a new finite dimensional control problem whose trajectories take values in the space of probability measures with a finite number of Fourier coefficients. Our main result asserts that, whenever the cost functionals are smooth and convex, the distance between the optimal trajectories of the original and approximating control problems decreases at a polynomial rate as the index of truncation in the Fourier-Galerkin method tends to $\infty$. A similar result holds for the distance between the corresponding value functions. From a practical point of view, our approach provides an efficient strategy to approximate mean field control optimizers by finite dimensional parameters and opens new perspectives for the numerical analysis of mean field control problems. It may be also applied to discretize more general mean field game systems. △ Less

Submitted 22 March, 2024; originally announced March 2024.

MSC Class: 49N80; 49L12; 35Q93; 42B05

Intrinsic regularization by noise for $1d$ mean field games

Authors: François Delarue, Youssef Ouknine

Abstract: The purpose of this article is to show that an intrinsic noise with values in the space ${\mathcal P}({\mathbb R})$ of $1d$ probability measures may force uniqueness to first order mean field games. The structure of the noise is inspired from an earlier work [arXiv:2210.01239]. It reads as a coloured Ornstein-Uhlenbeck process with reflection on the boundary of quantile functions on the $1d$ torus… ▽ More The purpose of this article is to show that an intrinsic noise with values in the space ${\mathcal P}({\mathbb R})$ of $1d$ probability measures may force uniqueness to first order mean field games. The structure of the noise is inspired from an earlier work [arXiv:2210.01239]. It reads as a coloured Ornstein-Uhlenbeck process with reflection on the boundary of quantile functions on the $1d$ torus, with the elements of the latter playing the role of indices for the continuum of players underpinning the game. In [arXiv:2210.01239], the semi-group generated by the noise is shown to enjoy smoothing properties that become key in the study carried out here. Although the analysis is limited to the 1d setting, this is the first example of uniqueness forcing for generic mean field games set over an infinite dimensional set of probability measures and this may be one step forward towards a more systematic regularization by noise theory for mean field games. △ Less

Submitted 24 January, 2024; originally announced January 2024.

MSC Class: 49N80; 91A16; 60H15; 60G5

From Nash Equilibrium to Social Optimum and vice versa: a Mean Field Perspective

Authors: Rene Carmona, Gokce Dayanikli, Francois Delarue, Mathieu Lauriere

Abstract: Mean field games (MFG) and mean field control (MFC) problems have been introduced to study large populations of strategic players. They correspond respectively to non-cooperative or cooperative scenarios, where the aim is to find the Nash equilibrium and social optimum. These frameworks provide approximate solutions to situations with a finite number of players and have found a wide range of appli… ▽ More Mean field games (MFG) and mean field control (MFC) problems have been introduced to study large populations of strategic players. They correspond respectively to non-cooperative or cooperative scenarios, where the aim is to find the Nash equilibrium and social optimum. These frameworks provide approximate solutions to situations with a finite number of players and have found a wide range of applications, from economics to biology and machine learning. In this paper, we study how the players can pass from a non-cooperative to a cooperative regime, and vice versa. The first direction is reminiscent of mechanism design, in which the game's definition is modified so that non-cooperative players reach an outcome similar to a cooperative scenario. The second direction studies how players that are initially cooperative gradually deviate from a social optimum to reach a Nash equilibrium when they decide to optimize their individual cost similar to the free rider phenomenon. To formalize these connections, we introduce two new classes of games which lie between MFG and MFC: $λ$-interpolated mean field games, in which the cost of an individual player is a $λ$-interpolation of the MFG and the MFC costs, and $p$-partial mean field games, in which a proportion $p$ of the population deviates from the social optimum by playing the game non-cooperatively. We conclude the paper by providing an algorithm for myopic players to learn a $p$-partial mean field equilibrium, and we illustrate it on a stylized model. △ Less

Submitted 16 December, 2023; originally announced December 2023.

Comments: 51 pages, 4 figures

MSC Class: 49N80; 49N90; 91A07; 91A10; 91A12; 91A15; 91A16

On the Optimal Rate for the Convergence Problem in Mean Field Control

Authors: Samuel Daudin, François Delarue, Joe Jackson

Abstract: The goal of this work is to obtain optimal rates for the convergence problem in mean field control. Our analysis covers cases where the solutions to the limiting problem may not be unique nor stable. Equivalently the value function of the limiting problem might not be differentiable on the entire space. Our main result is then to derive sharp rates of convergence in two distinct regimes. When the… ▽ More The goal of this work is to obtain optimal rates for the convergence problem in mean field control. Our analysis covers cases where the solutions to the limiting problem may not be unique nor stable. Equivalently the value function of the limiting problem might not be differentiable on the entire space. Our main result is then to derive sharp rates of convergence in two distinct regimes. When the data is sufficiently regular, we obtain rates proportional to $N^{-1/2}$, with $N$ being the number of particles. When the data is merely Lipschitz and semi-concave with respect to the first Wasserstein distance, we obtain rates proportional to $N^{-2/(3d+6)}$. Noticeably, the exponent $2/(3d+6)$ is close to $1/d$, which is the optimal rate of convergence for uncontrolled particle systems driven by data with a similar regularity. The key argument in our approach consists in mollifying the value function of the limiting problem in order to produce functions that are almost classical sub-solutions to the limiting Hamilton-Jacobi equation (which is a PDE set on the space of probability measures). These sub-solutions can be projected onto finite dimensional spaces and then compared with the value functions associated with the particle systems. In the end, this comparison is used to prove the most demanding bound in the estimates. The key challenge therein is thus to exhibit an appropriate form of mollification. We do so by employing sup-convolution within a convenient functional Hilbert space. To make the whole easier, we limit ourselves to the periodic setting. We also provide some examples to show that our results are sharp up to some extent. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Comments: 65 pages

Rearranged Stochastic Heat Equation

Authors: François Delarue, William R. P. Hammersley

Abstract: The purpose of this work is to provide an explicit construction of a strong Feller semigroup on the space of probability measures over the real line that additionally maps bounded measurable functions into Lipschitz continuous functions, with a Lipschitz constant that blows up in an integrable manner in small time. Our construction relies on a rearranged version of the stochastic heat equation on… ▽ More The purpose of this work is to provide an explicit construction of a strong Feller semigroup on the space of probability measures over the real line that additionally maps bounded measurable functions into Lipschitz continuous functions, with a Lipschitz constant that blows up in an integrable manner in small time. Our construction relies on a rearranged version of the stochastic heat equation on the circle driven by a coloured noise. Formally, this stochastic equation writes as a reflected equation in infinite dimension. Under the action of the rearrangement, the solution is forced to live in a space of quantile functions that is isometric to the space of probability measures on the real line. We prove the equation to be solvable by means of an Euler scheme in which we alternate flat dynamics in the space of random variables on the circle with a rearrangement operation that projects back the random variables onto the subset of quantile functions. A first challenge is to prove that this scheme is tight. A second one is to provide a consistent theory for the limiting reflected equation and in particular to interpret in a relevant manner the reflection term. The last step in our work is to establish the aforementioned Lipschitz property of the semigroup by adapting earlier ideas from the Bismut-Elworthy-Li formula. △ Less

Submitted 7 June, 2024; v1 submitted 3 October, 2022; originally announced October 2022.

MSC Class: 60H15; 60G57; 47D07; 60J35

Weak solutions to the master equation of potential mean field games

Authors: Alekos Cecchin, François Delarue

Abstract: The purpose of this work is to introduce a notion of weak solution to the master equation of a potential mean field game and to prove that existence and uniqueness hold under quite general assumptions. Remarkably, this is achieved without any monotonicity constraint on the coefficients. The key point is to interpret the master equation in a conservative sense and then to adapt to the infinite dime… ▽ More The purpose of this work is to introduce a notion of weak solution to the master equation of a potential mean field game and to prove that existence and uniqueness hold under quite general assumptions. Remarkably, this is achieved without any monotonicity constraint on the coefficients. The key point is to interpret the master equation in a conservative sense and then to adapt to the infinite dimensional setting earlier arguments for hyperbolic systems deriving from a Hamilton-Jacobi-Bellman equation. Here, the master equation is indeed regarded as an infinite dimensional system set on the space of probability measures and is formally written as the derivative of the Hamilton-Jacobi-Bellman equation associated with the mean field control problem lying above the mean field game. To make the analysis easier, we assume that the coefficients are periodic, which allows to represent probability measures through their Fourier coefficients. Most of the analysis then consists in rewriting the master equation and the corresponding Hamilton-Jacobi-Bellman equation for the mean field control problem as partial differential equations set on the Fourier coefficients themselves. In the end, we establish existence and uniqueness of functions that are displacement semi-concave in the measure argument and that solve the Hamilton-Jacobi-Bellman equation in a suitable generalized sense and, subsequently, we get existence and uniqueness of functions that solve the master equation in an appropriate weak sense and that satisfy a weak one-sided Lipschitz inequality. As another new result, we also prove that the optimal trajectories of the associated mean field control problem are unique for almost every starting point, for a suitable probability measure on the space of probability measures. △ Less

Submitted 29 June, 2022; v1 submitted 8 April, 2022; originally announced April 2022.

MSC Class: 35L40; 35Q89; 49L12; 49N80; 60J60; 91A16

Probabilistic rough paths II Lions-Taylor expansions and Random controlled rough paths

Authors: François Delarue, William Salkeld

Abstract: In line with the notion of probabilistic rough paths introduced in the previous contribution \cite{salkeld2021Probabilistic}, we address corresponding random controlled rough paths (first introduced in \cite{2019arXiv180205882.2B}), the structure of which is indexed by Lions forests. These are statistical distributions over the space of paths described by the combination of a jet on the underlying… ▽ More In line with the notion of probabilistic rough paths introduced in the previous contribution \cite{salkeld2021Probabilistic}, we address corresponding random controlled rough paths (first introduced in \cite{2019arXiv180205882.2B}), the structure of which is indexed by Lions forests. These are statistical distributions over the space of paths described by the combination of a jet on the underlying probabilistic rough path and a remainder term. The regularity of the latter facilitates the definition of a rough integral. We establish closedness and stability of two key operators on random controlled rough paths: rough integration and composition by a smooth function on the Wasserstein space. These are important results towards a complete theory of rough McKean-Vlasov equations that is still in gestation. The proof goes through a higher-order Taylor expansion for the Lions derivative which we rigorously expound. The coupled Hopf algebra structure (see \cite{salkeld2021Probabilistic}) and the Lions-Taylor expansion (established in Section \ref{section:TaylorExpansions}) introduce a number of additional challenges which mean these results are not simply a natural extension of classical theory. We dedicate this work to pursuing these details. △ Less

Submitted 2 March, 2022; originally announced March 2022.

Comments: 110 pages

MSC Class: Primary: 60L30; 41A58 Secondary: 60G07; 46G05

Exploration noise for learning linear-quadratic mean field games

Authors: François Delarue, Athanasios Vasileiadis

Abstract: The goal of this paper is to demonstrate that common noise may serve as an exploration noise for learning the solution of a mean field game. This concept is here exemplified through a toy linear-quadratic model, for which a suitable form of common noise has already been proven to restore existence and uniqueness. We here go one step further and prove that the same form of common noise may force th… ▽ More The goal of this paper is to demonstrate that common noise may serve as an exploration noise for learning the solution of a mean field game. This concept is here exemplified through a toy linear-quadratic model, for which a suitable form of common noise has already been proven to restore existence and uniqueness. We here go one step further and prove that the same form of common noise may force the convergence of the learning algorithm called `fictitious play', and this without any further potential or monotone structure. Several numerical examples are provided in order to support our theoretical analysis. △ Less

Submitted 1 November, 2023; v1 submitted 2 July, 2021; originally announced July 2021.

MSC Class: 68T05; 91A16; 49N80

An example driven introduction to probabilistic rough paths

Authors: Francois Delarue, William Salkeld

Abstract: In these notes, we provide an introduction to a new regularity structure used for solving rough mean-field equations. The index set of this regularity structure is described a collection of novel objects which we refer to as Lions trees. These objects arise in Taylor expansions involving the Lions derivative and capture many of the desirable properties of mean-field dynamics. This work represe… ▽ More In these notes, we provide an introduction to a new regularity structure used for solving rough mean-field equations. The index set of this regularity structure is described a collection of novel objects which we refer to as Lions trees. These objects arise in Taylor expansions involving the Lions derivative and capture many of the desirable properties of mean-field dynamics. This work represents a comprehensive generalisation of the ideas first introduced in [BCD20] that promise powerful insights into how interactions with a collective determine the dynamics of an individual within this collective. △ Less

Submitted 3 May, 2023; v1 submitted 17 June, 2021; originally announced June 2021.

Comments: 70 pages

MSC Class: 2020 AMS subject classifications: Primary: 60-XX; 60Lxx Secondary: 60L30; 16T05; 46G05

Uniform in time weak propagation of chaos on the torus

Authors: François Delarue, Alvin Tse

Abstract: We address the long time behaviour of weakly interacting diffusive particle systems on the d-dimensional torus. Our main result is to show that, under certain regularity conditions, the weak error between the empirical distribution of the particle system and the theoretical law of the limiting process (governed by a McKean-Vlasov stochastic differential equation) is of the order O(1/N), uniform in… ▽ More We address the long time behaviour of weakly interacting diffusive particle systems on the d-dimensional torus. Our main result is to show that, under certain regularity conditions, the weak error between the empirical distribution of the particle system and the theoretical law of the limiting process (governed by a McKean-Vlasov stochastic differential equation) is of the order O(1/N), uniform in time on [0, infinity), where N is the number of particles in the interacting diffusion. This comprises general interaction terms with a small enough mean-field dependence together with interactions terms driven by an H-stable potential. Our approach relies on a systematic analysis of the long-time behaviour of the derivatives of the semigroup generated by the McKean-Vlasov SDE, which may be explicitly computed through the linearised Fokker-Planck equation. Ergodic estimates for the latter hence play a key role in our analysis. We believe that this strategy is flexible enough to cover a wider broad of situations. To wit, we succeed in adapting it to the super-critical Kuramoto model, for which the corresponding McKean-Vlasov equation has several invariant measures. △ Less

Submitted 1 March, 2024; v1 submitted 30 April, 2021; originally announced April 2021.

MSC Class: 35R06; 60H30; 65C35

Finite state mean field games with Wright Fisher common noise as limits of $N$-player weighted games

Authors: Erhan Bayraktar, Alekos Cecchin, Asaf Cohen, François Delarue

Abstract: Forcing finite state mean field games by a relevant form of common noise is a subtle issue, which has been addressed only recently. Among others, one possible way is to subject the simplex valued dynamics of an equilibrium by a so-called Wright-Fisher noise, very much in the spirit of stochastic models in population genetics. A key feature is that such a random forcing preserves the structure of t… ▽ More Forcing finite state mean field games by a relevant form of common noise is a subtle issue, which has been addressed only recently. Among others, one possible way is to subject the simplex valued dynamics of an equilibrium by a so-called Wright-Fisher noise, very much in the spirit of stochastic models in population genetics. A key feature is that such a random forcing preserves the structure of the simplex, which is nothing but, in this setting, the probability space over the state space of the game. The purpose of this article is hence to elucidate the finite player version and, accordingly, to prove that $N$-player equilibria indeed converge towards the solution of such a kind of Wright-Fisher mean field game. Whilst part of the analysis is made easier by the fact that the corresponding master equation has already been proved to be uniquely solvable under the presence of the common noise, it becomes however more subtle than in the standard setting because the mean field interaction between the players now occurs through a weighted empirical measure. In other words, each player carries its own weight, which hence may differ from $1/N$ and which, most of all, evolves with the common noise. △ Less

Submitted 1 November, 2021; v1 submitted 8 December, 2020; originally announced December 2020.

Selection by vanishing common noise for potential finite state mean field games

Authors: Alekos Cecchin, François Delarue

Abstract: The goal of this paper is to provide a selection principle for potential mean field games on a finite state space and, in this respect, to show that equilibria that do not minimize the corresponding mean field control problem should be ruled out. Our strategy is a tailored-made version of the vanishing viscosity method for partial differential equations. Here, the viscosity has to be understood as… ▽ More The goal of this paper is to provide a selection principle for potential mean field games on a finite state space and, in this respect, to show that equilibria that do not minimize the corresponding mean field control problem should be ruled out. Our strategy is a tailored-made version of the vanishing viscosity method for partial differential equations. Here, the viscosity has to be understood as the square intensity of a common noise that is inserted in the mean field game or, equivalently, as the diffusivity parameter in the related parabolic version of the master equation. As established recently, the randomly forced mean field game becomes indeed uniquely solvable for a relevant choice of a Wright-Fisher common noise, the counterpart of which in the master equation is a Kimura operator on the simplex. We here elaborate on this idea to make the mean field game with common noise both uniquely solvable and potential, meaning that its unique solution is in fact equal to the unique minimizer of a suitable stochastic mean field control problem. Taking the limit as the intensity of the common noise vanishes, we obtain a rigorous proof of the aforementioned selection principle. As a byproduct, we get that the classical solution to the viscous master equation associated with the mean field game with common noise converges to the gradient of the value function of the mean field control problem without common noise; we hence select a particular weak solution of the master equation of the original mean field game. Lastly, we establish an intrinsic uniqueness criterion for this solution within a suitable class. △ Less

Submitted 25 May, 2020; originally announced May 2020.

MSC Class: 35K65; 35L40; 35Q89; 49L25; 49N80; 60F05; 91A16

Finite state Mean Field Games with Wright-Fisher common noise

Authors: Erhan Bayraktar, Alekos Cecchin, Asaf Cohen, Francois Delarue

Abstract: We force uniqueness in finite state mean field games by adding a Wright-Fisher common noise. We achieve this by analyzing the master equation of this game, which is a degenerate parabolic second-order partial differential equation set on the simplex whose characteristics solve the stochastic forward-backward system associated with the mean field game; see Cardaliaguet et al. (2019). We show that t… ▽ More We force uniqueness in finite state mean field games by adding a Wright-Fisher common noise. We achieve this by analyzing the master equation of this game, which is a degenerate parabolic second-order partial differential equation set on the simplex whose characteristics solve the stochastic forward-backward system associated with the mean field game; see Cardaliaguet et al. (2019). We show that this equation, which is a non-linear version of the Kimura type equation studied in Epstein and Mazzeo (2013), has a unique smooth solution whenever the normal component of the drift at the boundary is strong enough. Among others, this requires a priori estimates of Hölder type for the corresponding Kimura operator when the drift therein is merely continuous. △ Less

Submitted 9 January, 2021; v1 submitted 13 December, 2019; originally announced December 2019.

Zero noise limit for multidimensional SDEs driven by a pointy gradient

Authors: François Delarue, Mario Maurelli

Abstract: The purpose of the article is to address the limiting behavior of the solutions of stochastic differential equations driven by a pointy $d$-dimensional gradient as the intensity of the underlying Brownian motion tends to $0$. By pointy gradient, we here mean that the drift derives from a potential that is ${\mathcal C}^{1,1}$ on any compact subset that does not contain the origin. As a matter of f… ▽ More The purpose of the article is to address the limiting behavior of the solutions of stochastic differential equations driven by a pointy $d$-dimensional gradient as the intensity of the underlying Brownian motion tends to $0$. By pointy gradient, we here mean that the drift derives from a potential that is ${\mathcal C}^{1,1}$ on any compact subset that does not contain the origin. As a matter of fact, the corresponding deterministic version of the differential equation may have an infinite number of solutions when initialized from $0_{{\mathbb R}^d}$, in which case the limit theorem proved in the paper reads as a selection theorem of the solutions to the zero noise system. Generally speaking, our result says that, under suitable conditions, the probability that the particle leaves the origin by going through regions of higher potential tends to $1$ as the intensity of the noise tends to $0$. In particular, our result extends the earlier one due to Bafico and Baldi for the zero noise limit of one dimensional stochastic differential equations. △ Less

Submitted 18 September, 2019; originally announced September 2019.

MSC Class: 60H10

Propagation of chaos for mean field rough differential equations

Authors: I. Bailleul, R. Catellier, F. Delarue

Abstract: We address propagation of chaos for large systems of rough differential equations associated with random rough differential equations of mean field type $$ dX_t = V(X_t,\mathcal{L}(X_t))dt + F(X_t,\mathcal{L}(X_t))dW_t $$ where $W$ is a random rough path and $\mathcal{L}(X_t)$ is the law of $X_t$. We prove propagation of chaos, and provide also an explicit optimal convergence rate. The analysis is… ▽ More We address propagation of chaos for large systems of rough differential equations associated with random rough differential equations of mean field type $$ dX_t = V(X_t,\mathcal{L}(X_t))dt + F(X_t,\mathcal{L}(X_t))dW_t $$ where $W$ is a random rough path and $\mathcal{L}(X_t)$ is the law of $X_t$. We prove propagation of chaos, and provide also an explicit optimal convergence rate. The analysis is based upon the tools we developed in our companion paper [1] for solving mean field rough differential equations and in particular upon a corresponding version of the Itô-Lyons continuity theorem. The rate of convergence is obtained by a coupling argument developed first by Sznitman for particle systems with Brownian inputs. △ Less

Submitted 9 June, 2020; v1 submitted 1 July, 2019; originally announced July 2019.

Comments: Final version, 73p. arXiv admin note: text overlap with arXiv:1802.05882

Global solutions to the supercooled Stefan problem with blow-ups: regularity and uniqueness

Authors: Francois Delarue, Sergey Nadtochiy, Mykhaylo Shkolnikov

Abstract: We consider the supercooled Stefan problem, which captures the freezing of a supercooled liquid, in one space dimension. A probabilistic reformulation of the problem allows to define global solutions, even in the presence of blow-ups of the freezing rate. We provide a complete description of such solutions, by relating the temperature distribution in the liquid to the regularity of the ice growth… ▽ More We consider the supercooled Stefan problem, which captures the freezing of a supercooled liquid, in one space dimension. A probabilistic reformulation of the problem allows to define global solutions, even in the presence of blow-ups of the freezing rate. We provide a complete description of such solutions, by relating the temperature distribution in the liquid to the regularity of the ice growth process. The latter is shown to transition between (i) continuous differentiability, (ii) Holder continuity, and (iii) discontinuity. In particular, in the second regime we rediscover the square root behavior of the growth process pointed out by Stefan in his seminal paper [Ste89] from 1889 for the ordinary Stefan problem. In our second main theorem, we establish the uniqueness of the global solutions, a first result of this kind in the context of growth processes with singular self-excitation when blow-ups are present. △ Less

Submitted 25 September, 2020; v1 submitted 13 February, 2019; originally announced February 2019.

Comments: 41 pages

MSC Class: 80A22; 35B44; 60H30; 35B05

Journal ref: Prob. Math. Phys. 3 (2022) 171-213

Selection of equilibria in a linear quadratic mean-field game

Authors: François Delarue, Rinel Foguen Tchuendom

Abstract: In this paper, we address an instance of uniquely solvable mean-field game with a common noise whose corresponding counterpart without common noise has several equilibria. We study the selection problem for this mean-field game without common noise via three approaches. A common approach is to select, amongst all the equilibria, those yielding the minimal cost for the representative player. Anot… ▽ More In this paper, we address an instance of uniquely solvable mean-field game with a common noise whose corresponding counterpart without common noise has several equilibria. We study the selection problem for this mean-field game without common noise via three approaches. A common approach is to select, amongst all the equilibria, those yielding the minimal cost for the representative player. Another one is to select equilibria that are included in the support of the zero noise limit of the mean-field game with common noise. A last one is to select equilibria supported by the limit of the mean-field component of the corresponding $N$-player game as the number of players goes to infinity. The contribution of this paper is to show that, for the class under study, the last two approaches select the same equilibria, but the first approach selects another one. △ Less

Submitted 28 August, 2018; originally announced August 2018.

Numerical Probabilistic Approach to MFG

Authors: Andrea Angiuli, Christy V. Graves, Houzhi Li, Jean-François Chassagneux, François Delarue, René Carmona

Abstract: This project investigates numerical methods for solving fully coupled forward-backward stochastic differential equations (FBSDEs) of McKean-Vlasov type. Having numerical solvers for such mean field FBSDEs is of interest because of the potential application of these equations to optimization problems over a large population, say for instance mean field games (MFG) and optimal mean field control pro… ▽ More This project investigates numerical methods for solving fully coupled forward-backward stochastic differential equations (FBSDEs) of McKean-Vlasov type. Having numerical solvers for such mean field FBSDEs is of interest because of the potential application of these equations to optimization problems over a large population, say for instance mean field games (MFG) and optimal mean field control problems. Theory for this kind of problems has met with great success since the early works on mean field games by Lasry and Lions, see \cite{Lasry_Lions}, and by Huang, Caines, and Malhamé, see \cite{Huang}. Generally speaking, the purpose is to understand the continuum limit of optimizers or of equilibria (say in Nash sense) as the number of underlying players tends to infinity. When approached from the probabilistic viewpoint, solutions to these control problems (or games) can be described by coupled mean field FBSDEs, meaning that the coefficients depend upon the own marginal laws of the solution. In this note, we detail two methods for solving such FBSDEs which we implement and apply to five benchmark problems. The first method uses a tree structure to represent the pathwise laws of the solution, whereas the second method uses a grid discretization to represent the time marginal laws of the solutions. Both are based on a Picard scheme; importantly, we combine each of them with a generic continuation method that permits to extend the time horizon (or equivalently the coupling strength between the two equations) for which the Picard iteration converges. △ Less

Submitted 1 October, 2018; v1 submitted 7 May, 2018; originally announced May 2018.

From the master equation to mean field game limit theory: Large deviations and concentration of measure

Authors: Francois Delarue, Daniel Lacker, Kavita Ramanan

Abstract: We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitab… ▽ More We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitable regularity conditions, in the absence of common noise, we complement this law of large numbers result with non-asymptotic concentration bounds for the Wasserstein distance between the $n$-player Nash equilibrium empirical measure and the mean field equilibrium. We also show that the sequence of Nash equilibrium empirical measures satisfies a weak large deviation principle, which can be strengthened to a full large deviation principle only in the absence of common noise. For both sets of results, we first use the master equation, an infinite-dimensional partial differential equation that characterizes the value function of the mean field game, to construct an associated McKean-Vlasov interacting $n$-particle system that is exponentially close to the Nash equilibrium dynamics of the $n$-player game for large $n$, by refining estimates obtained in our companion paper. Then we establish a weak large deviation principle for McKean-Vlasov systems in the presence of common noise. In the absence of common noise, we upgrade this to a full large deviation principle and obtain new concentration estimates for McKean-Vlasov systems. Finally, in two specific examples that do not satisfy the assumptions of our main theorems, we show how to adapt our methodology to establish large deviations and concentration results. △ Less

Submitted 23 April, 2018; originally announced April 2018.

From the master equation to mean field game limit theory: A central limit theorem

Authors: Francois Delarue, Daniel Lacker, Kavita Ramanan

Abstract: Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG… ▽ More Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG equilibrium arises as the limit of the sequence of empirical measures of the $n$-player game Nash equilibria, including the case when player dynamics are driven by both idiosyncratic and common sources of noise. The proof of convergence relies on the so-called master equation for the value function of the MFG, a partial differential equation on the space of probability measures. In this work, under additional assumptions, we establish a functional central limit theorem (CLT) that characterizes the limiting fluctuations around the LLN limit as the unique solution of a linear stochastic PDE. The key idea is to use the solution to the master equation to construct an associated McKean-Vlasov interacting $n$-particle system that is sufficiently close to the Nash equilibrium dynamics of the $n$-player game for large $n$. We then derive the CLT for the latter from the CLT for the former. Along the way, we obtain a new multidimensional CLT for McKean-Vlasov systems. We also illustrate the broader applicability of our methodology by applying it to establish a CLT for a specific linear-quadratic example that does not satisfy our main assumptions, and we explicitly solve the resulting stochastic PDE in this case. △ Less

Submitted 23 April, 2018; originally announced April 2018.

Restoring Uniqueness to Mean-Field Games by Randomizing the Equilibria

Authors: Francois Delarue

Abstract: We here address the question of restoration of uniqueness in mean-field games deriving from deterministic differential games with a large number of players. The general strategy for restoring uniqueness is inspired from earlier similar results on ordinary and stochastic differential equations. It consists in randomizing the equilibria through an external noise. As a main feature, we choose the e… ▽ More We here address the question of restoration of uniqueness in mean-field games deriving from deterministic differential games with a large number of players. The general strategy for restoring uniqueness is inspired from earlier similar results on ordinary and stochastic differential equations. It consists in randomizing the equilibria through an external noise. As a main feature, we choose the external noise as an infinite dimensional Ornstein-Uhlenbeck process. We first investigate existence and uniqueness of a solution to the noisy system made of the mean-field game forced by the Ornstein-Uhlenbeck process. We also show how such a noisy system can be interpreted as the limit version of a stochastic differential game with a large number of players. △ Less

Submitted 10 April, 2018; originally announced April 2018.

Solving mean field rough differential equations

Authors: I. Bailleul, R. Catellier, F. Delarue

Abstract: We provide in this work a robust solution theory for random rough differential equations of mean field type $$ dX_t = V(X_t,\mathcal{L}(X_t))dt + F(X_t,\mathcal{L}(X_t))dW_t, $$ where $W$ is a random rough path and $\mathcal{L}(X_t)$ stands for the law of $X_t$, with mean field interaction in both the drift and diffusivity. The analysis requires the introduction of a new rough path-like setting an… ▽ More We provide in this work a robust solution theory for random rough differential equations of mean field type $$ dX_t = V(X_t,\mathcal{L}(X_t))dt + F(X_t,\mathcal{L}(X_t))dW_t, $$ where $W$ is a random rough path and $\mathcal{L}(X_t)$ stands for the law of $X_t$, with mean field interaction in both the drift and diffusivity. The analysis requires the introduction of a new rough path-like setting and an associated notion of controlled path. We use crucially Lions' approach to differential calculus on Wasserstein space along the way. △ Less

Submitted 1 July, 2019; v1 submitted 16 February, 2018; originally announced February 2018.

Comments: 63 pages; v2: Version 1 of this work has been split in two seperate works, the first part of which is the present work. A number of arguments in both parts have been reworked in depth, and improved

Convergence analysis of upwind type schemes for the aggregation equation with pointy potential

Authors: François Delarue, Frédéric Lagoutìère, Nicolas Vauchelet

Abstract: A numerical analysis of upwind type schemes for the nonlinear nonlocal aggregation equation is provided. In this approach, the aggregation equation is interpreted as a conservative transport equation driven by a nonlocal nonlinear velocity field with low regularity. In particular, we allow the interacting potential to be pointy, in which case the velocity field may have discontinuities. Based on r… ▽ More A numerical analysis of upwind type schemes for the nonlinear nonlocal aggregation equation is provided. In this approach, the aggregation equation is interpreted as a conservative transport equation driven by a nonlocal nonlinear velocity field with low regularity. In particular, we allow the interacting potential to be pointy, in which case the velocity field may have discontinuities. Based on recent results of existence and uniqueness of a Filippov flow for this type of equations, we study an upwind finite volume numerical scheme and we prove that it is convergent at order 1/2 in Wasserstein distance. This result is illustrated by numerical simulations, which show the optimality of the order of convergence. △ Less

Submitted 30 August, 2018; v1 submitted 27 September, 2017; originally announced September 2017.

Numerical Method for FBSDEs of McKean-Vlasov Type

Authors: Jean-François Chassagneux, Dan Crisan, François Delarue

Abstract: This paper is dedicated to the presentation and the analysis of a numerical scheme for forward-backward SDEs of the McKean-Vlasov type, or equivalently for solutions to PDEs on the Wasserstein space. Because of the mean field structure of the equation, earlier methods for classical forward-backward systems fail. The scheme is based on a variation of the method of continuation. The principle is to… ▽ More This paper is dedicated to the presentation and the analysis of a numerical scheme for forward-backward SDEs of the McKean-Vlasov type, or equivalently for solutions to PDEs on the Wasserstein space. Because of the mean field structure of the equation, earlier methods for classical forward-backward systems fail. The scheme is based on a variation of the method of continuation. The principle is to implement recursively local Picard iterations on small time intervals. We establish a bound for the rate of convergence under the assumption that the decoupling field of the forward-bakward SDE (or equivalently the solution of the PDE) satisfies mild regularity conditions. We also provide numerical illustrations. △ Less

Submitted 6 March, 2017; originally announced March 2017.

Comments: 33 pages, 3 figures

Mean field games of timing and models for bank runs

Authors: Rene Carmona, Francois Delarue, Daniel Lacker

Abstract: The goal of the paper is to introduce a set of problems which we call mean field games of timing. We motivate the formulation by a dynamic model of bank run in a continuous-time setting. We briefly review the economic and game theoretic contributions at the root of our effort, and we develop a mathematical theory for continuous-time stochastic games where the strategic decisions of the players are… ▽ More The goal of the paper is to introduce a set of problems which we call mean field games of timing. We motivate the formulation by a dynamic model of bank run in a continuous-time setting. We briefly review the economic and game theoretic contributions at the root of our effort, and we develop a mathematical theory for continuous-time stochastic games where the strategic decisions of the players are merely choices of times at which they leave the game, and the interaction between the strategic players is of a mean field nature. △ Less

Submitted 23 January, 2017; v1 submitted 12 June, 2016; originally announced June 2016.

Convergence order of upwind type schemes for transport equations with discontinuous coefficients

Authors: François Delarue, Frédéric Lagoutière, Nicolas Vauchelet

Abstract: An analysis of the error of the upwind scheme for transport equation with discontinuous coefficients is provided. We consider here a velocity field that is bounded and one-sided Lipschitz continuous. In this framework, solutions are defined in the sense of measures along the lines of Poupaud and Rascle's work. We study the convergence order of the upwind scheme in the Wasserstein distances. More p… ▽ More An analysis of the error of the upwind scheme for transport equation with discontinuous coefficients is provided. We consider here a velocity field that is bounded and one-sided Lipschitz continuous. In this framework, solutions are defined in the sense of measures along the lines of Poupaud and Rascle's work. We study the convergence order of the upwind scheme in the Wasserstein distances. More precisely, we prove that in this setting the convergence order is 1/2. We also show the optimality of this result. In the appendix, we show that this result also applies to other "diffusive" "first order" schemes and to a forward semi-Lagrangian scheme. △ Less

Submitted 18 February, 2016; originally announced February 2016.

The master equation and the convergence problem in mean field games

Authors: Pierre Cardaliaguet, François Delarue, Jean-Michel Lasry, Pierre-Louis Lions

Abstract: The paper studies the convergence, as $N$ tends to infinity, of a system of $N$ coupled Hamilton-Jacobi equations, the Nash system. This system arises in differential game theory. We describe the limit problem in terms of the so-called "master equation", a kind of second order partial differential equation stated on the space of probability measures. Our first main result is the well-posedness of… ▽ More The paper studies the convergence, as $N$ tends to infinity, of a system of $N$ coupled Hamilton-Jacobi equations, the Nash system. This system arises in differential game theory. We describe the limit problem in terms of the so-called "master equation", a kind of second order partial differential equation stated on the space of probability measures. Our first main result is the well-posedness of the master equation. To do so, we first show the existence and uniqueness of a solution to the "mean field game system with common noise", which consists in a coupled system made of a backward stochastic Hamilton-Jacobi equation and a forward stochastic Kolmogorov equation and which plays the role of characteristics for the master equation. Our second main result is the convergence, in average, of the solution of the Nash system and a propagation of chaos property for the associated "optimal trajectories". △ Less

Submitted 8 September, 2015; originally announced September 2015.

A Probabilistic approach to classical solutions of the master equation for large population equilibria

Authors: Jean-François Chassagneux, Dan Crisan, François Delarue

Abstract: We analyze a class of nonlinear partial differential equations (PDEs) defined on $\mathbb{R}^d \times \mathcal{P}_2(\mathbb{R}^d),$ where $\mathcal{P}_2(\mathbb{R}^d)$ is the Wasserstein space of probability measures on $\mathbb{R}^d$ with a finite second-order moment. We show that such equations admit a classical solutions for sufficiently small time intervals. Under additional constraints, we pr… ▽ More We analyze a class of nonlinear partial differential equations (PDEs) defined on $\mathbb{R}^d \times \mathcal{P}_2(\mathbb{R}^d),$ where $\mathcal{P}_2(\mathbb{R}^d)$ is the Wasserstein space of probability measures on $\mathbb{R}^d$ with a finite second-order moment. We show that such equations admit a classical solutions for sufficiently small time intervals. Under additional constraints, we prove that their solution can be extended to arbitrary large intervals. These nonlinear PDEs arise in the recent developments in the theory of large population stochastic control. More precisely they are the so-called master equations corresponding to asymptotic equilibria for a large population of controlled players with mean-field interaction and subject to minimization constraints. The results in the paper are deduced by exploiting this connection. In particular, we study the differentiability with respect to the initial condition of the flow generated by a forward-backward stochastic system of McKean-Vlasov type. As a byproduct, we prove that the decoupling field generated by the forward-backward system is a classical solution of the corresponding master equation. Finally, we give several applications to mean-field games and to the control of McKean-Vlasov diffusion processes. △ Less

Submitted 21 April, 2015; v1 submitted 11 November, 2014; originally announced November 2014.

Comments: 98 pages

MSC Class: Primary 93E20; secondary 60H30; 60K35

Mean field games with common noise

Authors: Rene Carmona, Francois Delarue, Daniel Lacker

Abstract: A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and existence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighte… ▽ More A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and existence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighten the underpinnings of the existence theory. Finally, an analog of the famous result of Yamada and Watanabe is derived, and it is used to prove existence and uniqueness of a strong solution under additional assumptions. △ Less

Submitted 20 May, 2015; v1 submitted 23 July, 2014; originally announced July 2014.

The Landau Equation for Maxwellian molecules and the Brownian Motion on SO_R(N)

Authors: François Delarue, Stephane Menozzi, Eulalia Nualart

Abstract: In this paper we prove that the spatially homogeneous Landau equation for Maxwellian molecules can be represented through the product of two elementary processes. The first one is the Brownian motion on the group of rotations. The second one is, conditionally on the first one, a Gaussian process. Using this representation, we establish sharp multi-scale upper and lower bounds for the transition de… ▽ More In this paper we prove that the spatially homogeneous Landau equation for Maxwellian molecules can be represented through the product of two elementary processes. The first one is the Brownian motion on the group of rotations. The second one is, conditionally on the first one, a Gaussian process. Using this representation, we establish sharp multi-scale upper and lower bounds for the transition density of the Landau equation, the multi-scale structure depending on the shape of the support of the initial condition. △ Less

Submitted 12 June, 2014; originally announced June 2014.

Comments: 38

Particle systems with a singular mean-field self-excitation. Application to neuronal networks

Authors: F. Delarue, J. Inglis, S. Rubenthaler, E. Tanré

Abstract: We discuss the construction and approximation of solutions to a nonlinear McKean-Vlasov equation driven by a singular self-excitatory interaction of the mean-field type. Such an equation is intended to describe an infinite population of neurons which interact with one another. Each time a proportion of neurons 'spike', the whole network instantaneously receives an excitatory kick. The instantaneo… ▽ More We discuss the construction and approximation of solutions to a nonlinear McKean-Vlasov equation driven by a singular self-excitatory interaction of the mean-field type. Such an equation is intended to describe an infinite population of neurons which interact with one another. Each time a proportion of neurons 'spike', the whole network instantaneously receives an excitatory kick. The instantaneous nature of the excitation makes the system singular and prevents the application of standard results from the literature. Making use of the Skorohod M1 topology, we prove that, for the right notion of a 'physical' solution, the nonlinear equation can be approximated either by a finite particle system or by a delayed equation. As a by-product, we obtain the existence of 'synchronized' solutions, for which a macroscopic proportion of neurons may spike at the same time. △ Less

Submitted 23 January, 2015; v1 submitted 4 June, 2014; originally announced June 2014.

Journal ref: Stochastic Processes and Applications, 2015, pp.40

The Master Equation for Large Population Equilibriums

Authors: René Carmona, Francois Delarue

Abstract: We use a simple N-player stochastic game with idiosyncratic and common noises to introduce the concept of Master Equation originally proposed by Lions in his lectures at the Collège de France. Controlling the limit N tends to the infinity of the explicit solution of the N-player game, we highlight the stochastic nature of the limit distributions of the states of the players due to the fact that th… ▽ More We use a simple N-player stochastic game with idiosyncratic and common noises to introduce the concept of Master Equation originally proposed by Lions in his lectures at the Collège de France. Controlling the limit N tends to the infinity of the explicit solution of the N-player game, we highlight the stochastic nature of the limit distributions of the states of the players due to the fact that the random environment does not average out in the limit, and we recast the Mean Field Game (MFG) paradigm in a set of coupled Stochastic Partial Differential Equations (SPDEs). The first one is a forward stochastic Kolmogorov equation giving the evolution of the conditional distributions of the states of the players given the common noise. The second is a form of stochastic Hamilton Jacobi Bellman (HJB) equation providing the solution of the optimization problem when the flow of conditional distributions is given. Being highly coupled, the system reads as an infinite dimensional Forward Backward Stochastic Differential Equation (FBSDE). Uniqueness of a solution and its Markov property lead to the representation of the solution of the backward equation (i.e. the value function of the stochastic HJB equation) as a deterministic function of the solution of the forward Kolmogorov equation, function which is usually called the decoupling field of the FBSDE. The (infinite dimensional) PDE satisfied by this decoupling field is identified with the \textit{master equation}. We also show that this equation can be derived for other large populations equilibriums like those given by the optimal control of McKean-Vlasov stochastic differential equations. The paper is written more in the style of a review than a technical paper, and we spend more time and energy motivating and explaining the probabilistic interpretation of the Master Equation, than identifying the most general set of assumptions under which our claims are true. △ Less

Submitted 29 April, 2014; v1 submitted 18 April, 2014; originally announced April 2014.

Rough paths and 1d sde with a time dependent distributional drift. Application to polymers

Authors: François Delarue, Roland Diel

Abstract: Motivated by the recent advances in the theory of stochastic partial differential equations involving nonlinear functions of distributions, like the Kardar-Parisi-Zhang (KPZ) equation, we reconsider the unique solvability of one-dimensional stochastic differential equations, the drift of which is a distribution, by means of rough paths theory. Existence and uniqueness are established in the weak s… ▽ More Motivated by the recent advances in the theory of stochastic partial differential equations involving nonlinear functions of distributions, like the Kardar-Parisi-Zhang (KPZ) equation, we reconsider the unique solvability of one-dimensional stochastic differential equations, the drift of which is a distribution, by means of rough paths theory. Existence and uniqueness are established in the weak sense when the drift reads as the derivative of a H{ö}lder continuous function. Regularity of the drift part is investigated carefully and a related stochastic calculus is also proposed, which makes the structure of the solutions more explicit than within the earlier framework of Dirichlet processes. △ Less

Submitted 6 March, 2015; v1 submitted 15 February, 2014; originally announced February 2014.

Information Transmission under Random Emission Constraints

Authors: Francis Comets, François Delarue, René Schott

Abstract: We model the transmission of a message on the complete graph with n vertices and limited resources. The vertices of the graph represent servers that may broadcast the message at random. Each server has a random emission capital that decreases at each emission. Quantities of interest are the number of servers that receive the information before the capital of all the informed servers is exhausted a… ▽ More We model the transmission of a message on the complete graph with n vertices and limited resources. The vertices of the graph represent servers that may broadcast the message at random. Each server has a random emission capital that decreases at each emission. Quantities of interest are the number of servers that receive the information before the capital of all the informed servers is exhausted and the exhaustion time. We establish limit theorems (law of large numbers, central limit theorem and large deviation principle), as n tends to infinity, for the proportion of visited vertices before exhaustion and for the total duration. The analysis relies on a construction of the transmission procedure as a dynamical selection of successful nodes in a Galton-Watson tree with respect to the success epochs of the coupon collector problem. △ Less

Submitted 7 October, 2013; v1 submitted 3 September, 2013; originally announced September 2013.

MSC Class: 90B31; 05C81; 60F05; 60F10; 60J20; 92D30

Journal ref: Combinator. Probab. Comp. 23 (2014) 973-1009

Forward-Backward Stochastic Differential Equations and Controlled McKean Vlasov Dynamics

Authors: René Carmona, Francois Delarue

Abstract: The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the connection and the differences between the two sets of problems. We prove a new version of the stochastic maximum principle and give sufficient conditions for exis… ▽ More The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the connection and the differences between the two sets of problems. We prove a new version of the stochastic maximum principle and give sufficient conditions for existence of an optimal control. We also provide examples for which our sufficient conditions for existence of an optimal solution are satisfied. Finally we show that our solution to the control problem provides approximate equilibria for large stochastic games with mean field interactions. △ Less

Submitted 23 March, 2013; originally announced March 2013.

Mean Field Forward-Backward Stochastic Differential Equations

Authors: Rene Carmona, Francois Delarue

Abstract: The purpose of this note is to provide an existence result for the solution of fully coupled Forward Backward Stochastic Differential Equations (FBSDEs) of the mean field type. These equations occur in the study of mean field games and the optimal control of dynamics of the McKean Vlasov type. The purpose of this note is to provide an existence result for the solution of fully coupled Forward Backward Stochastic Differential Equations (FBSDEs) of the mean field type. These equations occur in the study of mean field games and the optimal control of dynamics of the McKean Vlasov type. △ Less

Submitted 17 November, 2012; originally announced November 2012.

Global solvability of a networked integrate-and-fire model of McKean-Vlasov type

Authors: François Delarue, James Inglis, Sylvain Rubenthaler, Etienne Tanré

Abstract: We here investigate the well-posedness of a networked integrate-and-fire model describing an infinite population of neurons which interact with one another through their common statistical distribution. The interaction is of the self-excitatory type as, at any time, the potential of a neuron increases when some of the others fire: precisely, the kick it receives is proportional to the instantaneou… ▽ More We here investigate the well-posedness of a networked integrate-and-fire model describing an infinite population of neurons which interact with one another through their common statistical distribution. The interaction is of the self-excitatory type as, at any time, the potential of a neuron increases when some of the others fire: precisely, the kick it receives is proportional to the instantaneous proportion of firing neurons at the same time. From a mathematical point of view, the coefficient of proportionality, denoted by $α$, is of great importance as the resulting system is known to blow-up for large values of $α$. In the current paper, we focus on the complementary regime and prove that existence and uniqueness hold for all time when $α$ is small enough. △ Less

Submitted 19 June, 2015; v1 submitted 1 November, 2012; originally announced November 2012.

Comments: Published at http://dx.doi.org/10.1214/14-AAP1044 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP1044

Journal ref: Annals of Applied Probability 2015, Vol. 25, No. 4, 2096-2133

Probabilistic Analysis of Mean-Field Games

Authors: Rene Carmona, Francois Delarue

Abstract: The purpose of this paper is to provide a complete probabilistic analysis of a large class of stochastic differential games for which the interaction between the players is of mean-field type. We implement the Mean-Field Games strategy developed analytically by Lasry and Lions in a purely probabilistic framework, relying on tailor-made forms of the stochastic maximum principle. While we assume tha… ▽ More The purpose of this paper is to provide a complete probabilistic analysis of a large class of stochastic differential games for which the interaction between the players is of mean-field type. We implement the Mean-Field Games strategy developed analytically by Lasry and Lions in a purely probabilistic framework, relying on tailor-made forms of the stochastic maximum principle. While we assume that the state dynamics are affine in the states and the controls, our assumptions on the nature of the costs are rather weak, and surprisingly, the dependence of all the coefficients upon the statistical distribution of the states remains of a rather general nature. Our probabilistic approach calls for the solution of systems of forward-backward stochastic differential equations of a McKean-Vlasov type for which no existence result is known, and for which we prove existence and regularity of the corresponding value function. Finally, we prove that solutions of the mean-field game as formulated by Lasry and Lions do indeed provide approximate Nash equilibriums for games with a large number of players, and we quantify the nature of the approximation. △ Less

Submitted 21 October, 2012; originally announced October 2012.

Singular FBSDEs and Scalar Conservation Laws Driven by Diffusion Processes

Authors: Rene Carmona, Francois Delarue

Abstract: Motivated by earlier work on the use of fully-coupled Forward-Backward Stochastic Differential Equations (henceforth FBSDEs) in the analysis of mathematical models for the CO2 emissions markets, the present study is concerned with the analysis of these equations when the generator of the forward equation has a conservative degenerate structure and the terminal condition of the backward equation is… ▽ More Motivated by earlier work on the use of fully-coupled Forward-Backward Stochastic Differential Equations (henceforth FBSDEs) in the analysis of mathematical models for the CO2 emissions markets, the present study is concerned with the analysis of these equations when the generator of the forward equation has a conservative degenerate structure and the terminal condition of the backward equation is a non-smooth function of the terminal value of the forward component. We show that a general form of existence and uniqueness result still holds. When the function giving the terminal condition is binary, we also show that the flow property of the forward component of the solution can fail at the terminal time. In particular, we prove that a Dirac point mass appears in its distribution, exactly at the location of the jump of the binary function giving the terminal condition. We provide a detailed analysis of the breakdown of the Markovian representation of the solution at the terminal time. △ Less

Submitted 21 October, 2012; originally announced October 2012.

Singular Forward-Backward Stochastic Differential Equations and Emissions Derivatives

Authors: Rene Carmona, Francois Delarue, Gilles-Edouard Espinosa, Nizar Touzi

Abstract: We introduce two simple models of forward-backward stochastic differential equations with a singular terminal condition and we explain how and why they appear naturally as models for the valuation of CO2 emission allowances. Single phase cap-and-trade schemes lead readily to terminal conditions given by indicator functions of the forward component, and using fine partial differential equations est… ▽ More We introduce two simple models of forward-backward stochastic differential equations with a singular terminal condition and we explain how and why they appear naturally as models for the valuation of CO2 emission allowances. Single phase cap-and-trade schemes lead readily to terminal conditions given by indicator functions of the forward component, and using fine partial differential equations estimates, we show that the existence theory of these equations, as well as the properties of the candidates for solution, depend strongly upon the characteristics of the forward dynamics. Finally, we give a first order Taylor expansion and show how to numerically calibrate some of these models for the purpose of CO2 option pricing. △ Less

Submitted 21 October, 2012; originally announced October 2012.

Control of McKean-Vlasov Dynamics versus Mean Field Games

Authors: Rene Carmona, Francois Delarue, Aime Lachapelle

Abstract: We discuss and compare two methods of investigations for the asymptotic regime of stochastic differential games with a finite number of players as the number of players tends to the infinity. These two methods differ in the order in which optimization and passage to the limit are performed. When optimizing first, the asymptotic problem is usually referred to as a mean-field game. Otherwise, it rea… ▽ More We discuss and compare two methods of investigations for the asymptotic regime of stochastic differential games with a finite number of players as the number of players tends to the infinity. These two methods differ in the order in which optimization and passage to the limit are performed. When optimizing first, the asymptotic problem is usually referred to as a mean-field game. Otherwise, it reads as an optimization problem over controlled dynamics of McKean-Vlasov type. Both problems lead to the analysis of forward-backward stochastic differential equations, the coefficients of which depend on the marginal distributions of the solutions. We explain the difference between the nature and solutions to the two approaches by investigating the corresponding forward-backward systems. General results are stated and specific examples are treated, especially when cost functionals are of linear-quadratic type. △ Less

Submitted 21 October, 2012; originally announced October 2012.

Probabilistic analysis of the upwind scheme for transport

Authors: Francois Delarue, Frédéric Lagoutière

Abstract: We provide a probabilistic analysis of the upwind scheme for multi-dimensional transport equations. We associate a Markov chain with the numerical scheme and then obtain a backward representation formula of Kolmogorov type for the numerical solution. We then understand that the error induced by the scheme is governed by the fluctuations of the Markov chain around the characteristics of the flow.… ▽ More We provide a probabilistic analysis of the upwind scheme for multi-dimensional transport equations. We associate a Markov chain with the numerical scheme and then obtain a backward representation formula of Kolmogorov type for the numerical solution. We then understand that the error induced by the scheme is governed by the fluctuations of the Markov chain around the characteristics of the flow. We show, in various situations, that the fluctuations are of diffusive type. As a by-product, we prove that the scheme is of order 1/2 for an initial datum in BV and of order 1/2-a, for all a>0, for a Lipschitz continuous initial datum. Our analysis provides a new interpretation of the numerical diffusion phenomenon. △ Less

Submitted 19 December, 2007; originally announced December 2007.

MSC Class: 35L45; 65M15 (Primary) 60J10; 60G42; 60F05 (Secondary)

Journal ref: Archive for Rational Mechanics and Analysis (2011) 229--268

Large Deviations Analysis for Distributed Algorithms in an Ergodic Markovian Environment

Authors: Francis Comets, Francois Delarue, René Schott

Abstract: We provide a large deviations analysis of deadlock phenomena occurring in distributed systems sharing common resources. In our model transition probabilities of resource allocation and deallocation are time and space dependent. The process is driven by an ergodic Markov chain and is reflected on the boundary of the d-dimensional cube. In the large resource limit, we prove Freidlin-Wentzell estim… ▽ More We provide a large deviations analysis of deadlock phenomena occurring in distributed systems sharing common resources. In our model transition probabilities of resource allocation and deallocation are time and space dependent. The process is driven by an ergodic Markov chain and is reflected on the boundary of the d-dimensional cube. In the large resource limit, we prove Freidlin-Wentzell estimates, we study the asymptotic of the deadlock time and we show that the quasi-potential is a viscosity solution of a Hamilton-Jacobi equation with a Neumann boundary condition. We give a complete analysis of the colliding 2-stacks problem and show an example where the system has a stable attractor which is a limit cycle. △ Less

Submitted 17 December, 2007; originally announced December 2007.

MSC Class: (Primary) 60K37; (Secondary) 60F10; 60J10

Journal ref: Applied Mathematics and Optimization 60, 3 (2009) 341--396

A forward--backward stochastic algorithm for quasi-linear PDEs

Authors: François Delarue, Stéphane Menozzi

Abstract: We propose a time-space discretization scheme for quasi-linear parabolic PDEs. The algorithm relies on the theory of fully coupled forward--backward SDEs, which provides an efficient probabilistic representation of this type of equation. The derivated algorithm holds for strong solutions defined on any interval of arbitrary length. As a bypass product, we obtain a discretization procedure for th… ▽ More We propose a time-space discretization scheme for quasi-linear parabolic PDEs. The algorithm relies on the theory of fully coupled forward--backward SDEs, which provides an efficient probabilistic representation of this type of equation. The derivated algorithm holds for strong solutions defined on any interval of arbitrary length. As a bypass product, we obtain a discretization procedure for the underlying FBSDE. In particular, our work provides an alternative to the method described in [Douglas, Ma and Protter (1996) Ann. Appl. Probab. 6 940--968] and weakens the regularity assumptions required in this reference. △ Less

Submitted 10 March, 2006; originally announced March 2006.

Comments: Published at http://dx.doi.org/10.1214/105051605000000674 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP0137 MSC Class: 65C30 (Primary) 35K55; 60H10; 60H35 (Secondary)

Journal ref: Annals of Applied Probability 2006, Vol. 16, No. 1, 140-184

Distributed Algorithms in an Ergodic Markovian Environment

Authors: Francis Comets, Francois Delarue, Rene Schott

Abstract: We provide a probabilistic analysis of the banker algorithm when transition probabilities may depend on time and space. The transition probabilities evolve, as time goes by, along the trajectory of an ergodic Markovian environment, whereas the spatial parameter just acts on long runs. Our model appears as a new (small) step towards more general time and space dependent protocols. Our analysis re… ▽ More We provide a probabilistic analysis of the banker algorithm when transition probabilities may depend on time and space. The transition probabilities evolve, as time goes by, along the trajectory of an ergodic Markovian environment, whereas the spatial parameter just acts on long runs. Our model appears as a new (small) step towards more general time and space dependent protocols. Our analysis relies on well-known results in stochastic homogenization theory and investigates the asymptotic behaviour of the rescaled algorithm as the total amount of resource available for allocation tends to the infinity. In the two dimensional setting, we manage to exhibit three different possible regimes for the deadlock time of the limit system. △ Less

Submitted 6 July, 2005; originally announced July 2005.

MSC Class: AMS. Primary: 68W15; 60K37. Secondary: 60F17; 60J10; 60H10

Auxiliary SDEs for homogenization of quasilinear PDEs with periodic coefficients

Authors: Francois Delarue

Abstract: We study the homogenization property of systems of quasi-linear PDEs of parabolic type with periodic coefficients, highly oscillating drift and highly oscillating nonlinear term. To this end, we propose a probabilistic approach based on the theory of forward-backward stochastic differential equations and introduce the new concept of ``auxiliary SDEs.'' We study the homogenization property of systems of quasi-linear PDEs of parabolic type with periodic coefficients, highly oscillating drift and highly oscillating nonlinear term. To this end, we propose a probabilistic approach based on the theory of forward-backward stochastic differential equations and introduce the new concept of ``auxiliary SDEs.'' △ Less

Submitted 6 October, 2004; originally announced October 2004.

Comments: Published by the Institute of Mathematical Statistics (http://www.imstat.org) in the Annals of Probability (http://www.imstat.org/aop/) at http://dx.doi.org/10.1214/009117904000000144

Report number: IMS-AOP-AOP280 MSC Class: 35B27; 65C30 (Primary) 35K55 (Secondary)

Journal ref: Annals of Probability 2004, Vol. 32, No. 3B, 2305-2361