-
From entropic transport to martingale transport, and applications to model calibration
Authors:
Jean-David Benamou,
Guillaume Chazareix,
Grégoire Loeper
Abstract:
We propose a discrete time formulation of the semi martingale optimal transport problembased on multi-marginal entropic transport. This approach offers a new way to formulate and solve numerically the calibration problem proposed by Guo et al. 2022, using a multi-marginal extension of Sinkhorn algorithm as in Benamou, Carlier, and Nenna 2019; Carlier et al. 2017; Benamou et al. 2019. In the limit…
▽ More
We propose a discrete time formulation of the semi martingale optimal transport problembased on multi-marginal entropic transport. This approach offers a new way to formulate and solve numerically the calibration problem proposed by Guo et al. 2022, using a multi-marginal extension of Sinkhorn algorithm as in Benamou, Carlier, and Nenna 2019; Carlier et al. 2017; Benamou et al. 2019. In the limit when the time step goes to zero we recover, as detailed in the companion paper Benamou et al. 2024, a semi-martingale process, solution to a semi-martingale optimal transport problem, with a cost function involving the so-called specific entropy introduced in Gantert 1991, see also F{ö}llmer 2022 and Backhoff-Veraguas and Unterberger 2023.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
An entropy minimization approach to second-order variational mean-field games
Authors:
Jean-David Benamou,
Guillaume Carlier,
Simone Di Marino,
Luca Nenna
Abstract:
We propose a new viewpoint on variational mean-field games with diffusion and quadratic Hamiltonian. We show the equivalence of such mean-field games with a relative entropy minimization at the level of probabilities on curves. We also address the time-discretization of such problems, establish $Γ$-convergence results as the time step vanishes and propose an efficient algorithm relying on this ent…
▽ More
We propose a new viewpoint on variational mean-field games with diffusion and quadratic Hamiltonian. We show the equivalence of such mean-field games with a relative entropy minimization at the level of probabilities on curves. We also address the time-discretization of such problems, establish $Γ$-convergence results as the time step vanishes and propose an efficient algorithm relying on this entropic interpretation as well as on the Sinkhorn scaling algorithm.
△ Less
Submitted 29 March, 2019; v1 submitted 24 July, 2018;
originally announced July 2018.
-
Second order models for optimal transport and cubic splines on the Wasserstein space
Authors:
Jean-David Benamou,
Thomas Gallouët,
François-Xavier Vialard
Abstract:
On the space of probability densities, we extend the Wasserstein geodesics to the case of higher-order interpolation such as cubic spline interpolation. After presenting the natural extension of cubic splines to the Wasserstein space, we propose a simpler approach based on the relaxation of the variational problem on the path space. We explore two different numerical approaches, one based on multi…
▽ More
On the space of probability densities, we extend the Wasserstein geodesics to the case of higher-order interpolation such as cubic spline interpolation. After presenting the natural extension of cubic splines to the Wasserstein space, we propose a simpler approach based on the relaxation of the variational problem on the path space. We explore two different numerical approaches, one based on multi-marginal optimal transport and entropic regularization and the other based on semi-discrete optimal transport.
△ Less
Submitted 26 July, 2018; v1 submitted 12 January, 2018;
originally announced January 2018.
-
Generalized incompressible flows, multi-marginal transport and Sinkhorn algorithm
Authors:
Jean-David Benamou,
Guillaume Carlier,
Luca Nenna
Abstract:
Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic regularization of optimal transport. We also make a detailed comparison of this entropic regularization with the so-called Bredinger entropic interpolation problem. Num…
▽ More
Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic regularization of optimal transport. We also make a detailed comparison of this entropic regularization with the so-called Bredinger entropic interpolation problem. Numerical results in dimension one and two illustrate the feasibility of the method.
△ Less
Submitted 5 March, 2018; v1 submitted 23 October, 2017;
originally announced October 2017.
-
Minimal convex extensions and finite difference discretization of the quadratic Monge-Kantorovich problem
Authors:
Jean-David Benamou,
Vincent Duval
Abstract:
We present an adaptation of the MA-LBR scheme to the Monge-Amp{è}re equation with second boundary value condition, provided the target is a convex set. This yields a fast adaptive method to numerically solve the Optimal Transport problem between two absolutely continuous measures, the second of which has convex support. The proposed numerical method actually captures a specific Brenier solution wh…
▽ More
We present an adaptation of the MA-LBR scheme to the Monge-Amp{è}re equation with second boundary value condition, provided the target is a convex set. This yields a fast adaptive method to numerically solve the Optimal Transport problem between two absolutely continuous measures, the second of which has convex support. The proposed numerical method actually captures a specific Brenier solution which is minimal in some sense. We prove the convergence of the method as the grid stepsize vanishes and we show with numerical experiments that it is able to reproduce subtle properties of the Optimal Transport problem.
△ Less
Submitted 18 July, 2018; v1 submitted 16 October, 2017;
originally announced October 2017.
-
A Numerical Method to solve Optimal Transport Problems with Coulomb Cost
Authors:
Jean-David Benamou,
Guillaume Carlier,
Luca Nenna
Abstract:
In this paper, we present a numerical method, based on iterative Bregman projections, to solve the optimal transport problem with Coulomb cost. This is related to the strong interaction limit of Density Functional Theory. The first idea is to introduce an entropic regularization of the Kantorovich formulation of the Optimal Transport problem. The regularized problem then corresponds to the project…
▽ More
In this paper, we present a numerical method, based on iterative Bregman projections, to solve the optimal transport problem with Coulomb cost. This is related to the strong interaction limit of Density Functional Theory. The first idea is to introduce an entropic regularization of the Kantorovich formulation of the Optimal Transport problem. The regularized problem then corresponds to the projection of a vector on the intersection of the constraints with respect to the Kullback-Leibler distance. Iterative Bregman projections on each marginal constraint are explicit which enables us to approximate the optimal transport plan. We validate the numerical method against analytical test cases.
△ Less
Submitted 7 May, 2015; v1 submitted 5 May, 2015;
originally announced May 2015.
-
Iterative Bregman Projections for Regularized Transportation Problems
Authors:
Jean-David Benamou,
Guillaume Carlier,
Marco Cuturi,
Luca Nenna,
Gabriel Peyré
Abstract:
This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized problem corresponds to a Kullback-Leibler Bregman di-vergence projection of a vector (representing some initial joint distribu-tion) on the polytope of constraints. W…
▽ More
This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized problem corresponds to a Kullback-Leibler Bregman di-vergence projection of a vector (representing some initial joint distribu-tion) on the polytope of constraints. We show that for many problems related to optimal transport, the set of linear constraints can be split in an intersection of a few simple constraints, for which the projections can be computed in closed form. This allows us to make use of iterative Bregman projections (when there are only equality constraints) or more generally Bregman-Dykstra iterations (when inequality constraints are in-volved). We illustrate the usefulness of this approach to several variational problems related to optimal transport: barycenters for the optimal trans-port metric, tomographic reconstruction, multi-marginal optimal trans-port and in particular its application to Brenier's relaxed solutions of in-compressible Euler equations, partial un-balanced optimal transport and optimal transport with capacity constraints.
△ Less
Submitted 16 December, 2014;
originally announced December 2014.
-
Monotone and Consistent discretization of the Monge-Ampere operator
Authors:
Jean-David Benamou,
Francis Collino,
Jean-Marie Mirebeau
Abstract:
We introduce a novel discretization of the Monge-Ampere operator, simultaneously consistent and degenerate elliptic, hence accurate and robust in applications. These properties are achieved by exploiting the arithmetic structure of the discrete domain, assumed to be a two dimensional cartesian grid. The construction of our scheme is simple, but its analysis relies on original tools seldom encounte…
▽ More
We introduce a novel discretization of the Monge-Ampere operator, simultaneously consistent and degenerate elliptic, hence accurate and robust in applications. These properties are achieved by exploiting the arithmetic structure of the discrete domain, assumed to be a two dimensional cartesian grid. The construction of our scheme is simple, but its analysis relies on original tools seldom encountered in numerical analysis, such as the geometry of two dimensional lattices, and an arithmetic structure called the Stern-Brocot tree. Numerical experiments illustrate the method's efficiency.
△ Less
Submitted 23 September, 2014;
originally announced September 2014.
-
Discretization of functionals involving the Monge-Ampère operator
Authors:
Jean-David Benamou,
Guillaume Carlier,
Quentin Mérigot,
Edouard Oudet
Abstract:
Gradient flows in the Wasserstein space have become a powerful tool in the analysis of diffusion equations, following the seminal work of Jordan, Kinderlehrer and Otto (JKO). The numerical applications of this formulation have been limited by the difficulty to compute the Wasserstein distance in dimension >= 2. One step of the JKO scheme is equivalent to a variational problem on the space of conve…
▽ More
Gradient flows in the Wasserstein space have become a powerful tool in the analysis of diffusion equations, following the seminal work of Jordan, Kinderlehrer and Otto (JKO). The numerical applications of this formulation have been limited by the difficulty to compute the Wasserstein distance in dimension >= 2. One step of the JKO scheme is equivalent to a variational problem on the space of convex functions, which involves the Monge-Ampère operator. Convexity constraints are notably difficult to handle numerically, but in our setting the internal energy plays the role of a barrier for these constraints. This enables us to introduce a consistent discretization, which inherits convexity properties of the continuous variational problem. We show the effectiveness of our approach on nonlinear diffusion and crowd-motion models.
△ Less
Submitted 20 August, 2014;
originally announced August 2014.
-
A viscosity framework for computing Pogorelov solutions of the Monge-Ampere equation
Authors:
Jean-David Benamou,
Brittany D. Froese
Abstract:
We consider the Monge-Kantorovich optimal transportation problem between two measures, one of which is a weighted sum of Diracs. This problem is traditionally solved using expensive geometric methods. It can also be reformulated as an elliptic partial differential equation known as the Monge-Ampere equation. However, existing numerical methods for this non-linear PDE require the measures to have f…
▽ More
We consider the Monge-Kantorovich optimal transportation problem between two measures, one of which is a weighted sum of Diracs. This problem is traditionally solved using expensive geometric methods. It can also be reformulated as an elliptic partial differential equation known as the Monge-Ampere equation. However, existing numerical methods for this non-linear PDE require the measures to have finite density. We introduce a new formulation that couples the viscosity and Aleksandrov solution definitions and show that it is equivalent to the original problem. Moreover, we describe a local reformulation of the subgradient measure at the Diracs, which makes use of one-sided directional derivatives. This leads to a consistent, monotone discretisation of the equation. Computational results demonstrate the correctness of this scheme when methods designed for conventional viscosity solutions fail.
△ Less
Submitted 1 August, 2014; v1 submitted 4 July, 2014;
originally announced July 2014.
-
A viscosity solution approach to the Monge-Ampere formulation of the Optimal Transportation Problem
Authors:
Jean-David Benamou,
Brittany D. Froese,
Adam M. Oberman
Abstract:
In this work we present a numerical method for the Optimal Mass Transportation problem. Optimal Mass Transportation (OT) is an active research field in mathematics.It has recently led to significant theoretical results as well as applications in diverse areas. Numerical solution techniques for the OT problem remain underdeveloped. The solution is obtained by solving the second boundary value probl…
▽ More
In this work we present a numerical method for the Optimal Mass Transportation problem. Optimal Mass Transportation (OT) is an active research field in mathematics.It has recently led to significant theoretical results as well as applications in diverse areas. Numerical solution techniques for the OT problem remain underdeveloped. The solution is obtained by solving the second boundary value problem for the MA equation, a fully nonlinear elliptic partial differential equation (PDE). Instead of standard boundary conditions the problem has global state constraints. These are reformulated as a tractable local PDE. We give a proof of convergence of the numerical method, using the theory of viscosity solutions. Details of the implementation and a fast solution method are provided in the companion paper arXiv:1208.4870.
△ Less
Submitted 2 August, 2013; v1 submitted 23 August, 2012;
originally announced August 2012.
-
Numerical solution of the Optimal Transportation problem using the Monge-Ampere equation
Authors:
Jean-David Benamou,
Brittany D. Froese,
Adam M. Oberman
Abstract:
A numerical method for the solution of the elliptic Monge-Ampere Partial Differential Equation, with boundary conditions corresponding to the Optimal Transportation (OT) problem is presented. A local representation of the OT boundary conditions is combined with a finite difference scheme for the Monge-Ampere equation. Newton's method is implemented leading to a fast solver, comparable to solving t…
▽ More
A numerical method for the solution of the elliptic Monge-Ampere Partial Differential Equation, with boundary conditions corresponding to the Optimal Transportation (OT) problem is presented. A local representation of the OT boundary conditions is combined with a finite difference scheme for the Monge-Ampere equation. Newton's method is implemented leading to a fast solver, comparable to solving the Laplace equation on the same grid several times. Theoretical justification for the method is given by a convergence proof in the companion paper (Benamou et al., 2012). In this paper, the algorithm is modified to a simpler compact stencil implementation and details of the implementation are given. Solutions are computed with densities supported on non-convex and disconnected domains. Computational examples demonstrate robust performance on singular solutions and fast computational times.
△ Less
Submitted 23 August, 2012;
originally announced August 2012.
