-
An ordinary differential equation for entropic optimal transport and its linearly constrained variants
Authors:
Joshua Zoen-Git Hiew,
Luca Nenna,
Brendan Pass
Abstract:
We characterize the solution to the entropically regularized optimal transport problem by a well-posed ordinary differential equation (ODE). Our approach works for discrete marginals and general cost functions, and in addition to two marginal problems, applies to multi-marginal problems and those with additional linear constraints. Solving the ODE gives a new numerical method to solve the optimal…
▽ More
We characterize the solution to the entropically regularized optimal transport problem by a well-posed ordinary differential equation (ODE). Our approach works for discrete marginals and general cost functions, and in addition to two marginal problems, applies to multi-marginal problems and those with additional linear constraints. Solving the ODE gives a new numerical method to solve the optimal transport problem, which has the advantage of yielding the solution for all intermediate values of the ODE parameter (which is equivalent to the usual regularization parameter). We illustrate this method with several numerical simulations. The formulation of the ODE also allows one to compute derivatives of the optimal cost when the ODE parameter is $0$, corresponding to the fully regularized limit problem in which only the entropy is minimized.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Convergence rate of entropy-regularized multi-marginal optimal transport costs
Authors:
Luca Nenna,
Paul Pegon
Abstract:
We investigate the convergence rate of multi-marginal optimal transport costs that are regularized with the Boltzmann-Shannon entropy, as the noise parameter $\varepsilon$ tends to $0$. We establish lower and upper bounds on the difference with the unregularized cost of the form $C\varepsilon\log(1/\varepsilon)+O(\varepsilon)$ for some explicit dimensional constants $C$ depending on the marginals…
▽ More
We investigate the convergence rate of multi-marginal optimal transport costs that are regularized with the Boltzmann-Shannon entropy, as the noise parameter $\varepsilon$ tends to $0$. We establish lower and upper bounds on the difference with the unregularized cost of the form $C\varepsilon\log(1/\varepsilon)+O(\varepsilon)$ for some explicit dimensional constants $C$ depending on the marginals and on the ground cost, but not on the optimal transport plans themselves. Upper bounds are obtained for Lipschitz costs or locally semi-concave costs for a finer estimate, and lower bounds for $\mathscr{C}^2$ costs satisfying some signature condition on the mixed second derivatives that may include degenerate costs, thus generalizing results previously in the two marginals case and for non-degenerate costs. We obtain in particular matching bounds in some typical situations where the optimal plan is deterministic.
△ Less
Submitted 9 April, 2024; v1 submitted 6 July, 2023;
originally announced July 2023.
-
A sparse approximation of the Lieb functional with moment constraints
Authors:
Virginie Ehrlacher,
Luca Nenna
Abstract:
The aim of this paper is to present new sparsity results about the so-called Lieb functional, which is a key quantity in Density Functional Theory for electronic structure calculations of molecules. The Lieb functional was actually shown by Lieb to be a convexification of the so-called Lévy-Lieb functional. Given an electronic density for a system of $N$ electrons, which may be seen as a probabili…
▽ More
The aim of this paper is to present new sparsity results about the so-called Lieb functional, which is a key quantity in Density Functional Theory for electronic structure calculations of molecules. The Lieb functional was actually shown by Lieb to be a convexification of the so-called Lévy-Lieb functional. Given an electronic density for a system of $N$ electrons, which may be seen as a probability density on $\mathbb{R}^3$, the value of the Lieb functional for this density is defined as the solution of a quantum multi-marginal optimal transport problem, which reads as a minimization problem defined on the set of trace-class operators acting on the space of electronic wave-functions that are anti-symmetric $L^2$ functions of $\mathbb{R}^{3N}$, with partial trace equal to the prescribed electronic density. We introduce a relaxation of this quantum optimal transport problem where the full partial trace constraint is replaced by a finite number of moment constraints on the partial trace of the set of operators. We show that, under mild assumptions on the electronic density, there exist sparse minimizers to the resulting moment constrained approximation of the Lieb (MCAL) functional that read as operators with rank at most equal to the number of moment constraints. We also prove under appropriate assumptions on the set of moment functions that the value of the MCAL functional converges to the value of the exact Lieb functional as the number of moments go to infinity. We also prove some rates of convergence on the associated approximation of the ground state energy. We finally study the mathematical properties of the associated dual problem and introduce a suitable numerical algorithm in order to solve some simple toy models.
△ Less
Submitted 17 June, 2024; v1 submitted 1 June, 2023;
originally announced June 2023.
-
Universal diagonal estimates for minimizers of the Levy-Lieb functional
Authors:
Simone Di Marino,
Augusto Gerolin,
Luca Nenna
Abstract:
Given a wave-function minimizing the Levy-Lieb functional, the intent of this short note is to give an estimate of the probability of the particles being in positions $(x_1, \ldots, x_N)$ in the $δ$-close regime $D_δ= \cup_{i \neq j} \{|x_i - x_j| \leq δ\}$.
Given a wave-function minimizing the Levy-Lieb functional, the intent of this short note is to give an estimate of the probability of the particles being in positions $(x_1, \ldots, x_N)$ in the $δ$-close regime $D_δ= \cup_{i \neq j} \{|x_i - x_j| \leq δ\}$.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
An ODE characterisation of multi-marginal optimal transport with pairwise cost functions
Authors:
Luca Nenna,
Brendan Pass
Abstract:
The purpose of this paper is to introduce a new numerical method to solve multi-marginal optimal transport problems with pairwise interaction costs. The complexity of multi-marginal optimal transport generally scales exponentially in the number of marginals $m$. We introduce a one parameter family of cost functions that interpolates between the original and a special cost function for which the pr…
▽ More
The purpose of this paper is to introduce a new numerical method to solve multi-marginal optimal transport problems with pairwise interaction costs. The complexity of multi-marginal optimal transport generally scales exponentially in the number of marginals $m$. We introduce a one parameter family of cost functions that interpolates between the original and a special cost function for which the problem's complexity scales linearly in $m$. We then show that the solution to the original problem can be recovered by solving an ordinary differential equation in the parameter $ε$, whose initial condition corresponds to the solution for the special cost function mentioned above; we then present some simulations, using both explicit Euler and explicit higher order Runge-Kutta schemes to compute solutions to the ODE, and, as a result, the multi-marginal optimal transport problem.
△ Less
Submitted 5 August, 2023; v1 submitted 23 December, 2022;
originally announced December 2022.
-
Robust risk management via multi-marginal optimal transport
Authors:
Hamza Ennaji,
Quentin Mérigot,
Luca Nenna,
Brendan Pass
Abstract:
We study the problem of maximizing a spectral risk measure of a given output function which depends on several underlying variables, whose individual distributions are known but whose joint distribution is not. We establish and exploit an equivalence between this problem and a multi-marginal optimal transport problem. We use this reformulation to establish explicit, closed form solutions when the…
▽ More
We study the problem of maximizing a spectral risk measure of a given output function which depends on several underlying variables, whose individual distributions are known but whose joint distribution is not. We establish and exploit an equivalence between this problem and a multi-marginal optimal transport problem. We use this reformulation to establish explicit, closed form solutions when the underlying variables are one dimensional, for a large class of output functions. For higher dimensional underlying variables, we identify conditions on the output function and marginal distributions under which solutions concentrate on graphs over the first variable and are unique, and, for general output functions, we find upper bounds on the dimension of the support of the solution. We also establish a stability result on the maximal value and maximizing joint distributions when the output function, marginal distributions and spectral function are perturbed; in addition, when the variables one dimensional, we show that the optimal value exhibits Lipschitz dependence on the marginal distributions for a certain class of output functions. Finally, we show that the equivalence to a multi-marginal optimal transport problem extends to maximal correlation measures of multi-dimensional risks; in this setting, we again establish conditions under which the solution concentrates on a graph over the first marginal.
△ Less
Submitted 14 November, 2022;
originally announced November 2022.
-
A note on Cournot-Nash equilibria and Optimal Transport between unequal dimensions
Authors:
Luca Nenna,
Brendan Pass
Abstract:
This note is devoted to study a class of games with a continuum of players for which Cournot-Nash equilibria can be obtained by minimisation of some cost related to Optimal Transport. In particular we focus on the case of an Optimal Transport term between unequal dimension. We also present several numerical simulations.
This note is devoted to study a class of games with a continuum of players for which Cournot-Nash equilibria can be obtained by minimisation of some cost related to Optimal Transport. In particular we focus on the case of an Optimal Transport term between unequal dimension. We also present several numerical simulations.
△ Less
Submitted 29 September, 2022;
originally announced September 2022.
-
Grand-Canonical Optimal Transport
Authors:
Simone Di Marino,
Mathieu Lewin,
Luca Nenna
Abstract:
We study a generalization of the multi-marginal optimal transport problem, which has no fixed number of marginals $N$ and is inspired of statistical mechanics. It consists in optimizing a linear combination of the costs for all the possible $N$'s, while fixing a certain linear combination of the corresponding marginals.
We study a generalization of the multi-marginal optimal transport problem, which has no fixed number of marginals $N$ and is inspired of statistical mechanics. It consists in optimizing a linear combination of the costs for all the possible $N$'s, while fixing a certain linear combination of the corresponding marginals.
△ Less
Submitted 19 January, 2022; v1 submitted 18 January, 2022;
originally announced January 2022.
-
Transport type metrics on the space of probability measures involving singular base measures
Authors:
Luca Nenna,
Brendan Pass
Abstract:
We develop the theory of a metric, which we call the $ν$-based Wasserstein metric and denote by $W_ν$, on the set of probability measures $\mathcal P(X)$ on a domain $X \subseteq \mathbb{R}^m$. This metric is based on a slight refinement of the notion of generalized geodesics with respect to a base measure $ν$ and is relevant in particular for the case when $ν$ is singular with respect to $m$-dime…
▽ More
We develop the theory of a metric, which we call the $ν$-based Wasserstein metric and denote by $W_ν$, on the set of probability measures $\mathcal P(X)$ on a domain $X \subseteq \mathbb{R}^m$. This metric is based on a slight refinement of the notion of generalized geodesics with respect to a base measure $ν$ and is relevant in particular for the case when $ν$ is singular with respect to $m$-dimensional Lebesgue measure; it is also closely related to the concept of linearized optimal transport. The $ν$-based Wasserstein metric is defined in terms of an iterated variational problem involving optimal transport to $ν$; we also characterize it in terms of integrations of classical Wasserstein distance between the conditional probabilities and through limits of certain multi-marginal optimal transport problems. As we vary the base measure $ν$, the $ν$-based Wasserstein metric interpolates between the usual quadratic Wasserstein distance and a metric associated with the uniquely defined generalized geodesics obtained when $ν$ is sufficiently regular. When $ν$ concentrates on a lower dimensional submanifold of $\mathbb{R}^m$, we prove that the variational problem in the definition of the $ν$-based Wasserstein distance has a unique solution. We establish geodesic convexity of the usual class of functionals and of the set of source measures $μ$ such that optimal transport between $μ$ and $ν$ satisfies a strengthening of the generalized nestedness condition introduced in \cite{McCannPass20}.We finally introduce a slight variant of the dual metric mentioned above in order to prove convergence of an iterative scheme to solve a variational problem arising in game theory.
△ Less
Submitted 15 September, 2022; v1 submitted 3 January, 2022;
originally announced January 2022.
-
Variational problems involving unequal dimensional optimal transport
Authors:
Luca Nenna,
Brendan Pass
Abstract:
This paper is devoted to variational problems on the set of probability measures which involve optimal transport between unequal dimensional spaces. In particular, we study the minimization of a functional consisting of the sum of a term reflecting the cost of (unequal dimensional) optimal transport between one fixed and one free marginal, and another functional of the free marginal (of various fo…
▽ More
This paper is devoted to variational problems on the set of probability measures which involve optimal transport between unequal dimensional spaces. In particular, we study the minimization of a functional consisting of the sum of a term reflecting the cost of (unequal dimensional) optimal transport between one fixed and one free marginal, and another functional of the free marginal (of various forms). Motivating applications include Cournot-Nash equilibria where the strategy space is lower dimensional than the space of agent types. For a variety of different forms of the term described above, we show that a nestedness condition, which is known to yield much improved tractability of the optimal transport problem, holds for any minimizer. Depending on the exact form of the functional, we exploit this to find local differential equations characterizing solutions, prove convergence of an iterative scheme to compute the solution, and prove regularity results.
△ Less
Submitted 15 November, 2019; v1 submitted 1 April, 2019;
originally announced April 2019.
-
An entropy minimization approach to second-order variational mean-field games
Authors:
Jean-David Benamou,
Guillaume Carlier,
Simone Di Marino,
Luca Nenna
Abstract:
We propose a new viewpoint on variational mean-field games with diffusion and quadratic Hamiltonian. We show the equivalence of such mean-field games with a relative entropy minimization at the level of probabilities on curves. We also address the time-discretization of such problems, establish $Γ$-convergence results as the time step vanishes and propose an efficient algorithm relying on this ent…
▽ More
We propose a new viewpoint on variational mean-field games with diffusion and quadratic Hamiltonian. We show the equivalence of such mean-field games with a relative entropy minimization at the level of probabilities on curves. We also address the time-discretization of such problems, establish $Γ$-convergence results as the time step vanishes and propose an efficient algorithm relying on this entropic interpretation as well as on the Sinkhorn scaling algorithm.
△ Less
Submitted 29 March, 2019; v1 submitted 24 July, 2018;
originally announced July 2018.
-
Generalized incompressible flows, multi-marginal transport and Sinkhorn algorithm
Authors:
Jean-David Benamou,
Guillaume Carlier,
Luca Nenna
Abstract:
Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic regularization of optimal transport. We also make a detailed comparison of this entropic regularization with the so-called Bredinger entropic interpolation problem. Num…
▽ More
Starting from Brenier's relaxed formulation of the incompressible Euler equation in terms of geodesics in the group of measure-preserving diffeomorphisms, we propose a numerical method based on Sinkhorn's algorithm for the entropic regularization of optimal transport. We also make a detailed comparison of this entropic regularization with the so-called Bredinger entropic interpolation problem. Numerical results in dimension one and two illustrate the feasibility of the method.
△ Less
Submitted 5 March, 2018; v1 submitted 23 October, 2017;
originally announced October 2017.
-
The strictly-correlated electron functional for spherically symmetric systems revisited
Authors:
Michael Seidl,
Simone Di Marino,
Augusto Gerolin,
Luca Nenna,
Klaas J. H. Giesbertz,
Paola Gori-Giorgi
Abstract:
The strong-interaction limit of the Hohenberg-Kohn functional defines a multimarginal optimal transport problem with Coulomb cost. From physical arguments, the solution of this limit is expected to yield strictly-correlated particle positions, related to each other by co-motion functions (or optimal maps), but the existence of such a deterministic solution in the general three-dimensional case is…
▽ More
The strong-interaction limit of the Hohenberg-Kohn functional defines a multimarginal optimal transport problem with Coulomb cost. From physical arguments, the solution of this limit is expected to yield strictly-correlated particle positions, related to each other by co-motion functions (or optimal maps), but the existence of such a deterministic solution in the general three-dimensional case is still an open question. A conjecture for the co-motion functions for radially symmetric densities was presented in Phys.~Rev.~A {\bf 75}, 042511 (2007), and later used to build approximate exchange-correlation functionals for electrons confined in low-density quantum dots. Colombo and Stra [Math.~Models Methods Appl.~Sci., {\bf 26} 1025 (2016)] have recently shown that these conjectured maps are not always optimal. Here we revisit the whole issue both from the formal and numerical point of view, finding that even if the conjectured maps are not always optimal, they still yield an interaction energy (cost) that is numerically very close to the true minimum. We also prove that the functional built from the conjectured maps has the expected functional derivative also when they are not optimal.
△ Less
Submitted 16 February, 2017;
originally announced February 2017.
-
Computation of Cournot-Nash equilibria by entropic regularization
Authors:
Adrien Blanchet,
Guillaume Carlier,
Luca Nenna
Abstract:
We consider a class of games with continuum of players where equilibria can be obtained by the minimization of a certain functional related to optimal transport as emphasized in [7]. We then use the powerful entropic regularization technique to approximate the problem and solve it numerically in various cases. We also consider the extension to some models with several populations of players.
We consider a class of games with continuum of players where equilibria can be obtained by the minimization of a certain functional related to optimal transport as emphasized in [7]. We then use the powerful entropic regularization technique to approximate the problem and solve it numerically in various cases. We also consider the extension to some models with several populations of players.
△ Less
Submitted 9 September, 2016;
originally announced September 2016.
-
Optimal Transportation Theory with Repulsive Costs
Authors:
Simone Di Marino,
Augusto Gerolin,
Luca Nenna
Abstract:
This paper intents to present the state of art and recent developments of the optimal transportation theory with many marginals for a class of repulsive cost functions. We introduce some aspects of the Density Functional Theory (DFT) from a mathematical point of view, and revisit the theory of optimal transport from its perspective. Moreover, in the last three sections, we describe some recent and…
▽ More
This paper intents to present the state of art and recent developments of the optimal transportation theory with many marginals for a class of repulsive cost functions. We introduce some aspects of the Density Functional Theory (DFT) from a mathematical point of view, and revisit the theory of optimal transport from its perspective. Moreover, in the last three sections, we describe some recent and new theoretical and numerical results obtained for the Coulomb cost, the repulsive harmonic cost and the determinant cost.
△ Less
Submitted 1 December, 2015; v1 submitted 15 June, 2015;
originally announced June 2015.
-
A Numerical Method to solve Optimal Transport Problems with Coulomb Cost
Authors:
Jean-David Benamou,
Guillaume Carlier,
Luca Nenna
Abstract:
In this paper, we present a numerical method, based on iterative Bregman projections, to solve the optimal transport problem with Coulomb cost. This is related to the strong interaction limit of Density Functional Theory. The first idea is to introduce an entropic regularization of the Kantorovich formulation of the Optimal Transport problem. The regularized problem then corresponds to the project…
▽ More
In this paper, we present a numerical method, based on iterative Bregman projections, to solve the optimal transport problem with Coulomb cost. This is related to the strong interaction limit of Density Functional Theory. The first idea is to introduce an entropic regularization of the Kantorovich formulation of the Optimal Transport problem. The regularized problem then corresponds to the projection of a vector on the intersection of the constraints with respect to the Kullback-Leibler distance. Iterative Bregman projections on each marginal constraint are explicit which enables us to approximate the optimal transport plan. We validate the numerical method against analytical test cases.
△ Less
Submitted 7 May, 2015; v1 submitted 5 May, 2015;
originally announced May 2015.
-
Iterative Bregman Projections for Regularized Transportation Problems
Authors:
Jean-David Benamou,
Guillaume Carlier,
Marco Cuturi,
Luca Nenna,
Gabriel Peyré
Abstract:
This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized problem corresponds to a Kullback-Leibler Bregman di-vergence projection of a vector (representing some initial joint distribu-tion) on the polytope of constraints. W…
▽ More
This article details a general numerical framework to approximate so-lutions to linear programs related to optimal transport. The general idea is to introduce an entropic regularization of the initial linear program. This regularized problem corresponds to a Kullback-Leibler Bregman di-vergence projection of a vector (representing some initial joint distribu-tion) on the polytope of constraints. We show that for many problems related to optimal transport, the set of linear constraints can be split in an intersection of a few simple constraints, for which the projections can be computed in closed form. This allows us to make use of iterative Bregman projections (when there are only equality constraints) or more generally Bregman-Dykstra iterations (when inequality constraints are in-volved). We illustrate the usefulness of this approach to several variational problems related to optimal transport: barycenters for the optimal trans-port metric, tomographic reconstruction, multi-marginal optimal trans-port and in particular its application to Brenier's relaxed solutions of in-compressible Euler equations, partial un-balanced optimal transport and optimal transport with capacity constraints.
△ Less
Submitted 16 December, 2014;
originally announced December 2014.
