-
Viability and Exponentially Stable Trajectories for Differential Inclusions in Wasserstein Spaces
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this article, we prove a general viability theorem for continuity inclusions in Wasserstein spaces, and provide an application thereof to the existence of exponentially stable trajectories obtained via the second method of Lyapunov.
In this article, we prove a general viability theorem for continuity inclusions in Wasserstein spaces, and provide an application thereof to the existence of exponentially stable trajectories obtained via the second method of Lyapunov.
△ Less
Submitted 5 June, 2023; v1 submitted 8 September, 2022;
originally announced September 2022.
-
First-Order Pontryagin Maximum Principle for Risk-Averse Stochastic Optimal Control Problems
Authors:
Riccardo Bonalli,
Benoît Bonnet
Abstract:
In this paper, we derive first-order Pontryagin optimality conditions for risk-averse stochastic optimal control problems subject to final time inequality constraints, and whose costs are general, possibly non-smooth finite coherent risk measures. Unlike preexisting contributions covering this situation, our analysis holds for classical stochastic differential equations driven by standard Brownian…
▽ More
In this paper, we derive first-order Pontryagin optimality conditions for risk-averse stochastic optimal control problems subject to final time inequality constraints, and whose costs are general, possibly non-smooth finite coherent risk measures. Unlike preexisting contributions covering this situation, our analysis holds for classical stochastic differential equations driven by standard Brownian motions. In addition, it presents the advantages of neither involving second-order adjoint equations, nor leading to the so-called weak version of the PMP, in which the maximization condition with respect to the control variable is replaced by the stationarity of the Hamiltonian.
△ Less
Submitted 29 May, 2023; v1 submitted 6 April, 2022;
originally announced April 2022.
-
Consensus Formation in First-Order Graphon Models with Time-Varying Topologies
Authors:
Benoît Bonnet,
Nastassia Pouradier Duteil,
Mario Sigalotti
Abstract:
In this article, we investigate the asymptotic formation of consensus for several classes of time-dependent cooperative graphon dynamics. After motivating the use of this type of macroscopic models to describe multi-agent systems, we adapt the classical notion of scrambling coefficient to this setting, leverage it to establish sufficient conditions ensuring the exponential convergence to consensus…
▽ More
In this article, we investigate the asymptotic formation of consensus for several classes of time-dependent cooperative graphon dynamics. After motivating the use of this type of macroscopic models to describe multi-agent systems, we adapt the classical notion of scrambling coefficient to this setting, leverage it to establish sufficient conditions ensuring the exponential convergence to consensus with respect to the $L^{\infty}$-norm topology. We then shift our attention to consensus formation expressed in terms of the $L^2$-norm, and prove three different consensus result for symmetric, balanced and strongly connected topologies, which involve a suitable generalisation of the notion of algebraic connectivity to this infinite-dimensional framework. We then show that, just as in the finite-dimensional setting, the notion of algebraic connectivity that we propose encodes information about the connectivity properties of the underlying interaction topology. We finally use the corresponding results to shed some light on the relation between $L^2$- and $L^{\infty}$-consensus formation, and illustrate our contributions by a series of numerical simulations.
△ Less
Submitted 1 May, 2023; v1 submitted 6 November, 2021;
originally announced November 2021.
-
Semiconcavity and Sensitivity Analysis in Mean-Field Optimal Control and Applications
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this article, we investigate some of the fine properties of the value function associated to an optimal control problem in the Wasserstein space of probability measures. Building on new interpolation and linearisation formulas for non-local flows, we prove semiconcavity estimates for the value function, and establish several variants of the so-called sensitivity relations which provide connecti…
▽ More
In this article, we investigate some of the fine properties of the value function associated to an optimal control problem in the Wasserstein space of probability measures. Building on new interpolation and linearisation formulas for non-local flows, we prove semiconcavity estimates for the value function, and establish several variants of the so-called sensitivity relations which provide connections between its superdifferential and the adjoint curves stemming from the maximum principle. We subsequently make use of these results to study the propagation of regularity for the value function along optimal trajectories, as well as to investigate sufficient optimality conditions and optimal feedbacks for mean-field optimal control problems.
△ Less
Submitted 25 November, 2021; v1 submitted 5 August, 2021;
originally announced August 2021.
-
On the Properties of the Value Function Associated to a Mean-Field Optimal Control Problem of Bolza Type
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this paper, we obtain several structural results for the value function associated to a mean-field optimal control problem of Bolza type in the space of measures. After establishing the sensitivity relations bridging between the costates of the maximum principle and metric superdifferentials of the value function, we investigate semiconcavity properties of this latter with respect to both varia…
▽ More
In this paper, we obtain several structural results for the value function associated to a mean-field optimal control problem of Bolza type in the space of measures. After establishing the sensitivity relations bridging between the costates of the maximum principle and metric superdifferentials of the value function, we investigate semiconcavity properties of this latter with respect to both variables. We then characterise optimal trajectories using set-valued feedback map**s defined in terms of suitable directional derivatives of the value function.
△ Less
Submitted 25 November, 2021; v1 submitted 29 July, 2021;
originally announced July 2021.
-
A Measure Theoretical Approach to the Mean-field Maximum Principle for Training NeurODEs
Authors:
Benoît Bonnet,
Cristina Cipriani,
Massimo Fornasier,
Hui Huang
Abstract:
In this paper we consider a measure-theoretical formulation of the training of NeurODEs in the form of a mean-field optimal control with $L^2$-regularization of the control. We derive first order optimality conditions for the NeurODE training problem in the form of a mean-field maximum principle, and show that it admits a unique control solution, which is Lipschitz continuous in time. As a consequ…
▽ More
In this paper we consider a measure-theoretical formulation of the training of NeurODEs in the form of a mean-field optimal control with $L^2$-regularization of the control. We derive first order optimality conditions for the NeurODE training problem in the form of a mean-field maximum principle, and show that it admits a unique control solution, which is Lipschitz continuous in time. As a consequence of this uniqueness property, the mean-field maximum principle also provides a strong quantitative generalization error for finite sample approximations. Our derivation of the mean-field maximum principle is much simpler than the ones currently available in the literature for mean-field optimal control problems, and is based on a generalized Lagrange multiplier theorem on convex sets of spaces of measures. The latter is also new, and can be considered as a result of independent interest.
△ Less
Submitted 8 April, 2022; v1 submitted 19 July, 2021;
originally announced July 2021.
-
Variance Optimization and Control Regularity for Mean-Field Dynamics
Authors:
Benoît Bonnet,
Francesco Rossi
Abstract:
We study a family of optimal control problems in which one aims at minimizing a cost that mixes a quadratic control penalization and the variance of the system, both for finitely many agents and for the mean-field dynamics as their number goes to infinity. While solutions of the discrete problem always exist in a unique and explicit form, the behavior of their macroscopic counterparts is very sens…
▽ More
We study a family of optimal control problems in which one aims at minimizing a cost that mixes a quadratic control penalization and the variance of the system, both for finitely many agents and for the mean-field dynamics as their number goes to infinity. While solutions of the discrete problem always exist in a unique and explicit form, the behavior of their macroscopic counterparts is very sensitive to the magnitude of the time horizon and penalization parameter.
When one minimizes the final variance, there always exists a Lipschitz-in-space optimal controls for the infinite dimensional problem, which can be obtained as a suitable extension of the optimal controls for the finite-dimensional problems. The same holds true for variance maximizations whenever the time horizon is sufficiently small. On the contrary, for large final times (or equivalently for small penalizations of the control cost), it can be proven that there does not exist Lipschitz-regular optimal controls for the macroscopic problem.
△ Less
Submitted 29 July, 2021; v1 submitted 3 May, 2021;
originally announced May 2021.
-
RoBIC: A benchmark suite for assessing classifiers robustness
Authors:
Thibault Maho,
Benoît Bonnet,
Teddy Furon,
Erwan Le Merrer
Abstract:
Many defenses have emerged with the development of adversarial attacks. Models must be objectively evaluated accordingly. This paper systematically tackles this concern by proposing a new parameter-free benchmark we coin RoBIC. RoBIC fairly evaluates the robustness of image classifiers using a new half-distortion measure. It gauges the robustness of the network against white and black box attacks,…
▽ More
Many defenses have emerged with the development of adversarial attacks. Models must be objectively evaluated accordingly. This paper systematically tackles this concern by proposing a new parameter-free benchmark we coin RoBIC. RoBIC fairly evaluates the robustness of image classifiers using a new half-distortion measure. It gauges the robustness of the network against white and black box attacks, independently of its accuracy. RoBIC is faster than the other available benchmarks. We present the significant differences in the robustness of 16 recent models as assessed by RoBIC.
△ Less
Submitted 22 March, 2023; v1 submitted 10 February, 2021;
originally announced February 2021.
-
Necessary Optimality Conditions for Optimal Control Problems in Wasserstein Spaces
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this article, we derive first-order necessary optimality conditions for a constrained optimal control problem formulated in the Wasserstein space of probability measures. To this end, we introduce a new notion of localised metric subdifferential for compactly supported probability measures, and investigate the intrinsic linearised Cauchy problems associated to non-local continuity equations. In…
▽ More
In this article, we derive first-order necessary optimality conditions for a constrained optimal control problem formulated in the Wasserstein space of probability measures. To this end, we introduce a new notion of localised metric subdifferential for compactly supported probability measures, and investigate the intrinsic linearised Cauchy problems associated to non-local continuity equations. In particular, we show that when the velocity perturbations belong to the tangent cone to the convexification of the set of admissible velocities, the solutions of these linearised problems are tangent to the solution set of the corresponding continuity inclusion. We then make use of these novel concepts to provide a synthetic and geometric proof of the celebrated Pontryagin Maximum Principle for an optimal control problem with inequality final-point constraints. In addition, we propose sufficient conditions ensuring the normality of the maximum principle.
△ Less
Submitted 27 April, 2021; v1 submitted 26 January, 2021;
originally announced January 2021.
-
Adversarial Images through Stega Glasses
Authors:
Benoît Bonnet,
Teddy Furon,
Patrick Bas
Abstract:
This paper explores the connection between steganography and adversarial images. On the one hand, ste-ganalysis helps in detecting adversarial perturbations. On the other hand, steganography helps in forging adversarial perturbations that are not only invisible to the human eye but also statistically undetectable. This work explains how to use these information hiding tools for attacking or defend…
▽ More
This paper explores the connection between steganography and adversarial images. On the one hand, ste-ganalysis helps in detecting adversarial perturbations. On the other hand, steganography helps in forging adversarial perturbations that are not only invisible to the human eye but also statistically undetectable. This work explains how to use these information hiding tools for attacking or defending computer vision image classification. We play this cat and mouse game with state-of-art classifiers, steganalyzers, and steganographic embedding schemes. It turns out that steganography helps more the attacker than the defender.
△ Less
Submitted 15 October, 2020;
originally announced October 2020.
-
Mean-Field Optimal Control of Continuity Equations and Differential Inclusions
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this article, we propose a new unifying framework for the investigation of multi-agent control problems in the mean-field setting. Our approach is based on a new definition of differential inclusions for continuity equations formulated in the Wasserstein spaces of optimal transport. The latter allows to extend several known results of the classical theory of differential inclusions, and to prov…
▽ More
In this article, we propose a new unifying framework for the investigation of multi-agent control problems in the mean-field setting. Our approach is based on a new definition of differential inclusions for continuity equations formulated in the Wasserstein spaces of optimal transport. The latter allows to extend several known results of the classical theory of differential inclusions, and to prove an exact correspondence between solutions of differential inclusions and control systems. We show its appropriateness on an example of leader-follower evacuation problem.
△ Less
Submitted 14 September, 2020;
originally announced September 2020.
-
Differential Inclusions in Wasserstein Spaces: The Cauchy-Lipschitz Framework
Authors:
Benoît Bonnet,
Hélène Frankowska
Abstract:
In this article, we propose a general framework for the study of differential inclusions in the Wasserstein space of probability measures. Based on earlier geometric insights on the structure of continuity equations, we define solutions of differential inclusions as absolutely continuous curves whose driving velocity fields are measurable selections of multifunction taking their values in the spac…
▽ More
In this article, we propose a general framework for the study of differential inclusions in the Wasserstein space of probability measures. Based on earlier geometric insights on the structure of continuity equations, we define solutions of differential inclusions as absolutely continuous curves whose driving velocity fields are measurable selections of multifunction taking their values in the space of vector fields. In this general setting, we prove three of the founding results of the theory of differential inclusions: Filippov's theorem, the Relaxation theorem, and the compactness of the solution sets. These contributions -- which are based on novel estimates on solutions of continuity equations -- are then applied to derive a new existence result for fully non-linear mean-field optimal control problems with closed-loop controls.
△ Less
Submitted 26 July, 2020; v1 submitted 17 July, 2020;
originally announced July 2020.
-
Intrinsic Lipschitz Regularity of Mean-Field Optimal Controls
Authors:
Benoît Bonnet,
Francesco Rossi
Abstract:
In this article, we provide sufficient conditions under which the controlled vector fields solution of optimal control problems formulated on continuity equations are Lipschitz regular in space. Our approach involves a novel combination of mean-field approximations for infinite-dimensional multi-agent optimal control problems, along with a careful extension of an existence result of locally optima…
▽ More
In this article, we provide sufficient conditions under which the controlled vector fields solution of optimal control problems formulated on continuity equations are Lipschitz regular in space. Our approach involves a novel combination of mean-field approximations for infinite-dimensional multi-agent optimal control problems, along with a careful extension of an existence result of locally optimal Lipschitz feedbacks. The latter is based on the reformulation of a coercivity estimate in the language of Wasserstein calculus, which is used to obtain uniform Lipschitz bounds along sequences of approximations by empirical measures.
△ Less
Submitted 7 February, 2021; v1 submitted 12 August, 2019;
originally announced August 2019.
-
Consensus and Flocking under Communication Failures for a Class of Cucker-Smale Systems
Authors:
Benoît Bonnet,
Émilien Flayac
Abstract:
In this paper, we study sufficient conditions for the emergence of asymptotic consensus and flocking in a certain class of non-linear generalised Cucker-Smale systems subject to multiplicative communication failures. Our approach is based on the combination of strict Lyapunov design together with the formulation of a suitable persistence condition for multi-agent systems. The latter can be interpr…
▽ More
In this paper, we study sufficient conditions for the emergence of asymptotic consensus and flocking in a certain class of non-linear generalised Cucker-Smale systems subject to multiplicative communication failures. Our approach is based on the combination of strict Lyapunov design together with the formulation of a suitable persistence condition for multi-agent systems. The latter can be interpreted as a lower bound on the algebraic connectivity of the time-average of the interaction graph generated by the communication weights, and provides quantitative decay estimates for the variance functional along the solutions of the system.
△ Less
Submitted 3 May, 2021; v1 submitted 2 April, 2019;
originally announced April 2019.
-
Generic Singularities of the 3D-Contact sub-Riemannian Conjugate Locus
Authors:
Benoît Bonnet,
Jean-Paul Gauthier,
Francesco Rossi
Abstract:
In this paper, we extend and complete the classification of the generic singularities of the 3D-contact sub-Riemmanian conjugate locus in a neighbourhood of the origin.
In this paper, we extend and complete the classification of the generic singularities of the 3D-contact sub-Riemmanian conjugate locus in a neighbourhood of the origin.
△ Less
Submitted 4 July, 2019; v1 submitted 27 November, 2018;
originally announced December 2018.
-
A Pontryagin Maximum Principle in Wasserstein Spaces for Constrained Optimal Control Problems
Authors:
Benoît Bonnet
Abstract:
In this paper, we prove a Pontryagin Maximum Principle for constrained optimal control problems in the Wasserstein space of probability measures. The dynamics, is described by a transport equation with non-local velocities and is subject to end-point and running state constraints. Building on our previous work, we combine the classical method of needle-variations from geometric control theory and…
▽ More
In this paper, we prove a Pontryagin Maximum Principle for constrained optimal control problems in the Wasserstein space of probability measures. The dynamics, is described by a transport equation with non-local velocities and is subject to end-point and running state constraints. Building on our previous work, we combine the classical method of needle-variations from geometric control theory and the metric differential structure of the Wasserstein spaces to obtain a maximum principle stated in the so-called Gamkrelidze form.
△ Less
Submitted 19 October, 2019; v1 submitted 31 October, 2018;
originally announced October 2018.
-
The Pontryagin Maximum Principle in the Wasserstein Space
Authors:
Benoît Bonnet,
Francesco Rossi
Abstract:
We prove a Pontryagin Maximum Principle for optimal control problems in the space of probability measures, where the dynamics is given by a transport equation with non-local velocity. We formulate this first-order optimality condition using the formalism of subdifferential calculus in Wasserstein spaces. We show that the geometric approach based on needle variations and on the evolution of the cov…
▽ More
We prove a Pontryagin Maximum Principle for optimal control problems in the space of probability measures, where the dynamics is given by a transport equation with non-local velocity. We formulate this first-order optimality condition using the formalism of subdifferential calculus in Wasserstein spaces. We show that the geometric approach based on needle variations and on the evolution of the covector (here replaced by the evolution of a mesure on the dual space) can be translated into this formalism.
△ Less
Submitted 27 February, 2020; v1 submitted 21 November, 2017;
originally announced November 2017.
-
Sparse Control of Kinetic Cooperative Systems to Approximate Alignment
Authors:
Benoît Bonnet,
Francesco Rossi
Abstract:
Cooperative systems are systems in which the forces among agents are non-repulsive. The free evolution of such systems can tend to the formation of patterns, such as consensus or clustering, depending on the properties and intensity of the interaction forces between agents. The kinetic cooperative systems are obtained as the mean field limits of these systems when the number of agents goes to infi…
▽ More
Cooperative systems are systems in which the forces among agents are non-repulsive. The free evolution of such systems can tend to the formation of patterns, such as consensus or clustering, depending on the properties and intensity of the interaction forces between agents. The kinetic cooperative systems are obtained as the mean field limits of these systems when the number of agents goes to infinity. These limit dynamics are described by transport partial differential equations involving non-local terms. In this article, we design a simple and robust control strategy steering any kinetic cooperative system to approximate alignment. The computation of the control at each instant will only require knowledge of the size of the support of the crowd in the phase space and of the Lipschitz constant of the interaction forces. Besides, the control we apply to our system is sparse, in the sense that it acts only on a small portion of the total population at each time. It also presents the features of being obtained through a constructive procedure and to be independent on the number of agents, making it convenient for applications.
△ Less
Submitted 24 February, 2019; v1 submitted 31 March, 2017;
originally announced March 2017.
-
Stabilization of amorphous GaN by oxygen
Authors:
F. Budde,
B. J. Ruck,
A. Koo,
S. Granville,
H. J. Trodahl,
A. Bittar,
G. V. M. Williams,
M. J. Ariza,
B. Bonnet,
D. J. Jones,
J. B. Metson,
S. Rubanov,
P. Munroe
Abstract:
Ion assisted deposition (IAD) has been investigated for the growth of GaN, and the resulting films studied by x-ray diffraction and absorption spectroscopy and by transmission electron microscopy. IAD grown stoichiometric GaN consists of random-stacked quasicrystals of some 3 nm diameter. Amorphous material is formed only by incorporation of 15% or more oxygen, which we attribute to the presence…
▽ More
Ion assisted deposition (IAD) has been investigated for the growth of GaN, and the resulting films studied by x-ray diffraction and absorption spectroscopy and by transmission electron microscopy. IAD grown stoichiometric GaN consists of random-stacked quasicrystals of some 3 nm diameter. Amorphous material is formed only by incorporation of 15% or more oxygen, which we attribute to the presence of non-tetrahedral bonds centered on oxygen. The ionic favourability of heteropolar bonds and its strikingly simple constraint to even-membered rings is the likely cause of the instability of stoichiometric a-GaN.
△ Less
Submitted 26 July, 2004;
originally announced July 2004.
