-
A multiscale Consensus-Based algorithm for multi-level optimization
Authors:
Michael Herty,
Yuyang Huang,
Dante Kalise,
Hicham Kouhkouh
Abstract:
A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting populations of particles, each of which is used to optimize one level of the problem. These particle populations are evolved through multiscale-in-time dynamic…
▽ More
A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting populations of particles, each of which is used to optimize one level of the problem. These particle populations are evolved through multiscale-in-time dynamics, which are formulated as a singularly perturbed system of stochastic differential equations. Theoretical convergence analysis for the multiscale CBO model to an averaged effective dynamics as the time-scale separation parameter approaches zero is provided. The resulting algorithm is presented for both bi-level and tri-level optimization problems. The effectiveness of the approach in tackling complex multi-level optimization tasks is demonstrated through numerical experiments on various benchmark functions. Additionally, it is shown that the proposed method performs well on min-max optimization problems, comparing favorably with existing CBO algorithms for saddle point problems.
△ Less
Submitted 12 July, 2024;
originally announced July 2024.
-
Computation and Control of Unstable Steady States for Mean Field Multiagent Systems
Authors:
Sara Bicego,
Dante Kalise,
Grigorios A. Pavliotis
Abstract:
We study interacting particle systems driven by noise, modeling phenomena such as opinion dynamics. We are interested in systems that exhibit phase transitions i.e. non-uniqueness of stationary states for the corresponding McKean-Vlasov PDE, in the mean field limit. We develop an efficient numerical scheme for identifying all steady states (both stable and unstable) of the mean field McKean-Vlasov…
▽ More
We study interacting particle systems driven by noise, modeling phenomena such as opinion dynamics. We are interested in systems that exhibit phase transitions i.e. non-uniqueness of stationary states for the corresponding McKean-Vlasov PDE, in the mean field limit. We develop an efficient numerical scheme for identifying all steady states (both stable and unstable) of the mean field McKean-Vlasov PDE, based on a spectral Galerkin approximation combined with a deflated Newton's method to handle the multiplicity of solutions. Having found all possible equilibra, we formulate an optimal control strategy for steering the dynamics towards a chosen unstable steady state. The control is computed using iterated open-loop solvers in a receding horizon fashion. We demonstrate the effectiveness of the proposed steady state computation and stabilization methodology on several examples, including the noisy Hegselmann-Krause model for opinion dynamics and the Haken-Kelso-Bunz model from biophysics. The numerical experiments validate the ability of the approach to capture the rich self-organization landscape of these systems and to stabilize unstable configurations of interest. The proposed computational framework opens up new possibilities for understanding and controlling the collective behavior of noise-driven interacting particle systems, with potential applications in various fields such as social dynamics, biological synchronization, and collective behavior in physical and social systems.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Control of high-dimensional collective dynamics by deep neural feedback laws and kinetic modelling
Authors:
Giacomo Albi,
Sara Bicego,
Dante Kalise
Abstract:
Modeling and control of agent-based models is twice cursed by the dimensionality of the problem, as both the number of agents and their state space dimension can be large. Even though the computational barrier posed by a large ensemble of agents can be overcome through a mean field formulation of the control problem, the feasibility of its solution is generally guaranteed only for agents operating…
▽ More
Modeling and control of agent-based models is twice cursed by the dimensionality of the problem, as both the number of agents and their state space dimension can be large. Even though the computational barrier posed by a large ensemble of agents can be overcome through a mean field formulation of the control problem, the feasibility of its solution is generally guaranteed only for agents operating in low-dimensional spaces. To circumvent the difficulty posed by the high dimensionality of the state space a kinetic model is proposed, requiring the sampling of high-dimensional, two-agent sub-problems, to evolve the agents' density using a Boltzmann type equation. Such density evolution requires a high-frequency sampling of two-agent optimal control problems, which is efficiently approximated by means of deep neural networks and supervised learning, enabling the fast simulation of high-dimensional, large-scale ensembles of controlled particles. Numerical experiments demonstrate the effectiveness of the proposed approach in the control of consensus and attraction-repulsion dynamics.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Data/moment-driven approaches for fast predictive control of collective dynamics
Authors:
Giacomo Albi,
Sara Bicego,
Michael Herty,
Yuyang Huang,
Dante Kalise,
Chiara Segala
Abstract:
Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on fast online dynamic optimization at every time step. Two alternatives to MPC are proposed. First, the use of supervised learning techniques for the offline app…
▽ More
Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on fast online dynamic optimization at every time step. Two alternatives to MPC are proposed. First, the use of supervised learning techniques for the offline approximation of optimal feedback laws is discussed. Then, a procedure based on sequential linearization of the dynamics based on macroscopic quantities of the particle ensemble is reviewed. Both approaches circumvent the online solution of optimal control problems enabling fast, real-time, feedback synthesis for large-scale particle systems. Numerical experiments assess the performance of the proposed algorithms.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Multi-level Optimal Control with Neural Surrogate Models
Authors:
Dante Kalise,
Estefanía Loayza-Romero,
Kirsten A. Morris,
Zhengang Zhong
Abstract:
Optimal actuator and control design is studied as a multi-level optimisation problem, where the actuator design is evaluated based on the performance of the associated optimal closed loop. The evaluation of the optimal closed loop for a given actuator realisation is a computationally demanding task, for which the use of a neural network surrogate is proposed. The use of neural network surrogates t…
▽ More
Optimal actuator and control design is studied as a multi-level optimisation problem, where the actuator design is evaluated based on the performance of the associated optimal closed loop. The evaluation of the optimal closed loop for a given actuator realisation is a computationally demanding task, for which the use of a neural network surrogate is proposed. The use of neural network surrogates to replace the lower level of the optimisation hierarchy enables the use of fast gradient-based and gradient-free consensus-based optimisation methods to determine the optimal actuator design. The effectiveness of the proposed surrogate models and optimisation methods is assessed in a test related to optimal actuator location for heat control.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Statistical Proper Orthogonal Decomposition for model reduction in feedback control
Authors:
Sergey Dolgov,
Dante Kalise,
Luca Saluzzi
Abstract:
Feedback control synthesis for nonlinear, parameter-dependent fluid flow control problems is considered. The optimal feedback law requires the solution of the Hamilton-Jacobi-Bellman (HJB) PDE suffering the curse of dimensionality. This is mitigated by Model Order Reduction (MOR) techniques, where the system is projected onto a lower-dimensional subspace, over which the feedback synthesis becomes…
▽ More
Feedback control synthesis for nonlinear, parameter-dependent fluid flow control problems is considered. The optimal feedback law requires the solution of the Hamilton-Jacobi-Bellman (HJB) PDE suffering the curse of dimensionality. This is mitigated by Model Order Reduction (MOR) techniques, where the system is projected onto a lower-dimensional subspace, over which the feedback synthesis becomes feasible. However, existing MOR methods assume at least one relaxation of generality, that is, the system should be linear, or stable, or deterministic.
We propose a MOR method called Statistical POD (SPOD), which is inspired by the Proper Orthogonal Decomposition (POD), but extends to more general systems. Random samples of the original dynamical system are drawn, treating time and initial condition as random variables similarly to possible parameters in the model, and employing a stabilizing closed-loop control. The reduced subspace is chosen to minimize the empirical risk, which is shown to estimate the expected risk of the MOR solution with respect to the distribution of all possible outcomes of the controlled system. This reduced model is then used to compute a surrogate of the feedback control function in the Tensor Train (TT) format that is computationally fast to evaluate online. Using unstable Burgers' and Navier-Stokes equations, it is shown that the SPOD control is more accurate than Linear Quadratic Regulator or optimal control derived from a model reduced onto the standard POD basis, and faster than the direct optimal control of the original system.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
Separable approximations of optimal value functions under a decaying sensitivity assumption
Authors:
Mario Sperl,
Luca Saluzzi,
Lars Grüne,
Dante Kalise
Abstract:
An efficient approach for the construction of separable approximations of optimal value functions from interconnected optimal control problems is presented. The approach is based on assuming decaying sensitivities between subsystems, enabling a curse-of-dimensionality free approximation, for instance by deep neural networks.
An efficient approach for the construction of separable approximations of optimal value functions from interconnected optimal control problems is presented. The approach is based on assuming decaying sensitivities between subsystems, enabling a curse-of-dimensionality free approximation, for instance by deep neural networks.
△ Less
Submitted 8 September, 2023; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Data-driven initialization of deep learning solvers for Hamilton-Jacobi-Bellman PDEs
Authors:
Anastasia Borovykh,
Dante Kalise,
Alexis Laignelet,
Panos Parpas
Abstract:
A deep learning approach for the approximation of the Hamilton-Jacobi-Bellman partial differential equation (HJB PDE) associated to the Nonlinear Quadratic Regulator (NLQR) problem. A state-dependent Riccati equation control law is first used to generate a gradient-augmented synthetic dataset for supervised learning. The resulting model becomes a warm start for the minimization of a loss function…
▽ More
A deep learning approach for the approximation of the Hamilton-Jacobi-Bellman partial differential equation (HJB PDE) associated to the Nonlinear Quadratic Regulator (NLQR) problem. A state-dependent Riccati equation control law is first used to generate a gradient-augmented synthetic dataset for supervised learning. The resulting model becomes a warm start for the minimization of a loss function based on the residual of the HJB PDE. The combination of supervised learning and residual minimization avoids spurious solutions and mitigate the data inefficiency of a supervised learning-only approach. Numerical tests validate the different advantages of the proposed methodology.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
-
Supervised learning for kinetic consensus control
Authors:
Giacomo Albi,
Sara Bicego,
Dante Kalise
Abstract:
In this paper, how to successfully and efficiently condition a target population of agents towards consensus is discussed. To overcome the curse of dimensionality, the mean field formulation of the consensus control problem is considered. Although such formulation is designed to be independent of the number of agents, it is feasible to solve only for moderate intrinsic dimensions of the agents spa…
▽ More
In this paper, how to successfully and efficiently condition a target population of agents towards consensus is discussed. To overcome the curse of dimensionality, the mean field formulation of the consensus control problem is considered. Although such formulation is designed to be independent of the number of agents, it is feasible to solve only for moderate intrinsic dimensions of the agents space. For this reason, the solution is approached by means of a Boltzmann procedure, i.e. quasi-invariant limit of controlled binary interactions as approximation of the mean field PDE. The need for an efficient solver for the binary interaction control problem motivates the use of a supervised learning approach to encode a binary feedback map to be sampled at a very high rate. A gradient augmented feedforward neural network for the Value function of the binary control problem is considered and compared with direct approximation of the feedback law.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
-
Data-driven Tensor Train Gradient Cross Approximation for Hamilton-Jacobi-Bellman Equations
Authors:
Sergey Dolgov,
Dante Kalise,
Luca Saluzzi
Abstract:
A gradient-enhanced functional tensor train cross approximation method for the resolution of the Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control of nonlinear dynamics is presented. The procedure uses samples of both the solution of the HJB equation and its gradient to obtain a tensor train approximation of the value function. The collection of the data for the algori…
▽ More
A gradient-enhanced functional tensor train cross approximation method for the resolution of the Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control of nonlinear dynamics is presented. The procedure uses samples of both the solution of the HJB equation and its gradient to obtain a tensor train approximation of the value function. The collection of the data for the algorithm is based on two possible techniques: Pontryagin Maximum Principle and State Dependent Riccati Equations. Several numerical tests are presented in low and high dimension showing the effectiveness of the proposed method and its robustness with respect to inexact data evaluations, provided by the gradient information. The resulting tensor train approximation paves the way towards fast synthesis of the control signal in real-time applications.
△ Less
Submitted 22 February, 2023; v1 submitted 10 May, 2022;
originally announced May 2022.
-
Consensus based optimization via jump-diffusion stochastic differential equations
Authors:
D. Kalise,
A. Sharma,
M. V. Tretyakov
Abstract:
We introduce a new consensus based optimization (CBO) method where interacting particle system is driven by jump-diffusion stochastic differential equations. We study well-posedness of the particle system as well as of its mean-field limit. The major contributions of this paper are proofs of convergence of the interacting particle system towards the mean-field limit and convergence of a discretize…
▽ More
We introduce a new consensus based optimization (CBO) method where interacting particle system is driven by jump-diffusion stochastic differential equations. We study well-posedness of the particle system as well as of its mean-field limit. The major contributions of this paper are proofs of convergence of the interacting particle system towards the mean-field limit and convergence of a discretized particle system towards the continuous-time dynamics in the mean-square sense. We also prove convergence of the mean-field jump-diffusion SDEs towards global minimizer for a large class of objective functions. We demonstrate improved performance of the proposed CBO method over earlier CBO methods in numerical simulations on benchmark objective functions.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
Optimizing semilinear representations for State-dependent Riccati Equation-based feedback control
Authors:
Sergey Dolgov,
Dante Kalise,
Luca Saluzzi
Abstract:
An optimized variant of the State Dependent Riccati Equations (SDREs) approach for nonlinear optimal feedback stabilization is presented. The proposed method is based on the construction of equivalent semilinear representations associated to the dynamics and their affine combination. The optimal combination is chosen to minimize the discrepancy between the SDRE control and the optimal feedback law…
▽ More
An optimized variant of the State Dependent Riccati Equations (SDREs) approach for nonlinear optimal feedback stabilization is presented. The proposed method is based on the construction of equivalent semilinear representations associated to the dynamics and their affine combination. The optimal combination is chosen to minimize the discrepancy between the SDRE control and the optimal feedback law stemming from the solution of the corresponding Hamilton Jacobi Bellman (HJB) equation. Numerical experiments assess effectiveness of the method in terms of stability of the closed-loop with near-to-optimal performance.
△ Less
Submitted 19 July, 2022; v1 submitted 23 February, 2022;
originally announced February 2022.
-
State-dependent Riccati equation feedback stabilization for nonlinear PDEs
Authors:
Alessandro Alla,
Dante Kalise,
Valeria Simoncini
Abstract:
The synthesis of suboptimal feedback laws for controlling nonlinear dynamics arising from semi-discretized PDEs is studied. An approach based on the State-dependent Riccati Equation (SDRE) is presented for H2 and Hinf control problems. Depending on the nonlinearity and the dimension of the resulting problem, offline, online, and hybrid offline-online alternatives to the SDRE synthesis are proposed…
▽ More
The synthesis of suboptimal feedback laws for controlling nonlinear dynamics arising from semi-discretized PDEs is studied. An approach based on the State-dependent Riccati Equation (SDRE) is presented for H2 and Hinf control problems. Depending on the nonlinearity and the dimension of the resulting problem, offline, online, and hybrid offline-online alternatives to the SDRE synthesis are proposed. The hybrid offline-online SDRE method reduces to the sequential solution of Lyapunov equations, effectively enabling the computation of suboptimal feedback controls for two-dimensional PDEs. Numerical tests for the Sine-Gordon, degenerate Zeldovich, and viscous Burgers' PDEs are presented, providing a thorough experimental assessment of the proposed methodology.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Controlling swarms towards flocks and mills
Authors:
José Carrillo,
Dante Kalise,
Francesco Rossi,
Emmanuel Trélat
Abstract:
Self-organization and control around flocks and mills is studied for second-order swarming systems involving self-propulsion and potential terms. It is shown that through the action of constrained control, is it possible to control any initial configuration to a flock or a mill. The proof builds on an appropriate combination of several arguments: LaSalle invariance principle and Lyapunov-like decr…
▽ More
Self-organization and control around flocks and mills is studied for second-order swarming systems involving self-propulsion and potential terms. It is shown that through the action of constrained control, is it possible to control any initial configuration to a flock or a mill. The proof builds on an appropriate combination of several arguments: LaSalle invariance principle and Lyapunov-like decreasing functionals, control linearization techniques, and quasi-static deformations. A stability analysis of the second-order system guides the design of feedback laws for the stabilization to flock and mills, which are also assessed computationally.
△ Less
Submitted 17 November, 2021; v1 submitted 12 March, 2021;
originally announced March 2021.
-
Gradient-augmented Supervised Learning of Optimal Feedback Laws Using State-dependent Riccati Equations
Authors:
Giacomo Albi,
Sara Bicego,
Dante Kalise
Abstract:
A supervised learning approach for the solution of large-scale nonlinear stabilization problems is presented. A stabilizing feedback law is trained from a dataset generated from State-dependent Riccati Equation solves. The training phase is enriched by the use gradient information in the loss function, which is weighted through the use of hyperparameters. High-dimensional nonlinear stabilization t…
▽ More
A supervised learning approach for the solution of large-scale nonlinear stabilization problems is presented. A stabilizing feedback law is trained from a dataset generated from State-dependent Riccati Equation solves. The training phase is enriched by the use gradient information in the loss function, which is weighted through the use of hyperparameters. High-dimensional nonlinear stabilization tests demonstrate that real-time sequential large-scale Algebraic Riccati Equation solves can be substituted by a suitably trained feedforward neural network.
△ Less
Submitted 6 March, 2021;
originally announced March 2021.
-
Collisionless and Decentralized Formation Control for Strings
Authors:
Young-Pil Choi,
Dante Kalise,
Andrés A. Peters
Abstract:
A decentralized feedback controller for multi-agent systems, inspired by vehicle platooning, is proposed. The closed-loop resulting from the decentralized control action has three distinctive features: the generation of collision-free trajectories, flocking of the system towards a consensus state in velocity, and asymptotic convergence to a prescribed pattern of distances between agents. For each…
▽ More
A decentralized feedback controller for multi-agent systems, inspired by vehicle platooning, is proposed. The closed-loop resulting from the decentralized control action has three distinctive features: the generation of collision-free trajectories, flocking of the system towards a consensus state in velocity, and asymptotic convergence to a prescribed pattern of distances between agents. For each feature, a rigorous dynamical analysis is provided, yielding a characterization of the set of parameters and initial configurations where collision avoidance, flocking, and pattern formation is guaranteed. Numerical tests assess the theoretical results presented.
△ Less
Submitted 26 February, 2021;
originally announced February 2021.
-
Moment-Driven Predictive Control of Mean-Field Collective Dynamics
Authors:
G. Albi,
M. Herty,
D. Kalise,
C. Segala
Abstract:
The synthesis of control laws for interacting agent-based dynamics and their mean-field limit is studied. A linearization-based approach is used for the computation of sub-optimal feedback laws obtained from the solution of differential matrix Riccati equations. Quantification of dynamic performance of such control laws leads to theoretical estimates on suitable linearization points of the nonline…
▽ More
The synthesis of control laws for interacting agent-based dynamics and their mean-field limit is studied. A linearization-based approach is used for the computation of sub-optimal feedback laws obtained from the solution of differential matrix Riccati equations. Quantification of dynamic performance of such control laws leads to theoretical estimates on suitable linearization points of the nonlinear dynamics. Subsequently, the feedback laws are embedded into nonlinear model predictive control framework where the control is updated adaptively in time according to dynamic information on moments of linear mean-field dynamics. The performance and robustness of the proposed methodology is assessed through different numerical experiments in collective dynamics.
△ Less
Submitted 12 January, 2021; v1 submitted 6 January, 2021;
originally announced January 2021.
-
Optimal Feedback Law Recovery by Gradient-Augmented Sparse Polynomial Regression
Authors:
Behzad Azmi,
Dante Kalise,
Karl Kunisch
Abstract:
A sparse regression approach for the computation of high-dimensional optimal feedback laws arising in deterministic nonlinear control is proposed. The approach exploits the control-theoretical link between Hamilton-Jacobi-Bellman PDEs characterizing the value function of the optimal control problems, and first-order optimality conditions via Pontryagin's Maximum Principle. The latter is used as a…
▽ More
A sparse regression approach for the computation of high-dimensional optimal feedback laws arising in deterministic nonlinear control is proposed. The approach exploits the control-theoretical link between Hamilton-Jacobi-Bellman PDEs characterizing the value function of the optimal control problems, and first-order optimality conditions via Pontryagin's Maximum Principle. The latter is used as a representation formula to recover the value function and its gradient at arbitrary points in the space-time domain through the solution of a two-point boundary value problem. After generating a dataset consisting of different state-value pairs, a hyperbolic cross polynomial model for the value function is fitted using a LASSO regression. An extended set of low and high-dimensional numerical tests in nonlinear optimal control reveal that enriching the dataset with gradient information reduces the number of training samples, and that the sparse polynomial regression consistently yields a feedback law of lower complexity.
△ Less
Submitted 21 December, 2020; v1 submitted 19 July, 2020;
originally announced July 2020.
-
Using mobility data in the design of optimal lockdown strategies for the COVID-19 pandemic
Authors:
Ritabrata Dutta,
Susana Gomes,
Dante Kalise,
Lorenzo Pacchiardi
Abstract:
A mathematical model for the COVID-19 pandemic spread, which integrates age-structured Susceptible-Exposed-Infected-Recovered-Deceased dynamics with real mobile phone data accounting for the population mobility, is presented. The dynamical model adjustment is performed via Approximate Bayesian Computation. Optimal lockdown and exit strategies are determined based on nonlinear model predictive cont…
▽ More
A mathematical model for the COVID-19 pandemic spread, which integrates age-structured Susceptible-Exposed-Infected-Recovered-Deceased dynamics with real mobile phone data accounting for the population mobility, is presented. The dynamical model adjustment is performed via Approximate Bayesian Computation. Optimal lockdown and exit strategies are determined based on nonlinear model predictive control, constrained to public-health and socio-economic factors. Through an extensive computational validation of the methodology, it is shown that it is possible to compute robust exit strategies with realistic reduced mobility values to inform public policy making, and we exemplify the applicability of the methodology using datasets from England and France. Code implementing the described experiments is available at https://github.com/OptimalLockdown.
△ Less
Submitted 18 October, 2020; v1 submitted 29 June, 2020;
originally announced June 2020.
-
Shape Optimization of Actuators over Banach Spaces for Nonlinear Systems
Authors:
M. Sajjad Edalatzadeh,
Dante Kalise,
Kirsten A. Morris,
Kevin Sturm
Abstract:
In this paper, optimal actuator shape for nonlinear parabolic systems is discussed. The system under study is an abstract differential equation with a locally Lipschitz nonlinear part. A quadratic cost on the state and input of the system is considered. The existence of an optimal actuator shape has been established in the literature. This paper focuses on driving the optimality conditions for act…
▽ More
In this paper, optimal actuator shape for nonlinear parabolic systems is discussed. The system under study is an abstract differential equation with a locally Lipschitz nonlinear part. A quadratic cost on the state and input of the system is considered. The existence of an optimal actuator shape has been established in the literature. This paper focuses on driving the optimality conditions for actuator shapes belonging to a Banach space. The application of the theory to the optimal actuator shape design for railway track model is considered.
△ Less
Submitted 17 February, 2020;
originally announced February 2020.
-
Tensor Decomposition Methods for High-dimensional Hamilton-Jacobi-Bellman Equations
Authors:
Sergey Dolgov,
Dante Kalise,
Karl Kunisch
Abstract:
A tensor decomposition approach for the solution of high-dimensional, fully nonlinear Hamilton-Jacobi-Bellman equations arising in optimal feedback control of nonlinear dynamics is presented. The method combines a tensor train approximation for the value function together with a Newton-like iterative method for the solution of the resulting nonlinear system. The tensor approximation leads to a pol…
▽ More
A tensor decomposition approach for the solution of high-dimensional, fully nonlinear Hamilton-Jacobi-Bellman equations arising in optimal feedback control of nonlinear dynamics is presented. The method combines a tensor train approximation for the value function together with a Newton-like iterative method for the solution of the resulting nonlinear system. The tensor approximation leads to a polynomial scaling with respect to the dimension, partially circumventing the curse of dimensionality. A convergence analysis for the linear-quadratic case is presented. For nonlinear dynamics, the effectiveness of the high-dimensional control synthesis method is assessed in the optimal feedback stabilization of the Allen-Cahn and Fokker-Planck equations with a hundred of variables.
△ Less
Submitted 15 March, 2021; v1 submitted 5 August, 2019;
originally announced August 2019.
-
Robust feedback control of nonlinear PDEs by numerical approximation of high-dimensional Hamilton-Jacobi-Isaacs equations
Authors:
Dante Kalise,
Sudeep Kundu,
Karl Kunisch
Abstract:
We propose an approach for the synthesis of robust and optimal feedback controllers for nonlinear PDEs. Our approach considers the approximation of infinite-dimensional control systems by a pseudospectral collocation method, leading to high-dimensional nonlinear dynamics. For the reduced-order model, we construct a robust feedback control based on the $\cH_{\infty}$ control method, which requires…
▽ More
We propose an approach for the synthesis of robust and optimal feedback controllers for nonlinear PDEs. Our approach considers the approximation of infinite-dimensional control systems by a pseudospectral collocation method, leading to high-dimensional nonlinear dynamics. For the reduced-order model, we construct a robust feedback control based on the $\cH_{\infty}$ control method, which requires the solution of an associated high-dimensional Hamilton-Jacobi-Isaacs nonlinear PDE. The dimensionality of the Isaacs PDE is tackled by means of a separable representation of the control system, and a polynomial approximation ansatz for the corresponding value function. Our method proves to be effective for the robust stabilization of nonlinear dynamics up to dimension $d\approx 12$. We assess the robustness and optimality features of our design over a class of nonlinear parabolic PDEs, including nonlinear advection and reaction terms. The proposed design yields a feedback controller achieving optimal stabilization and disturbance rejection properties, along with providing a modelling framework for the robust control of PDEs under parametric uncertainties.
△ Less
Submitted 15 May, 2019;
originally announced May 2019.
-
Optimal actuator design for vibration control based on LQR performance and shape calculus
Authors:
M. Sajjad Edalatzadeh,
Dante Kalise,
Kirsten A. Morris,
Kevin Sturm
Abstract:
Optimal actuator design for a vibration control problem is calculated. The actuator shape is optimized according to the closed-loop performance of the resulting linear-quadratic regulator and a penalty on the actuator size. The optimal actuator shape is found by means of shape calculus and a topological derivative of the linear-quadratic regulator (LQR) performance index. An abstract framework is…
▽ More
Optimal actuator design for a vibration control problem is calculated. The actuator shape is optimized according to the closed-loop performance of the resulting linear-quadratic regulator and a penalty on the actuator size. The optimal actuator shape is found by means of shape calculus and a topological derivative of the linear-quadratic regulator (LQR) performance index. An abstract framework is proposed based on the theory for infinite-dimensional optimization of both the actuator shape and the associated control problem. A numerical realization of the optimality condition is presented for the actuator shape using a level-set method for topological derivatives. A Numerical example illustrating the design of actuator for Euler-Bernoulli beam model is provided.
△ Less
Submitted 18 March, 2019;
originally announced March 2019.
-
Sparse and Switching Infinite Horizon Optimal Control with Mixed-Norm Penalizations
Authors:
Dante Kalise,
Karl Kunisch,
Zhi** Rao
Abstract:
A class of infinite horizon optimal control problems involving mixed quasi-norms of $L^p$-type cost functionals for the controls is discussed. These functionals enhance sparsity and switching properties of the optimal controls. The existence of optimal controls and their structural properties are analyzed on the basis of first order optimality conditions. A dynamic programming approach is used for…
▽ More
A class of infinite horizon optimal control problems involving mixed quasi-norms of $L^p$-type cost functionals for the controls is discussed. These functionals enhance sparsity and switching properties of the optimal controls. The existence of optimal controls and their structural properties are analyzed on the basis of first order optimality conditions. A dynamic programming approach is used for numerical realization.
△ Less
Submitted 16 November, 2020; v1 submitted 31 August, 2018;
originally announced August 2018.
-
A collisionless singular Cucker-Smale model with decentralized formation control
Authors:
Young-Pil Choi,
Dante Kalise,
Jan Peszek,
Andrés A. Peters
Abstract:
We address the design of decentralized feedback control laws inducing consensus and prescribed spatial patterns over a singular interacting particle system of Cucker-Smale type. The control design consists of a feedback term regulating the distance between each agent and pre-assigned subset of neighbours. Such a design represents a multidimensional extension of existing control laws for 1d platoon…
▽ More
We address the design of decentralized feedback control laws inducing consensus and prescribed spatial patterns over a singular interacting particle system of Cucker-Smale type. The control design consists of a feedback term regulating the distance between each agent and pre-assigned subset of neighbours. Such a design represents a multidimensional extension of existing control laws for 1d platoon formation control. For the proposed controller we study consensus emergence, collision-avoidance and formation control features in terms of energy estimates for the closed-loop system. Numerical experiments in 1, 2 and 3 dimensions assess the different features of the proposed design.
△ Less
Submitted 5 September, 2019; v1 submitted 13 July, 2018;
originally announced July 2018.
-
(Sub)Optimal feedback control of mean field multi-population dynamics
Authors:
Giacomo Albi,
Dante Kalise
Abstract:
We study a multiscale approach for the control of agent-based, two-population models. The control variable acts over one population of leaders, which influence the population of followers via the coupling generated by their interaction. We cast a quadratic optimal control problem for the large-scale microscale model, which is approximated via a Boltzmann approach. By sampling solutions of the opti…
▽ More
We study a multiscale approach for the control of agent-based, two-population models. The control variable acts over one population of leaders, which influence the population of followers via the coupling generated by their interaction. We cast a quadratic optimal control problem for the large-scale microscale model, which is approximated via a Boltzmann approach. By sampling solutions of the optimal control problem associated to binary two-population dynamics, we generate sub-optimal control laws for the kinetic limit of the multi-population model. We present numerical experiments related to opinion dynamics assessing the performance of the proposed control design.
△ Less
Submitted 1 March, 2018;
originally announced March 2018.
-
On the implementation of a primal-dual algorithm for second order time-dependent mean field games with local couplings
Authors:
Luis Briceño-Arias,
Dante Kalise,
Ziad Kobeissi,
Mathieu Laurière,
Álvaro Mateos González,
Francisco José Silva
Abstract:
We study a numerical approximation of a time-dependent Mean Field Game (MFG) system with local couplings. The discretization we consider stems from a variational approach described in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] for the stationary problem and leads to the finite difference scheme introduced by Achdou and Capuzzo-Dolcetta in [SIAM J. Numer. Anal., 48(3):1136-116…
▽ More
We study a numerical approximation of a time-dependent Mean Field Game (MFG) system with local couplings. The discretization we consider stems from a variational approach described in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] for the stationary problem and leads to the finite difference scheme introduced by Achdou and Capuzzo-Dolcetta in [SIAM J. Numer. Anal., 48(3):1136-1162, 2010]. In order to solve the finite dimensional variational problems, in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] the authors implement the primal-dual algorithm introduced by Chambolle and Pock in [J. Math. Imaging Vision, 40(1):120-145, 2011], whose core consists in iteratively solving linear systems and applying a proximity operator. We apply that method to time-dependent MFG and, for large viscosity parameters, we improve the linear system solution by replacing the direct approach used in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] by suitable preconditioned iterative algorithms.
△ Less
Submitted 4 November, 2018; v1 submitted 21 February, 2018;
originally announced February 2018.
-
Optimal consensus control of the Cucker-Smale model
Authors:
Rafael Bailo,
Mattia Bongini,
José A. Carrillo,
Dante Kalise
Abstract:
We study the numerical realisation of optimal consensus control laws for agent-based models. For a nonlinear multi-agent system of Cucker-Smale type, consensus control is cast as a dynamic optimisation problem for which we derive first-order necessary optimality conditions. In the case of a smooth penalization fo the control energy, the optimality system is numerically approximated via a gradient-…
▽ More
We study the numerical realisation of optimal consensus control laws for agent-based models. For a nonlinear multi-agent system of Cucker-Smale type, consensus control is cast as a dynamic optimisation problem for which we derive first-order necessary optimality conditions. In the case of a smooth penalization fo the control energy, the optimality system is numerically approximated via a gradient-descent method. For sparsity promoting, non-smooth $\ell_1$-norm control penalizations, the optimal controllers are realised by means of heuristic methods. For an increasing number of agents, we discuss the approximation of the consensus control problem by following a mean-field modelling approach.
△ Less
Submitted 24 April, 2018; v1 submitted 5 February, 2018;
originally announced February 2018.
-
Optimal actuator design based on shape calculus
Authors:
Dante Kalise,
Karl Kunisch,
Kevin Sturm
Abstract:
An approach to optimal actuator design based on shape and topology optimisation techniques is presented. For linear diffusion equations, two scenarios are considered. For the first one, best actuators are determined depending on a given initial condition. In the second scenario, optimal actuators are determined based on all initial conditions not exceeding a chosen norm. Shape and topological sens…
▽ More
An approach to optimal actuator design based on shape and topology optimisation techniques is presented. For linear diffusion equations, two scenarios are considered. For the first one, best actuators are determined depending on a given initial condition. In the second scenario, optimal actuators are determined based on all initial conditions not exceeding a chosen norm. Shape and topological sensitivities of these cost functionals are determined. A numerical algorithm for optimal actuator design based on the sensitivities and a level-set method is presented. Numerical results support the proposed methodology.
△ Less
Submitted 4 March, 2024; v1 submitted 3 November, 2017;
originally announced November 2017.
-
Polynomial approximation of high-dimensional Hamilton-Jacobi-Bellman equations and applications to feedback control of semilinear parabolic PDEs
Authors:
Dante Kalise,
Karl Kunisch
Abstract:
A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a pseudospectral collocation approximation of the PDE dynamics, and an iterative method for the nonlinear HJB equation associated to the feedback synthesis. The latter is know…
▽ More
A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a pseudospectral collocation approximation of the PDE dynamics, and an iterative method for the nonlinear HJB equation associated to the feedback synthesis. The latter is known as the Successive Galerkin Approximation. It can also be interpreted as Newton iteration for the HJB equation. At every step, the associated linear Generalized HJB equation is approximated via a separable polynomial approximation ansatz. Stabilizing feedback controls are obtained from solutions to the HJB equations for systems of dimension up to fourteen.
△ Less
Submitted 6 February, 2019; v1 submitted 14 February, 2017;
originally announced February 2017.
-
A Boltzmann approach to mean-field sparse feedback control
Authors:
Giacomo Albi,
Massimo Fornasier,
Dante Kalise
Abstract:
We study the synthesis of optimal control policies for large-scale multi-agent systems. The optimal control design induces a parsimonious control intervention by means of l-1, sparsity-promoting control penalizations. We study instantaneous and infinite horizon sparse optimal feedback controllers. In order to circumvent the dimensionality issues associated to the control of large-scale agent-based…
▽ More
We study the synthesis of optimal control policies for large-scale multi-agent systems. The optimal control design induces a parsimonious control intervention by means of l-1, sparsity-promoting control penalizations. We study instantaneous and infinite horizon sparse optimal feedback controllers. In order to circumvent the dimensionality issues associated to the control of large-scale agent-based models, we follow a Boltzmann approach. We generate (sub)optimal controls signals for the kinetic limit of the multi-agent dynamics, by sampling of the optimal solution of the associated two-agent dynamics. Numerical experiments assess the performance of the proposed sparse design.
△ Less
Submitted 12 November, 2016;
originally announced November 2016.
-
Proximal methods for stationary Mean Field Games with local couplings
Authors:
L. M. Briceño-Arias,
D. Kalise,
F. J. Silva
Abstract:
We address the numerical approximation of Mean Field Games with local couplings. For power-like Hamiltonians, we consider both unconstrained and constrained stationary systems with density constraints in order to model hard congestion effects. For finite difference discretizations of the Mean Field Game system, we follow a variational approach. We prove that the aforementioned schemes can be obtai…
▽ More
We address the numerical approximation of Mean Field Games with local couplings. For power-like Hamiltonians, we consider both unconstrained and constrained stationary systems with density constraints in order to model hard congestion effects. For finite difference discretizations of the Mean Field Game system, we follow a variational approach. We prove that the aforementioned schemes can be obtained as the optimality system of suitably defined optimization problems. In order to prove the existence of solutions of the scheme with a variational argument, the monotonicity of the coupling term is not used, which allow us to recover general existence results. Next, assuming next that the coupling term is monotone, the variational problem is cast as a convex optimization problem for which we study and compare several proximal type methods. These algorithms have several interesting features, such as global convergence and stability with respect to the viscosity parameter, which can eventually be zero. We assess the performance of the methods via numerical experiments.
△ Less
Submitted 6 February, 2019; v1 submitted 27 August, 2016;
originally announced August 2016.
-
Mean field control hierarchy
Authors:
Giacomo Albi,
Young-Pil Choi,
Massimo Fornasier,
Dante Kalise
Abstract:
In this paper we model the role of a government of a large population as a mean field optimal control problem. Such control problems are constrainted by a PDE of continuity-type, governing the dynamics of the probability distribution of the agent population. We show the existence of mean field optimal controls both in the stochastic and deterministic setting. We derive rigorously the first order o…
▽ More
In this paper we model the role of a government of a large population as a mean field optimal control problem. Such control problems are constrainted by a PDE of continuity-type, governing the dynamics of the probability distribution of the agent population. We show the existence of mean field optimal controls both in the stochastic and deterministic setting. We derive rigorously the first order optimality conditions useful for numerical computation of mean field optimal controls. We introduce a novel approximating hierarchy of sub-optimal controls based on a Boltzmann approach, whose computation requires a very moderate numerical complexity with respect to the one of the optimal control. We provide numerical experiments for models in opinion formation comparing the behavior of the control hierarchy.
△ Less
Submitted 4 August, 2016;
originally announced August 2016.
-
Infinite horizon sparse optimal control
Authors:
Dante Kalise,
Karl Kunisch,
Zhi** Rao
Abstract:
A class of infinite horizon optimal control problems involving $L^p$-type cost functionals with $0<p\leq 1$ is discussed. The existence of optimal controls is studied for both the convex case with $p=1$ and the nonconvex case with $0<p<1$, and the sparsity structure of the optimal controls promoted by the $L^p$-type penalties is analyzed. A dynamic programming approach is proposed to numerically a…
▽ More
A class of infinite horizon optimal control problems involving $L^p$-type cost functionals with $0<p\leq 1$ is discussed. The existence of optimal controls is studied for both the convex case with $p=1$ and the nonconvex case with $0<p<1$, and the sparsity structure of the optimal controls promoted by the $L^p$-type penalties is analyzed. A dynamic programming approach is proposed to numerically approximate the corresponding sparse optimal controllers.
△ Less
Submitted 29 February, 2016;
originally announced February 2016.
-
Invisible control of self-organizing agents leaving unknown environments
Authors:
Giacomo Albi,
Mattia Bongini,
Emiliano Cristiani,
Dante Kalise
Abstract:
In this paper we are concerned with multiscale modeling, control, and simulation of self-organizing agents leaving an unknown area under limited visibility, with special emphasis on crowds. We first introduce a new microscopic model characterized by an exploration phase and an evacuation phase. The main ingredients of the model are an alignment term, accounting for the herding effect typical of un…
▽ More
In this paper we are concerned with multiscale modeling, control, and simulation of self-organizing agents leaving an unknown area under limited visibility, with special emphasis on crowds. We first introduce a new microscopic model characterized by an exploration phase and an evacuation phase. The main ingredients of the model are an alignment term, accounting for the herding effect typical of uncertain behavior, and a random walk, accounting for the need to explore the environment under limited visibility. We consider both metrical and topological interactions. Moreover, a few special agents, the leaders, not recognized as such by the crowd, are "hidden" in the crowd with a special controlled dynamics. Next, relying on a Boltzmann approach, we derive a mesoscopic model for a continuum density of followers, coupled with a microscopic description for the leaders' dynamics. Finally, optimal control of the crowd is studied. It is assumed that leaders exploit the herding effect in order to steer the crowd towards the exits and reduce clogging. Locally-optimal behavior of leaders is computed. Numerical simulations show the efficiency of the optimization methods in both microscopic and mesoscopic settings. We also perform a real experiment with people to study the feasibility of the proposed bottom-up crowd control technique.
△ Less
Submitted 23 May, 2016; v1 submitted 15 April, 2015;
originally announced April 2015.
-
Local minimization algorithms for dynamic programming equations
Authors:
Dante Kalise,
Axel Kröner,
Karl Kunisch
Abstract:
The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear map** over the set of admissible controls. This minimization is often performed by comparison over a finite number of elements of the control set. In this paper we demonstrate the importance of an acc…
▽ More
The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear map** over the set of admissible controls. This minimization is often performed by comparison over a finite number of elements of the control set. In this paper we demonstrate the importance of an accurate realization of these minimization problems and propose algorithms by which this can be achieved effectively. The considered class of equations includes nonsmooth control problems with $\ell_1$-penalization which lead to sparse controls.
△ Less
Submitted 25 February, 2015;
originally announced February 2015.
-
(Un)conditional consensus emergence under feedback controls
Authors:
Mattia Bongini,
Massimo Fornasier,
Dante Kalise
Abstract:
We study the problem of consensus emergence in multi-agent systems via external feedback controllers. We consider a set of agents interacting with dynamics given by a Cucker-Smale type of model, and study its consensus stabilization by means of centralized and decentralized control configurations. We present a characterization of consensus emergence for systems with different feedback structures,…
▽ More
We study the problem of consensus emergence in multi-agent systems via external feedback controllers. We consider a set of agents interacting with dynamics given by a Cucker-Smale type of model, and study its consensus stabilization by means of centralized and decentralized control configurations. We present a characterization of consensus emergence for systems with different feedback structures, such as leader-based configurations, perturbed information feedback, and feedback computed upon spatially confined information. We characterize consensus emergence for this latter design as a parameter-dependent transition regime between self-regulation and centralized feedback stabilization. Numerical experiments illustrate the different features of the proposed designs.
△ Less
Submitted 21 February, 2015;
originally announced February 2015.
-
An Efficient Policy Iteration Algorithm for Dynamic Programming Equations
Authors:
Alessandro Alla,
Maurizio Falcone,
Dante Kalise
Abstract:
We present an accelerated algorithm for the solution of static Hamilton-Jacobi-Bellman equations related to optimal control problems. Our scheme is based on a classic policy iteration procedure, which is known to have superlinear convergence in many relevant cases provided the initial guess is sufficiently close to the solution. In many cases, this limitation degenerates into a behavior similar to…
▽ More
We present an accelerated algorithm for the solution of static Hamilton-Jacobi-Bellman equations related to optimal control problems. Our scheme is based on a classic policy iteration procedure, which is known to have superlinear convergence in many relevant cases provided the initial guess is sufficiently close to the solution. In many cases, this limitation degenerates into a behavior similar to a value iteration method, with an increased computation time. The new scheme circumvents this problem by combining the advantages of both algorithms with an efficient coupling. The method starts with a value iteration phase and then switches to a policy iteration procedure when a certain error threshold is reached. A delicate point is to determine this threshold in order to avoid cumbersome computation with the value iteration and, at the same time, to be reasonably sure that the policy iteration method will finally converge to the optimal solution. We analyze the methods and efficient coupling in a number of examples in dimension two, three and four illustrating its properties.
△ Less
Submitted 2 July, 2014; v1 submitted 9 August, 2013;
originally announced August 2013.
-
Modelling and numerical approximation of a 2.5D set of equations for mesoscale atmospheric processes
Authors:
Dante Kalise,
Ivar Lie
Abstract:
The set of 3D inviscid primitive equations for the atmosphere is dimensionally reduced by a Discontinuous Galerkin discretization in one horizontal direction. The resulting model is a 2D system of balance laws where with a source term depending on the layering procedure and the choice of coupling fluxes, which is established in terms of upwind considerations. The "2.5D" system is discretized via a…
▽ More
The set of 3D inviscid primitive equations for the atmosphere is dimensionally reduced by a Discontinuous Galerkin discretization in one horizontal direction. The resulting model is a 2D system of balance laws where with a source term depending on the layering procedure and the choice of coupling fluxes, which is established in terms of upwind considerations. The "2.5D" system is discretized via a WENO-TVD scheme based in a flux limiter centered approach. We study four tests cases related to atmospheric phenomena to analyze the physical validity of the model.
△ Less
Submitted 9 November, 2011;
originally announced November 2011.
-
A study of a WENO-TVD finite volume scheme for the numerical simulation of atmospheric advective and convective phenomena
Authors:
Dante Kalise
Abstract:
We present a WENO-TVD scheme for the simulation of atmospheric phenomena. The scheme considers a spatial discretization via a second-order TVD flux based upon a flux-centered limiter approach, which makes use of high-order accurate extrapolated values arising from a WENO reconstruction procedure. Time discretization is performed with a third order RK-TVD scheme, and splitting is used for the inclu…
▽ More
We present a WENO-TVD scheme for the simulation of atmospheric phenomena. The scheme considers a spatial discretization via a second-order TVD flux based upon a flux-centered limiter approach, which makes use of high-order accurate extrapolated values arising from a WENO reconstruction procedure. Time discretization is performed with a third order RK-TVD scheme, and splitting is used for the inclusion of source terms. We present a comprehensive performance study of the method in atmospheric applications involving advective and convective motion. We present a set of tests for space-dependent linear advection, where we assess convergence and robustness with respect to the parameters of the scheme. We apply the method to approximate the 2D Euler equations in a series of tests for atmospheric convection.
△ Less
Submitted 7 November, 2011;
originally announced November 2011.
-
High-order finite volume schemes for layered atmospheric models
Authors:
Dante Kalise,
Ivar Lie,
Eleuterio F. Toro
Abstract:
We present a numerical scheme for the solution of a class of atmospheric models where high horizontal resolution is required while a coarser vertical structure is allowed. The proposed scheme considers a layering procedure for the original set of equations, and the use of high-order ADER finite volume schemes for the solution of the system of balance laws arising from the dimensional reduction pro…
▽ More
We present a numerical scheme for the solution of a class of atmospheric models where high horizontal resolution is required while a coarser vertical structure is allowed. The proposed scheme considers a layering procedure for the original set of equations, and the use of high-order ADER finite volume schemes for the solution of the system of balance laws arising from the dimensional reduction procedure. We present several types of layering based upon Galerkin discretizations of the vertical structure, and we study the effect of incrementing the order of horizontal approximation. Numerical experiments for the computational validation of the convergence of the scheme together with the study of physical phenomena are performed over 2D linear advective models, including a set of equations for an isothermal atmosphere.
△ Less
Submitted 31 October, 2011;
originally announced October 2011.