-
Decentralized real-time iterations for distributed nonlinear model predictive control
Authors:
Gösta Stomberg,
Alexander Engelmann,
Moritz Diehl,
Timm Faulwasser
Abstract:
This article presents a Real-Time Iteration (RTI) scheme for distributed Nonlinear Model Predictive Control (NMPC). The scheme transfers the well-known RTI approach, a key enabler for many industrial real-time NMPC implementations, to the setting of cooperative distributed control. At each sampling instant, one outer iteration of a bi-level decentralized Sequential Quadratic Programming (dSQP) met…
▽ More
This article presents a Real-Time Iteration (RTI) scheme for distributed Nonlinear Model Predictive Control (NMPC). The scheme transfers the well-known RTI approach, a key enabler for many industrial real-time NMPC implementations, to the setting of cooperative distributed control. At each sampling instant, one outer iteration of a bi-level decentralized Sequential Quadratic Programming (dSQP) method is applied to a centralized optimal control croblem. This ensures that real-time requirements are met and it facilitates cooperation between subsystems. Combining novel dSQP convergence results with RTI stability guarantees, we prove local exponential stability under standard assumptions on the MPC design with and without terminal constraints. The proposed scheme only requires neighbor-to-neighbor communication and avoids a central coordinator. A numerical example with coupled inverted pendulums demonstrates the efficacy of the approach.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
Distributed Interior Point Methods for Optimization in Energy Networks
Authors:
Alexander Engelmann,
Michael Kaupmann,
Timm Faulwasser
Abstract:
This note discusses an essentially decentralized interior point method, which is well suited for optimization problems arising in energy networks. Advantages of the proposed method are guaranteed and fast local convergence also for problems with non-convex constraints. Moreover, our method exhibits a small communication footprint and it achieves a comparably high solution accuracy with a limited n…
▽ More
This note discusses an essentially decentralized interior point method, which is well suited for optimization problems arising in energy networks. Advantages of the proposed method are guaranteed and fast local convergence also for problems with non-convex constraints. Moreover, our method exhibits a small communication footprint and it achieves a comparably high solution accuracy with a limited number of iterations, whereby the local subproblems are of low computational complexity. We illustrate the performance of the proposed method on a problem from energy systems, i.e., we consider an optimal power flow problem with 708 buses.
△ Less
Submitted 6 July, 2023;
originally announced July 2023.
-
Approximate Dynamic Programming with Feasibility Guarantees
Authors:
Alexander Engelmann,
Maisa B. Bandeira,
Timm Faulwasser
Abstract:
Safe and economic operation of networked systems is often challenging. Optimization-based schemes are frequently considered, since they achieve near-optimality while ensuring safety via the explicit consideration of constraints. In applications, these schemes, however, often require solving large-scale optimization problems. Iterative techniques from distributed optimization are frequently propose…
▽ More
Safe and economic operation of networked systems is often challenging. Optimization-based schemes are frequently considered, since they achieve near-optimality while ensuring safety via the explicit consideration of constraints. In applications, these schemes, however, often require solving large-scale optimization problems. Iterative techniques from distributed optimization are frequently proposed for complexity reduction. Yet, they achieve feasibility only asymptotically, which induces a substantial computational burden. This work presents an approximate dynamic programming scheme, which is guaranteed to deliver a feasible solution in "one shot", i.e., in one backward-forward iteration over all subproblems provided they are coupled by a tree structure. Our proposed scheme generalizes methods from seemingly disconnected domains such as power systems and optimal control. We demonstrate its efficacy for problems with nonconvex constraints via numerical examples from both domains.
△ Less
Submitted 29 January, 2024; v1 submitted 9 June, 2023;
originally announced June 2023.
-
Decentralized non-convex optimization via bi-level SQP and ADMM
Authors:
Gösta Stomberg,
Alexander Engelmann,
Timm Faulwasser
Abstract:
Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high subproblem complexity. We present a novel bi-level SQP method, where the inner quadratic problems are solved via ADMM. A decentralized stop** criterion from ine…
▽ More
Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high subproblem complexity. We present a novel bi-level SQP method, where the inner quadratic problems are solved via ADMM. A decentralized stop** criterion from inexact Newton methods allows the early termination of ADMM as an inner algorithm to improve computational efficiency. The method has local convergence guarantees for non-convex problems. Moreover, it only solves sequences of Quadratic Programs, whereas many existing algorithms solve sequences of Nonlinear Programs. The method shows competitive numerical performance for an optimal power flow problem.
△ Less
Submitted 14 October, 2022; v1 submitted 19 April, 2022;
originally announced April 2022.
-
Data-driven MPC of descriptor systems: A case study for power networks
Authors:
Philipp Schmitz,
Alexander Engelmann,
Timm Faulwasser,
Karl Worthmann
Abstract:
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete…
▽ More
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete-time descriptor model obtained by discretization of the power-swing equations for a nine-bus system. Our results shows the efficacy of the proposed control scheme and they underpin the prospect of the data-driven framework for control of descriptor systems.
△ Less
Submitted 4 March, 2022;
originally announced March 2022.
-
An essentially decentralized interior point method for control
Authors:
Alexander Engelmann,
Gösta Stomberg,
Timm Faulwasser
Abstract:
Distributed and decentralized optimization are key for the control of networked systems. Application examples include distributed model predictive control and distributed sensing or estimation. Non-linear systems, however, lead to problems with non-convex constraints for which classical decentralized optimization algorithms lack convergence guarantees. Moreover, classical decentralized algorithms…
▽ More
Distributed and decentralized optimization are key for the control of networked systems. Application examples include distributed model predictive control and distributed sensing or estimation. Non-linear systems, however, lead to problems with non-convex constraints for which classical decentralized optimization algorithms lack convergence guarantees. Moreover, classical decentralized algorithms usually exhibit only linear convergence. This paper presents an essentially decentralized primal-dual interior point method with convergence guarantees for non-convex problems at a superlinear rate. We show that the proposed method works reliably on a numerical example from power systems. Our results indicate that the proposed method outperforms ADMM in terms of computation time and computational complexity of the subproblems.
△ Less
Submitted 4 July, 2023; v1 submitted 9 July, 2021;
originally announced July 2021.
-
A Distributed Active Set Method for Model Predictive Control
Authors:
Gösta Stomberg,
Alexander Engelmann,
Timm Faulwasser
Abstract:
This paper presents a novel distributed active set method for model predictive control of linear systems. The method combines a primal active set strategy with a decentralized conjugate gradient method to solve convex quadratic programs. An advantage of the proposed method compared to existing distributed model predictive algorithms is the primal feasibility of the iterates. Numerical results show…
▽ More
This paper presents a novel distributed active set method for model predictive control of linear systems. The method combines a primal active set strategy with a decentralized conjugate gradient method to solve convex quadratic programs. An advantage of the proposed method compared to existing distributed model predictive algorithms is the primal feasibility of the iterates. Numerical results show that the proposed method can compete with the alternating direction method of multipliers in terms of communication requirements for a chain of masses example.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Essentially Decentralized Conjugate Gradients
Authors:
Alexander Engelmann,
Timm Faulwasser
Abstract:
Solving structured systems of linear equations in a non-centralized fashion is an important step in many distributed optimization and control algorithms. Fast convergence is required in manifold applications. Known decentralized algorithms, however, typically exhibit asymptotic convergence at a linear rate. This note proposes an essentially decentralized variant of the Conjugate Gradient algorithm…
▽ More
Solving structured systems of linear equations in a non-centralized fashion is an important step in many distributed optimization and control algorithms. Fast convergence is required in manifold applications. Known decentralized algorithms, however, typically exhibit asymptotic convergence at a linear rate. This note proposes an essentially decentralized variant of the Conjugate Gradient algorithm (d-CG). The proposed method exhibits a practical superlinear convergence rate and comes with a priori computable finite-step convergence guarantees. In contrast to previous works, we consider sum-wise decomposition instead of row-wise decomposition which enables application in multi-agent settings. We illustrate the performance of d-CG on problems from sensor fusion and compare the results to the widely-used Alternating Direction Method of Multipliers.
△ Less
Submitted 2 September, 2021; v1 submitted 24 February, 2021;
originally announced February 2021.
-
Distributed Power Flow and Distributed Optimization -- Formulation, Solution, and Open Source Implementation
Authors:
Tillmann Mühlpfordt,
Xinliang Dai,
Alexander Engelmann,
Veit Hagenmeyer
Abstract:
Solving the power flow problem in a distributed fashion empowers different grid operators to compute the overall grid state without having to share grid models-this is a practical problem to which industry does not have off-the-shelf answers. In cooperation with a German transmission system operator we propose two physically consistent problem formulations (feasibility, least-squares) amenable to…
▽ More
Solving the power flow problem in a distributed fashion empowers different grid operators to compute the overall grid state without having to share grid models-this is a practical problem to which industry does not have off-the-shelf answers. In cooperation with a German transmission system operator we propose two physically consistent problem formulations (feasibility, least-squares) amenable to two solution methods from distributed optimization (the Alternating direction method of multipliers (ADMM), and the Augmented Lagrangian based Alternating Direction Inexact Newton method (Aladin)); with Aladin there come convergence guarantees for the distributed power flow problem. In addition, we provide open source matlab code for rapid prototy** for distributed power flow (rapidPF), a fully matpower-compatible software that facilitates the laborious task of formulating power flow problems as distributed optimization problems; the code is available under https://github.com/KIT-IAI/rapidPF/. The approach to solving distributed power flow problems that we present is flexible, modular, consistent, and reproducible. Simulation results for systems ranging from 53 buses (with 3 regions) up to 4662 buses (with 5 regions) show that the least-squares formulation solved with aladin requires just about half a dozen coordinating steps before the power flow problem is solved.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
-
ALADIN-$α$ -- An open-source MATLAB toolbox for distributed non-convex optimization
Authors:
Alexander Engelmann,
Yuning Jiang,
Henrieke Benner,
Ruchuan Ou,
Boris Houska,
Timm Faulwasser
Abstract:
This paper introduces an open-source software for distributed and decentralized non-convex optimization named ALADIN-$α$. ALADIN-$α$ is a MATLAB implementation of tailored variants of the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Its user interface is convenient for rapid prototy** of non-convex distributed optimization algorithms. An improved version of the r…
▽ More
This paper introduces an open-source software for distributed and decentralized non-convex optimization named ALADIN-$α$. ALADIN-$α$ is a MATLAB implementation of tailored variants of the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Its user interface is convenient for rapid prototy** of non-convex distributed optimization algorithms. An improved version of the recently proposed bi-level variant of ALADIN is included enabling decentralized non-convex optimization with reduced information exchange. A collection of examples from different applications fields including chemical engineering, robotics, and power systems underpins the potential of ALADIN-$α$.
△ Less
Submitted 4 October, 2021; v1 submitted 2 June, 2020;
originally announced June 2020.
-
Decomposition of non-convex optimization via bi-level distributed ALADIN
Authors:
Alexander Engelmann,
Yuning Jiang,
Boris Houska,
Timm Faulwasser
Abstract:
Decentralized optimization algorithms are important in different contexts, such as distributed optimal power flow or distributed model predictive control, as they avoid central coordination and enable decomposition of large-scale problems. In case of constrained non-convex optimization only a few algorithms are currently are available; often their performance is limited, or they lack convergence g…
▽ More
Decentralized optimization algorithms are important in different contexts, such as distributed optimal power flow or distributed model predictive control, as they avoid central coordination and enable decomposition of large-scale problems. In case of constrained non-convex optimization only a few algorithms are currently are available; often their performance is limited, or they lack convergence guarantees. This paper proposes a framework for decentralized non-convex optimization via bi-level distribution of the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Bi-level distribution means that the outer ALADIN structure is combined with an inner distribution/decentralization level solving a condensed variant of ALADIN's convex coordination QP by decentralized algorithms. We prove sufficient conditions ensuring local convergence while allowing for inexact decentralized/distributed solutions of the coordination QP. Moreover, we show how a decentralized variant of conjugate gradient or decentralized ADMM schemes can be employed at the inner level. We draw upon case studies from power systems and robotics to illustrate the performance of the proposed framework.
△ Less
Submitted 27 March, 2019;
originally announced March 2019.
-
Distributed State Estimation for AC Power Systems using Gauss-Newton ALADIN
Authors:
Xu Du,
Alexander Engelmann,
Yuning Jiang,
Timm Faulwasser,
Boris Houska
Abstract:
This paper proposes a structure exploiting algorithm for solving non-convex power system state estimation problems in distributed fashion. Because the power flow equations in large electrical grid networks are non-convex equality constraints, we develop a tailored state estimator based on Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method, which can handle the nonlinearities…
▽ More
This paper proposes a structure exploiting algorithm for solving non-convex power system state estimation problems in distributed fashion. Because the power flow equations in large electrical grid networks are non-convex equality constraints, we develop a tailored state estimator based on Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method, which can handle the nonlinearities efficiently. Here, our focus is on using Gauss-Newton Hessian approximations within ALADIN in order to arrive at at an efficient (computationally and communicationally) variant of ALADIN for network maximum likelihood estimation problems. Analyzing the IEEE 30-Bus system we illustrate how the proposed algorithm can be used to solve highly non-trivial network state estimation problems. We also compare the method with existing distributed parameter estimation codes in order to illustrate its performance.
△ Less
Submitted 21 March, 2019;
originally announced March 2019.