Showing 1–11 of 11 results for author: Hauswirth, A

Optimization Algorithms as Robust Feedback Controllers

Authors: Adrian Hauswirth, Zhiyu He, Saverio Bolognani, Gabriela Hug, Florian Dörfler

Abstract: Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorith… ▽ More Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey. △ Less

Submitted 8 January, 2024; v1 submitted 21 March, 2021; originally announced March 2021.

Limit Behavior and the Role of Augmentation in Projected Saddle Flows for Convex Optimization

Authors: Adrian Hauswirth, Lukas Ortmann, Saverio Bolognani, Florian Dörfler

Abstract: In this paper, we study the stability and convergence of continuous-time Lagrangian saddle flows to solutions of a convex constrained optimization problem. Convergence of these flows is well-known when the underlying saddle function is either strictly convex in the primal or strictly concave in the dual variables. In this paper, we show convergence under non-strict convexity when a simple, unilate… ▽ More In this paper, we study the stability and convergence of continuous-time Lagrangian saddle flows to solutions of a convex constrained optimization problem. Convergence of these flows is well-known when the underlying saddle function is either strictly convex in the primal or strictly concave in the dual variables. In this paper, we show convergence under non-strict convexity when a simple, unilateral augmentation term is added. For this purpose, we establish a novel, non-trivial characterization of the limit set of saddle-flow trajectories that allows us to preclude limit cycles. With our presentation we try to unify several existing problem formulations as a projected dynamical system that allows projection of both the primal and dual variables, thus complementing results available in the recent literature. △ Less

Submitted 19 October, 2020; originally announced October 2020.

Quantitative Sensitivity Bounds for Nonlinear Programming and Time-varying Optimization

Authors: Irina Subotić, Adrian Hauswirth, Florian Dörfler

Abstract: Inspired by classical sensitivity results for nonlinear optimization, we derive and discuss new quantitative bounds to characterize the solution map and dual variables of a parametrized nonlinear program. In particular, we derive explicit expressions for the local and global Lipschitz constants of the solution map of non-convex or convex optimization problems, respectively. Our results are geared… ▽ More Inspired by classical sensitivity results for nonlinear optimization, we derive and discuss new quantitative bounds to characterize the solution map and dual variables of a parametrized nonlinear program. In particular, we derive explicit expressions for the local and global Lipschitz constants of the solution map of non-convex or convex optimization problems, respectively. Our results are geared towards the study of time-varying optimization problems which are commonplace in various applications of online optimization, including power systems, robotics, signal processing and more. In this context, our results can be used to bound the rate of change of the optimizer. To illustrate the use of our sensitivity bounds we generalize existing arguments to quantify the tracking performance of continuous-time, monotone running algorithms. Further, we introduce a new continuous-time running algorithm for time-varying constrained optimization which we model as a so-called perturbed swee** process. For this discontinuous scheme, we establish an explicit bound on the asymptotic solution tracking for a class of convex problems. △ Less

Submitted 18 June, 2020; originally announced June 2020.

On the Differentiability of Projected Trajectories and the Robust Convergence of Non-convex Anti-Windup Gradient Flows

Authors: Adrian Hauswirth, Florian Dörfler, Andrew Teel

Abstract: This paper concerns a new class of discontinuous dynamical systems for constrained optimization. These dynamics are particularly suited to solve nonlinear, non-convex problems in closed-loop with a physical system. Such approaches using feedback controllers that emulate optimization algorithms have recently been proposed for the autonomous optimization of power systems and other infrastructures. I… ▽ More This paper concerns a new class of discontinuous dynamical systems for constrained optimization. These dynamics are particularly suited to solve nonlinear, non-convex problems in closed-loop with a physical system. Such approaches using feedback controllers that emulate optimization algorithms have recently been proposed for the autonomous optimization of power systems and other infrastructures. In this paper, we consider feedback gradient flows that exploit physical input saturation with the help of anti-windup control to enforce constraints. We prove semi-global convergence of "projected" trajectories to first-order optimal points, i.e., of the trajectories obtained from a pointwise projection onto the feasible set. In the process, we establish properties of the directional derivative of the projection map for non-convex, prox-regular sets. △ Less

Submitted 15 April, 2020; v1 submitted 5 March, 2020; originally announced March 2020.

Anti-Windup Approximations of Oblique Projected Dynamics for Feedback-based Optimization

Authors: Adrian Hauswirth, Florian Dörfler, Andrew Teel

Abstract: In this paper we study how high-gain anti-windup schemes can be used to implement projected dynamical systems in control loops that are subject to saturation on a (possibly unknown) set of admissible inputs. This insight is especially useful for the design of autonomous optimization schemes that realize a closed-loop behavior which approximates a particular optimization algorithm (e.g., projected… ▽ More In this paper we study how high-gain anti-windup schemes can be used to implement projected dynamical systems in control loops that are subject to saturation on a (possibly unknown) set of admissible inputs. This insight is especially useful for the design of autonomous optimization schemes that realize a closed-loop behavior which approximates a particular optimization algorithm (e.g., projected gradient or Newton descent) while requiring only limited model information. In our analysis we show that a saturated integral controller, augmented with an anti-windup scheme, gives rise to a perturbed projected dynamical system. This insight allows us to show uniform convergence and robust practical stability as the anti-windup gain goes to infinity. Moreover, for a special case encountered in autonomous optimization we show robust convergence, i.e., convergence to an optimal steady-state for finite gains. Apart from being particularly suited for online optimization of large-scale systems, such as power grids, these results are potentially useful for other control and optimization applications as they shed a new light on both anti-windup control and projected gradient systems. △ Less

Submitted 1 March, 2020; originally announced March 2020.

Experimental Validation of Feedback Optimization in Power Distribution Grids

Authors: Lukas Ortmann, Adrian Hauswirth, Ivo Caduff, Florian Dörfler, Saverio Bolognani

Abstract: We consider the problem of controlling the voltage of a distribution feeder using the reactive power capabilities of inverters. On a real distribution grid, we compare the local Volt/VAr droop control recommended in recent grid codes, a centralized dispatch based on optimal power flow (OPF) programming, and a feedback optimization (FO) controller that we propose. The local droop control yields sub… ▽ More We consider the problem of controlling the voltage of a distribution feeder using the reactive power capabilities of inverters. On a real distribution grid, we compare the local Volt/VAr droop control recommended in recent grid codes, a centralized dispatch based on optimal power flow (OPF) programming, and a feedback optimization (FO) controller that we propose. The local droop control yields suboptimal regulation, as predicted analytically. The OPF-based dispatch strategy requires an accurate grid model and measurement of all loads on the feeder in order to achieve proper voltage regulation. However, in the experiment, the OPF-based strategy violates voltage constraints due to inevitable model mismatch and uncertainties. Our proposed FO controller, on the other hand, satisfies the constraints and does not require load measurements or any grid state estimation. The only needed model knowledge is the sensitivity of the voltages with respect to reactive power, which can be obtained from data. As we show, an approximation of these sensitivities is also sufficient, which makes the approach essentially model-free, easy to tune, compatible with the current sensing and control infrastructure, and remarkably robust to measurement noise. We expect these properties to be fundamental features of FO for power systems and not specific to Volt/VAr regulation or to distribution grids. △ Less

Submitted 21 July, 2022; v1 submitted 8 October, 2019; originally announced October 2019.

Journal ref: Electric Power Systems Research 2020

Timescale Separation in Autonomous Optimization

Authors: Adrian Hauswirth, Saverio Bolognani, Gabriela Hug, Florian Dörfler

Abstract: Autonomous optimization refers to the design of feedback controllers that steer a physical system to a steady state that solves a predefined, possibly constrained, optimization problem. As such, no exogenous control inputs such as setpoints or trajectories are required. Instead, these controllers are modeled after optimization algorithms that take the form of dynamical systems. The interconnection… ▽ More Autonomous optimization refers to the design of feedback controllers that steer a physical system to a steady state that solves a predefined, possibly constrained, optimization problem. As such, no exogenous control inputs such as setpoints or trajectories are required. Instead, these controllers are modeled after optimization algorithms that take the form of dynamical systems. The interconnection of this type of optimization dynamics with a physical system is however not guaranteed to be stable unless both dynamics act on sufficiently different timescales. In this paper, we quantify the required timescale separation and give prescriptions that can be directly used in the design of this type of feedback controllers. Using ideas from singular perturbation analysis, we derive stability bounds for different feedback laws that are based on common continuous-time optimization schemes. In particular, we consider gradient descent and its variations, including projected gradient, and Newton gradient. We further give stability bounds for momentum methods and saddle-point flows. Finally, we discuss how optimization algorithms like subgradient and accelerated gradient descent, while well-behaved in offline settings, are unsuitable for autonomous optimization due to their general lack of robustness. △ Less

Submitted 7 October, 2020; v1 submitted 15 May, 2019; originally announced May 2019.

Stability of Dynamic Feedback Optimization with Applications to Power Systems

Authors: Sandeep Menta, Adrian Hauswirth, Saverio Bolognani, Gabriela Hug, Florian Dörfler

Abstract: We consider the problem of optimizing the steady state of a dynamical system in closed loop. Conventionally, the design of feedback optimization control laws assumes that the system is stationary. However, in reality, the dynamics of the (slow) iterative optimization routines can interfere with the (fast) system dynamics. We provide a study of the stability and convergence of these feedback optimi… ▽ More We consider the problem of optimizing the steady state of a dynamical system in closed loop. Conventionally, the design of feedback optimization control laws assumes that the system is stationary. However, in reality, the dynamics of the (slow) iterative optimization routines can interfere with the (fast) system dynamics. We provide a study of the stability and convergence of these feedback optimization setups in closed loop with the underlying plant, via a custom-tailored singular perturbation analysis result. Our study is particularly geared towards applications in power systems and the question whether recently developed online optimization schemes can be deployed without jeopardizing dynamic system stability. △ Less

Submitted 14 October, 2018; originally announced October 2018.

Time-varying Projected Dynamical Systems with Applications to Feedback Optimization of Power Systems

Authors: Adrian Hauswirth, Irina Subotić, Saverio Bolognani, Gabriela Hug, Florian Dörfler

Abstract: This paper is concerned with the study of continuous-time, non-smooth dynamical systems which arise in the context of time-varying non-convex optimization problems, as for example the feedback-based optimization of power systems. We generalize the notion of projected dynamical systems to time-varying, possibly non-regular, domains and derive conditions for the existence of so-called Krasovskii sol… ▽ More This paper is concerned with the study of continuous-time, non-smooth dynamical systems which arise in the context of time-varying non-convex optimization problems, as for example the feedback-based optimization of power systems. We generalize the notion of projected dynamical systems to time-varying, possibly non-regular, domains and derive conditions for the existence of so-called Krasovskii solutions. The key insight is that for trajectories to exist, informally, the time-varying domain can only contract at a bounded rate whereas it may expand discontinuously. This condition is met, in particular, by feasible sets delimited via piecewise differentiable functions under appropriate constraint qualifications. To illustrate the necessity and usefulness of such a general framework, we consider a simple yet insightful power system example, and we discuss the implications of the proposed conditions for the design of feedback optimization schemes. △ Less

Submitted 21 November, 2018; v1 submitted 19 September, 2018; originally announced September 2018.

Projected Dynamical Systems on Irregular, Non-Euclidean Domains for Nonlinear Optimization

Authors: Adrian Hauswirth, Saverio Bolognani, Florian Dörfler

Abstract: Continuous-time projected dynamical systems are an elementary class of discontinuous dynamical systems with trajectories that remain in a feasible domain by means of projecting outward-pointing vector fields. They are essential when modeling physical saturation in control systems, constraints of motion, as well as studying projection-based numerical optimization algorithms. Motivated by the emergi… ▽ More Continuous-time projected dynamical systems are an elementary class of discontinuous dynamical systems with trajectories that remain in a feasible domain by means of projecting outward-pointing vector fields. They are essential when modeling physical saturation in control systems, constraints of motion, as well as studying projection-based numerical optimization algorithms. Motivated by the emerging application of feedback-based continuous-time optimization schemes that rely on the physical system to enforce nonlinear hard constraints, we study the fundamental properties of these dynamics on general locally-Euclidean sets. Among others, we propose the use of Krasovskii solutions, show their existence on nonconvex, irregular subsets of low-regularity Riemannian manifolds, and investigate how they relate to conventional Carathéodory solutions. Furthermore, we establish conditions for uniqueness, thereby introducing a generalized definition of prox-regularity which is suitable for non-flat domains. Finally, we use these results to study the stability and convergence of projected gradient flows as an illustrative application of our framework. We provide simple counter-examples for our main results to illustrate the necessity of our already weak assumptions. △ Less

Submitted 5 August, 2020; v1 submitted 13 September, 2018; originally announced September 2018.

MSC Class: 34A60; 34A12; 49J24; 49K24

Generic Existence of Unique Lagrange Multipliers in AC Optimal Power Flow

Authors: Adrian Hauswirth, Saverio Bolognani, Gabriela Hug, Florian Dörfler

Abstract: Solutions to nonlinear, nonconvex optimization problems can fail to satisfy the KKT optimality conditions even when they are optimal. This is due to the fact that unless constraint qualifications (CQ) are satisfied, Lagrange multipliers may fail to exist. Even if the KKT conditions are applicable, the multipliers may not be unique. These possibilities also affect AC optimal power flow (OPF) proble… ▽ More Solutions to nonlinear, nonconvex optimization problems can fail to satisfy the KKT optimality conditions even when they are optimal. This is due to the fact that unless constraint qualifications (CQ) are satisfied, Lagrange multipliers may fail to exist. Even if the KKT conditions are applicable, the multipliers may not be unique. These possibilities also affect AC optimal power flow (OPF) problems which are routinely solved in power systems planning, scheduling and operations. The complex structure -- in particular the presence of the nonlinear power flow equations which naturally exhibit a structural degeneracy -- make any attempt to establish CQs for the entire class of problems very challenging. In this paper, we resort to tools from differential topology to show that for AC OPF problems in various contexts the linear independence constraint qualification is satisfied almost certainly, thus effectively obviating the usual assumption on CQs. Consequently, for any local optimizer there generically exists a unique set of multipliers that satisfy the KKT conditions. △ Less

Submitted 18 June, 2018; originally announced June 2018.

Journal ref: IEEE Control Systems Letters, vol. 2, no. 4, October 2018