Showing 1–17 of 17 results for author: Summers, T H

Policy Iteration for Multiplicative Noise Output Feedback Control

Authors: Benjamin Gravell, Matilde Gargiani, John Lygeros, Tyler H. Summers

Abstract: We propose a policy iteration algorithm for solving the multiplicative noise linear quadratic output feedback design problem. The algorithm solves a set of coupled Riccati equations for estimation and control arising from a partially observable Markov decision process (POMDP) under a class of linear dynamic control policies. We show in numerical experiments far faster convergence than a value iter… ▽ More We propose a policy iteration algorithm for solving the multiplicative noise linear quadratic output feedback design problem. The algorithm solves a set of coupled Riccati equations for estimation and control arising from a partially observable Markov decision process (POMDP) under a class of linear dynamic control policies. We show in numerical experiments far faster convergence than a value iteration algorithm, formerly the only known algorithm for solving this class of problem. The results suggest promising future research directions for policy optimization algorithms in more general POMDPs, including the potential to develop novel approximate data-driven approaches when model parameters are not available. △ Less

Submitted 31 March, 2022; originally announced March 2022.

An Online Joint Optimization-Estimation Architecture for Distribution Networks

Authors: Yi Guo, Xinyang Zhou, Changhong Zhao, Lijun Chen, Gabriela Hug, Tyler H. Summers

Abstract: In this paper, we propose an optimal control-estimation architecture for distribution networks, which jointly solves the optimal power flow (OPF) problem and static state estimation (SE) problem through an online gradient-based feedback algorithm. The main objective is to enable a fast and timely interaction between the optimal controllers and state estimators with limited sensor measurements. Fir… ▽ More In this paper, we propose an optimal control-estimation architecture for distribution networks, which jointly solves the optimal power flow (OPF) problem and static state estimation (SE) problem through an online gradient-based feedback algorithm. The main objective is to enable a fast and timely interaction between the optimal controllers and state estimators with limited sensor measurements. First, convergence and optimality of the proposed algorithm are analytically established. Then, the proposed gradient-based algorithm is modified by introducing statistical information of the inherent estimation and linearization errors for an improved and robust performance of the online control decisions. Overall, the proposed method eliminates the traditional separation of control and operation, where control and estimation usually operate at distinct layers and different time-scales. Hence, it enables a computationally affordable, efficient and robust online operational framework for distribution networks under time-varying settings. △ Less

Submitted 30 August, 2022; v1 submitted 21 March, 2022; originally announced March 2022.

Optimal Power Flow with State Estimation In the Loop for Distribution Networks

Authors: Yi Guo, Xinyang Zhou, Changhong Zhao, Lijun Chen, Tyler H. Summers

Abstract: We propose a framework for integrating optimal power flow (OPF) with state estimation (SE) in the loop for distribution networks. Our approach combines a primal-dual gradient-based OPF solver with a SE feedback loop based on a limited set of sensors for system monitoring, instead of assuming exact knowledge of all states. The estimation algorithm reduces uncertainty on unmeasured grid states based… ▽ More We propose a framework for integrating optimal power flow (OPF) with state estimation (SE) in the loop for distribution networks. Our approach combines a primal-dual gradient-based OPF solver with a SE feedback loop based on a limited set of sensors for system monitoring, instead of assuming exact knowledge of all states. The estimation algorithm reduces uncertainty on unmeasured grid states based on a few appropriate online state measurements and noisy "pseudo-measurements". We analyze the convergence of the proposed algorithm and quantify the statistical estimation errors based on a weighted least squares (WLS) estimator. The numerical results on a 4521-node network demonstrate that this approach can scale to extremely large networks and provide robustness to both large pseudo measurement variability and inherent sensor measurement noise. △ Less

Submitted 4 May, 2022; v1 submitted 29 April, 2020; originally announced May 2020.

Comments: arXiv admin note: text overlap with arXiv:1909.12763

Trust-based user-interface design for human-automation systems

Authors: Abraham P. Vinod, Adam J. Thorpe, Philip A. Olaniyi, Tyler H. Summers, Meeko M. K. Oishi

Abstract: We present a method for dynamics-driven, user-interface design for a human-automation system via sensor selection. We define the user-interface to be the output of a MIMO LTI system, and formulate the design problem as one of selecting an output matrix from a given set of candidate output matrices. Sufficient conditions for situation awareness are captured as additional constraints on the selectio… ▽ More We present a method for dynamics-driven, user-interface design for a human-automation system via sensor selection. We define the user-interface to be the output of a MIMO LTI system, and formulate the design problem as one of selecting an output matrix from a given set of candidate output matrices. Sufficient conditions for situation awareness are captured as additional constraints on the selection of the output matrix. These constraints depend upon the level of trust the human has in the automation. We show that the resulting user-interface design problem is a combinatorial, set-cardinality minimization problem with set function constraints. We propose tractable algorithms to compute optimal or sub-optimal solutions with suboptimality bounds. Our approaches exploit monotonicity and submodularity present in the design problem, and rely on constraint programming and submodular maximization. We apply this method to the IEEE 118-bus, to construct correct-by-design interfaces under various operating scenarios. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: 20 pages, 8 figures, 4 tables

A Performance and Stability Analysis of Low-inertia Power Grids with Stochastic System Inertia

Authors: Yi Guo, Tyler H. Summers

Abstract: Traditional synchronous generators with rotational inertia are being replaced by low-inertia renewable energy resources (RESs) in many power grids and operational scenarios. Due to emerging market mechanisms, inherent variability of RESs, and existing control schemes, the resulting system inertia levels can not only be low but also markedly time-varying. In this paper, we investigate performance a… ▽ More Traditional synchronous generators with rotational inertia are being replaced by low-inertia renewable energy resources (RESs) in many power grids and operational scenarios. Due to emerging market mechanisms, inherent variability of RESs, and existing control schemes, the resulting system inertia levels can not only be low but also markedly time-varying. In this paper, we investigate performance and stability of low-inertia power systems with stochastic system inertia. In particular, we consider system dynamics modelled by a linearized stochastic swing equation, where stochastic system inertia is regarded as multiplicative noise. The $\mathcal{H}_2$ norm is used to quantify the performance of the system in the presence of persistent disturbances or transient faults. The performance metric can be computed by solving a generalized Lyapunov equation, which has fundamentally different characteristics from systems with only additive noise. For grids with uniform inertia and dam** parameters, we derive closed-form expressions for the $\mathcal{H}_2$ norm of the proposed stochastic swing equation. The analysis gives insights into how the $\mathcal{H}_2$ norm of the stochastic swing equation depends on 1) network topology; 2) system parameters; and 3) distribution parameters of disturbances. A mean-square stability condition is also derived. Numerical results provide additional insights for performance and stability of the stochastic swing equation. △ Less

Submitted 2 March, 2019; originally announced March 2019.

Algorithms for Joint Sensor and Control Nodes Selection in Dynamic Networks

Authors: Sebastian A. Nugroho, Ahmad F. Taha, Nikolaos Gatsis, Tyler H. Summers, Ram Krishnan

Abstract: The problem of placing or selecting sensors and control nodes plays a pivotal role in the operation of dynamic networks. This paper proposes optimal algorithms and heuristics to solve the simultaneous sensor and actuator selection problem in linear dynamic networks. In particular, a sufficiency condition of static output feedback stabilizability is used to obtain the minimal set of sensors and con… ▽ More The problem of placing or selecting sensors and control nodes plays a pivotal role in the operation of dynamic networks. This paper proposes optimal algorithms and heuristics to solve the simultaneous sensor and actuator selection problem in linear dynamic networks. In particular, a sufficiency condition of static output feedback stabilizability is used to obtain the minimal set of sensors and control nodes needed to stabilize an unstable network. We show the joint sensor/actuator selection and output feedback control can be written as a mixed-integer nonconvex problem. To solve this nonconvex combinatorial problem, three methods based on (1) mixed-integer nonlinear programming, (2) binary search algorithms, and (3) simple heuristics are proposed. The first method yields optimal solutions to the selection problem---given that some constants are appropriately selected. The second method requires a database of binary sensor/actuator combinations, returns optimal solutions, and necessitates no tuning parameters. The third approach is a heuristic that yields suboptimal solutions but is computationally attractive. The theoretical properties of these methods are discussed and numerical tests on dynamic networks showcase the trade-off between optimality and computational time. △ Less

Submitted 7 March, 2019; v1 submitted 28 November, 2018; originally announced November 2018.

Data-based Distributionally Robust Stochastic Optimal Power Flow, Part I: Methodologies

Authors: Yi Guo, Kyri Baker, Emiliano Dall'Anese, Zechun Hu, Tyler H. Summers

Abstract: We propose a data-based method to solve a multi-stage stochastic optimal power flow (OPF) problem based on limited information about forecast error distributions. The framework explicitly combines multi-stage feedback policies with any forecasting method and historical forecast error data. The objective is to determine power scheduling policies for controllable devices in a power network to balanc… ▽ More We propose a data-based method to solve a multi-stage stochastic optimal power flow (OPF) problem based on limited information about forecast error distributions. The framework explicitly combines multi-stage feedback policies with any forecasting method and historical forecast error data. The objective is to determine power scheduling policies for controllable devices in a power network to balance operational cost and conditional value-at-risk (CVaR) of device and network constraint violations. These decisions include both nominal power schedules and reserve policies, which specify planned reactions to forecast errors in order to accommodate fluctuating renewable energy sources. Instead of assuming the uncertainties across the networks follow prescribed probability distributions, we consider ambiguity sets of distributions centered around a finite training dataset. By utilizing the Wasserstein metric to quantify differences between the empirical data-based distribution and the real unknown data-generating distribution, we formulate a multi-stage distributionally robust OPF problem to compute optimal control policies that are robust to both forecast errors and sampling errors inherent in the dataset. Two specific data-based distributionally robust stochastic OPF problems are proposed for distribution networks and transmission systems. △ Less

Submitted 25 October, 2018; v1 submitted 17 April, 2018; originally announced April 2018.

Comments: arXiv admin note: text overlap with arXiv:1706.04267

Data-based Distributionally Robust Stochastic Optimal Power Flow, Part II: Case studies

Authors: Yi Guo, Kyri Baker, Emiliano Dall'Anese, Zechun Hu, Tyler H. Summers

Abstract: This is the second part of a two-part paper on data-based distributionally robust stochastic optimal power flow (OPF). The general problem formulation and methodology have been presented in Part I [1]. Here, we present extensive numerical experiments in both distribution and transmission networks to illustrate the effectiveness and flexibility of the proposed methodology for balancing efficiency,… ▽ More This is the second part of a two-part paper on data-based distributionally robust stochastic optimal power flow (OPF). The general problem formulation and methodology have been presented in Part I [1]. Here, we present extensive numerical experiments in both distribution and transmission networks to illustrate the effectiveness and flexibility of the proposed methodology for balancing efficiency, constraint violation risk, and out-of-sample performance. On the distribution side, the method mitigates overvoltages due to high photovoltaic penetration using local energy storage devices. On the transmission side, the method reduces N-1 security line flow constraint risks due to high wind penetration using reserve policies for controllable generators. In both cases, the data-based distributionally robust model predictive control (MPC) algorithm explicitly utilizes forecast error training datasets, which can be updated online. The numerical results illustrate inherent tradeoffs between the operational costs, risks of constraints violations, and out-of-sample performance, offering systematic techniques for system operators to balance these objectives. △ Less

Submitted 25 October, 2018; v1 submitted 17 April, 2018; originally announced April 2018.

Mutually Quadratically Invariant Information Structures in Two-Team Stochastic Dynamic Games

Authors: Marcello Colombino, Roy S. Smith, Tyler H. Summers

Abstract: We formulate a two-team linear quadratic stochas- tic dynamic game featuring two opposing teams each with decentralized information structures. We introduce the concept of mutual quadratic invariance (MQI), which, analogously to quadratic invariance in (single team) decentralized control, defines a class of interacting information structures for the two teams under which optimal linear feedback co… ▽ More We formulate a two-team linear quadratic stochas- tic dynamic game featuring two opposing teams each with decentralized information structures. We introduce the concept of mutual quadratic invariance (MQI), which, analogously to quadratic invariance in (single team) decentralized control, defines a class of interacting information structures for the two teams under which optimal linear feedback control strate- gies are easy to compute. We show that, for zero-sum two- team dynamic games, structured state feedback Nash (saddle- point) equilibrium strategies can be computed from equivalent structured disturbance feedforward saddle point equilibrium strategies. However, for nonzero-sum games we show via a counterexample that a similar equivalence fails to hold. The results are illustrated with a simple yet rich numerical example that illustrates the importance of the information structure for dynamic games. △ Less

Submitted 19 July, 2016; originally announced July 2016.

Upper bounds for the reach-avoid probability via robust optimization

Authors: Nikolaos Kariotoglou, Maryam Kamgarpour, Tyler H. Summers, John Lygeros

Abstract: We consider finite horizon reach-avoid problems for discrete time stochastic systems. Our goal is to construct upper bound functions for the reach-avoid probability by means of tractable convex optimization problems. We achieve this by restricting attention to the span of Gaussian radial basis functions and imposing structural assumptions on the transition kernel of the stochastic processes as wel… ▽ More We consider finite horizon reach-avoid problems for discrete time stochastic systems. Our goal is to construct upper bound functions for the reach-avoid probability by means of tractable convex optimization problems. We achieve this by restricting attention to the span of Gaussian radial basis functions and imposing structural assumptions on the transition kernel of the stochastic processes as well as the target and safe sets of the reach-avoid problem. In particular, we require the kernel to be written as a Gaussian mixture density with each mean of the distribution being affine in the current state and input and the target and safe sets to be written as intersections of quadratic inequalities. Taking advantage of these structural assumptions, we formulate a recursion of semidefinite programs where each step provides an upper bound to the value function of the reach- avoid problem. The upper bounds provide a performance metric to which any suboptimal control policy can be compared, and can themselves be used to construct suboptimal control policies. We illustrate via numerical examples that even if the resulting bounds are conservative, the associated control policies achieve higher reach-avoid probabilities than heuristic controllers for problems of large state-input space dimensions (more than 20). The results presented in this paper, far exceed the limits of current approximation methods for reach-avoid problems in the specific class of stochastic systems considered. △ Less

Submitted 10 June, 2015; originally announced June 2015.

On Submodularity and Controllability in Complex Dynamical Networks

Authors: Tyler H. Summers, Fabrizio L. Cortesi, John Lygeros

Abstract: Controllability and observability have long been recognized as fundamental structural properties of dynamical systems, but have recently seen renewed interest in the context of large, complex networks of dynamical systems. A basic problem is sensor and actuator placement: choose a subset from a finite set of possible placements to optimize some real-valued controllability and observability metrics… ▽ More Controllability and observability have long been recognized as fundamental structural properties of dynamical systems, but have recently seen renewed interest in the context of large, complex networks of dynamical systems. A basic problem is sensor and actuator placement: choose a subset from a finite set of possible placements to optimize some real-valued controllability and observability metrics of the network. Surprisingly little is known about the structure of such combinatorial optimization problems. In this paper, we show that several important classes of metrics based on the controllability and observability Gramians have a strong structural property that allows for either efficient global optimization or an approximation guarantee by using a simple greedy heuristic for their maximization. In particular, the map** from possible placements to several scalar functions of the associated Gramian is either a modular or submodular set function. The results are illustrated on randomly generated systems and on a problem of power electronic actuator placement in a model of the European power grid. △ Less

Submitted 30 September, 2016; v1 submitted 30 April, 2014; originally announced April 2014.

Comments: Original arXiv version of IEEE Transactions on Control of Network Systems paper (Volume 3, Issue 1), with a addendum (located in the ancillary documents) that explains an error in a proof of the original paper and provides a counterexample to the corresponding result

Submodularity of Energy Related Controllability Metrics

Authors: Fabrizio L. Cortesi, Tyler H. Summers, John Lygeros

Abstract: The quantification of controllability and observability has recently received new interest in the context of large, complex networks of dynamical systems. A fundamental but computationally difficult problem is the placement or selection of actuators and sensors that optimize real-valued controllability and observability metrics of the network. We show that several classes of energy related metrics… ▽ More The quantification of controllability and observability has recently received new interest in the context of large, complex networks of dynamical systems. A fundamental but computationally difficult problem is the placement or selection of actuators and sensors that optimize real-valued controllability and observability metrics of the network. We show that several classes of energy related metrics associated with the controllability Gramian in linear dynamical systems have a strong structural property, called submodularity. This property allows for an approximation guarantee by using a simple greedy heuristic for their maximization. The results are illustrated for randomly generated systems and for placement of power electronic actuators in a model of the European power grid. △ Less

Submitted 25 March, 2014; originally announced March 2014.

Comments: 7 pages, 2 figures; submitted to the 2014 IEEE Conference on Decision and Control

Certifying non-existence of undesired locally stable equilibria in formation shape control problems

Authors: Tyler H. Summers, Changbin Yu, Soura Dasgupta, Brian D. O. Anderson

Abstract: A fundamental control problem for autonomous vehicle formations is formation shape control, in which the agents must maintain a prescribed formation shape using only information measured or communicated from neighboring agents. While a large and growing literature has recently emerged on distance-based formation shape control, global stability properties remain a significant open problem. Even in… ▽ More A fundamental control problem for autonomous vehicle formations is formation shape control, in which the agents must maintain a prescribed formation shape using only information measured or communicated from neighboring agents. While a large and growing literature has recently emerged on distance-based formation shape control, global stability properties remain a significant open problem. Even in four-agent formations, the basic question of whether or not there can exist locally stable incorrect equilibrium shapes remains open. This paper shows how this question can be answered for any size formation in principle using semidefinite programming techniques for semialgebraic problems, involving solutions sets of polynomial equations, inequations, and inequalities. △ Less

Submitted 8 July, 2013; originally announced July 2013.

Comments: 6 pages; to appear in the 2013 IEEE Multiconference on Systems and Control

Performance Bounds for Constrained Linear Min-Max Control

Authors: Tyler H. Summers, Paul J. Goulart

Abstract: This paper proposes a method to compute lower performance bounds for discrete-time infinite-horizon min-max control problems with input constraints and bounded disturbances. Such bounds can be used as a performance metric for control policies synthesized via suboptimal design techniques. Our approach is motivated by recent work on performance bounds for stochastic constrained optimal control probl… ▽ More This paper proposes a method to compute lower performance bounds for discrete-time infinite-horizon min-max control problems with input constraints and bounded disturbances. Such bounds can be used as a performance metric for control policies synthesized via suboptimal design techniques. Our approach is motivated by recent work on performance bounds for stochastic constrained optimal control problems using relaxations of the Bellman equation. The central idea of the paper is to find an unconstrained min-max control problem, with negatively weighted disturbances as in H infinity control, that provides the tightest possible lower performance bound on the original problem of interest and whose value function is easily computed. The new method is demonstrated via a numerical example for a system with box constrained input. △ Less

Submitted 8 July, 2013; originally announced July 2013.

Comments: 6 pages, in proceedings of the 2013 European Control Conference

Optimal Sensor and Actuator Placement in Complex Dynamical Networks

Authors: Tyler H. Summers, John Lygeros

Abstract: Controllability and observability have long been recognized as fundamental structural properties of dynamical systems, but have recently seen renewed interest in the context of large, complex networks of dynamical systems. A basic problem is sensor and actuator placement: choose a subset from a finite set of possible placements to optimize some real-valued controllability and observability metrics… ▽ More Controllability and observability have long been recognized as fundamental structural properties of dynamical systems, but have recently seen renewed interest in the context of large, complex networks of dynamical systems. A basic problem is sensor and actuator placement: choose a subset from a finite set of possible placements to optimize some real-valued controllability and observability metrics of the network. Surprisingly little is known about the structure of such combinatorial optimization problems. In this paper, we show that an important class of metrics based on the controllability and observability Gramians has a strong structural property that allows efficient global optimization: the map** from possible placements to the trace of the associated Gramian is a modular set function. We illustrate the results via placement of power electronic actuators in a model of the European power grid. △ Less

Submitted 25 March, 2014; v1 submitted 11 June, 2013; originally announced June 2013.

Comments: 6 pages, 3 figures; to appear at the 2014 IFAC World Congress

Distributed Model Predictive Consensus via the Alternating Direction Method of Multipliers

Authors: Tyler H. Summers, John Lygeros

Abstract: We propose a distributed optimization method for solving a distributed model predictive consensus problem. The goal is to design a distributed controller for a network of dynamical systems to optimize a coupled objective function while respecting state and input constraints. The distributed optimization method is an augmented Lagrangian method called the Alternating Direction Method of Multipliers… ▽ More We propose a distributed optimization method for solving a distributed model predictive consensus problem. The goal is to design a distributed controller for a network of dynamical systems to optimize a coupled objective function while respecting state and input constraints. The distributed optimization method is an augmented Lagrangian method called the Alternating Direction Method of Multipliers (ADMM), which was introduced in the 1970s but has seen a recent resurgence in the context of dramatic increases in computing power and the development of widely available distributed computing platforms. The method is applied to position and velocity consensus in a network of double integrators. We find that a few tens of ADMM iterations yield closed-loop performance near what is achieved by solving the optimization problem centrally. Furthermore, the use of recent code generation techniques for solving local subproblems yields fast overall computation times. △ Less

Submitted 6 December, 2012; originally announced December 2012.

Comments: 7 pages, 5 figures, 50th Allerton Conference on Communication, Control, and Computing, Monticello, IL, USA, 2012

Approximate Dynamic Programming via Sum of Squares Programming

Authors: Tyler H. Summers, Konstantin Kunz, Nikolaos Kariotoglou, Maryam Kamgarpour, Sean Summers, John Lygeros

Abstract: We describe an approximate dynamic programming method for stochastic control problems on infinite state and input spaces. The optimal value function is approximated by a linear combination of basis functions with coefficients as decision variables. By relaxing the Bellman equation to an inequality, one obtains a linear program in the basis coefficients with an infinite set of constraints. We show… ▽ More We describe an approximate dynamic programming method for stochastic control problems on infinite state and input spaces. The optimal value function is approximated by a linear combination of basis functions with coefficients as decision variables. By relaxing the Bellman equation to an inequality, one obtains a linear program in the basis coefficients with an infinite set of constraints. We show that a recently introduced method, which obtains convex quadratic value function approximations, can be extended to higher order polynomial approximations via sum of squares programming techniques. An approximate value function can then be computed offline by solving a semidefinite program, without having to sample the infinite constraint. The policy is evaluated online by solving a polynomial optimization problem, which also turns out to be convex in some cases. We experimentally validate the method on an autonomous helicopter testbed using a 10-dimensional helicopter model. △ Less

Submitted 6 December, 2012; originally announced December 2012.

Comments: 7 pages, 5 figures. Submitted to the 2013 European Control Conference, Zurich, Switzerland