-
A Convex Optimization Approach to Compute Trap** Regions for Lossless Quadratic Systems
Authors:
Shih-Chi Liao,
A. Leonid Heide,
Maziar S. Hemati,
Peter J. Seiler
Abstract:
Quadratic systems with lossless quadratic terms arise in many applications, including models of atmosphere and incompressible fluid flows. Such systems have a trap** region if all trajectories eventually converge to and stay within a bounded set. Conditions for the existence and characterization of trap** regions have been established in prior works for boundedness analysis. However, prior sol…
▽ More
Quadratic systems with lossless quadratic terms arise in many applications, including models of atmosphere and incompressible fluid flows. Such systems have a trap** region if all trajectories eventually converge to and stay within a bounded set. Conditions for the existence and characterization of trap** regions have been established in prior works for boundedness analysis. However, prior solutions have used non-convex optimization methods, resulting in conservative estimates. In this paper, we build on this prior work and provide a convex semidefinite programming condition for the existence of a trap** region. The condition allows precise verification or falsification of the existence of a trap** region. If a trap** region exists, then we provide a second semidefinite program to compute the least conservative trap** region in the form of a ball. Two low-dimensional systems are provided as examples to illustrate the results. A third high-dimensional example is also included to demonstrate that the computation required for the analysis can be scaled to systems of up to $\sim O(100)$ states. The proposed method provides a precise and computationally efficient numerical approach for computing trap** regions. We anticipate this work will benefit future studies on modeling and control of lossless quadratic dynamical systems.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Reduced-order Aggregate Dynamical Model for Wind Farms
Authors:
Sanjana Vijayshankar,
Victor Purba,
Peter J. Seiler,
Sairaj V. Dhople
Abstract:
This paper presents an aggregate reduced-order model for a wind farm composed of identical parallel-connected Type-3 wind turbines. The model for individual turbines includes mechanical dynamics (arising from the turbine and doubly fed induction generator) and electrical dynamics (arising from the rotor-side and grid-side converters and associated filters). The proposed aggregate wind-farm model i…
▽ More
This paper presents an aggregate reduced-order model for a wind farm composed of identical parallel-connected Type-3 wind turbines. The model for individual turbines includes mechanical dynamics (arising from the turbine and doubly fed induction generator) and electrical dynamics (arising from the rotor-side and grid-side converters and associated filters). The proposed aggregate wind-farm model is structure preserving, in the sense that the parameters of the model are derived by scaling corresponding ones from the individual turbines. The aggregate model hence maps to an equivalent--albeit fictitious--wind turbine that captures the dynamics corresponding to the entire wind farm. The reduced-order model has obvious computational advantages, but more importantly, the presented analysis rigorously formalizes parametric scalings for aggregate wind-turbine models that have been applied with limited justification in prior works. Exhaustive numerical simulations validate the accuracy and computational benefits of the proposed reduced-order model.
△ Less
Submitted 27 October, 2018;
originally announced October 2018.
-
Recovering Robustness in Model-Free Reinforcement learning
Authors:
Harish K. Venkataraman,
Peter J. Seiler
Abstract:
Reinforcement learning (RL) is used to directly design a control policy using data collected from the system. This paper considers the robustness of controllers trained via model-free RL. The discussion focuses on the standard model-based linear quadratic Gaussian (LQG) problem as a special instance of RL. A simple example, originally formulated for LQG problems, is used to demonstrate that RL wit…
▽ More
Reinforcement learning (RL) is used to directly design a control policy using data collected from the system. This paper considers the robustness of controllers trained via model-free RL. The discussion focuses on the standard model-based linear quadratic Gaussian (LQG) problem as a special instance of RL. A simple example, originally formulated for LQG problems, is used to demonstrate that RL with partial observations can lead to poor robustness margins. It is proposed to recover robustness by introducing random perturbations at the system input during the RL training. The perturbation magnitude can be used to trade off performance for robustness. Two simple examples are presented to demonstrate the proposed method for enhancing robustness during RL training.
△ Less
Submitted 7 April, 2019; v1 submitted 22 October, 2018;
originally announced October 2018.
-
Computation of lower bounds for the induced L2 norm of LPV systems
Authors:
Tamas Peni,
Peter J. Seiler
Abstract:
Determining the induced L2 norm of a linear, parameter-varying (LPV) system is an integral part of many analysis and robust control design procedures. Most prior work has focused on efficiently computing upper bounds for the induced L2 norm. The conditions for upper bounds are typically based on scaled small-gain theorems with dynamic multipliers or dissipation inequalities with parameter dependen…
▽ More
Determining the induced L2 norm of a linear, parameter-varying (LPV) system is an integral part of many analysis and robust control design procedures. Most prior work has focused on efficiently computing upper bounds for the induced L2 norm. The conditions for upper bounds are typically based on scaled small-gain theorems with dynamic multipliers or dissipation inequalities with parameter dependent Lyapunov functions. This paper presents a complementary algorithm to compute lower bounds for the induced L2 norm. The proposed approach computes a lower bound on the gain by restricting the parameter trajectory to be a periodic signal. This restriction enables the use of recent results for exact calculation of the L2 norm for a periodic linear time varying system. The proposed lower bound algorithm has two benefits. First, the lower bound complements standard upper bound techniques. Specifically, a small gap between the bounds indicates that further computation, e.g. upper bounds with more complex Lyapunov functions, is unnecessary. Second, the lower bound algorithm returns a bad parameter trajectory for the LPV system that can be further analyzed to provide insight into the system performance.
△ Less
Submitted 28 August, 2014;
originally announced August 2014.