Showing 1–20 of 20 results for author: Packard, A

Optimal assignment of collaborating agents in multi-body asset-guarding games

Authors: Emmanuel Sin, Murat Arcak, Andrew Packard, Douglas Philbrick, Peter Seiler

Abstract: We study a multi-body asset-guarding game in missile defense where teams of interceptor missiles collaborate to defend a non-manuevering asset against a group of threat missiles. We approach the problem in two steps. We first formulate an assignment problem where we optimally assign subsets of collaborating interceptors to each threat so that all threats are intercepted as far away from the asset… ▽ More We study a multi-body asset-guarding game in missile defense where teams of interceptor missiles collaborate to defend a non-manuevering asset against a group of threat missiles. We approach the problem in two steps. We first formulate an assignment problem where we optimally assign subsets of collaborating interceptors to each threat so that all threats are intercepted as far away from the asset as possible. We assume that each interceptor is controlled by a collaborative guidance law derived from linear quadratic dynamic games. Our results include a 6-DOF simulation of a 5-interceptor versus 3-threat missile engagement where each agent is modeled as a missile airframe controlled by an autopilot. Despite the assumption of linear dynamics in our collaborative guidance law and the unmodeled dynamics in the simulation environment (e.g., varying density and gravity), we show that the simulated trajectories match well with those predicted by our approach. Furthermore, we show that a more agile threat, with greater speed and acceleration, can be intercepted by inferior interceptors when they collaborate. We believe the concepts introduced in this paper may be applied in asymmetric missile defense scenarios, including defense against advanced cruise missiles and hypersonic vehicles. △ Less

Submitted 25 May, 2020; originally announced May 2020.

An Introduction to Disk Margins

Authors: Peter Seiler, Andrew Packard, Pascal Gahinet

Abstract: This paper provides a tutorial introduction to disk margins. These are robust stability measures that account for simultaneous gain and phase perturbations in a feedback system. The paper first reviews the classical (gain-only and phase-only) margins and their limitations. This motivates the use of disk margins which are defined using a set of perturbations that have simultaneous gain and phase va… ▽ More This paper provides a tutorial introduction to disk margins. These are robust stability measures that account for simultaneous gain and phase perturbations in a feedback system. The paper first reviews the classical (gain-only and phase-only) margins and their limitations. This motivates the use of disk margins which are defined using a set of perturbations that have simultaneous gain and phase variations. A necessary and sufficient condition is provided to compute the disk margin for a single-input, single-output feedback system. Frequency-dependent disk margins can also be computed yielding additional insight. The paper concludes with a discussion of stability margins for multiple-input, multiple output (MIMO) feedback systems. A typical approach is to assess robust stability "loop-at-a-time" with a perturbation introduced into a single channel and all other channels held at their nominal values. MIMO disk margins provide a useful extension to consider simultaneous variations in multiple channels. This multiple-loop analysis can provide a more accurate robustness assessment as compared to the loop-at-a-time approach. △ Less

Submitted 7 April, 2020; v1 submitted 10 March, 2020; originally announced March 2020.

Optimization Based Planner Tracker Design for Safety Guarantees

Authors: He Yin, Monimoy Bujarbaruah, Murat Arcak, Andrew Packard

Abstract: We present a safe-by-design approach to path planning and control for nonlinear systems. The planner uses a low fidelity model of the plant to compute reference trajectories by solving an MPC problem, while the plant being controlled utilizes a feedback control law that tracks those trajectories with an upper-bound on the tracking error. Our main goal is to allow for maximum permissiveness (that i… ▽ More We present a safe-by-design approach to path planning and control for nonlinear systems. The planner uses a low fidelity model of the plant to compute reference trajectories by solving an MPC problem, while the plant being controlled utilizes a feedback control law that tracks those trajectories with an upper-bound on the tracking error. Our main goal is to allow for maximum permissiveness (that is, room for constraint feasibility) of the planner, while maintaining safety after accounting for the tracking error bound. We achieve this by parametrizing the state and input constraints imposed on the planner and deriving corresponding parametrized tracking control laws and tracking error bounds, which are computed offline through Sum-of-Squares programming. The parameters are then optimally chosen to maximize planner permissiveness, while guaranteeing safety. △ Less

Submitted 2 October, 2019; originally announced October 2019.

Comments: Submitted to IEEE American Control Conference (ACC), Denver, CO, USA, July 2020

Backward Reachability for Polynomial Systems on A Finite Horizon

Authors: He Yin, Murat Arcak, Andrew Packard, Peter Seiler

Abstract: A method is presented to obtain an inner-approximation of the backward reachable set (BRS) of a given target tube, along with an admissible controller that maintains trajectories inside this tube. The proposed optimization algorithms are formulated as nonlinear optimization problems, which are decoupled into tractable subproblems and solved by an iterative algorithm using the polynomial S-procedur… ▽ More A method is presented to obtain an inner-approximation of the backward reachable set (BRS) of a given target tube, along with an admissible controller that maintains trajectories inside this tube. The proposed optimization algorithms are formulated as nonlinear optimization problems, which are decoupled into tractable subproblems and solved by an iterative algorithm using the polynomial S-procedure and sum-of-squares techniques. This framework is also extended to uncertain nonlinear systems with L_2 disturbances and L_{\infty} parametric uncertainties. The effectiveness of the method is demonstrated on several nonlinear robotics and aircraft systems with control saturation. △ Less

Submitted 7 July, 2019; originally announced July 2019.

Comments: Submitted to IEEE TAC

Representing Model Discrepancy in Bound-to-Bound Data Collaboration

Authors: Wenyu Li, Arun Hegde, James Oreluk, Andrew Packard, Michael Frenklach

Abstract: We extended the existing methodology in Bound-to-Bound Data Collaboration (B2BDC), an optimization-based deterministic uncertainty quantification (UQ) framework, to explicitly take into account model discrepancy. The discrepancy was represented as a linear combination of finite basis functions and the feasible set was constructed according to a collection of modified model-data constraints. Formul… ▽ More We extended the existing methodology in Bound-to-Bound Data Collaboration (B2BDC), an optimization-based deterministic uncertainty quantification (UQ) framework, to explicitly take into account model discrepancy. The discrepancy was represented as a linear combination of finite basis functions and the feasible set was constructed according to a collection of modified model-data constraints. Formulas for making predictions were also modified to include the model discrepancy function. Prior information about the model discrepancy can be added to the framework as additional constraints. Dataset consistency, a central feature of B2BDC, was generalized based on the extended framework. △ Less

Submitted 4 February, 2020; v1 submitted 1 July, 2019; originally announced July 2019.

Comments: 31 pages, 10 figures and 7 tables

MSC Class: 62P35; 68T37

Robust Control of the Sit-to-Stand Movement for a Powered Lower Limb Orthosis

Authors: Octavio Narvaez-Aroche, Pierre-Jean Meyer, Stephen Tu, Andrew Packard, Murat Arcak

Abstract: The sit-to-stand movement is a key feature for wide adoption of powered lower limb orthoses for patients with complete paraplegia. In this paper we study the control of the ascending phase of the sit-to-stand movement for a minimally actuated powered lower limb orthosis at the hips. First, we generate a pool of finite horizon Linear Quadratic Regulator feedback gains, designed under the assumption… ▽ More The sit-to-stand movement is a key feature for wide adoption of powered lower limb orthoses for patients with complete paraplegia. In this paper we study the control of the ascending phase of the sit-to-stand movement for a minimally actuated powered lower limb orthosis at the hips. First, we generate a pool of finite horizon Linear Quadratic Regulator feedback gains, designed under the assumption that we can control not only the torque at the hips but also the loads at the shoulders that in reality are applied by the user. Next we conduct reachability analysis to define a performance metric measuring the robustness of each controller against parameter uncertainty, and choose the best controller from the pool with respect to this metric. Then, we replace the presumed shoulder control with an Iterative Learning Control algorithm as a substitute for human experiments. Indeed this algorithm obtains torque and forces at the shoulders that result in successful simulations of the sit-to-stand movement, regardless of parameter uncertainty and factors deliberately introduced to hinder learning. Thus it is reasonable to expect that the superior cognitive skills of real users will enable them to cooperate with the hip torque controller through training. △ Less

Submitted 16 November, 2018; originally announced November 2018.

Comments: 19 pages, 14 figures

Finite Horizon Backward Reachability Analysis and Control Synthesis for Uncertain Nonlinear Systems

Authors: He Yin, Andrew Packard, Murat Arcak, Pete Seiler

Abstract: We present a method for synthesizing controllers to steer trajectories from an initial set to a target set on a finite time horizon. The proposed control synthesis problem is decomposed into two steps. The first step under-approximates the backward reachable set (BRS) from the target set, using level sets of storage functions. The storage function is constructed with an iterative algorithm to maxi… ▽ More We present a method for synthesizing controllers to steer trajectories from an initial set to a target set on a finite time horizon. The proposed control synthesis problem is decomposed into two steps. The first step under-approximates the backward reachable set (BRS) from the target set, using level sets of storage functions. The storage function is constructed with an iterative algorithm to maximize the volume of the under-approximated BRS. The second step obtains a control law by solving a pointwise min-norm optimization problem using the pre-computed storage function. A closed-form solution of this min-norm optimization can be computed through the KKT conditions. This control synthesis framework is then extended to uncertain nonlinear systems with parametric uncertainties and L_2 disturbances. The computation algorithm for all cases is derived using sum-of-squares (SOS) programming and the S-procedure. The proposed method is applied to several robotics and aircraft examples. △ Less

Submitted 30 September, 2018; originally announced October 2018.

Comments: 17 pages, 6 figures, submitted to ACC 2019

Reachability Analysis Using Dissipation Inequalities For Uncertain Nonlinear Systems

Authors: He Yin, Andrew Packard, Murat Arcak, Peter Seiler

Abstract: We propose a method to outer bound forward reachable sets on finite horizons for uncertain nonlinear systems with polynomial dynamics. This method makes use of time-dependent polynomial storage functions that satisfy appropriate dissipation inequalities that account for time-varying uncertain parameters, L2 disturbances, and perturbations characterized by integral quadratic constraints (IQCs) with… ▽ More We propose a method to outer bound forward reachable sets on finite horizons for uncertain nonlinear systems with polynomial dynamics. This method makes use of time-dependent polynomial storage functions that satisfy appropriate dissipation inequalities that account for time-varying uncertain parameters, L2 disturbances, and perturbations characterized by integral quadratic constraints (IQCs) with both hard and soft factorizations. In fact, to our knowledge, this is the first result introducing IQCs to reachability analysis, thus allowing for various types of uncertainty, including unmodeled dynamics. The generalized S-procedure and Sum-of-Squares techniques are used to derive algorithms with the goal of finding the tightest outer bound with a desired shape. Both pedagogical and practically motivated examples are presented, including a 7-state F-18 aircraft model. △ Less

Submitted 15 May, 2020; v1 submitted 7 August, 2018; originally announced August 2018.

Comments: 23 pages, 14 figures, submitted to Systems & Control Letters

Diagnostics of Data-Driven Models: Uncertainty Quantification of PM7 Semi-Empirical Quantum Chemical Method

Authors: James Oreluk, Zhenyuan Liu, Arun Hegde, Wenyu Li, Andrew Packard, Michael Frenklach, Dmitry Zubarev

Abstract: We report an evaluation of a semi-empirical quantum chemical method PM7 from the perspective of uncertainty quantification. Specifically, we apply Bound-to-Bound Data Collaboration, an uncertainty quantification framework, to characterize a) variability of PM7 model parameter values consistent with the uncertainty in the training data, and b) uncertainty propagation from the training data to the m… ▽ More We report an evaluation of a semi-empirical quantum chemical method PM7 from the perspective of uncertainty quantification. Specifically, we apply Bound-to-Bound Data Collaboration, an uncertainty quantification framework, to characterize a) variability of PM7 model parameter values consistent with the uncertainty in the training data, and b) uncertainty propagation from the training data to the model predictions. Experimental heats of formation of a homologous series of linear alkanes are used as the property of interest. The training data are chemically accurate, i.e., they have very low uncertainty by the standards of computational chemistry. The analysis does not find evidence of PM7 consistency with the entire data set considered as no single set of parameter values is found that captures the experimental uncertainties of all training data. Nevertheless, PM7 is found to be consistent for subsets of the training data. In such cases, uncertainty propagation from the chemically accurate training data to the predicted values preserves error within bounds of chemical accuracy if predictions are made for the molecules of comparable size. Otherwise, the error grows linearly with the relative size of the molecules. △ Less

Submitted 16 June, 2018; v1 submitted 12 June, 2018; originally announced June 2018.

Journal ref: Scientific Reports 8, Article number: 13248 (2018)

Reachability Analysis for Robustness Evaluation of the Sit-To-Stand Movement for Powered Lower Limb Orthoses

Authors: Octavio Narvaez-Aroche, Pierre-Jean Meyer, Murat Arcak, Andrew Packard

Abstract: A sensitivity-based approach for computing over-approximations of reachable sets, in the presence of constant parameter uncertainties and a single initial state, is used to analyze a three-link planar robot modeling a Powered Lower Limb Orthosis and its user. Given the nature of the map**s relating the state and parameters of the system with the inputs, and outputs describing the trajectories of… ▽ More A sensitivity-based approach for computing over-approximations of reachable sets, in the presence of constant parameter uncertainties and a single initial state, is used to analyze a three-link planar robot modeling a Powered Lower Limb Orthosis and its user. Given the nature of the map**s relating the state and parameters of the system with the inputs, and outputs describing the trajectories of its Center of Mass, reachable sets for their respective spaces can be obtained relying on the sensitivities of the nonlinear closed-loop dynamics in the state space. These over-approximations are used to evaluate the worst-case performances of a finite time horizon linear-quadratic regulator (LQR) for controlling the ascending phase of the Sit-To-Stand movement. △ Less

Submitted 28 May, 2018; originally announced May 2018.

Comments: 14 pages, 19 figures, DSCC 2018 Submission

Finite Time Robust Control of the Sit-to-Stand Movement for Powered Lower Limb Orthoses

Authors: Octavio Narvaez-Aroche, Andrew Packard, Murat Arcak

Abstract: This study presents a technique to safely control the Sit-to-Stand movement of powered lower limb orthoses in the presence of parameter uncertainty. The weight matrices used to calculate the finite time horizon linear-quadratic regulator (LQR) gain in the feedback loop are chosen from a pool of candidates as to minimize a robust performance metric involving induced gains that measure the deviation… ▽ More This study presents a technique to safely control the Sit-to-Stand movement of powered lower limb orthoses in the presence of parameter uncertainty. The weight matrices used to calculate the finite time horizon linear-quadratic regulator (LQR) gain in the feedback loop are chosen from a pool of candidates as to minimize a robust performance metric involving induced gains that measure the deviation of variables of interest in a linear time-varying (LTV) system, at specific times within a finite horizon, caused by a perturbation signal modeling the variation of the parameters. Two relevant Sit-to-Stand movements are simulated for drawing comparisons with the results documented in a previous work. △ Less

Submitted 24 May, 2018; originally announced May 2018.

Comments: 8 pages, 14 figures, ACC 2018 Submission

Finite Horizon Robustness Analysis of LTV Systems Using Integral Quadratic Constraints

Authors: Peter Seiler, Robert Moore, Chris Meissen, Murat Arcak, Andrew Packard

Abstract: The goal of this paper is to assess the robustness of an uncertain linear time-varying (LTV) system on a finite time horizon. The uncertain system is modeled as a connection of a known LTV system and a perturbation. The input/output behavior of the perturbation is described by time-domain, integral quadratic constraints (IQCs). Typical notions of robustness, e.g. nominal stability and gain/phase m… ▽ More The goal of this paper is to assess the robustness of an uncertain linear time-varying (LTV) system on a finite time horizon. The uncertain system is modeled as a connection of a known LTV system and a perturbation. The input/output behavior of the perturbation is described by time-domain, integral quadratic constraints (IQCs). Typical notions of robustness, e.g. nominal stability and gain/phase margins, can be insufficient for finite-horizon analysis. Instead, this paper focuses on robust induced gains and bounds on the reachable set of states. Sufficient conditions to compute robust performance bounds are formulated using dissipation inequalities and IQCs. The analysis conditions are provided in two equivalent forms as Riccati differential equations and differential linear matrix inequalities. A computational approach is provided that leverages both forms of the analysis conditions. The approach is demonstrated with two examples △ Less

Submitted 20 November, 2017; originally announced November 2017.

Journal ref: Automatica, volume 100, pp 135-143, 2019

Small Satellite Constellation Separation using Linear Programming based Differential Drag Commands

Authors: Emmanuel Sin, Murat Arcak, Andrew Packard

Abstract: We study the optimal control of an arbitrarily large constellation of small satellites operating in low Earth orbit. Simulating the lack of on-board propulsion, we limit our actuation to the use of differential drag maneuvers to make in-plane changes to the satellite orbits. We propose an efficient method to separate a cluster of satellites into a desired constellation shape while respecting actua… ▽ More We study the optimal control of an arbitrarily large constellation of small satellites operating in low Earth orbit. Simulating the lack of on-board propulsion, we limit our actuation to the use of differential drag maneuvers to make in-plane changes to the satellite orbits. We propose an efficient method to separate a cluster of satellites into a desired constellation shape while respecting actuation constraints and maximizing the operational lifetime of the constellation. By posing the problem as a linear program, we solve for the optimal drag commands for each of the satellites on a daily basis with a shrinking-horizon model predictive control approach. We then apply this control strategy in a nonlinear orbital dynamics simulation with a simple, varying atmospheric density model. We demonstrate the ability to control a cluster of 100+ satellites starting at the same initial conditions in a circular low Earth orbit to form an equally spaced constellation (with a relative angular separation error tolerance of one-tenth a degree). The constellation separation task can be executed in 71 days, a time frame that is competitive for the state-of-the-practice. This method allows us to trade the time required to converge to the desired constellation with a sacrifice in the overall constellation lifetime, measured as the maximum altitude loss experienced by one of the satellites in the group after the separation maneuvers. △ Less

Submitted 29 September, 2017; originally announced October 2017.

Comments: 8 pages, 9 figures

Non-Asymptotic Analysis of Robust Control from Coarse-Grained Identification

Authors: Stephen Tu, Ross Boczar, Andrew Packard, Benjamin Recht

Abstract: This work explores the trade-off between the number of samples required to accurately build models of dynamical systems and the degradation of performance in various control objectives due to a coarse approximation. In particular, we show that simple models can be easily fit from input/output data and are sufficient for achieving various control objectives. We derive bounds on the number of noisy… ▽ More This work explores the trade-off between the number of samples required to accurately build models of dynamical systems and the degradation of performance in various control objectives due to a coarse approximation. In particular, we show that simple models can be easily fit from input/output data and are sufficient for achieving various control objectives. We derive bounds on the number of noisy input/output samples from a stable linear time-invariant system that are sufficient to guarantee that the corresponding finite impulse response approximation is close to the true system in the $\mathcal{H}_\infty$-norm. We demonstrate that these demands are lower than those derived in prior art which aimed to accurately identify dynamical models. We also explore how different physical input constraints, such as power constraints, affect the sample complexity. Finally, we show how our analysis fits within the established framework of robust control, by demonstrating how a controller designed for an approximate system provably meets performance objectives on the true system. △ Less

Submitted 30 November, 2017; v1 submitted 15 July, 2017; originally announced July 2017.

Comments: A substantial revision, where we strengthen our existing upper bounds and introduce a matching lower bound

Exponential Stability Analysis via Integral Quadratic Constraints

Authors: Ross Boczar, Laurent Lessard, Andrew Packard, Benjamin Recht

Abstract: The theory of integral quadratic constraints (IQCs) allows verification of stability and gain-bound properties of systems containing nonlinear or uncertain elements. Gain bounds often imply exponential stability, but it can be challenging to compute useful numerical bounds on the exponential decay rate. This work presents a generalization of the classical IQC results of Megretski and Rantzer that… ▽ More The theory of integral quadratic constraints (IQCs) allows verification of stability and gain-bound properties of systems containing nonlinear or uncertain elements. Gain bounds often imply exponential stability, but it can be challenging to compute useful numerical bounds on the exponential decay rate. This work presents a generalization of the classical IQC results of Megretski and Rantzer that leads to a tractable computational procedure for finding exponential rate certificates that are far less conservative than ones computed from $L_2$ gain bounds alone. An expanded library of IQCs for certifying exponential stability is also provided and the effectiveness of the technique is demonstrated via numerical examples. △ Less

Submitted 2 June, 2017; originally announced June 2017.

Comments: arXiv admin note: text overlap with arXiv:1503.07222

Consistency Analysis for Massively Inconsistent Datasets in Bound-to-Bound Data Collaboration

Authors: Arun Hegde, Wenyu Li, James Oreluk, Andrew Packard, Michael Frenklach

Abstract: Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental observations with interval uncertainty. A collection of such models and observations is termed a dataset and carves out a feasible region in the parameter space… ▽ More Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental observations with interval uncertainty. A collection of such models and observations is termed a dataset and carves out a feasible region in the parameter space. If a dataset has a nonempty feasible set, it is said to be consistent. In real-world applications, it is often the case that collections of experiments and observations are inconsistent. Revealing the source of this inconsistency, i.e., identifying which models and/or observations are problematic, is essential before a dataset can be used for prediction. To address this issue, we introduce a constraint relaxation-based approach, entitled the vector consistency measure, for investigating datasets with numerous sources of inconsistency. The benefits of this vector consistency measure over a previous method of consistency analysis are demonstrated in two realistic gas combustion examples. △ Less

Submitted 1 April, 2019; v1 submitted 13 January, 2017; originally announced January 2017.

Comments: 31 pages, published in SIAM/ASA Journal on Uncertainty Quantification

Journal ref: SIAM/ASA J. Uncertainty Quantification, 6(2), 2018, pp. 429-456

Scale-Bridging Model Development for Coal Particle Devolatilization

Authors: Benjamin B Schroeder, Sean T Smith, Philip J Smith, Thomas H Fletcher, Andrew Packard, Michael Frenklach, Arun Hegde, Wenyu Li, James Oreluk

Abstract: When performing large-scale, high-performance computations of multi-physics applications, it is common to limit the complexity of physics sub-models comprising the simulation. For a hierarchical system of coal boiler simulations a scale-bridging model is constructed to capture characteristics appropriate for the application-scale from a detailed coal devolatilization model. Such scale-bridging all… ▽ More When performing large-scale, high-performance computations of multi-physics applications, it is common to limit the complexity of physics sub-models comprising the simulation. For a hierarchical system of coal boiler simulations a scale-bridging model is constructed to capture characteristics appropriate for the application-scale from a detailed coal devolatilization model. Such scale-bridging allows full descriptions of scale-applicable physics, while functioning at reasonable computational costs. This study presents a variation on multi-fidelity modeling with a detailed physics model, the chemical percolation devolatilization model, being used to calibrate a scale-briding model for the application of interest. The application space provides essential context for designing the scale-bridging model by defining scales, determining requirements and weighting desired characteristics. A single kinetic reaction equation with functional yield model and distributed activation energy is implemented to act as the scale-bridging model-form. Consistency constraints are used to locate regions of the scale-bridging model's parameter-space that are consistent with the uncertainty identified within the detailed model. Ultimately, the performance of the scale-bridging model with consistent parameter-sets was assessed against desired characteristics of the detailed model and found to perform satisfactorily in capturing thermodynamic trends and kinetic timescales for the desired application-scale. Framing the process of model-form selection within the context of calibration and uncertainty quantification allows the credibility of the model to be established. △ Less

Submitted 3 September, 2016; originally announced September 2016.

A General Analysis of the Convergence of ADMM

Authors: Robert Nishihara, Laurent Lessard, Benjamin Recht, Andrew Packard, Michael I. Jordan

Abstract: We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms introduced in Lessard et al. (2014), reducing algorithm convergence to verifying the stability of a dynamical system. This approach generalizes a number of existing resu… ▽ More We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms introduced in Lessard et al. (2014), reducing algorithm convergence to verifying the stability of a dynamical system. This approach generalizes a number of existing results and obviates any assumptions about specific choices of algorithm parameters. On a numerical example, we demonstrate that minimizing the derived bound on the convergence rate provides a practical approach to selecting algorithm parameters for particular ADMM instances. We complement our upper bound by constructing a nearly-matching lower bound on the worst-case rate of convergence. △ Less

Submitted 18 May, 2015; v1 submitted 6 February, 2015; originally announced February 2015.

Comments: 10 pages, 6 figures

Journal ref: International Conference on Machine Learning 32, 2015

Compositional Performance Certification of Interconnected Systems using ADMM

Authors: Chris Meissen, Laurent Lessard, Murat Arcak, Andrew Packard

Abstract: A compositional performance certification method is presented for interconnected systems using subsystem dissipativity properties and the interconnection structure. A large-scale optimization problem is formulated to search for the most relevant dissipativity properties. The alternating direction method of multipliers (ADMM) is employed to decompose and solve this problem, and is demonstrated on s… ▽ More A compositional performance certification method is presented for interconnected systems using subsystem dissipativity properties and the interconnection structure. A large-scale optimization problem is formulated to search for the most relevant dissipativity properties. The alternating direction method of multipliers (ADMM) is employed to decompose and solve this problem, and is demonstrated on several examples. △ Less

Submitted 26 August, 2015; v1 submitted 8 October, 2014; originally announced October 2014.

Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints

Authors: Laurent Lessard, Benjamin Recht, Andrew Packard

Abstract: This manuscript develops a new framework to analyze and design iterative optimization algorithms built on the notion of Integral Quadratic Constraints (IQC) from robust control theory. IQCs provide sufficient conditions for the stability of complicated interconnected systems, and these conditions can be checked by semidefinite programming. We discuss how to adapt IQC theory to study optimization a… ▽ More This manuscript develops a new framework to analyze and design iterative optimization algorithms built on the notion of Integral Quadratic Constraints (IQC) from robust control theory. IQCs provide sufficient conditions for the stability of complicated interconnected systems, and these conditions can be checked by semidefinite programming. We discuss how to adapt IQC theory to study optimization algorithms, proving new inequalities about convex functions and providing a version of IQC theory adapted for use by optimization researchers. Using these inequalities, we derive numerical upper bounds on convergence rates for the gradient method, the heavy-ball method, Nesterov's accelerated method, and related variants by solving small, simple semidefinite programming problems. We also briefly show how these techniques can be used to search for optimization algorithms with desired performance characteristics, establishing a new methodology for algorithm design. △ Less

Submitted 28 October, 2015; v1 submitted 15 August, 2014; originally announced August 2014.

Comments: The previous version of this paper quoted the wrong rate of Nesterov's optimal method when applied to strongly convex functions. With this correction, our bounds are now slightly better than those previously derived for Nesterov's method