Showing 1–19 of 19 results for author: Mitchell, T

Development of a central-moment phase-field lattice Boltzmann model for thermocapillary flows: Droplet capture and computational performance

Authors: Markus Holzer, Travis Mitchell, Christopher R. Leonardi, Ulrich Ruede

Abstract: This study develops a computationally efficient phase-field lattice Boltzmann model with the capability to simulate thermocapillary flows. The model was implemented into the open-source simulation framework, waLBerla, and extended to conduct the collision stage using central moments. The multiphase model was coupled with both a passive-scalar thermal LB, and a RK solution to the energy equation in… ▽ More This study develops a computationally efficient phase-field lattice Boltzmann model with the capability to simulate thermocapillary flows. The model was implemented into the open-source simulation framework, waLBerla, and extended to conduct the collision stage using central moments. The multiphase model was coupled with both a passive-scalar thermal LB, and a RK solution to the energy equation in order to resolve temperature-dependent surface tension phenomena. Various lattice stencils (D3Q7, D3Q15, D3Q19, D3Q27) were tested for the passive-scalar LB and both the second- and fourth-order RK methods were investigated. There was no significant difference observed in the accuracy of the LB or RK schemes. The passive scalar D3Q7 LB discretisation tended to provide computational benefits, while the second order RK scheme is superior in memory usage. This paper makes contributions relating to the modelling of thermocapillary flows and to understanding the behaviour of droplet capture with thermal sources analogous to thermal tweezers. Four primary contributions to the literature are identified. First, a new 3D thermocapillary, central-moment phase-field LB model is presented and implemented in the open-source software, waLBerla. Second, the accuracy and computational performance of various techniques to resolve the energy equation for multiphase, incompressible fluids is investigated. Third, the dynamic droplet transport behaviour in the presence of thermal sources is studied and insight is provided on the potential ability to manipulate droplets based on local domain heating. Finally, a concise analysis of the computational performance together with near-perfect scaling results on NVIDIA and AMD GPU-clusters is shown. This research enables the detailed study of droplet manipulation and control in thermocapillary devices. △ Less

Submitted 5 January, 2024; originally announced January 2024.

An Experimental Comparison of Methods for Computing the Numerical Radius

Authors: Tim Mitchell, Michael L. Overton

Abstract: We make an experimental comparison of methods for computing the numerical radius of an $n\times n$ complex matrix, based on two well-known characterizations, the first a nonconvex optimization problem in one real variable and the second a convex optimization problem in $n^{2}+1$ real variables. We make comparisons with respect to both accuracy and computation time using publicly available software… ▽ More We make an experimental comparison of methods for computing the numerical radius of an $n\times n$ complex matrix, based on two well-known characterizations, the first a nonconvex optimization problem in one real variable and the second a convex optimization problem in $n^{2}+1$ real variables. We make comparisons with respect to both accuracy and computation time using publicly available software. △ Less

Submitted 6 October, 2023; originally announced October 2023.

MSC Class: 15A60; 90C22

NCVX: A General-Purpose Optimization Solver for Constrained Machine and Deep Learning

Authors: Buyun Liang, Tim Mitchell, Ju Sun

Abstract: Imposing explicit constraints is relatively new but increasingly pressing in deep learning, stimulated by, e.g., trustworthy AI that performs robust optimization over complicated perturbation sets and scientific applications that need to respect physical laws and constraints. However, it can be hard to reliably solve constrained deep learning problems without optimization expertise. The existing d… ▽ More Imposing explicit constraints is relatively new but increasingly pressing in deep learning, stimulated by, e.g., trustworthy AI that performs robust optimization over complicated perturbation sets and scientific applications that need to respect physical laws and constraints. However, it can be hard to reliably solve constrained deep learning problems without optimization expertise. The existing deep learning frameworks do not admit constraints. General-purpose optimization packages can handle constraints but do not perform auto-differentiation and have trouble dealing with nonsmoothness. In this paper, we introduce a new software package called NCVX, whose initial release contains the solver PyGRANSO, a PyTorch-enabled general-purpose optimization package for constrained machine/deep learning problems, the first of its kind. NCVX inherits auto-differentiation, GPU acceleration, and tensor variables from PyTorch, and is built on freely available and widely used open-source frameworks. NCVX is available at https://ncvx.org, with detailed documentation and numerous examples from machine/deep learning and other fields. △ Less

Submitted 13 November, 2022; v1 submitted 3 October, 2022; originally announced October 2022.

Comments: Accepted by the NeurIPS Workshop on Optimization for Machine Learning (OPT 2022). arXiv admin note: text overlap with arXiv:2111.13984

Optimization for Robustness Evaluation beyond $\ell_p$ Metrics

Authors: Hengyue Liang, Buyun Liang, Ying Cui, Tim Mitchell, Ju Sun

Abstract: Empirical evaluation of deep learning models against adversarial attacks entails solving nontrivial constrained optimization problems. Popular algorithms for solving these constrained problems rely on projected gradient descent (PGD) and require careful tuning of multiple hyperparameters. Moreover, PGD can only handle $\ell_1$, $\ell_2$, and $\ell_\infty$ attack models due to the use of analytical… ▽ More Empirical evaluation of deep learning models against adversarial attacks entails solving nontrivial constrained optimization problems. Popular algorithms for solving these constrained problems rely on projected gradient descent (PGD) and require careful tuning of multiple hyperparameters. Moreover, PGD can only handle $\ell_1$, $\ell_2$, and $\ell_\infty$ attack models due to the use of analytical projectors. In this paper, we introduce a novel algorithmic framework that blends a general-purpose constrained-optimization solver PyGRANSO, With Constraint-Folding (PWCF), to add reliability and generality to robustness evaluation. PWCF 1) finds good-quality solutions without the need of delicate hyperparameter tuning, and 2) can handle general attack models, e.g., general $\ell_p$ ($p \geq 0$) and perceptual attacks, which are inaccessible to PGD-based algorithms. △ Less

Submitted 13 November, 2022; v1 submitted 2 October, 2022; originally announced October 2022.

Comments: 5 pages, 1 figure, 3 tables, accepted by the 14th International OPT Workshop on Optimization for Machine Learning, and submitted to the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

NCVX: A User-Friendly and Scalable Package for Nonconvex Optimization in Machine Learning

Authors: Buyun Liang, Tim Mitchell, Ju Sun

Abstract: Optimizing nonconvex (NCVX) problems, especially nonsmooth and constrained ones, is an essential part of machine learning. However, it can be hard to reliably solve such problems without optimization expertise. Existing general-purpose NCVX optimization packages are powerful but typically cannot handle nonsmoothness. GRANSO is among the first optimization solvers targeting general nonsmooth NCVX p… ▽ More Optimizing nonconvex (NCVX) problems, especially nonsmooth and constrained ones, is an essential part of machine learning. However, it can be hard to reliably solve such problems without optimization expertise. Existing general-purpose NCVX optimization packages are powerful but typically cannot handle nonsmoothness. GRANSO is among the first optimization solvers targeting general nonsmooth NCVX problems with nonsmooth constraints, but, as it is implemented in MATLAB and requires the user to provide analytical gradients, GRANSO is often not a convenient choice in machine learning (especially deep learning) applications. To greatly lower the technical barrier, we introduce a new software package called NCVX, whose initial release contains the solver PyGRANSO, a PyTorch-enabled port of GRANSO incorporating auto-differentiation, GPU acceleration, tensor input, and support for new QP solvers. NCVX is built on freely available and widely used open-source frameworks, and as a highlight, can solve general constrained deep learning problems, the first of its kind. NCVX is available at https://ncvx.org, with detailed documentation and numerous examples from machine learning and other fields. △ Less

Submitted 1 January, 2022; v1 submitted 27 November, 2021; originally announced November 2021.

Comments: NCVX is available at https://ncvx.org

Root-max Problems, Hybrid Expansion-Contraction, and Quadratically Convergent Optimization of Passive Systems

Authors: Tim Mitchell, Paul Van Dooren

Abstract: We present quadratically convergent algorithms to compute the extremal value of a real parameter for which a given rational transfer function of a linear time-invariant system is passive. This problem is formulated for both continuous-time and discrete-time systems and is linked to the problem of finding a realization of a rational transfer function such that its passivity radius is maximized. Our… ▽ More We present quadratically convergent algorithms to compute the extremal value of a real parameter for which a given rational transfer function of a linear time-invariant system is passive. This problem is formulated for both continuous-time and discrete-time systems and is linked to the problem of finding a realization of a rational transfer function such that its passivity radius is maximized. Our new methods make use of the Hybrid Expansion-Contraction algorithm, which we extend and generalize to the setting of what we call root-max problems. △ Less

Submitted 25 May, 2022; v1 submitted 2 September, 2021; originally announced September 2021.

Comments: Revision #1

MSC Class: 93D09; 93C05; 49M15; 37J25

On Properties of Univariate Max Functions at Local Maximizers

Authors: Tim Mitchell, Michael L. Overton

Abstract: More than three decades ago, Boyd and Balakrishnan established a regularity result for the two-norm of a transfer function at maximizers. Their result extends easily to the statement that the maximum eigenvalue of a univariate real analytic Hermitian matrix family is twice continuously differentiable, with Lipschitz second derivative, at all local maximizers, a property that is useful in several a… ▽ More More than three decades ago, Boyd and Balakrishnan established a regularity result for the two-norm of a transfer function at maximizers. Their result extends easily to the statement that the maximum eigenvalue of a univariate real analytic Hermitian matrix family is twice continuously differentiable, with Lipschitz second derivative, at all local maximizers, a property that is useful in several applications that we describe. We also investigate whether this smoothness property extends to max functions more generally. We show that the pointwise maximum of a finite set of $q$-times continuously differentiable univariate functions must have zero derivative at a maximizer for $q=1$, but arbitrarily close to the maximizer, the derivative may not be defined, even when $q=3$ and the maximizer is isolated. △ Less

Submitted 17 August, 2021; originally announced August 2021.

Comments: Initial preprint

MSC Class: 49J52; 65F99

Fast optimization of viscosities for frequency-weighted dam** of second-order systems

Authors: Nevena Jakovcevic Stor, Tim Mitchell, Zoran Tomljanovic, Matea Ugrica

Abstract: We consider frequency-weighted dam** optimization for vibrating systems described by a second-order differential equation. The goal is to determine viscosity values such that eigenvalues are kept away from certain undesirable areas on the imaginary axis. To this end, we present two complementary techniques. First, we propose new frameworks using nonsmooth constrained optimization problems, whose… ▽ More We consider frequency-weighted dam** optimization for vibrating systems described by a second-order differential equation. The goal is to determine viscosity values such that eigenvalues are kept away from certain undesirable areas on the imaginary axis. To this end, we present two complementary techniques. First, we propose new frameworks using nonsmooth constrained optimization problems, whose solutions both damp undesirable frequency bands and maintain stability of the system. These frameworks also allow us to weight which frequency bands are the most important to damp. Second, we also propose a fast new eigensolver for the structured quadratic eigenvalue problems that appear in such vibrating systems. In order to be efficient, our new eigensolver exploits special properties of diagonal-plus-rank-one complex symmetric matrices, which we leverage by showing how each quadratic eigenvalue problem can be transformed into a short sequence of such linear eigenvalue problems. The result is an eigensolver that is substantially faster than standard techniques. By combining this new solver with our new optimization frameworks, we obtain our overall algorithm for fast computation of optimal viscosities. The efficiency and performance of our new methods are verified and illustrated on several numerical examples. △ Less

Submitted 8 April, 2021; originally announced April 2021.

Optimization-based parametric model order reduction via $\mathcal{H}_2\otimes\mathcal{L}_2$ first-order necessary conditions

Authors: Manuela Hund, Tim Mitchell, Petar Mlinarić, Jens Saak

Abstract: In this paper, we generalize existing frameworks for $\mathcal{H}_2\otimes\mathcal{L}_2$-optimal model order reduction to a broad class of parametric linear time-invariant systems. To this end, we derive first-order necessary ptimality conditions for a class of structured reduced-order models, and then building on those, propose a stability-preserving optimization-based method for computing locall… ▽ More In this paper, we generalize existing frameworks for $\mathcal{H}_2\otimes\mathcal{L}_2$-optimal model order reduction to a broad class of parametric linear time-invariant systems. To this end, we derive first-order necessary ptimality conditions for a class of structured reduced-order models, and then building on those, propose a stability-preserving optimization-based method for computing locally $\mathcal{H}_2\otimes\mathcal{L}_2$-optimal reduced-order models. We also make a theoretical comparison to existing approaches in the literature, and in numerical experiments, show how our new method, with reasonable computational effort, produces stable optimized reduced-order models with significantly lower approximation errors. △ Less

Submitted 31 March, 2022; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: 24 pages, 6 figures

MSC Class: 15A24; 46N10; 65K05; 65Y20; 93A15; 93B40

Convergence rate analysis and improved iterations for numerical radius computation

Authors: Tim Mitchell

Abstract: The main two algorithms for computing the numerical radius are the level-set method of Mengi and Overton and the cutting-plane method of Uhlig. Via new analyses, we explain why the cutting-plane approach is sometimes much faster or much slower than the level-set one and then propose a new hybrid algorithm that remains efficient in all cases. For matrices whose fields of values are a circular disk… ▽ More The main two algorithms for computing the numerical radius are the level-set method of Mengi and Overton and the cutting-plane method of Uhlig. Via new analyses, we explain why the cutting-plane approach is sometimes much faster or much slower than the level-set one and then propose a new hybrid algorithm that remains efficient in all cases. For matrices whose fields of values are a circular disk centered at the origin, we show that the cost of Uhlig's method blows up with respect to the desired relative accuracy. More generally, we also analyze the local behavior of Uhlig's cutting procedure at outermost points in the field of values, showing that it often has a fast Q-linear rate of convergence and is Q-superlinear at corners. Finally, we identify and address inefficiencies in both the level-set and cutting-plane approaches and propose refined versions of these techniques. △ Less

Submitted 6 June, 2022; v1 submitted 31 January, 2020; originally announced February 2020.

Comments: Revision #3

Fast Computation of Sep$_λ$ via Interpolation-based Globality Certificates

Authors: Tim Mitchell

Abstract: Given two square matrices $A$ and $B$, we propose a new approach for computing the smallest value $\varepsilon \geq 0$ such that $A+E$ and $A+F$ share an eigenvalue, where $\|E\|=\|F\|=\varepsilon$. In 2006, Gu and Overton proposed the first algorithm for computing this quantity, called $\mathrm{sep}_λ(A,B)$ ("sep-lambda"), using ideas inspired from an earlier algorithm of Gu for computing the dis… ▽ More Given two square matrices $A$ and $B$, we propose a new approach for computing the smallest value $\varepsilon \geq 0$ such that $A+E$ and $A+F$ share an eigenvalue, where $\|E\|=\|F\|=\varepsilon$. In 2006, Gu and Overton proposed the first algorithm for computing this quantity, called $\mathrm{sep}_λ(A,B)$ ("sep-lambda"), using ideas inspired from an earlier algorithm of Gu for computing the distance to uncontrollability. However, the algorithm of Gu and Overton is extremely expensive, which limits it to the tiniest of problems, and until now, no other algorithms have been known. Our new algorithm can be orders of magnitude faster and can solve problems where $A$ and $B$ are of moderate size. Moreover, our method consists of many "embarrassingly parallel" computations, and so it can be further accelerated on multi-core hardware. Finally, we also propose the first algorithm to compute an earlier version of sep-lambda where $\|E\| + \|F\|=\varepsilon$. △ Less

Submitted 21 January, 2023; v1 submitted 12 November, 2019; originally announced November 2019.

Comments: 4th Revision, January 21, 2023

Fast Interpolation-based Globality Certificates for Computing Kreiss Constants and the Distance to Uncontrollability

Authors: Tim Mitchell

Abstract: We propose a new approach to computing global minimizers of singular value functions in two real variables. Specifically, we present new algorithms to compute the Kreiss constant of a matrix and the distance to uncontrollability of a linear control system, both to arbitrary accuracy. Previous state-of-the-art methods for these two quantities rely on 2D level-set tests that are based on solving lar… ▽ More We propose a new approach to computing global minimizers of singular value functions in two real variables. Specifically, we present new algorithms to compute the Kreiss constant of a matrix and the distance to uncontrollability of a linear control system, both to arbitrary accuracy. Previous state-of-the-art methods for these two quantities rely on 2D level-set tests that are based on solving large eigenvalue problems. Consequently, these methods are costly, i.e., $\mathcal{O}(n^6)$ work using dense eigensolvers, and often multiple tests are needed before convergence. Divide-and-conquer techniques have been proposed that reduce the work complexity to $\mathcal{O}(n^4)$ on average and $\mathcal{O}(n^5)$ in the worst case, but these variants are nevertheless still very expensive and can be numerically unreliable. In contrast, our new interpolation-based globality certificates perform level-set tests by building interpolant approximations to certain one-variable continuous functions that are both relatively cheap and numerically robust to evaluate. Our new approach has a $\mathcal{O}(kn^3)$ work complexity and uses $\mathcal{O}(n^2)$ memory, where $k$ is the number of function evaluations necessary to build the interpolants. Not only is this interpolation process mostly "embarrassingly parallel," but also low-fidelity approximations typically suffice for all but the final interpolant, which must be built to high accuracy. Even without taking advantage of the aforementioned parallelism, $k$ is sufficiently small that our new approach is generally orders of magnitude faster than the previous state-of-the-art. △ Less

Submitted 22 December, 2020; v1 submitted 2 October, 2019; originally announced October 2019.

Comments: Revision #2

Computing the Kreiss Constant of a Matrix

Authors: Tim Mitchell

Abstract: We establish the first globally convergent algorithms for computing the Kreiss constant of a matrix to arbitrary accuracy. We propose three different iterations for continuous-time Kreiss constants and analogues for discrete-time Kreiss constants. With standard eigensolvers, the methods do $\mathcal{O}(n^6)$ work, but we show how this theoretical work complexity can be lowered to… ▽ More We establish the first globally convergent algorithms for computing the Kreiss constant of a matrix to arbitrary accuracy. We propose three different iterations for continuous-time Kreiss constants and analogues for discrete-time Kreiss constants. With standard eigensolvers, the methods do $\mathcal{O}(n^6)$ work, but we show how this theoretical work complexity can be lowered to $\mathcal{O}(n^4)$ on average and $\mathcal{O}(n^5)$ in the worst case via divide-and-conquer variants. Finally, locally optimal Kreiss constant approximations can be efficiently obtained for large-scale matrices via optimization. △ Less

Submitted 22 December, 2020; v1 submitted 15 July, 2019; originally announced July 2019.

Comments: Second revision plus a few math typos fixed

A Comparison of Nonsmooth, Nonconvex, Constrained Optimization Solvers for the Design of Time-Delay Compensators

Authors: Vyacheslav Kungurtsev, Tim Mitchell, Tomas Vyhlidal

Abstract: We present a detailed set of performance comparisons of two state-of-the-art solvers for the application of designing time-delay compensators, an important problem in the field of robust control. Formulating such robust control mechanics as constrained optimization problems often involves objective and constraint functions that are both nonconvex and nonsmooth, both of which present significant ch… ▽ More We present a detailed set of performance comparisons of two state-of-the-art solvers for the application of designing time-delay compensators, an important problem in the field of robust control. Formulating such robust control mechanics as constrained optimization problems often involves objective and constraint functions that are both nonconvex and nonsmooth, both of which present significant challenges to many solvers and their end-users ho** to obtain good solutions to these problems. In our particular engineering task, the main difficulty in the optimization arises in a nonsmooth and nonconvex stability constraint, which states that the infinite spectrum of zeros of the so-called shaper should remain in the open left half-plane. To perform our evaluation, we make use $β$-relative minimization profiles, recently introduced visualization tools that are particularly suited for benchmarking solvers on nonsmooth, nonconvex, constrained optimization problems. Furthermore, we also introduce new visualization tools, called Global-Local Profiles, which for a given problem and a fixed computational budget, assess the tradeoffs of distributing the budget over few or many starting points, with the former getting more budget per point and latter less. △ Less

Submitted 30 December, 2018; originally announced December 2018.

Comments: Initial preprint

Low-Order Control Design using a Reduced-Order Model with a Stability Constraint on the Full-Order Model

Authors: Peter Benner, Tim Mitchell, Michael L. Overton

Abstract: We consider low-order controller design for large-scale linear time-invariant dynamical systems with inputs and outputs. Model order reduction is a popular technique, but controllers designed for reduced-order models may result in unstable closed-loop plants when applied to the full-order system. We introduce a new method to design a fixed-order controller by minimizing the $L_\infty$ norm of a re… ▽ More We consider low-order controller design for large-scale linear time-invariant dynamical systems with inputs and outputs. Model order reduction is a popular technique, but controllers designed for reduced-order models may result in unstable closed-loop plants when applied to the full-order system. We introduce a new method to design a fixed-order controller by minimizing the $L_\infty$ norm of a reduced-order closed-loop transfer matrix function subject to stability constraints on the closed-loop systems for both the reduced-order and the full-order models. Since the optimization objective and the constraints are all nonsmooth and nonconvex we use a sequential quadratic programming method based on quasi-Newton updating that is intended for this problem class, available in the open-source software package GRANSO. Using a publicly available test set, the controllers obtained by the new method are compared with those computed by the HIFOO (H-Infinity Fixed-Order Optimization) toolbox applied to a reduced-order model alone, which frequently fail to stabilize the closed-loop system for the associated full-order model. △ Less

Submitted 17 March, 2018; originally announced March 2018.

Extended and improved criss-cross algorithms for computing the spectral value set abscissa and radius

Authors: Peter Benner, Tim Mitchell

Abstract: In this paper, we extend the original criss-cross algorithms for computing the $\varepsilon$-pseudospectral abscissa and radius to general spectral value sets. By proposing new root-finding-based strategies for the horizontal/radial search subphases, we significantly reduce the number of expensive Hamiltonian eigenvalue decompositions incurred, which typically translates to meaningful speedups in… ▽ More In this paper, we extend the original criss-cross algorithms for computing the $\varepsilon$-pseudospectral abscissa and radius to general spectral value sets. By proposing new root-finding-based strategies for the horizontal/radial search subphases, we significantly reduce the number of expensive Hamiltonian eigenvalue decompositions incurred, which typically translates to meaningful speedups in overall computation times. Furthermore, and partly necessitated by our root-finding approach, we develop a new way of handling the singular pencils or problematic interior searches that can arise when computing the $\varepsilon$-spectral value set radius. Compared to would-be direct extensions of the original algorithms, that is, without our additional modifications, our improved criss-cross algorithms are not only noticeably faster but also more robust and numerically accurate, for both spectral value set and pseudospectral problems. △ Less

Submitted 6 September, 2019; v1 submitted 28 December, 2017; originally announced December 2017.

Comments: Final version

On Reduced Input-Output Dynamic Mode Decomposition

Authors: Peter Benner, Christian Himpe, Tim Mitchell

Abstract: The identification of reduced-order models from high-dimensional data is a challenging task, and even more so if the identified system should not only be suitable for a certain data set, but generally approximate the input-output behavior of the data source. In this work, we consider the input-output dynamic mode decomposition method for system identification. We compare excitation approaches for… ▽ More The identification of reduced-order models from high-dimensional data is a challenging task, and even more so if the identified system should not only be suitable for a certain data set, but generally approximate the input-output behavior of the data source. In this work, we consider the input-output dynamic mode decomposition method for system identification. We compare excitation approaches for the data-driven identification process and describe an optimization-based stabilization strategy for the identified systems. △ Less

Submitted 22 December, 2017; originally announced December 2017.

MSC Class: 93B30; 90C99

Faster and more accurate computation of the $\mathcal{H}_\infty$ norm via optimization

Authors: Peter Benner, Tim Mitchell

Abstract: In this paper, we propose an improved method for computing the $\mathcal{H}_\infty$ norm of linear dynamical systems that results in a code that is often several times faster than existing methods. By using standard optimization tools to rebalance the work load of the standard algorithm due to Boyd, Balakrishnan, Bruinsma, and Steinbuch, we aim to minimize the number of expensive eigenvalue comput… ▽ More In this paper, we propose an improved method for computing the $\mathcal{H}_\infty$ norm of linear dynamical systems that results in a code that is often several times faster than existing methods. By using standard optimization tools to rebalance the work load of the standard algorithm due to Boyd, Balakrishnan, Bruinsma, and Steinbuch, we aim to minimize the number of expensive eigenvalue computations that must be performed. Unlike the standard algorithm, our modified approach can also calculate the $\mathcal{H}_\infty$ norm to full precision with little extra work, and also offers more opportunity to further accelerate its performance via parallelization. Finally, we demonstrate that the local optimization we have employed to speed up the standard globally-convergent algorithm can also be an effective strategy on its own for approximating the $\mathcal{H}_\infty$ norm of large-scale systems. △ Less

Submitted 6 September, 2019; v1 submitted 8 July, 2017; originally announced July 2017.

Comments: Final version

Approximating the Real Structured Stability Radius with Frobenius Norm Bounded Perturbations

Authors: Nicola Guglielmi, Mert Gurbuzbalaban, Tim Mitchell, Michael Overton

Abstract: We propose a fast method to approximate the real stability radius of a linear dynamical system with output feedback, where the perturbations are restricted to be real valued and bounded with respect to the Frobenius norm. Our work builds on a number of scalable algorithms that have been proposed in recent years, ranging from methods that approximate the complex or real pseudospectral abscissa and… ▽ More We propose a fast method to approximate the real stability radius of a linear dynamical system with output feedback, where the perturbations are restricted to be real valued and bounded with respect to the Frobenius norm. Our work builds on a number of scalable algorithms that have been proposed in recent years, ranging from methods that approximate the complex or real pseudospectral abscissa and radius of large sparse matrices (and generalizations of these methods for pseudospectra to spectral value sets) to algorithms for approximating the complex stability radius (the reciprocal of the $H_\infty$ norm). Although our algorithm is guaranteed to find only upper bounds to the real stability radius, it seems quite effective in practice. As far as we know, this is the first algorithm that addresses the Frobenius-norm version of this problem. Because the cost mainly consists of computing the eigenvalue with maximal real part for continuous-time systems (or modulus for discrete-time systems) of a sequence of matrices, our algorithm remains very efficient for large-scale systems provided that the system matrices are sparse. △ Less

Submitted 8 February, 2017; originally announced February 2017.