-
Balanced truncation with conformal maps
Authors:
Alessandro Borghi,
Tobias Breiten,
Serkan Gugercin
Abstract:
We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framewo…
▽ More
We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framework through conformal maps to handle poles in general domains. The major difference from classical balanced truncation resides in the formulation of the Gramians. We show that these new Gramians can still be computed by solving modified Lyapunov equations for specific conformal maps. A numerical algorithm to perform balanced truncation with conformal maps is developed and is tested on three numerical examples, namely a heat model, the Schrödinger equation, and the undamped linear wave equation, the latter two having spectra on the imaginary axis.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
$\mathcal{H}_2$ optimal model reduction of linear systems with multiple quadratic outputs
Authors:
Sean Reiter,
Igor Pontes Duff,
Ion Victor Gosea,
Serkan Gugercin
Abstract:
In this work, we consider the $\mathcal{H}_2$ optimal model reduction of dynamical systems that are linear in the state equation and up to quadratic nonlinearity in the output equation. As our primary theoretical contributions, we derive gradients of the squared $\mathcal{H}_2$ system error with respect to the reduced model quantities and, from the stationary points of these gradients, introduce G…
▽ More
In this work, we consider the $\mathcal{H}_2$ optimal model reduction of dynamical systems that are linear in the state equation and up to quadratic nonlinearity in the output equation. As our primary theoretical contributions, we derive gradients of the squared $\mathcal{H}_2$ system error with respect to the reduced model quantities and, from the stationary points of these gradients, introduce Gramian-based first-order necessary conditions for the $\mathcal{H}_2$ optimal approximation of a linear quadratic output (LQO) system. The resulting $\mathcal{H}_2$ optimality framework neatly generalizes the analogous Gramian-based optimality framework for purely linear systems. Computationally, we show how to enforce the necessary optimality conditions using Petrov-Galerkin projection; the corresponding projection matrices are obtained from a pair of Sylvester equations. Based on this result, we propose an iteratively corrected algorithm for the $\mathcal{H}_2$ model reduction of LQO systems, which we refer to as LQO-TSIA (linear quadratic output two-sided iteration algorithm). Numerical examples are included to illustrate the effectiveness of the proposed computational method against other existing approaches.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
Interpolatory Necessary Optimality Conditions for Reduced-order Modeling of Parametric Linear Time-invariant Systems
Authors:
Petar Mlinarić,
Peter Benner,
Serkan Gugercin
Abstract:
Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for p…
▽ More
Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for parametric LTI systems with a general pole-residue form. We then specialize this result to recover known conditions for systems with parameter-independent poles and develop new conditions for a certain class of systems with parameter-dependent poles.
△ Less
Submitted 18 January, 2024;
originally announced January 2024.
-
Generalizations of data-driven balancing: what to sample for different balancing-based reduced models
Authors:
Sean Reiter,
Ion Victor Gosea,
Serkan Gugercin
Abstract:
The Quadrature-based Balanced Truncation (QuadBT) framework of arXiv:2104.01006 is a "non-intrusive" reformulation of balanced truncation; a classical projection-based model-order reduction technique for linear systems. QuadBT is non-intrusive in the sense that it builds approximate balanced reduced-order models entirely from system response data (e.g., transfer function measurements) without the…
▽ More
The Quadrature-based Balanced Truncation (QuadBT) framework of arXiv:2104.01006 is a "non-intrusive" reformulation of balanced truncation; a classical projection-based model-order reduction technique for linear systems. QuadBT is non-intrusive in the sense that it builds approximate balanced reduced-order models entirely from system response data (e.g., transfer function measurements) without the need to reference an explicit state-space realization of the underlying full-order model. In this work, we generalize and extend QuadBT to other types of balanced truncation model reduction. Namely, we develop non-intrusive implementations for balanced stochastic truncation, positive-real balanced truncation, and bounded-real balanced truncation. We show that the data-driven construction of these balanced reduced-order models requires sampling certain spectral factors associated with the system of interest. Numerical examples are included in each case to validate our approach.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Frequency-Based Reduced Models from Purely Time-Domain Data via Data Informativity
Authors:
Michael S. Ackermann,
Serkan Gugercin
Abstract:
Frequency-based methods have been successfully employed in creating high fidelity data-driven reduced order models (DDROMs) for linear dynamical systems. These methods require access to values (and sometimes derivatives) of the frequency-response function (transfer function) in the complex plane. These frequency domain values can at times be costly or difficult to obtain (especially if the method…
▽ More
Frequency-based methods have been successfully employed in creating high fidelity data-driven reduced order models (DDROMs) for linear dynamical systems. These methods require access to values (and sometimes derivatives) of the frequency-response function (transfer function) in the complex plane. These frequency domain values can at times be costly or difficult to obtain (especially if the method of choice requires resampling); instead one may have access to only time-domain input-output data. The data informativity approach to moment matching provides a powerful new framework for recovering the required frequency data from a single time-domain trajectory. In this work, we analyze and extend upon this framework, resulting in vastly improved conditioning of the associated linear systems, an error indicator, and removal of an assumption that the system order is known. This analysis leads to a robust algorithm for recovering frequency information from time-domain data, suitable for large scale systems. We demonstrate the effectiveness of our algorithm by forming frequency based DDROMs from time-domain data of several dynamical systems.
△ Less
Submitted 2 January, 2024; v1 submitted 8 November, 2023;
originally announced November 2023.
-
IRKA is a Riemannian Gradient Descent Method
Authors:
Petar Mlinarić,
Christopher Beattie,
Zlatko Drmač,
Serkan Gugercin
Abstract:
The iterative rational Krylov algorithm (IRKA) is a commonly used fixed-point iteration developed to minimize the $\mathcal{H}_2$ model order reduction error. In this work, IRKA is recast as a Riemannian gradient descent method with a fixed step size over the manifold of rational functions having fixed degree. This interpretation motivates the development of a Riemannian gradient descent method ut…
▽ More
The iterative rational Krylov algorithm (IRKA) is a commonly used fixed-point iteration developed to minimize the $\mathcal{H}_2$ model order reduction error. In this work, IRKA is recast as a Riemannian gradient descent method with a fixed step size over the manifold of rational functions having fixed degree. This interpretation motivates the development of a Riemannian gradient descent method utilizing as a natural extension variable step size and line search. Comparisons made between IRKA and this extension on a few examples demonstrate significant benefits.
△ Less
Submitted 3 November, 2023;
originally announced November 2023.
-
Interpolatory $\mathcal{H}_2$-optimality Conditions for Structured Linear Time-invariant Systems
Authors:
Petar Mlinarić,
Peter Benner,
Serkan Gugercin
Abstract:
Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured…
▽ More
Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured LTI systems, in particular, for second-order, port-Hamiltonian, and time-delay systems. Under certain diagonalizability assumptions, we show that across all these different structured settings, bitangential Hermite interpolation is the common form for optimality, thus proving a unifying optimality framework for structured reduced-order modeling.
△ Less
Submitted 24 June, 2024; v1 submitted 16 October, 2023;
originally announced October 2023.
-
Structured interpolation for multivariate transfer functions of quadratic-bilinear systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simu…
▽ More
High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures.
△ Less
Submitted 27 April, 2023;
originally announced April 2023.
-
Structured barycentric forms for interpolation-based data-driven reduced modeling of second-order systems
Authors:
Ion Victor Gosea,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' tr…
▽ More
An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' transfer functions are rewritten in different barycentric forms using different parametrizations. Loewner-like algorithms are developed for the explicit computation of second-order systems from data based on the developed barycentric forms. Numerical experiments show the performance of these new structured data driven modeling methods compared to other interpolation-based data-driven modeling techniques from the literature.
△ Less
Submitted 22 March, 2023;
originally announced March 2023.
-
Nonlinear Balanced Truncation: Part 2 -- Model Reduction on Manifolds
Authors:
Boris Kramer,
Serkan Gugercin,
Jeff Borggaard
Abstract:
Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and ob…
▽ More
Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and observability are solutions of high-dimensional Hamilton-Jacobi-(Bellman) equations, which have been computationally intractable and (b) the transformations to construct the reduced-order models (ROMs) are potentially ill-conditioned and the resulting ROMs are difficult to simulate on the nonlinear balanced manifolds. Part~1 of this two-part article addressed challenge (a) via a scalable tensor-based method to solve for polynomial approximations of the open- and closed-loop energy functions. This article, (Part~2), addresses challenge (b) by presenting a novel and scalable method to reduce the dimensionality of the full-order model via model reduction on polynomially-nonlinear balanced manifolds. The associated nonlinear state transformation simultaneously 'diagonalizes' relevant energy functions in the new coordinates. Since this nonlinear balancing transformation can be ill-conditioned and expensive to evaluate, inspired by the linear case we develop a computationally efficient balance-and-reduce strategy, resulting in a scalable and better conditioned truncated transformation to produce balanced nonlinear ROMs. The algorithm is demonstrated on a semi-discretized partial differential equation, namely Burgers equation, which illustrates that higher-degree transformations can improve the accuracy of ROM outputs.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
Scalable Computation of Energy Functions for Nonlinear Balanced Truncation
Authors:
Boris Kramer,
Serkan Gugercin,
Jeff Borggaard,
Linus Balicki
Abstract:
Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. A computational challenges that has so far prevented its deployment on large-scale systems is that the energy functions required for characterization of controllability a…
▽ More
Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. A computational challenges that has so far prevented its deployment on large-scale systems is that the energy functions required for characterization of controllability and observability are solutions of various high-dimensional Hamilton-Jacobi-(Bellman) equations, which are computationally intractable in high dimensions. This work proposes a unifying and scalable approach to this challenge by considering a Taylor-series-based approximation to solve a class of parametrized Hamilton-Jacobi-Bellman equations that are at the core of nonlinear balancing. The value of a formulation parameter provides either open-loop balancing or a variety of closed-loop balancing options. To solve for the coefficients of Taylor-series approximations to the energy functions, the presented method derives a linear tensor system and heavily utilizes it to numerically solve structured linear systems with billions of unknowns. The strength and scalability of the algorithm is demonstrated on two semi-discretized partial differential equations, namely the Burgers and the Kuramoto-Sivashinsky equations.
△ Less
Submitted 20 April, 2024; v1 submitted 15 September, 2022;
originally announced September 2022.
-
A Unifying Framework for Interpolatory $\mathcal{L}_2$-optimal Reduced-order Modeling
Authors:
Petar Mlinarić,
Serkan Gugercin
Abstract:
We develop a unifying framework for interpolatory $\mathcal{L}_2$-optimal reduced-order modeling for a wide classes of problems ranging from stationary models to parametric dynamical systems. We first show that the framework naturally covers the well-known interpolatory necessary conditions for $\mathcal{H}_2$-optimal model order reduction and leads to the interpolatory conditions for…
▽ More
We develop a unifying framework for interpolatory $\mathcal{L}_2$-optimal reduced-order modeling for a wide classes of problems ranging from stationary models to parametric dynamical systems. We first show that the framework naturally covers the well-known interpolatory necessary conditions for $\mathcal{H}_2$-optimal model order reduction and leads to the interpolatory conditions for $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimal model order reduction of multi-input/multi-output parametric dynamical systems. Moreover, we derive novel interpolatory optimality conditions for rational discrete least-squares minimization and for $\mathcal{L}_2$-optimal model order reduction of a class of parametric stationary models. We show that bitangential Hermite interpolation appears as the main tool for optimality across different domains. The theoretical results are illustrated on two numerical examples.
△ Less
Submitted 25 September, 2023; v1 submitted 1 September, 2022;
originally announced September 2022.
-
$\mathcal{L}_2$-optimal Reduced-order Modeling Using Parameter-separable Forms
Authors:
Petar Mlinarić,
Serkan Gugercin
Abstract:
We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent al…
▽ More
We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent algorithm to construct the optimal approximant using only output samples. By choosing an appropriate measure, the framework covers both continuous (Lebesgue) and discrete cost functions. We show the efficacy of the proposed algorithm via various numerical examples. Furthermore, we analyze under what conditions the data-driven approximant can be obtained via projection.
△ Less
Submitted 14 October, 2022; v1 submitted 6 June, 2022;
originally announced June 2022.
-
A unifying framework for tangential interpolation of structured bilinear control systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of ta…
▽ More
In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of tangential interpolation for bilinear systems from the literature and also provides a unifying framework. We then derive explicit conditions on the projection spaces to enforce tangential interpolation in different settings, including conditions for tangential Hermite interpolation. The analysis is illustrated by means of three numerical examples.
△ Less
Submitted 3 June, 2022;
originally announced June 2022.
-
Model Reduction of Linear Dynamical Systems via Balancing for Bayesian Inference
Authors:
Elizabeth Qian,
Jemima M. Tabeart,
Christopher Beattie,
Serkan Gugercin,
Jiahua Jiang,
Peter R. Kramer,
Akil Narayan
Abstract:
We consider the Bayesian approach to the linear Gaussian inference problem of inferring the initial condition of a linear dynamical system from noisy output measurements taken after the initial time. In practical applications, the large dimension of the dynamical system state poses a computational obstacle to computing the exact posterior distribution. Model reduction offers a variety of computati…
▽ More
We consider the Bayesian approach to the linear Gaussian inference problem of inferring the initial condition of a linear dynamical system from noisy output measurements taken after the initial time. In practical applications, the large dimension of the dynamical system state poses a computational obstacle to computing the exact posterior distribution. Model reduction offers a variety of computational tools that seek to reduce this computational burden. In particular, balanced truncation is a system-theoretic approach to model reduction which obtains an efficient reduced-dimension dynamical system by projecting the system operators onto state directions which trade off the reachability and observability of state directions as expressed through the associated Gramians. We introduce Gramian definitions relevant to the inference setting and propose a balanced truncation approach based on these inference Gramians that yield a reduced dynamical system that can be used to cheaply approximate the posterior mean and covariance. Our definitions exploit natural connections between (i) the reachability Gramian and the prior covariance and (ii) the observability Gramian and the Fisher information. The resulting reduced model then inherits stability properties and error bounds from system theoretic considerations, and in some settings yields an optimal posterior covariance approximation. Numerical demonstrations on two benchmark problems in model reduction show that our method can yield near-optimal posterior covariance approximations with order-of-magnitude state dimension reduction.
△ Less
Submitted 25 November, 2021;
originally announced November 2021.
-
A wavelet-based dynamic mode decomposition for modeling mechanical systems from partial observations
Authors:
Manu Krishnan,
Serkan Gugercin,
Pablo A. Tarazaga
Abstract:
Dynamic mode decomposition (DMD) has emerged as a popular data-driven modeling approach to identifying spatio-temporal coherent structures in dynamical systems, owing to its strong relation with the Koopman operator. For dynamical systems with external forcing, the identified model should not only be suitable for a specific forcing function but should generally approximate the input-output behavio…
▽ More
Dynamic mode decomposition (DMD) has emerged as a popular data-driven modeling approach to identifying spatio-temporal coherent structures in dynamical systems, owing to its strong relation with the Koopman operator. For dynamical systems with external forcing, the identified model should not only be suitable for a specific forcing function but should generally approximate the input-output behavior of the underlying dynamics. A novel methodology for modeling those classes of dynamical systems is proposed in the present work, using wavelets in conjunction with the input-output dynamic mode decomposition (ioDMD). Our non-intrusive approach constructs numerical models directly from trajectories of the full model's inputs and outputs, without requiring the full-model operators. These trajectories are generated by running a simulation of the full model or observing the original dynamical systems' response to inputs in an experimental framework. Hence, the present methodology is applicable for dynamical systems whose internal state vector measurements are not available. Instead, data from only a few output locations are only accessible, as often the case in practice. The present methodology's applicability is explained by modeling the input-output response of a finite element beam model. The WDMD provides a linear state-space representation of the dynamical system using the response measurements and the corresponding input forcing functions. The developed state-space model is then used to simulate the beam's response towards different types of forcing functions. The method is further validated on an experimental data set using modal analysis on a simple free-free beam, demonstrating the efficacy of the proposed methodology as an appropriate candidate for modeling practical dynamical systems despite having no access to internal state measurements and treating the full model as a black-box.
△ Less
Submitted 25 October, 2021;
originally announced October 2021.
-
Structured vector fitting framework for mechanical systems
Authors:
Steffen W. R. Werner,
Ion Victor Gosea,
Serkan Gugercin
Abstract:
In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within th…
▽ More
In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within the classical vector fitting algorithm leads to the formulation of two new algorithms that allow the computation of modally damped mechanical systems from data in a least squares fashion. Thus, the learned model is guaranteed to have the desired structure. We test the proposed algorithms on two benchmark models.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
Parametric model reduction via rational interpolation along parameters
Authors:
Ion Victor Gosea,
Serkan Gugercin,
Benjamin Unger
Abstract:
We present a novel projection-based model reduction framework for parametric linear time-invariant systems that allows interpolating the transfer function at a given frequency point along parameter-dependent curves as opposed to the standard approach where transfer function interpolation is achieved for a discrete set of parameter and frequency samples. We accomplish this goal by using parameter-d…
▽ More
We present a novel projection-based model reduction framework for parametric linear time-invariant systems that allows interpolating the transfer function at a given frequency point along parameter-dependent curves as opposed to the standard approach where transfer function interpolation is achieved for a discrete set of parameter and frequency samples. We accomplish this goal by using parameter-dependent projection spaces. Our main result shows that for holomorphic system matrices, the corresponding interpolatory projection spaces are also holomorphic. The coefficients of the power series representation of the projection spaces can be computed iteratively using standard methods. We illustrate the analysis on three numerical examples.
△ Less
Submitted 30 March, 2021;
originally announced April 2021.
-
Data-driven balancing of linear dynamical systems
Authors:
Ion Victor Gosea,
Serkan Gugercin,
Christopher Beattie
Abstract:
We present a novel reformulation of balanced truncation, a classical model reduction method. The principal innovation that we introduce comes through the use of system response data that has been either measured or computed, without reference to any prescribed realization of the original model. Data are represented by sampled values of the transfer function {or the impulse response} corresponding…
▽ More
We present a novel reformulation of balanced truncation, a classical model reduction method. The principal innovation that we introduce comes through the use of system response data that has been either measured or computed, without reference to any prescribed realization of the original model. Data are represented by sampled values of the transfer function {or the impulse response} corresponding to the original model. We discuss parallels that our approach bears with the Loewner framework, another popular data-driven model reduction method. We illustrate our approach numerically in both continuous-time and discrete-time cases.
△ Less
Submitted 24 October, 2021; v1 submitted 2 April, 2021;
originally announced April 2021.
-
Data-driven modeling of linear dynamical systems with quadratic output in the AAA framework
Authors:
Ion Victor Gosea,
Serkan Gugercin
Abstract:
We extend the AAA (Adaptive-Antoulas-Anderson) algorithm to develop a data-driven modeling framework for linear systems with quadratic output (LQO). Such systems are characterized by two transfer functions: one corresponding to the linear part of the output and another one to the quadratic part. We first establish the joint barycentric representations and the interpolation theory for the two trans…
▽ More
We extend the AAA (Adaptive-Antoulas-Anderson) algorithm to develop a data-driven modeling framework for linear systems with quadratic output (LQO). Such systems are characterized by two transfer functions: one corresponding to the linear part of the output and another one to the quadratic part. We first establish the joint barycentric representations and the interpolation theory for the two transfer functions of LQO systems. This analysis leads to the proposed AAA-LQO algorithm. We show that by interpolating the transfer function values on a subset of samples together with imposing a least-squares minimization on the rest, we construct reliable data-driven LQO models. Two numerical test cases illustrate the efficiency of the proposed method.
△ Less
Submitted 25 February, 2021;
originally announced February 2021.
-
Contour Integral Methods for Nonlinear Eigenvalue Problems: A Systems Theoretic Approach
Authors:
Michael C. Brennan,
Mark Embree,
Serkan Gugercin
Abstract:
Contour integral methods for nonlinear eigenvalue problems seek to compute a subset of the spectrum in a bounded region of the complex plane. We briefly survey this class of algorithms, establishing a relationship to system realization techniques in control theory. This connection motivates a new general framework for contour integral methods (for linear and nonlinear eigenvalue problems), buildin…
▽ More
Contour integral methods for nonlinear eigenvalue problems seek to compute a subset of the spectrum in a bounded region of the complex plane. We briefly survey this class of algorithms, establishing a relationship to system realization techniques in control theory. This connection motivates a new general framework for contour integral methods (for linear and nonlinear eigenvalue problems), building on recent developments in multi-point rational interpolation of dynamical systems. These new techniques, which replace the usual Hankel matrices with Loewner matrix pencils, incorporate general interpolation schemes and permit ready recovery of eigenvectors. Because the main computations (the solution of linear systems associated with contour integration) are identical for these Loewner methods and the traditional Hankel approach, a variety of new eigenvalue approximations can be explored with modest additional work. Numerical examples illustrate the potential of this approach. We also discuss how the concept of filter functions can be employed in this new framework, and show how contour methods enable a data-driven modal truncation method for model reduction.
△ Less
Submitted 29 December, 2020;
originally announced December 2020.
-
On the balanced truncation error bound and sign parameters from arrowhead realizations
Authors:
Sean Reiter,
Tobias Damm,
Mark Embree,
Serkan Gugercin
Abstract:
Balanced truncation and singular perturbation approximation for linear dynamical systems yield reduced-order models that satisfy a well-known error bound involving the Hankel singular values. We show that this bound holds with equality for single-input, single-output systems, if the sign parameters corresponding to the truncated Hankel singular values are all equal. These signs are determined by a…
▽ More
Balanced truncation and singular perturbation approximation for linear dynamical systems yield reduced-order models that satisfy a well-known error bound involving the Hankel singular values. We show that this bound holds with equality for single-input, single-output systems, if the sign parameters corresponding to the truncated Hankel singular values are all equal. These signs are determined by a generalized state-space symmetry property of the corresponding linear model. For a special class of systems having arrowhead realizations, the signs can be determined directly from the off-diagonal entries of the corresponding arrowhead matrix. We describe how such arrowhead systems arise naturally in certain applications of network modeling, and illustrate these results with a power system model that motivated this study.
△ Less
Submitted 17 January, 2024; v1 submitted 13 November, 2020;
originally announced November 2020.
-
Structure-Preserving Interpolation for Model Reduction of Parametric Bilinear Systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure…
▽ More
In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure and parameter dependencies are preserved in the reduced-order model. Two benchmark examples with different parameter dependencies are used to demonstrate the theoretical analysis.
△ Less
Submitted 22 July, 2020;
originally announced July 2020.
-
Randomization for the Efficient Computation of Parametric Reduced Order Models for Inversion
Authors:
Selin Aslan,
Eric de Sturler,
Serkan Gugercin
Abstract:
Nonlinear parametric inverse problems appear in many applications. Here, we focus on diffuse optical tomography (DOT) in medical imaging to recover unknown images of interest, such as cancerous tissue in a given medium, using a mathematical (forward) model. The forward model in DOT is a diffusion-absorption model for the photon flux. The main bottleneck in these problems is the repeated evaluation…
▽ More
Nonlinear parametric inverse problems appear in many applications. Here, we focus on diffuse optical tomography (DOT) in medical imaging to recover unknown images of interest, such as cancerous tissue in a given medium, using a mathematical (forward) model. The forward model in DOT is a diffusion-absorption model for the photon flux. The main bottleneck in these problems is the repeated evaluation of the large-scale forward model. For DOT, this corresponds to solving large linear systems for each source and frequency at each optimization step. Moreover, Newton-type methods, often the method of choice, require additional linear solves with the adjoint to compute derivative information. Emerging technology allows for large numbers of sources and detectors, making these problems prohibitively expensive. Reduced order models (ROM) have been used to drastically reduce the system size in each optimization step, while solving the inverse problem accurately. However, for large numbers of sources and detectors, just the construction of the candidate basis for the ROM projection space incurs a substantial cost, as matching the full parameter gradient matrix in interpolatory model reduction requires large linear solves for all sources and frequencies and all detectors and frequencies for each parameter interpolation point. As this candidate basis numerically has low rank, this construction is followed by a rank-revealing factorization that typically reduces the number of vectors in the candidate basis substantially. We propose to use randomization to approximate this basis with a drastically reduced number of large linear solves. We also provide a detailed analysis for the low-rank structure of the candidate basis for our problem of interest. Even though we focus on the DOT problem, the ideas presented are relevant to many other large scale inverse problems and optimization problems.
△ Less
Submitted 12 July, 2020;
originally announced July 2020.
-
The AAA framework for modeling linear dynamical systems with quadratic output
Authors:
Ion Victor Gosea,
Serkan Gugercin
Abstract:
We consider linear dynamical systems with quadratic output. We first define the two transfer functions, a single-variable and a multivariate one, that fully describe the dynamics of these special nonlinear systems. Then, using the samples of these two transfer functions, we extend the AAA algorithm to model linear systems with quadratic output from data.
We consider linear dynamical systems with quadratic output. We first define the two transfer functions, a single-variable and a multivariate one, that fully describe the dynamics of these special nonlinear systems. Then, using the samples of these two transfer functions, we extend the AAA algorithm to model linear systems with quadratic output from data.
△ Less
Submitted 20 May, 2020;
originally announced May 2020.
-
Structure-Preserving Interpolation of Bilinear Control Systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input sin…
▽ More
In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input single-output structured bilinear systems. Then, we extend these results to the case of multi-input multi-output structured bilinear systems by matrix interpolation. The effectiveness of our structure-preserving approach is illustrated by means of various numerical examples.
△ Less
Submitted 2 May, 2020;
originally announced May 2020.
-
The p-AAA algorithm for data driven modeling of parametric dynamical systems
Authors:
Andrea Carracedo Rodriguez,
Linus Balicki,
Serkan Gugercin
Abstract:
The AAA algorithm has become a popular tool for data-driven rational approximation of single variable functions, such as transfer functions of a linear dynamical system. In the setting of parametric dynamical systems appearing in many prominent applications, the underlying (transfer) function to be modeled is a multivariate function. With this in mind, we develop the AAA framework for approximatin…
▽ More
The AAA algorithm has become a popular tool for data-driven rational approximation of single variable functions, such as transfer functions of a linear dynamical system. In the setting of parametric dynamical systems appearing in many prominent applications, the underlying (transfer) function to be modeled is a multivariate function. With this in mind, we develop the AAA framework for approximating multivariate functions where the approximant is constructed in the multivariate barycentric form. The method is data-driven, in the sense that it does not require access to full state-space model and requires only function evaluations. We discuss an extension to the case of matrix-valued functions, i.e., multi-input/multi-output dynamical systems, and provide a connection to the tangential interpolation theory. Several numerical examples illustrate the effectiveness of the proposed approach.
△ Less
Submitted 10 July, 2022; v1 submitted 13 March, 2020;
originally announced March 2020.
-
Sampling-free parametric model reduction for structured systems
Authors:
Christopher Beattie,
Serkan Gugercin,
Zoran Tomljanovic
Abstract:
We consider the reduction of parametric families of linear dynamical systems having an affine parameter dependence that differ from one another by a low-rank variation in the state matrix. Usual approaches for parametric model reduction typically involve exploring the parameter space to isolate representative models on which to focus model reduction methodology, which are then combined in various…
▽ More
We consider the reduction of parametric families of linear dynamical systems having an affine parameter dependence that differ from one another by a low-rank variation in the state matrix. Usual approaches for parametric model reduction typically involve exploring the parameter space to isolate representative models on which to focus model reduction methodology, which are then combined in various ways in order to interpolate the response from these representative models. The initial exploration of the parameter space can be a forbiddingly expensive task. A different approach is proposed here that does not require any parameter sampling or exploration of the parameter space. Instead, we represent the system response in terms of four subsystems that are nonparametric. One may apply any one of a number of standard (nonparametric) model reduction strategies to reduce the subsystems independently, and then conjoin these reduced models with the underlying parameterized representation to obtain an overall parameterized response. Our approach has elements in common with the parameter map** approach of Baur et al. [8], but offers greater flexibility and potentially greater control over accuracy. In particular, a data-driven variation of our approach is described that exercises this flexibility through the use of limited frequency-sampling of the underlying nonparametric models. The parametric structure of our system representation allows for a priori guarantees of system stability the resulting parametric reduced models, uniformly across all parameter values. Incorporation of system theoretic error bounds allow us to determine appropriate approximation orders for the nonparametric systems sufficient to yield uniformly high accuracy with respect to parameter variation.
△ Less
Submitted 24 December, 2019;
originally announced December 2019.
-
Revisiting IRKA: Connections with pole placement and backward stability
Authors:
C. Beattie,
Z. Drmac,
S. Gugercin
Abstract:
The iterative rational Krylov algorithm (\textsf{IRKA}) is a popular approach for producing locally optimal reduced-order $\mathcal{H}_2$-approximations to linear time-invariant (LTI) dynamical systems. Overall, \textsf{IRKA} has seen significant practical success in computing high fidelity (locally) optimal reduced models and has been successfully applied in a variety of large-scale settings. Mor…
▽ More
The iterative rational Krylov algorithm (\textsf{IRKA}) is a popular approach for producing locally optimal reduced-order $\mathcal{H}_2$-approximations to linear time-invariant (LTI) dynamical systems. Overall, \textsf{IRKA} has seen significant practical success in computing high fidelity (locally) optimal reduced models and has been successfully applied in a variety of large-scale settings. Moreover, \textsf{IRKA} has provided a foundation for recent extensions to the systematic model reduction of bilinear and nonlinear dynamical systems.
Convergence of the basic \textsf{IRKA} iteration is generally observed to be rapid --- but not always; and despite the simplicity of the iteration, its convergence behavior is remarkably complex and not well understood aside from a few special cases. The overall effectiveness and computational robustness of the basic \textsf{IRKA} iteration is surprising since its algorithmic goals are very similar to a pole assignment problem, which can be notoriously ill-conditioned. We investigate this connection here and discuss a variety of nice properties of the \textsf{IRKA} iteration that are revealed when the iteration is framed with respect to a primitive basis. We find that the connection with pole assignment suggests refinements to the basic algorithm that can improve convergence behavior, leading also to new choices for termination criteria that assure backward stability.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
Structure-preserving Interpolatory Model Reduction for Port-Hamiltonian Differential-Algebraic Systems
Authors:
Chris A. Beattie,
Serkan Gugercin,
Volker Mehrmann
Abstract:
We examine interpolatory model reduction methods that are well-suited for treating large scale port-Hamiltonian differential-algebraic systems in a way that is able to preserve and indeed, take advantage of the underlying structural features of the system. We introduce approaches that incorporate regularization together with prudent selection of interpolation data. We focus on linear time-invarian…
▽ More
We examine interpolatory model reduction methods that are well-suited for treating large scale port-Hamiltonian differential-algebraic systems in a way that is able to preserve and indeed, take advantage of the underlying structural features of the system. We introduce approaches that incorporate regularization together with prudent selection of interpolation data. We focus on linear time-invariant systems and present a systematic treatment of a variety of model classes that include combinations of index-$1$ and index-$2$ systems, describing in particular how constraints may be represented in the transfer function and then preserved with interpolatory methods. We propose an algorithm to generate effective interpolation data and illustrate its effectiveness via two numerical examples.
△ Less
Submitted 1 November, 2021; v1 submitted 12 October, 2019;
originally announced October 2019.
-
$\mathcal{H}_2$-gap model reduction for stabilizable and detectable systems
Authors:
Tobias Breiten,
Chris A. Beattie,
Serkan Gugercin
Abstract:
We formulate here an approach to model reduction that is well-suited for linear time-invariant control systems that are stabilizable and detectable but may otherwise be unstable. We introduce a modified $\mathcal{H}_2$-error metric, the $\mathcal{H}_2$-gap, that provides an effective measure of model fidelity in this setting. While the direct evaluation of the $\mathcal{H}_2$-gap requires the solu…
▽ More
We formulate here an approach to model reduction that is well-suited for linear time-invariant control systems that are stabilizable and detectable but may otherwise be unstable. We introduce a modified $\mathcal{H}_2$-error metric, the $\mathcal{H}_2$-gap, that provides an effective measure of model fidelity in this setting. While the direct evaluation of the $\mathcal{H}_2$-gap requires the solutions of a pair of algebraic Riccati equations associated with related closed-loop systems, we are able to work entirely within an interpolatory framework, develo** algorithms and supporting analysis that do not reference full-order closed-loop Gramians. This leads to a computationally effective strategy yielding reduced models designed so that the corresponding reduced closed-loop systems will interpolate the full-order closed-loop system at specially adapted interpolation points, without requiring evaluation of the full-order closed-loop system nor even computation of the feedback law that determines it. The analytical framework and computational algorithm presented here provides an effective new approach toward constructing reduced-order models for unstable systems. Numerical examples for an unstable convection diffusion equation and a linearized incompressible Navier-Stokes equation illustrate the effectiveness of this approach.
△ Less
Submitted 30 September, 2019;
originally announced September 2019.
-
Stability of discrete empirical interpolation and gappy proper orthogonal decomposition with randomized and deterministic sampling points
Authors:
Benjamin Peherstorfer,
Zlatko Drmač,
Serkan Gugercin
Abstract:
This work investigates the stability of (discrete) empirical interpolation for nonlinear model reduction and state field approximation from measurements. Empirical interpolation derives approximations from a few samples (measurements) via interpolation in low-dimensional spaces. It has been observed that empirical interpolation can become unstable if the samples are perturbed due to, e.g., noise,…
▽ More
This work investigates the stability of (discrete) empirical interpolation for nonlinear model reduction and state field approximation from measurements. Empirical interpolation derives approximations from a few samples (measurements) via interpolation in low-dimensional spaces. It has been observed that empirical interpolation can become unstable if the samples are perturbed due to, e.g., noise, turbulence, and numerical inaccuracies. The main contribution of this work is a probabilistic analysis that shows that stable approximations are obtained if samples are randomized and if more samples than dimensions of the low-dimensional spaces are used. Oversampling, i.e., taking more sampling points than dimensions of the low-dimensional spaces, leads to approximations via regression and is known under the name of gappy proper orthogonal decomposition. Building on the insights of the probabilistic analysis, a deterministic sampling strategy is presented that aims to achieve lower approximation errors with fewer points than randomized sampling by taking information about the low-dimensional spaces into account. Numerical results of reconstructing velocity fields from noisy measurements of combustion processes and model reduction in the presence of noise demonstrate the instability of empirical interpolation and the stability of gappy proper orthogonal decomposition with oversampling.
△ Less
Submitted 19 May, 2020; v1 submitted 30 August, 2018;
originally announced August 2018.
-
Empirical least-squares fitting of parametrized dynamical systems
Authors:
Alexander Grimm,
Christopher Beattie,
Zlatko Drmač,
Serkan Gugercin
Abstract:
Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to internal system dynamics or equivalently, to realizations of the original system is either not possible or not practical; only response observations over a range of p…
▽ More
Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to internal system dynamics or equivalently, to realizations of the original system is either not possible or not practical; only response observations over a range of parameter settings might be known. Respecting these typical operational constraints, we propose a two phase approach that first encodes the response data into a high fidelity intermediate model of modest order, followed then by a compression stage that serves to eliminate redundancy in the intermediate model. For the first phase, we extend non-parametric least-squares fitting approaches so as to accommodate parameterized systems. This results in a (discrete) least-squares problem formulated with respect to both frequency and parameter that identifies "local" system response features. The second phase uses an $\mathbf{\mathcal{H}}_2$-optimal model reduction strategy accommodating the specialized parametric structure of the intermediate model obtained in the first phase. The final compressed model inherits the parametric dependence of the intermediate model and maintains the high fidelity of the intermediate model, while generally having dramatically smaller system order. We provide a variety of numerical examples demonstrating our approach.
△ Less
Submitted 16 August, 2018;
originally announced August 2018.
-
$\mathcal{H}_2(t_f)$ Optimality Conditions for a Finite-time Horizon
Authors:
Klajdi Sinani,
Serkan Gugercin
Abstract:
In this paper we establish the interpolatory model reduction framework for optimal approximation of MIMO dynamical systems with respect to the $\mathcal{H}_2$ norm over a finite-time horizon, denoted as the $\mathcal{H}_2(t_f)$ norm. Using the underlying inner product space, we derive the interpolatory first-order necessary optimality conditions for approximation in the $\mathcal{H}_2(t_f)$ norm.…
▽ More
In this paper we establish the interpolatory model reduction framework for optimal approximation of MIMO dynamical systems with respect to the $\mathcal{H}_2$ norm over a finite-time horizon, denoted as the $\mathcal{H}_2(t_f)$ norm. Using the underlying inner product space, we derive the interpolatory first-order necessary optimality conditions for approximation in the $\mathcal{H}_2(t_f)$ norm. Then, we develop an algorithm, which yields a locally optimal reduced model that satisfies the established interpolation-based optimality conditions. We test the algorithm on various numerical examples to illustrate its performance.
△ Less
Submitted 20 May, 2019; v1 submitted 28 June, 2018;
originally announced June 2018.
-
Kolmogorov $n$-widths for linear dynamical systems
Authors:
Benjamin Unger,
Serkan Gugercin
Abstract:
Kolmogorov $n$-widths and Hankel singular values are two commonly used concepts in model reduction. Here we show that for the special case of linear time-invariant dynamical (LTI) systems, these two concepts are directly connected. More specifically, the greedy search applied to the Hankel operator of an LTI system resembles the minimizing subspace for the Kolmogorov n-width and the Kolmogorov…
▽ More
Kolmogorov $n$-widths and Hankel singular values are two commonly used concepts in model reduction. Here we show that for the special case of linear time-invariant dynamical (LTI) systems, these two concepts are directly connected. More specifically, the greedy search applied to the Hankel operator of an LTI system resembles the minimizing subspace for the Kolmogorov n-width and the Kolmogorov $n$-width of an LTI system equals its $(n+1)st$ Hankel singular value once the subspaces are appropriately defined. We also establish a lower bound for the Kolmorogov $n$-width for parametric LTI systems and illustrate that the method of active subspaces can be viewed as the dual concept to the minimizing subspace for the Kolmogorov $n$-width.
△ Less
Submitted 26 June, 2018;
originally announced June 2018.
-
Interpolatory Model Reduction of Parameterized Bilinear Dynamical Systems
Authors:
Andrea Carracedo Rodriguez,
Serkan Gugercin,
Jeff Borggaard
Abstract:
Interpolatory projection methods for model reduction of nonparametric linear dynamical systems have been successfully extended to nonparametric bilinear dynamical systems. However, this is not the case for parametric bilinear systems. In this work, we aim to close this gap by providing a natural extension of interpolatory projections to model reduction of parametric bilinear dynamical systems. We…
▽ More
Interpolatory projection methods for model reduction of nonparametric linear dynamical systems have been successfully extended to nonparametric bilinear dynamical systems. However, this is not the case for parametric bilinear systems. In this work, we aim to close this gap by providing a natural extension of interpolatory projections to model reduction of parametric bilinear dynamical systems. We introduce necessary conditions that the projection subspaces must satisfy to obtain parametric tangential interpolation of each subsystem transfer function. These conditions also guarantee that the parameter sensitivities (Jacobian) of each subsystem transfer function is matched tangentially by those of the corresponding reduced order model transfer function. Similarly, we obtain conditions for interpolating the parameter Hessian of the transfer function by including extra vectors in the projection subspaces. As in the parametric linear case, the basis construction for two-sided projections does not require computing the Jacobian or the Hessian.
△ Less
Submitted 19 December, 2017;
originally announced December 2017.
-
Dam** optimization of parameter dependent mechanical systems by rational interpolation
Authors:
Zoran Tomljanović,
Christopher Beattie,
Serkan Gugercin
Abstract:
We consider an optimization problem related to semi-active dam** of vibrating systems. The main problem is to determine the best dam** matrix able to minimize influence of the input on the output of the system. We use a minimization criteria based on the $\mathcal{H}_2$ system norm.
The objective function is non-convex and the associated optimization problem typically requires a large number…
▽ More
We consider an optimization problem related to semi-active dam** of vibrating systems. The main problem is to determine the best dam** matrix able to minimize influence of the input on the output of the system. We use a minimization criteria based on the $\mathcal{H}_2$ system norm.
The objective function is non-convex and the associated optimization problem typically requires a large number of objective function evaluations. We propose an optimization approach that calculates `interpolatory' reduced order models, allowing for significant acceleration of the optimization process.
In our approach, we use parametric model reduction (PMOR) based on the Iterative Rational Krylov Algorithm, which ensures good approximations relative to the $\mathcal{H}_2$ system norm, aligning well with the underlying dam** design objectives. For the parameter sampling that occurs within each PMOR cycle, we consider approaches with predetermined sampling and approaches using adaptive sampling, and each of these approaches may be combined with three possible strategies for internal reduction. In order to preserve important system properties, we maintain second-order structure, which through the use of modal coordinates, allows for very efficient implementation.
The methodology proposed here provides a significant acceleration of the optimization process; the gain in efficiency is illustrated in numerical experiments.
△ Less
Submitted 6 July, 2017;
originally announced July 2017.
-
Linear time-periodic dynamical systems: An H2 analysis and a model reduction framework
Authors:
Caleb C. Magruder,
Serkan Gugercin,
Christopher A. Beattie
Abstract:
Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction.
We develop…
▽ More
Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction.
We develop here an algorithmic framework for constructing reduced models that retains the linear time-periodic structure of the original LTP system. Our approach generalizes optimal approaches that have been established previously for linear time-invariant (LTI) model reduction problems. We employ an extension of the usual H2 Hardy space defined for the LTI setting to time-periodic systems and within this broader framework develop an a posteriori error bound expressible in terms of related LTI systems. Optimization of this bound motivates our algorithm. We illustrate the success of our method on two numerical examples.
△ Less
Submitted 10 June, 2017;
originally announced June 2017.
-
Data-driven Structured Realization
Authors:
Philipp Schulze,
Benjamin Unger,
Christopher Beattie,
Serkan Gugercin
Abstract:
We present a framework for constructing structured realizations of linear dynamical systems having transfer functions of the form $C(\sum_{k=1}^K h_k(s)A_k)^{-1}B$ where $h_1,h_2,\ldots,h_K$ are prescribed functions that specify the surmised structure of the model. Our construction is data-driven in the sense that an interpolant is derived entirely from measurements of a transfer function. Our app…
▽ More
We present a framework for constructing structured realizations of linear dynamical systems having transfer functions of the form $C(\sum_{k=1}^K h_k(s)A_k)^{-1}B$ where $h_1,h_2,\ldots,h_K$ are prescribed functions that specify the surmised structure of the model. Our construction is data-driven in the sense that an interpolant is derived entirely from measurements of a transfer function. Our approach extends the Loewner realization framework to more general system structure that includes second-order (and higher) systems as well as systems with internal delays. Numerical examples demonstrate the advantages of this approach.
△ Less
Submitted 7 November, 2016;
originally announced November 2016.
-
$\mathcal H_2$-Quasi-Optimal Model Order Reduction for Quadratic-Bilinear Control Systems
Authors:
Peter Benner,
Pawan Goyal,
Serkan Gugercin
Abstract:
We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next…
▽ More
We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next, we derive first-order necessary conditions for an optimal approximation, where optimality is measured in term of the truncated $\mathcal H_2$-norm of the error system. We then propose an iterative model reduction algorithm, which upon convergence yields a reduced-order system that approximately satisfies the newly derived optimality conditions. We also discuss an efficient computation of the reduced Hessian, using the special Kronecker structure of the Hessian of the system. We illustrate the efficiency of the proposed method by means of several numerical examples resulting from semi-discretized nonlinear partial differential equations and show its competitiveness with the existing model reduction schemes for QB systems such as moment-matching methods and balanced truncation.
△ Less
Submitted 16 May, 2017; v1 submitted 11 October, 2016;
originally announced October 2016.
-
Model Reduction for Systems with Inhomogeneous Initial Conditions
Authors:
Christopher A. Beattie,
Serkan Gugercin,
Volker Mehrmann
Abstract:
We consider the model reduction problem for linear time-invariant dynamical systems having nonzero (but otherwise indeterminate) initial conditions. Building upon the observation that the full system response is decomposable as a superposition of the response map for an unforced system having nontrivial initial conditions and the response map for a forced system having null initial conditions, we…
▽ More
We consider the model reduction problem for linear time-invariant dynamical systems having nonzero (but otherwise indeterminate) initial conditions. Building upon the observation that the full system response is decomposable as a superposition of the response map for an unforced system having nontrivial initial conditions and the response map for a forced system having null initial conditions, we develop a new approach that involves reducing these component responses independently and then combining the reduced responses into an aggregate reduced system response. This approach allows greater flexibility and offers better approximation properties than other comparable methods.
△ Less
Submitted 2 January, 2017; v1 submitted 11 October, 2016;
originally announced October 2016.
-
Interpolatory methods for $\mathcal{H}_\infty$ model reduction of multi-input/multi-output systems
Authors:
Alessandro Castagnotto,
Christopher Beattie,
Serkan Gugercin
Abstract:
We develop here a computationally effective approach for producing high-quality $\mathcal{H}_\infty$-approximations to large scale linear dynamical systems having multiple inputs and multiple outputs (MIMO). We extend an approach for $\mathcal{H}_\infty$ model reduction introduced by Flagg, Beattie, and Gugercin for the single-input/single-output (SISO) setting, which combined ideas originating in…
▽ More
We develop here a computationally effective approach for producing high-quality $\mathcal{H}_\infty$-approximations to large scale linear dynamical systems having multiple inputs and multiple outputs (MIMO). We extend an approach for $\mathcal{H}_\infty$ model reduction introduced by Flagg, Beattie, and Gugercin for the single-input/single-output (SISO) setting, which combined ideas originating in interpolatory $\mathcal{H}_2$-optimal model reduction with complex Chebyshev approximation. Retaining this framework, our approach to the MIMO problem has its principal computational cost dominated by (sparse) linear solves, and so it can remain an effective strategy in many large-scale settings. We are able to avoid computationally demanding $\mathcal{H}_\infty$ norm calculations that are normally required to monitor progress within each optimization cycle through the use of "data-driven" rational approximations that are built upon previously computed function samples. Numerical examples are included that illustrate our approach. We produce high fidelity reduced models having consistently better $\mathcal{H}_\infty$ performance than models produced via balanced truncation; these models often are as good as (and occasionally better than) models produced using optimal Hankel norm approximation as well. In all cases considered, the method described here produces reduced models at far lower cost than is possible with either balanced truncation or optimal Hankel norm approximation.
△ Less
Submitted 4 October, 2016;
originally announced October 2016.
-
Computing Reduced Order Models via Inner-Outer Krylov Recycling in Diffuse Optical Tomography
Authors:
Meghan O'Connell,
Misha E. Kilmer,
Eric de Sturler,
Serkan Gugercin
Abstract:
In nonlinear imaging problems whose forward model is described by a partial differential equation (PDE), the main computational bottleneck in solving the inverse problem is the need to solve many large-scale discretized PDEs at each step of the optimization process. In the context of absorption imaging in diffuse optical tomography, one approach to addressing this bottleneck proposed recently (de…
▽ More
In nonlinear imaging problems whose forward model is described by a partial differential equation (PDE), the main computational bottleneck in solving the inverse problem is the need to solve many large-scale discretized PDEs at each step of the optimization process. In the context of absorption imaging in diffuse optical tomography, one approach to addressing this bottleneck proposed recently (de Sturler, et al, 2015) reformulates the viewing of the forward problem as a differential algebraic system, and then employs model order reduction (MOR). However, the construction of the reduced model requires the solution of several full order problems (i.e. the full discretized PDE for multiple right-hand sides) to generate a candidate global basis. This step is then followed by a rank-revealing factorization of the matrix containing the candidate basis in order to compress the basis to a size suitable for constructing the reduced transfer function. The present paper addresses the costs associated with the global basis approximation in two ways. First, we use the structure of the matrix to rewrite the full order transfer function, and corresponding derivatives, such that the full order systems to be solved are symmetric (positive definite in the zero frequency case). Then we apply MOR to the new formulation of the problem. Second, we give an approach to computing the global basis approximation dynamically as the full order systems are solved. In this phase, only the incrementally new, relevant information is added to the existing global basis, and redundant information is not computed. This new approach is achieved by an inner-outer Krylov recycling approach which has potential use in other applications as well. We show the value of the new approach to approximate global basis computation on two DOT absorption image reconstruction problems.
△ Less
Submitted 6 March, 2016; v1 submitted 30 January, 2016;
originally announced February 2016.
-
Preconditioning Parametrized Linear Systems
Authors:
Arielle Grim-McNally,
Eric de Sturler,
Serkan Gugercin
Abstract:
Preconditioners are generally essential for fast convergence in the iterative solution of linear systems of equations. However, the computation of a good preconditioner can be expensive. So, while solving a sequence of many linear systems, it is advantageous to recycle preconditioners, that is, update a previous preconditioner and reuse the updated version. In this paper, we introduce a simple and…
▽ More
Preconditioners are generally essential for fast convergence in the iterative solution of linear systems of equations. However, the computation of a good preconditioner can be expensive. So, while solving a sequence of many linear systems, it is advantageous to recycle preconditioners, that is, update a previous preconditioner and reuse the updated version. In this paper, we introduce a simple and effective method for doing this. Although our approach can be used for matrices changing slowly in any way, we focus on the important case of sequences of the type $(s_k\textbf{E}(\textbf{p}) + \textbf{A}(\textbf{p}))\textbf{x}_k = \textbf{b}_k$, where the right hand side may or may not change. More general changes in matrices will be discussed in a future paper. We update preconditioners by defining a map from a new matrix to a previous matrix, for example the first matrix in the sequence, and combine the preconditioner for this previous matrix with the map to define the new preconditioner. This approach has several advantages. The update is entirely independent from the original preconditioner, so it can be applied to any preconditioner. The possibly high cost of an initial preconditioner can be amortized over many linear solves. The cost of updating the preconditioner is more or less constant and independent of the original preconditioner. There is flexibility in balancing the quality of the map with the computational cost. In the numerical experiments section we demonstrate good results for several applications, in particular when using an algebraic multigrid preconditioner.
△ Less
Submitted 17 December, 2020; v1 submitted 22 January, 2016;
originally announced January 2016.
-
Structure-preserving Model Reduction for Nonlinear Port-Hamiltonian Systems
Authors:
Saifon Chaturantabut,
Chris Beattie,
Serkan Gugercin
Abstract:
This paper presents a structure-preserving model reduction approach applicable to large-scale, nonlinear port-Hamiltonian systems. Structure preservation in the reduction step ensures the retention of port-Hamiltonian structure which, in turn, assures the stability and passivity of the reduced model. Our analysis provides a priori error bounds for both state variables and outputs. Three techniques…
▽ More
This paper presents a structure-preserving model reduction approach applicable to large-scale, nonlinear port-Hamiltonian systems. Structure preservation in the reduction step ensures the retention of port-Hamiltonian structure which, in turn, assures the stability and passivity of the reduced model. Our analysis provides a priori error bounds for both state variables and outputs. Three techniques are considered for constructing bases needed for the reduction: one that utilizes proper orthogonal decompositions; one that utilizes $\mathcal{H}_2/\mathcal{H}_{\infty}$-derived optimized bases; and one that is a mixture of the two. The complexity of evaluating the reduced nonlinear term is managed efficiently using a modification of the discrete empirical interpolation method (DEIM) that also preserves port-Hamiltonian structure. The efficiency and accuracy of this model reduction framework are illustrated with two examples: a nonlinear ladder network and a tethered Toda lattice.
△ Less
Submitted 4 January, 2016;
originally announced January 2016.
-
A New Selection Operator for the Discrete Empirical Interpolation Method -- improved a priori error bound and extensions
Authors:
Zlatko Drmac,
Serkan Gugercin
Abstract:
This paper introduces a new framework for constructing the Discrete Empirical Interpolation Method DEIM projection operator. The interpolation node selection procedure is formulated using the QR factorization with column pivoting, and it enjoys a sharper error bound for the DEIM projection error. Furthermore, for a subspace $\mathcal{U}$ given as the range of an orthonormal $U$, the DEIM projectio…
▽ More
This paper introduces a new framework for constructing the Discrete Empirical Interpolation Method DEIM projection operator. The interpolation node selection procedure is formulated using the QR factorization with column pivoting, and it enjoys a sharper error bound for the DEIM projection error. Furthermore, for a subspace $\mathcal{U}$ given as the range of an orthonormal $U$, the DEIM projection does not change if $U$ is replaced by $U Ω$ with arbitrary unitary matrix $Ω$. In a large-scale setting, the new approach allows modifications that use only randomly sampled rows of $U$, but with the potential of producing good approximations with corresponding probabilistic error bounds. Another salient feature of the new framework is that robust and efficient software implementation is easily developed, based on readily available high performance linear algebra packages.
△ Less
Submitted 31 October, 2015; v1 submitted 2 May, 2015;
originally announced May 2015.
-
Vector Fitting for Matrix-valued Rational Approximation
Authors:
Zlatko Drmac,
Serkan Gugercin,
Christopher Beattie
Abstract:
Vector Fitting (VF) is a popular method of constructing rational approximants that provides a least squares fit to frequency response measurements. In an earlier work, we provided an analysis of VF for scalar-valued rational functions and established a connection with optimal $H_2$ approximation. We build on this work and extend the previous framework to include the construction of effective ratio…
▽ More
Vector Fitting (VF) is a popular method of constructing rational approximants that provides a least squares fit to frequency response measurements. In an earlier work, we provided an analysis of VF for scalar-valued rational functions and established a connection with optimal $H_2$ approximation. We build on this work and extend the previous framework to include the construction of effective rational approximations to matrix-valued functions, a problem which presents significant challenges that do not appear in the scalar case. Transfer functions associated with multi-input/multi-output (MIMO) dynamical systems typify the class of functions that we consider here. Others have also considered extensions of VF to matrix-valued functions and related numerical implementations are readily available. However to our knowledge, a detailed analysis of numerical issues that arise does not yet exist. We offer such an analysis including critical implementation details here.
One important issue that arises for VF on matrix-valued functions that has remained largely unaddressed is the control of the McMillan degree of the resulting rational approximant; the McMillan degree can grow very high in the case of large input/output dimensions. We introduce two new mechanisms for controlling the McMillan degree of the final approximant, one based on alternating least-squares minimization and one based on ancillary system-theoretic reduction methods. Motivated in part by our earlier work on the scalar VF problem as well as by recent innovations for computing optimal $H_2$ approximation, we establish a connection with optimal $H_2$ approximation, and are able to improve significantly the fidelity of VF through numerical quadrature, with virtually no increase in cost or complexity. We provide several numerical examples to support the theoretical discussion and proposed algorithms.
△ Less
Submitted 1 March, 2015;
originally announced March 2015.
-
Model Reduction by Rational Interpolation
Authors:
Christopher Beattie,
Serkan Gugercin
Abstract:
The last two decades have seen major developments in interpolatory methods for model reduction of large-scale linear dynamical systems. Advances of note include the ability to produce (locally) optimal reduced models at modest cost; refined methods for deriving interpolatory reduced models directly from input/output measurements; and extensions for the reduction of parametrized systems. This chapt…
▽ More
The last two decades have seen major developments in interpolatory methods for model reduction of large-scale linear dynamical systems. Advances of note include the ability to produce (locally) optimal reduced models at modest cost; refined methods for deriving interpolatory reduced models directly from input/output measurements; and extensions for the reduction of parametrized systems. This chapter offers a survey of interpolatory model reduction methods starting from basic principles and ranging up through recent developments that include weighted model reduction and structure-preserving methods based on generalized coprime representations. Our discussion is supported by an assortment of numerical examples.
△ Less
Submitted 7 September, 2014;
originally announced September 2014.
-
Model Reduction for DAEs with an Application to Flow Control
Authors:
Jeff T. Borggaard,
Serkan Gugercin
Abstract:
Direct numerical simulation of dynamical systems is of fundamental importance in studying a wide range of complex physical phenomena. However, the ever-increasing need for accuracy leads to extremely large-scale dynamical systems whose simulations impose huge computational demands. Model reduction offers one remedy to this problem by producing simpler reduced models that are both easier to analyze…
▽ More
Direct numerical simulation of dynamical systems is of fundamental importance in studying a wide range of complex physical phenomena. However, the ever-increasing need for accuracy leads to extremely large-scale dynamical systems whose simulations impose huge computational demands. Model reduction offers one remedy to this problem by producing simpler reduced models that are both easier to analyze and faster to simulate while accurately replicating the original behavior. Interpolatory model reduction methods have emerged as effective candidates for very large-scale problems due to their ability to produce high-fidelity (optimal in some cases) reduced models for linear and bilinear dynamical systems with modest computational cost. In this paper, we will briefly review the interpolation framework for model reduction and describe a well studied flow control problem that requires model reduction of a large scale system of differential algebraic equations. We show that interpolatory model reduction produces a feedback control strategy that matches the structure of much more expensive control design methodologies.
△ Less
Submitted 4 June, 2014;
originally announced June 2014.
-
Quadrature-Based Vector Fitting: Implications For H2 System Approximation
Authors:
Zlatko Drmac,
Serkan Gugercin,
Christopher Beattie
Abstract:
Vector Fitting is a popular method of constructing rational approximants designed to fit given frequency response measurements. The original method, which we refer to as VF, is based on a least-squares fit to the measurements by a rational function, using an iterative reallocation of the poles of the approximant. We show that one can improve the performance of VF significantly, by using a particul…
▽ More
Vector Fitting is a popular method of constructing rational approximants designed to fit given frequency response measurements. The original method, which we refer to as VF, is based on a least-squares fit to the measurements by a rational function, using an iterative reallocation of the poles of the approximant. We show that one can improve the performance of VF significantly, by using a particular choice of frequency sampling points and properly weighting their contribution based on quadrature rules that connect the least squares objective with an H2 error measure. Our modified approach, designated here as QuadVF, helps recover the original transfer function with better global fidelity (as measured with respect to the H2 norm), than the localized least squares approximation implicit in VF. We extend the new framework also to incorporate derivative information, leading to rational approximants that minimize system error with respect to a discrete Sobolev norm. We consider the convergence behavior of both VF and QuadVF as well, and evaluate potential numerical ill-conditioning of the underlying least-squares problems. We investigate briefly VF in the case of noisy measurements and propose a new formulation for the resulting approximation problem. Several numerical examples are provided to support the theoretical discussion.
△ Less
Submitted 18 March, 2014;
originally announced March 2014.