Showing 1–50 of 66 results for author: Gugercin, S

Balanced truncation with conformal maps

Authors: Alessandro Borghi, Tobias Breiten, Serkan Gugercin

Abstract: We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framewo… ▽ More We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framework through conformal maps to handle poles in general domains. The major difference from classical balanced truncation resides in the formulation of the Gramians. We show that these new Gramians can still be computed by solving modified Lyapunov equations for specific conformal maps. A numerical algorithm to perform balanced truncation with conformal maps is developed and is tested on three numerical examples, namely a heat model, the Schrödinger equation, and the undamped linear wave equation, the latter two having spectra on the imaginary axis. △ Less

Submitted 24 May, 2024; originally announced May 2024.

$\mathcal{H}_2$ optimal model reduction of linear systems with multiple quadratic outputs

Authors: Sean Reiter, Igor Pontes Duff, Ion Victor Gosea, Serkan Gugercin

Abstract: In this work, we consider the $\mathcal{H}_2$ optimal model reduction of dynamical systems that are linear in the state equation and up to quadratic nonlinearity in the output equation. As our primary theoretical contributions, we derive gradients of the squared $\mathcal{H}_2$ system error with respect to the reduced model quantities and, from the stationary points of these gradients, introduce G… ▽ More In this work, we consider the $\mathcal{H}_2$ optimal model reduction of dynamical systems that are linear in the state equation and up to quadratic nonlinearity in the output equation. As our primary theoretical contributions, we derive gradients of the squared $\mathcal{H}_2$ system error with respect to the reduced model quantities and, from the stationary points of these gradients, introduce Gramian-based first-order necessary conditions for the $\mathcal{H}_2$ optimal approximation of a linear quadratic output (LQO) system. The resulting $\mathcal{H}_2$ optimality framework neatly generalizes the analogous Gramian-based optimality framework for purely linear systems. Computationally, we show how to enforce the necessary optimality conditions using Petrov-Galerkin projection; the corresponding projection matrices are obtained from a pair of Sylvester equations. Based on this result, we propose an iteratively corrected algorithm for the $\mathcal{H}_2$ model reduction of LQO systems, which we refer to as LQO-TSIA (linear quadratic output two-sided iteration algorithm). Numerical examples are included to illustrate the effectiveness of the proposed computational method against other existing approaches. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: 18 pages, 4 figures

MSC Class: 15A24; 46N10; 49K15; 93A15; 93C10; 93C80

Interpolatory Necessary Optimality Conditions for Reduced-order Modeling of Parametric Linear Time-invariant Systems

Authors: Petar Mlinarić, Peter Benner, Serkan Gugercin

Abstract: Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for p… ▽ More Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for parametric LTI systems with a general pole-residue form. We then specialize this result to recover known conditions for systems with parameter-independent poles and develop new conditions for a certain class of systems with parameter-dependent poles. △ Less

Submitted 18 January, 2024; originally announced January 2024.

Comments: 8 pages

Generalizations of data-driven balancing: what to sample for different balancing-based reduced models

Authors: Sean Reiter, Ion Victor Gosea, Serkan Gugercin

Abstract: The Quadrature-based Balanced Truncation (QuadBT) framework of arXiv:2104.01006 is a "non-intrusive" reformulation of balanced truncation; a classical projection-based model-order reduction technique for linear systems. QuadBT is non-intrusive in the sense that it builds approximate balanced reduced-order models entirely from system response data (e.g., transfer function measurements) without the… ▽ More The Quadrature-based Balanced Truncation (QuadBT) framework of arXiv:2104.01006 is a "non-intrusive" reformulation of balanced truncation; a classical projection-based model-order reduction technique for linear systems. QuadBT is non-intrusive in the sense that it builds approximate balanced reduced-order models entirely from system response data (e.g., transfer function measurements) without the need to reference an explicit state-space realization of the underlying full-order model. In this work, we generalize and extend QuadBT to other types of balanced truncation model reduction. Namely, we develop non-intrusive implementations for balanced stochastic truncation, positive-real balanced truncation, and bounded-real balanced truncation. We show that the data-driven construction of these balanced reduced-order models requires sampling certain spectral factors associated with the system of interest. Numerical examples are included in each case to validate our approach. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Comments: 13 pages, 3 figures

MSC Class: 93B15 (Primary) 93A15; 37M99; 65D30; 65K99; 15A24 (Secondary)

Frequency-Based Reduced Models from Purely Time-Domain Data via Data Informativity

Authors: Michael S. Ackermann, Serkan Gugercin

Abstract: Frequency-based methods have been successfully employed in creating high fidelity data-driven reduced order models (DDROMs) for linear dynamical systems. These methods require access to values (and sometimes derivatives) of the frequency-response function (transfer function) in the complex plane. These frequency domain values can at times be costly or difficult to obtain (especially if the method… ▽ More Frequency-based methods have been successfully employed in creating high fidelity data-driven reduced order models (DDROMs) for linear dynamical systems. These methods require access to values (and sometimes derivatives) of the frequency-response function (transfer function) in the complex plane. These frequency domain values can at times be costly or difficult to obtain (especially if the method of choice requires resampling); instead one may have access to only time-domain input-output data. The data informativity approach to moment matching provides a powerful new framework for recovering the required frequency data from a single time-domain trajectory. In this work, we analyze and extend upon this framework, resulting in vastly improved conditioning of the associated linear systems, an error indicator, and removal of an assumption that the system order is known. This analysis leads to a robust algorithm for recovering frequency information from time-domain data, suitable for large scale systems. We demonstrate the effectiveness of our algorithm by forming frequency based DDROMs from time-domain data of several dynamical systems. △ Less

Submitted 2 January, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

IRKA is a Riemannian Gradient Descent Method

Authors: Petar Mlinarić, Christopher Beattie, Zlatko Drmač, Serkan Gugercin

Abstract: The iterative rational Krylov algorithm (IRKA) is a commonly used fixed-point iteration developed to minimize the $\mathcal{H}_2$ model order reduction error. In this work, IRKA is recast as a Riemannian gradient descent method with a fixed step size over the manifold of rational functions having fixed degree. This interpretation motivates the development of a Riemannian gradient descent method ut… ▽ More The iterative rational Krylov algorithm (IRKA) is a commonly used fixed-point iteration developed to minimize the $\mathcal{H}_2$ model order reduction error. In this work, IRKA is recast as a Riemannian gradient descent method with a fixed step size over the manifold of rational functions having fixed degree. This interpretation motivates the development of a Riemannian gradient descent method utilizing as a natural extension variable step size and line search. Comparisons made between IRKA and this extension on a few examples demonstrate significant benefits. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Comments: 13 pages, 6 figures

Interpolatory $\mathcal{H}_2$-optimality Conditions for Structured Linear Time-invariant Systems

Authors: Petar Mlinarić, Peter Benner, Serkan Gugercin

Abstract: Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured… ▽ More Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured LTI systems, in particular, for second-order, port-Hamiltonian, and time-delay systems. Under certain diagonalizability assumptions, we show that across all these different structured settings, bitangential Hermite interpolation is the common form for optimality, thus proving a unifying optimality framework for structured reduced-order modeling. △ Less

Submitted 24 June, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

Comments: 23 pages

Structured interpolation for multivariate transfer functions of quadratic-bilinear systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simu… ▽ More High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: 29 pages, 7 figures

MSC Class: 30E05; 34K17; 65D05; 93C10; 93A15

Journal ref: Adv. Comput. Math., 50(2):18, 2024

Structured barycentric forms for interpolation-based data-driven reduced modeling of second-order systems

Authors: Ion Victor Gosea, Serkan Gugercin, Steffen W. R. Werner

Abstract: An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' tr… ▽ More An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' transfer functions are rewritten in different barycentric forms using different parametrizations. Loewner-like algorithms are developed for the explicit computation of second-order systems from data based on the developed barycentric forms. Numerical experiments show the performance of these new structured data driven modeling methods compared to other interpolation-based data-driven modeling techniques from the literature. △ Less

Submitted 22 March, 2023; originally announced March 2023.

Comments: 27 pages, 5 figures

MSC Class: 41A20; 65D05; 93B15; 93C05; 93C80

Journal ref: Adv. Comput. Math., 50(2):26, 2024

Nonlinear Balanced Truncation: Part 2 -- Model Reduction on Manifolds

Authors: Boris Kramer, Serkan Gugercin, Jeff Borggaard

Abstract: Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and ob… ▽ More Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and observability are solutions of high-dimensional Hamilton-Jacobi-(Bellman) equations, which have been computationally intractable and (b) the transformations to construct the reduced-order models (ROMs) are potentially ill-conditioned and the resulting ROMs are difficult to simulate on the nonlinear balanced manifolds. Part~1 of this two-part article addressed challenge (a) via a scalable tensor-based method to solve for polynomial approximations of the open- and closed-loop energy functions. This article, (Part~2), addresses challenge (b) by presenting a novel and scalable method to reduce the dimensionality of the full-order model via model reduction on polynomially-nonlinear balanced manifolds. The associated nonlinear state transformation simultaneously 'diagonalizes' relevant energy functions in the new coordinates. Since this nonlinear balancing transformation can be ill-conditioned and expensive to evaluate, inspired by the linear case we develop a computationally efficient balance-and-reduce strategy, resulting in a scalable and better conditioned truncated transformation to produce balanced nonlinear ROMs. The algorithm is demonstrated on a semi-discretized partial differential equation, namely Burgers equation, which illustrates that higher-degree transformations can improve the accuracy of ROM outputs. △ Less

Submitted 3 February, 2023; originally announced February 2023.

Comments: 16 pages, 5 figures. arXiv admin note: text overlap with arXiv:2209.07645

Scalable Computation of Energy Functions for Nonlinear Balanced Truncation

Authors: Boris Kramer, Serkan Gugercin, Jeff Borggaard, Linus Balicki

Abstract: Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. A computational challenges that has so far prevented its deployment on large-scale systems is that the energy functions required for characterization of controllability a… ▽ More Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. A computational challenges that has so far prevented its deployment on large-scale systems is that the energy functions required for characterization of controllability and observability are solutions of various high-dimensional Hamilton-Jacobi-(Bellman) equations, which are computationally intractable in high dimensions. This work proposes a unifying and scalable approach to this challenge by considering a Taylor-series-based approximation to solve a class of parametrized Hamilton-Jacobi-Bellman equations that are at the core of nonlinear balancing. The value of a formulation parameter provides either open-loop balancing or a variety of closed-loop balancing options. To solve for the coefficients of Taylor-series approximations to the energy functions, the presented method derives a linear tensor system and heavily utilizes it to numerically solve structured linear systems with billions of unknowns. The strength and scalability of the algorithm is demonstrated on two semi-discretized partial differential equations, namely the Burgers and the Kuramoto-Sivashinsky equations. △ Less

Submitted 20 April, 2024; v1 submitted 15 September, 2022; originally announced September 2022.

Comments: 23 pages, 4 figures

A Unifying Framework for Interpolatory $\mathcal{L}_2$-optimal Reduced-order Modeling

Authors: Petar Mlinarić, Serkan Gugercin

Abstract: We develop a unifying framework for interpolatory $\mathcal{L}_2$-optimal reduced-order modeling for a wide classes of problems ranging from stationary models to parametric dynamical systems. We first show that the framework naturally covers the well-known interpolatory necessary conditions for $\mathcal{H}_2$-optimal model order reduction and leads to the interpolatory conditions for… ▽ More We develop a unifying framework for interpolatory $\mathcal{L}_2$-optimal reduced-order modeling for a wide classes of problems ranging from stationary models to parametric dynamical systems. We first show that the framework naturally covers the well-known interpolatory necessary conditions for $\mathcal{H}_2$-optimal model order reduction and leads to the interpolatory conditions for $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimal model order reduction of multi-input/multi-output parametric dynamical systems. Moreover, we derive novel interpolatory optimality conditions for rational discrete least-squares minimization and for $\mathcal{L}_2$-optimal model order reduction of a class of parametric stationary models. We show that bitangential Hermite interpolation appears as the main tool for optimality across different domains. The theoretical results are illustrated on two numerical examples. △ Less

Submitted 25 September, 2023; v1 submitted 1 September, 2022; originally announced September 2022.

Comments: 20 pages, 2 figures

$\mathcal{L}_2$-optimal Reduced-order Modeling Using Parameter-separable Forms

Authors: Petar Mlinarić, Serkan Gugercin

Abstract: We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent al… ▽ More We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent algorithm to construct the optimal approximant using only output samples. By choosing an appropriate measure, the framework covers both continuous (Lebesgue) and discrete cost functions. We show the efficacy of the proposed algorithm via various numerical examples. Furthermore, we analyze under what conditions the data-driven approximant can be obtained via projection. △ Less

Submitted 14 October, 2022; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: 22 pages, 10 figures

A unifying framework for tangential interpolation of structured bilinear control systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of ta… ▽ More In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of tangential interpolation for bilinear systems from the literature and also provides a unifying framework. We then derive explicit conditions on the projection spaces to enforce tangential interpolation in different settings, including conditions for tangential Hermite interpolation. The analysis is illustrated by means of three numerical examples. △ Less

Submitted 3 June, 2022; originally announced June 2022.

Comments: 33 pages, 9 figures

MSC Class: 30E05; 34K17; 65D05; 93A15; 93C10

Journal ref: Numer. Math., 155(3-4): 445-483, 2023

Structure-Preserving Model Reduction for Nonlinear Power Grid Network

Authors: Bita Safaee, Serkan Gugercin

Abstract: We develop a structure-preserving system-theoretic model reduction framework for nonlinear power grid networks. First, via a lifting transformation, we convert the original nonlinear system with trigonometric nonlinearities to an equivalent quadratic nonlinear model. This equivalent representation allows us to employ the $\mathcal{H}_2$-based model reduction approach, Quadratic Iterative Rational… ▽ More We develop a structure-preserving system-theoretic model reduction framework for nonlinear power grid networks. First, via a lifting transformation, we convert the original nonlinear system with trigonometric nonlinearities to an equivalent quadratic nonlinear model. This equivalent representation allows us to employ the $\mathcal{H}_2$-based model reduction approach, Quadratic Iterative Rational Krylov Algorithm (Q-IRKA), as an intermediate model reduction step. Exploiting the structure of the underlying power network model, we show that the model reduction bases resulting from Q-IRKA have a special subspace structure, which allows us to effectively construct the final model reduction basis. This final basis is applied on the original nonlinear structure to yield a reduced model that preserves the physically meaningful (second-order) structure of the original model. The effectiveness of our proposed framework is illustrated via two numerical examples. △ Less

Submitted 16 March, 2022; originally announced March 2022.

Model Reduction of Linear Dynamical Systems via Balancing for Bayesian Inference

Authors: Elizabeth Qian, Jemima M. Tabeart, Christopher Beattie, Serkan Gugercin, Jiahua Jiang, Peter R. Kramer, Akil Narayan

Abstract: We consider the Bayesian approach to the linear Gaussian inference problem of inferring the initial condition of a linear dynamical system from noisy output measurements taken after the initial time. In practical applications, the large dimension of the dynamical system state poses a computational obstacle to computing the exact posterior distribution. Model reduction offers a variety of computati… ▽ More We consider the Bayesian approach to the linear Gaussian inference problem of inferring the initial condition of a linear dynamical system from noisy output measurements taken after the initial time. In practical applications, the large dimension of the dynamical system state poses a computational obstacle to computing the exact posterior distribution. Model reduction offers a variety of computational tools that seek to reduce this computational burden. In particular, balanced truncation is a system-theoretic approach to model reduction which obtains an efficient reduced-dimension dynamical system by projecting the system operators onto state directions which trade off the reachability and observability of state directions as expressed through the associated Gramians. We introduce Gramian definitions relevant to the inference setting and propose a balanced truncation approach based on these inference Gramians that yield a reduced dynamical system that can be used to cheaply approximate the posterior mean and covariance. Our definitions exploit natural connections between (i) the reachability Gramian and the prior covariance and (ii) the observability Gramian and the Fisher information. The resulting reduced model then inherits stability properties and error bounds from system theoretic considerations, and in some settings yields an optimal posterior covariance approximation. Numerical demonstrations on two benchmark problems in model reduction show that our method can yield near-optimal posterior covariance approximations with order-of-magnitude state dimension reduction. △ Less

Submitted 25 November, 2021; originally announced November 2021.

A wavelet-based dynamic mode decomposition for modeling mechanical systems from partial observations

Authors: Manu Krishnan, Serkan Gugercin, Pablo A. Tarazaga

Abstract: Dynamic mode decomposition (DMD) has emerged as a popular data-driven modeling approach to identifying spatio-temporal coherent structures in dynamical systems, owing to its strong relation with the Koopman operator. For dynamical systems with external forcing, the identified model should not only be suitable for a specific forcing function but should generally approximate the input-output behavio… ▽ More Dynamic mode decomposition (DMD) has emerged as a popular data-driven modeling approach to identifying spatio-temporal coherent structures in dynamical systems, owing to its strong relation with the Koopman operator. For dynamical systems with external forcing, the identified model should not only be suitable for a specific forcing function but should generally approximate the input-output behavior of the underlying dynamics. A novel methodology for modeling those classes of dynamical systems is proposed in the present work, using wavelets in conjunction with the input-output dynamic mode decomposition (ioDMD). Our non-intrusive approach constructs numerical models directly from trajectories of the full model's inputs and outputs, without requiring the full-model operators. These trajectories are generated by running a simulation of the full model or observing the original dynamical systems' response to inputs in an experimental framework. Hence, the present methodology is applicable for dynamical systems whose internal state vector measurements are not available. Instead, data from only a few output locations are only accessible, as often the case in practice. The present methodology's applicability is explained by modeling the input-output response of a finite element beam model. The WDMD provides a linear state-space representation of the dynamical system using the response measurements and the corresponding input forcing functions. The developed state-space model is then used to simulate the beam's response towards different types of forcing functions. The method is further validated on an experimental data set using modal analysis on a simple free-free beam, demonstrating the efficacy of the proposed methodology as an appropriate candidate for modeling practical dynamical systems despite having no access to internal state measurements and treating the full model as a black-box. △ Less

Submitted 25 October, 2021; originally announced October 2021.

Structured vector fitting framework for mechanical systems

Authors: Steffen W. R. Werner, Ion Victor Gosea, Serkan Gugercin

Abstract: In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within th… ▽ More In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within the classical vector fitting algorithm leads to the formulation of two new algorithms that allow the computation of modally damped mechanical systems from data in a least squares fashion. Thus, the learned model is guaranteed to have the desired structure. We test the proposed algorithms on two benchmark models. △ Less

Submitted 18 October, 2021; originally announced October 2021.

Comments: 8 pages, 2 figures

Journal ref: IFAC-Pap., 55(20):163-168, 2022

Data-driven modeling of power networks

Authors: Bita Safaee, Serkan Gugercin

Abstract: We develop a non-intrusive data-driven modeling framework for power network dynamics using the Lift and Learn approach of \cite{QianWillcox2020}. A lifting map is applied to the snapshot data obtained from the original nonlinear swing equations describing the underlying power network such that the lifted-data corresponds to quadratic nonlinearity. The lifted data is then projected onto a lower dim… ▽ More We develop a non-intrusive data-driven modeling framework for power network dynamics using the Lift and Learn approach of \cite{QianWillcox2020}. A lifting map is applied to the snapshot data obtained from the original nonlinear swing equations describing the underlying power network such that the lifted-data corresponds to quadratic nonlinearity. The lifted data is then projected onto a lower dimensional basis and the reduced quadratic matrices are fit to this reduced lifted data using a least-squares measure. The effectiveness of the proposed approach is investigated by two power network models. △ Less

Submitted 13 April, 2021; originally announced April 2021.

Parametric model reduction via rational interpolation along parameters

Authors: Ion Victor Gosea, Serkan Gugercin, Benjamin Unger

Abstract: We present a novel projection-based model reduction framework for parametric linear time-invariant systems that allows interpolating the transfer function at a given frequency point along parameter-dependent curves as opposed to the standard approach where transfer function interpolation is achieved for a discrete set of parameter and frequency samples. We accomplish this goal by using parameter-d… ▽ More We present a novel projection-based model reduction framework for parametric linear time-invariant systems that allows interpolating the transfer function at a given frequency point along parameter-dependent curves as opposed to the standard approach where transfer function interpolation is achieved for a discrete set of parameter and frequency samples. We accomplish this goal by using parameter-dependent projection spaces. Our main result shows that for holomorphic system matrices, the corresponding interpolatory projection spaces are also holomorphic. The coefficients of the power series representation of the projection spaces can be computed iteratively using standard methods. We illustrate the analysis on three numerical examples. △ Less

Submitted 30 March, 2021; originally announced April 2021.

Comments: 8 pages, 4 figures

MSC Class: 93C05; 93C35; 32E30

Data-driven balancing of linear dynamical systems

Authors: Ion Victor Gosea, Serkan Gugercin, Christopher Beattie

Abstract: We present a novel reformulation of balanced truncation, a classical model reduction method. The principal innovation that we introduce comes through the use of system response data that has been either measured or computed, without reference to any prescribed realization of the original model. Data are represented by sampled values of the transfer function {or the impulse response} corresponding… ▽ More We present a novel reformulation of balanced truncation, a classical model reduction method. The principal innovation that we introduce comes through the use of system response data that has been either measured or computed, without reference to any prescribed realization of the original model. Data are represented by sampled values of the transfer function {or the impulse response} corresponding to the original model. We discuss parallels that our approach bears with the Loewner framework, another popular data-driven model reduction method. We illustrate our approach numerically in both continuous-time and discrete-time cases. △ Less

Submitted 24 October, 2021; v1 submitted 2 April, 2021; originally announced April 2021.

Comments: 28 pages, 9 figures

MSC Class: 37M99; 41A20; 65D30; 65K99; 93A15; 93B15

Data-driven modeling of linear dynamical systems with quadratic output in the AAA framework

Authors: Ion Victor Gosea, Serkan Gugercin

Abstract: We extend the AAA (Adaptive-Antoulas-Anderson) algorithm to develop a data-driven modeling framework for linear systems with quadratic output (LQO). Such systems are characterized by two transfer functions: one corresponding to the linear part of the output and another one to the quadratic part. We first establish the joint barycentric representations and the interpolation theory for the two trans… ▽ More We extend the AAA (Adaptive-Antoulas-Anderson) algorithm to develop a data-driven modeling framework for linear systems with quadratic output (LQO). Such systems are characterized by two transfer functions: one corresponding to the linear part of the output and another one to the quadratic part. We first establish the joint barycentric representations and the interpolation theory for the two transfer functions of LQO systems. This analysis leads to the proposed AAA-LQO algorithm. We show that by interpolating the transfer function values on a subset of samples together with imposing a least-squares minimization on the rest, we construct reliable data-driven LQO models. Two numerical test cases illustrate the efficiency of the proposed method. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Comments: 16 pages, 9 figures

MSC Class: 41A20; 93D25; 93C10

Structure-preserving Model Reduction of Parametric Power Networks

Authors: Bita Safaee, Serkan Gugercin

Abstract: We develop a structure-preserving parametric model reduction approach for linearized swing equations where parametrization corresponds to variations in operating conditions. We employ a global basis approach to develop the parametric reduced model in which we concatenate the local bases obtained via $\mathcal{H}_2$-based interpolatory model reduction. The residue of the underlying dynamics corresp… ▽ More We develop a structure-preserving parametric model reduction approach for linearized swing equations where parametrization corresponds to variations in operating conditions. We employ a global basis approach to develop the parametric reduced model in which we concatenate the local bases obtained via $\mathcal{H}_2$-based interpolatory model reduction. The residue of the underlying dynamics corresponding to the simple pole at zero varies with the parameters. Therefore, to have bounded $\mathcal{H}_2$ and $\mathcal{H}_\infty$ errors, the reduced model residue for the pole at zero should match the original one over the entire parameter domain. Our framework achieves this goal by enriching the global basis based on a residue analysis. The effectiveness of the proposed method is illustrated through two numerical examples. △ Less

Submitted 9 February, 2021; originally announced February 2021.

Estimating Experimental Dispersion Curves from Steady-State Frequency Response Measurements

Authors: V. V. N. Sriram Malladi, Mohammad I. Albakri, Manu Krishnan, Serkan Gugercin, Pablo A. Tarazaga

Abstract: Dispersion curves characterize the frequency dependence of the phase and the group velocities of propagating elastic waves. Many analytical and numerical techniques produce dispersion curves from physics-based models. However, it is often challenging to accurately model engineering structures with intricate geometric features and inhomogeneous material properties. For such cases, this paper propos… ▽ More Dispersion curves characterize the frequency dependence of the phase and the group velocities of propagating elastic waves. Many analytical and numerical techniques produce dispersion curves from physics-based models. However, it is often challenging to accurately model engineering structures with intricate geometric features and inhomogeneous material properties. For such cases, this paper proposes a novel method to estimate group velocities from experimental data-driven models. Experimental frequency response functions (FRFs) are used to develop data-driven models, {which are then used to estimate dispersion curves}. The advantages of this approach over other traditionally used transient techniques stem from the need to conduct only steady-state experiments. In comparison, transient experiments often need a higher-sampling rate for wave-propagation applications and are more susceptible to noise. The vector-fitting (VF) algorithm is adopted to develop data-driven models from experimental in-plane and out-of-plane FRFs of a one-dimensional structure. The quality of the corresponding data-driven estimates is evaluated using an analytical Timoshenko beam as a baseline. The data-driven model (using the out-of-plane FRFs) estimates the anti-symmetric ($A_0$) group velocity with a maximum error of $4\%$ over a 40~kHz frequency band. In contrast, group velocities estimated from transient experiments resulted in a maximum error of $6\%$ over the same frequency band. △ Less

Submitted 31 December, 2020; originally announced January 2021.

Contour Integral Methods for Nonlinear Eigenvalue Problems: A Systems Theoretic Approach

Authors: Michael C. Brennan, Mark Embree, Serkan Gugercin

Abstract: Contour integral methods for nonlinear eigenvalue problems seek to compute a subset of the spectrum in a bounded region of the complex plane. We briefly survey this class of algorithms, establishing a relationship to system realization techniques in control theory. This connection motivates a new general framework for contour integral methods (for linear and nonlinear eigenvalue problems), buildin… ▽ More Contour integral methods for nonlinear eigenvalue problems seek to compute a subset of the spectrum in a bounded region of the complex plane. We briefly survey this class of algorithms, establishing a relationship to system realization techniques in control theory. This connection motivates a new general framework for contour integral methods (for linear and nonlinear eigenvalue problems), building on recent developments in multi-point rational interpolation of dynamical systems. These new techniques, which replace the usual Hankel matrices with Loewner matrix pencils, incorporate general interpolation schemes and permit ready recovery of eigenvectors. Because the main computations (the solution of linear systems associated with contour integration) are identical for these Loewner methods and the traditional Hankel approach, a variety of new eigenvalue approximations can be explored with modest additional work. Numerical examples illustrate the potential of this approach. We also discuss how the concept of filter functions can be employed in this new framework, and show how contour methods enable a data-driven modal truncation method for model reduction. △ Less

Submitted 29 December, 2020; originally announced December 2020.

MSC Class: 15A18; 65F15; 93B20; 93B30 15A18; 65F15; 93B20; 93B30 15A18; 65F15; 93B20; 93B30

On the balanced truncation error bound and sign parameters from arrowhead realizations

Authors: Sean Reiter, Tobias Damm, Mark Embree, Serkan Gugercin

Abstract: Balanced truncation and singular perturbation approximation for linear dynamical systems yield reduced-order models that satisfy a well-known error bound involving the Hankel singular values. We show that this bound holds with equality for single-input, single-output systems, if the sign parameters corresponding to the truncated Hankel singular values are all equal. These signs are determined by a… ▽ More Balanced truncation and singular perturbation approximation for linear dynamical systems yield reduced-order models that satisfy a well-known error bound involving the Hankel singular values. We show that this bound holds with equality for single-input, single-output systems, if the sign parameters corresponding to the truncated Hankel singular values are all equal. These signs are determined by a generalized state-space symmetry property of the corresponding linear model. For a special class of systems having arrowhead realizations, the signs can be determined directly from the off-diagonal entries of the corresponding arrowhead matrix. We describe how such arrowhead systems arise naturally in certain applications of network modeling, and illustrate these results with a power system model that motivated this study. △ Less

Submitted 17 January, 2024; v1 submitted 13 November, 2020; originally announced November 2020.

Comments: 21 pages. To be published in Advances in Computational Mathematics, Topical Collection: MORe 2022

MSC Class: 93B10; 93B11; 93C05

Structure-Preserving Interpolation for Model Reduction of Parametric Bilinear Systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure… ▽ More In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure and parameter dependencies are preserved in the reduced-order model. Two benchmark examples with different parameter dependencies are used to demonstrate the theoretical analysis. △ Less

Submitted 22 July, 2020; originally announced July 2020.

Comments: 10 pages, 2 figures

Journal ref: Automatica J. IFAC, 132:109799, 2021

Randomization for the Efficient Computation of Parametric Reduced Order Models for Inversion

Authors: Selin Aslan, Eric de Sturler, Serkan Gugercin

Abstract: Nonlinear parametric inverse problems appear in many applications. Here, we focus on diffuse optical tomography (DOT) in medical imaging to recover unknown images of interest, such as cancerous tissue in a given medium, using a mathematical (forward) model. The forward model in DOT is a diffusion-absorption model for the photon flux. The main bottleneck in these problems is the repeated evaluation… ▽ More Nonlinear parametric inverse problems appear in many applications. Here, we focus on diffuse optical tomography (DOT) in medical imaging to recover unknown images of interest, such as cancerous tissue in a given medium, using a mathematical (forward) model. The forward model in DOT is a diffusion-absorption model for the photon flux. The main bottleneck in these problems is the repeated evaluation of the large-scale forward model. For DOT, this corresponds to solving large linear systems for each source and frequency at each optimization step. Moreover, Newton-type methods, often the method of choice, require additional linear solves with the adjoint to compute derivative information. Emerging technology allows for large numbers of sources and detectors, making these problems prohibitively expensive. Reduced order models (ROM) have been used to drastically reduce the system size in each optimization step, while solving the inverse problem accurately. However, for large numbers of sources and detectors, just the construction of the candidate basis for the ROM projection space incurs a substantial cost, as matching the full parameter gradient matrix in interpolatory model reduction requires large linear solves for all sources and frequencies and all detectors and frequencies for each parameter interpolation point. As this candidate basis numerically has low rank, this construction is followed by a rank-revealing factorization that typically reduces the number of vectors in the candidate basis substantially. We propose to use randomization to approximate this basis with a drastically reduced number of large linear solves. We also provide a detailed analysis for the low-rank structure of the candidate basis for our problem of interest. Even though we focus on the DOT problem, the ideas presented are relevant to many other large scale inverse problems and optimization problems. △ Less

Submitted 12 July, 2020; originally announced July 2020.

Comments: 18 pages, 5 figures

MSC Class: 65F22; 65N22; 93A15; 93C05

The AAA framework for modeling linear dynamical systems with quadratic output

Authors: Ion Victor Gosea, Serkan Gugercin

Abstract: We consider linear dynamical systems with quadratic output. We first define the two transfer functions, a single-variable and a multivariate one, that fully describe the dynamics of these special nonlinear systems. Then, using the samples of these two transfer functions, we extend the AAA algorithm to model linear systems with quadratic output from data. We consider linear dynamical systems with quadratic output. We first define the two transfer functions, a single-variable and a multivariate one, that fully describe the dynamics of these special nonlinear systems. Then, using the samples of these two transfer functions, we extend the AAA algorithm to model linear systems with quadratic output from data. △ Less

Submitted 20 May, 2020; originally announced May 2020.

Structure-Preserving Interpolation of Bilinear Control Systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input sin… ▽ More In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input single-output structured bilinear systems. Then, we extend these results to the case of multi-input multi-output structured bilinear systems by matrix interpolation. The effectiveness of our structure-preserving approach is illustrated by means of various numerical examples. △ Less

Submitted 2 May, 2020; originally announced May 2020.

Comments: 26 pages, 9 figures

Journal ref: Adv. Comput. Math., 47(3):43, 2021

The p-AAA algorithm for data driven modeling of parametric dynamical systems

Authors: Andrea Carracedo Rodriguez, Linus Balicki, Serkan Gugercin

Abstract: The AAA algorithm has become a popular tool for data-driven rational approximation of single variable functions, such as transfer functions of a linear dynamical system. In the setting of parametric dynamical systems appearing in many prominent applications, the underlying (transfer) function to be modeled is a multivariate function. With this in mind, we develop the AAA framework for approximatin… ▽ More The AAA algorithm has become a popular tool for data-driven rational approximation of single variable functions, such as transfer functions of a linear dynamical system. In the setting of parametric dynamical systems appearing in many prominent applications, the underlying (transfer) function to be modeled is a multivariate function. With this in mind, we develop the AAA framework for approximating multivariate functions where the approximant is constructed in the multivariate barycentric form. The method is data-driven, in the sense that it does not require access to full state-space model and requires only function evaluations. We discuss an extension to the case of matrix-valued functions, i.e., multi-input/multi-output dynamical systems, and provide a connection to the tangential interpolation theory. Several numerical examples illustrate the effectiveness of the proposed approach. △ Less

Submitted 10 July, 2022; v1 submitted 13 March, 2020; originally announced March 2020.

Estimating Dispersion Curves from Frequency Response Functions via Vector-Fitting

Authors: Mohammad I. Albakri, Vijaya V. N. Sriram Malladi, Serkan Gugercin, Pablo A. Tarazaga

Abstract: Driven by the need for describing and understanding wave propagation in structural materials and components, several analytical, numerical, and experimental techniques have been developed to obtain dispersion curves. Accurate characterization of the structure (waveguide) under test is needed for analytical and numerical approaches. Experimental approaches, on the other hand, rely on analyzing wave… ▽ More Driven by the need for describing and understanding wave propagation in structural materials and components, several analytical, numerical, and experimental techniques have been developed to obtain dispersion curves. Accurate characterization of the structure (waveguide) under test is needed for analytical and numerical approaches. Experimental approaches, on the other hand, rely on analyzing waveforms as they propagate along the structure. Material inhomogeneity, reflections from boundaries, and the physical dimensions of the structure under test limit the frequency range over which dispersion curves can be measured. In this work, a new data-driven modeling approach for estimating dispersion curves is developed. This approach utilizes the relatively easy-to-measure, steady-state Frequency Response Functions (FRFs) to develop a state-space dynamical model of the structure under test. The developed model is then used to study the transient response of the structure and estimate its dispersion curves. This paper lays down the foundation of this approach and demonstrates its capabilities on a one-dimensional homogeneous beam using numerically calculated FRFs. Both in-plane and out-of-plane FRFs corresponding, respectively, to longitudinal (the first symmetric) and flexural (the first anti-symmetric) wave modes are analyzed. The effects of boundary conditions on the performance of this approach are also addressed. △ Less

Submitted 27 December, 2019; originally announced December 2019.

Comments: Accepted to appear in Mechanical Systems and Signal Processing, in press

Sampling-free parametric model reduction for structured systems

Authors: Christopher Beattie, Serkan Gugercin, Zoran Tomljanovic

Abstract: We consider the reduction of parametric families of linear dynamical systems having an affine parameter dependence that differ from one another by a low-rank variation in the state matrix. Usual approaches for parametric model reduction typically involve exploring the parameter space to isolate representative models on which to focus model reduction methodology, which are then combined in various… ▽ More We consider the reduction of parametric families of linear dynamical systems having an affine parameter dependence that differ from one another by a low-rank variation in the state matrix. Usual approaches for parametric model reduction typically involve exploring the parameter space to isolate representative models on which to focus model reduction methodology, which are then combined in various ways in order to interpolate the response from these representative models. The initial exploration of the parameter space can be a forbiddingly expensive task. A different approach is proposed here that does not require any parameter sampling or exploration of the parameter space. Instead, we represent the system response in terms of four subsystems that are nonparametric. One may apply any one of a number of standard (nonparametric) model reduction strategies to reduce the subsystems independently, and then conjoin these reduced models with the underlying parameterized representation to obtain an overall parameterized response. Our approach has elements in common with the parameter map** approach of Baur et al. [8], but offers greater flexibility and potentially greater control over accuracy. In particular, a data-driven variation of our approach is described that exercises this flexibility through the use of limited frequency-sampling of the underlying nonparametric models. The parametric structure of our system representation allows for a priori guarantees of system stability the resulting parametric reduced models, uniformly across all parameter values. Incorporation of system theoretic error bounds allow us to determine appropriate approximation orders for the nonparametric systems sufficient to yield uniformly high accuracy with respect to parameter variation. △ Less

Submitted 24 December, 2019; originally announced December 2019.

Revisiting IRKA: Connections with pole placement and backward stability

Authors: C. Beattie, Z. Drmac, S. Gugercin

Abstract: The iterative rational Krylov algorithm (\textsf{IRKA}) is a popular approach for producing locally optimal reduced-order $\mathcal{H}_2$-approximations to linear time-invariant (LTI) dynamical systems. Overall, \textsf{IRKA} has seen significant practical success in computing high fidelity (locally) optimal reduced models and has been successfully applied in a variety of large-scale settings. Mor… ▽ More The iterative rational Krylov algorithm (\textsf{IRKA}) is a popular approach for producing locally optimal reduced-order $\mathcal{H}_2$-approximations to linear time-invariant (LTI) dynamical systems. Overall, \textsf{IRKA} has seen significant practical success in computing high fidelity (locally) optimal reduced models and has been successfully applied in a variety of large-scale settings. Moreover, \textsf{IRKA} has provided a foundation for recent extensions to the systematic model reduction of bilinear and nonlinear dynamical systems. Convergence of the basic \textsf{IRKA} iteration is generally observed to be rapid --- but not always; and despite the simplicity of the iteration, its convergence behavior is remarkably complex and not well understood aside from a few special cases. The overall effectiveness and computational robustness of the basic \textsf{IRKA} iteration is surprising since its algorithmic goals are very similar to a pole assignment problem, which can be notoriously ill-conditioned. We investigate this connection here and discuss a variety of nice properties of the \textsf{IRKA} iteration that are revealed when the iteration is framed with respect to a primitive basis. We find that the connection with pole assignment suggests refinements to the basic algorithm that can improve convergence behavior, leading also to new choices for termination criteria that assure backward stability. △ Less

Submitted 13 November, 2019; originally announced November 2019.

Structure-preserving Interpolatory Model Reduction for Port-Hamiltonian Differential-Algebraic Systems

Authors: Chris A. Beattie, Serkan Gugercin, Volker Mehrmann

Abstract: We examine interpolatory model reduction methods that are well-suited for treating large scale port-Hamiltonian differential-algebraic systems in a way that is able to preserve and indeed, take advantage of the underlying structural features of the system. We introduce approaches that incorporate regularization together with prudent selection of interpolation data. We focus on linear time-invarian… ▽ More We examine interpolatory model reduction methods that are well-suited for treating large scale port-Hamiltonian differential-algebraic systems in a way that is able to preserve and indeed, take advantage of the underlying structural features of the system. We introduce approaches that incorporate regularization together with prudent selection of interpolation data. We focus on linear time-invariant systems and present a systematic treatment of a variety of model classes that include combinations of index-$1$ and index-$2$ systems, describing in particular how constraints may be represented in the transfer function and then preserved with interpolatory methods. We propose an algorithm to generate effective interpolation data and illustrate its effectiveness via two numerical examples. △ Less

Submitted 1 November, 2021; v1 submitted 12 October, 2019; originally announced October 2019.

$\mathcal{H}_2$-gap model reduction for stabilizable and detectable systems

Authors: Tobias Breiten, Chris A. Beattie, Serkan Gugercin

Abstract: We formulate here an approach to model reduction that is well-suited for linear time-invariant control systems that are stabilizable and detectable but may otherwise be unstable. We introduce a modified $\mathcal{H}_2$-error metric, the $\mathcal{H}_2$-gap, that provides an effective measure of model fidelity in this setting. While the direct evaluation of the $\mathcal{H}_2$-gap requires the solu… ▽ More We formulate here an approach to model reduction that is well-suited for linear time-invariant control systems that are stabilizable and detectable but may otherwise be unstable. We introduce a modified $\mathcal{H}_2$-error metric, the $\mathcal{H}_2$-gap, that provides an effective measure of model fidelity in this setting. While the direct evaluation of the $\mathcal{H}_2$-gap requires the solutions of a pair of algebraic Riccati equations associated with related closed-loop systems, we are able to work entirely within an interpolatory framework, develo** algorithms and supporting analysis that do not reference full-order closed-loop Gramians. This leads to a computationally effective strategy yielding reduced models designed so that the corresponding reduced closed-loop systems will interpolate the full-order closed-loop system at specially adapted interpolation points, without requiring evaluation of the full-order closed-loop system nor even computation of the feedback law that determines it. The analytical framework and computational algorithm presented here provides an effective new approach toward constructing reduced-order models for unstable systems. Numerical examples for an unstable convection diffusion equation and a linearized incompressible Navier-Stokes equation illustrate the effectiveness of this approach. △ Less

Submitted 30 September, 2019; originally announced September 2019.

Stability of discrete empirical interpolation and gappy proper orthogonal decomposition with randomized and deterministic sampling points

Authors: Benjamin Peherstorfer, Zlatko Drmač, Serkan Gugercin

Abstract: This work investigates the stability of (discrete) empirical interpolation for nonlinear model reduction and state field approximation from measurements. Empirical interpolation derives approximations from a few samples (measurements) via interpolation in low-dimensional spaces. It has been observed that empirical interpolation can become unstable if the samples are perturbed due to, e.g., noise,… ▽ More This work investigates the stability of (discrete) empirical interpolation for nonlinear model reduction and state field approximation from measurements. Empirical interpolation derives approximations from a few samples (measurements) via interpolation in low-dimensional spaces. It has been observed that empirical interpolation can become unstable if the samples are perturbed due to, e.g., noise, turbulence, and numerical inaccuracies. The main contribution of this work is a probabilistic analysis that shows that stable approximations are obtained if samples are randomized and if more samples than dimensions of the low-dimensional spaces are used. Oversampling, i.e., taking more sampling points than dimensions of the low-dimensional spaces, leads to approximations via regression and is known under the name of gappy proper orthogonal decomposition. Building on the insights of the probabilistic analysis, a deterministic sampling strategy is presented that aims to achieve lower approximation errors with fewer points than randomized sampling by taking information about the low-dimensional spaces into account. Numerical results of reconstructing velocity fields from noisy measurements of combustion processes and model reduction in the presence of noise demonstrate the instability of empirical interpolation and the stability of gappy proper orthogonal decomposition with oversampling. △ Less

Submitted 19 May, 2020; v1 submitted 30 August, 2018; originally announced August 2018.

Empirical least-squares fitting of parametrized dynamical systems

Authors: Alexander Grimm, Christopher Beattie, Zlatko Drmač, Serkan Gugercin

Abstract: Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to internal system dynamics or equivalently, to realizations of the original system is either not possible or not practical; only response observations over a range of p… ▽ More Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to internal system dynamics or equivalently, to realizations of the original system is either not possible or not practical; only response observations over a range of parameter settings might be known. Respecting these typical operational constraints, we propose a two phase approach that first encodes the response data into a high fidelity intermediate model of modest order, followed then by a compression stage that serves to eliminate redundancy in the intermediate model. For the first phase, we extend non-parametric least-squares fitting approaches so as to accommodate parameterized systems. This results in a (discrete) least-squares problem formulated with respect to both frequency and parameter that identifies "local" system response features. The second phase uses an $\mathbf{\mathcal{H}}_2$-optimal model reduction strategy accommodating the specialized parametric structure of the intermediate model obtained in the first phase. The final compressed model inherits the parametric dependence of the intermediate model and maintains the high fidelity of the intermediate model, while generally having dramatically smaller system order. We provide a variety of numerical examples demonstrating our approach. △ Less

Submitted 16 August, 2018; originally announced August 2018.

$\mathcal{H}_2(t_f)$ Optimality Conditions for a Finite-time Horizon

Authors: Klajdi Sinani, Serkan Gugercin

Abstract: In this paper we establish the interpolatory model reduction framework for optimal approximation of MIMO dynamical systems with respect to the $\mathcal{H}_2$ norm over a finite-time horizon, denoted as the $\mathcal{H}_2(t_f)$ norm. Using the underlying inner product space, we derive the interpolatory first-order necessary optimality conditions for approximation in the $\mathcal{H}_2(t_f)$ norm.… ▽ More In this paper we establish the interpolatory model reduction framework for optimal approximation of MIMO dynamical systems with respect to the $\mathcal{H}_2$ norm over a finite-time horizon, denoted as the $\mathcal{H}_2(t_f)$ norm. Using the underlying inner product space, we derive the interpolatory first-order necessary optimality conditions for approximation in the $\mathcal{H}_2(t_f)$ norm. Then, we develop an algorithm, which yields a locally optimal reduced model that satisfies the established interpolation-based optimality conditions. We test the algorithm on various numerical examples to illustrate its performance. △ Less

Submitted 20 May, 2019; v1 submitted 28 June, 2018; originally announced June 2018.

Comments: 11 pages, 4 figures, 2 .tex file, 1 .bbl file

Kolmogorov $n$-widths for linear dynamical systems

Authors: Benjamin Unger, Serkan Gugercin

Abstract: Kolmogorov $n$-widths and Hankel singular values are two commonly used concepts in model reduction. Here we show that for the special case of linear time-invariant dynamical (LTI) systems, these two concepts are directly connected. More specifically, the greedy search applied to the Hankel operator of an LTI system resembles the minimizing subspace for the Kolmogorov n-width and the Kolmogorov… ▽ More Kolmogorov $n$-widths and Hankel singular values are two commonly used concepts in model reduction. Here we show that for the special case of linear time-invariant dynamical (LTI) systems, these two concepts are directly connected. More specifically, the greedy search applied to the Hankel operator of an LTI system resembles the minimizing subspace for the Kolmogorov n-width and the Kolmogorov $n$-width of an LTI system equals its $(n+1)st$ Hankel singular value once the subspaces are appropriately defined. We also establish a lower bound for the Kolmorogov $n$-width for parametric LTI systems and illustrate that the method of active subspaces can be viewed as the dual concept to the minimizing subspace for the Kolmogorov $n$-width. △ Less

Submitted 26 June, 2018; originally announced June 2018.

Comments: S. Adv Comput Math (2019)

MSC Class: 37M99; 47B35; 65P99; 34A45; 35A35; 93C05

Interpolatory Model Reduction of Parameterized Bilinear Dynamical Systems

Authors: Andrea Carracedo Rodriguez, Serkan Gugercin, Jeff Borggaard

Abstract: Interpolatory projection methods for model reduction of nonparametric linear dynamical systems have been successfully extended to nonparametric bilinear dynamical systems. However, this is not the case for parametric bilinear systems. In this work, we aim to close this gap by providing a natural extension of interpolatory projections to model reduction of parametric bilinear dynamical systems. We… ▽ More Interpolatory projection methods for model reduction of nonparametric linear dynamical systems have been successfully extended to nonparametric bilinear dynamical systems. However, this is not the case for parametric bilinear systems. In this work, we aim to close this gap by providing a natural extension of interpolatory projections to model reduction of parametric bilinear dynamical systems. We introduce necessary conditions that the projection subspaces must satisfy to obtain parametric tangential interpolation of each subsystem transfer function. These conditions also guarantee that the parameter sensitivities (Jacobian) of each subsystem transfer function is matched tangentially by those of the corresponding reduced order model transfer function. Similarly, we obtain conditions for interpolating the parameter Hessian of the transfer function by including extra vectors in the projection subspaces. As in the parametric linear case, the basis construction for two-sided projections does not require computing the Jacobian or the Hessian. △ Less

Submitted 19 December, 2017; originally announced December 2017.

Dam** optimization of parameter dependent mechanical systems by rational interpolation

Authors: Zoran Tomljanović, Christopher Beattie, Serkan Gugercin

Abstract: We consider an optimization problem related to semi-active dam** of vibrating systems. The main problem is to determine the best dam** matrix able to minimize influence of the input on the output of the system. We use a minimization criteria based on the $\mathcal{H}_2$ system norm. The objective function is non-convex and the associated optimization problem typically requires a large number… ▽ More We consider an optimization problem related to semi-active dam** of vibrating systems. The main problem is to determine the best dam** matrix able to minimize influence of the input on the output of the system. We use a minimization criteria based on the $\mathcal{H}_2$ system norm. The objective function is non-convex and the associated optimization problem typically requires a large number of objective function evaluations. We propose an optimization approach that calculates `interpolatory' reduced order models, allowing for significant acceleration of the optimization process. In our approach, we use parametric model reduction (PMOR) based on the Iterative Rational Krylov Algorithm, which ensures good approximations relative to the $\mathcal{H}_2$ system norm, aligning well with the underlying dam** design objectives. For the parameter sampling that occurs within each PMOR cycle, we consider approaches with predetermined sampling and approaches using adaptive sampling, and each of these approaches may be combined with three possible strategies for internal reduction. In order to preserve important system properties, we maintain second-order structure, which through the use of modal coordinates, allows for very efficient implementation. The methodology proposed here provides a significant acceleration of the optimization process; the gain in efficiency is illustrated in numerical experiments. △ Less

Submitted 6 July, 2017; originally announced July 2017.

MSC Class: 49J15; 74P10; 70Q05; 41A05

Linear time-periodic dynamical systems: An H2 analysis and a model reduction framework

Authors: Caleb C. Magruder, Serkan Gugercin, Christopher A. Beattie

Abstract: Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction. We develop… ▽ More Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear models. Such LTP systems can reach orders that make repeated simulation or other necessary analysis prohibitive, motivating the need for model reduction. We develop here an algorithmic framework for constructing reduced models that retains the linear time-periodic structure of the original LTP system. Our approach generalizes optimal approaches that have been established previously for linear time-invariant (LTI) model reduction problems. We employ an extension of the usual H2 Hardy space defined for the LTI setting to time-periodic systems and within this broader framework develop an a posteriori error bound expressible in terms of related LTI systems. Optimization of this bound motivates our algorithm. We illustrate the success of our method on two numerical examples. △ Less

Submitted 10 June, 2017; originally announced June 2017.

Comments: Submitted to Mathematical and Computer Modeling of Dynamical Systems

Data-driven Structured Realization

Authors: Philipp Schulze, Benjamin Unger, Christopher Beattie, Serkan Gugercin

Abstract: We present a framework for constructing structured realizations of linear dynamical systems having transfer functions of the form $C(\sum_{k=1}^K h_k(s)A_k)^{-1}B$ where $h_1,h_2,\ldots,h_K$ are prescribed functions that specify the surmised structure of the model. Our construction is data-driven in the sense that an interpolant is derived entirely from measurements of a transfer function. Our app… ▽ More We present a framework for constructing structured realizations of linear dynamical systems having transfer functions of the form $C(\sum_{k=1}^K h_k(s)A_k)^{-1}B$ where $h_1,h_2,\ldots,h_K$ are prescribed functions that specify the surmised structure of the model. Our construction is data-driven in the sense that an interpolant is derived entirely from measurements of a transfer function. Our approach extends the Loewner realization framework to more general system structure that includes second-order (and higher) systems as well as systems with internal delays. Numerical examples demonstrate the advantages of this approach. △ Less

Submitted 7 November, 2016; originally announced November 2016.

Report number: Preprint 31-2016 MSC Class: 93B15; 30E05; 93C05

Journal ref: Linear Algebra and its Applications, Volume 537, 15 January 2018, Pages 250-286

$\mathcal H_2$-Quasi-Optimal Model Order Reduction for Quadratic-Bilinear Control Systems

Authors: Peter Benner, Pawan Goyal, Serkan Gugercin

Abstract: We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next… ▽ More We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next, we derive first-order necessary conditions for an optimal approximation, where optimality is measured in term of the truncated $\mathcal H_2$-norm of the error system. We then propose an iterative model reduction algorithm, which upon convergence yields a reduced-order system that approximately satisfies the newly derived optimality conditions. We also discuss an efficient computation of the reduced Hessian, using the special Kronecker structure of the Hessian of the system. We illustrate the efficiency of the proposed method by means of several numerical examples resulting from semi-discretized nonlinear partial differential equations and show its competitiveness with the existing model reduction schemes for QB systems such as moment-matching methods and balanced truncation. △ Less

Submitted 16 May, 2017; v1 submitted 11 October, 2016; originally announced October 2016.

Model Reduction for Systems with Inhomogeneous Initial Conditions

Authors: Christopher A. Beattie, Serkan Gugercin, Volker Mehrmann

Abstract: We consider the model reduction problem for linear time-invariant dynamical systems having nonzero (but otherwise indeterminate) initial conditions. Building upon the observation that the full system response is decomposable as a superposition of the response map for an unforced system having nontrivial initial conditions and the response map for a forced system having null initial conditions, we… ▽ More We consider the model reduction problem for linear time-invariant dynamical systems having nonzero (but otherwise indeterminate) initial conditions. Building upon the observation that the full system response is decomposable as a superposition of the response map for an unforced system having nontrivial initial conditions and the response map for a forced system having null initial conditions, we develop a new approach that involves reducing these component responses independently and then combining the reduced responses into an aggregate reduced system response. This approach allows greater flexibility and offers better approximation properties than other comparable methods. △ Less

Submitted 2 January, 2017; v1 submitted 11 October, 2016; originally announced October 2016.

Comments: Preprint 15-2016, Preprint-Reihe des Instituts fur Mathematik, Technische Universitat Berlin

Interpolatory methods for $\mathcal{H}_\infty$ model reduction of multi-input/multi-output systems

Authors: Alessandro Castagnotto, Christopher Beattie, Serkan Gugercin

Abstract: We develop here a computationally effective approach for producing high-quality $\mathcal{H}_\infty$-approximations to large scale linear dynamical systems having multiple inputs and multiple outputs (MIMO). We extend an approach for $\mathcal{H}_\infty$ model reduction introduced by Flagg, Beattie, and Gugercin for the single-input/single-output (SISO) setting, which combined ideas originating in… ▽ More We develop here a computationally effective approach for producing high-quality $\mathcal{H}_\infty$-approximations to large scale linear dynamical systems having multiple inputs and multiple outputs (MIMO). We extend an approach for $\mathcal{H}_\infty$ model reduction introduced by Flagg, Beattie, and Gugercin for the single-input/single-output (SISO) setting, which combined ideas originating in interpolatory $\mathcal{H}_2$-optimal model reduction with complex Chebyshev approximation. Retaining this framework, our approach to the MIMO problem has its principal computational cost dominated by (sparse) linear solves, and so it can remain an effective strategy in many large-scale settings. We are able to avoid computationally demanding $\mathcal{H}_\infty$ norm calculations that are normally required to monitor progress within each optimization cycle through the use of "data-driven" rational approximations that are built upon previously computed function samples. Numerical examples are included that illustrate our approach. We produce high fidelity reduced models having consistently better $\mathcal{H}_\infty$ performance than models produced via balanced truncation; these models often are as good as (and occasionally better than) models produced using optimal Hankel norm approximation as well. In all cases considered, the method described here produces reduced models at far lower cost than is possible with either balanced truncation or optimal Hankel norm approximation. △ Less

Submitted 4 October, 2016; originally announced October 2016.

Computing Reduced Order Models via Inner-Outer Krylov Recycling in Diffuse Optical Tomography

Authors: Meghan O'Connell, Misha E. Kilmer, Eric de Sturler, Serkan Gugercin

Abstract: In nonlinear imaging problems whose forward model is described by a partial differential equation (PDE), the main computational bottleneck in solving the inverse problem is the need to solve many large-scale discretized PDEs at each step of the optimization process. In the context of absorption imaging in diffuse optical tomography, one approach to addressing this bottleneck proposed recently (de… ▽ More In nonlinear imaging problems whose forward model is described by a partial differential equation (PDE), the main computational bottleneck in solving the inverse problem is the need to solve many large-scale discretized PDEs at each step of the optimization process. In the context of absorption imaging in diffuse optical tomography, one approach to addressing this bottleneck proposed recently (de Sturler, et al, 2015) reformulates the viewing of the forward problem as a differential algebraic system, and then employs model order reduction (MOR). However, the construction of the reduced model requires the solution of several full order problems (i.e. the full discretized PDE for multiple right-hand sides) to generate a candidate global basis. This step is then followed by a rank-revealing factorization of the matrix containing the candidate basis in order to compress the basis to a size suitable for constructing the reduced transfer function. The present paper addresses the costs associated with the global basis approximation in two ways. First, we use the structure of the matrix to rewrite the full order transfer function, and corresponding derivatives, such that the full order systems to be solved are symmetric (positive definite in the zero frequency case). Then we apply MOR to the new formulation of the problem. Second, we give an approach to computing the global basis approximation dynamically as the full order systems are solved. In this phase, only the incrementally new, relevant information is added to the existing global basis, and redundant information is not computed. This new approach is achieved by an inner-outer Krylov recycling approach which has potential use in other applications as well. We show the value of the new approach to approximate global basis computation on two DOT absorption image reconstruction problems. △ Less

Submitted 6 March, 2016; v1 submitted 30 January, 2016; originally announced February 2016.

MSC Class: 65F10; 65F22

Preconditioning Parametrized Linear Systems

Authors: Arielle Grim-McNally, Eric de Sturler, Serkan Gugercin

Abstract: Preconditioners are generally essential for fast convergence in the iterative solution of linear systems of equations. However, the computation of a good preconditioner can be expensive. So, while solving a sequence of many linear systems, it is advantageous to recycle preconditioners, that is, update a previous preconditioner and reuse the updated version. In this paper, we introduce a simple and… ▽ More Preconditioners are generally essential for fast convergence in the iterative solution of linear systems of equations. However, the computation of a good preconditioner can be expensive. So, while solving a sequence of many linear systems, it is advantageous to recycle preconditioners, that is, update a previous preconditioner and reuse the updated version. In this paper, we introduce a simple and effective method for doing this. Although our approach can be used for matrices changing slowly in any way, we focus on the important case of sequences of the type $(s_k\textbf{E}(\textbf{p}) + \textbf{A}(\textbf{p}))\textbf{x}_k = \textbf{b}_k$, where the right hand side may or may not change. More general changes in matrices will be discussed in a future paper. We update preconditioners by defining a map from a new matrix to a previous matrix, for example the first matrix in the sequence, and combine the preconditioner for this previous matrix with the map to define the new preconditioner. This approach has several advantages. The update is entirely independent from the original preconditioner, so it can be applied to any preconditioner. The possibly high cost of an initial preconditioner can be amortized over many linear solves. The cost of updating the preconditioner is more or less constant and independent of the original preconditioner. There is flexibility in balancing the quality of the map with the computational cost. In the numerical experiments section we demonstrate good results for several applications, in particular when using an algebraic multigrid preconditioner. △ Less

Submitted 17 December, 2020; v1 submitted 22 January, 2016; originally announced January 2016.

Comments: V2 Model Reduction. V3 analysis of sparsity patterns, Topopt added. Flow replace rail. Only early THT shifts. ILUTP, SAM implementations more efficient. ILUTP m-file included. V4 New pattern added to top opt sparsity pattern analysis/results. ILUTP m-file minor updates V5 Add AMG, remove THT V6 NO CHANGE TO PDF added ilutp anc file

Structure-preserving Model Reduction for Nonlinear Port-Hamiltonian Systems

Authors: Saifon Chaturantabut, Chris Beattie, Serkan Gugercin

Abstract: This paper presents a structure-preserving model reduction approach applicable to large-scale, nonlinear port-Hamiltonian systems. Structure preservation in the reduction step ensures the retention of port-Hamiltonian structure which, in turn, assures the stability and passivity of the reduced model. Our analysis provides a priori error bounds for both state variables and outputs. Three techniques… ▽ More This paper presents a structure-preserving model reduction approach applicable to large-scale, nonlinear port-Hamiltonian systems. Structure preservation in the reduction step ensures the retention of port-Hamiltonian structure which, in turn, assures the stability and passivity of the reduced model. Our analysis provides a priori error bounds for both state variables and outputs. Three techniques are considered for constructing bases needed for the reduction: one that utilizes proper orthogonal decompositions; one that utilizes $\mathcal{H}_2/\mathcal{H}_{\infty}$-derived optimized bases; and one that is a mixture of the two. The complexity of evaluating the reduced nonlinear term is managed efficiently using a modification of the discrete empirical interpolation method (DEIM) that also preserves port-Hamiltonian structure. The efficiency and accuracy of this model reduction framework are illustrated with two examples: a nonlinear ladder network and a tethered Toda lattice. △ Less

Submitted 4 January, 2016; originally announced January 2016.

MSC Class: 37M05; 65P10; 93A15