-
The Loewner framework for parametric systems: Taming the curse of dimensionality
Authors:
Athanasios C. Antoulas,
Ion Victor Gosea,
Charles Poussot-Vassal
Abstract:
The Loewner framework is an interpolatory approach designed for approximating linear and nonlinear systems. The goal here is to extend this framework to linear parametric systems with an arbitrary number n of parameters. One main innovation established here is the construction of data-based realizations for any number of parameters. Equally importantly, we show how to alleviate the computational b…
▽ More
The Loewner framework is an interpolatory approach designed for approximating linear and nonlinear systems. The goal here is to extend this framework to linear parametric systems with an arbitrary number n of parameters. One main innovation established here is the construction of data-based realizations for any number of parameters. Equally importantly, we show how to alleviate the computational burden, by avoiding the explicit construction of large-scale n-dimensional Loewner matrices of size $N \times N$. This reduces the complexity from $O(N^3)$ to about $O(N^{1.4})$, thus taming the curse of dimensionality and making the solution scalable to very large data sets. To achieve this, a new generalized multivariate rational function realization is defined. Then, we introduce the n-dimensional multivariate Loewner matrices and show that they can be computed by solving a coupled set of Sylvester equations. The null space of these Loewner matrices then allows the construction of the multivariate barycentric transfer function. The principal result of this work is to show how the null space of the n-dimensional Loewner matrix can be computed using a sequence of 1-dimensional Loewner matrices, leading to a drastic computational burden reduction. Finally, we suggest two algorithms (one direct and one iterative) to construct, directly from data, multivariate (or parametric) realizations ensuring (approximate) interpolation. Numerical examples highlight the effectiveness and scalability of the method.
△ Less
Submitted 20 June, 2024; v1 submitted 1 May, 2024;
originally announced May 2024.
-
Data-driven quadratic modeling in the Loewner framework from input-output time-domain measurements
Authors:
D. S. Karachalios,
I. V. Gosea,
L. Gkimisis,
A. C. Antoulas
Abstract:
In this study, we present a purely data-driven method that uses the Loewner framework (LF) along with nonlinear optimization techniques to infer quadratic with affine control dynamical systems that admit Volterra series (VS) representations from input-output (i/o) time-domain measurements. The proposed method extensively employs optimization tools for interpolating the symmetric generalized freque…
▽ More
In this study, we present a purely data-driven method that uses the Loewner framework (LF) along with nonlinear optimization techniques to infer quadratic with affine control dynamical systems that admit Volterra series (VS) representations from input-output (i/o) time-domain measurements. The proposed method extensively employs optimization tools for interpolating the symmetric generalized frequency response functions (GFRFs) derived in the VS framework. The GFRF estimations are obtained from the Fourier spectrum (phase and amplitude) of the quasi-steady state system response under harmonic excitation. Appropriate treatment of these measurements under the developed framework allows the identification of low-order quadratic state-space models with non-trivial stable equilibria, such as in the Lorenz '63 forced system. We thus can achieve low-order global model identification for systems that can bifurcate to multiple equilibria after solely collecting measurements from a local stable operational regime. The developed framework is tested for several examples of increasing dimension and complexity, up to a test case of the viscous Burgers' equation with Robin boundary conditions. In the latter case, this study enforces new directions of employing data-driven reduced model inference that successfully can provide low-order accurate surrogate predictive models suitable for control. Future directions and open challenges conclude this work.
△ Less
Submitted 15 April, 2024; v1 submitted 19 November, 2022;
originally announced November 2022.
-
Bilinear realization from input-output data with neural networks
Authors:
Dimitrios S. Karachalios,
Ion Victor Gosea,
Kirandeep Kour,
Athanasios C. Antoulas
Abstract:
We present a method that connects a well-established nonlinear (bilinear) identification method from time-domain data with neural network (NNs) advantages. The main challenge for fitting bilinear systems is the accurate recovery of the corresponding Markov parameters from the input and output measurements. Afterward, a realization algorithm similar to that proposed by Isidori can be employed. The…
▽ More
We present a method that connects a well-established nonlinear (bilinear) identification method from time-domain data with neural network (NNs) advantages. The main challenge for fitting bilinear systems is the accurate recovery of the corresponding Markov parameters from the input and output measurements. Afterward, a realization algorithm similar to that proposed by Isidori can be employed. The novel step is that NNs are used here as a surrogate data simulator to construct input-output (i/o) data sequences. Then, classical realization theory is used to build a bilinear interpretable model that can further optimize engineering processes via robust simulations and control design.
△ Less
Submitted 22 August, 2022;
originally announced August 2022.
-
A framework for fitting quadratic-bilinear systems with applications to models of electrical circuits
Authors:
Dimitrios S. Karachalios,
Ion Victor Gosea,
Athanasios C. Antoulas
Abstract:
In this contribution, we propose a data-driven procedure to fit quadratic-bilinear surrogate models from data. Although the dynamics characterizing the original model are strongly nonlinear, we rely on lifting techniques to embed the original model into a quadratic-bilinear format. Here, data represent generalized transfer function values. This method is an extension of methods that do bilinear, o…
▽ More
In this contribution, we propose a data-driven procedure to fit quadratic-bilinear surrogate models from data. Although the dynamics characterizing the original model are strongly nonlinear, we rely on lifting techniques to embed the original model into a quadratic-bilinear format. Here, data represent generalized transfer function values. This method is an extension of methods that do bilinear, or quadratic inference, separately. It is based on first fitting a linear model with the classical Loewner framework, and then on inferring the best supplementing nonlinear operators, in a least-squares sense. The application scope of this method is given by electrical circuits with nonlinear components (such as diodes). We propose various test cases to illustrate the performance of the method.
△ Less
Submitted 2 December, 2021;
originally announced December 2021.
-
Data-driven modeling and control of large-scale dynamical systems in the Loewner framework
Authors:
Ion Victor Gosea,
Charles Poussot-Vassal,
Athanasios C. Antoulas
Abstract:
In this contribution, we discuss the modeling and model reduction framework known as the Loewner framework. This is a data-driven approach, applicable to large-scale systems, which was originally developed for applications to linear time-invariant systems. In recent years, this method has been extended to a number of additional more complex scenarios, including linear parametric or nonlinear dynam…
▽ More
In this contribution, we discuss the modeling and model reduction framework known as the Loewner framework. This is a data-driven approach, applicable to large-scale systems, which was originally developed for applications to linear time-invariant systems. In recent years, this method has been extended to a number of additional more complex scenarios, including linear parametric or nonlinear dynamical systems. We will provide here an overview of the latter two, together with time-domain extensions. Additionally, the application of the Loewner framework is illustrated by a collection of practical test cases. Firstly, for data-driven complexity reduction of the underlying model, and secondly, for dealing with control applications of complex systems (in particular, with feedback controller design).
△ Less
Submitted 26 August, 2021;
originally announced August 2021.
-
Reduced-order modeling of LPV systems in the Loewner framework
Authors:
Ion Victor Gosea,
Mihaly Petreczky,
Athanasios C. Antoulas
Abstract:
We propose a model reduction method for LPV systems. We consider LPV state-space representations with an affine dependence on the scheduling variables. The main idea behind the proposed method is to compute the reduced order model in such a manner that its frequency domain transfer function coincides with that of the original model for some frequencies. The proposed method uses Loewner-like matric…
▽ More
We propose a model reduction method for LPV systems. We consider LPV state-space representations with an affine dependence on the scheduling variables. The main idea behind the proposed method is to compute the reduced order model in such a manner that its frequency domain transfer function coincides with that of the original model for some frequencies. The proposed method uses Loewner-like matrices, which can be calculated from the frequency domain representation of the system. The contribution of the paper represents an extension of the well-established Loewner framework to LPV models.
△ Less
Submitted 21 April, 2021;
originally announced April 2021.
-
Factorization of the Loewner matrix pencil and its consequences
Authors:
Qiang Zhang,
Ion Victor Gosea,
Athanasios C. Antoulas
Abstract:
This paper starts by deriving a factorization of the Loewner matrix pencil that appears in the data-driven modeling approach known as the Loewner framework and explores its consequences. The first is that the associated quadruple constructed from the data yields a model without requiring further processing. The second consequence is related to how sensitive the eigenvalues of the Loewner pencil ar…
▽ More
This paper starts by deriving a factorization of the Loewner matrix pencil that appears in the data-driven modeling approach known as the Loewner framework and explores its consequences. The first is that the associated quadruple constructed from the data yields a model without requiring further processing. The second consequence is related to how sensitive the eigenvalues of the Loewner pencil are to perturbations. Based on an explicit generalized eigenvalue decomposition of this pencil and by making use of perturbation theory of matrix pencils, we explore two types of eigenvalue sensitivities. The first one is defined with respect to unstructured perturbations of the Loewner pencil, while the second one is defined for structured perturbations. We also discuss how the choice of data affects the two sensitivities.
△ Less
Submitted 6 March, 2021;
originally announced March 2021.
-
Learning reduced-order models of quadratic control systems from input-output data
Authors:
Ion Victor Gosea,
Dimitrios S. Karachalios,
Athanasios C. Antoulas
Abstract:
In this paper, we address an extension of the Loewner framework for learning quadratic control systems from input-output data. The proposed method first constructs a reduced-order linear model from measurements of the classical transfer function. Then, this surrogate model is enhanced by incorporating a term that depends quadratically on the state. More precisely, we employ an iterative procedure…
▽ More
In this paper, we address an extension of the Loewner framework for learning quadratic control systems from input-output data. The proposed method first constructs a reduced-order linear model from measurements of the classical transfer function. Then, this surrogate model is enhanced by incorporating a term that depends quadratically on the state. More precisely, we employ an iterative procedure based on least squares fitting that takes into account measured or computed data. Here, data represent transfer function values inferred from higher harmonics of the observed output, when the control input is purely oscillatory.
△ Less
Submitted 25 November, 2020;
originally announced December 2020.
-
On Loewner data-driven control for infinite-dimensional systems
Authors:
Ion Victor Gosea,
Charles Poussot-Vassal,
Athanasios C. Antoulas
Abstract:
In this paper, we address extensions of the Loewner Data-Driven Control (L-DDC) methodology. First, this approach is extended by incorporating two alternative approximation methods known as Adaptive-Antoulas-Anderson (AAA) and Vector Fitting (VF). These algorithms also include least squares fitting which provides additional flexibility and enables possible adjustments for control tuning. Secondly,…
▽ More
In this paper, we address extensions of the Loewner Data-Driven Control (L-DDC) methodology. First, this approach is extended by incorporating two alternative approximation methods known as Adaptive-Antoulas-Anderson (AAA) and Vector Fitting (VF). These algorithms also include least squares fitting which provides additional flexibility and enables possible adjustments for control tuning. Secondly, the standard model reference data-driven setting is extended to handle noise affecting the data and uncertainty in the closed-loop objective function. These proposed adaptations yield a more robust data-driven control design.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
Rational approximation of the absolute value function from measurements: a numerical study of recent methods
Authors:
Ion Victor Gosea,
Athanasios C. Antoulas
Abstract:
In this work, we propose an extensive numerical study on approximating the absolute value function. The methods presented in this paper compute approximants in the form of rational functions and have been proposed relatively recently, e.g., the Loewner framework and the AAA algorithm. Moreover, these methods are based on data, i.e., measurements of the original function (hence data-driven nature).…
▽ More
In this work, we propose an extensive numerical study on approximating the absolute value function. The methods presented in this paper compute approximants in the form of rational functions and have been proposed relatively recently, e.g., the Loewner framework and the AAA algorithm. Moreover, these methods are based on data, i.e., measurements of the original function (hence data-driven nature). We compare numerical results for these two methods with those of a recently-proposed best rational approximation method (the minimax algorithm) and with various classical bounds from the previous century. Finally, we propose an iterative extension of the Loewner framework that can be used to increase the approximation quality of the rational approximant.
△ Less
Submitted 6 May, 2020;
originally announced May 2020.
-
On Bilinear Time Domain Identification and Reduction in the Loewner Framework
Authors:
D. S. Karachalios,
I. V. Gosea,
A. C. Antoulas
Abstract:
The Loewner framework-(LF) in combination with Volterra series-(VS) offers a non-intrusive approximation method that is capable of identifying bilinear models from time-domain measurements. This method uses harmonic inputs which establish a natural way for data acquisition. For the general class of nonlinear problems with VS representation, the growing exponential approach allows the derivation of…
▽ More
The Loewner framework-(LF) in combination with Volterra series-(VS) offers a non-intrusive approximation method that is capable of identifying bilinear models from time-domain measurements. This method uses harmonic inputs which establish a natural way for data acquisition. For the general class of nonlinear problems with VS representation, the growing exponential approach allows the derivation of the generalized kernels, namely symmetric generalized frequency response functions - (GFRFs). In addition, the homogeneity of the Volterra operator determines the accuracy in terms of how many kernels are considered. For the weakly nonlinear setup, only a few kernels are needed to obtain a good approximation. In this direction, the proposed adaptive scheme is able to improve the estimations of the computationally non-zero kernels. The Fourier transform associates these measurements with the derived GFRFs and the LF makes the connection with system theory. In the linear case, the LF associates the so-called S-parameters with the linear transfer function by interpolating in the frequency domain. The goal of the proposed method is to extend identification to the case of bilinear systems from time-domain measurements and to approximate other general nonlinear systems (by means of the Carleman bilinearizarion scheme). By identifying the linear contribution with the LF, a considerable reduction is achieved by means of the SVD. The fitted linear system has the same McMillan degree as the original linear system. Then, the performance of the linear model is improved by augmenting a special nonlinear structure. In a nutshell, we learn reduced-dimension bilinear models directly from a potentially large-scale system that is simulated in the time domain. This is done by fitting first a linear model, and afterwards, by fitting the corresponding bilinear operator.
△ Less
Submitted 22 September, 2020; v1 submitted 19 March, 2020;
originally announced March 2020.
-
Model reduction of linear hybrid systems
Authors:
Ion Victor Gosea,
Mihaly Petreczky,
John Leth,
Rafael Wisniewski,
Athanasios C. Antoulas
Abstract:
The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced…
▽ More
The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced order model. This error bound is formulated in terms of singular values of the Gramians used for model reduction.
△ Less
Submitted 17 March, 2020;
originally announced March 2020.
-
Data-driven Spatio-temporal Prediction of High-dimensional Geophysical Turbulence using Koopman Operator Approximation
Authors:
M. A. Khodkar,
Athanasios C. Antoulas,
Pedram Hassanzadeh
Abstract:
We show the skills of a data-driven low-dimensional linear model in predicting the spatio-temporal evolution of turbulent Rayleigh-Bénard convection. The model is based on dynamic mode decomposition with delay-embedding, which provides a data-driven finite-dimensional approximation to the system's Koopman operator. The model is built using vector-valued observables from direct numerical simulation…
▽ More
We show the skills of a data-driven low-dimensional linear model in predicting the spatio-temporal evolution of turbulent Rayleigh-Bénard convection. The model is based on dynamic mode decomposition with delay-embedding, which provides a data-driven finite-dimensional approximation to the system's Koopman operator. The model is built using vector-valued observables from direct numerical simulations, and can provide accurate predictions. Similar high prediction skills are found for the Kuramoto-Sivashinsky equation in the strongly-chaotic regimes.
△ Less
Submitted 1 March, 2019; v1 submitted 21 December, 2018;
originally announced December 2018.
-
Case study: Approximations of the Bessel Function
Authors:
D. S. Karachalios,
I. V. Gosea,
Q. Zhang,
A. C. Antoulas
Abstract:
The purpose of this note is to compare various approximation methods as applied to the inverse of the Bessel function of the first kind, in a given domain of the complex plane.
The purpose of this note is to compare various approximation methods as applied to the inverse of the Bessel function of the first kind, in a given domain of the complex plane.
△ Less
Submitted 31 December, 2017;
originally announced January 2018.
-
Approximation of a damped Euler-Bernoulli beam model in the Loewner framework
Authors:
Ion Victor Gosea,
Athanasios C. Antoulas
Abstract:
The Loewner framework for model order reduction is applied to the class of infinite-dimension systems. The transfer function of such systems is irrational (as opposed to linear systems, whose transfer function is rational) and can be expressed as an infinite series of rational functions. The main advantage of the method is the fact that reduced orders models are constructed using only input-output…
▽ More
The Loewner framework for model order reduction is applied to the class of infinite-dimension systems. The transfer function of such systems is irrational (as opposed to linear systems, whose transfer function is rational) and can be expressed as an infinite series of rational functions. The main advantage of the method is the fact that reduced orders models are constructed using only input-output measurements. The procedure can be directly applied to the original transfer function or to the one obtained from the finite element discretization of the PDE. Significantly better results are obtained when using it directly, as it is presented in the experiments section.
△ Less
Submitted 16 December, 2017;
originally announced December 2017.
-
Data-driven model order reduction of linear switched systems
Authors:
Ion Victor Gosea,
Mihaly Petreczky,
Athanasios C. Antoulas
Abstract:
The Loewner framework for model reduction is extended to the class of linear switched systems. One advantage of this framework is that it introduces a trade-off between accuracy and complexity. Moreover, through this procedure, one can derive state-space models directly from data which is related to the input-output behavior of the original system. Hence, another advantage of the framework is that…
▽ More
The Loewner framework for model reduction is extended to the class of linear switched systems. One advantage of this framework is that it introduces a trade-off between accuracy and complexity. Moreover, through this procedure, one can derive state-space models directly from data which is related to the input-output behavior of the original system. Hence, another advantage of the framework is that it does not require the initial system matrices. More exactly, the data used in this framework consists in frequency domain samples of input-output map**s of the original system. The definition of generalized transfer functions for linear switched systems resembles the one for bilinear systems. A key role is played by the coupling matrices, which ensure the transition from one active mode to another.
△ Less
Submitted 15 December, 2017;
originally announced December 2017.
-
On the $\mathcal{H}_2$ norm and iterative model order reduction of linear switched systems
Authors:
Ion Victor Gosea,
Athanasios C. Antoulas
Abstract:
A new definition of the $\mathcal{H}_2$ norm for linear switched systems is introduced. It is based on appropriately defined time-domain kernels, or equivalently, on infinite controllability and observability Gramian matrices. Furthermore, an extension of the iterative rational Krylov algorithm to the class of linear switched systems is proposed.
A new definition of the $\mathcal{H}_2$ norm for linear switched systems is introduced. It is based on appropriately defined time-domain kernels, or equivalently, on infinite controllability and observability Gramian matrices. Furthermore, an extension of the iterative rational Krylov algorithm to the class of linear switched systems is proposed.
△ Less
Submitted 6 December, 2017;
originally announced December 2017.
-
Balanced truncation for linear switched systems
Authors:
Ion Victor Gosea,
Mihaly Petreczky,
Athanasios C. Antoulas,
Christophe Fiter
Abstract:
We propose a model order reduction approach for balanced truncation of linear switched systems. Such systems switch among a finite number of linear subsystems or modes.
We compute pairs of controllability and observability Gramians corresponding to each active discrete mode by solving systems of coupled Lyapunov equations. Depending on the type, each such Gramian corresponds to the energy associ…
▽ More
We propose a model order reduction approach for balanced truncation of linear switched systems. Such systems switch among a finite number of linear subsystems or modes.
We compute pairs of controllability and observability Gramians corresponding to each active discrete mode by solving systems of coupled Lyapunov equations. Depending on the type, each such Gramian corresponds to the energy associated to all possible switching scenarios that start or, respectively end, in a particular operational mode.
In order to guarantee that hard to control and hard to observe states are simultaneously eliminated, we construct a transformed system, whose Gramians are equal and diagonal. Then, by truncation, directly construct reduced order models. One can show that these models preserve some properties of the original model, such as stability and that it is possible to obtain error bounds relating the observed output, the control input and the entries of the diagonal Gramians.
△ Less
Submitted 6 December, 2017;
originally announced December 2017.
-
Interpolatory Weighted-H2 Model Reduction
Authors:
Branimir Anic,
Christopher A. Beattie,
Serkan Gugercin,
Athanasios C. Antoulas
Abstract:
This paper introduces an interpolation framework for the weighted-H2 model reduction problem. We obtain a new representation of the weighted-H2 norm of SISO systems that provides new interpolatory first order necessary conditions for an optimal reduced-order model. The H2 norm representation also provides an error expression that motivates a new weighted-H2 model reduction algorithm. Several numer…
▽ More
This paper introduces an interpolation framework for the weighted-H2 model reduction problem. We obtain a new representation of the weighted-H2 norm of SISO systems that provides new interpolatory first order necessary conditions for an optimal reduced-order model. The H2 norm representation also provides an error expression that motivates a new weighted-H2 model reduction algorithm. Several numerical examples illustrate the effectiveness of the proposed approach.
△ Less
Submitted 31 July, 2012; v1 submitted 12 January, 2012;
originally announced January 2012.
