-
Deep polytopic autoencoders for low-dimensional linear parameter-varying approximations and nonlinear feedback design
Authors:
Jan Heiland,
Yongho Kim,
Steffen W. R. Werner
Abstract:
Polytopic autoencoders provide low-dimensional parametrizations of states in a polytope. For nonlinear PDEs, this is readily applied to low-dimensional linear parameter-varying (LPV) approximations as they have been exploited for efficient nonlinear controller design via series expansions of the solution to the state-dependent Riccati equation. In this work, we develop a polytopic autoencoder for…
▽ More
Polytopic autoencoders provide low-dimensional parametrizations of states in a polytope. For nonlinear PDEs, this is readily applied to low-dimensional linear parameter-varying (LPV) approximations as they have been exploited for efficient nonlinear controller design via series expansions of the solution to the state-dependent Riccati equation. In this work, we develop a polytopic autoencoder for control applications and show how it outperforms standard linear approaches in view of LPV approximations of nonlinear systems and how the particular architecture enables higher order series expansions at little extra computational effort. We illustrate the properties and potentials of this approach to computational nonlinear controller design for large-scale systems with a thorough numerical study.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Interpolatory model order reduction of large-scale dynamical systems with root mean squared error measures
Authors:
Sean Reiter,
Steffen W. R. Werner
Abstract:
The root mean squared error is an important measure used in a variety of applications such as structural dynamics and acoustics to model averaged deviations from standard behavior. For large-scale systems, simulations of this quantity quickly become computationally prohibitive. Classical model order reduction techniques attempt to resolve this issue via the construction of surrogate models that em…
▽ More
The root mean squared error is an important measure used in a variety of applications such as structural dynamics and acoustics to model averaged deviations from standard behavior. For large-scale systems, simulations of this quantity quickly become computationally prohibitive. Classical model order reduction techniques attempt to resolve this issue via the construction of surrogate models that emulate the root mean squared error measure using an intermediate linear system. However, this approach requires a potentially large number of linear outputs, which can be disadvantageous in the design of reduced-order models. In this work, we consider directly the root mean squared error as the quantity of interest using the concept of quadratic-output models and propose several new model reduction techniques for the construction of appropriate surrogates. We test the proposed methods on a model for the vibrational response of a plate with tuned vibration absorbers.
△ Less
Submitted 11 June, 2024; v1 submitted 13 March, 2024;
originally announced March 2024.
-
Using $LDL^{T}$ factorizations in Newton's method for solving general large-scale algebraic Riccati equations
Authors:
Jens Saak,
Steffen W. R. Werner
Abstract:
Continuous-time algebraic Riccati equations can be found in many disciplines in different forms. In the case of small-scale dense coefficient matrices, stabilizing solutions can be computed to all possible formulations of the Riccati equation. This is not the case when it comes to large-scale sparse coefficient matrices. In this paper, we provide a reformulation of the Newton-Kleinman iteration sc…
▽ More
Continuous-time algebraic Riccati equations can be found in many disciplines in different forms. In the case of small-scale dense coefficient matrices, stabilizing solutions can be computed to all possible formulations of the Riccati equation. This is not the case when it comes to large-scale sparse coefficient matrices. In this paper, we provide a reformulation of the Newton-Kleinman iteration scheme for continuous-time algebraic Riccati equations using indefinite symmetric low-rank factorizations. This allows the application of the method to the case of general large-scale sparse coefficient matrices. We provide convergence results for several prominent realizations of the equation and show in numerical examples the effectiveness of the approach.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Adaptive choice of near-optimal expansion points for interpolation-based structure-preserving model reduction
Authors:
Quirin Aumann,
Steffen W. R. Werner
Abstract:
Interpolation-based methods are well-established and effective approaches for the efficient generation of accurate reduced-order surrogate models. Common challenges for such methods are the automatic selection of good or even optimal interpolation points and the appropriate size of the reduced-order model. An approach that addresses the first problem for linear, unstructured systems is the Iterati…
▽ More
Interpolation-based methods are well-established and effective approaches for the efficient generation of accurate reduced-order surrogate models. Common challenges for such methods are the automatic selection of good or even optimal interpolation points and the appropriate size of the reduced-order model. An approach that addresses the first problem for linear, unstructured systems is the Iterative Rational Krylov Algorithm (IRKA), which computes optimal interpolation points through iterative updates by solving linear eigenvalue problems. However, in the case of preserving internal system structures, optimal interpolation points are unknown, and heuristics based on nonlinear eigenvalue problems result in numbers of potential interpolation points that typically exceed the reasonable size of reduced-order systems. In our work, we propose a projection-based iterative interpolation method inspired by IRKA for generally structured systems to adaptively compute near-optimal interpolation points as well as an appropriate size for the reduced-order system. Additionally, the iterative updates of the interpolation points can be chosen such that the reduced-order model provides an accurate approximation in specified frequency ranges of interest. For such applications, our new approach outperforms the established methods in terms of accuracy and computational effort. We show this in numerical examples with different structures.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
Structured interpolation for multivariate transfer functions of quadratic-bilinear systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simu…
▽ More
High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures.
△ Less
Submitted 27 April, 2023;
originally announced April 2023.
-
Structured barycentric forms for interpolation-based data-driven reduced modeling of second-order systems
Authors:
Ion Victor Gosea,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' tr…
▽ More
An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' transfer functions are rewritten in different barycentric forms using different parametrizations. Loewner-like algorithms are developed for the explicit computation of second-order systems from data based on the developed barycentric forms. Numerical experiments show the performance of these new structured data driven modeling methods compared to other interpolation-based data-driven modeling techniques from the literature.
△ Less
Submitted 22 March, 2023;
originally announced March 2023.
-
Low-complexity linear parameter-varying approximations of incompressible Navier-Stokes equations for truncated state-dependent Riccati feedback
Authors:
Jan Heiland,
Steffen W. R. Werner
Abstract:
Nonlinear feedback design via state-dependent Riccati equations is well established but unfeasible for large-scale systems because of computational costs. If the system can be embedded in the class of linear parameter-varying (LPV) systems with the parameter dependency being affine-linear, then the nonlinear feedback law has a series expansion with constant and precomputable coefficients. In this…
▽ More
Nonlinear feedback design via state-dependent Riccati equations is well established but unfeasible for large-scale systems because of computational costs. If the system can be embedded in the class of linear parameter-varying (LPV) systems with the parameter dependency being affine-linear, then the nonlinear feedback law has a series expansion with constant and precomputable coefficients. In this work, we propose a general method to approximating nonlinear systems such that the series expansion is possible and efficient even for high-dimensional systems. We lay out the stabilization of incompressible Navier-Stokes equations as application, discuss the numerical solution of the involved matrix-valued equations, and confirm the performance of the approach in a numerical example.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
Context-aware controller inference for stabilizing dynamical systems from scarce data
Authors:
Steffen W. R. Werner,
Benjamin Peherstorfer
Abstract:
This work introduces a data-driven control approach for stabilizing high-dimensional dynamical systems from scarce data. The proposed context-aware controller inference approach is based on the observation that controllers need to act locally only on the unstable dynamics to stabilize systems. This means it is sufficient to learn the unstable dynamics alone, which are typically confined to much lo…
▽ More
This work introduces a data-driven control approach for stabilizing high-dimensional dynamical systems from scarce data. The proposed context-aware controller inference approach is based on the observation that controllers need to act locally only on the unstable dynamics to stabilize systems. This means it is sufficient to learn the unstable dynamics alone, which are typically confined to much lower dimensional spaces than the high-dimensional state spaces of all system dynamics and thus few data samples are sufficient to identify them. Numerical experiments demonstrate that context-aware controller inference learns stabilizing controllers from orders of magnitude fewer data samples than traditional data-driven control techniques and variants of reinforcement learning. The experiments further show that the low data requirements of context-aware controller inference are especially beneficial in data-scarce engineering problems with complex physics, for which learning complete system dynamics is often intractable in terms of data and training costs.
△ Less
Submitted 18 January, 2023; v1 submitted 22 July, 2022;
originally announced July 2022.
-
A unifying framework for tangential interpolation of structured bilinear control systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of ta…
▽ More
In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of tangential interpolation for bilinear systems from the literature and also provides a unifying framework. We then derive explicit conditions on the projection spaces to enforce tangential interpolation in different settings, including conditions for tangential Hermite interpolation. The analysis is illustrated by means of three numerical examples.
△ Less
Submitted 3 June, 2022;
originally announced June 2022.
-
Multi-fidelity robust controller design with gradient sampling
Authors:
Steffen W. R. Werner,
Michael L. Overton,
Benjamin Peherstorfer
Abstract:
Robust controllers that stabilize dynamical systems even under disturbances and noise are often formulated as solutions of nonsmooth, nonconvex optimization problems. While methods such as gradient sampling can handle the nonconvexity and nonsmoothness, the costs of evaluating the objective function may be substantial, making robust control challenging for dynamical systems with high-dimensional s…
▽ More
Robust controllers that stabilize dynamical systems even under disturbances and noise are often formulated as solutions of nonsmooth, nonconvex optimization problems. While methods such as gradient sampling can handle the nonconvexity and nonsmoothness, the costs of evaluating the objective function may be substantial, making robust control challenging for dynamical systems with high-dimensional state spaces. In this work, we introduce multi-fidelity variants of gradient sampling that leverage low-cost, low-fidelity models with low-dimensional state spaces for speeding up the optimization process while nonetheless providing convergence guarantees for a high-fidelity model of the system of interest, which is primarily accessed in the last phase of the optimization process. Our first multi-fidelity method initiates gradient sampling on higher fidelity models with starting points obtained from cheaper, lower fidelity models. Our second multi-fidelity method relies on ensembles of gradients that are computed from low- and high-fidelity models. Numerical experiments with controlling the cooling of a steel rail profile and laminar flow in a cylinder wake demonstrate that our new multi-fidelity gradient sampling methods achieve up to two orders of magnitude speedup compared to the single-fidelity gradient sampling method that relies on the high-fidelity model alone.
△ Less
Submitted 5 December, 2022; v1 submitted 30 May, 2022;
originally announced May 2022.
-
On the sample complexity of stabilizing linear dynamical systems from data
Authors:
Steffen W. R. Werner,
Benjamin Peherstorfer
Abstract:
Learning controllers from data for stabilizing dynamical systems typically follows a two step process of first identifying a model and then constructing a controller based on the identified model. However, learning models means identifying generic descriptions of the dynamics of systems, which can require large amounts of data and extracting information that are unnecessary for the specific task o…
▽ More
Learning controllers from data for stabilizing dynamical systems typically follows a two step process of first identifying a model and then constructing a controller based on the identified model. However, learning models means identifying generic descriptions of the dynamics of systems, which can require large amounts of data and extracting information that are unnecessary for the specific task of stabilization. The contribution of this work is to show that if a linear dynamical system has dimension (McMillan degree) $n$, then there always exist $n$ states from which a stabilizing feedback controller can be constructed, independent of the dimension of the representation of the observed states and the number of inputs. By building on previous work, this finding implies that any linear dynamical system can be stabilized from fewer observed states than the minimal number of states required for learning a model of the dynamics. The theoretical findings are demonstrated with numerical experiments that show the stabilization of the flow behind a cylinder from less data than necessary for learning a model.
△ Less
Submitted 22 July, 2022; v1 submitted 28 February, 2022;
originally announced March 2022.
-
Structured model order reduction for vibro-acoustic problems using interpolation and balancing methods
Authors:
Quirin Aumann,
Steffen W. R. Werner
Abstract:
Vibration and dissipation in vibro-acoustic systems can be assessed using frequency response analysis. Evaluating a frequency sweep on a full-order model can be very costly, so model order reduction methods are employed to compute cheap-to-evaluate surrogates. This work compares structure-preserving model reduction methods based on rational interpolation and balanced truncation with a specific foc…
▽ More
Vibration and dissipation in vibro-acoustic systems can be assessed using frequency response analysis. Evaluating a frequency sweep on a full-order model can be very costly, so model order reduction methods are employed to compute cheap-to-evaluate surrogates. This work compares structure-preserving model reduction methods based on rational interpolation and balanced truncation with a specific focus on their applicability to vibro-acoustic systems. Such models typically exhibit a second-order structure and their material properties as well as their excitation may be depending on the driving frequency. We show and compare the effectiveness of all considered methods by applying them to numerical models of vibro-acoustic systems depicting structural vibration, sound transmission, acoustic scattering, and poroelastic problems.
△ Less
Submitted 17 January, 2022;
originally announced January 2022.
-
A low-rank solution method for Riccati equations with indefinite quadratic terms
Authors:
Peter Benner,
Jan Heiland,
Steffen W. R. Werner
Abstract:
Algebraic Riccati equations with indefinite quadratic terms play an important role in applications related to robust controller design. While there are many established approaches to solve these in case of small-scale dense coefficients, there is no approach available to compute solutions in the large-scale sparse setting. In this paper, we develop an iterative method to compute low-rank approxima…
▽ More
Algebraic Riccati equations with indefinite quadratic terms play an important role in applications related to robust controller design. While there are many established approaches to solve these in case of small-scale dense coefficients, there is no approach available to compute solutions in the large-scale sparse setting. In this paper, we develop an iterative method to compute low-rank approximations of stabilizing solutions of large-scale sparse continuous-time algebraic Riccati equations with indefinite quadratic terms. We test the developed approach for dense examples in comparison to other established matrix equation solvers, and investigate the applicability and performance in large-scale sparse examples.
△ Less
Submitted 11 November, 2021;
originally announced November 2021.
-
Structured vector fitting framework for mechanical systems
Authors:
Steffen W. R. Werner,
Ion Victor Gosea,
Serkan Gugercin
Abstract:
In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within th…
▽ More
In this paper, we develop a structure-preserving formulation of the data-driven vector fitting algorithm for the case of modally damped mechanical systems. Using the structured pole-residue form of the transfer function of modally damped second-order systems, we propose two possible structured extensions of the barycentric formula of system transfer functions. Integrating these new forms within the classical vector fitting algorithm leads to the formulation of two new algorithms that allow the computation of modally damped mechanical systems from data in a least squares fashion. Thus, the learned model is guaranteed to have the desired structure. We test the proposed algorithms on two benchmark models.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
Robust output-feedback stabilization for incompressible flows using low-dimensional $\mathcal{H}_{\infty}$-controllers
Authors:
Peter Benner,
Jan Heiland,
Steffen W. R. Werner
Abstract:
Output-based controllers are known to be fragile with respect to model uncertainties. The standard $\mathcal{H}_{\infty}$-control theory provides a general approach to robust controller design based on the solution of the $\mathcal{H}_{\infty}$-Riccati equations. In view of stabilizing incompressible flows in simulations, two major challenges have to be addressed: the high-dimensional nature of th…
▽ More
Output-based controllers are known to be fragile with respect to model uncertainties. The standard $\mathcal{H}_{\infty}$-control theory provides a general approach to robust controller design based on the solution of the $\mathcal{H}_{\infty}$-Riccati equations. In view of stabilizing incompressible flows in simulations, two major challenges have to be addressed: the high-dimensional nature of the spatially discretized model and the differential-algebraic structure that comes with the incompressibility constraint. This work demonstrates the synthesis of low-dimensional robust controllers with guaranteed robustness margins for the stabilization of incompressible flow problems. The performance and the robustness of the reduced-order controller with respect to linearization and model reduction errors are investigated and illustrated in numerical examples.
△ Less
Submitted 6 October, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Structure-Preserving Model Reduction for Dissipative Mechanical Systems
Authors:
Rebekka S. Beddig,
Peter Benner,
Ines Dorschky,
Timo Reis,
Paul Schwerdtner,
Matthias Voigt,
Steffen W. R. Werner
Abstract:
Suppressing vibrations in mechanical systems, usually described by second-order dynamical models, is a challenging task in mechanical engineering in terms of computational resources even nowadays. One remedy is structure-preserving model order reduction to construct easy-to-evaluate surrogates for the original dynamical system having the same structure. In our work, we present an overview of recen…
▽ More
Suppressing vibrations in mechanical systems, usually described by second-order dynamical models, is a challenging task in mechanical engineering in terms of computational resources even nowadays. One remedy is structure-preserving model order reduction to construct easy-to-evaluate surrogates for the original dynamical system having the same structure. In our work, we present an overview of recently developed structure-preserving model reduction methods for second-order systems. These methods are based on modal and balanced truncation in different variants, as well as on rational interpolation. Numerical examples are used to illustrate the effectiveness of all described methods.
△ Less
Submitted 25 January, 2022; v1 submitted 13 October, 2020;
originally announced October 2020.
-
Structure-Preserving Interpolation for Model Reduction of Parametric Bilinear Systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure…
▽ More
In this paper, we present an interpolation framework for structure-preserving model order reduction of parametric bilinear dynamical systems. We introduce a general setting, covering a broad variety of different structures for parametric bilinear systems, and then provide conditions on projection spaces for the interpolation of structured subsystem transfer functions such that the system structure and parameter dependencies are preserved in the reduced-order model. Two benchmark examples with different parameter dependencies are used to demonstrate the theoretical analysis.
△ Less
Submitted 22 July, 2020;
originally announced July 2020.
-
Structure-Preserving Interpolation of Bilinear Control Systems
Authors:
Peter Benner,
Serkan Gugercin,
Steffen W. R. Werner
Abstract:
In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input sin…
▽ More
In this paper, we extend the structure-preserving interpolatory model reduction framework, originally developed for linear systems, to structured bilinear control systems. Specifically, we give explicit construction formulae for the model reduction bases to satisfy different types of interpolation conditions. First, we establish the analysis for transfer function interpolation for single-input single-output structured bilinear systems. Then, we extend these results to the case of multi-input multi-output structured bilinear systems by matrix interpolation. The effectiveness of our structure-preserving approach is illustrated by means of various numerical examples.
△ Less
Submitted 2 May, 2020;
originally announced May 2020.
-
MORLAB -- The Model Order Reduction LABoratory
Authors:
Peter Benner,
Steffen W. R. Werner
Abstract:
For an easy use of model order reduction techniques in applications, software solutions are needed. In this paper, we describe the MORLAB, Model Order Reduction LABoratory, toolbox as an efficient implementation of model reduction techniques for dense, medium-scale linear time-invariant systems. Giving an introduction to the underlying programming principles of the toolbox, we show the basic idea…
▽ More
For an easy use of model order reduction techniques in applications, software solutions are needed. In this paper, we describe the MORLAB, Model Order Reduction LABoratory, toolbox as an efficient implementation of model reduction techniques for dense, medium-scale linear time-invariant systems. Giving an introduction to the underlying programming principles of the toolbox, we show the basic idea of spectral splitting and present an overview about implemented model reduction techniques. Two numerical examples are used to illustrate different use cases of the MORLAB toolbox.
△ Less
Submitted 28 February, 2020;
originally announced February 2020.
-
Frequency- and Time-Limited Balanced Truncation for Large-Scale Second-Order Systems
Authors:
Peter Benner,
Steffen W. R. Werner
Abstract:
Considering the use of dynamical systems in practical applications, often only limited regions in the time or frequency domain are of interest. Therefor, it usually pays off to compute local approximations of the used dynamical systems in the frequency and time domain. In this paper, we consider a structure-preserving extension of the frequency- and time-limited balanced truncation methods to seco…
▽ More
Considering the use of dynamical systems in practical applications, often only limited regions in the time or frequency domain are of interest. Therefor, it usually pays off to compute local approximations of the used dynamical systems in the frequency and time domain. In this paper, we consider a structure-preserving extension of the frequency- and time-limited balanced truncation methods to second-order dynamical systems. We give a full overview about the first-order limited balanced truncation methods and extend those methods to second-order systems by using the different second-order balanced truncation formulas from the literature. Also, we present numerical methods for solving the arising large-scale sparse matrix equations and give numerical modifications to deal with the problematic case of second-order systems. The results are then illustrated on three numerical examples.
△ Less
Submitted 17 January, 2020;
originally announced January 2020.
-
Hankel-Norm Approximation of Large-Scale Descriptor Systems
Authors:
Peter Benner,
Steffen W. R. Werner
Abstract:
The Hankel-norm approximation is a model reduction method which provides the best approximation in the Hankel semi-norm. In this paper the computation of the optimal Hankel-norm approximation is generalized to the case of linear time-invariant continuous-time descriptor systems. An efficient algorithm is developed by refining the generalized balanced truncation square root method. For a wide pract…
▽ More
The Hankel-norm approximation is a model reduction method which provides the best approximation in the Hankel semi-norm. In this paper the computation of the optimal Hankel-norm approximation is generalized to the case of linear time-invariant continuous-time descriptor systems. An efficient algorithm is developed by refining the generalized balanced truncation square root method. For a wide practical usage, adaptations of the introduced algorithm towards stable computations and sparse systems are made as well as an approach for a projection-free algorithm. To show the approximation behavior of the introduced method, numerical examples are presented.
△ Less
Submitted 31 July, 2018; v1 submitted 19 December, 2016;
originally announced December 2016.
