Showing 1–50 of 140 results for author: Benner, P

Modelling Gas Networks with Compressors: A port-Hamiltonian Approach

Authors: Thomas Bendokat, Peter Benner, Sara Grundel, Ashwin S. Nayak

Abstract: Transient gas network simulations can significantly assist in design and operational aspects of gas networks. Models used in these simulations require a detailed framework integrating various models of the network constituents - pipes and compressor stations among others. In this context, the port-Hamiltonian modelling framework provides an energy-based modelling approach with a port-based couplin… ▽ More Transient gas network simulations can significantly assist in design and operational aspects of gas networks. Models used in these simulations require a detailed framework integrating various models of the network constituents - pipes and compressor stations among others. In this context, the port-Hamiltonian modelling framework provides an energy-based modelling approach with a port-based coupling mechanism. This study investigates develo** compressor models in an integrated isothermal port-Hamiltonian model for gas networks. Four different models of compressors are considered and their inclusion in a larger network model is detailed. A numerical implementation for a simple testcase is provided to confirm the validity of the proposed model and to highlight their differences. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 9 pages, 3 figures. Submitted to Proceedings of the 94 Annual Meeting of GAMM

MSC Class: 93-10 (Primary) 93-04; 76N15 (Secondary)

GN-SINDy: Greedy Sampling Neural Network in Sparse Identification of Nonlinear Partial Differential Equations

Authors: Ali Forootani, Peter Benner

Abstract: The sparse identification of nonlinear dynamical systems (SINDy) is a data-driven technique employed for uncovering and representing the fundamental dynamics of intricate systems based on observational data. However, a primary obstacle in the discovery of models for nonlinear partial differential equations (PDEs) lies in addressing the challenges posed by the curse of dimensionality and large data… ▽ More The sparse identification of nonlinear dynamical systems (SINDy) is a data-driven technique employed for uncovering and representing the fundamental dynamics of intricate systems based on observational data. However, a primary obstacle in the discovery of models for nonlinear partial differential equations (PDEs) lies in addressing the challenges posed by the curse of dimensionality and large datasets. Consequently, the strategic selection of the most informative samples within a given dataset plays a crucial role in reducing computational costs and enhancing the effectiveness of SINDy-based algorithms. To this aim, we employ a greedy sampling approach to the snapshot matrix of a PDE to obtain its valuable samples, which are suitable to train a deep neural network (DNN) in a SINDy framework. SINDy based algorithms often consist of a data collection unit, constructing a dictionary of basis functions, computing the time derivative, and solving a sparse identification problem which ends to regularised least squares minimization. In this paper, we extend the results of a SINDy based deep learning model discovery (DeePyMoD) approach by integrating greedy sampling technique in its data collection unit and new sparsity promoting algorithms in the least squares minimization unit. In this regard we introduce the greedy sampling neural network in sparse identification of nonlinear partial differential equations (GN-SINDy) which blends a greedy sampling method, the DNN, and the SINDy algorithm. In the implementation phase, to show the effectiveness of GN-SINDy, we compare its results with DeePyMoD by using a Python package that is prepared for this purpose on numerous PDE discovery △ Less

Submitted 14 May, 2024; originally announced May 2024.

GS-PINN: Greedy Sampling for Parameter Estimation in Partial Differential Equations

Authors: Ali Forootani, Harshit Kapadia, Sridhar Chellappa, Pawan Goyal, Peter Benner

Abstract: Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equatio… ▽ More Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equation to estimate its parameters. Greedy samples are used to train a physics-informed neural network architecture which maps the nonlinear relation between spatio-temporal data and the measured values. To prove the impact of greedy samples on the training of the physics-informed neural network for parameter estimation of a partial differential equation, their performance is compared with random samples taken from the given dataset. Our simulation results show that for all considered partial differential equations, greedy samples outperform random samples, i.e., we can estimate parameters with a significantly lower number of samples while simultaneously reducing the relative estimation error. A Python package is also prepared to support different phases of the proposed algorithm, including data prepossessing, greedy sampling, neural network training, and comparison. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Estimates of the Kolmogorov n-width for nonlinear transformations with application to distributed-parameter control systems

Authors: Alexander Zuyev, Lihong Feng, Peter Benner

Abstract: This paper aims at characterizing the approximability of bounded sets in the range of nonlinear operators in Banach spaces by finite-dimensional linear varieties. In particular, the class of operators we consider includes the endpoint maps of nonlinear distributed-parameter control systems. We describe the relationship between the Kolmogorov n-width of a bounded subset and the width of its image u… ▽ More This paper aims at characterizing the approximability of bounded sets in the range of nonlinear operators in Banach spaces by finite-dimensional linear varieties. In particular, the class of operators we consider includes the endpoint maps of nonlinear distributed-parameter control systems. We describe the relationship between the Kolmogorov n-width of a bounded subset and the width of its image under an essentially nonlinear transformation. We propose explicit estimates of the n-width in the space of images in terms of the affine part of the corresponding operator and the width of its nonlinear perturbation. These $n$-width estimates enable us to describe the reachable sets for infinite-dimensional bilinear control systems, with applications to controlling the Euler-Bernoulli beam using a contraction force and to a single-input Schrödinger equation. △ Less

Submitted 20 June, 2024; v1 submitted 9 March, 2024; originally announced March 2024.

Comments: This is a preprint version of the paper submitted to the IEEE L-CSS and CDC 2024

MSC Class: 93C20; 93C25; 41A25; 41A46; 81Q93; 74K10

Journal ref: IEEE Control Systems Letters, 2024

Stability-Certified Learning of Control Systems with Quadratic Nonlinearities

Authors: Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability is a fundamental attribute of dynamical systems, yet it is not always assured in models derived through inference. Our main objective is to develop a method tha… ▽ More This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability is a fundamental attribute of dynamical systems, yet it is not always assured in models derived through inference. Our main objective is to develop a method that facilitates the inference of quadratic control dynamical systems with inherent stability guarantees. To this aim, we investigate the stability characteristics of control systems with energy-preserving nonlinearities, thereby identifying conditions under which such systems are bounded-input bounded-state stable. These insights are subsequently applied to the learning process, yielding inferred models that are inherently stable by design. The efficacy of our proposed framework is demonstrated through a couple of numerical examples. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 12 pages, 4 figures

Learning reduced-order Quadratic-Linear models in Process Engineering using Operator Inference

Authors: Ion Victor Gosea, Luisa Peterson, Pawan Goyal, Jens Bremer, Kai Sundmacher, Peter Benner

Abstract: In this work, we address the challenge of efficiently modeling dynamical systems in process engineering. We use reduced-order model learning, specifically operator inference. This is a non-intrusive, data-driven method for learning dynamical systems from time-domain data. The application in our study is carbon dioxide methanation, an important reaction within the Power-to-X framework, to demonstra… ▽ More In this work, we address the challenge of efficiently modeling dynamical systems in process engineering. We use reduced-order model learning, specifically operator inference. This is a non-intrusive, data-driven method for learning dynamical systems from time-domain data. The application in our study is carbon dioxide methanation, an important reaction within the Power-to-X framework, to demonstrate its potential. The numerical results show the ability of the reduced-order models constructed with operator inference to provide a reduced yet accurate surrogate solution. This represents an important milestone towards the implementation of fast and reliable digital twin architectures. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Comments: 10 pages, 3 figures

Balanced Truncation of Descriptor Systems with a Quadratic Output

Authors: Jennifer Przybilla, Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: This work discusses model reduction for differential-algebraic systems with quadratic output equations. Under mild conditions, these systems can be transformed into a Weierstraß canonical form and, thus, be decoupled into differential equations and algebraic equations. The corresponding decoupled states are referred to as proper and improper states. Due to the quadratic function of the state as an… ▽ More This work discusses model reduction for differential-algebraic systems with quadratic output equations. Under mild conditions, these systems can be transformed into a Weierstraß canonical form and, thus, be decoupled into differential equations and algebraic equations. The corresponding decoupled states are referred to as proper and improper states. Due to the quadratic function of the state as an output, the proper and improper states are coupled in the output equation, which imposes a challenge from a model reduction viewpoint. Kee** the coupling in mind, our goal in this work is to find important subspaces of the proper and improper states and to reduce the system accordingly. To that end, we first propose the system's matrices, the so-called Gramians, to characterize the system's dominant subspaces. We pay particular attention to the computation of the observability Gramians that take into account the nonlinear coupling between the proper and the improper states. We furthermore show that the proposed Gramians are related to certain kernel functions, which are used to identify important subspaces. This allows us to propose a reduction algorithm to obtain reduced-order systems by removing the subspaces that are difficult to reach, as well as, difficult to observe. Moreover, we quantify the error between the full-order and reduced-order models and demonstrate the proposed methodology using three numerical experiments. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Numerical methods for closed-loop systems with non-autonomous data

Authors: B. Baran, P. Benner, J. Saak, T. Stillfjord

Abstract: By computing a feedback control via the linear quadratic regulator (LQR) approach and simulating a non-linear non-autonomous closed-loop system using this feedback, we combine two numerically challenging tasks. For the first task, the computation of the feedback control, we use the non-autonomous generalized differential Riccati equation (DRE), whose solution determines the time-varying feedback g… ▽ More By computing a feedback control via the linear quadratic regulator (LQR) approach and simulating a non-linear non-autonomous closed-loop system using this feedback, we combine two numerically challenging tasks. For the first task, the computation of the feedback control, we use the non-autonomous generalized differential Riccati equation (DRE), whose solution determines the time-varying feedback gain matrix. Regarding the second task, we want to be able to simulate non-linear closed-loop systems for which it is known that the regulator is only valid for sufficiently small perturbations. Thus, one easily runs into numerical issues in the integrators when the closed-loop control varies greatly. For these systems, e.g., the A-stable implicit Euler methods fails.\newline On the one hand, we implement non-autonomous versions of splitting schemes and BDF methods for the solution of our non-autonomous DREs. These are well-established DRE solvers in the autonomous case. On the other hand, to tackle the numerical issues in the simulation of the non-linear closed-loop system, we apply a fractional-step-theta scheme with time-adaptivity tuned specifically to this kind of challenge. That is, we additionally base the time-adaptivity on the activity of the control. We compare this approach to the more classical error-based time-adaptivity.\newline We describe techniques to make these two tasks computable in a reasonable amount of time and are able to simulate closed-loop systems with strongly varying controls, while avoiding numerical issues. Our time-adaptivity approach requires fewer time steps than the error-based alternative and is more reliable. △ Less

Submitted 21 February, 2024; originally announced February 2024.

MSC Class: 65F45; 93A15; 93B52; 93C10

Interpolatory Necessary Optimality Conditions for Reduced-order Modeling of Parametric Linear Time-invariant Systems

Authors: Petar Mlinarić, Peter Benner, Serkan Gugercin

Abstract: Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for p… ▽ More Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for parametric LTI systems with a general pole-residue form. We then specialize this result to recover known conditions for systems with parameter-independent poles and develop new conditions for a certain class of systems with parameter-dependent poles. △ Less

Submitted 18 January, 2024; originally announced January 2024.

Comments: 8 pages

Iterative approximations of periodic trajectories for nonlinear systems with discontinuous inputs

Authors: Alexander Zuyev, Peter Benner

Abstract: Nonlinear control-affine systems described by ordinary differential equations with bounded measurable input functions are considered. The problem of the existence of periodic trajectories to these systems is formulated in the sense of Carathéodory solutions. It is shown that, under the dominant linearization assumption, the periodic boundary value problem admits a unique solution for any admissibl… ▽ More Nonlinear control-affine systems described by ordinary differential equations with bounded measurable input functions are considered. The problem of the existence of periodic trajectories to these systems is formulated in the sense of Carathéodory solutions. It is shown that, under the dominant linearization assumption, the periodic boundary value problem admits a unique solution for any admissible control. This solution can be obtained as the limit of the proposed simple iterative scheme and Newton-type method. Under additional technical assumptions, sufficient contraction conditions of the corresponding generating operators are derived analytically. The proposed iterative approach is applied for the computation of periodic solutions of a realistic chemical reaction model with discontinuous control inputs. △ Less

Submitted 30 December, 2023; originally announced January 2024.

Comments: This is a preprint version of the paper that has been submitted to the journal "Applied Mathematics and Computation"

MSC Class: 93C15; 34B15; 34A36; 47J25; 65L10; 92E20

Fast and Reliable Reduced-Order Models for Cardiac Electrophysiology

Authors: Sridhar Chellappa, Barış Cansız, Lihong Feng, Peter Benner, Michael Kaliske

Abstract: Mathematical models of the human heart are increasingly playing a vital role in understanding the working mechanisms of the heart, both under healthy functioning and during disease. The aim is to aid medical practitioners diagnose and treat the many ailments affecting the heart. Towards this, modelling cardiac electrophysiology is crucial as the heart's electrical activity underlies the contractio… ▽ More Mathematical models of the human heart are increasingly playing a vital role in understanding the working mechanisms of the heart, both under healthy functioning and during disease. The aim is to aid medical practitioners diagnose and treat the many ailments affecting the heart. Towards this, modelling cardiac electrophysiology is crucial as the heart's electrical activity underlies the contraction mechanism and the resulting pum** action. The governing equations and the constitutive laws describing the electrical activity in the heart are coupled, nonlinear, and involve a fast moving wave front, which is generally solved by the finite element method. The simulation of this complex system as part of a virtual heart model is challenging due to the necessity of fine spatial and temporal resolution of the domain. Therefore, efficient surrogate models are needed to predict the dynamics under varying parameters and inputs. In this work, we develop an adaptive, projection-based surrogate model for cardiac electrophysiology. We introduce an a posteriori error estimator that can accurately and efficiently quantify the accuracy of the surrogate model. Using the error estimator, we systematically update our surrogate model through a greedy search of the parameter space. Furthermore, using the error estimator, the parameter search space is dynamically updated such that the most relevant samples get chosen at every iteration. The proposed adaptive surrogate modelling technique is tested on three benchmark models to illustrate its efficiency, accuracy, and ability of generalization. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Comments: 28 pages, 17 figures, 1 table

Interpolatory $\mathcal{H}_2$-optimality Conditions for Structured Linear Time-invariant Systems

Authors: Petar Mlinarić, Peter Benner, Serkan Gugercin

Abstract: Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured… ▽ More Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured LTI systems, in particular, for second-order, port-Hamiltonian, and time-delay systems. Under certain diagonalizability assumptions, we show that across all these different structured settings, bitangential Hermite interpolation is the common form for optimality, thus proving a unifying optimality framework for structured reduced-order modeling. △ Less

Submitted 24 June, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

Comments: 23 pages

A Robust SINDy Approach by Combining Neural Networks and an Integral Form

Authors: Ali Forootani, Pawan Goyal, Peter Benner

Abstract: The discovery of governing equations from data has been an active field of research for decades. One widely used methodology for this purpose is sparse regression for nonlinear dynamics, known as SINDy. Despite several attempts, noisy and scarce data still pose a severe challenge to the success of the SINDy approach. In this work, we discuss a robust method to discover nonlinear governing equation… ▽ More The discovery of governing equations from data has been an active field of research for decades. One widely used methodology for this purpose is sparse regression for nonlinear dynamics, known as SINDy. Despite several attempts, noisy and scarce data still pose a severe challenge to the success of the SINDy approach. In this work, we discuss a robust method to discover nonlinear governing equations from noisy and scarce data. To do this, we make use of neural networks to learn an implicit representation based on measurement data so that not only it produces the output in the vicinity of the measurements but also the time-evolution of output can be described by a dynamical system. Additionally, we learn such a dynamic system in the spirit of the SINDy framework. Leveraging the implicit representation using neural networks, we obtain the derivative information -- required for SINDy -- using an automatic differentiation tool. To enhance the robustness of our methodology, we further incorporate an integral condition on the output of the implicit networks. Furthermore, we extend our methodology to handle data collected from multiple initial conditions. We demonstrate the efficiency of the proposed methodology to discover governing equations under noisy and scarce data regimes by means of several examples and compare its performance with existing methods. △ Less

Submitted 13 September, 2023; originally announced September 2023.

Deep Learning for Structure-Preserving Universal Stable Koopman-Inspired Embeddings for Nonlinear Canonical Hamiltonian Dynamics

Authors: Pawan Goyal, Süleyman Yıldız, Peter Benner

Abstract: Discovering a suitable coordinate transformation for nonlinear systems enables the construction of simpler models, facilitating prediction, control, and optimization for complex nonlinear systems. To that end, Koopman operator theory offers a framework for global linearization for nonlinear systems, thereby allowing the usage of linear tools for design studies. In this work, we focus on the identi… ▽ More Discovering a suitable coordinate transformation for nonlinear systems enables the construction of simpler models, facilitating prediction, control, and optimization for complex nonlinear systems. To that end, Koopman operator theory offers a framework for global linearization for nonlinear systems, thereby allowing the usage of linear tools for design studies. In this work, we focus on the identification of global linearized embeddings for canonical nonlinear Hamiltonian systems through a symplectic transformation. While this task is often challenging, we leverage the power of deep learning to discover the desired embeddings. Furthermore, to overcome the shortcomings of Koopman operators for systems with continuous spectra, we apply the lifting principle and learn global cubicized embeddings. Additionally, a key emphasis is paid to enforce the bounded stability for the dynamics of the discovered embeddings. We demonstrate the capabilities of deep learning in acquiring compact symplectic coordinate transformation and the corresponding simple dynamical models, fostering data-driven learning of nonlinear canonical Hamiltonian systems, even those with continuous spectra. △ Less

Submitted 26 August, 2023; originally announced August 2023.

Guaranteed Stable Quadratic Models and their applications in SINDy and Operator Inference

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: Scientific machine learning for inferring dynamical systems combines data-driven modeling, physics-based modeling, and empirical knowledge. It plays an essential role in engineering design and digital twinning. In this work, we primarily focus on an operator inference methodology that builds dynamical models, preferably in low-dimension, with a prior hypothesis on the model structure, often determ… ▽ More Scientific machine learning for inferring dynamical systems combines data-driven modeling, physics-based modeling, and empirical knowledge. It plays an essential role in engineering design and digital twinning. In this work, we primarily focus on an operator inference methodology that builds dynamical models, preferably in low-dimension, with a prior hypothesis on the model structure, often determined by known physics or given by experts. Then, for inference, we aim to learn the operators of a model by setting up an appropriate optimization problem. One of the critical properties of dynamical systems is stability. However, this property is not guaranteed by the inferred models. In this work, we propose inference formulations to learn quadratic models, which are stable by design. Precisely, we discuss the parameterization of quadratic systems that are locally and globally stable. Moreover, for quadratic systems with no stable point yet bounded (e.g., chaotic Lorenz model), we discuss how to parameterize such bounded behaviors in the learning process. Using those parameterizations, we set up inference problems, which are then solved using a gradient-based optimization method. Furthermore, to avoid numerical derivatives and still learn continuous systems, we make use of an integral form of differential equations. We present several numerical examples, illustrating the preservation of stability and discussing its comparison with the existing state-of-the-art approach to infer operators. By means of numerical examples, we also demonstrate how the proposed methods are employed to discover governing equations and energy-preserving models. △ Less

Submitted 7 January, 2024; v1 submitted 26 August, 2023; originally announced August 2023.

Periodic optimal control of a plug flow reactor model with an isoperimetric constraint

Authors: Yevgeniia Yevgenieva, Alexander Zuyev, Peter Benner, Andreas Seidel-Morgenstern

Abstract: We study a class of nonlinear hyperbolic partial differential equations with boundary control. This class describes chemical reactions of the type ``$A \to$ product'' carried out in a plug flow reactor (PFR) in the presence of an inert component. An isoperimetric optimal control problem with periodic boundary conditions and input constraints is formulated for the considered mathematical model in o… ▽ More We study a class of nonlinear hyperbolic partial differential equations with boundary control. This class describes chemical reactions of the type ``$A \to$ product'' carried out in a plug flow reactor (PFR) in the presence of an inert component. An isoperimetric optimal control problem with periodic boundary conditions and input constraints is formulated for the considered mathematical model in order to maximize the mean amount of product over the period. For the single-input system, the optimality of a bang-bang control strategy is proved in the class of bounded measurable inputs. The case of controlled flow rate input is also analyzed by exploiting the method of characteristics. A case study is performed to illustrate the performance of the reaction model under different control strategies. △ Less

Submitted 9 August, 2023; originally announced August 2023.

MSC Class: 93C20; 92E20; 49K20; 49N20

Journal ref: Journal of Optimization Theory and Applications, 2024

Parameterized Interpolation of Passive Systems

Authors: Peter Benner, Pawan Goyal, Paul Van Dooren

Abstract: We study the tangential interpolation problem for a passive transfer function in standard state-space form. We derive new interpolation conditions based on the computation of a deflating subspace associated with a selection of spectral zeros of a parameterized para-Hermitian transfer function. We show that this technique improves the robustness of the low order model and that it can also be applie… ▽ More We study the tangential interpolation problem for a passive transfer function in standard state-space form. We derive new interpolation conditions based on the computation of a deflating subspace associated with a selection of spectral zeros of a parameterized para-Hermitian transfer function. We show that this technique improves the robustness of the low order model and that it can also be applied to non-passive systems, provided they have sufficiently many spectral zeros in the open right half plane. We analyze the accuracy needed for the computation of the deflating subspace, in order to still have a passive lower order model and we derive a novel selection procedure of spectral zeros in order to obtain low order models with a small approximation error. △ Less

Submitted 7 August, 2023; originally announced August 2023.

MSC Class: 93A30; 93C05; 93D09

Linearly Implicit Global Energy Preserving Reduced-order Models for Cubic Hamiltonian Systems

Authors: Süleyman Yildiz, Pawan Goyal, Peter Benner

Abstract: This work discusses the model reduction problem for large-scale multi-symplectic PDEs with cubic invariants. For this, we present a linearly implicit global energy-preserving method to construct reduced-order models. This allows to construct reduced-order models in the form of Hamiltonian systems suitable for long-time integration. Furthermore, We prove that the constructed reduced-order models pr… ▽ More This work discusses the model reduction problem for large-scale multi-symplectic PDEs with cubic invariants. For this, we present a linearly implicit global energy-preserving method to construct reduced-order models. This allows to construct reduced-order models in the form of Hamiltonian systems suitable for long-time integration. Furthermore, We prove that the constructed reduced-order models preserve global energy, and the spatially discrete equations also preserve the spatially-discrete local energy conversation law. We illustrate the efficiency of the proposed method using three numerical examples, namely a linear wave equation, the Korteweg-de Vries equation, and the Camassa-Holm equation, and present a comparison with the classical POD-Galerkin method. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Accurate error estimation for model reduction of nonlinear dynamical systems via data-enhanced error closure

Authors: Sridhar Chellappa, Lihong Feng, Peter Benner

Abstract: Accurate error estimation is crucial in model order reduction, both to obtain small reduced-order models and to certify their accuracy when deployed in downstream applications such as digital twins. In existing a posteriori error estimation approaches, knowledge about the time integration scheme is mandatory, e.g., the residual-based error estimators proposed for the reduced basis method. This pos… ▽ More Accurate error estimation is crucial in model order reduction, both to obtain small reduced-order models and to certify their accuracy when deployed in downstream applications such as digital twins. In existing a posteriori error estimation approaches, knowledge about the time integration scheme is mandatory, e.g., the residual-based error estimators proposed for the reduced basis method. This poses a challenge when automatic ordinary differential equation solver libraries are used to perform the time integration. To address this, we present a data-enhanced approach for a posteriori error estimation. Our new formulation enables residual-based error estimators to be independent of any time integration method. To achieve this, we introduce a corrected reduced-order model which takes into account a data-driven closure term for improved accuracy. The closure term, subject to mild assumptions, is related to the local truncation error of the corresponding time integration scheme. We propose efficient computational schemes for approximating the closure term, at the cost of a modest amount of training data. Furthermore, the new error estimator is incorporated within a greedy process to obtain parametric reduced-order models. Numerical results on three different systems show the accuracy of the proposed error estimation approach and its ability to produce ROMs that generalize well. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Comments: 37 pages, 25 figures

Adjacency-based, Non-intrusive Reduced-order Modeling for Fluid-Structure Interactions

Authors: Leonidas Gkimisis, Thomas Richter, Peter Benner

Abstract: Non-intrusive model reduction is a promising solution to system dynamics prediction, especially in cases where data are collected from experimental campaigns or proprietary software simulations. In this work, we present a method for non-intrusive model reduction applied to Fluid-Structure Interaction (FSI) problems. The approach is based on the a priori known sparsity of the full-order system oper… ▽ More Non-intrusive model reduction is a promising solution to system dynamics prediction, especially in cases where data are collected from experimental campaigns or proprietary software simulations. In this work, we present a method for non-intrusive model reduction applied to Fluid-Structure Interaction (FSI) problems. The approach is based on the a priori known sparsity of the full-order system operators, which is dictated by grid adjacency information. In order to enforce this type of sparsity, we solve a local, regularized least-squares problem for each degree of freedom on a grid, considering only the training data from adjacent degrees of freedom, thus making computation and storage of the inferred full-order operators feasible. After constructing the non-intrusive, sparse full-order model, Proper Orthogonal Decomposition (POD) is used for its projection to a reduced dimension subspace and thus the construction of a reduced-order model (ROM). The methodology is applied to the challenging Hron-Turek benchmark FSI3, for Re = 200. A physics-informed, non-intrusive ROM is constructed to predict the two-way coupled dynamics of a solid with a deformable, slender tail, subject to an incompressible, laminar flow. Results considering the accuracy and predictive capabilities of the inferred reduced models are discussed. △ Less

Submitted 26 June, 2023; originally announced June 2023.

Journal ref: Proceedings in Applied Mathematics and Mechanics, 2023

Active-Learning-Driven Surrogate Modeling for Efficient Simulation of Parametric Nonlinear Systems

Authors: Harshit Kapadia, Lihong Feng, Peter Benner

Abstract: When repeated evaluations for varying parameter configurations of a high-fidelity physical model are required, surrogate modeling techniques based on model order reduction are desired. In absence of the governing equations describing the dynamics, we need to construct the parametric reduced-order surrogate model in a non-intrusive fashion. In this setting, the usual residual-based error estimate f… ▽ More When repeated evaluations for varying parameter configurations of a high-fidelity physical model are required, surrogate modeling techniques based on model order reduction are desired. In absence of the governing equations describing the dynamics, we need to construct the parametric reduced-order surrogate model in a non-intrusive fashion. In this setting, the usual residual-based error estimate for optimal parameter sampling associated with the reduced basis method is not directly available. Our work provides a non-intrusive optimality criterion to efficiently populate the parameter snapshots, thereby, enabling us to effectively construct a parametric surrogate model. We consider separate parameter-specific proper orthogonal decomposition (POD) subspaces and propose an active-learning-driven surrogate model using kernel-based shallow neural networks, abbreviated as ActLearn-POD-KSNN surrogate model. To demonstrate the validity of our proposed ideas, we present numerical experiments using two physical models, namely Burgers' equation and shallow water equations. Both the models have mixed -- convective and diffusive -- effects within their respective parameter domains, with each of them dominating in certain regions. The proposed ActLearn-POD-KSNN surrogate model efficiently predicts the solution at new parameter locations, even for a setting with multiple interacting shock profiles. △ Less

Submitted 9 June, 2023; originally announced June 2023.

Comments: 31 pages, 24 figures, 1 table; Under review

Semi-active dam** optimization of vibrational systems using the reduced basis method

Authors: Jennifer Przybilla, Igor Pontes Duff, Peter Benner

Abstract: In this article, we consider vibrational systems with semi-active dam** that are described by a second-order model. In order to minimize the influence of external inputs to the system response, we are optimizing some dam** values. As minimization criterion, we evaluate the energy response, that is the $\cH_2$-norm of the corresponding transfer function of the system. Computing the energy respo… ▽ More In this article, we consider vibrational systems with semi-active dam** that are described by a second-order model. In order to minimize the influence of external inputs to the system response, we are optimizing some dam** values. As minimization criterion, we evaluate the energy response, that is the $\cH_2$-norm of the corresponding transfer function of the system. Computing the energy response includes solving Lyapunov equations for different dam** parameters. Hence, the minimization process leads to high computational costs if the system is of large dimension. We present two techniques that reduce the optimization problem by applying the reduced basis method to the corresponding parametric Lyapunov equations. In the first method, we determine a reduced solution space on which the Lyapunov equations and hence the resulting energy response values are computed approximately in a reasonable time. The second method includes the reduced basis method in the minimization process. To evaluate the quality of the approximations, we introduce error estimators that evaluate the error in the controllability Gramians and the energy response. Finally, we illustrate the advantages of our methods by applying them to two different examples. △ Less

Submitted 22 May, 2023; originally announced May 2023.

Parametric Dynamic Mode Decomposition for nonlinear parametric dynamical systems

Authors: Shuwen Sun, Lihong Feng, Hoon Seng Chan, Tamara Miličić, Tanja Vidaković-Koch, Fridolin Röder, Peter Benner

Abstract: A non-intrusive model order reduction (MOR) method that combines features of the dynamic mode decomposition (DMD) and the radial basis function (RBF) network is proposed to predict the dynamics of parametric nonlinear systems. In many applications, we have limited access to the information of the whole system, which motivates non-intrusive model reduction. One bottleneck is capturing the dynamics… ▽ More A non-intrusive model order reduction (MOR) method that combines features of the dynamic mode decomposition (DMD) and the radial basis function (RBF) network is proposed to predict the dynamics of parametric nonlinear systems. In many applications, we have limited access to the information of the whole system, which motivates non-intrusive model reduction. One bottleneck is capturing the dynamics of the solution without knowing the physics inside the "black-box" system. DMD is a powerful tool to mimic the dynamics of the system and give a reliable approximation of the solution in the time domain using only the dominant DMD modes. However, DMD cannot reproduce the parametric behavior of the dynamics. Our contribution focuses on extending DMD to parametric DMD by RBF interpolation. Specifically, a RBF network is first trained using snapshot matrices at limited parameter samples. The snapshot matrix at any new parameter sample can be quickly learned from the RBF network. DMD will use the newly generated snapshot matrix at the online stage to predict the time patterns of the dynamics corresponding to the new parameter sample. The proposed framework and algorithm are tested and validated by numerical examples including models with parametrized and time-varying inputs. △ Less

Submitted 1 August, 2023; v1 submitted 10 May, 2023; originally announced May 2023.

Structured interpolation for multivariate transfer functions of quadratic-bilinear systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simu… ▽ More High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: 29 pages, 7 figures

MSC Class: 30E05; 34K17; 65D05; 93C10; 93A15

Journal ref: Adv. Comput. Math., 50(2):18, 2024

Rank-Minimizing and Structured Model Inference

Authors: Pawan Goyal, Benjamin Peherstorfer, Peter Benner

Abstract: While extracting information from data with machine learning plays an increasingly important role, physical laws and other first principles continue to provide critical insights about systems and processes of interest in science and engineering. This work introduces a method that infers models from data with physical insights encoded in the form of structure and that minimizes the model order so t… ▽ More While extracting information from data with machine learning plays an increasingly important role, physical laws and other first principles continue to provide critical insights about systems and processes of interest in science and engineering. This work introduces a method that infers models from data with physical insights encoded in the form of structure and that minimizes the model order so that the training data are fitted well while redundant degrees of freedom without conditions and sufficient data to fix them are automatically eliminated. The models are formulated via solution matrices of specific instances of generalized Sylvester equations that enforce interpolation of the training data and relate the model order to the rank of the solution matrices. The proposed method numerically solves the Sylvester equations for minimal-rank solutions and so obtains models of low order. Numerical experiments demonstrate that the combination of structure preservation and rank minimization leads to accurate models with orders of magnitude fewer degrees of freedom than models of comparable prediction quality that are learned with structure preservation alone. △ Less

Submitted 19 February, 2023; originally announced February 2023.

Inference of Continuous Linear Systems from Data with Guaranteed Stability

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: Machine-learning technologies for learning dynamical systems from data play an important role in engineering design. This research focuses on learning continuous linear models from data. Stability, a key feature of dynamic systems, is especially important in design tasks such as prediction and control. Thus, there is a need to develop methodologies that provide stability guarantees. To that end, w… ▽ More Machine-learning technologies for learning dynamical systems from data play an important role in engineering design. This research focuses on learning continuous linear models from data. Stability, a key feature of dynamic systems, is especially important in design tasks such as prediction and control. Thus, there is a need to develop methodologies that provide stability guarantees. To that end, we leverage the parameterization of stable matrices proposed in [Gillis/Sharma, Automatica, 2017] to realize the desired models. Furthermore, to avoid the estimation of derivative information to learn continuous systems, we formulate the inference problem in an integral form. We also discuss a few extensions, including those related to control systems. Numerical experiments show that the combination of a stable matrix parameterization and an integral form of differential equations allows us to learn stable systems without requiring derivative information, which can be challenging to obtain in situations with noisy or limited data. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Dominant Subspaces of High-Fidelity Nonlinear Structured Parametric Dynamical Systems and Model Reduction

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: In this work, we investigate a model order reduction scheme for high-fidelity nonlinear structured parametric dynamical systems. More specifically, we consider a class of nonlinear dynamical systems whose nonlinear terms are polynomial functions, and the linear part corresponds to a linear structured model, such as second-order, time-delay, or fractional-order systems. Our approach relies on the V… ▽ More In this work, we investigate a model order reduction scheme for high-fidelity nonlinear structured parametric dynamical systems. More specifically, we consider a class of nonlinear dynamical systems whose nonlinear terms are polynomial functions, and the linear part corresponds to a linear structured model, such as second-order, time-delay, or fractional-order systems. Our approach relies on the Volterra series representation of these dynamical systems. Using this representation, we identify the kernels and, thus, the generalized multivariate transfer functions associated with these systems. Consequently, we present results allowing the construction of reduced-order models whose generalized transfer functions interpolate these of the original system at pre-defined frequency points. For efficient calculations, we also need the concept of a symmetric Kronecker product representation of a tensor and derive particular properties of them. Moreover, we propose an algorithm that extracts dominant subspaces from the prescribed interpolation conditions. This allows the construction of reduced-order models that preserve the structure. We also extend these results to parametric systems and a special case (delay in input/output). We demonstrate the efficiency of the proposed method by means of various numerical benchmarks. △ Less

Submitted 23 January, 2023; originally announced January 2023.

Multi-fidelity error estimation accelerates greedy model reduction of complex dynamical systems

Authors: Lihong Feng, Luigi Lombardi, Giulio Antonini, Peter Benner

Abstract: Model order reduction usually consists of two stages: the offline stage and the online stage. The offline stage is the expensive part that sometimes takes hours till the final reduced-order model is derived, especially when the original model is very large or complex. Once the reduced-order model is obtained, the online stage of querying the reduced-order model for simulation is very fast and ofte… ▽ More Model order reduction usually consists of two stages: the offline stage and the online stage. The offline stage is the expensive part that sometimes takes hours till the final reduced-order model is derived, especially when the original model is very large or complex. Once the reduced-order model is obtained, the online stage of querying the reduced-order model for simulation is very fast and often real-time capable. This work concerns a strategy to significantly speed up the offline stage of model order reduction for large and complex systems. In particular, it is successful in accelerating the greedy algorithm that is often used in the offline stage for reduced-order model construction. We propose multi-fidelity error estimators and replace the high-fidelity error estimator in the greedy algorithm. Consequently, the computational complexity at each iteration of the greedy algorithm is reduced and the algorithm converges more than 3 times faster without incurring noticeable accuracy loss. △ Less

Submitted 19 January, 2023; v1 submitted 13 January, 2023; originally announced January 2023.

Comments: Compared to the first version, only the title is rephrased

Generalized Quadratic Embeddings for Nonlinear Dynamics using Deep Learning

Authors: Pawan Goyal, Peter Benner

Abstract: The engineering design process often relies on mathematical modeling that can describe the underlying dynamic behavior. In this work, we present a data-driven methodology for modeling the dynamics of nonlinear systems. To simplify this task, we aim to identify a coordinate transformation that allows us to represent the dynamics of nonlinear systems using a common, simple model structure. The advan… ▽ More The engineering design process often relies on mathematical modeling that can describe the underlying dynamic behavior. In this work, we present a data-driven methodology for modeling the dynamics of nonlinear systems. To simplify this task, we aim to identify a coordinate transformation that allows us to represent the dynamics of nonlinear systems using a common, simple model structure. The advantage of a common simple model is that customized design tools developed for it can be applied to study a large variety of nonlinear systems. The simplest common model -- one can think of -- is linear, but linear systems often fall short in accurately capturing the complex dynamics of nonlinear systems. In this work, we propose using quadratic systems as the common structure, inspired by the lifting principle. According to this principle, smooth nonlinear systems can be expressed as quadratic systems in suitable coordinates without approximation errors. However, finding these coordinates solely from data is challenging. Here, we leverage deep learning to identify such lifted coordinates using only data, enabling a quadratic dynamical system to describe the system's dynamics. Additionally, we discuss the asymptotic stability of these quadratic dynamical systems. We illustrate the approach using data collected from various numerical examples, demonstrating its superior performance with the existing well-known techniques. △ Less

Submitted 4 January, 2024; v1 submitted 1 November, 2022; originally announced November 2022.

An Operator Inference Oriented Approach for Mechanical Systems

Authors: Yevgeniya Filanova, Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: Model-order reduction techniques allow the construction of low-dimensional surrogate models that can accelerate engineering design processes. Often, these techniques are intrusive, meaning that they require direct access to underlying high-fidelity models. Accessing these models is laborious or may not even be possible in some cases. Therefore, there is an interest in develo** non-intrusive mode… ▽ More Model-order reduction techniques allow the construction of low-dimensional surrogate models that can accelerate engineering design processes. Often, these techniques are intrusive, meaning that they require direct access to underlying high-fidelity models. Accessing these models is laborious or may not even be possible in some cases. Therefore, there is an interest in develo** non-intrusive model reduction techniques to construct low-dimensional models directly from simulated or experimental data. In this work, we focus on a recent data-driven methodology, namely operator inference, that aims at inferring the reduced operators using only trajectories of high-fidelity models. We present an extension of operator inference for mechanical systems, preserving the second-order structure. We also study a particular case in which complete information about the external forces is available. In this formulation, the reduced operators having certain properties inspired by the original system matrices are enforced by adding constraints to the optimization problem. We illustrate the presented methodology using three numerical examples. △ Less

Submitted 2 December, 2022; v1 submitted 14 October, 2022; originally announced October 2022.

A quadratic decoder approach to nonintrusive reduced-order modeling of nonlinear dynamical systems

Authors: Peter Benner, Pawan Goyal, Jan Heiland, Igor Pontes

Abstract: Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform linear methods in terms of dimension reduction versus accuracy but, typically, come with a large computational overhead. In this work, we consider a quadratic reduc… ▽ More Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform linear methods in terms of dimension reduction versus accuracy but, typically, come with a large computational overhead. In this work, we consider a quadratic reduction scheme which induces nonlinear structures that are well accessible to tensorized linear algebra routines. We discuss that nonintrusive approaches can be used to simultaneously reduce the complexity in the equations and propose an operator inference formulation that respects dynamics on nonlinear manifolds. △ Less

Submitted 30 September, 2022; originally announced September 2022.

MSC Class: 37N10; 68T05; 76D05; 65F22; 93A15; 93C10

Riccati-feedback Control of a Two-dimensional Two-phase Stefan Problem

Authors: Björn Baran, Peter Benner, Jens Saak

Abstract: We discuss the feedback control problem for a two-dimensional two-phase Stefan problem. In our approach, we use a sharp interface representation in combination with mesh-movement to track the interface position. To attain a feedback control, we apply the linear-quadratic regulator approach to a suitable linearization of the problem. We address details regarding the discretization and the interface… ▽ More We discuss the feedback control problem for a two-dimensional two-phase Stefan problem. In our approach, we use a sharp interface representation in combination with mesh-movement to track the interface position. To attain a feedback control, we apply the linear-quadratic regulator approach to a suitable linearization of the problem. We address details regarding the discretization and the interface representation therein. Further, we document the matrix assembly to generate a non-autonomous generalized differential Riccati equation. To numerically solve the Riccati equation, we use low-rank factored and matrix-valued versions of the non-autonomous backward differentiation formulas, which incorporate implicit index reduction techniques. For the numerical simulation of the feedback controlled Stefan problem, we use a time-adaptive fractional-step-theta scheme. We provide the implementations for the developed methods and test these in several numerical experiments. With these experiments we show that our feedback control approach is applicable to the Stefan control problem and makes this large-scale problem computable. Also, we discuss the influence of several controller design parameters, such as the choice of inputs and outputs. △ Less

Submitted 21 December, 2022; v1 submitted 12 September, 2022; originally announced September 2022.

MSC Class: 35R35; 49N10; 65F45; 93A15; 93B52; 93C10

Exponential Lag Synchronization of Cohen-Grossberg Neural Networks with Discrete and Distributed Delays on Time Scales

Authors: Vipin Kumar, Jan Heiland, Peter Benner

Abstract: In this article, we investigate exponential lag synchronization results for the Cohen-Grossberg neural networks (C-GNNs) with discrete and distributed delays on an arbitrary time domain by applying feedback control. We formulate the problem by using the time scales theory so that the results can be applied to any uniform or non-uniform time domains. Also, we provide a comparison of results that sh… ▽ More In this article, we investigate exponential lag synchronization results for the Cohen-Grossberg neural networks (C-GNNs) with discrete and distributed delays on an arbitrary time domain by applying feedback control. We formulate the problem by using the time scales theory so that the results can be applied to any uniform or non-uniform time domains. Also, we provide a comparison of results that shows that obtained results are unified and generalize the existing results. Mainly, we use the unified matrix-measure theory and Halanay inequality to establish these results. In the last section, we provide two simulated examples for different time domains to show the effectiveness and generality of the obtained analytical results. △ Less

Submitted 25 March, 2023; v1 submitted 1 September, 2022; originally announced September 2022.

Comments: 20 pages, 18 figures

MSC Class: 34N05; 34D06; 92B20; 40C05

Journal ref: Neural Process Lett (2023)

Model reduction for second-order systems with inhomogeneous initial conditions

Authors: Jennifer Przybilla, Igor Pontes Duff, Peter Benner

Abstract: In this paper, we consider the problem of finding surrogate models for large-scale second-order linear time-invariant systems with inhomogeneous initial conditions. For this class of systems, the superposition principle allows us to decompose the system behavior into three independent components. The first behavior corresponds to the transfer between the input and output having zero initial condit… ▽ More In this paper, we consider the problem of finding surrogate models for large-scale second-order linear time-invariant systems with inhomogeneous initial conditions. For this class of systems, the superposition principle allows us to decompose the system behavior into three independent components. The first behavior corresponds to the transfer between the input and output having zero initial conditions. In contrast, the other two correspond to the transfer between the initial position and the initial velocity conditions having zero input, respectively. Based on this superposition of systems, our goal is to propose model reduction schemes allowing to preserve the second-order structure in the surrogate models. To this aim, we introduce tailored second-order Gramians for each system component and compute them numerically, solving Lyapunov equations. As a consequence, two methodologies are proposed. The first one consists in reducing each of the components independently using a suitable balanced truncation procedure. The sum of these reduced systems provides an approximation of the original system. This methodology allows flexibility on the order of the reduced-order model. The second proposed methodology consists in extracting the dominant subspaces from the sum of Gramians to build the projection matrices leading to a surrogate model. Additionally, we discuss error bounds for the overall output approximation. Finally, the proposed methods are illustrated by means of benchmark problems. △ Less

Submitted 23 June, 2022; v1 submitted 14 June, 2022; originally announced June 2022.

A unifying framework for tangential interpolation of structured bilinear control systems

Authors: Peter Benner, Serkan Gugercin, Steffen W. R. Werner

Abstract: In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of ta… ▽ More In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of tangential interpolation for bilinear systems from the literature and also provides a unifying framework. We then derive explicit conditions on the projection spaces to enforce tangential interpolation in different settings, including conditions for tangential Hermite interpolation. The analysis is illustrated by means of three numerical examples. △ Less

Submitted 3 June, 2022; originally announced June 2022.

Comments: 33 pages, 9 figures

MSC Class: 30E05; 34K17; 65D05; 93A15; 93C10

Journal ref: Numer. Math., 155(3-4): 445-483, 2023

Neural ODEs with Irregular and Noisy Data

Authors: Pawan Goyal, Peter Benner

Abstract: Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and irregular sampled measurements. In our methodology, the main innovation can be seen in the in… ▽ More Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and irregular sampled measurements. In our methodology, the main innovation can be seen in the integration of deep neural networks with the neural ordinary differential equations (ODEs) approach. Precisely, we aim at learning a neural network that provides (approximately) an implicit representation of the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by constraining using neural ODEs. The proposed framework to learn a model describing the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. Moreover, a particular structure, e.g., second-order with respect to time, can easily be incorporated. We demonstrate the effectiveness of the proposed method for learning models using data obtained from various differential equations and present a comparison with the neural ODE method that does not make any special treatment to noise. △ Less

Submitted 19 May, 2022; originally announced May 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2109.11446

On an integrated Krylov-ADI solver for large-scale Lyapunov equations

Authors: Peter Benner, Davide Palitta, Jens Saak

Abstract: One of the most computationally expensive steps of the low-rank ADI method for large-scale Lyapunov equations is the solution of a shifted linear system at each iteration. We propose the use of the extended Krylov subspace method for this task. In particular, we illustrate how a single approximation space can be constructed to solve all the shifted linear systems needed to achieve a prescribed acc… ▽ More One of the most computationally expensive steps of the low-rank ADI method for large-scale Lyapunov equations is the solution of a shifted linear system at each iteration. We propose the use of the extended Krylov subspace method for this task. In particular, we illustrate how a single approximation space can be constructed to solve all the shifted linear systems needed to achieve a prescribed accuracy in terms of Lyapunov residual norm. Moreover, we show how to fully merge the two iterative procedures in order to obtain a novel, efficient implementation of the low-rank ADI method, for an important class of equations. Many state-of-the-art algorithms for the shift computation can be easily incorporated into our new scheme, as well. Several numerical results illustrate the potential of our novel procedure when compared to an implementation of the low-rank ADI method based on sparse direct solvers for the shifted linear systems. △ Less

Submitted 8 August, 2022; v1 submitted 31 March, 2022; originally announced March 2022.

A Structure-Preserving Divide-and-Conquer Method for Pseudosymmetric Matrices

Authors: Peter Benner, Yuji Nakatsukasa, Carolin Penke

Abstract: We devise a spectral divide-and-conquer scheme for matrices that are self-adjoint with respect to a given indefinite scalar product (i.e. pseudosymmetic matrices). The pseudosymmetric structure of the matrix is preserved in the spectral division, such that the method can be applied recursively to achieve full diagonalization. The method is well-suited for structured matrices that come up in comput… ▽ More We devise a spectral divide-and-conquer scheme for matrices that are self-adjoint with respect to a given indefinite scalar product (i.e. pseudosymmetic matrices). The pseudosymmetric structure of the matrix is preserved in the spectral division, such that the method can be applied recursively to achieve full diagonalization. The method is well-suited for structured matrices that come up in computational quantum physics and chemistry. In this application context, additional definiteness properties guarantee a convergence of the matrix sign function iteration within two steps when Zolotarev functions are used. The steps are easily parallelizable. Furthermore, it is shown that the matrix decouples into symmetric definite eigenvalue problems after just one step of spectral division. △ Less

Submitted 16 March, 2022; originally announced March 2022.

MSC Class: 65F15; 65F55 ACM Class: G.1.3

The Hamiltonian Extended Krylov Subspace Method

Authors: Peter Benner, Heike Faßbender, Michel-Niklas Senn

Abstract: An algorithm for constructing a $J$-orthogonal basis of the extended Krylov subspace $\mathcal{K}_{r,s}=\operatorname{range}\{u,Hu, H^2u,$ $ \ldots, $ $H^{2r-1}u, H^{-1}u, H^{-2}u, \ldots, H^{-2s}u\},$ where $H \in \mathbb{R}^{2n \times 2n}$ is a large (and sparse) Hamiltonian matrix is derived (for $r = s+1$ or $r=s$). Surprisingly, this allows for short recurrences involving at most five previou… ▽ More An algorithm for constructing a $J$-orthogonal basis of the extended Krylov subspace $\mathcal{K}_{r,s}=\operatorname{range}\{u,Hu, H^2u,$ $ \ldots, $ $H^{2r-1}u, H^{-1}u, H^{-2}u, \ldots, H^{-2s}u\},$ where $H \in \mathbb{R}^{2n \times 2n}$ is a large (and sparse) Hamiltonian matrix is derived (for $r = s+1$ or $r=s$). Surprisingly, this allows for short recurrences involving at most five previously generated basis vectors. Projecting $H$ onto the subspace $\mathcal{K}_{r,s}$ yields a small Hamiltonian matrix. The resulting HEKS algorithm may be used in order to approximate $f(H)u$ where $f$ is a function which maps the Hamiltonian matrix $H$ to, e.g., a (skew-)Hamiltonian or symplectic matrix. Numerical experiments illustrate that approximating $f(H)u$ with the HEKS algorithm is competitive for some functions compared to the use of other (structure-preserving) Krylov subspace methods. △ Less

Submitted 25 February, 2022; originally announced February 2022.

MSC Class: 65F25; 65F50; 65F60; 15A23

A low-rank solution method for Riccati equations with indefinite quadratic terms

Authors: Peter Benner, Jan Heiland, Steffen W. R. Werner

Abstract: Algebraic Riccati equations with indefinite quadratic terms play an important role in applications related to robust controller design. While there are many established approaches to solve these in case of small-scale dense coefficients, there is no approach available to compute solutions in the large-scale sparse setting. In this paper, we develop an iterative method to compute low-rank approxima… ▽ More Algebraic Riccati equations with indefinite quadratic terms play an important role in applications related to robust controller design. While there are many established approaches to solve these in case of small-scale dense coefficients, there is no approach available to compute solutions in the large-scale sparse setting. In this paper, we develop an iterative method to compute low-rank approximations of stabilizing solutions of large-scale sparse continuous-time algebraic Riccati equations with indefinite quadratic terms. We test the developed approach for dense examples in comparison to other established matrix equation solvers, and investigate the applicability and performance in large-scale sparse examples. △ Less

Submitted 11 November, 2021; originally announced November 2021.

Comments: 19 pages, 2 figures, 5 tables

Journal ref: Numer. Algorithms, 92(2):1083-1103, 2023

Fast A Posteriori State Error Estimation for Reliable Frequency Swee** in Microwave Circuits via the Reduced-Basis Method

Authors: Valentin de la Rubia, Sridhar Chellappa, Lihong Feng, Peter Benner

Abstract: We develop a compact, reliable model order reduction approach for fast frequency sweeps in microwave circuits by means of the reduced-basis method. Contrary to what has been previously done, special emphasis is placed on certifying the accuracy of the reduced-order model with respect to the original full-order model in an effective and efficient way. Previous works on model order reduction accurac… ▽ More We develop a compact, reliable model order reduction approach for fast frequency sweeps in microwave circuits by means of the reduced-basis method. Contrary to what has been previously done, special emphasis is placed on certifying the accuracy of the reduced-order model with respect to the original full-order model in an effective and efficient way. Previous works on model order reduction accuracy certification rely on costly $\textit{a posteriori}$ error estimators, which typically require expensive $\textit{inf-sup}$ constant evaluations of the underlying full-order model. This scenario is often too time-consuming and unaffordable in electromagnetic applications. As a result, less expensive and heuristic error estimators are commonly used instead. Very often, one is interested in knowing about the full state vector, instead of just some output quantities derived from the full state. Therefore, error estimators for the full state vector become relevant. In this work, we detail the frequency behavior of both the electric field and the state error when an approximation to the electric field solution is carried out. Both field quantities share the same frequency behavior. Based on this observation, we focus on the efficient estimation of the electric field state error and propose a fast evaluation of the reduced-order model state error in the frequency band of analysis, minimizing the number of full-order model evaluations. This methodology is of paramount importance to carry out a reliable fast frequency sweep in microwave circuits. Finally, real-life applications will illustrate the capabilities and efficiency of the proposed approach. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Comments: 24 pages, 13 Figures, 6 Tables

Journal ref: IEEE Transactions on Microwave Theory and Techniques, vol. 70, no. 11, pp. 5172-5184, 2022

Palindromic linearization and numerical solution of nonsymmetric algebraic T-Riccati equations

Authors: Peter Benner, Bruno Iannazzo, Beatrice Meini, Davide Palitta

Abstract: We identify a relationship between the solutions of a nonsymmetric algebraic T-Riccati equation (T-NARE) and the deflating subspaces of a palindromic matrix pencil, obtained by arranging the coefficients of the T-NARE. The interplay between T-NARE and palindromic pencils allows one to derive both theoretical properties of the solutions of the equation, and new methods for its numerical solution. I… ▽ More We identify a relationship between the solutions of a nonsymmetric algebraic T-Riccati equation (T-NARE) and the deflating subspaces of a palindromic matrix pencil, obtained by arranging the coefficients of the T-NARE. The interplay between T-NARE and palindromic pencils allows one to derive both theoretical properties of the solutions of the equation, and new methods for its numerical solution. In particular, we propose methods based on the (palindromic) QZ algorithm and the doubling algorithm, whose effectiveness is demonstrated by several numerical tests △ Less

Submitted 7 October, 2021; originally announced October 2021.

Solution decomposition for the nonlinear Poisson-Boltzmann equation using the range-separated tensor format

Authors: Cleophas Kweyu, Venera Khoromskaia, Boris Khoromskij, Matthias Stein, Peter Benner

Abstract: The Poisson-Boltzmann equation (PBE) is an implicit solvent continuum model for calculating the electrostatic potential and energies of ionic solvated biomolecules. However, its numerical solution remains a significant challenge due strong singularities and nonlinearity caused by the singular source terms and the exponential nonlinear terms, respectively. An efficient method for the treatment of s… ▽ More The Poisson-Boltzmann equation (PBE) is an implicit solvent continuum model for calculating the electrostatic potential and energies of ionic solvated biomolecules. However, its numerical solution remains a significant challenge due strong singularities and nonlinearity caused by the singular source terms and the exponential nonlinear terms, respectively. An efficient method for the treatment of singularities in the linear PBE was introduced in \cite{BeKKKS:18}, that is based on the RS tensor decomposition for both electrostatic potential and the discretized Dirac delta distribution. In this paper, we extend this regularization method to the nonlinear PBE. We apply the PBE only to the regular part of the solution corresponding to the modified right-hand side via extraction of the long-range part in the discretized Dirac delta distribution. The total electrostatic potential is obtained by adding the long-range solution to the directly precomputed short-range potential. The main computational benefit of the approach is the automatic maintaining of the continuity in the Cauchy data on the solute-solvent interface. The boundary conditions are also obtained from the long-range component of the precomputed canonical tensor representation of the Newton kernel. In the numerical experiments, we illustrate the accuracy of the nonlinear regularized PBE (NRPBE) over the classical variant. △ Less

Submitted 10 June, 2023; v1 submitted 28 September, 2021; originally announced September 2021.

Comments: 26 pages, 15 figures

MSC Class: 65F30; 65F50; 65N35; 65F10 ACM Class: G.1.3; G.1.8

Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

Authors: Pawan Goyal, Peter Benner

Abstract: Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is a necessary step to draw conclusions from these data, and it often becomes quite essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and sparsely sampled measurements. In our methodology, the main innovation can be se… ▽ More Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is a necessary step to draw conclusions from these data, and it often becomes quite essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and sparsely sampled measurements. In our methodology, the main innovation can be seen in of integration of deep neural networks with a classical numerical integration method. Precisely, we aim at learning a neural network that implicitly represents the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by enforcing the constraint that the data at the next time-steps can be given by following a numerical integration scheme such as the fourth-order Runge-Kutta scheme. The proposed framework to learn a model predicting the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. We demonstrate the effectiveness of the proposed method to learning models using data obtained from various differential equations. The proposed approach provides a promising methodology to learn dynamic models, where the first-principle understanding remains opaque. △ Less

Submitted 23 September, 2021; originally announced September 2021.

Learning reduced order models from data for hyperbolic PDEs

Authors: Neeraj Sarna, Peter Benner

Abstract: Given a set of solution snapshots of a hyperbolic PDE, we are interested in learning a reduced order model (ROM). To this end, we propose a novel decompose then learn approach. We decompose the solution by expressing it as a composition of a transformed solution and a de-transformer. Our idea is to learn a ROM for both these objects, which, unlike the solution, are well approximable in a linear re… ▽ More Given a set of solution snapshots of a hyperbolic PDE, we are interested in learning a reduced order model (ROM). To this end, we propose a novel decompose then learn approach. We decompose the solution by expressing it as a composition of a transformed solution and a de-transformer. Our idea is to learn a ROM for both these objects, which, unlike the solution, are well approximable in a linear reduced space. A ROM for the (untransformed) solution is then recovered via a recomposition. The transformed solution results from composing the solution with a spatial transform that aligns the spatial discontinuities. Furthermore, the de-transformer is the inverse of the spatial transform and lets us recover a ROM for the solution. We consider an image registration technique to compute the spatial transform, and to learn a ROM, we resort to the dynamic mode decomposition (DMD) methodology. Several benchmark problems demonstrate the effectiveness our method in representing the data and as a predictive tool. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Next-Gen Gas Network Simulation

Authors: Christian Himpe, Sara Grundel, Peter Benner

Abstract: To overcome many-query optimization, control, or uncertainty quantification work loads in reliable gas and energy network operations, model order reduction is the mathematical technology of choice. To this end, we enhance the model, solver and reductor components of the "morgen" platform, introduced in Himpe et al [J.~Math.~Ind. 11:13, 2021], and conclude with a mathematically, numerically and com… ▽ More To overcome many-query optimization, control, or uncertainty quantification work loads in reliable gas and energy network operations, model order reduction is the mathematical technology of choice. To this end, we enhance the model, solver and reductor components of the "morgen" platform, introduced in Himpe et al [J.~Math.~Ind. 11:13, 2021], and conclude with a mathematically, numerically and computationally favorable model-solver-reductor ensemble. △ Less

Submitted 5 August, 2021; originally announced August 2021.

A Greedy Data Collection Scheme For Linear Dynamical Systems

Authors: Karim Cherifi, Pawan Goyal, Peter Benner

Abstract: Mathematical models are essential to analyze and understand the dynamics of complex systems. Recently, data-driven methodologies have got a lot of attention which is leveraged by advancements in sensor technology. However, the quality of obtained data plays a vital role in learning a good and reliable model. Therefore, in this paper, we propose an efficient heuristic methodology to collect data bo… ▽ More Mathematical models are essential to analyze and understand the dynamics of complex systems. Recently, data-driven methodologies have got a lot of attention which is leveraged by advancements in sensor technology. However, the quality of obtained data plays a vital role in learning a good and reliable model. Therefore, in this paper, we propose an efficient heuristic methodology to collect data both in the frequency domain and time-domain, aiming at the best possible information gain from limited experimental data. The efficiency of the proposed methodology is illustrated by means of several examples, and also, its robustness in the presence of noisy data is shown. △ Less

Submitted 27 July, 2021; originally announced July 2021.

Multivariate moment matching for model order reduction of quadratic-bilinear systems using error bounds

Authors: Muhammad Altaf Khattak, Mian Ilyas Ahmad, Lihong Feng, Peter Benner

Abstract: We propose an adaptive moment-matching framework for model order reduction of quadratic-bilinear descriptor systems. In this framework, an important issue is the selection of those shift frequencies where moment-matching is to be achieved. Often, the choice is random or linked to the linear part of the nonlinear system. In this paper, we extend the use of an existing a posteriori error bound for g… ▽ More We propose an adaptive moment-matching framework for model order reduction of quadratic-bilinear descriptor systems. In this framework, an important issue is the selection of those shift frequencies where moment-matching is to be achieved. Often, the choice is random or linked to the linear part of the nonlinear system. In this paper, we extend the use of an existing a posteriori error bound for general linear time invariant systems to quadratic-bilinear systems and develop a greedy-type framework to select a good choice of interpolation points for the construction of the projection matrices. The results are compared with standard quadratic-bilinear projection methods and we observe that the approximations obtained by the proposed method yield high accuracy. △ Less

Submitted 27 May, 2021; originally announced May 2021.

Data-Driven Model Order Reduction for Problems with Parameter-Dependent Jump-Discontinuities

Authors: Neeraj Sarna, Peter Benner

Abstract: We propose a data-driven model order reduction (MOR) technique for parametrized partial differential equations that exhibit parameter-dependent jump-discontinuities. Such problems have poor-approximability in a linear space and therefore, are challenging for standard MOR techniques. We build upon the methodology of approximating the map between the parameter domain and the expansion coefficients o… ▽ More We propose a data-driven model order reduction (MOR) technique for parametrized partial differential equations that exhibit parameter-dependent jump-discontinuities. Such problems have poor-approximability in a linear space and therefore, are challenging for standard MOR techniques. We build upon the methodology of approximating the map between the parameter domain and the expansion coefficients of the reduced basis via regression. The online stage queries the regression model for the expansion coefficients and recovers a reduced approximation for the solution. We propose to apply this technique to a transformed solution that results from composing the solution with a spatial transform. Unlike the (untransformed) solution, it is sufficiently regular along the parameter domain and thus, is well-approximable in a low-dimensional linear space. To recover an approximation for the (untransformed) solution, we propose an online efficient regression-based technique that approximates the inverse of the spatial transform. Our method features a decoupled online and offline stage, and benchmark problems involving hyperbolic and parabolic equations demonstrate its effectiveness. △ Less

Submitted 2 May, 2021; originally announced May 2021.

Inf-Sup-Constant-Free State Error Estimator for Model Order Reduction of Parametric Systems in Electromagnetics

Authors: Sridhar Chellappa, Lihong Feng, Valentin de la Rubia, Peter Benner

Abstract: A reliable model order reduction process for parametric analysis in electromagnetics is detailed. Special emphasis is placed on certifying the accuracy of the reduced-order model. For this purpose, a sharp state error estimator is proposed. Standard a posteriori state error estimation for model order reduction relies on the inf-sup constant. For parametric systems, the inf-sup constant is paramete… ▽ More A reliable model order reduction process for parametric analysis in electromagnetics is detailed. Special emphasis is placed on certifying the accuracy of the reduced-order model. For this purpose, a sharp state error estimator is proposed. Standard a posteriori state error estimation for model order reduction relies on the inf-sup constant. For parametric systems, the inf-sup constant is parameter-dependent. The a posteriori error estimation for systems with very small or vanishing inf-sup constant poses a challenge, since it is inversely proportional to the inf-sup constant, resulting in rather useless, overly pessimistic error estimators. Such systems appear in electromagnetics since the inf-sup constant values are close to zero at points close to resonant frequencies, where they eventually vanish. We propose a novel a posteriori state error estimator which avoids the calculation of the inf-sup constant. The proposed state error estimator is compared with the standard error estimator and a recently proposed one in the literature. It is shown that our proposed error estimator outperforms both existing estimators. Numerical experiments are performed on real-life microwave devices such as narrowband and wideband antennas, two types of dielectric resonator filters as well as a dual-mode waveguide filter. These examples show the capabilities and efficiency of the proposed methodology. △ Less

Submitted 2 April, 2023; v1 submitted 26 April, 2021; originally announced April 2021.

Comments: 20 pages, 30 Figures, 3 Tables