-
GS-PINN: Greedy Sampling for Parameter Estimation in Partial Differential Equations
Authors:
Ali Forootani,
Harshit Kapadia,
Sridhar Chellappa,
Pawan Goyal,
Peter Benner
Abstract:
Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equatio…
▽ More
Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equation to estimate its parameters. Greedy samples are used to train a physics-informed neural network architecture which maps the nonlinear relation between spatio-temporal data and the measured values. To prove the impact of greedy samples on the training of the physics-informed neural network for parameter estimation of a partial differential equation, their performance is compared with random samples taken from the given dataset. Our simulation results show that for all considered partial differential equations, greedy samples outperform random samples, i.e., we can estimate parameters with a significantly lower number of samples while simultaneously reducing the relative estimation error. A Python package is also prepared to support different phases of the proposed algorithm, including data prepossessing, greedy sampling, neural network training, and comparison.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Fast and Reliable Reduced-Order Models for Cardiac Electrophysiology
Authors:
Sridhar Chellappa,
Barış Cansız,
Lihong Feng,
Peter Benner,
Michael Kaliske
Abstract:
Mathematical models of the human heart are increasingly playing a vital role in understanding the working mechanisms of the heart, both under healthy functioning and during disease. The aim is to aid medical practitioners diagnose and treat the many ailments affecting the heart. Towards this, modelling cardiac electrophysiology is crucial as the heart's electrical activity underlies the contractio…
▽ More
Mathematical models of the human heart are increasingly playing a vital role in understanding the working mechanisms of the heart, both under healthy functioning and during disease. The aim is to aid medical practitioners diagnose and treat the many ailments affecting the heart. Towards this, modelling cardiac electrophysiology is crucial as the heart's electrical activity underlies the contraction mechanism and the resulting pum** action. The governing equations and the constitutive laws describing the electrical activity in the heart are coupled, nonlinear, and involve a fast moving wave front, which is generally solved by the finite element method. The simulation of this complex system as part of a virtual heart model is challenging due to the necessity of fine spatial and temporal resolution of the domain. Therefore, efficient surrogate models are needed to predict the dynamics under varying parameters and inputs. In this work, we develop an adaptive, projection-based surrogate model for cardiac electrophysiology. We introduce an a posteriori error estimator that can accurately and efficiently quantify the accuracy of the surrogate model. Using the error estimator, we systematically update our surrogate model through a greedy search of the parameter space. Furthermore, using the error estimator, the parameter search space is dynamically updated such that the most relevant samples get chosen at every iteration. The proposed adaptive surrogate modelling technique is tested on three benchmark models to illustrate its efficiency, accuracy, and ability of generalization.
△ Less
Submitted 10 November, 2023;
originally announced November 2023.
-
Accurate error estimation for model reduction of nonlinear dynamical systems via data-enhanced error closure
Authors:
Sridhar Chellappa,
Lihong Feng,
Peter Benner
Abstract:
Accurate error estimation is crucial in model order reduction, both to obtain small reduced-order models and to certify their accuracy when deployed in downstream applications such as digital twins. In existing a posteriori error estimation approaches, knowledge about the time integration scheme is mandatory, e.g., the residual-based error estimators proposed for the reduced basis method. This pos…
▽ More
Accurate error estimation is crucial in model order reduction, both to obtain small reduced-order models and to certify their accuracy when deployed in downstream applications such as digital twins. In existing a posteriori error estimation approaches, knowledge about the time integration scheme is mandatory, e.g., the residual-based error estimators proposed for the reduced basis method. This poses a challenge when automatic ordinary differential equation solver libraries are used to perform the time integration. To address this, we present a data-enhanced approach for a posteriori error estimation. Our new formulation enables residual-based error estimators to be independent of any time integration method. To achieve this, we introduce a corrected reduced-order model which takes into account a data-driven closure term for improved accuracy. The closure term, subject to mild assumptions, is related to the local truncation error of the corresponding time integration scheme. We propose efficient computational schemes for approximating the closure term, at the cost of a modest amount of training data. Furthermore, the new error estimator is incorporated within a greedy process to obtain parametric reduced-order models. Numerical results on three different systems show the accuracy of the proposed error estimation approach and its ability to produce ROMs that generalize well.
△ Less
Submitted 20 July, 2023;
originally announced July 2023.
-
Fast A Posteriori State Error Estimation for Reliable Frequency Swee** in Microwave Circuits via the Reduced-Basis Method
Authors:
Valentin de la Rubia,
Sridhar Chellappa,
Lihong Feng,
Peter Benner
Abstract:
We develop a compact, reliable model order reduction approach for fast frequency sweeps in microwave circuits by means of the reduced-basis method. Contrary to what has been previously done, special emphasis is placed on certifying the accuracy of the reduced-order model with respect to the original full-order model in an effective and efficient way. Previous works on model order reduction accurac…
▽ More
We develop a compact, reliable model order reduction approach for fast frequency sweeps in microwave circuits by means of the reduced-basis method. Contrary to what has been previously done, special emphasis is placed on certifying the accuracy of the reduced-order model with respect to the original full-order model in an effective and efficient way. Previous works on model order reduction accuracy certification rely on costly $\textit{a posteriori}$ error estimators, which typically require expensive $\textit{inf-sup}$ constant evaluations of the underlying full-order model. This scenario is often too time-consuming and unaffordable in electromagnetic applications. As a result, less expensive and heuristic error estimators are commonly used instead. Very often, one is interested in knowing about the full state vector, instead of just some output quantities derived from the full state. Therefore, error estimators for the full state vector become relevant. In this work, we detail the frequency behavior of both the electric field and the state error when an approximation to the electric field solution is carried out. Both field quantities share the same frequency behavior. Based on this observation, we focus on the efficient estimation of the electric field state error and propose a fast evaluation of the reduced-order model state error in the frequency band of analysis, minimizing the number of full-order model evaluations. This methodology is of paramount importance to carry out a reliable fast frequency sweep in microwave circuits. Finally, real-life applications will illustrate the capabilities and efficiency of the proposed approach.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
Inf-Sup-Constant-Free State Error Estimator for Model Order Reduction of Parametric Systems in Electromagnetics
Authors:
Sridhar Chellappa,
Lihong Feng,
Valentin de la Rubia,
Peter Benner
Abstract:
A reliable model order reduction process for parametric analysis in electromagnetics is detailed. Special emphasis is placed on certifying the accuracy of the reduced-order model. For this purpose, a sharp state error estimator is proposed. Standard a posteriori state error estimation for model order reduction relies on the inf-sup constant. For parametric systems, the inf-sup constant is paramete…
▽ More
A reliable model order reduction process for parametric analysis in electromagnetics is detailed. Special emphasis is placed on certifying the accuracy of the reduced-order model. For this purpose, a sharp state error estimator is proposed. Standard a posteriori state error estimation for model order reduction relies on the inf-sup constant. For parametric systems, the inf-sup constant is parameter-dependent. The a posteriori error estimation for systems with very small or vanishing inf-sup constant poses a challenge, since it is inversely proportional to the inf-sup constant, resulting in rather useless, overly pessimistic error estimators. Such systems appear in electromagnetics since the inf-sup constant values are close to zero at points close to resonant frequencies, where they eventually vanish. We propose a novel a posteriori state error estimator which avoids the calculation of the inf-sup constant. The proposed state error estimator is compared with the standard error estimator and a recently proposed one in the literature. It is shown that our proposed error estimator outperforms both existing estimators. Numerical experiments are performed on real-life microwave devices such as narrowband and wideband antennas, two types of dielectric resonator filters as well as a dual-mode waveguide filter. These examples show the capabilities and efficiency of the proposed methodology.
△ Less
Submitted 2 April, 2023; v1 submitted 26 April, 2021;
originally announced April 2021.
-
A Training Set Subsampling Strategy for the Reduced Basis Method
Authors:
Sridhar Chellappa,
Lihong Feng,
Peter Benner
Abstract:
We present a subsampling strategy for the offline stage of the Reduced Basis Method. The approach is aimed at bringing down the considerable offline costs associated with using a finely-sampled training set. The proposed algorithm exploits the potential of the pivoted QR decomposition and the discrete empirical interpolation method to identify important parameter samples. It consists of two stages…
▽ More
We present a subsampling strategy for the offline stage of the Reduced Basis Method. The approach is aimed at bringing down the considerable offline costs associated with using a finely-sampled training set. The proposed algorithm exploits the potential of the pivoted QR decomposition and the discrete empirical interpolation method to identify important parameter samples. It consists of two stages. In the first stage, we construct a low-fidelity approximation to the solution manifold over a fine training set. Then, for the available low-fidelity snapshots of the output variable, we apply the pivoted QR decomposition or the discrete empirical interpolation method to identify a set of sparse sampling locations in the parameter domain. These points reveal the structure of the parametric dependence of the output variable. The second stage proceeds with a subsampled training set containing a by far smaller number of parameters than the initial training set. Different subsampling strategies inspired from recent variants of the empirical interpolation method are also considered. Tests on benchmark examples justify the new approach and show its potential to substantially speed up the offline stage of the Reduced Basis Method, while generating reliable reduced-order models.
△ Less
Submitted 1 October, 2021; v1 submitted 10 March, 2021;
originally announced March 2021.
-
Adaptive Interpolatory MOR by Learning the Error Estimator in the Parameter Domain
Authors:
Sridhar Chellappa,
Lihong Feng,
Valentin de la Rubia,
Peter Benner
Abstract:
Interpolatory methods offer a powerful framework for generating reduced-order models (ROMs) for non-parametric or parametric systems with time-varying inputs. Choosing the interpolation points adaptively remains an area of active interest. A greedy framework has been introduced in Feng et al. [ESAIM: Math. Model. Numer. Anal. 51(6), 2017] and in Feng and Benner [IEEE Trans. Microw. Theory Techn. 6…
▽ More
Interpolatory methods offer a powerful framework for generating reduced-order models (ROMs) for non-parametric or parametric systems with time-varying inputs. Choosing the interpolation points adaptively remains an area of active interest. A greedy framework has been introduced in Feng et al. [ESAIM: Math. Model. Numer. Anal. 51(6), 2017] and in Feng and Benner [IEEE Trans. Microw. Theory Techn. 67(12), 2019] to choose interpolation points automatically using a posteriori error estimators. Nevertheless, when the parameter range is large or if the parameter space dimension is larger than two, the greedy algorithm may take considerable time, since the training set needs to include a considerable number of parameters. As a remedy, we introduce an adaptive training technique by learning an efficient a posteriori error estimator over the parameter domain. A fast learning process is created by interpolating the error estimator using radial basis functions (RBF) over a fine parameter training set, representing the whole parameter domain. The error estimator is evaluated only on a coarse training set including a few parameter samples. The algorithm is an extension of the work in Chellappa et al. [arXiv e-prints 1910.00298] to interpolatory model order reduction (MOR) in frequency domain. Beyond this work, we use a newly proposed inf-sup-constant-free error estimator in the frequency domain, which is often much tighter than the error estimator using the inf-sup constant.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
-
Adaptive Basis Construction and Improved Error Estimation for Parametric Nonlinear Dynamical Systems
Authors:
Sridhar Chellappa,
Lihong Feng,
Peter Benner
Abstract:
An adaptive scheme to generate reduced-order models for parametric nonlinear dynamical systems is proposed. It aims to automatize the POD-Greedy algorithm combined with empirical interpolation. At each iteration, it is able to adaptively determine the number of the reduced basis vectors and the number of the interpolation basis vectors for basis construction. The proposed technique is able to deri…
▽ More
An adaptive scheme to generate reduced-order models for parametric nonlinear dynamical systems is proposed. It aims to automatize the POD-Greedy algorithm combined with empirical interpolation. At each iteration, it is able to adaptively determine the number of the reduced basis vectors and the number of the interpolation basis vectors for basis construction. The proposed technique is able to derive a suitable match between the reduced basis and the interpolation basis vectors, making the generation of a stable, compact and reliable reduced-order model possible. This is achieved by adaptively adding new basis vectors or removing unnecessary ones, at each iteration of the greedy algorithm. An efficient output error indicator plays a key role in the adaptive scheme. We also propose an improved output error indicator based on previous work. Upon convergence of the POD-Greedy algorithm, the new error indicator is shown to be sharper than the existing ones, implicating that a more reliable reduced-order model can be constructed. The proposed method is tested on several nonlinear dynamical systems, namely, the viscous Burgers' equation and two other models from chemical engineering.
△ Less
Submitted 13 June, 2020; v1 submitted 12 November, 2019;
originally announced November 2019.
-
An Adaptive Sampling Approach for the Reduced Basis Method
Authors:
Sridhar Chellappa,
Lihong Feng,
Peter Benner
Abstract:
The offline time of the reduced basis method can be very long given a large training set of parameter samples. This usually happens when the system has more than two independent parameters. On the other hand, if the training set includes fewer parameter samples, the greedy algorithm might produce a reduced-order model with large errors at the samples outside of the training set. We introduce a met…
▽ More
The offline time of the reduced basis method can be very long given a large training set of parameter samples. This usually happens when the system has more than two independent parameters. On the other hand, if the training set includes fewer parameter samples, the greedy algorithm might produce a reduced-order model with large errors at the samples outside of the training set. We introduce a method based on a surrogate error model to efficiently sample the parameter domain such that the training set is adaptively updated starting from a coarse set with a small number of parameter samples. A sharp a posteriori error estimator is evaluated on a coarse training set. Radial Basis Functions are used to interpolate the error estimator over a separate fine training set. Points from the fine training set are added into the coarse training set at every iteration based on a user defined criterion. In parallel, parameter samples satisfying a defined tolerance are adaptively removed from the coarse training set. The approach is shown to avoid high computational costs by using a small training set and to provide a reduced-order model with guaranteed accuracy over a fine training set. Further, we show numerical evidence that the reduced-order model meets the defined tolerance over an independently sampled test set from the parameter domain.
△ Less
Submitted 13 August, 2020; v1 submitted 1 October, 2019;
originally announced October 2019.
