-
Greedy Kernel Methods for Approximating Breakthrough Curves for Reactive Flow from 3D Porous Geometry Data
Authors:
Robin Herkert,
Patrick Buchfink,
Tizian Wenzel,
Bernard Haasdonk,
Pavel Toktaliev,
Oleg Iliev
Abstract:
We address the challenging application of 3D pore scale reactive flow under varying geometry parameters. The task is to predict time-dependent integral quantities, i.e., breakthrough curves, from the given geometries. As the 3D reactive flow simulation is highly complex and computationally expensive, we are interested in data-based surrogates that can give a rapid prediction of the target quantiti…
▽ More
We address the challenging application of 3D pore scale reactive flow under varying geometry parameters. The task is to predict time-dependent integral quantities, i.e., breakthrough curves, from the given geometries. As the 3D reactive flow simulation is highly complex and computationally expensive, we are interested in data-based surrogates that can give a rapid prediction of the target quantities of interest. This setting is an example of an application with scarce data, i.e., only having available few data samples, while the input and output dimensions are high. In this scarce data setting, standard machine learning methods are likely to ail. Therefore, we resort to greedy kernel approximation schemes that have shown to be efficient meshless approximation techniques for multivariate functions. We demonstrate that such methods can efficiently be used in the high-dimensional input/output case under scarce data. Especially, we show that the vectorial kernel orthogonal greedy approximation (VKOGA) procedure with a data-adapted two-layer kernel yields excellent predictors for learning from 3D geometry voxel data via both morphological descriptors or principal component analysis.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
Error Analysis of Randomized Symplectic Model Order Reduction for Hamiltonian systems
Authors:
Robin Herkert,
Patrick Buchfink,
Bernard Haasdonk,
Johannes Rettberg,
Jörg Fehr
Abstract:
Solving high-dimensional dynamical systems in multi-query or real-time applications requires efficient surrogate modelling techniques, as e.g., achieved via model order reduction (MOR). If these systems are Hamiltonian systems their physical structure should be preserved during the reduction, which can be ensured by applying symplectic basis generation techniques such as the complex SVD (cSVD). Re…
▽ More
Solving high-dimensional dynamical systems in multi-query or real-time applications requires efficient surrogate modelling techniques, as e.g., achieved via model order reduction (MOR). If these systems are Hamiltonian systems their physical structure should be preserved during the reduction, which can be ensured by applying symplectic basis generation techniques such as the complex SVD (cSVD). Recently, randomized symplectic methods such as the randomized complex singular value decomposition (rcSVD) have been developed for a more efficient computation of symplectic bases that preserve the Hamiltonian structure during MOR. In the current paper, we present two error bounds for the rcSVD basis depending on the choice of hyperparameters and show that with a proper choice of hyperparameters, the projection error of rcSVD is at most a constant factor worse than the projection error of cSVD. We provide numerical experiments that demonstrate the efficiency of randomized symplectic basis generation and compare the bounds numerically.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
Model reduction on manifolds: A differential geometric framework
Authors:
Patrick Buchfink,
Silke Glas,
Bernard Haasdonk,
Benjamin Unger
Abstract:
Using nonlinear projections and preserving structure in model order reduction (MOR) are currently active research fields. In this paper, we provide a novel differential geometric framework for model reduction on smooth manifolds, which emphasizes the geometric nature of the objects involved. The crucial ingredient is the construction of an embedding for the low-dimensional submanifold and a compat…
▽ More
Using nonlinear projections and preserving structure in model order reduction (MOR) are currently active research fields. In this paper, we provide a novel differential geometric framework for model reduction on smooth manifolds, which emphasizes the geometric nature of the objects involved. The crucial ingredient is the construction of an embedding for the low-dimensional submanifold and a compatible reduction map, for which we discuss several options. Our general framework allows capturing and generalizing several existing MOR techniques, such as structure preservation for Lagrangian- or Hamiltonian dynamics, and using nonlinear projections that are, for instance, relevant in transport-dominated problems. The joint abstraction can be used to derive shared theoretical properties for different methods, such as an exact reproduction result. To connect our framework to existing work in the field, we demonstrate that various techniques for data-driven construction of nonlinear projections can be included in our framework.
△ Less
Submitted 2 April, 2024; v1 submitted 4 December, 2023;
originally announced December 2023.
-
Approximation Bounds for Model Reduction on Polynomially Mapped Manifolds
Authors:
Patrick Buchfink,
Silke Glas,
Bernard Haasdonk
Abstract:
For projection-based linear-subspace model order reduction (MOR), it is well known that the Kolmogorov n-width describes the best-possible error for a reduced order model (ROM) of size n. In this paper, we provide approximation bounds for ROMs on polynomially mapped manifolds. In particular, we show that the approximation bounds depend on the polynomial degree p of the map** function as well as…
▽ More
For projection-based linear-subspace model order reduction (MOR), it is well known that the Kolmogorov n-width describes the best-possible error for a reduced order model (ROM) of size n. In this paper, we provide approximation bounds for ROMs on polynomially mapped manifolds. In particular, we show that the approximation bounds depend on the polynomial degree p of the map** function as well as on the linear Kolmogorov n-width for the underlying problem. This results in a Kolmogorov (n, p)-width, which describes a lower bound for the best-possible error for a ROM on polynomially mapped manifolds of polynomial degree p and reduced size n.
△ Less
Submitted 1 December, 2023;
originally announced December 2023.
-
On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces
Authors:
Gabriele Santin,
Tizian Wenzel,
Bernard Haasdonk
Abstract:
Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces.
In the context of interpolation, the selection of optimal function sampling locations is a central problem, both from a practical perspective, and as an interesting theoretical question. Greedy int…
▽ More
Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces.
In the context of interpolation, the selection of optimal function sampling locations is a central problem, both from a practical perspective, and as an interesting theoretical question. Greedy interpolation algorithms provide a viable solution for this task, being efficient to run and provably accurate in their approximation.
In this paper we close a gap that is present in the convergence theory for these algorithms by employing a recent result on general greedy algorithms. This modification leads to new convergence rates which match the optimal ones when restricted to the $P$-greedy target-data-independent selection rule, and can additionally be proven to be optimal when they fully exploit adaptivity ($f$-greedy).
Other than closing this gap, the new results have some significance in the broader setting of the optimality of general approximation algorithms in Reproducing Kernel Hilbert Spaces, as they allow us to compare adaptive interpolation with non-adaptive best nonlinear approximation.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
Hermite kernel surrogates for the value function of high-dimensional nonlinear optimal control problems
Authors:
Tobias Ehring,
Bernard Haasdonk
Abstract:
Numerical methods for the optimal feedback control of high-dimensional dynamical systems typically suffer from the curse of dimensionality. In the current presentation, we devise a mesh-free data-based approximation method for the value function of optimal control problems, which partially mitigates the dimensionality problem. The method is based on a greedy Hermite kernel interpolation scheme and…
▽ More
Numerical methods for the optimal feedback control of high-dimensional dynamical systems typically suffer from the curse of dimensionality. In the current presentation, we devise a mesh-free data-based approximation method for the value function of optimal control problems, which partially mitigates the dimensionality problem. The method is based on a greedy Hermite kernel interpolation scheme and incorporates context-knowledge by its structure. Especially, the value function surrogate is elegantly enforced to be 0 in the target state, non-negative and constructed as a correction of a linearized model. The algorithm is proposed in a matrix-free way, which circumvents the large-matrix-problem for multivariate Hermite interpolation. For finite time horizons, both convergence of the surrogate to the value function as well as for the surrogate vs. the optimal controlled dynamical system are proven. Experiments support the effectiveness of the scheme, using among others a new academic model that has a scalable dimension and an explicitly given value function. It may also be useful for the community to validate other optimal control approaches.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
Dictionary-based Online-adaptive Structure-preserving Model Order Reduction for Parametric Hamiltonian Systems
Authors:
Robin Herkert,
Patrick Buchfink,
Bernard Haasdonk
Abstract:
Classical model order reduction (MOR) for parametric problems may become computationally inefficient due to large sizes of the required projection bases, especially for problems with slowly decaying Kolmogorov n-widths. Additionally, Hamiltonian structure of dynamical systems may be available and should be preserved during the reduction. In the current presentation, we address these two aspects by…
▽ More
Classical model order reduction (MOR) for parametric problems may become computationally inefficient due to large sizes of the required projection bases, especially for problems with slowly decaying Kolmogorov n-widths. Additionally, Hamiltonian structure of dynamical systems may be available and should be preserved during the reduction. In the current presentation, we address these two aspects by proposing a corresponding dictionary-based, online-adaptive MOR approach. The method requires dictionaries for the state-variable, non-linearities and discrete empirical interpolation (DEIM) points. During the online simulation, local basis extensions/simplifications are performed in an online-efficient way, i.e. the runtime complexity of basis modifications and online simulation of the reduced models do not depend on the full state dimension. Experiments on a linear wave equation and a non-linear Sine-Gordon example demonstrate the efficiency of the approach.
△ Less
Submitted 31 March, 2023;
originally announced March 2023.
-
Improved a posteriori Error Bounds for Reduced port-Hamiltonian Systems
Authors:
Johannes Rettberg,
Dominik Wittwar,
Patrick Buchfink,
Robin Herkert,
Jörg Fehr,
Bernard Haasdonk
Abstract:
Projection-based model order reduction of dynamical systems usually introduces an error between the high-fidelity model and its counterpart of lower dimension. This unknown error can be bounded by residual-based methods, which are typically known to be highly pessimistic in the sense of largely overestimating the true error. This work applies two improved error bounding techniques, namely (a) a hi…
▽ More
Projection-based model order reduction of dynamical systems usually introduces an error between the high-fidelity model and its counterpart of lower dimension. This unknown error can be bounded by residual-based methods, which are typically known to be highly pessimistic in the sense of largely overestimating the true error. This work applies two improved error bounding techniques, namely (a) a hierarchical error bound and (b) an error bound based on an auxiliary linear problem, to the case of port-Hamiltonian systems. The approaches rely on a second approximation of (a) the dynamical system and (b) the error system. In this paper, these methods are for the first time adapted to port-Hamiltonian systems by exploiting their structure. The mathematical relationship between the two methods is discussed both, theoretically and numerically. The effectiveness of the described methods is demonstrated using a challenging three-dimensional port-Hamiltonian model of a classical guitar with fluid-structure interaction.
△ Less
Submitted 30 March, 2023;
originally announced March 2023.
-
Randomized Symplectic Model Order Reduction for Hamiltonian Systems
Authors:
Robin Herkert,
Patrick Buchfink,
Bernard Haasdonk,
Johannes Rettberg,
Jörg Fehr
Abstract:
Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular value decomposition (cSVD) or the SVD-like decomposition have been developed for preserving Hamiltonian structure during MOR. In the current contribution, we show…
▽ More
Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular value decomposition (cSVD) or the SVD-like decomposition have been developed for preserving Hamiltonian structure during MOR. In the current contribution, we show how symplectic structure preserving basis generation can be made more efficient with randomized matrix factorizations. We present a randomized complex SVD (rcSVD) algorithm and a randomized SVD-like (rSVD-like) decomposition. We demonstrate the efficiency of the approaches with numerical experiments on high dimensional systems.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Application of Deep Kernel Models for Certified and Adaptive RB-ML-ROM Surrogate Modeling
Authors:
Tizian Wenzel,
Bernard Haasdonk,
Hendrik Kleikamp,
Mario Ohlberger,
Felix Schindler
Abstract:
In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial differential equations. This adaptive approach combines a full order model, a reduced order model and a machine-learning model. In this contribution, we extend the ap…
▽ More
In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial differential equations. This adaptive approach combines a full order model, a reduced order model and a machine-learning model. In this contribution, we extend the approach by leveraging novel kernel models for the machine learning part, especially structured deep kernel networks as well as two layered kernel models. We demonstrate the usability of those enhanced kernel models for the RB-ML-ROM surrogate modeling chain and highlight their benefits in numerical experiments.
△ Less
Submitted 28 February, 2023;
originally announced February 2023.
-
Adaptive meshfree approximation for linear elliptic partial differential equations with PDE-greedy kernel methods
Authors:
Tizian Wenzel,
Daniel Winkle,
Gabriele Santin,
Bernard Haasdonk
Abstract:
We consider the meshless approximation for solutions of boundary value problems (BVPs) of elliptic Partial Differential Equations (PDEs) via symmetric kernel collocation. We discuss the importance of the choice of the collocation points, in particular by using greedy kernel methods. We introduce a scale of PDE-greedy selection criteria that generalizes existing techniques, such as the PDE-P -greed…
▽ More
We consider the meshless approximation for solutions of boundary value problems (BVPs) of elliptic Partial Differential Equations (PDEs) via symmetric kernel collocation. We discuss the importance of the choice of the collocation points, in particular by using greedy kernel methods. We introduce a scale of PDE-greedy selection criteria that generalizes existing techniques, such as the PDE-P -greedy and the PDE-f -greedy rules for collocation point selection. For these greedy selection criteria we provide bounds on the approximation error in terms of the number of greedily selected points and analyze the corresponding convergence rates. This is achieved by a novel analysis of Kolmogorov widths of special sets of BVP point-evaluation functionals. Especially, we prove that target-data dependent algorithms that make use of the right hand side functions of the BVP exhibit faster convergence rates than the target-data independent PDE-P -greedy. The convergence rate of the PDE-f -greedy possesses a dimension independent rate, which makes it amenable to mitigate the curse of dimensionality. The advantages of these greedy algorithms are highlighted by numerical examples.
△ Less
Submitted 1 July, 2024; v1 submitted 28 July, 2022;
originally announced July 2022.
-
A new certified hierarchical and adaptive RB-ML-ROM surrogate model for parametrized PDEs
Authors:
B. Haasdonk,
H. Kleikamp,
M. Ohlberger,
F. Schindler,
T. Wenzel
Abstract:
We present a new surrogate modeling technique for efficient approximation of input-output maps governed by parametrized PDEs. The model is hierarchical as it is built on a full order model (FOM), reduced order model (ROM) and machine-learning (ML) model chain. The model is adaptive in the sense that the ROM and ML model are adapted on-the-fly during a sequence of parametric requests to the model.…
▽ More
We present a new surrogate modeling technique for efficient approximation of input-output maps governed by parametrized PDEs. The model is hierarchical as it is built on a full order model (FOM), reduced order model (ROM) and machine-learning (ML) model chain. The model is adaptive in the sense that the ROM and ML model are adapted on-the-fly during a sequence of parametric requests to the model. To allow for a certification of the model hierarchy, as well as to control the adaptation process, we employ rigorous a posteriori error estimates for the ROM and ML models. In particular, we provide an example of an ML-based model that allows for rigorous analytical quality statements. We demonstrate the efficiency of the modeling chain on a Monte Carlo and a parameter-optimization example. Here, the ROM is instantiated by Reduced Basis Methods and the ML model is given by a neural network or a VKOGA kernel model.
△ Less
Submitted 2 December, 2022; v1 submitted 28 April, 2022;
originally announced April 2022.
-
Stability of convergence rates: Kernel interpolation on non-Lipschitz domains
Authors:
Tizian Wenzel,
Gabriele Santin,
Bernard Haasdonk
Abstract:
Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian kernel.
In this paper we leverage an analysis of greedy kernel algorithms to prove that it is possible to obtain convergence results (in the number of interpolatio…
▽ More
Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian kernel.
In this paper we leverage an analysis of greedy kernel algorithms to prove that it is possible to obtain convergence results (in the number of interpolation points) for kernel interpolation for arbitrary domains $Ω\subset \mathbb{R}^d$, thus allowing for non-Lipschitz domains including e.g. cusps and irregular boundaries. Especially we show that, when going to a smaller domain $\tildeΩ \subset Ω\subset \mathbb{R}^d$, the convergence rate does not deteriorate - i.e. the convergence rates are stable with respect to going to a subset.
The impact of this result is explained on the examples of kernels of finite as well as infinite smoothness like the Gaussian kernel. A comparison to approximation in Sobolev spaces is drawn, where the shape of the domain $Ω$ has an impact on the approximation properties. Numerical experiments illustrate and confirm the experiments.
△ Less
Submitted 12 July, 2023; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Port-Hamiltonian Fluid-Structure Interaction Modeling and Structure-Preserving Model Order Reduction of a Classical Guitar
Authors:
Johannes Rettberg,
Dominik Wittwar,
Patrick Buchfink,
Alexander Brauchler,
Pascal Ziegler,
Jörg Fehr,
Bernard Haasdonk
Abstract:
A fluid-structure interaction model in a port-Hamiltonian representation is derived for a classical guitar. We combine the laws of continuum mechanics for solids and fluids within a unified port-Hamiltonian (pH) modeling approach by adapting the discretized equations on second-order level in order to obtain a damped multi-physics model. The high-dimensionality of the resulting system is reduced by…
▽ More
A fluid-structure interaction model in a port-Hamiltonian representation is derived for a classical guitar. We combine the laws of continuum mechanics for solids and fluids within a unified port-Hamiltonian (pH) modeling approach by adapting the discretized equations on second-order level in order to obtain a damped multi-physics model. The high-dimensionality of the resulting system is reduced by model order reduction. The article focuses on pH-systems in different state transformations, a variety of basis generation techniques as well as structure-preserving model order reduction approaches that are independent from the projection basis. As main contribution a thorough comparison of these method combinations is conducted. In contrast to typical frequency-based simulations in acoustics, transient time simulations of the system are presented. The approach is embedded into a straightforward workflow of sophisticated commercial software modeling and flexible in-house software for multi-physics coupling and model order reduction.
△ Less
Submitted 18 March, 2022;
originally announced March 2022.
-
Symplectic Model Reduction of Hamiltonian Systems on Nonlinear Manifolds
Authors:
Patrick Buchfink,
Silke Glas,
Bernard Haasdonk
Abstract:
Classical model reduction techniques project the governing equations onto linear subspaces of the high-dimensional state-space. For problems with slowly decaying Kolmogorov-n-widths such as certain transport-dominated problems, however, classical linear-subspace reduced-order models (ROMs) of low dimension might yield inaccurate results. Thus, the concept of classical linear-subspace ROMs has to b…
▽ More
Classical model reduction techniques project the governing equations onto linear subspaces of the high-dimensional state-space. For problems with slowly decaying Kolmogorov-n-widths such as certain transport-dominated problems, however, classical linear-subspace reduced-order models (ROMs) of low dimension might yield inaccurate results. Thus, the concept of classical linear-subspace ROMs has to be extended to more general concepts, like Model Order Reduction (MOR) on manifolds. Moreover, as we are dealing with Hamiltonian systems, it is crucial that the underlying symplectic structure is preserved in the reduced model, as otherwise it could become unphysical in the sense that the energy is not conserved or stability properties are lost. To the best of our knowledge, existing literature addresses either MOR on manifolds or symplectic model reduction for Hamiltonian systems, but not their combination. In this work, we bridge the two aforementioned approaches by providing a novel projection technique called symplectic manifold Galerkin (SMG), which projects the Hamiltonian system onto a nonlinear symplectic trial manifold such that the reduced model is again a Hamiltonian system. We derive analytical results such as stability, energy-preservation and a rigorous a-posteriori error bound. Moreover, we construct a weakly symplectic deep convolutional autoencoder as a computationally practical approach to approximate a nonlinear symplectic trial manifold. Finally, we numerically demonstrate the ability of the method to outperform (non-)structure-preserving linear-subspace ROMs and non-structure-preserving MOR on manifold techniques.
△ Less
Submitted 20 December, 2021;
originally announced December 2021.
-
An adaptive model hierarchy for data-augmented training of kernel models for reactive flow
Authors:
Bernard Haasdonk,
Mario Ohlberger,
Felix Schindler
Abstract:
We consider machine-learning of time-dependent quantities of interest derived from solution trajectories of parabolic partial differential equations. For large-scale or long-time integration scenarios, where using a full order model (FOM) to generate sufficient training data is computationally prohibitive, we propose an adaptive hierarchy of intermediate Reduced Basis reduced order models (ROM) to…
▽ More
We consider machine-learning of time-dependent quantities of interest derived from solution trajectories of parabolic partial differential equations. For large-scale or long-time integration scenarios, where using a full order model (FOM) to generate sufficient training data is computationally prohibitive, we propose an adaptive hierarchy of intermediate Reduced Basis reduced order models (ROM) to augment the FOM training data by certified ROM training data required to fit a kernel model.
△ Less
Submitted 29 April, 2022; v1 submitted 24 October, 2021;
originally announced October 2021.
-
Analysis of target data-dependent greedy kernel algorithms: Convergence rates for $f$-, $f \cdot P$- and $f/P$-greedy
Authors:
Tizian Wenzel,
Gabriele Santin,
Bernard Haasdonk
Abstract:
Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory especially when compared to the case of the data-independent $P$-greedy algorithm, for which optimal convergence rates are av…
▽ More
Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory especially when compared to the case of the data-independent $P$-greedy algorithm, for which optimal convergence rates are available, despite its performances being usually inferior to the ones of target data-dependent algorithms.
In this work we fill this gap by first defining a new scale of greedy algorithms for interpolation that comprises all the existing ones in a unique analysis, where the degree of dependency of the selection criterion on the functional data is quantified by a real parameter. We then prove new convergence rates where this degree is taken into account and we show that, possibly up to a logarithmic factor, target data-dependent selection strategies provide faster convergence.
In particular, for the first time we obtain convergence rates for target data adaptive interpolation that are faster than the ones given by uniform points, without the need of any special assumption on the target function. The rates are confirmed by a number of examples.
These results are made possible by a new analysis of greedy algorithms in general Hilbert spaces.
△ Less
Submitted 16 May, 2021;
originally announced May 2021.
-
A full order, reduced order and machine learning model pipeline for efficient prediction of reactive flows
Authors:
Pavel Gavrilenko,
Bernard Haasdonk,
Oleg Iliev,
Mario Ohlberger,
Felix Schindler,
Pavel Toktaliev,
Tizian Wenzel,
Maha Youssef
Abstract:
We present an integrated approach for the use of simulated data from full order discretization as well as projection-based Reduced Basis reduced order models for the training of machine learning approaches, in particular Kernel Methods, in order to achieve fast, reliable predictive models for the chemical conversion rate in reactive flows with varying transport regimes.
We present an integrated approach for the use of simulated data from full order discretization as well as projection-based Reduced Basis reduced order models for the training of machine learning approaches, in particular Kernel Methods, in order to achieve fast, reliable predictive models for the chemical conversion rate in reactive flows with varying transport regimes.
△ Less
Submitted 29 April, 2022; v1 submitted 6 April, 2021;
originally announced April 2021.
-
Reduced Basis Methods for Efficient Simulation of a Rigid Robot Hand Interacting with Soft Tissue
Authors:
Shahnewaz Shuva,
Patrick Buchfink,
Oliver Röhrle,
Bernard Haasdonk
Abstract:
We present efficient reduced basis (RB) methods for the simulation of the coupled problem consisting of a rigid robot hand interacting with soft tissue material which is modeled by the linear elasticity equation and discretized with the Finite Element Method. We look at two different scenarios: (i) the forward simulation and (ii) a feedback control formulation of the model. In both cases, large-sc…
▽ More
We present efficient reduced basis (RB) methods for the simulation of the coupled problem consisting of a rigid robot hand interacting with soft tissue material which is modeled by the linear elasticity equation and discretized with the Finite Element Method. We look at two different scenarios: (i) the forward simulation and (ii) a feedback control formulation of the model. In both cases, large-scale systems of equations appear, which need to be solved in real-time. This is essential in practice for the implementation in a real robot. For the feedback-scenario, in the context of the linear quadratic regulator, we encounter a high-dimensional Algebraic Riccati Equation (ARE). To overcome the real-time constraint by significantly reducing the computational complexity, we use several structure-preserving and non-structure-preserving reduction methods. These include proper orthogonal decomposition-based reduced basis techniques. For the ARE, instead of solving a full dimensional problem we compute a low-rank-factor and hence a low-dimensional ARE is solved. Numerical examples for both cases are provided. These illustrate the approximation quality of the reduced solution and speedup factors of the different reduction approaches.
△ Less
Submitted 7 June, 2021; v1 submitted 29 March, 2021;
originally announced March 2021.
-
Structured Deep Kernel Networks for Data-Driven Closure Terms of Turbulent Flows
Authors:
Tizian Wenzel,
Marius Kurz,
Andrea Beck,
Gabriele Santin,
Bernard Haasdonk
Abstract:
Standard kernel methods for machine learning usually struggle when dealing with large datasets. We review a recently introduced Structured Deep Kernel Network (SDKN) approach that is capable of dealing with high-dimensional and huge datasets - and enjoys typical standard machine learning approximation properties. We extend the SDKN to combine it with standard machine learning modules and compare i…
▽ More
Standard kernel methods for machine learning usually struggle when dealing with large datasets. We review a recently introduced Structured Deep Kernel Network (SDKN) approach that is capable of dealing with high-dimensional and huge datasets - and enjoys typical standard machine learning approximation properties. We extend the SDKN to combine it with standard machine learning modules and compare it with Neural Networks on the scientific challenge of data-driven prediction of closure terms of turbulent flows. We show experimentally that the SDKNs are capable of dealing with large datasets and achieve near-perfect accuracy on the given application.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
Kernel methods for center manifold approximation and a data-based version of the Center Manifold Theorem
Authors:
Bernard Haasdonk,
Boumediene Hamzi,
Gabriele Santin,
Dominik Wittwar
Abstract:
For dynamical systems with a non hyperbolic equilibrium, it is possible to significantly simplify the study of stability by means of the center manifold theory. This theory allows to isolate the complicated asymptotic behavior of the system close to the equilibrium point and to obtain meaningful predictions of its behavior by analyzing a reduced order system on the so-called center manifold.
Sin…
▽ More
For dynamical systems with a non hyperbolic equilibrium, it is possible to significantly simplify the study of stability by means of the center manifold theory. This theory allows to isolate the complicated asymptotic behavior of the system close to the equilibrium point and to obtain meaningful predictions of its behavior by analyzing a reduced order system on the so-called center manifold.
Since the center manifold is usually not known, good approximation methods are important as the center manifold theorem states that the stability properties of the origin of the reduced order system are the same as those of the origin of the full order system.
In this work, we establish a data-based version of the center manifold theorem that works by considering an approximation in place of an exact manifold. Also the error between the approximated and the original reduced dynamics are quantified.
We then use an apposite data-based kernel method to construct a suitable approximation of the manifold close to the equilibrium, which is compatible with our general error theory. The data are collected by repeated numerical simulation of the full system by means of a high-accuracy solver, which generates sets of discrete trajectories that are then used as a training set. The method is tested on different examples which show promising performance and good accuracy.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Biomechanical surrogate modelling using stabilized vectorial greedy kernel methods
Authors:
Bernard Haasdonk,
Tizian Wenzel,
Gabriele Santin,
Syn Schmitt
Abstract:
Greedy kernel approximation algorithms are successful techniques for sparse and accurate data-based modelling and function approximation. Based on a recent idea of stabilization of such algorithms in the scalar output case, we here consider the vectorial extension built on VKOGA. We introduce the so called $γ$-restricted VKOGA, comment on analytical properties and present numerical evaluation on d…
▽ More
Greedy kernel approximation algorithms are successful techniques for sparse and accurate data-based modelling and function approximation. Based on a recent idea of stabilization of such algorithms in the scalar output case, we here consider the vectorial extension built on VKOGA. We introduce the so called $γ$-restricted VKOGA, comment on analytical properties and present numerical evaluation on data from a clinically relevant application, the modelling of the human spine. The experiments show that the new stabilized algorithms result in improved accuracy and stability over the non-stabilized algorithms.
△ Less
Submitted 28 April, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
Sampling based approximation of linear functionals in Reproducing Kernel Hilbert Spaces
Authors:
Gabriele Santin,
Toni Karvonen,
Bernard Haasdonk
Abstract:
In this paper we analyze a greedy procedure to approximate a linear functional defined in a Reproducing Kernel Hilbert Space by nodal values. This procedure computes a quadrature rule which can be applied to general functionals, including integration functionals. For a large class of functionals, we prove convergence results for the approximation by means of uniform and greedy points which general…
▽ More
In this paper we analyze a greedy procedure to approximate a linear functional defined in a Reproducing Kernel Hilbert Space by nodal values. This procedure computes a quadrature rule which can be applied to general functionals, including integration functionals. For a large class of functionals, we prove convergence results for the approximation by means of uniform and greedy points which generalize in various ways several known results. A perturbation analysis of the weights and node computation is also discussed. Beyond the theoretical investigations, we demonstrate numerically that our algorithm is effective in treating various integration densities, and that it is even very competitive when compared to existing methods for Uncertainty Quantification.
△ Less
Submitted 1 April, 2020;
originally announced April 2020.
-
A novel class of stabilized greedy kernel approximation algorithms: Convergence, stability & uniform point distribution
Authors:
Tizian Wenzel,
Gabriele Santin,
Bernard Haasdonk
Abstract:
Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the sampling points. Since the computation of an optimal selection of sampling points may be an infeasible task, one promising option is to use greedy methods.
A…
▽ More
Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the sampling points. Since the computation of an optimal selection of sampling points may be an infeasible task, one promising option is to use greedy methods.
Although these methods may be very effective, depending on the specific greedy criterion the chosen points might quickly lead to instabilities in the computation. To circumvent this problem, we introduce and investigate a new class of \textit{stabilized} greedy kernel algorithms, which can be used to create a scale of new selection strategies.
We analyze these algorithms, and in particular we prove convergence results and quantify in a precise way the distribution of the selected points. These results allow to prove, in the case of certain Sobolev kernels, that the algorithms have optimal stability and optimal convergence rates, including for functions outside the native space of the kernel. The results also apply to the case of the usual $P$-greedy algorithm, significantly improving state-of-the-art results available in the literature. Illustrative experiments are presented that support the theoretical findings.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
-
Kernel Methods for Surrogate Modeling
Authors:
Gabriele Santin,
Bernard Haasdonk
Abstract:
This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent experimental performance and elegant functional analytic background. These data-based techniques provide so called kernel expansions, i.e., linear combinations of k…
▽ More
This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent experimental performance and elegant functional analytic background. These data-based techniques provide so called kernel expansions, i.e., linear combinations of kernel functions which are generated from given input-output point samples that may be arbitrarily scattered. In particular, these techniques are meshless, do not require or depend on a grid, hence are less prone to the curse of dimensionality, even for high-dimensional problems.
In contrast to projection-based model reduction, we do not necessarily assume a high-dimensional model, but a general function that models input-output behavior within some simulation context. This could be some micro-model in a multiscale-simulation, some submodel in a coupled system, some initialization function for solvers, coefficient function in PDEs, etc.
First, kernel surrogates can be useful if the input-output function is expensive to evaluate, e.g. is a result of a finite element simulation. Here, acceleration can be obtained by sparse kernel expansions. Second, if a function is available only via measurements or a few function evaluation samples, kernel approximation techniques can provide function surrogates that allow global evaluation.
We present some important kernel approximation techniques, which are kernel interpolation, greedy kernel approximation and support vector regression. Pseudo-code is provided for ease of reproducibility. In order to illustrate the main features, commonalities and differences, we compare these techniques on a real-world application. The experiments clearly indicate the enormous acceleration potential
△ Less
Submitted 24 July, 2019;
originally announced July 2019.
-
Symplectic Model Order Reduction with Non-Orthonormal Bases
Authors:
Patrick Buchfink,
Ashish Bhatt,
Bernard Haasdonk
Abstract:
Parametric high-fidelity simulations are of interest for a wide range of applications. But the restriction of computational resources renders such models to be inapplicable in a real-time context or in multi-query scenarios. Model order reduction (MOR) is used to tackle this issue. Recently, MOR is extended to preserve specific structures of the model throughout the reduction, e.g. structure-prese…
▽ More
Parametric high-fidelity simulations are of interest for a wide range of applications. But the restriction of computational resources renders such models to be inapplicable in a real-time context or in multi-query scenarios. Model order reduction (MOR) is used to tackle this issue. Recently, MOR is extended to preserve specific structures of the model throughout the reduction, e.g. structure-preserving MOR for Hamiltonian systems. This is referred to as symplectic MOR. It is based on the classical projection-based MOR and uses a symplectic reduced order basis (ROB). Such a ROB can be derived in a data-driven manner with the Proper Symplectic Decomposition (PSD) in the form of a minimization problem. Due to the strong nonlinearity of the minimization problem, it is unclear how to efficiently find a global optimum. In our paper, we show that current solution procedures almost exclusively yield suboptimal solutions by restricting to orthonormal ROBs. As new methodological contribution, we propose a new method which eliminates this restriction by generating non-orthonormal ROBs. In the numerical experiments, we examine the different techniques for a classical linear elasticity problem and observe that the non-orthonormal technique proposed in this paper shows superior results with respect to the error introduced by the reduction.
△ Less
Submitted 27 February, 2019;
originally announced February 2019.
-
Greedy Kernel Methods for Center Manifold Approximation
Authors:
Bernard Haasdonk,
Boumediene Hamzi,
Gabriele Santin,
Dominik Wittwar
Abstract:
For certain dynamical systems it is possible to significantly simplify the study of stability by means of the center manifold theory. This theory allows to isolate the complicated asymptotic behavior of the system close to a non-hyperbolic equilibrium point, and to obtain meaningful predictions of its behavior by analyzing a reduced dimensional problem. Since the manifold is usually not known, app…
▽ More
For certain dynamical systems it is possible to significantly simplify the study of stability by means of the center manifold theory. This theory allows to isolate the complicated asymptotic behavior of the system close to a non-hyperbolic equilibrium point, and to obtain meaningful predictions of its behavior by analyzing a reduced dimensional problem. Since the manifold is usually not known, approximation methods are of great interest to obtain qualitative estimates. In this work, we use a data-based greedy kernel method to construct a suitable approximation of the manifold close to the equilibrium. The data are collected by repeated numerical simulation of the full system by means of a high-accuracy solver, which generates sets of discrete trajectories that are then used to construct a surrogate model of the manifold. The method is tested on different examples which show promising performance and good accuracy.
△ Less
Submitted 30 October, 2018; v1 submitted 26 October, 2018;
originally announced October 2018.
-
Feedback control of parametrized PDEs via model order reduction and dynamic programming principle
Authors:
Alessandro Alla,
Bernard Haasdonk,
Andreas Schmidt
Abstract:
In this paper we investigate infinite horizon optimal control problems for parametrized partial differential equations. We are interested in feedback control via dynamic programming equations which is well-known to suffer from the curse of dimensionality. Thus, we apply parametric model order reduction techniques to construct low-dimensional subspaces with suitable information on the control probl…
▽ More
In this paper we investigate infinite horizon optimal control problems for parametrized partial differential equations. We are interested in feedback control via dynamic programming equations which is well-known to suffer from the curse of dimensionality. Thus, we apply parametric model order reduction techniques to construct low-dimensional subspaces with suitable information on the control problem, where the dynamic programming equations can be approximated. To guarantee a low number of basis functions, we combine recent basis generation methods and parameter partitioning techniques. Furthermore, we present a novel technique to construct nonuniform grids in the reduced domain, which is based on statistical information. Finally, we discuss numerical examples to illustrate the effectiveness of the proposed methods for PDEs in two space dimensions.
△ Less
Submitted 28 September, 2018;
originally announced October 2018.
-
Greedy regularized kernel interpolation
Authors:
Gabriele Santin,
Dominik Wittwar,
Bernard Haasdonk
Abstract:
Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some advantage over exact interpolation: one can obtain the same approximation order while solving a better conditioned linear system. This method is well suited also for n…
▽ More
Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some advantage over exact interpolation: one can obtain the same approximation order while solving a better conditioned linear system. This method is well suited also for noisy data values, where exact interpolation is not meaningful. Moreover, it allows more flexibility in the kernel choice, since approximation problems can be solved also for non strictly positive definite kernels. We discuss in this paper a greedy algorithm to compute a sparse approximation of the kernel regularized interpolant. This sparsity is a desirable property when the approximant is used as a surrogate of an expensive function, since the resulting model is fast to evaluate. Moreover, we derive convergence results for the approximation scheme, and we prove that a certain greedy selection rule produces asymptotically quasi-optimal error rates.
△ Less
Submitted 25 July, 2018;
originally announced July 2018.
-
Interpolation with uncoupled separable matrix-valued kernels
Authors:
Dominik Wittwar,
Gabriele Santin,
Bernard Haasdonk
Abstract:
In this paper we consider the problem of approximating vector-valued functions over a domain $Ω$. For this purpose, we use matrix-valued reproducing kernels, which can be related to Reproducing kernel Hilbert spaces of vectorial functions and which can be viewed as an extension to the scalar-valued case. These spaces seem promising, when modelling correlations between the target function component…
▽ More
In this paper we consider the problem of approximating vector-valued functions over a domain $Ω$. For this purpose, we use matrix-valued reproducing kernels, which can be related to Reproducing kernel Hilbert spaces of vectorial functions and which can be viewed as an extension to the scalar-valued case. These spaces seem promising, when modelling correlations between the target function components, as the components are not learned independently of one another. We focus on the interpolation with such matrix-valued kernels. We derive error bounds for the interpolation error in terms of a generalized power-function and we introduce a subclass of matrix-valued kernels whose power-functions can be traced back to the power-function of scalar-valued reproducing kernels. Finally, we apply these kind of kernels to some artificial data to illustrate the benefit of interpolation with matrix-valued kernels in comparison to a componentwise approach.
△ Less
Submitted 24 July, 2018;
originally announced July 2018.
-
Symplectic Model-Reduction with a Weighted Inner Product
Authors:
Babak Maboudi Afkham,
Ashish Bhatt,
Bernard Haasdonk,
Jan S. Hesthaven
Abstract:
In the recent years, considerable attention has been paid to preserving structures and invariants in reduced basis methods, in order to enhance the stability and robustness of the reduced system. In the context of Hamiltonian systems, symplectic model reduction seeks to construct a reduced system that preserves the symplectic symmetry of Hamiltonian systems. However, symplectic methods are based o…
▽ More
In the recent years, considerable attention has been paid to preserving structures and invariants in reduced basis methods, in order to enhance the stability and robustness of the reduced system. In the context of Hamiltonian systems, symplectic model reduction seeks to construct a reduced system that preserves the symplectic symmetry of Hamiltonian systems. However, symplectic methods are based on the standard Euclidean inner products and are not suitable for problems equipped with a more general inner product. In this paper, we generalize symplectic model reduction to allow for the norms and inner products that are most appropriate to the problem while preserving the symplectic symmetry of the Hamiltonian systems. To construct a reduced basis and accelerate the evaluation of nonlinear terms, a greedy generation of a symplectic basis is proposed. Furthermore, it is shown that the greedy approach yields a norm-bounded reduced basis. The accuracy and the stability of this model reduction technique are illustrated through the development of reduced models for a vibrating elastic beam and the sine-Gordon equation.
△ Less
Submitted 21 March, 2018;
originally announced March 2018.
-
Greedy kernel methods for accelerating implicit integrators for parametric ODEs
Authors:
T. Brünnette,
G. Santin,
B. Haasdonk
Abstract:
We present a novel acceleration method for the solution of parametric ODEs by single-step implicit solvers by means of greedy kernel-based surrogate models. In an offline phase, a set of trajectories is precomputed with a high-accuracy ODE solver for a selected set of parameter samples, and used to train a kernel model which predicts the next point in the trajectory as a function of the last one.…
▽ More
We present a novel acceleration method for the solution of parametric ODEs by single-step implicit solvers by means of greedy kernel-based surrogate models. In an offline phase, a set of trajectories is precomputed with a high-accuracy ODE solver for a selected set of parameter samples, and used to train a kernel model which predicts the next point in the trajectory as a function of the last one. This model is cheap to evaluate, and it is used in an online phase for new parameter samples to provide a good initialization point for the nonlinear solver of the implicit integrator. The accuracy of the surrogate reflects into a reduction of the number of iterations until convergence of the solver, thus providing an overall speedup of the full simulation. Interestingly, in addition to providing an acceleration, the accuracy of the solution is maintained, since the ODE solver is still used to guarantee the required precision. Although the method can be applied to a large variety of solvers and different ODEs, we will present in details its use with the Implicit Euler method for the solution of the Burgers equation, which results to be a meaningful test case to demonstrate the method's features.
△ Less
Submitted 22 February, 2018;
originally announced February 2018.
-
Numerical modelling of a peripheral arterial stenosis using dimensionally reduced models and kernel methods
Authors:
Tobias Köppl,
Gabriele Santin,
Bernard Haasdonk,
Rainer Helmig
Abstract:
In this work, we consider two kinds of model reduction techniques to simulate blood flow through the largest systemic arteries, where a stenosis is located in a peripheral artery i.e. in an artery that is located far away from the heart. For our simulations we place the stenosis in one of the tibial arteries belonging to the right lower leg (right post tibial artery). The model reduction technique…
▽ More
In this work, we consider two kinds of model reduction techniques to simulate blood flow through the largest systemic arteries, where a stenosis is located in a peripheral artery i.e. in an artery that is located far away from the heart. For our simulations we place the stenosis in one of the tibial arteries belonging to the right lower leg (right post tibial artery). The model reduction techniques that are used are on the one hand dimensionally reduced models (1-D and 0-D models, the so-called mixed-dimension model) and on the other hand surrogate models produced by kernel methods. Both methods are combined in such a way that the mixed-dimension models yield training data for the surrogate model, where the surrogate model is parametrised by the degree of narrowing of the peripheral stenosis. By means of a well-trained surrogate model, we show that simulation data can be reproduced with a satisfactory accuracy and that parameter optimisation or state estimation problems can be solved in a very efficient way. Furthermore it is demonstrated that a surrogate model enables us to present after a very short simulation time the impact of a varying degree of stenosis on blood flow, obtaining a speedup of several orders over the full model.
△ Less
Submitted 12 June, 2018; v1 submitted 13 February, 2018;
originally announced February 2018.
-
Comparison of data-driven uncertainty quantification methods for a carbon dioxide storage benchmark scenario
Authors:
Markus Köppel,
Fabian Franzelin,
Ilja Kröker,
Sergey Oladyshkin,
Gabriele Santin,
Dominik Wittwar,
Andrea Barth,
Bernard Haasdonk,
Wolfgang Nowak,
Dirk Pflüger,
Christian Rohde
Abstract:
A variety of methods is available to quantify uncertainties arising with\-in the modeling of flow and transport in carbon dioxide storage, but there is a lack of thorough comparisons. Usually, raw data from such storage sites can hardly be described by theoretical statistical distributions since only very limited data is available. Hence, exact information on distribution shapes for all uncertain…
▽ More
A variety of methods is available to quantify uncertainties arising with\-in the modeling of flow and transport in carbon dioxide storage, but there is a lack of thorough comparisons. Usually, raw data from such storage sites can hardly be described by theoretical statistical distributions since only very limited data is available. Hence, exact information on distribution shapes for all uncertain parameters is very rare in realistic applications. We discuss and compare four different methods tested for data-driven uncertainty quantification based on a benchmark scenario of carbon dioxide storage. In the benchmark, for which we provide data and code, carbon dioxide is injected into a saline aquifer modeled by the nonlinear capillarity-free fractional flow formulation for two incompressible fluid phases, namely carbon dioxide and brine. To cover different aspects of uncertainty quantification, we incorporate various sources of uncertainty such as uncertainty of boundary conditions, of conceptual model definitions and of material properties. We consider recent versions of the following non-intrusive and intrusive uncertainty quantification methods: arbitary polynomial chaos, spatially adaptive sparse grids, kernel-based greedy interpolation and hybrid stochastic Galerkin. The performance of each approach is demonstrated assessing expectation value and standard deviation of the carbon dioxide saturation against a reference statistic based on Monte Carlo sampling. We compare the convergence of all methods reporting on accuracy with respect to the number of model runs and resolution. Finally we offer suggestions about the methods' advantages and disadvantages that can guide the modeler for uncertainty quantification in carbon dioxide storage and beyond.
△ Less
Submitted 8 February, 2018;
originally announced February 2018.
-
Convergence rate of the data-independent $P$-greedy algorithm in kernel-based approximation
Authors:
Gabriele Santin,
Bernard Haasdonk
Abstract:
Kernel-based methods provide flexible and accurate algorithms for the reconstruction of functions from meshless samples. A major question in the use of such methods is the influence of the samples locations on the behavior of the approximation, and feasible optimal strategies are not known for general problems.
Nevertheless, efficient and greedy point-selection strategies are known. This paper g…
▽ More
Kernel-based methods provide flexible and accurate algorithms for the reconstruction of functions from meshless samples. A major question in the use of such methods is the influence of the samples locations on the behavior of the approximation, and feasible optimal strategies are not known for general problems.
Nevertheless, efficient and greedy point-selection strategies are known. This paper gives a proof of the convergence rate of the data-independent \textit{$P$-greedy} algorithm, based on the application of the convergence theory for greedy algorithms in reduced basis methods. The resulting rate of convergence is shown to be near-optimal in the case of kernels generating Sobolev spaces.
As a consequence, this convergence rate proves that, for kernels of Sobolev spaces, the points selected by the algorithm are asymptotically uniformly distributed, as conjectured in the paper where the algorithm has been introduced.
△ Less
Submitted 8 December, 2016;
originally announced December 2016.
-
Data-driven time parallelism via forecasting
Authors:
Kevin Carlberg,
Lukas Brencher,
Bernard Haasdonk,
Andrea Barth
Abstract:
This work proposes a data-driven method for enabling the efficient, stable time-parallel numerical solution of systems of ordinary differential equations (ODEs). The method assumes that low-dimensional bases that accurately capture the time evolution of the state are available. The method adopts the parareal framework for time parallelism, which is defined by an initialization method, a coarse pro…
▽ More
This work proposes a data-driven method for enabling the efficient, stable time-parallel numerical solution of systems of ordinary differential equations (ODEs). The method assumes that low-dimensional bases that accurately capture the time evolution of the state are available. The method adopts the parareal framework for time parallelism, which is defined by an initialization method, a coarse propagator, and a fine propagator. Rather than employing usual approaches for initialization and coarse propagation, we propose novel data-driven techniques that leverage the available time-evolution bases. The coarse propagator is defined by a forecast (proposed in Ref. [12]) applied locally within each coarse time interval, which comprises the following steps: (1) apply the fine propagator for a small number of time steps, (2) approximate the state over the entire coarse time interval using gappy POD with the local time-evolution bases, and (3) select the approximation at the end of the time interval as the propagated state. We also propose both local-forecast and global-forecast initialization. The method is particularly well suited for POD-based reduced-order models (ROMs). In this case, spatial parallelism quickly saturates, as the ROM dynamical system is low dimensional; thus, time parallelism is needed to enable lower wall times. Further, the time-evolution bases can be extracted from the (readily available) right singular vectors arising during POD computation. In addition to performing analyses related to the method's accuracy, speedup, stability, and convergence, we also numerically demonstrate the method's performance. Here, numerical experiments on ROMs for a nonlinear convection-reaction problem demonstrate the method's ability to realize near-ideal speedups; global-forecast initialization with a local-forecast coarse propagator leads to the best performance.
△ Less
Submitted 12 July, 2017; v1 submitted 27 October, 2016;
originally announced October 2016.
-
An algorithmic comparison of the Hyper-Reduction and the Discrete Empirical Interpolation Method for a nonlinear thermal problem
Authors:
Felix Fritzen,
Bernhard Haasdonk,
David Ryckelynck,
Sebastian Schöps
Abstract:
A novel algorithmic discussion of the methodological and numerical differences of competing parametric model reduction techniques for nonlinear problems are presented. First, the Galerkin reduced basis (RB) formulation is presented which fails at providing significant gains with respect to the computational efficiency for nonlinear problems. Renown methods for the reduction of the computing time o…
▽ More
A novel algorithmic discussion of the methodological and numerical differences of competing parametric model reduction techniques for nonlinear problems are presented. First, the Galerkin reduced basis (RB) formulation is presented which fails at providing significant gains with respect to the computational efficiency for nonlinear problems. Renown methods for the reduction of the computing time of nonlinear reduced order models are the Hyper-Reduction and the (Discrete) Empirical Interpolation Method (EIM, DEIM). An algorithmic description and a methodological comparison of both methods are provided. The accuracy of the predictions of the hyper-reduced model and the (D)EIM in comparison to the Galerkin RB is investigated. All three approaches are applied to a simple uncertainty quantification of a planar nonlinear thermal conduction problem. The results are compared to computationally intense finite element simulations.
△ Less
Submitted 19 December, 2017; v1 submitted 17 October, 2016;
originally announced October 2016.
-
Model order reduction approaches for infinite horizon optimal control problems via the HJB equation
Authors:
Alessandro Alla,
Andreas Schmidt,
Bernard Haasdonk
Abstract:
We investigate feedback control for infinite horizon optimal control problems for partial differential equations. The method is based on the coupling between Hamilton-Jacobi-Bellman (HJB) equations and model reduction techniques. It is well-known that HJB equations suffer the so called curse of dimensionality and, therefore, a reduction of the dimension of the system is mandatory. In this report w…
▽ More
We investigate feedback control for infinite horizon optimal control problems for partial differential equations. The method is based on the coupling between Hamilton-Jacobi-Bellman (HJB) equations and model reduction techniques. It is well-known that HJB equations suffer the so called curse of dimensionality and, therefore, a reduction of the dimension of the system is mandatory. In this report we focus on the infinite horizon optimal control problem with quadratic cost functionals. We compare several model reduction methods such as Proper Orthogonal Decomposition, Balanced Truncation and a new algebraic Riccati equation based approach. Finally, we present numerical examples and discuss several features of the different methods analyzing advantages and disadvantages of the reduction methods.
△ Less
Submitted 8 July, 2016;
originally announced July 2016.
-
A Reduced Basis Landweber method for nonlinear inverse problems
Authors:
Dominik Garmatter,
Bernard Haasdonk,
Bastian Harrach
Abstract:
We consider parameter identification problems in parametrized partial differential equations (PDE). This leads to nonlinear ill-posed inverse problems. One way to solve them are iterative regularization methods, which typically require numerous amounts of forward solutions during the solution process. In this article we consider the nonlinear Landweber method and want to couple it with the reduced…
▽ More
We consider parameter identification problems in parametrized partial differential equations (PDE). This leads to nonlinear ill-posed inverse problems. One way to solve them are iterative regularization methods, which typically require numerous amounts of forward solutions during the solution process. In this article we consider the nonlinear Landweber method and want to couple it with the reduced basis method as a model order reduction technique in order to reduce the overall computational time. In particular, we consider PDEs with a high-dimensional parameter space, which are known to pose difficulties in the context of reduced basis methods. We present a new method that is able to handle such high-dimensional parameter spaces by combining the nonlinear Landweber method with adaptive online reduced basis updates. It is then applied to the inverse problem of reconstructing the conductivity in the stationary heat equation.
△ Less
Submitted 4 May, 2018; v1 submitted 20 July, 2015;
originally announced July 2015.
-
Reduced basis methods for pricing options with the Black-Scholes and Heston model
Authors:
Olena Burkovska,
Bernard Haasdonk,
Julien Salomon,
Barbara Wohlmuth
Abstract:
In this paper, we present a reduced basis method for pricing European and American options based on the Black-Scholes and Heston model. To tackle each model numerically, we formulate the problem in terms of a time dependent variational equality or inequality. We apply a suitable reduced basis approach for both types of options. The characteristic ingredients used in the method are a combined POD-G…
▽ More
In this paper, we present a reduced basis method for pricing European and American options based on the Black-Scholes and Heston model. To tackle each model numerically, we formulate the problem in terms of a time dependent variational equality or inequality. We apply a suitable reduced basis approach for both types of options. The characteristic ingredients used in the method are a combined POD-Greedy and Angle-Greedy procedure for the construction of the primal and dual reduced spaces. Analytically, we prove the reproduction property of the reduced scheme and derive a posteriori error estimators. Numerical examples are provided, illustrating the approximation quality and convergence of our approach for the different option pricing models. Also, we investigate the reliability and effectivity of the error estimators.
△ Less
Submitted 6 August, 2014;
originally announced August 2014.
-
The Localized Reduced Basis Multiscale method for two-phase flows in porous media
Authors:
Sven Kaulmann,
Bernd Flemisch,
Bernard Haasdonk,
Knut-Andreas Lie,
Mario Ohlberger
Abstract:
In this work, we propose a novel model order reduction approach for two-phase flow in porous media by introducing a formulation in which the mobility, which realizes the coupling between phase saturations and phase pressures, is regarded as a parameter to the pressure equation. Using this formulation, we introduce the Localized Reduced Basis Multiscale method to obtain a low-dimensional surrogate…
▽ More
In this work, we propose a novel model order reduction approach for two-phase flow in porous media by introducing a formulation in which the mobility, which realizes the coupling between phase saturations and phase pressures, is regarded as a parameter to the pressure equation. Using this formulation, we introduce the Localized Reduced Basis Multiscale method to obtain a low-dimensional surrogate of the high-dimensional pressure equation. By applying ideas from model order reduction for parametrized partial differential equations, we are able to split the computational effort for solving the pressure equation into a costly offline step that is performed only once and an inexpensive online step that is carried out in every time step of the two-phase flow simulation, which is thereby largely accelerated. Usage of elements from numerical multiscale methods allows us to displace the computational intensity between the offline and online step to reach an ideal runtime at acceptable error increase for the two-phase flow simulation.
△ Less
Submitted 12 May, 2014;
originally announced May 2014.
-
Efficient parametric analysis of the chemical master equation through model order reduction
Authors:
Steffen Waldherr,
Bernard Haasdonk
Abstract:
Background: Stochastic biochemical reaction networks are commonly modelled by the chemical master equation, and can be simulated as first order linear differential equations through a finite state projection. Due to the very high state space dimension of these equations, numerical simulations are computationally expensive. This is a particular problem for analysis tasks requiring repeated simulati…
▽ More
Background: Stochastic biochemical reaction networks are commonly modelled by the chemical master equation, and can be simulated as first order linear differential equations through a finite state projection. Due to the very high state space dimension of these equations, numerical simulations are computationally expensive. This is a particular problem for analysis tasks requiring repeated simulations for different parameter values. Such tasks are computationally expensive to the point of infeasibility with the chemical master equation. Results: In this article, we apply parametric model order reduction techniques in order to construct accurate low-dimensional parametric models of the chemical master equation. These surrogate models can be used in various parametric analysis task such as identifiability analysis, parameter estimation, or sensitivity analysis. As biological examples, we consider two models for gene regulation networks, a bistable switch and a network displaying stochastic oscillations. Conclusions: The results show that the parametric model reduction yields efficient models of stochastic biochemical reaction networks, and that these models can be useful for systems biology applications involving parametric analysis problems such as parameter exploration, optimization, estimation or sensitivity analysis.
△ Less
Submitted 9 July, 2012; v1 submitted 18 January, 2012;
originally announced January 2012.
-
A Reduced Basis Method for the Simulation of American Options
Authors:
Bernard Haasdonk,
Julien Salomon,
Barbara Wohlmuth
Abstract:
We present a reduced basis method for the simulation of American option pricing. To tackle this model numerically, we formulate the problem in terms of a time dependent variational inequality. Characteristic ingredients are a POD-greedy and an angle-greedy procedure for the construction of the primal and dual reduced spaces. Numerical examples are provided, illustrating the approximation quality a…
▽ More
We present a reduced basis method for the simulation of American option pricing. To tackle this model numerically, we formulate the problem in terms of a time dependent variational inequality. Characteristic ingredients are a POD-greedy and an angle-greedy procedure for the construction of the primal and dual reduced spaces. Numerical examples are provided, illustrating the approximation quality and convergence of our approach.
△ Less
Submitted 16 January, 2012;
originally announced January 2012.
