-
The Kolmogorov N-width for linear transport: Exact representation and the influence of the data
Authors:
Florian Arbes,
Constantin Greif,
Karsten Urban
Abstract:
The Kolmogorov $N$-width describes the best possible error one can achieve by elements of an $N$-dimensional linear space. Its decay has extensively been studied in Approximation Theory and for the solution of Partial Differential Equations (PDEs). Particular interest has occurred within Model Order Reduction (MOR) of parameterized PDEs e.g.\ by the Reduced Basis Method (RBM).
While it is known…
▽ More
The Kolmogorov $N$-width describes the best possible error one can achieve by elements of an $N$-dimensional linear space. Its decay has extensively been studied in Approximation Theory and for the solution of Partial Differential Equations (PDEs). Particular interest has occurred within Model Order Reduction (MOR) of parameterized PDEs e.g.\ by the Reduced Basis Method (RBM).
While it is known that the $N$-width decays exponentially fast (and thus admits efficient MOR) for certain problems, there are examples of the linear transport and the wave equation, where the decay rate deteriorates to $N^{-1/2}$. On the other hand, it is widely accepted that a smooth parameter dependence admits a fast decay of the $N$-width. However, a detailed analysis of the influence of properties of the data (such as regularity or slope) on the rate of the $N$-width seems to lack.
In this paper, we use techniques from Fourier Analysis to derive exact representations of the $N$-width in terms of initial and boundary conditions of the linear transport equation modeled by some function $g$ for half-wave symmetric data. For arbitrary functions $g$, we derive bounds and prove that these bounds are sharp. In particular, we prove that the $N$-width decays as ${c_r N^{-r}}$ for functions {with Sobolev regularity} $g\in H^{r{-\varepsilon}}$ for all $\varepsilon>0$ even if $g\not\in H^{r}$. Our theoretical investigations are complemented by numerical experiments which confirm the sharpness of our bounds and give additional quantitative insight.
△ Less
Submitted 31 January, 2024; v1 submitted 28 April, 2023;
originally announced May 2023.
-
An Ultra-Weak Space-Time Variational Formulation for the Schrödinger Equation
Authors:
Stefan Hain,
Karsten Urban
Abstract:
We present a well-posed ultra-weak space-time variational formulation for the time-dependent version of the linear Schrödinger equation with an instationary Hamiltonian. We prove optimal inf-sup stability and introduce a space-time Petrov-Galerkin discretization with optimal discrete inf-sup stability.
We show norm-preservation of the ultra-weak formulation. The inf-sup optimal Petrov-Galerkin d…
▽ More
We present a well-posed ultra-weak space-time variational formulation for the time-dependent version of the linear Schrödinger equation with an instationary Hamiltonian. We prove optimal inf-sup stability and introduce a space-time Petrov-Galerkin discretization with optimal discrete inf-sup stability.
We show norm-preservation of the ultra-weak formulation. The inf-sup optimal Petrov-Galerkin discretization is shown to be asymptotically norm-preserving, where the deviation is shown to be in the order of the discretization. In addition, we introduce a Galerkin discretization, which has suboptimal inf-sup stability but exact norm-preservation.
Numerical experiments underline the performance of the ultra-weak space-time variational formulation, especially for non-smooth initial data.
△ Less
Submitted 29 December, 2022;
originally announced December 2022.
-
A certified wavelet-based physics-informed neural network for the solution of parameterized partial differential equations
Authors:
Lewin Ernst,
Karsten Urban
Abstract:
Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error, which is particularly relevant for model reduction of Parameterized PDEs (PPDEs). To this end, we suggest to use a weighted sum of expansion coefficients of the res…
▽ More
Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error, which is particularly relevant for model reduction of Parameterized PDEs (PPDEs). To this end, we suggest to use a weighted sum of expansion coefficients of the residual in terms of an adaptive wavelet expansion both for the loss function and an error bound.
This approach is shown here for elliptic PPDEs using both the standard variational and an optimally stable ultra-weak formulation. Numerical examples show a very good quantitative effectivity of the wavelet-based error bound.
△ Less
Submitted 16 December, 2022;
originally announced December 2022.
-
An ultraweak variational method for parameterized linear differential-algebraic equations
Authors:
Emil Beurer,
Moritz Feuerle,
Niklas Reich,
Karsten Urban
Abstract:
We investigate an ultraweak variational formulation for (parameterized) linear differential-algebraic equations (DAEs) w.r.t. the time variable which yields an optimally stable system. This is used within a Petrov-Galerkin method to derive a certified detailed discretization which provides an approximate solution in an ultraweak setting as well as for model reduction w.r.t. time in the spirit of t…
▽ More
We investigate an ultraweak variational formulation for (parameterized) linear differential-algebraic equations (DAEs) w.r.t. the time variable which yields an optimally stable system. This is used within a Petrov-Galerkin method to derive a certified detailed discretization which provides an approximate solution in an ultraweak setting as well as for model reduction w.r.t. time in the spirit of the Reduced Basis Method (RBM). A computable sharp error bound is derived. Numerical experiments are presented that show that this method yields a significant reduction and can be combined with well-known system theoretic methods such as Balanced Truncation to reduce the size of the DAE.
△ Less
Submitted 25 March, 2022; v1 submitted 25 February, 2022;
originally announced February 2022.
-
Very Weak Space-Time Variational Formulation for the Wave Equation: Analysis and Efficient Numerical Solution
Authors:
Julian Henning,
Davide Palitta,
Valeria Simoncini,
Karsten Urban
Abstract:
We introduce a very weak space-time variational formulation for the wave equation, prove its well-posedness (even in the case of minimal regularity) and optimal inf-sup stability. Then, we introduce a tensor product-style space-time Petrov-Galerkin discretization with optimal discrete inf-sup stability, obtained by a non-standard definition of the trial space. As a consequence, the numerical appro…
▽ More
We introduce a very weak space-time variational formulation for the wave equation, prove its well-posedness (even in the case of minimal regularity) and optimal inf-sup stability. Then, we introduce a tensor product-style space-time Petrov-Galerkin discretization with optimal discrete inf-sup stability, obtained by a non-standard definition of the trial space. As a consequence, the numerical approximation error is equal to the residual, which is particularly useful for a posteriori error estimation.
For the arising {discrete linear systems} in space and time, we introduce efficient numerical solvers that appropriately exploit the equation structure, either at the preconditioning level or in the approximation phase by using a tailored Galerkin projection. This Galerkin method shows competitive behavior concerning {wall-clock} time, accuracy and memory as compared with a standard time-step** method in particular in low regularity cases. Numerical experiments with a 3D (in space) wave equation illustrate our findings.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Linear/Ridge expansions: Enhancing linear approximations by ridge functions
Authors:
Constantin Greif,
Philipp Junk,
Karsten Urban
Abstract:
We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions -- a Linear/Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear/Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustn…
▽ More
We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions -- a Linear/Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear/Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustness and efficiency of the algorithm.
One particular source of motivation is model reduction of parameterized transport or wave equations. We show that the particle grid algorithm is able to produce a Linear/Ridge expansion as an efficient nonlinear model reduction.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
A Space-Time Variational Method for Optimal Control Problems: Well-posedness, stability and numerical solution
Authors:
Nina Beranek,
M. Alexander Reinhold,
Karsten Urban
Abstract:
We consider an optimal control problem constrained by a parabolic partial differential equation (PDE) with Robin boundary conditions. We use a well-posed space-time variational formulation in Lebesgue--Bochner spaces with minimal regularity. The abstract formulation of the optimal control problem yields the Lagrange function and Karush--Kuhn--Tucker (KKT) conditions in a natural manner. This resul…
▽ More
We consider an optimal control problem constrained by a parabolic partial differential equation (PDE) with Robin boundary conditions. We use a well-posed space-time variational formulation in Lebesgue--Bochner spaces with minimal regularity. The abstract formulation of the optimal control problem yields the Lagrange function and Karush--Kuhn--Tucker (KKT) conditions in a natural manner. This results in space-time variational formulations of the adjoint and gradient equation in Lebesgue--Bochner spaces with minimal regularity. Necessary and sufficient optimality conditions are formulated and the optimality system is shown to be well-posed.
Next, we introduce a conforming uniformly stable simultaneous space-time (tensorproduct) discretization of the optimality system in these Lebesgue--Boch\-ner spaces. Using finite elements of appropriate orders in space and time for trial and test spaces, this setting is known to be equivalent to a Crank--Nicolson time-step** scheme for parabolic problems. Differences to existing methods are detailed.
We show numerical comparisons with time-step** methods. The space-time method shows good stability properties and requires fewer degrees of freedom in time to reach the same accuracy.
△ Less
Submitted 5 December, 2022; v1 submitted 1 October, 2020;
originally announced October 2020.
-
Matrix oriented reduction of space-time Petrov-Galerkin variational problems
Authors:
Julian Henning,
Davide Palitta,
Valeria Simoncini,
Karsten Urban
Abstract:
Variational formulations of time-dependent PDEs in space and time yield $(d+1)$-dimensional problems to be solved numerically. This increases the number of unknowns as well as the storage amount. On the other hand, this approach enables adaptivity in space and time as well as model reduction w.r.t. both type of variables. In this paper, we show that matrix oriented techniques can significantly red…
▽ More
Variational formulations of time-dependent PDEs in space and time yield $(d+1)$-dimensional problems to be solved numerically. This increases the number of unknowns as well as the storage amount. On the other hand, this approach enables adaptivity in space and time as well as model reduction w.r.t. both type of variables. In this paper, we show that matrix oriented techniques can significantly reduce the computational timings for solving the arising linear systems outperforming both time-step** schemes and other solvers.
△ Less
Submitted 20 December, 2019;
originally announced December 2019.
-
Decay of the Kolmogorov $N$-width for wave problems
Authors:
Constantin Greif,
Karsten Urban
Abstract:
The Kolmogorov $N$-width $d_N(\mathcal{M})$ describes the rate of the worst-case error (w.r.t.\ a subset $\mathcal{M}\subset H$ of a normed space $H$) arising from a projection onto the best-possible linear subspace of $H$ of dimension $N\in\mathbb{N}$. Thus, $d_N(\mathcal{M})$ sets a limit to any projection-based approximation such as determined by the reduced basis method. While it is known that…
▽ More
The Kolmogorov $N$-width $d_N(\mathcal{M})$ describes the rate of the worst-case error (w.r.t.\ a subset $\mathcal{M}\subset H$ of a normed space $H$) arising from a projection onto the best-possible linear subspace of $H$ of dimension $N\in\mathbb{N}$. Thus, $d_N(\mathcal{M})$ sets a limit to any projection-based approximation such as determined by the reduced basis method. While it is known that $d_N(\mathcal{M})$ decays exponentially fast for many linear coercive parametrized partial differential equations, i.e., $d_N(\mathcal{M})=\mathcal{O}(e^{-βN})$, we show in this note, that only $d_N(\mathcal{M}) =\mathcal{O}(N^{-1/2})$ for initial-boundary-value problems of the hyperbolic wave equation with discontinuous initial conditions. This is aligned with the known slow decay of $d_N(\mathcal{M})$ for the linear transport problem.
△ Less
Submitted 10 April, 2019; v1 submitted 20 March, 2019;
originally announced March 2019.
-
HT-AWGM: A Hierarchical Tucker-Adaptive Wavelet Galerkin Method for High Dimensional Elliptic Problems
Authors:
Mazen Ali,
Karsten Urban
Abstract:
This paper is concerned with the construction, analysis and realization of a numerical method to approximate the solution of high dimensional elliptic partial differential equations. We propose a new combination of an Adaptive Wavelet Galerkin Method (AWGM) and the well known Hierarchical Tensor (HT) format. The arising HT-AWGM is adaptive both in the wavelet representation of the low dimensional…
▽ More
This paper is concerned with the construction, analysis and realization of a numerical method to approximate the solution of high dimensional elliptic partial differential equations. We propose a new combination of an Adaptive Wavelet Galerkin Method (AWGM) and the well known Hierarchical Tensor (HT) format. The arising HT-AWGM is adaptive both in the wavelet representation of the low dimensional factors and in the tensor rank of the HT representation. The point of departure is an adaptive wavelet method for the HT format using approximate Richardson iterations from [1] and an AWGM method as described in [13]. HT-AWGM performs a sequence of Galerkin solves based upon a truncated preconditioned conjugate gradient (PCG) algorithm from [33] in combination with a tensor-based preconditioner from [3]. Our analysis starts by showing convergence of the truncated conjugate gradient method. The next step is to add routines realizing the adaptive refinement. The resulting HT-AWGM is analyzed concerning convergence and complexity. We show that the performance of the scheme asymptotically depends only on the desired tolerance with convergence rates depending on the Besov regularity of low dimensional quantities and the low rank tensor structure of the solution. The complexity in the ranks is algebraic with powers of four stemming from the complexity of the tensor truncation. Numerical experiments show the quantitative performance.
△ Less
Submitted 30 May, 2018;
originally announced May 2018.
-
(Parametrized) First Order Transport Equations: Realization of Optimally Stable Petrov-Galerkin Methods
Authors:
Julia Brunken,
Kathrin Smetana,
Karsten Urban
Abstract:
We consider ultraweak variational formulations for (parametrized) linear first order transport equations in time and/or space. Computationally feasible pairs of optimally stable trial and test spaces are presented, starting with a suitable test space and defining an optimal trial space by the application of the adjoint operator. As a result, the inf-sup constant is one in the continuous as well as…
▽ More
We consider ultraweak variational formulations for (parametrized) linear first order transport equations in time and/or space. Computationally feasible pairs of optimally stable trial and test spaces are presented, starting with a suitable test space and defining an optimal trial space by the application of the adjoint operator. As a result, the inf-sup constant is one in the continuous as well as in the discrete case and the computational realization is therefore easy. In particular, regarding the latter, we avoid a stabilization loop within the greedy algorithm when constructing reduced models within the framework of reduced basis methods. Several numerical experiments demonstrate the good performance of the new method.
△ Less
Submitted 12 September, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
A Hierarchical A-Posteriori Error Estimatorfor the Reduced Basis Method
Authors:
Stefan Hain,
Mario Ohlberger,
Mladjan Radic,
Karsten Urban
Abstract:
In this contribution we are concerned with tight a posteriori error estimation for projection based model order reduction of $\inf$-$\sup$ stable parameterized variational problems. In particular, we consider the Reduced Basis Method in a Petrov-Galerkin framework, where the reduced approximation spaces are constructed by the (weak) Greedy algorithm. We propose and analyze a hierarchical a posteri…
▽ More
In this contribution we are concerned with tight a posteriori error estimation for projection based model order reduction of $\inf$-$\sup$ stable parameterized variational problems. In particular, we consider the Reduced Basis Method in a Petrov-Galerkin framework, where the reduced approximation spaces are constructed by the (weak) Greedy algorithm. We propose and analyze a hierarchical a posteriori error estimator which evaluates the difference of two reduced approximations of different accuracy. Based on the a priori error analysis of the (weak) Greedy algorithm, it is expected that the hierarchical error estimator is sharp with efficiency index close to one, if the Kolmogorov N-with decays fast for the underlying problem and if a suitable saturation assumption for the reduced approximation is satisfied. We investigate the tightness of the hierarchical a posteriori estimator both from a theoretical and numerical perspective. For the respective approximation with higher accuracy we study and compare basis enrichment of Lagrange- and Taylor-type reduced bases. Numerical experiments indicate the efficiency for both, the construction of a reduced basis using the hierarchical error estimator in a weak Greedy algorithm, and for tight online certification of reduced approximations. This is particularly relevant in cases where the $\inf$-$\sup$ constant may become small depending on the parameter. In such cases a standard residual-based error estimator -- complemented by the successive constrained method to compute a lower bound of the parameter dependent $\inf$-$\sup$ constant -- may become infeasible.
△ Less
Submitted 9 February, 2018;
originally announced February 2018.
-
A Reduced Basis Method for the Hamilton-Jacobi-Bellman Equation with Application to the European Union Emission Trading Scheme
Authors:
Sebastian Steck,
Karsten Urban
Abstract:
This paper draws on two sources of motivation: (1) The European Union Emission Trading Scheme (EU-ETS) aims at limiting the overall emissions of greenhouse gases. The optimal abatement strategy of companies for the use of emission permits can be described as the viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. It is a question of general interest, how regulatory constraints can be s…
▽ More
This paper draws on two sources of motivation: (1) The European Union Emission Trading Scheme (EU-ETS) aims at limiting the overall emissions of greenhouse gases. The optimal abatement strategy of companies for the use of emission permits can be described as the viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. It is a question of general interest, how regulatory constraints can be set within the EU-ETS in order to reach certain political goals such as a good balance of emission reduction and economical growth. Such regulatory constraints can be modeled as parameters within the HJB equation.
(2) The EU-ETS is just one example where one is interested in solving a parameterized HJB equation often for different values of the parameters (e.g.\ to optimize their values with respect to a given target functional). The Reduced Basis Method (RBM) is by now a well-established numerical method to efficiently solve parameterized partial differential equations. However, to the best of our knowledge, an RBM for the HJB equation is not known so far and of (mathematical) interest by its own, since the HJB equation is of hyperbolic type which is in general a nontrivial task for model reduction.
We analyze and realize a RBM for the HJB equation. In particular, we construct an online-efficient error estimator for this nonlinear problem using the Brezzi-Rapaz-Raviart (RBB) theory as well as numerical algorithms for the involved parameter-dependent constants. Numerical experiments are presented.
△ Less
Submitted 25 March, 2015;
originally announced March 2015.
-
A Reduced Basis Method for Parabolic Partial Differential Equations with Parameter Functions and Application to Option Pricing
Authors:
Antonia Mayerhofer,
Karsten Urban
Abstract:
We consider the Heston model as an example of a parameterized parabolic partial differential equation. A space-time variational formulation is derived that allows for parameters in the coefficients (for calibration) as well as choosing the initial condition (for option pricing) as a parameter function. A corresponding discretization in space and time amd initial condition is introduced and shown t…
▽ More
We consider the Heston model as an example of a parameterized parabolic partial differential equation. A space-time variational formulation is derived that allows for parameters in the coefficients (for calibration) as well as choosing the initial condition (for option pricing) as a parameter function. A corresponding discretization in space and time amd initial condition is introduced and shown to be stable. Finally, a Reduced Basis Method (RBM) is introduced that is able to use parameter functions also for the initial condition. Corresponding numerical results are shown.
△ Less
Submitted 12 August, 2014;
originally announced August 2014.
-
Reduced Basis Methods Based Upon Adaptive Snapshot Computations
Authors:
Mazen Ali,
Kristina Steih,
Karsten Urban
Abstract:
We use asymptotically optimal \emph{adaptive} numerical methods (here specifically a wavelet scheme) for snapshot computations within the offline phase of the Reduced Basis Method (RBM). The resulting discretizations for each snapshot (i.e., parameter-dependent) do not permit the standard RB `truth space', but allow for error estimation of the RB approximation with respect to the exact solution of…
▽ More
We use asymptotically optimal \emph{adaptive} numerical methods (here specifically a wavelet scheme) for snapshot computations within the offline phase of the Reduced Basis Method (RBM). The resulting discretizations for each snapshot (i.e., parameter-dependent) do not permit the standard RB `truth space', but allow for error estimation of the RB approximation with respect to the exact solution of the considered parameterized partial differential equation.
The residual-based a posteriori error estimators are computed by an adaptive dual wavelet expansion, which allows us to compute a surrogate of the dual norm of the residual. The resulting adaptive RBM is analyzed. We show the convergence of the resulting adaptive Greedy method. Numerical experiments for stationary and instationary problems underline the potential of this approach.
△ Less
Submitted 23 September, 2015; v1 submitted 7 July, 2014;
originally announced July 2014.
-
An efficient space-time adaptive wavelet Galerkin method for time-periodic parabolic partial differential equations
Authors:
Sebastian Kestler,
Kristina Steih,
Karsten Urban
Abstract:
We introduce a multitree-based adaptive wavelet Galerkin algorithm {for} space-time discretized linear parabolic partial differential equations, focusing on time-periodic problems. It is shown that the method converges with the best possible rate in linear complexity and can be applied for a wide range of wavelet bases. We discuss the implementational challenges arising from the Petrov-Galerkin na…
▽ More
We introduce a multitree-based adaptive wavelet Galerkin algorithm {for} space-time discretized linear parabolic partial differential equations, focusing on time-periodic problems. It is shown that the method converges with the best possible rate in linear complexity and can be applied for a wide range of wavelet bases. We discuss the implementational challenges arising from the Petrov-Galerkin nature of the variational formulation and present numerical results for the heat and a convection-diffusion-reaction equation.
△ Less
Submitted 22 January, 2014;
originally announced January 2014.
-
On Wavelet-Galerkin methods for Semilinear Parabolic Equations with Additive Noise
Authors:
M. Kovács,
S. Larsson,
K. Urban
Abstract:
We consider the semilinear stochastic heat equation perturbed by additive noise. After time-discretization by Euler's method the equation is split into a linear stochastic equation and a non-linear random evolution equation. The linear stochastic equation is discretized in space by a non-adaptive wavelet-Galerkin method. This equation is solved first and its solution is substituted into the nonlin…
▽ More
We consider the semilinear stochastic heat equation perturbed by additive noise. After time-discretization by Euler's method the equation is split into a linear stochastic equation and a non-linear random evolution equation. The linear stochastic equation is discretized in space by a non-adaptive wavelet-Galerkin method. This equation is solved first and its solution is substituted into the nonlinear random evolution equation, which is solved by an adaptive wavelet method. We provide mean square estimates for the overall error.
△ Less
Submitted 28 March, 2013; v1 submitted 2 August, 2012;
originally announced August 2012.
