-
Inducing Riesz and orthonormal bases in $L^2$ via composition operators
Authors:
Yahya Saleh,
Armin Iske
Abstract:
We investigate perturbations of orthonormal bases of $L^2$ via a composition operator $C_h$ induced by a map** $h$. We provide a comprehensive characterization of the map** $h$ required for the perturbed sequence to form an orthonormal or Riesz basis. Restricting our analysis to differentiable map**s, we reveal that all Riesz bases of the given form are induced by bi-Lipschitz map**s. In a…
▽ More
We investigate perturbations of orthonormal bases of $L^2$ via a composition operator $C_h$ induced by a map** $h$. We provide a comprehensive characterization of the map** $h$ required for the perturbed sequence to form an orthonormal or Riesz basis. Restricting our analysis to differentiable map**s, we reveal that all Riesz bases of the given form are induced by bi-Lipschitz map**s. In addition, we discuss implications of these results for approximation theory, highlighting the potential of using bijective neural networks to construct complete sequences with favorable approximation properties.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
Finetuning greedy kernel models by exchange algorithms
Authors:
Tizian Wenzel,
Armin Iske
Abstract:
Kernel based approximation offers versatile tools for high-dimensional approximation, which can especially be leveraged for surrogate modeling. For this purpose, both "knot insertion" and "knot removal" approaches aim at choosing a suitable subset of the data, in order to obtain a sparse but nevertheless accurate kernel model. In the present work, focussing on kernel based interpolation, we aim at…
▽ More
Kernel based approximation offers versatile tools for high-dimensional approximation, which can especially be leveraged for surrogate modeling. For this purpose, both "knot insertion" and "knot removal" approaches aim at choosing a suitable subset of the data, in order to obtain a sparse but nevertheless accurate kernel model. In the present work, focussing on kernel based interpolation, we aim at combining these two approaches to further improve the accuracy of kernel models, without increasing the computational complexity of the final kernel model. For this, we introduce a class of kernel exchange algorithms (KEA). The resulting KEA algorithm can be used for finetuning greedy kernel surrogate models, allowing for an reduction of the error up to 86.4% (17.2% on average) in our experiments.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
Product kernels are efficient and flexible tools for high-dimensional scattered interpolation
Authors:
Kristof Albrecht,
Juliane Entzian,
Armin Iske
Abstract:
This work concerns the construction and characterization of product kernels for multivariate approximation from a finite set of discrete samples. To this end, we consider composing different component kernels, each acting on a low-dimensional Euclidean space. Due to Aronszajn (1950), the product of positive semi-definite kernel functions is again positive semi-definite, where, moreover, the corres…
▽ More
This work concerns the construction and characterization of product kernels for multivariate approximation from a finite set of discrete samples. To this end, we consider composing different component kernels, each acting on a low-dimensional Euclidean space. Due to Aronszajn (1950), the product of positive semi-definite kernel functions is again positive semi-definite, where, moreover, the corresponding native space is a particular instance of a tensor product, referred to as Hilbert tensor product. We first analyze the general problem of multivariate interpolation by product kernels. Then, we further investigate the tensor product structure, in particular for grid-like samples. We use this case to show that the product of strictly positive definite kernel functions is again strictly positive definite. Moreover, we develop an efficient computation scheme for the well-known Newton basis. Supporting numerical examples show the good performance of product kernels, especially for their flexibility.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Augmenting Basis Sets by Normalizing Flows
Authors:
Yahya Saleh,
Armin Iske,
Andrey Yachmenev,
Jochen Küpper
Abstract:
Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by provable approximation orders. On the down side, however, these methods often suffer from the curse of dimensionality, which limits their approximation behavior,…
▽ More
Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by provable approximation orders. On the down side, however, these methods often suffer from the curse of dimensionality, which limits their approximation behavior, especially in situations of highly oscillatory target functions. Nonlinear approximation methods, such as neural networks, were shown to be very efficient in approximating high-dimensional functions. We investigate nonlinear approximation methods that are constructed by composing standard basis sets with normalizing flows. Such models yield richer approximation spaces while maintaining the density properties of the initial basis set, as we show. Simulations to approximate eigenfunctions of a perturbed quantum harmonic oscillator indicate convergence with respect to the size of the basis set.
△ Less
Submitted 13 December, 2022; v1 submitted 30 November, 2022;
originally announced December 2022.
-
Dimensionality Reduction and Wasserstein Stability for Kernel Regression
Authors:
Stephan Eckstein,
Armin Iske,
Mathias Trabs
Abstract:
In a high-dimensional regression framework, we study consequences of the naive two-step procedure where first the dimension of the input variables is reduced and second, the reduced input variables are used to predict the output variable with kernel regression. In order to analyze the resulting regression errors, a novel stability result for kernel regression with respect to the Wasserstein distan…
▽ More
In a high-dimensional regression framework, we study consequences of the naive two-step procedure where first the dimension of the input variables is reduced and second, the reduced input variables are used to predict the output variable with kernel regression. In order to analyze the resulting regression errors, a novel stability result for kernel regression with respect to the Wasserstein distance is derived. This allows us to bound errors that occur when perturbed input data is used to fit the regression function. We apply the general stability result to principal component analysis (PCA). Exploiting known estimates from the literature on both principal component analysis and kernel regression, we deduce convergence rates for the two-step procedure. The latter turns out to be particularly useful in a semi-supervised setting.
△ Less
Submitted 27 November, 2023; v1 submitted 17 March, 2022;
originally announced March 2022.
