-
Generalized Gearhart-Koshy acceleration is a Krylov space method of a new type
Authors:
Markus Hegland,
Janosch Rieger
Abstract:
The Gearhart-Koshy acceleration for the Kaczmarz method for linear systems is a line-search with the unusual property that it does not minimize the residual, but the error. Recently one of the authors generalized the this acceleration from a line-search to a search in affine subspaces.
In this paper, we demonstrate that the affine search is a Krylov space method that is neither a CG-type nor a M…
▽ More
The Gearhart-Koshy acceleration for the Kaczmarz method for linear systems is a line-search with the unusual property that it does not minimize the residual, but the error. Recently one of the authors generalized the this acceleration from a line-search to a search in affine subspaces.
In this paper, we demonstrate that the affine search is a Krylov space method that is neither a CG-type nor a MINRES-type method, and we prove that it is mathematically equivalent with a more canonical Gram-Schmidt-based method. We also investigate what abstract property of the Kaczmarz method enables this type of algorithm, and we conclude with a simple numerical example.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Computing expected moments of the Rényi parking problem on the circle
Authors:
Markus Hegland,
Conrad J. Burden,
Zbigniew Stachurski
Abstract:
A highly accurate and efficient method to compute the expected values of the count, sum, and squared norm of the sum of the centre vectors of a random maximal sized collection of non-overlap** unit diameter disks touching a fixed unit-diameter disk is presented. This extends earlier work on Rényi's parking problem [Magyar Tud. Akad. Mat. Kutató Int. Közl. 3 (1-2), 1958, pp. 109-127]. Underlying…
▽ More
A highly accurate and efficient method to compute the expected values of the count, sum, and squared norm of the sum of the centre vectors of a random maximal sized collection of non-overlap** unit diameter disks touching a fixed unit-diameter disk is presented. This extends earlier work on Rényi's parking problem [Magyar Tud. Akad. Mat. Kutató Int. Közl. 3 (1-2), 1958, pp. 109-127]. Underlying the method is a splitting of the the problem conditional on the value of the first disk. This splitting is proven and then used to derive integral equations for the expectations. These equations take a lower block triangular form. They are solved using substitution and approximation of the integrals to very high accuracy using a polynomial approximation within the blocks.
△ Less
Submitted 27 November, 2023; v1 submitted 28 January, 2023;
originally announced January 2023.
-
A Note on Error Bounds for Pseudo Skeleton Approximations of Matrices
Authors:
Frank de Hoog,
Markus Hegland
Abstract:
Due to their importance in both data analysis and numerical algorithms, low rank approximations have recently been widely studied. They enable the handling of very large matrices. Tight error bounds for the computationally efficient Gaussian elimination based methods (skeleton approximations) are available. In practice, these bounds are useful for matrices with singular values which decrease quick…
▽ More
Due to their importance in both data analysis and numerical algorithms, low rank approximations have recently been widely studied. They enable the handling of very large matrices. Tight error bounds for the computationally efficient Gaussian elimination based methods (skeleton approximations) are available. In practice, these bounds are useful for matrices with singular values which decrease quickly. Using the Chebyshev norm, this paper provides improved bounds for the errors of the matrix elements. These bounds are substantially better in the practically relevant cases where the eigenvalues decrease polynomially. Results are proven for general real rectangular matrices. Even stronger bounds are obtained for symmetric positive definite matrices. A simple example is given, comparing these new bounds to earlier ones.
△ Less
Submitted 14 August, 2022; v1 submitted 5 July, 2021;
originally announced July 2021.
-
Low rank approximation of positive semi-definite symmetric matrices using Gaussian elimination and volume sampling
Authors:
Markus Hegland,
Frank deHoog
Abstract:
Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve systems with such a matrix can be very costly. A core idea to reduce computational complexity is to approximate the matrix by one with a low rank. The optimal and we…
▽ More
Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve systems with such a matrix can be very costly. A core idea to reduce computational complexity is to approximate the matrix by one with a low rank. The optimal and well understood choice is based on the eigenvalue decomposition of the matrix. Unfortunately, this is computationally very expensive.
Cheaper methods are based on Gaussian elimination but they require pivoting. We will show how invariant matrix theory provides explicit error formulas for an averaged error based on volume sampling. The formula leads to ratios of elementary symmetric polynomials on the eigenvalues. We discuss some new an old bounds and include several examples where an expected error norm can be computed exactly.
△ Less
Submitted 30 November, 2020;
originally announced November 2020.
-
Stratified Space Learning: Reconstructing Embedded Graphs
Authors:
Yossi Bokor,
Daniel Grixti-Cheng,
Markus Hegland,
Stephen Roberts,
Katharine Turner
Abstract:
Many data-rich industries are interested in the efficient discovery and modelling of structures underlying large data sets, as it allows for the fast triage and dimension reduction of large volumes of data embedded in high dimensional spaces. The modelling of these underlying structures is also beneficial for the creation of simulated data that better represents real data. In particular, for syste…
▽ More
Many data-rich industries are interested in the efficient discovery and modelling of structures underlying large data sets, as it allows for the fast triage and dimension reduction of large volumes of data embedded in high dimensional spaces. The modelling of these underlying structures is also beneficial for the creation of simulated data that better represents real data. In particular, for systems testing in cases where the use of real data streams might prove impractical or otherwise undesirable. We seek to discover and model the structure by combining methods from topological data analysis with numerical modelling. As a first step in combining these two areas, we examine the recovery of the abstract graph $G$ structure, and model a linear embedding $|G|$ given only a noisy point cloud sample $X$ of $|G|$.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
Self-referential Functions
Authors:
Michael Barnsley,
Markus Hegland,
Peter Massopust
Abstract:
We introduce the concept of fractels for functions and discuss their analytic and algebraic properties. We also consider the representation of polynomials and analytic functions using fractels, and the consequences of these representations in numerical analysis.
We introduce the concept of fractels for functions and discuss their analytic and algebraic properties. We also consider the representation of polynomials and analytic functions using fractels, and the consequences of these representations in numerical analysis.
△ Less
Submitted 5 October, 2016;
originally announced October 2016.
-
Conjugacies provided by fractal transformations I : Conjugate measures, Hilbert spaces, orthogonal expansions, and flows, on self-referential spaces
Authors:
Christoph Bandt,
Michael Barnsley,
Markus Hegland,
Andrew Vince
Abstract:
Theorems and explicit examples are used to show how transformations between self-similar sets (general sense) may be continuous almost everywhere with respect to stationary measures on the sets and may be used to carry well known flows and spectral analysis over from familiar settings to new ones. The focus of this work is on a number of surprising applications including (i) what we call fractal F…
▽ More
Theorems and explicit examples are used to show how transformations between self-similar sets (general sense) may be continuous almost everywhere with respect to stationary measures on the sets and may be used to carry well known flows and spectral analysis over from familiar settings to new ones. The focus of this work is on a number of surprising applications including (i) what we call fractal Fourier analysis, in which the graphs of the basis functions are Cantor sets, being discontinuous at a countable dense set of points, yet have very good approximation properties; (ii) Lebesgue measure-preserving flows, on polygonal laminas, whose wave-fronts are fractals. The key idea is to exploit fractal transformations to provide unitary transformations between Hilbert spaces defined on attractors of iterated function systems. Some of the examples relate to work of Oxtoby and Ulam concerning ergodic flows on regions bounded by polygons.
△ Less
Submitted 10 September, 2014;
originally announced September 2014.
-
Scalable and Fault Tolerant Computation with the Sparse Grid Combination Technique
Authors:
Brendan Harding,
Markus Hegland,
Jay Larson,
James Southern
Abstract:
This paper continues to develop a fault tolerant extension of the sparse grid combination technique recently proposed in [B. Harding and M. Hegland, ANZIAM J., 54 (CTAC2012), pp. C394-C411]. The approach is novel for two reasons, first it provides several levels in which one can exploit parallelism leading towards massively parallel implementations, and second, it provides algorithm-based fault to…
▽ More
This paper continues to develop a fault tolerant extension of the sparse grid combination technique recently proposed in [B. Harding and M. Hegland, ANZIAM J., 54 (CTAC2012), pp. C394-C411]. The approach is novel for two reasons, first it provides several levels in which one can exploit parallelism leading towards massively parallel implementations, and second, it provides algorithm-based fault tolerance so that solutions can still be recovered if failures occur during computation. We present a generalisation of the combination technique from which the fault tolerant algorithm is a consequence. Using a model for the time between faults on each node of a high performance computer we provide bounds on the expected error for interpolation with this algorithm. Numerical experiments on the scalar advection PDE demonstrate that the algorithm is resilient to faults on a real application. It is observed that the trade-off of recovery time to decreased accuracy of the solution is suitably small. A comparison with traditional checkpoint-restart methods applied to the combination technique show that our approach is highly scalable with respect to the number of faults.
△ Less
Submitted 9 April, 2014;
originally announced April 2014.
-
Convergence rates in $\ell^1$-regularization when the basis is not smooth enough
Authors:
Jens Flemming,
Markus Hegland
Abstract:
Sparsity promoting regularization is an important technique for signal reconstruction and several other ill-posed problems. Theoretical investigation typically bases on the assumption that the unknown solution has a sparse representation with respect to a fixed basis. We drop this sparsity assumption and provide error estimates for non-sparse solutions. After discussing a result in this direction…
▽ More
Sparsity promoting regularization is an important technique for signal reconstruction and several other ill-posed problems. Theoretical investigation typically bases on the assumption that the unknown solution has a sparse representation with respect to a fixed basis. We drop this sparsity assumption and provide error estimates for non-sparse solutions. After discussing a result in this direction published earlier by one of the authors and coauthors we prove a similar error estimate under weaker assumptions. Two examples illustrate that this set of weaker assumptions indeed covers additional situations which appear in applications.
△ Less
Submitted 8 November, 2013;
originally announced November 2013.
-
Numerics and Fractals
Authors:
Michael F. Barnsley,
Markus Hegland,
Peter Massopust
Abstract:
Local iterated function systems are an important generalisation of the standard (global) iterated function systems (IFSs). For a particular class of map**s, their fixed points are the graphs of local fractal functions and these functions themselves are known to be the fixed points of an associated Read-Bajactarević operator. This paper establishes existence and properties of local fractal functi…
▽ More
Local iterated function systems are an important generalisation of the standard (global) iterated function systems (IFSs). For a particular class of map**s, their fixed points are the graphs of local fractal functions and these functions themselves are known to be the fixed points of an associated Read-Bajactarević operator. This paper establishes existence and properties of local fractal functions and discusses how they are computed. In particular, it is shown that piecewise polynomials are a special case of local fractal functions. Finally, we develop a method to compute the components of a local IFS from data or (partial differential) equations.
△ Less
Submitted 5 August, 2014; v1 submitted 4 September, 2013;
originally announced September 2013.
-
Sparse grid quadrature on products of spheres
Authors:
Markus Hegland,
Paul Leopardi
Abstract:
We examine sparse grid quadrature on weighted tensor products (WTP) of reproducing kernel Hilbert spaces on products of the unit sphere, in the case of worst case quadrature error for rules with arbitrary quadrature weights. We describe a dimension adaptive quadrature algorithm based on an algorithm of Hegland (2003), and also formulate a version of Wasilkowski and Wozniakowski's WTP algorithm (19…
▽ More
We examine sparse grid quadrature on weighted tensor products (WTP) of reproducing kernel Hilbert spaces on products of the unit sphere, in the case of worst case quadrature error for rules with arbitrary quadrature weights. We describe a dimension adaptive quadrature algorithm based on an algorithm of Hegland (2003), and also formulate a version of Wasilkowski and Wozniakowski's WTP algorithm (1999), here called the WW algorithm. We prove that the dimension adaptive algorithm is optimal in the sense of Dantzig (1957) and therefore no greater in cost than the WW algorithm. Both algorithms therefore have the optimal asymptotic rate of convergence given by Theorem 3 of Wasilkowski and Wozniakowski (1999). A numerical example shows that, even though the asymptotic convergence rate is optimal, if the dimension weights decay slowly enough, and the dimensionality of the problem is large enough, the initial convergence of the dimension adaptive algorithm can be slow.
△ Less
Submitted 22 January, 2015; v1 submitted 25 February, 2012;
originally announced February 2012.
-
On Tractability of Approximation for a Special Space of Functions
Authors:
Markus Hegland,
Greg W. Wasilkowski
Abstract:
We consider approximation problems for a special space of d variate functions. We show that the problems have small number of active variables, as it has been postulated in the past using concentration of measure arguments. We also show that, depending on the norm for measuring the error, the problems are strongly polynomially or quasi-polynomially tractable even in the model of computation where…
▽ More
We consider approximation problems for a special space of d variate functions. We show that the problems have small number of active variables, as it has been postulated in the past using concentration of measure arguments. We also show that, depending on the norm for measuring the error, the problems are strongly polynomially or quasi-polynomially tractable even in the model of computation where functional evaluations have the cost exponential in the number of active variables.
△ Less
Submitted 23 January, 2012;
originally announced January 2012.
-
Errors of regularisation under range inclusions using variable Hilbert scales
Authors:
Markus Hegland,
Bernd Hofmann
Abstract:
Based on the variable Hilbert scale interpolation inequality bounds for the error of regularisation methods are derived under range inclusions. In this context, new formulae for the modulus of continuity of the inverse of bounded operators with non-closed range are given. Even if one can show the equivalence of this approach to the version used previously in the literature, the new formulae and co…
▽ More
Based on the variable Hilbert scale interpolation inequality bounds for the error of regularisation methods are derived under range inclusions. In this context, new formulae for the modulus of continuity of the inverse of bounded operators with non-closed range are given. Even if one can show the equivalence of this approach to the version used previously in the literature, the new formulae and corresponding conditions are simpler than the former ones. Several examples from image processing and spectral enhancement illustrate how the new error bounds can be applied.
△ Less
Submitted 21 May, 2010;
originally announced May 2010.
-
Error bounds for spectral enhancement which are based on variable Hilbert scale inequalities
Authors:
Markus Hegland
Abstract:
Spectral enhancement -- which aims to undo spectral broadening -- leads to integral equations which are ill-posed and require special regularisation techniques for their solution. Even when an optimal regularisation technique is used, however, the errors in the solution -- which originate in data approximation errors -- can be substantial and it is important to have good bounds for these errors…
▽ More
Spectral enhancement -- which aims to undo spectral broadening -- leads to integral equations which are ill-posed and require special regularisation techniques for their solution. Even when an optimal regularisation technique is used, however, the errors in the solution -- which originate in data approximation errors -- can be substantial and it is important to have good bounds for these errors in order to select appropriate enhancement methods. A discussion of the causes and nature of broadening provides regularity or source conditions which are required to obtain bounds for the regularised solution of the spectral enhancement problem. The source conditions do only in special cases satisfy the requirements of the standard convergence theory for ill-posed problems. Instead we have to use variable Hilbert scales and their interpolation inequalities to get error bounds. The error bounds in this case turn out to be of the form $O(ε^{1-η(ε)})$ where $ε$ is the data error and $η(ε)$ is a function which tends to zero when $ε$ tends to zero. The approach is demonstrated with the Eddington correction formula and applied to a new spectral reconstruction technique for Voigt spectra. In this case $η(ε)=O(1/\sqrt{|\logε|})$ is found.
△ Less
Submitted 13 November, 2009;
originally announced November 2009.
-
A Stabilized Mixed Finite Element Method for Thin Plate Splines Based on Biorthogonal Systems
Authors:
Bishnu P. Lamichhane,
Markus Hegland
Abstract:
The thin plate spline is a popular tool for the interpolation and smoothing of scattered data. In this paper we propose a novel stabilized mixed finite element method for the discretization of thin plate splines. The mixed formulation is obtained by introducing the gradient of the smoother as an additional unknown. Working with a pair of bases for the gradient of the smoother and the Lagrange mult…
▽ More
The thin plate spline is a popular tool for the interpolation and smoothing of scattered data. In this paper we propose a novel stabilized mixed finite element method for the discretization of thin plate splines. The mixed formulation is obtained by introducing the gradient of the smoother as an additional unknown. Working with a pair of bases for the gradient of the smoother and the Lagrange multiplier which forms a biorthogonal system, we can easily eliminate these two variables (gradient of the smoother and Lagrange multiplier) leading to a positive definite formulation. The optimal a priori estimate is proved by using a superconvergence property of a gradient recovery operator.
△ Less
Submitted 9 May, 2013; v1 submitted 19 May, 2009;
originally announced May 2009.
-
Configurational Effects on Alfvenic modes and Confinement in the H-1NF Heliac
Authors:
B. D. Blackwell,
D. G. Pretty,
J. Howard,
R. Nazikian,
S. T. A. Kumar,
D. Oliver,
D. Byrne,
J. H. Harris,
C. A. Nuhrenberg,
M. McGann,
R. L. Dewar,
F. Detering,
M. Hegland,
G. I. Potter,
J. W. Read
Abstract:
The flexible Heliac coil set of helical axis stellarator H-1 (R=1m, <r>~0.15-0.2 m) permits access to a wide range of magnetic configurations. Surprisingly, in the absence of any obvious population of energetic particles, Alfven modes normally associated with energetic populations in larger fusion experiments are observed. Using H-1's unique combination of flexibility and advanced diagnostics, R…
▽ More
The flexible Heliac coil set of helical axis stellarator H-1 (R=1m, <r>~0.15-0.2 m) permits access to a wide range of magnetic configurations. Surprisingly, in the absence of any obvious population of energetic particles, Alfven modes normally associated with energetic populations in larger fusion experiments are observed. Using H-1's unique combination of flexibility and advanced diagnostics, RF-generated plasma in H-1 is shown to have a very complex dependence on configuration of both the electron density and fluctuations in the MHD Alfven range. Magnetic fluctuations range from highly coherent, often multi-frequency, to approaching broad-band (df/f ~ 0.02-0.5), in the range 1-200 kHz. Application of datamining techniques to a wide range of configurations classifies these fluctuations and extracts poloidal and toroidal mode numbers, revealing that a significant class of fluctuations exhibit scaling which is i) Alfvenic with electron density (within a constant factor) and ii) shear Alfvenic in rotational transform. This is confirmed by scans within a single pulse, which can follow mode conversions. An array of optical and interferometric diagnostics is combined with the magnetic probe arrays to provide initial information on the internal structure of the MHD modes, and associated 3D effects. The configurational dependence is closely related to the presence of low order rational surfaces; density falls to very low values near, but not precisely at these rational values. Results from a uniquely accurate magnetic field map** system, combined with a comprehensive model of the vacuum magnetic field in H-1 show that magnetic islands should not dominate the confinement of the configuration, and indicate that the dependence of density on configuration may be attributable to plasma generation effects.
△ Less
Submitted 27 February, 2009;
originally announced February 2009.
-
Dilational Hilbert Scales and Deconvolutional Sharpening
Authors:
Markus Hegland,
Robert S. Anderssen
Abstract:
Operationally, index functions of variable Hilbert scales can be viewed as generators for families of spaces and norms. Using a one parameter family of index functions based on the dilations of a given index function, a new class of scales (dilational Hilbert scales (DHS)) is derived which generates new interpolatory inequalities (dilational interpolatory inequalities (DII)) which have the ordin…
▽ More
Operationally, index functions of variable Hilbert scales can be viewed as generators for families of spaces and norms. Using a one parameter family of index functions based on the dilations of a given index function, a new class of scales (dilational Hilbert scales (DHS)) is derived which generates new interpolatory inequalities (dilational interpolatory inequalities (DII)) which have the ordinary Hilbert scales (OHS) interpolatory inequalities as special cases. They therefore represent a one-parameter family generalization of OHS, and are a precise and concise subset of VHS approriate for deriving error estimates for deconvolution. The role of the Hilbert scales in deriving error estimates for the approximate solution of inverse problems is discussed along with an application of DHS to deconvolution sharpening.
△ Less
Submitted 10 March, 2008;
originally announced March 2008.
-
Additive models in high dimensions
Authors:
Markus Hegland,
Vladimir Pestov
Abstract:
We discuss some aspects of approximating functions on high-dimensional data sets with additive functions or ANOVA decompositions, that is, sums of functions depending on fewer variables each. It is seen that under appropriate smoothness conditions, the errors of the ANOVA decompositions are of order $O(n^{m/2})$ for approximations using sums of functions of up to $m$ variables under some mild re…
▽ More
We discuss some aspects of approximating functions on high-dimensional data sets with additive functions or ANOVA decompositions, that is, sums of functions depending on fewer variables each. It is seen that under appropriate smoothness conditions, the errors of the ANOVA decompositions are of order $O(n^{m/2})$ for approximations using sums of functions of up to $m$ variables under some mild restrictions on the (possibly dependent) predictor variables. Several simulated examples illustrate this behaviour.
△ Less
Submitted 24 May, 2002; v1 submitted 30 December, 1999;
originally announced December 1999.
