-
Quantitative estimates: How well does the discrete Fourier transform approximate the Fourier transform on $\mathbb{R}$
Authors:
Martin Ehler,
Karlheinz Gröchenig,
Andreas Klotz
Abstract:
In order to compute the Fourier transform of a function $f$ on the real line numerically, one samples $f$ on a grid and then takes the discrete Fourier transform. We derive exact error estimates for this procedure in terms of the decay and smoothness of $f$. The analysis provides a new recipe of how to relate the number of samples, the sampling interval, and the grid size.
In order to compute the Fourier transform of a function $f$ on the real line numerically, one samples $f$ on a grid and then takes the discrete Fourier transform. We derive exact error estimates for this procedure in terms of the decay and smoothness of $f$. The analysis provides a new recipe of how to relate the number of samples, the sampling interval, and the grid size.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
Fitting Auditory Filterbanks with Multiresolution Neural Networks
Authors:
Vincent Lostanlen,
Daniel Haider,
Han Han,
Mathieu Lagrange,
Peter Balazs,
Martin Ehler
Abstract:
Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency responses become more irregular as their receptive fields grow. On the other hand, a parametric model such as LEAF is guaranteed to yield Gabor filters, hence an optima…
▽ More
Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency responses become more irregular as their receptive fields grow. On the other hand, a parametric model such as LEAF is guaranteed to yield Gabor filters, hence an optimal time-frequency localization; yet, this strong inductive bias comes at the detriment of representational capacity. In this paper, we aim to overcome this dilemma by introducing a neural audio model, named multiresolution neural network (MuReNN). The key idea behind MuReNN is to train separate convolutional operators over the octave subbands of a discrete wavelet transform (DWT). Since the scale of DWT atoms grows exponentially between octaves, the receptive fields of the subsequent learnable convolutions in MuReNN are dilated accordingly. For a given real-world dataset, we fit the magnitude response of MuReNN to that of a well-established auditory filterbank: Gammatone for speech, CQT for music, and third-octave for urban sounds, respectively. This is a form of knowledge distillation (KD), in which the filterbank ''teacher'' is engineered by domain knowledge while the neural network ''student'' is optimized from data. We compare MuReNN to the state of the art in terms of goodness of fit after KD on a hold-out set and in terms of Heisenberg time-frequency localization. Compared to convnets and Gabor convolutions, we find that MuReNN reaches state-of-the-art performance on all three optimization problems.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Convex Geometry of ReLU-layers, Injectivity on the Ball and Local Reconstruction
Authors:
Daniel Haider,
Martin Ehler,
Peter Balazs
Abstract:
The paper uses a frame-theoretic setting to study the injectivity of a ReLU-layer on the closed ball of $\mathbb{R}^n$ and its non-negative part. In particular, the interplay between the radius of the ball and the bias vector is emphasized. Together with a perspective from convex geometry, this leads to a computationally feasible method of verifying the injectivity of a ReLU-layer under reasonable…
▽ More
The paper uses a frame-theoretic setting to study the injectivity of a ReLU-layer on the closed ball of $\mathbb{R}^n$ and its non-negative part. In particular, the interplay between the radius of the ball and the bias vector is emphasized. Together with a perspective from convex geometry, this leads to a computationally feasible method of verifying the injectivity of a ReLU-layer under reasonable restrictions in terms of an upper bound of the bias vector. Explicit reconstruction formulas are provided, inspired by the duality concept from frame theory. All this gives rise to the possibility of quantifying the invertibility of a ReLU-layer and a concrete reconstruction algorithm for any input vector on the ball.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
t-design curves and mobile sampling on the sphere
Authors:
Martin Ehler,
Karlheinz Gröchenig
Abstract:
In analogy to classical spherical t-design points, we introduce the concept of t-design curves on the sphere. This means that the line integral along a t-design curve integrates polynomials of degree t exactly. For low degrees we construct explicit examples. We also derive lower asymptotic bounds on the lengths of t-design curves. Our main results prove the existence of asymptotically optimal t-de…
▽ More
In analogy to classical spherical t-design points, we introduce the concept of t-design curves on the sphere. This means that the line integral along a t-design curve integrates polynomials of degree t exactly. For low degrees we construct explicit examples. We also derive lower asymptotic bounds on the lengths of t-design curves. Our main results prove the existence of asymptotically optimal t-design curves in the Euclidean 2-sphere and the existence of t-design curves in the d-sphere.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
-
Gauss Quadrature for Freud Weights, Modulation Spaces, and Marcinkiewicz-Zygmund Inequalities
Authors:
Martin Ehler,
Karlheinz Gröchenig
Abstract:
We study Gauss quadrature for Freud weights and derive worst case error estimates for functions in a family of associated Sobolev spaces. For the Gaussian weight $e^{-πx^2}$ these spaces coincide with a class of modulation spaces which are well-known in (time-frequency) analysis and also appear under the name of Hermite spaces. Extensions are given to more general sets of nodes that are derived fr…
▽ More
We study Gauss quadrature for Freud weights and derive worst case error estimates for functions in a family of associated Sobolev spaces. For the Gaussian weight $e^{-πx^2}$ these spaces coincide with a class of modulation spaces which are well-known in (time-frequency) analysis and also appear under the name of Hermite spaces. Extensions are given to more general sets of nodes that are derived from Marcinkiewicz-Zygmund inequalities. This generalization can be interpreted as a stability result for Gauss quadrature.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
On the reconstruction accuracy of multi-coil MRI with orthogonal projections
Authors:
Anna Breger,
Gabriel Ramos Llorden,
Gonzalo Vegas Sanchez - Ferrero,
W. Scott Hoge,
Martin Ehler,
Carl-Fredrik Westin
Abstract:
MRI signal acquisition with multiple coils in a phased array is nowadays commonplace. The use of multiple receiver coils increases the signal-to-noise ratio (SNR) and enables accelerated parallel imaging methods. Some of these methods, like GRAPPA or SPIRiT, yield individual coil images in the k-space domain which need to be combined to form a final image. Coil combination is often the last step o…
▽ More
MRI signal acquisition with multiple coils in a phased array is nowadays commonplace. The use of multiple receiver coils increases the signal-to-noise ratio (SNR) and enables accelerated parallel imaging methods. Some of these methods, like GRAPPA or SPIRiT, yield individual coil images in the k-space domain which need to be combined to form a final image. Coil combination is often the last step of the image reconstruction, where the root sum of squares (rSOS) is frequently used. This straightforward method works well for coil images with high SNR, but can yield problems in images with artifacts or low SNR in all individual coils. We aim to analyze the final coil combination step in the framework of linear compression, including principal component analysis (PCA). With two data sets, a simulated and an in-vivo, we use random projections as a representation of the whole space of orthogonal projections. This allows us to study the impact of linear compression in the image space with diverse measures of reconstruction accuracy. In particular, the $L_2$ error, variance, SNR, and visual results serve as performance measures to describe the final image quality. We study their relationships and observe that the $L_2$ error and variance strongly correlate, but as expected minimal $L_2$ error does not necessarily correspond to the best visual results. In terms of visual evaluation and SNR, the compression with PCA outperforms all other methods, including rSOS on the uncompressed image space data.
△ Less
Submitted 27 November, 2019; v1 submitted 29 October, 2019;
originally announced October 2019.
-
Curve Based Approximation of Measures on Manifolds by Discrepancy Minimization
Authors:
Martin Ehler,
Manuel Gräf,
Sebastian Neumayer,
Gabriele Steidl
Abstract:
The approximation of probability measures on compact metric spaces and in particular on Riemannian manifoldsby atomic or empirical ones is a classical task in approximation and complexity theory with a wide range of applications. Instead of point measures we are concerned with the approximation by measures supported on Lipschitz curves. Special attention is paid to push-forward measures of Lebesgu…
▽ More
The approximation of probability measures on compact metric spaces and in particular on Riemannian manifoldsby atomic or empirical ones is a classical task in approximation and complexity theory with a wide range of applications. Instead of point measures we are concerned with the approximation by measures supported on Lipschitz curves. Special attention is paid to push-forward measures of Lebesgue measures on the interval by such curves. Using the discrepancy as distance between measures, we prove optimal approximation rates in terms of Lipschitz constants of curves. Having established the theoretical convergence rates, we are interested in the numerical minimization of the discrepancy between a given probability measure and the set of push-forward measures of Lebesgue measures on the interval by Lipschitz curves. We present numerical examples for measures on the 2- and 3-dimensional torus, the 2-sphere, the rotation group on $\mathbb R^3$ and the Grassmannian of all 2-dimensional linear subspaces of $\mathbb{R}^4$. Our algorithm of choice is a conjugate gradient method on these manifolds which incorporates second-oder information. For efficiently computing the gradients and the Hessians within the algorithm, we approximate the given measures by truncated Fourier series and use fast Fourier transform techniques on these manifolds.
△ Less
Submitted 11 January, 2021; v1 submitted 14 October, 2019;
originally announced October 2019.
-
Spectral decomposition of discrepancy kernels on the Euclidean ball, the special orthogonal group, and the Grassmannian manifold
Authors:
Josef Dick,
Martin Ehler,
Manuel Gräf,
Christian Krattenthaler
Abstract:
To numerically approximate Borel probability measures by finite atomic measures, we study the spectral decomposition of discrepancy kernels when restricted to compact subsets of $\mathbb{R}^d$. For restrictions to the Euclidean ball in odd dimensions, to the rotation group $SO(3)$, and to the Grassmannian manifold $\mathcal{G}_{2,4}$, we compute the kernels' Fourier coefficients and determine thei…
▽ More
To numerically approximate Borel probability measures by finite atomic measures, we study the spectral decomposition of discrepancy kernels when restricted to compact subsets of $\mathbb{R}^d$. For restrictions to the Euclidean ball in odd dimensions, to the rotation group $SO(3)$, and to the Grassmannian manifold $\mathcal{G}_{2,4}$, we compute the kernels' Fourier coefficients and determine their asymptotics. The $L_2$-discrepancy is then expressed in the Fourier domain that enables efficient numerical minimization based on the nonequispaced fast Fourier transform. For $SO(3)$, the nonequispaced fast Fourier transform is publicly available, and, for $\mathcal{G}_{2,4}$, the transform is derived here. We also provide numerical experiments for $SO(3)$ and $\mathcal{G}_{2,4}$.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
On orthogonal projections for dimension reduction and applications in augmented target loss functions for learning problems
Authors:
Anna Breger,
Jose Ignacio Orlando,
Pavol Harar,
Monika Dörfler,
Sophie Klimscha,
Christoph Grechenig,
Bianca S. Gerendas,
Ursula Schmidt-Erfurth,
Martin Ehler
Abstract:
The use of orthogonal projections on high-dimensional input and target data in learning frameworks is studied. First, we investigate the relations between two standard objectives in dimension reduction, preservation of variance and of pairwise relative distances. Investigations of their asymptotic correlation as well as numerical experiments show that a projection does usually not satisfy both obj…
▽ More
The use of orthogonal projections on high-dimensional input and target data in learning frameworks is studied. First, we investigate the relations between two standard objectives in dimension reduction, preservation of variance and of pairwise relative distances. Investigations of their asymptotic correlation as well as numerical experiments show that a projection does usually not satisfy both objectives at once. In a standard classification problem we determine projections on the input data that balance the objectives and compare subsequent results. Next, we extend our application of orthogonal projections to deep learning tasks and introduce a general framework of augmented target loss functions. These loss functions integrate additional information via transformations and projections of the target data. In two supervised learning problems, clinical image segmentation and music information classification, the application of our proposed augmented target loss functions increase the accuracy.
△ Less
Submitted 9 September, 2019; v1 submitted 22 January, 2019;
originally announced January 2019.
-
Asymptotically optimal cubature formulas on manifolds for prefixed weights
Authors:
Martin Ehler,
Ujué Etayo,
Bianca Gariboldi,
Giacomo Gigante,
Thomas Peter
Abstract:
We propose a new extension of the proof of the Korevaar-Meyers conjecture by Bondarenko, Radchenko and Viazovska for cubature formulas with prefixed weights (we fix different weights for different points) on algebraic and Riemannian manifolds.
We propose a new extension of the proof of the Korevaar-Meyers conjecture by Bondarenko, Radchenko and Viazovska for cubature formulas with prefixed weights (we fix different weights for different points) on algebraic and Riemannian manifolds.
△ Less
Submitted 25 March, 2020; v1 submitted 2 October, 2018;
originally announced October 2018.
-
A Randomized Multivariate Matrix Pencil Method for Superresolution Microscopy
Authors:
Martin Ehler,
Stefan Kunis,
Thomas Peter,
Christian Richter
Abstract:
The matrix pencil method is an eigenvalue based approach for the parameter identification of sparse exponential sums. We derive a reconstruction algorithm for multivariate exponential sums that is based on simultaneous diagonalization. Randomization is used and quantified to reduce the simultaneous diagonalization to the eigendecomposition of a single random matrix. To verify feasibility, the algo…
▽ More
The matrix pencil method is an eigenvalue based approach for the parameter identification of sparse exponential sums. We derive a reconstruction algorithm for multivariate exponential sums that is based on simultaneous diagonalization. Randomization is used and quantified to reduce the simultaneous diagonalization to the eigendecomposition of a single random matrix. To verify feasibility, the algorithm is applied to synthetic and experimental fluorescence microscopy data.
△ Less
Submitted 16 May, 2018; v1 submitted 7 May, 2018;
originally announced May 2018.
-
Optimal Monte Carlo integration on closed manifolds
Authors:
Martin Ehler,
Manuel Graef,
Chris. J. Oates
Abstract:
The worst case integration error in reproducing kernel Hilbert spaces of standard Monte Carlo methods with n random points decays as $n^{-1/2}$. However, re-weighting of random points can sometimes be used to improve the convergence order. This paper contributes general theoretical results for Sobolev spaces on closed Riemannian manifolds, where we verify that such re-weighting yields optimal appr…
▽ More
The worst case integration error in reproducing kernel Hilbert spaces of standard Monte Carlo methods with n random points decays as $n^{-1/2}$. However, re-weighting of random points can sometimes be used to improve the convergence order. This paper contributes general theoretical results for Sobolev spaces on closed Riemannian manifolds, where we verify that such re-weighting yields optimal approximation rates up to a logarithmic factor. We also provide numerical experiments matching the theoretical results for some Sobolev spaces on the unit sphere and on the Grassmannian manifold. Our theoretical findings also cover function spaces on more general sets such as the unit ball, the cube, and the simplex.
△ Less
Submitted 24 January, 2018; v1 submitted 15 July, 2017;
originally announced July 2017.
-
Cubatures on Grassmannians: moments, dimension reduction, and related topics
Authors:
Anna Breger,
Martin Ehler,
Manuel Graef,
Thomas Peter
Abstract:
We briefly explain the use of cubature points on Grassmannians in numerical analysis.
We briefly explain the use of cubature points on Grassmannians in numerical analysis.
△ Less
Submitted 8 May, 2017;
originally announced May 2017.
-
Points on manifolds with asymptotically optimal covering radius
Authors:
Anna Breger,
Martin Ehler,
Manuel Graef
Abstract:
Given a finite set of points on the Euclidean sphere, the worst case quadrature error in Sobolev spaces has recently been shown to provide upper bounds on the covering radius of the point set. Moreover, quasi-Monte Carlo integration points on the sphere achieve the asymptotically optimal covering radius. Here, we extend these results to points on compact smooth Riemannian manifolds and provide num…
▽ More
Given a finite set of points on the Euclidean sphere, the worst case quadrature error in Sobolev spaces has recently been shown to provide upper bounds on the covering radius of the point set. Moreover, quasi-Monte Carlo integration points on the sphere achieve the asymptotically optimal covering radius. Here, we extend these results to points on compact smooth Riemannian manifolds and provide numerical experiments illustrating our findings for the Grassmannian manifold.
△ Less
Submitted 23 July, 2016;
originally announced July 2016.
-
Quasi Monte Carlo integration and kernel-based function approximation on Grassmannians
Authors:
Anna Breger,
Martin Ehler,
Manuel Graef
Abstract:
Numerical integration and function approximation on compact Riemannian manifolds based on eigenfunctions of the Laplace-Beltrami operator have been widely studied in the recent literature. The standard example in numerical experiments is the Euclidean sphere. Here, we derive numerically feasible expressions for the approximation schemes on the Grassmannian manifold, and we present the associated n…
▽ More
Numerical integration and function approximation on compact Riemannian manifolds based on eigenfunctions of the Laplace-Beltrami operator have been widely studied in the recent literature. The standard example in numerical experiments is the Euclidean sphere. Here, we derive numerically feasible expressions for the approximation schemes on the Grassmannian manifold, and we present the associated numerical experiments on the Grassmannian. Indeed, our experiments illustrate and match the corresponding theoretical results in the literature.
△ Less
Submitted 18 January, 2017; v1 submitted 30 May, 2016;
originally announced May 2016.
-
From low to high-dimensional moments without magic
Authors:
Bernhard G. Bodmann,
Martin Ehler,
Manuel Graef
Abstract:
We aim to compute the first few moments of a high-dimensional random vector from the first few moments of a number of its low-dimensional projections. To this end, we identify algebraic conditions on the set of low-dimensional projectors that yield explicit reconstruction formulas. We also provide a computational framework, with which suitable projectors can be derived by solving an optimization p…
▽ More
We aim to compute the first few moments of a high-dimensional random vector from the first few moments of a number of its low-dimensional projections. To this end, we identify algebraic conditions on the set of low-dimensional projectors that yield explicit reconstruction formulas. We also provide a computational framework, with which suitable projectors can be derived by solving an optimization problem. Finally, we show that randomized projections permit approximate recovery.
△ Less
Submitted 1 September, 2017; v1 submitted 27 January, 2016;
originally announced January 2016.
-
Phase retrieval using random cubatures and fusion frames of positive semidefinite matrices
Authors:
Martin Ehler,
Manuel Graef,
Franz J. Kiraly
Abstract:
As a generalization of the standard phase retrieval problem, we seek to reconstruct symmetric rank-1 matrices from inner products with subclasses of positive semidefinite matrices. For such subclasses, we introduce random cubatures for spaces of multivariate polynomials based on moment conditions. The inner products with samples from sufficiently strong random cubatures allow the reconstruction of…
▽ More
As a generalization of the standard phase retrieval problem, we seek to reconstruct symmetric rank-1 matrices from inner products with subclasses of positive semidefinite matrices. For such subclasses, we introduce random cubatures for spaces of multivariate polynomials based on moment conditions. The inner products with samples from sufficiently strong random cubatures allow the reconstruction of symmetric rank-1 matrices with a decent probability by solving the feasibility problem of a semidefinite program.
△ Less
Submitted 19 May, 2015;
originally announced May 2015.
-
Optimal configurations of lines and a statistical application
Authors:
François Bachoc,
Martin Ehler,
Manuel Gräf
Abstract:
Motivated by the construction of confidence intervals in statistics, we study optimal configurations of $2^d-1$ lines in real projective space $RP^{d-1}$. For small $d$, we determine line sets that numerically minimize a wide variety of potential functions among all configurations of $2^d-1$ lines through the origin. Numerical experiments verify that our findings enable to assess efficiently the t…
▽ More
Motivated by the construction of confidence intervals in statistics, we study optimal configurations of $2^d-1$ lines in real projective space $RP^{d-1}$. For small $d$, we determine line sets that numerically minimize a wide variety of potential functions among all configurations of $2^d-1$ lines through the origin. Numerical experiments verify that our findings enable to assess efficiently the tightness of a bound arising from the statistical literature.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
-
Reproducing kernels for the irreducible components of polynomial spaces on unions of Grassmannians
Authors:
Martin Ehler,
Manuel Gräf
Abstract:
The decomposition of polynomial spaces on unions of Grassmannians $\mathcal G_{{k_1},d}\cup\ldots\cup \mathcal G_{{k_r},d}$ into irreducible orthogonally invariant subspaces and their reproducing kernels are investigated. We also generalize the concepts of cubature points and $t$-designs from single Grassmannians to unions. We derive their characterization as minimizers of a suitable energy potent…
▽ More
The decomposition of polynomial spaces on unions of Grassmannians $\mathcal G_{{k_1},d}\cup\ldots\cup \mathcal G_{{k_r},d}$ into irreducible orthogonally invariant subspaces and their reproducing kernels are investigated. We also generalize the concepts of cubature points and $t$-designs from single Grassmannians to unions. We derive their characterization as minimizers of a suitable energy potential to enable $t$-design constructions by numerical optimization. We also present new analytic families of $t$-designs for $t=1,2,3$.
△ Less
Submitted 15 May, 2018; v1 submitted 21 November, 2014;
originally announced November 2014.
-
The Algebraic Approach to Phase Retrieval and Explicit Inversion at the Identifiability Threshold
Authors:
Franz J Király,
Martin Ehler
Abstract:
We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that a certain number of generic rank-one or generic linear measurements are sufficient to enable signal reconstruction for generic signals, and slightly more gener…
▽ More
We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that a certain number of generic rank-one or generic linear measurements are sufficient to enable signal reconstruction for generic signals, and slightly more generic measurements yield reconstructability for all signals. Our results solve a few open problems stated in the recent literature. Furthermore, we show how the algebraic estimation problem can be solved by a closed-form algebraic estimation technique, termed ideal regression, providing non-asymptotic success guarantees.
△ Less
Submitted 17 February, 2014;
originally announced February 2014.
-
Quasi-Linear Compressed Sensing
Authors:
Martin Ehler,
Massimo Fornasier,
Juliane Sigl
Abstract:
Inspired by significant real-life applications, in particular, sparse phase retrieval and sparse pulsation frequency detection in Asteroseismology, we investigate a general framework for compressed sensing, where the measurements are quasi-linear. We formulate natural generalizations of the well-known Restricted Isometry Property (RIP) towards nonlinear measurements, which allow us to prove both u…
▽ More
Inspired by significant real-life applications, in particular, sparse phase retrieval and sparse pulsation frequency detection in Asteroseismology, we investigate a general framework for compressed sensing, where the measurements are quasi-linear. We formulate natural generalizations of the well-known Restricted Isometry Property (RIP) towards nonlinear measurements, which allow us to prove both unique identifiability of sparse signals as well as the convergence of recovery algorithms to compute them efficiently. We show that for certain randomized quasi-linear measurements, including Lipschitz perturbations of classical RIP matrices and phase retrieval from random projections, the proposed restricted isometry properties hold with high probability. We analyze a generalized Orthogonal Least Squares (OLS) under the assumption that magnitudes of signal entries to be recovered decay fast. Greed is good again, as we show that this algorithm performs efficiently in phase retrieval and asteroseismology. For situations where the decay assumption on the signal does not necessarily hold, we propose two alternative algorithms, which are natural generalizations of the well-known iterative hard and soft-thresholding. While these algorithms are rarely successful for the mentioned applications, we show their strong recovery guarantees for quasi-linear measurements which are Lipschitz perturbations of RIP matrices.
△ Less
Submitted 7 November, 2013;
originally announced November 2013.
-
Metric entropy, n-widths, and sampling of functions on manifolds
Authors:
Martin Ehler,
Frank Filbir
Abstract:
We first investigate on the asymptotics of the Kolmogorov metric entropy and nonlinear n-widths of approximation spaces on some function classes on manifolds and quasi-metric measure spaces. Secondly, we develop constructive algorithms to represent those functions within a prescribed accuracy. The constructions can be based on either spectral information or scattered samples of the target function…
▽ More
We first investigate on the asymptotics of the Kolmogorov metric entropy and nonlinear n-widths of approximation spaces on some function classes on manifolds and quasi-metric measure spaces. Secondly, we develop constructive algorithms to represent those functions within a prescribed accuracy. The constructions can be based on either spectral information or scattered samples of the target function. Our algorithmic scheme is asymptotically optimal in the sense of nonlinear n-widths and asymptotically optimal up to a logarithmic factor with respect to the metric entropy.
△ Less
Submitted 6 September, 2017; v1 submitted 6 November, 2013;
originally announced November 2013.
-
Tight and random nonorthogonal fusion frames
Authors:
Jameson Cahill,
Peter G. Casazza,
Martin Ehler,
Shidong Li
Abstract:
First we show that tight nonorthogonal fusion frames a relatively easy to com by. In order to do this we need to establish a classification of how to to wire a self adjoint operator as a product of (nonorthogonal) projection operators. We also discuss the link between nonorthogonal fusion frames and positive operator valued measures, we define and study a nonorthogonal fusion frame potential, and…
▽ More
First we show that tight nonorthogonal fusion frames a relatively easy to com by. In order to do this we need to establish a classification of how to to wire a self adjoint operator as a product of (nonorthogonal) projection operators. We also discuss the link between nonorthogonal fusion frames and positive operator valued measures, we define and study a nonorthogonal fusion frame potential, and we introduce the idea of random nonorthogonal fusion frames.
△ Less
Submitted 2 September, 2013;
originally announced September 2013.
-
Preconditioning filter bank decompositions using structured normalized tight frames
Authors:
Martin Ehler
Abstract:
We turn a given filter bank into a filtering scheme that provides perfect reconstruction, synthesis is the adjoint of the analysis part (so-called unitary filter banks), all filters have equal norm, and the essential features of the original filter bank are preserved. Unitary filter banks providing perfect reconstruction are induced by tight generalized frames, which enable signal decomposition us…
▽ More
We turn a given filter bank into a filtering scheme that provides perfect reconstruction, synthesis is the adjoint of the analysis part (so-called unitary filter banks), all filters have equal norm, and the essential features of the original filter bank are preserved. Unitary filter banks providing perfect reconstruction are induced by tight generalized frames, which enable signal decomposition using a set of linear operators. If, in addition, frame elements have equal norm, then the signal energy is spread through the various filter bank channels in some uniform fashion, which is often more suitable for further signal processing. We start with a given generalized frame whose elements allow for fast matrix vector multiplication, as for instance, convolution operators, and compute a normalized tight frame, for which signal analysis and synthesis still preserve those fast algorithmic schemes.
△ Less
Submitted 6 November, 2013; v1 submitted 3 May, 2013;
originally announced May 2013.
-
Signal reconstruction from the magnitude of subspace components
Authors:
Christine Bachoc,
Martin Ehler
Abstract:
We consider signal reconstruction from the norms of subspace components generalizing standard phase retrieval problems. In the deterministic setting, a closed reconstruction formula is derived when the subspaces satisfy certain cubature conditions, that require at least a quadratic number of subspaces. Moreover, we address reconstruction under the erasure of a subset of the norms; using the concep…
▽ More
We consider signal reconstruction from the norms of subspace components generalizing standard phase retrieval problems. In the deterministic setting, a closed reconstruction formula is derived when the subspaces satisfy certain cubature conditions, that require at least a quadratic number of subspaces. Moreover, we address reconstruction under the erasure of a subset of the norms; using the concepts of $p$-fusion frames and list decoding, we propose an algorithm that outputs a finite list of candidate signals, one of which is the correct one. In the random setting, we show that a set of subspaces chosen at random and of cardinality scaling linearly in the ambient dimension allows for exact reconstruction with high probability by solving the feasibility problem of a semidefinite program.
△ Less
Submitted 11 May, 2015; v1 submitted 26 September, 2012;
originally announced September 2012.
-
Tight p-fusion frames
Authors:
Christine Bachoc,
Martin Ehler
Abstract:
Fusion frames enable signal decompositions into weighted linear subspace components. For positive integers p, we introduce p-fusion frames, a sharpening of the notion of fusion frames. Tight p-fusion frames are closely related to the classical notions of designs and cubature formulas in Grassmann spaces and are analyzed with methods from harmonic analysis in the Grassmannians. We define the p-fusi…
▽ More
Fusion frames enable signal decompositions into weighted linear subspace components. For positive integers p, we introduce p-fusion frames, a sharpening of the notion of fusion frames. Tight p-fusion frames are closely related to the classical notions of designs and cubature formulas in Grassmann spaces and are analyzed with methods from harmonic analysis in the Grassmannians. We define the p-fusion frame potential, derive bounds for its value, and discuss the connections to tight p-fusion frames.
△ Less
Submitted 26 September, 2012; v1 submitted 9 January, 2012;
originally announced January 2012.
-
Probabilistic frames: An overview
Authors:
Martin Ehler,
Kasso A. Okoudjou
Abstract:
Finite frames can be viewed as mass points distributed in $N$-dimensional Euclidean space. As such they form a subclass of a larger and rich class of probability measures that we call probabilistic frames. We derive the basic properties of probabilistic frames, and we characterize one of their subclasses in terms of minimizers of some appropriate potential function. In addition, we survey a range…
▽ More
Finite frames can be viewed as mass points distributed in $N$-dimensional Euclidean space. As such they form a subclass of a larger and rich class of probability measures that we call probabilistic frames. We derive the basic properties of probabilistic frames, and we characterize one of their subclasses in terms of minimizers of some appropriate potential function. In addition, we survey a range of areas where probabilistic frames, albeit, under different names, appear. These areas include directional statistics, the geometry of convex bodies, and the theory of t-designs.
△ Less
Submitted 10 August, 2011;
originally announced August 2011.
-
Random Tight Frames
Authors:
Martin Ehler
Abstract:
We introduce probabilistic frames to study finite frames whose elements are chosen at random. While finite tight frames generalize orthonormal bases by allowing redundancy, independent, uniformly distributed points on the sphere approximately form a finite unit norm tight frame (FUNTF). In the present paper, we develop probabilistic versions of tight frames and FUNTFs to significantly weaken the r…
▽ More
We introduce probabilistic frames to study finite frames whose elements are chosen at random. While finite tight frames generalize orthonormal bases by allowing redundancy, independent, uniformly distributed points on the sphere approximately form a finite unit norm tight frame (FUNTF). In the present paper, we develop probabilistic versions of tight frames and FUNTFs to significantly weaken the requirements on the random choice of points to obtain an approximate finite tight frame. Namely, points can be chosen from any probabilistic tight frame, they do not have to be identically distributed, nor have unit norm. We also observe that classes of random matrices used in compressed sensing are induced by probabilistic tight frames.
△ Less
Submitted 20 April, 2011; v1 submitted 20 February, 2011;
originally announced February 2011.
-
Minimization of the Probabilistic p-frame Potential
Authors:
Martin Ehler,
Kasso A. Okoudjou
Abstract:
We investigate the optimal configurations of n points on the unit sphere for a class of potential functions. In particular, we characterize these optimal configurations in terms of their approximation properties within frame theory. Furthermore, we consider similar optimal configurations in terms of random distributions of points on the sphere. In this probabilistic setting, we characterize these…
▽ More
We investigate the optimal configurations of n points on the unit sphere for a class of potential functions. In particular, we characterize these optimal configurations in terms of their approximation properties within frame theory. Furthermore, we consider similar optimal configurations in terms of random distributions of points on the sphere. In this probabilistic setting, we characterize these optimal distributions by means of special classes of probabilistic frames. Our work also indicates some connections between statistical shape analysis and frame theory.
△ Less
Submitted 20 April, 2011; v1 submitted 30 December, 2010;
originally announced January 2011.
-
Shrinkage Rules for Variational Minimization Problems and Applications to Analytical Ultracentrifugation
Authors:
Martin Ehler
Abstract:
Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of this type have to be solved multiple times, one needs fast algorithms to compute these minimizers. Identifying the exact minimizers is computationally expensive.…
▽ More
Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of this type have to be solved multiple times, one needs fast algorithms to compute these minimizers. Identifying the exact minimizers is computationally expensive. We consider minimization up to a constant factor to circumvent this limitation. We verify that q-dependent modifications of shrinkage rules provide closed formulas for such minimizers. Therefore, their computation is extremely fast. We also introduce a new shrinkage rule which is adapted to q. To support the theoretical results, the proposed method is applied to Landweber iteration with shrinkage used at each iteration step. This approach is utilized to solve the ill-posed problem of analytic ultracentrifugation, a method to determine the size distribution of macromolecules. For relatively pure solutes, our proposed scheme leads to sparser solutions with sharper peaks, higher resolution, and smaller residuals than standard regularization for this problem.
△ Less
Submitted 30 December, 2010;
originally announced January 2011.
