-
Reconstruction algorithms for source term recovery from dynamical samples in catalyst models
Authors:
Akram Aldroubi,
Le Gong,
Ilya Krishtal,
Brendan Miller,
Sumati Thareja
Abstract:
This paper investigates the problem of recovering source terms in abstract initial value problems (IVP) commonly used to model various scientific phenomena in physics, chemistry, economics, and other fields. We consider source terms of the form $F=h+η$, where $η$ is a Lipschitz continuous background source. The primary objective is to estimate the unknown parameters of non-instantaneous sources…
▽ More
This paper investigates the problem of recovering source terms in abstract initial value problems (IVP) commonly used to model various scientific phenomena in physics, chemistry, economics, and other fields. We consider source terms of the form $F=h+η$, where $η$ is a Lipschitz continuous background source. The primary objective is to estimate the unknown parameters of non-instantaneous sources $h(t)=\sum\limits_{j=0}^M h_je^{-ρ_j(t-t_j)}χ_{[t_j,\infty)}(t)$, such as the decay rates, initial intensities and activation times. We present two novel recovery algorithms that employ distinct sampling methods of the solution of the IVP. Algorithm 1 combines discrete and weighted average measurements, whereas Algorithm 2 uses a different variant of weighted average measurements. We analyze the performance of these algorithms, providing upper bounds on the recovery errors of the model parameters. Our focus is on the structure of the dynamical samples used by the algorithms and on the error guarantees they yield.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
Characterization of frames for source recovery from dynamical samples
Authors:
Akram Aldroubi,
Rocio Diaz Martin,
Le Gong,
Javad Mashreghi,
Ivan Medri
Abstract:
In this paper, we address the problem of recovering constant source terms in a discrete dynamical system represented by $x_{n+1} = Ax_n + w$, where $x_n$ is the $n$-th state in a Hilbert space $\mathcal{H}$, $A$ is a bounded linear operator in $\mathcal{B}(\mathcal{H})$, and $w$ is a source term within a closed subspace $W$ of $\HH$. Our focus is on the stable recovery of $w$ using time-space samp…
▽ More
In this paper, we address the problem of recovering constant source terms in a discrete dynamical system represented by $x_{n+1} = Ax_n + w$, where $x_n$ is the $n$-th state in a Hilbert space $\mathcal{H}$, $A$ is a bounded linear operator in $\mathcal{B}(\mathcal{H})$, and $w$ is a source term within a closed subspace $W$ of $\HH$. Our focus is on the stable recovery of $w$ using time-space sample measurements formed by inner products with vectors from a Bessel system $\mathcal{G} \subset \mathcal{H}$. We establish the necessary and sufficient conditions for the recovery of $w$ from these measurements, independent of the unknown initial state $x_0$ and for any $w \in W$. This research is particularly relevant to applications such as environmental monitoring, where precise source identification is critical.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
Dynamical Sampling for the Recovery of Spatially Constant Source Terms in Dynamical Systems
Authors:
Akram Aldroubi,
Rocio Diaz Martin,
Ivan Medri
Abstract:
In this paper, we investigate the problem of source recovery in a dynamical system utilizing space-time samples. This is a specific issue within the broader field of dynamical sampling, which involves collecting samples from solutions to a differential equation across both space and time with the aim of recovering critical data, such as initial values, the sources, the driving operator, or other r…
▽ More
In this paper, we investigate the problem of source recovery in a dynamical system utilizing space-time samples. This is a specific issue within the broader field of dynamical sampling, which involves collecting samples from solutions to a differential equation across both space and time with the aim of recovering critical data, such as initial values, the sources, the driving operator, or other relevant details. Our focus in this study is the recovery of unknown, stationary sources across both space and time, leveraging space-time samples. This research may have significant applications; for instance, it could provide a model for strategically placing devices to measure the quantity of pollutants emanating from factory smokestacks and dispersing across a specific area. Space-time samples could be collected using measuring devices placed at various spatial locations and activated at different times. We present necessary and sufficient conditions for the positioning of these measuring devices to successfully resolve this dynamical sampling problem. This paper provides both a theoretical foundation for the recovery of sources in dynamical systems and potential practical applications.
△ Less
Submitted 2 August, 2023;
originally announced August 2023.
-
Recovery of rapidly decaying source terms from dynamical samples in evolution equations
Authors:
Akram Aldroubi,
Le Gong,
Ilya Krishtal
Abstract:
We analyze the problem of recovering a source term of the form $h(t)=\sum_{j}h_jφ(t-t_j)χ_{[t_j, \infty)}(t)$ from space-time samples of the solution $u$ of an initial value problem in a Hilbert space of functions. In the expression of $h$, the terms $h_j$ belong to the Hilbert space, while $φ$ is a generic real-valued function with exponential decay at $\infty$. The design of the sampling strateg…
▽ More
We analyze the problem of recovering a source term of the form $h(t)=\sum_{j}h_jφ(t-t_j)χ_{[t_j, \infty)}(t)$ from space-time samples of the solution $u$ of an initial value problem in a Hilbert space of functions. In the expression of $h$, the terms $h_j$ belong to the Hilbert space, while $φ$ is a generic real-valued function with exponential decay at $\infty$. The design of the sampling strategy takes into account noise in measurements and the existence of a background source.
△ Less
Submitted 29 August, 2022;
originally announced August 2022.
-
Signed Cumulative Distribution Transform for Parameter Estimation of 1-D Signals
Authors:
Sumati Thareja,
Gustavo Rohde,
Rocio Diaz Martin,
Ivan Medri,
Akram Aldroubi
Abstract:
We describe a method for signal parameter estimation using the signed cumulative distribution transform (SCDT), a recently introduced signal representation tool based on optimal transport theory. The method builds upon signal estimation using the cumulative distribution transform (CDT) originally introduced for positive distributions. Specifically, we show that Wasserstein-type distance minimizati…
▽ More
We describe a method for signal parameter estimation using the signed cumulative distribution transform (SCDT), a recently introduced signal representation tool based on optimal transport theory. The method builds upon signal estimation using the cumulative distribution transform (CDT) originally introduced for positive distributions. Specifically, we show that Wasserstein-type distance minimization can be performed simply using linear least squares techniques in SCDT space for arbitrary signal classes, thus providing a global minimizer for the estimation problem even when the underlying signal is a nonlinear function of the unknown parameters. Comparisons to current signal estimation methods using $L_p$ minimization shows the advantage of the method.
△ Less
Submitted 16 July, 2022;
originally announced July 2022.
-
Predictive algorithms in dynamical sampling for burst-like forcing terms
Authors:
Akram Aldroubi,
Longxiu Huang,
Keri Kornelson,
Ilya Krishtal
Abstract:
In this paper, we consider the problem of recovery of a burst-like forcing term in an initial value problem (IVP) in the framework of dynamical sampling. We introduce an idea of using two particular classes of samplers that allow one to predict the solution of the IVP over a time interval without a burst. This leads to two different algorithms that stably and accurately approximate the burst-like…
▽ More
In this paper, we consider the problem of recovery of a burst-like forcing term in an initial value problem (IVP) in the framework of dynamical sampling. We introduce an idea of using two particular classes of samplers that allow one to predict the solution of the IVP over a time interval without a burst. This leads to two different algorithms that stably and accurately approximate the burst-like forcing term even in the presence of a measurement acquisition error and a large background source.
△ Less
Submitted 1 September, 2021;
originally announced September 2021.
-
The Signed Cumulative Distribution Transform for 1-D Signal Analysis and Classification
Authors:
Akram Aldroubi,
Rocio Diaz Martin,
Ivan Medri,
Gustavo K. Rohde,
Sumati Thareja
Abstract:
This paper presents a new mathematical signal transform that is especially suitable for decoding information related to non-rigid signal displacements. We provide a measure theoretic framework to extend the existing Cumulative Distribution Transform [ACHA 45 (2018), no. 3, 616-641] to arbitrary (signed) signals on $\overline{\mathbb{R}}$. We present both forward (analysis) and inverse (synthesis)…
▽ More
This paper presents a new mathematical signal transform that is especially suitable for decoding information related to non-rigid signal displacements. We provide a measure theoretic framework to extend the existing Cumulative Distribution Transform [ACHA 45 (2018), no. 3, 616-641] to arbitrary (signed) signals on $\overline{\mathbb{R}}$. We present both forward (analysis) and inverse (synthesis) formulas for the transform, and describe several of its properties including translation, scaling, convexity, linear separability and others. Finally, we describe a metric in transform space, and demonstrate the application of the transform in classifying (detecting) signals under random displacements.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
Partitioning signal classes using transport transforms for data analysis and machine learning
Authors:
Akram Aldroubi,
Shiying Li,
Gustavo K. Rohde
Abstract:
A relatively new set of transport-based transforms (CDT, R-CDT, LOT) have shown their strength and great potential in various image and data processing tasks such as parametric signal estimation, classification, cancer detection among many others. It is hence worthwhile to elucidate some of the mathematical properties that explain the successes of these transforms when they are used as tools in da…
▽ More
A relatively new set of transport-based transforms (CDT, R-CDT, LOT) have shown their strength and great potential in various image and data processing tasks such as parametric signal estimation, classification, cancer detection among many others. It is hence worthwhile to elucidate some of the mathematical properties that explain the successes of these transforms when they are used as tools in data analysis, signal processing or data classification. In particular, we give conditions under which classes of signals that are created by algebraic generative models are transformed into convex sets by the transport transforms. Such convexification of the classes simplify the classification and other data analysis and processing problems when viewed in the transform domain. More specifically, we study the extent and limitation of the convexification ability of these transforms under an algebraic generative modeling framework. We hope that this paper will serve as an introduction to these transforms and will encourage mathematicians and other researchers to further explore the theoretical underpinnings and algorithmic tools that will help understand the successes of these transforms and lay the groundwork for further successful applications.
△ Less
Submitted 24 February, 2021; v1 submitted 8 August, 2020;
originally announced August 2020.
-
Sampling the flow of a bandlimited function
Authors:
Akram Aldroubi,
Karlheinz Gröchenig,
Longxiu Huang,
Philippe Jaming,
Ilya Krishtal,
José Luis Romero
Abstract:
We analyze the problem of reconstruction of a bandlimited function $f$ from the space-time samples of its states $f_t=φ_t\ast f$ resulting from the convolution with a kernel $φ_t$. It is well-known that, in natural phenomena, uniform space-time samples of $f$ are not sufficient to reconstruct $f$ in a stable way. To enable stable reconstruction, a space-time sampling with periodic nonuniformly spa…
▽ More
We analyze the problem of reconstruction of a bandlimited function $f$ from the space-time samples of its states $f_t=φ_t\ast f$ resulting from the convolution with a kernel $φ_t$. It is well-known that, in natural phenomena, uniform space-time samples of $f$ are not sufficient to reconstruct $f$ in a stable way. To enable stable reconstruction, a space-time sampling with periodic nonuniformly spaced samples must be used as was shown by Lu and Vetterli. We show that the stability of reconstruction, as measured by a condition number, controls the maximal gap between the spacial samples. We provide a quantitative statement of this result. In addition, instead of irregular space-time samples, we show that uniform dynamical samples at sub-Nyquist spatial rate allow one to stably reconstruct the function $\widehat f$ away from certain, explicitly described blind spots. We also consider several classes of finite dimensional subsets of bandlimited functions in which the stable reconstruction is possible, even inside the blind spots. We obtain quantitative estimates for it using Remez-Turán type inequalities. En route, we obtain a Remez-Turán inequality for prolate spheroidal wave functions. To illustrate our results, we present some numerics and explicit estimates for the heat flow problem.
△ Less
Submitted 3 February, 2021; v1 submitted 29 April, 2020;
originally announced April 2020.
-
Radon cumulative distribution transform subspace modeling for image classification
Authors:
Mohammad Shifat-E-Rabbi,
Xuwang Yin,
Abu Hasnat Mohammad Rubaiyat,
Shiying Li,
Soheil Kolouri,
Akram Aldroubi,
Jonathan M. Nichols,
Gustavo K. Rohde
Abstract:
We present a new supervised image classification method applicable to a broad class of image deformation models. The method makes use of the previously described Radon Cumulative Distribution Transform (R-CDT) for image data, whose mathematical properties are exploited to express the image data in a form that is more suitable for machine learning. While certain operations such as translation, scal…
▽ More
We present a new supervised image classification method applicable to a broad class of image deformation models. The method makes use of the previously described Radon Cumulative Distribution Transform (R-CDT) for image data, whose mathematical properties are exploited to express the image data in a form that is more suitable for machine learning. While certain operations such as translation, scaling, and higher-order transformations are challenging to model in native image space, we show the R-CDT can capture some of these variations and thus render the associated image classification problems easier to solve. The method -- utilizing a nearest-subspace algorithm in R-CDT space -- is simple to implement, non-iterative, has no hyper-parameters to tune, is computationally efficient, label efficient, and provides competitive accuracies to state-of-the-art neural networks for many types of classification problems. In addition to the test accuracy performances, we show improvements (with respect to neural network-based methods) in terms of computational efficiency (it can be implemented without the use of GPUs), number of training samples needed for training, as well as out-of-distribution generalization. The Python code for reproducing our results is available at https://github.com/rohdelab/rcdt_ns_classifier.
△ Less
Submitted 2 March, 2022; v1 submitted 7 April, 2020;
originally announced April 2020.
-
Local-to-global frames and applications to dynamical sampling problem
Authors:
Akram Aldroubi,
Carlos Cabrelli,
Ursula Molter,
Armenak Petrosyan
Abstract:
In this paper we consider systems of vectors in a Hilbert space $\mathcal{H}$ of the form $\{g_{jk}: j \in J, \, k\in K\}\subset \mathcal{H}$ where $J$ and $K$ are countable sets of indices. We find conditions under which the local reconstruction properties of such a system extend to global stable recovery properties on the whole space. As a particular case, we obtain new local-to-global results f…
▽ More
In this paper we consider systems of vectors in a Hilbert space $\mathcal{H}$ of the form $\{g_{jk}: j \in J, \, k\in K\}\subset \mathcal{H}$ where $J$ and $K$ are countable sets of indices. We find conditions under which the local reconstruction properties of such a system extend to global stable recovery properties on the whole space. As a particular case, we obtain new local-to-global results for systems of type $\{A^ng\}_{g\in\mathcal{G},0\leq n\leq L }$ arising in the dynamical sampling problem.
△ Less
Submitted 6 September, 2019;
originally announced September 2019.
-
Dynamical sampling with additive random noise
Authors:
Akram Aldroubi,
Longxiu Huang,
Ilya Krishtal,
Akos Ledeczi,
Roy R. Lederman,
Peter Volgyesi
Abstract:
Dynamical sampling deals with signals that evolve in time under the action of a linear operator. The purpose of the present paper is to analyze the performance of the basic dynamical sampling algorithms in the finite dimensional case and study the impact of additive noise. The algorithms are implemented and tested on synthetic and real data sets, and denoising techniques are integrated to mitigate…
▽ More
Dynamical sampling deals with signals that evolve in time under the action of a linear operator. The purpose of the present paper is to analyze the performance of the basic dynamical sampling algorithms in the finite dimensional case and study the impact of additive noise. The algorithms are implemented and tested on synthetic and real data sets, and denoising techniques are integrated to mitigate the effect of the noise. We also develop theoretical and numerical results that validate the algorithm for recovering the driving operators, which are defined via a real symmetric convolution.
△ Less
Submitted 14 October, 2018; v1 submitted 27 July, 2018;
originally announced July 2018.
-
Frames Induced by the Action of Continuous Powers of an Operator
Authors:
Akram Aldroubi,
Longxiu Huang,
Armenak Petrosyan
Abstract:
We investigate systems of the form $\{A^tg:g\in\mathcal{G},t\in[0,L]\}$ where $A \in B(\mathcal{H})$ is a normal operator in a separable Hilbert space $\mathcal{H}$, $\mathcal{G}\subset \mathcal{H}$ is a countable set, and $L$ is a positive real number. Although the main goal of this work is to study the frame properties of $\{A^tg:g\in\mathcal{G},t\in[0,L]\}$, as intermediate steps, we explore th…
▽ More
We investigate systems of the form $\{A^tg:g\in\mathcal{G},t\in[0,L]\}$ where $A \in B(\mathcal{H})$ is a normal operator in a separable Hilbert space $\mathcal{H}$, $\mathcal{G}\subset \mathcal{H}$ is a countable set, and $L$ is a positive real number. Although the main goal of this work is to study the frame properties of $\{A^tg:g\in\mathcal{G},t\in[0,L]\}$, as intermediate steps, we explore the completeness and Bessel properties of such systems from a theoretical perspective, which are of interest by themselves. Beside the theoretical appeal of investigating such systems, their connections to dynamical and mobile sampling make them fundamental for understanding and solving several major problems in engineering and science.
△ Less
Submitted 21 February, 2019; v1 submitted 30 January, 2018;
originally announced January 2018.
-
CUR Decompositions, Similarity Matrices, and Subspace Clustering
Authors:
Akram Aldroubi,
Keaton Hamm,
Ahmet Bugra Koku,
Ali Sekmen
Abstract:
A general framework for solving the subspace clustering problem using the CUR decomposition is presented. The CUR decomposition provides a natural way to construct similarity matrices for data that come from a union of unknown subspaces $\mathscr{U}=\underset{i=1}{\overset{M}\bigcup}S_i$. The similarity matrices thus constructed give the exact clustering in the noise-free case. Additionally, this…
▽ More
A general framework for solving the subspace clustering problem using the CUR decomposition is presented. The CUR decomposition provides a natural way to construct similarity matrices for data that come from a union of unknown subspaces $\mathscr{U}=\underset{i=1}{\overset{M}\bigcup}S_i$. The similarity matrices thus constructed give the exact clustering in the noise-free case. Additionally, this decomposition gives rise to many distinct similarity matrices from a given set of data, which allow enough flexibility to perform accurate clustering of noisy data. We also show that two known methods for subspace clustering can be derived from the CUR decomposition. An algorithm based on the theoretical construction of similarity matrices is presented, and experiments on synthetic and real data are presented to test the method.
Additionally, an adaptation of our CUR based similarity matrices is utilized to provide a heuristic algorithm for subspace clustering; this algorithm yields the best overall performance to date for clustering the Hopkins155 motion segmentation dataset.
△ Less
Submitted 11 December, 2018; v1 submitted 11 November, 2017;
originally announced November 2017.
-
Phaseless Reconstruction from Space-Time Samples
Authors:
Akram Aldroubi,
llya krishtal,
Sui Tang
Abstract:
Phaseless reconstruction from space-time samples is a nonlinear problem of recovering a function $x$ in a Hilbert space $\mathcal{H}$ from the modulus of linear measurements $\{\lvert \langle x, φ_i\rangle \rvert$, $ \ldots$, $\lvert \langle A^{L_i}x, φ_i \rangle \rvert : i \in\mathscr I\}$, where $\{φ_i; i \in\mathscr I\}\subset \mathcal{H}$ is a set of functionals on $\mathcal{H}$, and $A$ is a…
▽ More
Phaseless reconstruction from space-time samples is a nonlinear problem of recovering a function $x$ in a Hilbert space $\mathcal{H}$ from the modulus of linear measurements $\{\lvert \langle x, φ_i\rangle \rvert$, $ \ldots$, $\lvert \langle A^{L_i}x, φ_i \rangle \rvert : i \in\mathscr I\}$, where $\{φ_i; i \in\mathscr I\}\subset \mathcal{H}$ is a set of functionals on $\mathcal{H}$, and $A$ is a bounded operator on $\mathcal{H}$ that acts as an evolution operator. In this paper, we provide various sufficient or necessary conditions for solving this problem, which has connections to $X$-ray crystallography, the scattering transform, and deep learning.
△ Less
Submitted 16 June, 2017;
originally announced June 2017.
-
Dynamical sampling and systems from iterative actions of operators
Authors:
Akram Aldroubi,
Armenak Petrosyan
Abstract:
We review some of the recent developments and prove new results concerning frames and Bessel systems generated by iterations of the form $\{A^ng: g\in G,\, n=0,1,2,\dots \}$, where $A$ is a bounded linear operators on a separable complex Hilbert space $ \mathcal{H} $ and $G$ is a countable set of vectors in $ \mathcal{H} $. The system of iterations mentioned above was motivated from the so called…
▽ More
We review some of the recent developments and prove new results concerning frames and Bessel systems generated by iterations of the form $\{A^ng: g\in G,\, n=0,1,2,\dots \}$, where $A$ is a bounded linear operators on a separable complex Hilbert space $ \mathcal{H} $ and $G$ is a countable set of vectors in $ \mathcal{H} $. The system of iterations mentioned above was motivated from the so called dynamical sampling problem. In dynamical sampling, an unknown function $f$ and its future states $A^nf$ are coarsely sampled at each time level $n$, $0\leq n< L$, where $A$ is an evolution operator that drives the system. The goal is to recover $f$ from these space-time samples.
△ Less
Submitted 30 October, 2016; v1 submitted 9 June, 2016;
originally announced June 2016.
-
Iterative actions of normal operators
Authors:
A. Aldroubi,
C. Cabrelli,
A. F. Çakmak,
U. Molter,
A. Petrosyan
Abstract:
Let $A$ be a normal operator in a Hilbert space $\mathcal{H}$, and let $\mathcal{G} \subset \mathcal{H}$ be a countable set of vectors. We investigate the relations between $A$, $\mathcal{G}$ , and $L$ that makes the system of iterations $\{A^ng: g\in \mathcal{G},\;0\leq n< L(g)\}$ complete, Bessel, a basis, or a frame for $\mathcal{H}$. The problem is motivated by the dynamical sampling problem a…
▽ More
Let $A$ be a normal operator in a Hilbert space $\mathcal{H}$, and let $\mathcal{G} \subset \mathcal{H}$ be a countable set of vectors. We investigate the relations between $A$, $\mathcal{G}$ , and $L$ that makes the system of iterations $\{A^ng: g\in \mathcal{G},\;0\leq n< L(g)\}$ complete, Bessel, a basis, or a frame for $\mathcal{H}$. The problem is motivated by the dynamical sampling problem and is connected to several topics in functional analysis, including, frame theory and spectral theory. It also has relations to topics in applied harmonic analysis including, wavelet theory and time-frequency analysis.
△ Less
Submitted 1 November, 2016; v1 submitted 14 February, 2016;
originally announced February 2016.
-
Krylov Subspace Methods in Dynamical Sampling
Authors:
Akram Aldroubi,
Ilya Krishtal
Abstract:
Let $B$ be an unknown linear evolution process on $\mathbb C^d\simeq l^2(\mathbb Z_d)$ driving an unknown initial state $x$ and producing the states $\{B^\ell x, \ell = 0,1,\ldots\}$ at different time levels. The problem under consideration in this paper is to find as much information as possible about $B$ and $x$ from the measurements $Y=\{x(i)$, $Bx(i)$, $\dots$,…
▽ More
Let $B$ be an unknown linear evolution process on $\mathbb C^d\simeq l^2(\mathbb Z_d)$ driving an unknown initial state $x$ and producing the states $\{B^\ell x, \ell = 0,1,\ldots\}$ at different time levels. The problem under consideration in this paper is to find as much information as possible about $B$ and $x$ from the measurements $Y=\{x(i)$, $Bx(i)$, $\dots$, $B^{\ell_i}x(i): i \in Ω\subset \mathbb Z^d\}$. If $B$ is a "low-pass" convolution operator, we show that we can recover both $B$ and $x$, almost surely, as long as we double the amount of temporal samples needed in \cite{ADK13} to recover the signal propagated by a known operator $B$. For a general operator $B$, we can recover parts or even all of its spectrum from $Y$. As a special case of our method, we derive the centuries old Prony's method \cite{BDVMC08, P795, PP13} which recovers a vector with an $s$-sparse Fourier transform from $2s$ of its consecutive components.
△ Less
Submitted 3 December, 2014;
originally announced December 2014.
-
Dynamical sampling
Authors:
A. Aldroubi,
C. Cabrelli,
U. Molter,
S. Tang
Abstract:
Let Y={f(i), Af(i),..., A^{li} f(i): i in Omega}, where A is a bounded operator on l^2(I). The problem under consideration is to find necessary and sufficient conditions on A, Omega, {l_i:i in Omega} in order to recover any f \in l^2(I) from the measurements Y. This is the so called dynamical sampling problem in which we seek to recover a function f by combining coarse samples of f and its futures…
▽ More
Let Y={f(i), Af(i),..., A^{li} f(i): i in Omega}, where A is a bounded operator on l^2(I). The problem under consideration is to find necessary and sufficient conditions on A, Omega, {l_i:i in Omega} in order to recover any f \in l^2(I) from the measurements Y. This is the so called dynamical sampling problem in which we seek to recover a function f by combining coarse samples of f and its futures states A^l f. We completely solve this problem in finite dimensional spaces, and for a large class of self adjoint operators in infinite dimensional spaces. In the latter case, the Müntz-Szász Theorem combined with the Kadison-Singer/Feichtinger Theorem allows us to show that Y can never be a Riesz basis when Omega is finite. We can also show that, when Omega is finite, Y={f(i), Af(i),..., A^{li}f(i): i in Omega} is not a frame except for some very special cases. The existence of these special cases is derived from Carleson's Theorem for interpolating sequences in the Hardy space H^2(D).
△ Less
Submitted 29 September, 2014;
originally announced September 2014.
-
Exact Reconstruction of Spatially Undersampled Signals in Evolutionary Systems
Authors:
Akram Aldroubi,
Jacqueline Davis,
Ilya Krishtal
Abstract:
We consider the problem of spatiotemporal sampling in which an initial state $f$ of an evolution process $f_t=A_tf$ is to be recovered from a combined set of coarse samples from varying time levels $\{t_1,\dots,t_N\}$. This new way of sampling, which we call dynamical sampling, differs from standard sampling since at any fixed time $t_i$ there are not enough samples to recover the function $f$ or…
▽ More
We consider the problem of spatiotemporal sampling in which an initial state $f$ of an evolution process $f_t=A_tf$ is to be recovered from a combined set of coarse samples from varying time levels $\{t_1,\dots,t_N\}$. This new way of sampling, which we call dynamical sampling, differs from standard sampling since at any fixed time $t_i$ there are not enough samples to recover the function $f$ or the state $f_{t_i}$. Although dynamical sampling is an inverse problem, it differs from the typical inverse problems in which $f$ is to be recovered from $A_Tf$ for a single time $T$. In this paper, we consider signals that are modeled by $\ell^2(\mathbb Z)$ or a shift invariant space $V\subset L^2(\mathbb R)$.
△ Less
Submitted 4 December, 2013;
originally announced December 2013.
-
Nearness to Local Subspace Algorithm for Subspace and Motion Segmentation
Authors:
Akram Aldroubi,
Ali Sekmen
Abstract:
There is a growing interest in computer science, engineering, and mathematics for modeling signals in terms of union of subspaces and manifolds. Subspace segmentation and clustering of high dimensional data drawn from a union of subspaces are especially important with many practical applications in computer vision, image and signal processing, communications, and information theory. This paper pre…
▽ More
There is a growing interest in computer science, engineering, and mathematics for modeling signals in terms of union of subspaces and manifolds. Subspace segmentation and clustering of high dimensional data drawn from a union of subspaces are especially important with many practical applications in computer vision, image and signal processing, communications, and information theory. This paper presents a clustering algorithm for high dimensional data that comes from a union of lower dimensional subspaces of equal and known dimensions. Such cases occur in many data clustering problems, such as motion segmentation and face recognition. The algorithm is reliable in the presence of noise, and applied to the Hopkins 155 Dataset, it generates the best results to date for motion segmentation. The two motion, three motion, and overall segmentation rates for the video sequences are 99.43%, 98.69%, and 99.24%, respectively.
△ Less
Submitted 14 May, 2012; v1 submitted 11 October, 2010;
originally announced October 2010.
-
On the existence of Optimal Subspace Clustering Models
Authors:
Akram Aldroubi,
Romain Tessera
Abstract:
Given a set of vectors $\F=\{f_1,\dots,f_m\}$ in a Hilbert space $\HH$, and given a family $\CC$ of closed subspaces of $\HH$, the {\it subspace clustering problem} consists in finding a union of subspaces in $\CC$ that best approximates (models) the data $\F$.
This problem has applications and connections to many areas of mathematics, computer science and engineering such as the Generalized Pri…
▽ More
Given a set of vectors $\F=\{f_1,\dots,f_m\}$ in a Hilbert space $\HH$, and given a family $\CC$ of closed subspaces of $\HH$, the {\it subspace clustering problem} consists in finding a union of subspaces in $\CC$ that best approximates (models) the data $\F$.
This problem has applications and connections to many areas of mathematics, computer science and engineering such as the Generalized Principle Component Analysis (GPCA), learning theory, compressed sensing, and sampling with finite rate of innovation. In this paper, we characterize families of subspaces $\CC$ for which such a best approximation exists. In finite dimensions the characterization is in terms of the convex hull of an augmented set $\CC^+$. In infinite dimensions however, the characterization is in terms of a new but related notion of contact hull. As an application, the existence of best approximations from $π(G)$-invariant families $\CC$ of unitary representations of abelian groups is derived.
△ Less
Submitted 27 August, 2010;
originally announced August 2010.
-
Uncertainty Principles and Balian-Low type Theorems in Principal Shift-Invariant Spaces
Authors:
Akram Aldroubi,
Qiyu Sun,
Haichao Wang
Abstract:
In this paper, we consider the time-frequency localization of the generator of a principal shift-invariant space on the real line which has additional shift-invariance. We prove that if a principal shift-invariant space on the real line is translation-invariant then any of its orthonormal (or Riesz) generators is non-integrable. However, for any $n\ge2$, there exist principal shift-invariant space…
▽ More
In this paper, we consider the time-frequency localization of the generator of a principal shift-invariant space on the real line which has additional shift-invariance. We prove that if a principal shift-invariant space on the real line is translation-invariant then any of its orthonormal (or Riesz) generators is non-integrable. However, for any $n\ge2$, there exist principal shift-invariant spaces on the real line that are also $\nZ$-invariant with an integrable orthonormal (or a Riesz) generator $φ$, but $φ$ satisfies $\int_{\mathbb R} |φ(x)|^2 |x|^{1+ε} dx=\infty$ for any $ε>0$ and its Fourier transform $\hatφ$ cannot decay as fast as $ (1+|ξ|)^{-r}$ for any $r>1/2$. Examples are constructed to demonstrate that the above decay properties for the orthormal generator in the time domain and in the frequency domain are optimal.
△ Less
Submitted 25 August, 2010;
originally announced August 2010.
-
A Dimension Reduction Scheme for the Computation of Optimal Unions of Subspaces
Authors:
Akram Aldroubi,
Magalí Anastasio,
Carlos Cabrelli,
Ursula Molter
Abstract:
Given a set of points \F in a high dimensional space, the problem of finding a union of subspaces \cup_i V_i\subset \R^N that best explains the data \F increases dramatically with the dimension of \R^N. In this article, we study a class of transformations that map the problem into another one in lower dimension. We use the best model in the low dimensional space to approximate the best solution in…
▽ More
Given a set of points \F in a high dimensional space, the problem of finding a union of subspaces \cup_i V_i\subset \R^N that best explains the data \F increases dramatically with the dimension of \R^N. In this article, we study a class of transformations that map the problem into another one in lower dimension. We use the best model in the low dimensional space to approximate the best solution in the original high dimensional space. We then estimate the error produced between this solution and the optimal solution in the high dimensional space.
△ Less
Submitted 10 January, 2011; v1 submitted 16 August, 2010;
originally announced August 2010.
-
A Unified Approach to Sparse Signal Processing
Authors:
F. Marvasti,
A. Amini,
F. Haddadi,
M. Soltanolkotabi,
B. H. Khalaj,
A. Aldroubi,
S. Holm,
S. Sanei,
J. Chambers
Abstract:
A unified view of sparse signal processing is presented in tutorial form by bringing together various fields. For each of these fields, various algorithms and techniques, which have been developed to leverage sparsity, are described succinctly. The common benefits of significant reduction in sampling rate and processing manipulations are revealed.
The key applications of sparse signal processi…
▽ More
A unified view of sparse signal processing is presented in tutorial form by bringing together various fields. For each of these fields, various algorithms and techniques, which have been developed to leverage sparsity, are described succinctly. The common benefits of significant reduction in sampling rate and processing manipulations are revealed.
The key applications of sparse signal processing are sampling, coding, spectral estimation, array processing, component analysis, and multipath channel estimation. In terms of reconstruction algorithms, linkages are made with random sampling, compressed sensing and rate of innovation. The redundancy introduced by channel coding in finite/real Galois fields is then related to sampling with similar reconstruction algorithms. The methods of Prony, Pisarenko, and MUSIC are next discussed for sparse frequency domain representations. Specifically, the relations of the approach of Prony to an annihilating filter and Error Locator Polynomials in coding are emphasized; the Pisarenko and MUSIC methods are further improvements of the Prony method. Such spectral estimation methods is then related to multi-source location and DOA estimation in array processing. The notions of sparse array beamforming and sparse sensor networks are also introduced. Sparsity in unobservable source signals is also shown to facilitate source separation in SCA; the algorithms developed in this area are also widely used in compressed sensing. Finally, the multipath channel estimation problem is shown to have a sparse formulation; algorithms similar to sampling and coding are used to estimate OFDM channels.
△ Less
Submitted 11 February, 2009;
originally announced February 2009.
-
Sequential adaptive compressed sampling via Huffman codes
Authors:
Akram Aldroubi,
Haichao Wang,
Kourosh Zarringhalam
Abstract:
There are two main approaches in compressed sensing: the geometric approach and the combinatorial approach. In this paper we introduce an information theoretic approach and use results from the theory of Huffman codes to construct a sequence of binary sampling vectors to determine a sparse signal. Unlike other approaches, our approach is adaptive in the sense that each sampling vector depends on…
▽ More
There are two main approaches in compressed sensing: the geometric approach and the combinatorial approach. In this paper we introduce an information theoretic approach and use results from the theory of Huffman codes to construct a sequence of binary sampling vectors to determine a sparse signal. Unlike other approaches, our approach is adaptive in the sense that each sampling vector depends on the previous sample. The number of measurements we need for a k-sparse vector in n-dimensional space is no more than O(k log n) and the reconstruction is O(k).
△ Less
Submitted 25 June, 2009; v1 submitted 27 October, 2008;
originally announced October 2008.
-
Invariance of a Shift-Invariant Space
Authors:
Akram Aldroubi,
Carlos Cabrelli,
Christopher Heil,
Keri Kornelson,
Ursula Molter
Abstract:
A shift-invariant space is a space of functions that is invariant under integer translations. Such spaces are often used as models for spaces of signals and images in mathematical and engineering applications. This paper characterizes those shift-invariant subspaces S that are also invariant under additional (non-integer) translations. For the case of finitely generated spaces, these spaces are…
▽ More
A shift-invariant space is a space of functions that is invariant under integer translations. Such spaces are often used as models for spaces of signals and images in mathematical and engineering applications. This paper characterizes those shift-invariant subspaces S that are also invariant under additional (non-integer) translations. For the case of finitely generated spaces, these spaces are characterized in terms of the generators of the space. As a consequence, it is shown that principal shift-invariant spaces with a compactly supported generator cannot be invariant under any non-integer translations.
△ Less
Submitted 21 December, 2008; v1 submitted 9 April, 2008;
originally announced April 2008.
-
Optimal Non-Linear Models for Sparsity and Sampling
Authors:
Akram Aldroubi,
Carlos Cabrelli,
Ursula Molter
Abstract:
Given a set of vectors (the data) in a Hilbert space H, we prove the existence of an optimal collection of subspaces minimizing the sum of the square of the distances between each vector and its closest subspace in the collection. This collection of subspaces gives the best sparse representation for the given data, in a sense defined in the paper, and provides an optimal model for sampling in un…
▽ More
Given a set of vectors (the data) in a Hilbert space H, we prove the existence of an optimal collection of subspaces minimizing the sum of the square of the distances between each vector and its closest subspace in the collection. This collection of subspaces gives the best sparse representation for the given data, in a sense defined in the paper, and provides an optimal model for sampling in union of subspaces. The results are proved in a general setting and then applied to the case of low dimensional subspaces of R^N and to infinite dimensional shift-invariant spaces in L^2(R^d). We also present an iterative search algorithm for finding the solution subspaces. These results are tightly connected to the new emergent theories of compressed sensing and dictionary design, signal models for signals with finite rate of innovation, and the subspace segmentation problem.
△ Less
Submitted 6 February, 2008; v1 submitted 13 July, 2007;
originally announced July 2007.
-
On Stability of Sampling-Reconstruction Models
Authors:
E. costa-Reyes,
A. Aldroubi,
I. Krishtal
Abstract:
A useful sampling-reconstruction model should be stable with respect to different kind of small perturbations, regardless whether they result from jitter, measurement errors, or simply from a small change in the model assumptions. In this paper we prove this result for a large class of sampling models. We define different classes of perturbations and quantify the robustness of a model with respe…
▽ More
A useful sampling-reconstruction model should be stable with respect to different kind of small perturbations, regardless whether they result from jitter, measurement errors, or simply from a small change in the model assumptions. In this paper we prove this result for a large class of sampling models. We define different classes of perturbations and quantify the robustness of a model with respect to them. We also use the theory of localized frames to study the frame algorithm for recovering the original signal from its samples.
△ Less
Submitted 29 May, 2007;
originally announced May 2007.
-
Slanted matrices, Banach frames, and sampling
Authors:
A. Aldroubi,
A. Baskakov,
I. Krishtal
Abstract:
In this paper we present a rare combination of abstract results on the spectral properties of slanted matrices and some of their very specific applications to frame theory and sampling problems. We show that for a large class of slanted matrices boundedness below of the corresponding operator in $\ell^p$ for some $p$ implies boundedness below in $\ell^p$ for all $p$. We use the established resul…
▽ More
In this paper we present a rare combination of abstract results on the spectral properties of slanted matrices and some of their very specific applications to frame theory and sampling problems. We show that for a large class of slanted matrices boundedness below of the corresponding operator in $\ell^p$ for some $p$ implies boundedness below in $\ell^p$ for all $p$. We use the established resultto enrich our understanding of Banach frames and obtain new results for irregular sampling problems. We also present a version of a non-commutative Wiener's lemma for slanted matrices.
△ Less
Submitted 29 May, 2007;
originally announced May 2007.
-
Wavelets on Irregular Grids with Arbitrary Dilation Matrices, and Frames Atoms for L^2(R^d)
Authors:
Akram Aldroubi,
Carlos Cabrelli,
Ursula M. Molter
Abstract:
In this article, we develop a general method for constructing wavelets {|det A_j|^{1/2} g(A_jx-x_{j,k}): j in J, k in K}, on irregular lattices of the form X={x_{j,k} in R^d: j in J, k in K}, and with an arbitrary countable family of invertible dxd matrices {A_j in GL_d(R): j in J} that do not necessarily have a group structure. This wavelet construction is a particular case of general atomic fr…
▽ More
In this article, we develop a general method for constructing wavelets {|det A_j|^{1/2} g(A_jx-x_{j,k}): j in J, k in K}, on irregular lattices of the form X={x_{j,k} in R^d: j in J, k in K}, and with an arbitrary countable family of invertible dxd matrices {A_j in GL_d(R): j in J} that do not necessarily have a group structure. This wavelet construction is a particular case of general atomic frame decompositions of L^2(R^d) developed in this article, that allow other time frequency decompositions such as non-harmonic Gabor frames with non-uniform covering of the Euclidean space R^d. Possible applications include image and video compression, speech coding, image and digital data transmission, image analysis, estimations and detection, and seismology.
△ Less
Submitted 14 March, 2007;
originally announced March 2007.
-
Optimal Shift Invariant Spaces and Their Parseval Generators
Authors:
Akram Aldroubi,
Carlos Cabrelli,
Doug Hardin,
Ursula Molter
Abstract:
Given a set of functions F={f_1,...,f_m} of L2(Rd), we study the problem of finding the shift-invariant space V with n generators {phi_1,...,phi_n} that is ``closest'' to the functions of F in the sense that V minimize the least square distance from the data F to V over the set of all shift-invariant spaces that can be generated by n or less generators.
The Eckart-Young Theorem uses the singul…
▽ More
Given a set of functions F={f_1,...,f_m} of L2(Rd), we study the problem of finding the shift-invariant space V with n generators {phi_1,...,phi_n} that is ``closest'' to the functions of F in the sense that V minimize the least square distance from the data F to V over the set of all shift-invariant spaces that can be generated by n or less generators.
The Eckart-Young Theorem uses the singular value decomposition to provide a solution to a related problem in finite dimension. We transform the problem under study into an uncountable set of finite dimensional problems each of which can be solved using an extension of the Eckart-Young Theorem. We prove that the finite dimensional solutions can be patched together and transformed to obtain the optimal shift-invariant space solution to the original problem, and we produce a Parseval frame for the optimal space.
A typical application is the problem of finding a shift-invariant space model that describes a given class of signals or images (e.g., the class of chest X-Rays), from the observation of a set of m signals or images f_1,...f_m, which may be theoretical samples, or experimental data.
△ Less
Submitted 7 August, 2006; v1 submitted 13 June, 2006;
originally announced June 2006.
-
Geometric Aspects of Frame Representations of Abelian Groups
Authors:
Akram Aldroubi,
David Larson,
Wai-Shing Tang,
Eric Weber
Abstract:
We consider frames arising from the action of a unitary representation of a discrete countable abelian group. We show that the range of the analysis operator can be determined by computing which characters appear in the representation. This allows one to compare the ranges of two such frames, which is useful for determining similarity and also for multiplexing schemes. Our results then partially…
▽ More
We consider frames arising from the action of a unitary representation of a discrete countable abelian group. We show that the range of the analysis operator can be determined by computing which characters appear in the representation. This allows one to compare the ranges of two such frames, which is useful for determining similarity and also for multiplexing schemes. Our results then partially extend to Bessel sequences arising from the action of the group. We apply the results to sampling on bandlimited functions and to wavelet and Weyl-Heisenberg frames. This yields a sufficient condition for two sampling transforms to have orthogonal ranges, and two analysis operators for wavelet and Weyl-Heisenberg frames to have orthogonal ranges. The sufficient condition is easy to compute in terms of the periodization of the Fourier transform of the frame generators.
△ Less
Submitted 26 August, 2003;
originally announced August 2003.
