-
Accelerated Projected Gradient Method for Linear Inverse Problems with Sparsity Constraints
Authors:
I. Daubechies,
M. Fornasier,
I. Loris
Abstract:
Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an iterative soft-thresholding algorithm. We propose an alternative implementation to $\ell_1$-constraints, using a gradient method, with projection on $\ell_1$-…
▽ More
Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an iterative soft-thresholding algorithm. We propose an alternative implementation to $\ell_1$-constraints, using a gradient method, with projection on $\ell_1$-balls. The corresponding algorithm uses again iterative soft-thresholding, now with a variable thresholding parameter. We also propose accelerated versions of this iterative method, using ingredients of the (linear) steepest descent method. We prove convergence in norm for one of these projected gradient methods, without and with acceleration.
△ Less
Submitted 27 August, 2008; v1 submitted 28 June, 2007;
originally announced June 2007.
-
Recovery algorithms for vector valued data with joint sparsity constraints
Authors:
Massimo Fornasier,
Holger Rauhut
Abstract:
Vector valued data appearing in concrete applications often possess sparse expansions with respect to a preassigned frame for each vector component individually. Additionally, different components may also exhibit common sparsity patterns. Recently, there were introduced sparsity measures that take into account such joint sparsity patterns, promoting coupling of non-vanishing components. These m…
▽ More
Vector valued data appearing in concrete applications often possess sparse expansions with respect to a preassigned frame for each vector component individually. Additionally, different components may also exhibit common sparsity patterns. Recently, there were introduced sparsity measures that take into account such joint sparsity patterns, promoting coupling of non-vanishing components. These measures are typically constructed as weighted $\ell_1$ norms of componentwise $\ell_q$ norms of frame coefficients. We show how to compute solutions of linear inverse problems with such joint sparsity regularization constraints by fast thresholded Landweber algorithms. Next we discuss the adaptive choice of suitable weights appearing in the definition of sparsity measures. The weights are interpreted as indicators of the sparsity pattern and are iteratively up-dated after each new application of the thresholded Landweber algorithm. The resulting two-step algorithm is interpreted as a double-minimization scheme for a suitable target functional. We show its $\ell_2$-norm convergence. An implementable version of the algorithm is also formulated, and its norm convergence is proven. Numerical experiments in color image restoration are presented.
△ Less
Submitted 7 August, 2006; v1 submitted 4 August, 2006;
originally announced August 2006.
-
Sampling theorems on bounded domain
Authors:
Massimo Fornasier,
Laura Gori
Abstract:
This paper concerns with iterative schemes for the perfect reconstruction of functions belonging to multiresolution spaces on bounded manifolds from nonuniform sampling. The schemes have optimal complexity in the sense that the computational cost to achieve a certain fixed accuracy is proportional to the computed quantity. Since the iterations converge uniformly, one can produce corresponding it…
▽ More
This paper concerns with iterative schemes for the perfect reconstruction of functions belonging to multiresolution spaces on bounded manifolds from nonuniform sampling. The schemes have optimal complexity in the sense that the computational cost to achieve a certain fixed accuracy is proportional to the computed quantity. Since the iterations converge uniformly, one can produce corresponding iterative integration schemes that allow to recover the integral of functions belonging to multiresolution spaces from nonuniform sampling. We present also an error analysis and, in particular, we estimate the $L^2$-error which one produces in recovering smooth functions in $H^s$, but not necessarily in any multiresolution space, and their integrals from nonuniform sampling. Several uni- and bi-variate numerical examples are illustrated and discussed. We also show that one can construct a rather large variety of multiresolution spaces on manifolds from certain refinable bases on the real line formed by so-called GP-functions. This class of functions that contains in particular B-splines has remarkable properties in terms of producing well-conditioned bases. The resulting multiresolution analyses are well-suited for the application of the iterative recovering of functions from nonuniform sampling.
△ Less
Submitted 28 April, 2006;
originally announced April 2006.
-
Adaptive Frame Methods for Magnetohydrodynamic Flows
Authors:
M. Charina,
C. Conti,
M. Fornasier
Abstract:
In this paper we develop adaptive numerical schemes for certain nonlinear variational problems. The discretization of the variational problems is done by representing the solution as a suitable frame decomposition, i.e., a complete, stable, and redundant expansion. The discretization yields an equivalent nonlinear problem on $\ell_2(\mathcal{N})$, the space of frame coefficients. The discrete pr…
▽ More
In this paper we develop adaptive numerical schemes for certain nonlinear variational problems. The discretization of the variational problems is done by representing the solution as a suitable frame decomposition, i.e., a complete, stable, and redundant expansion. The discretization yields an equivalent nonlinear problem on $\ell_2(\mathcal{N})$, the space of frame coefficients. The discrete problem is then adaptively solved using approximated nested fixed point and Richardson type iterations. We investigate the convergence, stability, and optimal complexity of the scheme. This constitutes a theoretical advantage, for example, with respect to adaptive finite element schemes for which convergence and complexity results are still hard to prove. The use of frames is further motivated by their redundancy, which, at least numerically, has been shown to improve the conditioning of the corresponding discretization matrices. Frames also are usually easier to construct than Riesz bases. Finally, we show how to apply the adaptive scheme we propose for finding an approximation to the solution of the PDEs governing magnetohydrodynamic (MHD) flows, once suitable frame expansions are constructed.
△ Less
Submitted 17 March, 2006; v1 submitted 18 March, 2005;
originally announced March 2005.
-
On some stability results of frame atomic decompositions
Authors:
Massimo Fornasier
Abstract:
This paper is concerned with the implications of sufficient conditions ensuring that a perturbation of a frame is again a frame. We emphasize how stability of frames is fundamental for numerical applications and we discuss in particular the connection between stability conditions and localization principles for frame atomic decompositions in Banach spaces.
This paper is concerned with the implications of sufficient conditions ensuring that a perturbation of a frame is again a frame. We emphasize how stability of frames is fundamental for numerical applications and we discuss in particular the connection between stability conditions and localization principles for frame atomic decompositions in Banach spaces.
△ Less
Submitted 10 February, 2005;
originally announced February 2005.
-
Nonlinear projection digital image inpainting and restoration methods
Authors:
Massimo Fornasier
Abstract:
This paper concerns with nonuniform sampling and interpolation methods combined with variational models for the solution of a generalized image inpainting problem and the restoration of digital signals. In particular, we discuss the problem of reconstructing a digital signal/image from very few, sparse, and complete information and a substantial incomplete information, which will be assumed as t…
▽ More
This paper concerns with nonuniform sampling and interpolation methods combined with variational models for the solution of a generalized image inpainting problem and the restoration of digital signals. In particular, we discuss the problem of reconstructing a digital signal/image from very few, sparse, and complete information and a substantial incomplete information, which will be assumed as the result of a nonlinear distortion. As a typical and inspiring example, we illustrate the concrete problem of the color restoration of a destroyed art fresco from its few known fragments and some gray picture taken prior to the damage. Numerical implementations are included together with several examples and numerical results to illustrate the proposed method. The numerical experience suggests furthermore that a particular system of coupled Hamilton-Jacobi equations is well-posed.
△ Less
Submitted 6 December, 2004;
originally announced December 2004.
-
Continuous Frames, Function Spaces, and the Discretization Problem
Authors:
Massimo Fornasier,
Holger Rauhut
Abstract:
A continuous frame is a family of vectors in a Hilbert space which allows reproductions of arbitrary elements by continuous superpositions. Associated to a given continuous frame we construct certain Banach spaces. Many classical function spaces can be identified as such spaces. We provide a general method to derive Banach frames and atomic decompositions for these Banach spaces by sampling the…
▽ More
A continuous frame is a family of vectors in a Hilbert space which allows reproductions of arbitrary elements by continuous superpositions. Associated to a given continuous frame we construct certain Banach spaces. Many classical function spaces can be identified as such spaces. We provide a general method to derive Banach frames and atomic decompositions for these Banach spaces by sampling the continuous frame. This is done by generalizing the coorbit space theory developed by Feichtinger and Groechenig. As an important tool the concept of localization of frames is extended to continuous frames. As a byproduct we give a partial answer to the question raised by Ali, Antoine and Gazeau whether any continuous frame admits a corresponding discrete realization generated by sampling.
△ Less
Submitted 27 October, 2004;
originally announced October 2004.
-
Banach frames for alpha-modulation spaces
Authors:
Massimo Fornasier
Abstract:
This paper is concerned with the characterization of $α$-modulation spaces by Banach frames, i.e., stable and redundant non-orthogonal expansions, constituted of functions obtained by a suitable combination of translation, modulation and dilation of a mother atom. In particular, the parameter $α\in [0,1]$ governs the dependence of the dilation factor on the frequency. The result is achieved by e…
▽ More
This paper is concerned with the characterization of $α$-modulation spaces by Banach frames, i.e., stable and redundant non-orthogonal expansions, constituted of functions obtained by a suitable combination of translation, modulation and dilation of a mother atom. In particular, the parameter $α\in [0,1]$ governs the dependence of the dilation factor on the frequency. The result is achieved by exploiting intrinsic properties of localization of such frames. The well-known Gabor and wavelet frames arise as special cases ($α= 0$) and limiting case ($ α\to 1)$, to characterize respectively modulation and Besov spaces. This intermediate theory contributes to a further answer to the theoretical need of a common interpretation and framework between Gabor and wavelet theory and to the construction of new tools for applications in time-frequency analysis, signal processing, and numerical analysis.
△ Less
Submitted 26 October, 2004;
originally announced October 2004.
