-
Deep Unrolling for Nonconvex Robust Principal Component Analysis
Authors:
Elizabeth Z. C. Tan,
Caroline Chaux,
Emmanuel Soubies,
Vincent Y. F. Tan
Abstract:
We design algorithms for Robust Principal Component Analysis (RPCA) which consists in decomposing a matrix into the sum of a low rank matrix and a sparse matrix. We propose a deep unrolled algorithm based on an accelerated alternating projection algorithm which aims to solve RPCA in its nonconvex form. The proposed procedure combines benefits of deep neural networks and the interpretability of the…
▽ More
We design algorithms for Robust Principal Component Analysis (RPCA) which consists in decomposing a matrix into the sum of a low rank matrix and a sparse matrix. We propose a deep unrolled algorithm based on an accelerated alternating projection algorithm which aims to solve RPCA in its nonconvex form. The proposed procedure combines benefits of deep neural networks and the interpretability of the original algorithm and it automatically learns hyperparameters. We demonstrate the unrolled algorithm's effectiveness on synthetic datasets and also on a face modeling problem, where it leads to both better numerical and visual performances.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Straight-Through meets Sparse Recovery: the Support Exploration Algorithm
Authors:
Mimoun Mohamed,
François Malgouyres,
Valentin Emiya,
Caroline Chaux
Abstract:
The {\it straight-through estimator} (STE) is commonly used to optimize quantized neural networks, yet its contexts of effective performance are still unclear despite empirical successes.To make a step forward in this comprehension, we apply STE to a well-understood problem: {\it sparse support recovery}. We introduce the {\it Support Exploration Algorithm} (SEA), a novel algorithm promoting spars…
▽ More
The {\it straight-through estimator} (STE) is commonly used to optimize quantized neural networks, yet its contexts of effective performance are still unclear despite empirical successes.To make a step forward in this comprehension, we apply STE to a well-understood problem: {\it sparse support recovery}. We introduce the {\it Support Exploration Algorithm} (SEA), a novel algorithm promoting sparsity, and we analyze its performance in support recovery (a.k.a. model selection) problems. SEA explores more supports than the state-of-the-art, leading to superior performance in experiments, especially when the columns of $A$ are strongly coherent.The theoretical analysis considers recovery guarantees when the linear measurements matrix $A$ satisfies the {\it Restricted Isometry Property} (RIP).The sufficient conditions of recovery are comparable but more stringent than those of the state-of-the-art in sparse support recovery. Their significance lies mainly in their applicability to an instance of the STE.
△ Less
Submitted 25 June, 2024; v1 submitted 31 January, 2023;
originally announced January 2023.
-
Unmixing 2D HSQC NMR mixtures with $β$-NMF and sparsity
Authors:
Afef Cherni,
Sandrine Anthoine,
Caroline Chaux
Abstract:
Nuclear Magnetic Resonance (NMR) spectroscopy is an efficient technique to analyze chemical mixtures in which one acquires spectra of the chemical mixtures along one ore more dimensions. One of the important issues is to efficiently analyze the composition of the mixture, this is a classical Blind Source Separation (BSS) problem. The poor resolution of NMR spectra and their large dimension call fo…
▽ More
Nuclear Magnetic Resonance (NMR) spectroscopy is an efficient technique to analyze chemical mixtures in which one acquires spectra of the chemical mixtures along one ore more dimensions. One of the important issues is to efficiently analyze the composition of the mixture, this is a classical Blind Source Separation (BSS) problem. The poor resolution of NMR spectra and their large dimension call for a tailored BSS method. We propose in this paper a new variational formulation for BSS based on a $β$-divergence data fidelity term combined with sparsity promoting regularization functions. A majorization-minimization strategy is developped to solve the problem and experiments on simulated and real 2D HSQC NMR data illustrate the interest and the effectiveness of the proposed method.
△ Less
Submitted 30 October, 2020;
originally announced November 2020.
-
Phase inpainting in time-frequency plane
Authors:
A. ~Marina Krémé,
Valentin Emiya,
Caroline Chaux
Abstract:
We propose a new problem of missing data reconstruction in the time-frequency plane. This problem called phase inpainting, consists in reconstructing a signal from time-frequency observations where all amplitudes and some phases are known while the remaining phases are missing. A mathematical formulation of this problem is given. We propose three alternatives of existing algorithms. An iterative a…
▽ More
We propose a new problem of missing data reconstruction in the time-frequency plane. This problem called phase inpainting, consists in reconstructing a signal from time-frequency observations where all amplitudes and some phases are known while the remaining phases are missing. A mathematical formulation of this problem is given. We propose three alternatives of existing algorithms. An iterative algorithm: Griffin and Lim and two semidefinite programming optimization algorithms: PhaseLift and PhaseCut. The obtained results show that knowledge of certain phases improves the reconstruction's quality.
△ Less
Submitted 11 December, 2018;
originally announced December 2018.
-
Image Analysis Using a Dual-Tree $M$-Band Wavelet Transform
Authors:
Caroline Chaux,
Laurent Duval,
Jean-Christophe Pesquet
Abstract:
We propose a 2D generalization to the $M$-band case of the dual-tree decomposition structure (initially proposed by N. Kingsbury and further investigated by I. Selesnick) based on a Hilbert pair of wavelets. We particularly address (\textit{i}) the construction of the dual basis and (\textit{ii}) the resulting directional analysis. We also revisit the necessary pre-processing stage in the $M$-band…
▽ More
We propose a 2D generalization to the $M$-band case of the dual-tree decomposition structure (initially proposed by N. Kingsbury and further investigated by I. Selesnick) based on a Hilbert pair of wavelets. We particularly address (\textit{i}) the construction of the dual basis and (\textit{ii}) the resulting directional analysis. We also revisit the necessary pre-processing stage in the $M$-band case. While several reconstructions are possible because of the redundancy of the representation, we propose a new optimal signal reconstruction technique, which minimizes potential estimation errors. The effectiveness of the proposed $M$-band decomposition is demonstrated via denoising comparisons on several image types (natural, texture, seismics), with various $M$-band wavelets and thresholding strategies. Significant improvements in terms of both overall noise reduction and direction preservation are observed.
△ Less
Submitted 27 February, 2017;
originally announced February 2017.
-
A constrained-based optimization approach for seismic data recovery problems
Authors:
Mai Quyen Pham,
Caroline Chaux,
Laurent Duval,
Jean-Christophe Pesquet
Abstract:
Random and structured noise both affect seismic data, hiding the reflections of interest (primaries) that carry meaningful geophysical interpretation. When the structured noise is composed of multiple reflections, its adaptive cancellation is obtained through time-varying filtering, compensating inaccuracies in given approximate templates. The under-determined problem can then be formulated as a c…
▽ More
Random and structured noise both affect seismic data, hiding the reflections of interest (primaries) that carry meaningful geophysical interpretation. When the structured noise is composed of multiple reflections, its adaptive cancellation is obtained through time-varying filtering, compensating inaccuracies in given approximate templates. The under-determined problem can then be formulated as a convex optimization one, providing estimates of both filters and primaries. Within this framework, the criterion to be minimized mainly consists of two parts: a data fidelity term and hard constraints modeling a priori information. This formulation may avoid, or at least facilitate, some parameter determination tasks, usually difficult to perform in inverse problems. Not only classical constraints, such as sparsity, are considered here, but also constraints expressed through hyperplanes, onto which the projection is easy to compute. The latter constraints lead to improved performance by further constraining the space of geophysically sound solutions.
△ Less
Submitted 18 June, 2014;
originally announced June 2014.
-
A Primal-Dual Proximal Algorithm for Sparse Template-Based Adaptive Filtering: Application to Seismic Multiple Removal
Authors:
Mai Quyen Pham,
Laurent Duval,
Caroline Chaux,
Jean-Christophe Pesquet
Abstract:
Unveiling meaningful geophysical information from seismic data requires to deal with both random and structured "noises". As their amplitude may be greater than signals of interest (primaries), additional prior information is especially important in performing efficient signal separation. We address here the problem of multiple reflections, caused by wave-field bouncing between layers. Since only…
▽ More
Unveiling meaningful geophysical information from seismic data requires to deal with both random and structured "noises". As their amplitude may be greater than signals of interest (primaries), additional prior information is especially important in performing efficient signal separation. We address here the problem of multiple reflections, caused by wave-field bouncing between layers. Since only approximate models of these phenomena are available, we propose a flexible framework for time-varying adaptive filtering of seismic signals, using sparse representations, based on inaccurate templates. We recast the joint estimation of adaptive filters and primaries in a new convex variational formulation. This approach allows us to incorporate plausible knowledge about noise statistics, data sparsity and slow filter variation in parsimony-promoting wavelet frames. The designed primal-dual algorithm solves a constrained minimization problem that alleviates standard regularization issues in finding hyperparameters. The approach demonstrates significantly good performance in low signal-to-noise ratio conditions, both for simulated and real field seismic data.
△ Less
Submitted 22 September, 2014; v1 submitted 5 May, 2014;
originally announced May 2014.
-
A Hamiltonian Monte Carlo Method for Non-Smooth Energy Sampling
Authors:
Lotfi Chaari,
Jean-Yves Tourneret,
Caroline Chaux,
Hadj Batatia
Abstract:
Efficient sampling from high-dimensional distributions is a challenging issue which is encountered in many large data recovery problems involving Markov chain Monte Carlo schemes. In this context, sampling using Hamiltonian dynamics is one of the recent techniques that have been proposed to exploit the target distribution geometry. Such schemes have clearly been shown to be efficient for multi-dim…
▽ More
Efficient sampling from high-dimensional distributions is a challenging issue which is encountered in many large data recovery problems involving Markov chain Monte Carlo schemes. In this context, sampling using Hamiltonian dynamics is one of the recent techniques that have been proposed to exploit the target distribution geometry. Such schemes have clearly been shown to be efficient for multi-dimensional sampling, but are rather adapted to the exponential families of distributions with smooth energy function. In this paper, we address the problem of using Hamiltonian dynamics to sample from probability distributions having non-differentiable energy functions such as $\ell_1$. Such distributions are being more and more used in sparse signal and image recovery applications. The proposed technique uses a modified leapfrog transform involving a proximal step. The resulting non-smooth Hamiltonian Monte Carlo (ns-HMC) method is tested and validated on a number of experiments. Results show its ability to accurately sample according to various multivariate target distributions. The proposed technique is illustrated on synthetic examples and is applied to an image denoising problem.
△ Less
Submitted 30 January, 2015; v1 submitted 16 January, 2014;
originally announced January 2014.
-
Noise Covariance Properties in Dual-Tree Wavelet Decompositions
Authors:
Caroline Chaux,
Jean-Christophe Pesquet,
Laurent Duval
Abstract:
Dual-tree wavelet decompositions have recently gained much popularity, mainly due to their ability to provide an accurate directional analysis of images combined with a reduced redundancy. When the decomposition of a random process is performed -- which occurs in particular when an additive noise is corrupting the signal to be analyzed -- it is useful to characterize the statistical properties of…
▽ More
Dual-tree wavelet decompositions have recently gained much popularity, mainly due to their ability to provide an accurate directional analysis of images combined with a reduced redundancy. When the decomposition of a random process is performed -- which occurs in particular when an additive noise is corrupting the signal to be analyzed -- it is useful to characterize the statistical properties of the dual-tree wavelet coefficients of this process. As dual-tree decompositions constitute overcomplete frame expansions, correlation structures are introduced among the coefficients, even when a white noise is analyzed. In this paper, we show that it is possible to provide an accurate description of the covariance properties of the dual-tree coefficients of a wide-sense stationary process. The expressions of the (cross-)covariance sequences of the coefficients are derived in the one and two-dimensional cases. Asymptotic results are also provided, allowing to predict the behaviour of the second-order moments for large lag values or at coarse resolution. In addition, the cross-correlations between the primal and dual wavelets, which play a primary role in our theoretical analysis, are calculated for a number of classical wavelet families. Simulation results are finally provided to validate these results.
△ Less
Submitted 26 August, 2011;
originally announced August 2011.
-
Relaxing Tight Frame Condition in Parallel Proximal Methods for Signal Restoration
Authors:
Nelly Pustelnik,
Jean-Christophe Pesquet,
Caroline Chaux
Abstract:
A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have become popular optimization techniques to approximate iteratively the desired solution. Until now, in most of these methods, either Lipschitz differentiability…
▽ More
A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have become popular optimization techniques to approximate iteratively the desired solution. Until now, in most of these methods, either Lipschitz differentiability properties or tight frame representations were assumed. In this paper, it is shown that it is possible to relax these assumptions by considering a class of non necessarily tight frame representations, thus offering the possibility of addressing a broader class of signal restoration problems. In particular, it is possible to use non necessarily maximally decimated filter banks with perfect reconstruction, which are common tools in digital signal processing. The proposed approach allows us to solve both frame analysis and frame synthesis problems for various noise distributions. In our simulations, it is applied to the deconvolution of data corrupted with Poisson noise or Laplacian noise by using (non-tight) discrete dual-tree wavelet representations and filter bank structures.
△ Less
Submitted 18 December, 2011; v1 submitted 25 May, 2011;
originally announced May 2011.
-
A Panorama on Multiscale Geometric Representations, Intertwining Spatial, Directional and Frequency Selectivity
Authors:
Laurent Jacques,
Laurent Duval,
Caroline Chaux,
Gabriel Peyré
Abstract:
The richness of natural images makes the quest for optimal representations in image processing and computer vision challenging. The latter observation has not prevented the design of image representations, which trade off between efficiency and complexity, while achieving accurate rendering of smooth regions as well as reproducing faithful contours and textures. The most recent ones, proposed in t…
▽ More
The richness of natural images makes the quest for optimal representations in image processing and computer vision challenging. The latter observation has not prevented the design of image representations, which trade off between efficiency and complexity, while achieving accurate rendering of smooth regions as well as reproducing faithful contours and textures. The most recent ones, proposed in the past decade, share an hybrid heritage highlighting the multiscale and oriented nature of edges and patterns in images. This paper presents a panorama of the aforementioned literature on decompositions in multiscale, multi-orientation bases or dictionaries. They typically exhibit redundancy to improve sparsity in the transformed domain and sometimes its invariance with respect to simple geometric deformations (translation, rotation). Oriented multiscale dictionaries extend traditional wavelet processing and may offer rotation invariance. Highly redundant dictionaries require specific algorithms to simplify the search for an efficient (sparse) representation. We also discuss the extension of multiscale geometric decompositions to non-Euclidean domains such as the sphere or arbitrary meshed surfaces. The etymology of panorama suggests an overview, based on a choice of partially overlap** "pictures". We hope that this paper will contribute to the appreciation and apprehension of a stream of current research directions in image understanding.
△ Less
Submitted 20 April, 2011; v1 submitted 27 January, 2011;
originally announced January 2011.
-
Parallel Proximal Algorithm for Image Restoration Using Hybrid Regularization -- Extended Version
Authors:
Nelly Pustelnik,
Caroline Chaux,
Jean-Christophe Pesquet
Abstract:
Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total variation introduces staircase effects, wavelet domain regularization brings other artefacts, e.g. ringing. However, a compromise can be found by introducing a…
▽ More
Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total variation introduces staircase effects, wavelet domain regularization brings other artefacts, e.g. ringing. However, a compromise can be found by introducing a hybrid regularization including several terms non necessarily acting in the same domain (e.g. spatial and wavelet transform domains). We adopt a convex optimization framework where the criterion to be minimized is split in the sum of more than two terms. For spatial domain regularization, isotropic or anisotropic total variation definitions using various gradient filters are considered. An accelerated version of the Parallel ProXimal Algorithm is proposed to perform the minimization. Some difficulties in the computation of the proximity operators involved in this algorithm are also addressed in this paper. Numerical experiments performed in the context of Poisson data recovery, show the good behavior of the algorithm as well as promising results concerning the use of hybrid regularization techniques.
△ Less
Submitted 22 October, 2011; v1 submitted 8 November, 2009;
originally announced November 2009.
-
A SURE Approach for Digital Signal/Image Deconvolution Problems
Authors:
Jean-Christophe Pesquet,
Amel Benazza-Benyahia,
Caroline Chaux
Abstract:
In this paper, we are interested in the classical problem of restoring data degraded by a convolution and the addition of a white Gaussian noise. The originality of the proposed approach is two-fold. Firstly, we formulate the restoration problem as a nonlinear estimation problem leading to the minimization of a criterion derived from Stein's unbiased quadratic risk estimate. Secondly, the deconv…
▽ More
In this paper, we are interested in the classical problem of restoring data degraded by a convolution and the addition of a white Gaussian noise. The originality of the proposed approach is two-fold. Firstly, we formulate the restoration problem as a nonlinear estimation problem leading to the minimization of a criterion derived from Stein's unbiased quadratic risk estimate. Secondly, the deconvolution procedure is performed using any analysis and synthesis frames that can be overcomplete or not. New theoretical results concerning the calculation of the variance of the Stein's risk estimate are also provided in this work. Simulations carried out on natural images show the good performance of our method w.r.t. conventional wavelet-based restoration methods.
△ Less
Submitted 7 July, 2009; v1 submitted 27 October, 2008;
originally announced October 2008.
-
Nested iterative algorithms for convex constrained image recovery problems
Authors:
Caroline Chaux,
Jean-Christophe Pesquet,
Nelly Pustelnik
Abstract:
The objective of this paper is to develop methods for solving image recovery problems subject to constraints on the solution. More precisely, we will be interested in problems which can be formulated as the minimization over a closed convex constraint set of the sum of two convex functions f and g, where f may be non-smooth and g is differentiable with a Lipschitz-continuous gradient. To reach thi…
▽ More
The objective of this paper is to develop methods for solving image recovery problems subject to constraints on the solution. More precisely, we will be interested in problems which can be formulated as the minimization over a closed convex constraint set of the sum of two convex functions f and g, where f may be non-smooth and g is differentiable with a Lipschitz-continuous gradient. To reach this goal, we derive two types of algorithms that combine forward-backward and Douglas-Rachford iterations. The weak convergence of the proposed algorithms is proved. In the case when the Lipschitz-continuity property of the gradient of g is not satisfied, we also show that, under some assumptions, it remains possible to apply these methods to the considered optimization problem by making use of a quadratic extension technique. The effectiveness of the algorithms is demonstrated for two wavelet-based image restoration problems involving a signal-dependent Gaussian noise and a Poisson noise, respectively.
△ Less
Submitted 11 December, 2012; v1 submitted 24 June, 2008;
originally announced June 2008.
-
A nonlinear Stein based estimator for multichannel image denoising
Authors:
Caroline Chaux,
Laurent Duval,
Amel Benazza-Benyahia,
Jean-Christophe Pesquet
Abstract:
The use of multicomponent images has become widespread with the improvement of multisensor systems having increased spatial and spectral resolutions. However, the observed images are often corrupted by an additive Gaussian noise. In this paper, we are interested in multichannel image denoising based on a multiscale representation of the images. A multivariate statistical approach is adopted to t…
▽ More
The use of multicomponent images has become widespread with the improvement of multisensor systems having increased spatial and spectral resolutions. However, the observed images are often corrupted by an additive Gaussian noise. In this paper, we are interested in multichannel image denoising based on a multiscale representation of the images. A multivariate statistical approach is adopted to take into account both the spatial and the inter-component correlations existing between the different wavelet subbands. More precisely, we propose a new parametric nonlinear estimator which generalizes many reported denoising methods. The derivation of the optimal parameters is achieved by applying Stein's principle in the multivariate case. Experiments performed on multispectral remote sensing images clearly indicate that our method outperforms conventional wavelet denoising techniques
△ Less
Submitted 14 December, 2007;
originally announced December 2007.
