Showing 1–36 of 36 results for author: Fageot, J

PolyCLEAN: When Högbom meets Bayes -- Fast Super-Resolution Imaging with Bayesian MAP Estimation

Authors: Adrian Jarret, Sepand Kashani, Joan Rué-Queralt, Paul Hurley, Julien Fageot, Matthieu Simeoni

Abstract: Aims: We address two issues for the adoption of convex optimization in radio interferometric imaging. First, a method for a fine resolution setup is proposed which scales naturally in terms of memory usage and reconstruction speed. Second, a new tool to localize a region of uncertainty is developed, paving the way for quantitative imaging in radio interferometry. Methods: The classical $\ell_1$ pe… ▽ More Aims: We address two issues for the adoption of convex optimization in radio interferometric imaging. First, a method for a fine resolution setup is proposed which scales naturally in terms of memory usage and reconstruction speed. Second, a new tool to localize a region of uncertainty is developed, paving the way for quantitative imaging in radio interferometry. Methods: The classical $\ell_1$ penalty is used to turn the inverse problem into a sparsity-promoting optimization. For efficient implementation, the so-called Frank-Wolfe algorithm is used together with a \textit{polyatomic} refinement. The algorithm naturally produces sparse images at each iteration, leveraged to reduce memory and computational requirements. In that regard, PolyCLEAN reproduces the numerical behavior of CLEAN while guaranteeing that it solves the minimization problem of interest. Additionally, we introduce the dual certificate image, which appears as a numerical byproduct of the Frank-Wolfe algorithm. This image is proposed as a tool for uncertainty quantification on the location of the recovered sources. Results: PolyCLEAN demonstrates good scalability performance, in particular for fine-resolution grids. On simulations, the Python-based implementation is competitive with the fast numerically-optimized CLEAN solver. This acceleration does not affect image reconstruction quality: PolyCLEAN images are consistent with CLEAN-obtained ones for both point sources and diffuse emission recovery. We also highlight PolyCLEAN reconstruction capabilities on observed radio measurements. Conclusions: PolyCLEAN can be considered as an alternative to CLEAN in the radio interferometric imaging pipeline, as it enables the use of Bayesian priors without impacting the scalability and numerical performance of the imaging method. △ Less

Submitted 3 June, 2024; originally announced June 2024.

A Decoupled Approach for Composite Sparse-plus-Smooth Penalized Optimization

Authors: Adrian Jarret, Valérie Costa, Julien Fageot

Abstract: We consider a linear inverse problem whose solution is expressed as a sum of two components: one smooth and the other sparse. This problem is addressed by minimizing an objective function with a least squares data-fidelity term and a different regularization term applied to each of the components. Sparsity is promoted with an $\ell_1$ norm, while the smooth component is penalized with an $\ell_2$… ▽ More We consider a linear inverse problem whose solution is expressed as a sum of two components: one smooth and the other sparse. This problem is addressed by minimizing an objective function with a least squares data-fidelity term and a different regularization term applied to each of the components. Sparsity is promoted with an $\ell_1$ norm, while the smooth component is penalized with an $\ell_2$ norm. We characterize the solution set of this composite optimization problem by stating a Representer Theorem. Consequently, we identify that solving the optimization problem can be decoupled by first identifying the sparse solution as a solution of a modified single-variable problem and then deducing the smooth component. We illustrate that this decoupled solving method can lead to significant computational speedups in applications, considering the problem of Dirac recovery over a smooth background with two-dimensional partial Fourier measurements. △ Less

Submitted 15 June, 2024; v1 submitted 8 March, 2024; originally announced March 2024.

Generalized Bradley-Terry Models for Score Estimation from Paired Comparisons

Authors: Julien Fageot, Sadegh Farhadkhani, Lê Nguyên Hoang, Oscar Villemaud

Abstract: Many applications, e.g. in content recommendation, sports, or recruitment, leverage the comparisons of alternatives to score those alternatives. The classical Bradley-Terry model and its variants have been widely used to do so. The historical model considers binary comparisons (victory or defeat) between alternatives, while more recent developments allow finer comparisons to be taken into account.… ▽ More Many applications, e.g. in content recommendation, sports, or recruitment, leverage the comparisons of alternatives to score those alternatives. The classical Bradley-Terry model and its variants have been widely used to do so. The historical model considers binary comparisons (victory or defeat) between alternatives, while more recent developments allow finer comparisons to be taken into account. In this article, we introduce a probabilistic model encompassing a broad variety of paired comparisons that can take discrete or continuous values. We do so by considering a well-behaved subset of the exponential family, which we call the family of generalized Bradley-Terry (GBT) models, as it includes the classical Bradley-Terry model and many of its variants. Remarkably, we prove that all GBT models are guaranteed to yield a strictly convex negative log-likelihood. Moreover, assuming a Gaussian prior on alternatives' scores, we prove that the maximum a posteriori (MAP) of GBT models, whose existence, uniqueness and fast computation are thus guaranteed, varies monotonically with respect to comparisons (the more A beats B, the better the score of A) and is Lipschitz-resilient with respect to each new comparison (a single new comparison can only have a bounded effect on all the estimated scores). These desirable properties make GBT models appealing for practical use. We illustrate some features of GBT models on simulations. △ Less

Submitted 21 February, 2024; v1 submitted 16 August, 2023; originally announced August 2023.

Tournesol: Permissionless Collaborative Algorithmic Governance with Security Guarantees

Authors: Lê Nguyên Hoang, Romain Beylerian, Bérangère Colbois, Julien Fageot, Louis Faucon, Aidan Jungo, Alain Le Noac'h, Adrien Matissart, Oscar Villemaud

Abstract: Recommendation algorithms play an increasingly central role in our information ecosystem. Yet, so far, they are mostly designed, parameterized and updated unilaterally by private groups or governmental authorities, based on insecure data from increasingly many fake accounts. In this paper, we present an end-to-end permissionless collaborative algorithmic governance pipeline with security guarantee… ▽ More Recommendation algorithms play an increasingly central role in our information ecosystem. Yet, so far, they are mostly designed, parameterized and updated unilaterally by private groups or governmental authorities, based on insecure data from increasingly many fake accounts. In this paper, we present an end-to-end permissionless collaborative algorithmic governance pipeline with security guarantees, which is deployed on the open-source platform https://tournesol.app. Our pipeline has essentially four steps. First, voting rights are assigned to the contributors, based on Sybil-resilient email domains and on a novel secure trust propagation algorithm. Second, a generalized Bradley-Terry model turns contributors' pairwise alternative comparisons into scores. Third, contributors' scores are collaboratively scaled, by an adaptation of the robust sparse voting solution Mehestan. Finally, scaled scores are post-processed and securely aggregated into human-readable global scores, which are used for recommendation and display. We believe that our pipeline lays an appealing foundation for any collaborative, effective, scalable, fair, interpretable and secure algorithmic governance. △ Less

Submitted 15 August, 2023; v1 submitted 30 October, 2022; originally announced November 2022.

Comments: 33 pages, 8 figures

Complex-Order Scale-Invariant Operators and Self-Similar Processes

Authors: Arash Amini, Julien Fageot, Michael Unser

Abstract: Derivatives and integration operators are well-studied examples of linear operators that commute with scaling up to a fixed multiplicative factor; i.e., they are scale-invariant. Fractional order derivatives (integration operators) also belong to this family. In this paper, we extend the fractional operators to complex-order operators by constructing them in the Fourier domain. We analyze these op… ▽ More Derivatives and integration operators are well-studied examples of linear operators that commute with scaling up to a fixed multiplicative factor; i.e., they are scale-invariant. Fractional order derivatives (integration operators) also belong to this family. In this paper, we extend the fractional operators to complex-order operators by constructing them in the Fourier domain. We analyze these operators in details with a special emphasis on the decay properties of the outputs. We further use these operators to introduce a family of complex-valued stable processes that are self-similar with complex-valued Hurst indices. These processes are expressed via the characteristic functionals over the Schwartz space of functions. Besides the self-similarity and stationarity, we study the regularity (in terms of Sobolev spaces) of the proposed processes. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: 40

MSC Class: 26A33; 60G18; 60G52

Une version polyatomique de l'algorithme Frank-Wolfe pour résoudre le problème LASSO en grandes dimensions

Authors: Adrian Jarret, Matthieu Simeoni, Julien Fageot

Abstract: Nous nous intéressons à la reconstruction parcimonieuse d'images à l'aide du problème d'optimisation régularisé LASSO. Dans de nombreuses applications pratiques, les grandes dimensions des objets à reconstruire limitent, voire empêchent, l'utilisation des méthodes de résolution proximales classiques. C'est le cas par exemple en radioastronomie. Nous détaillons dans cet article le fonctionnement de… ▽ More Nous nous intéressons à la reconstruction parcimonieuse d'images à l'aide du problème d'optimisation régularisé LASSO. Dans de nombreuses applications pratiques, les grandes dimensions des objets à reconstruire limitent, voire empêchent, l'utilisation des méthodes de résolution proximales classiques. C'est le cas par exemple en radioastronomie. Nous détaillons dans cet article le fonctionnement de l'algorithme \textit{Frank-Wolfe Polyatomique}, spécialement développé pour résoudre le problème LASSO dans ces contextes exigeants. Nous démontrons sa supériorité par rapport aux méthodes proximales dans des situations en grande dimension avec des mesures de Fourier, lors de la résolution de problèmes simulés inspirés de la radio-interférométrie. -- We consider the problem of recovering sparse images by means of the penalised optimisation problem LASSO. For various practical applications, it is impossible to rely on the proximal solvers commonly used for that purpose due to the size of the objects to recover, as it is the case for radio astronomy. In this article we explain the mechanisms of the \textit{Polyatomic Frank-Wolfe algorithm}, specifically designed to minimise the LASSO problem in such challenging contexts. We demonstrate in simulated problems inspired from radio-interferometry the preeminence of this algorithm over the proximal methods for high dimensional images with Fourier measurements. △ Less

Submitted 28 April, 2022; originally announced April 2022.

Comments: in French

TV-based Spline Reconstruction with Fourier Measurements: Uniqueness and Convergence of Grid-Based Methods

Authors: Thomas Debarre, Quentin Denoyelle, Julien Fageot

Abstract: We study the problem of recovering piecewise-polynomial periodic functions from their low-frequency information. This means that we only have access to possibly corrupted versions of the Fourier samples of the ground truth up to a maximum cutoff frequency $K_c$. The reconstruction task is specified as an optimization problem with total-variation (TV) regularization (in the sense of measures) invol… ▽ More We study the problem of recovering piecewise-polynomial periodic functions from their low-frequency information. This means that we only have access to possibly corrupted versions of the Fourier samples of the ground truth up to a maximum cutoff frequency $K_c$. The reconstruction task is specified as an optimization problem with total-variation (TV) regularization (in the sense of measures) involving the $M$-th order derivative regularization operator $\mathrm{L} = \mathrm{D}^M$. The order $M \geq 1$ determines the degree of the reconstructed piecewise polynomial spline, whereas the TV regularization norm, which is known to promote sparsity, guarantees a small number of pieces. We show that the solution of our optimization problem is always unique, which, to the best of our knowledge, is a first for TV-based problems. Moreover, we show that this solution is a periodic spline matched to the regularization operator $\mathrm{L}$ whose number of knots is upper-bounded by $2 K_c$. We then consider the grid-based discretization of our optimization problem in the space of uniform $\mathrm{L}$-splines. On the theoretical side, we show that any sequence of solutions of the discretized problem converges uniformly to the unique solution of the gridless problem as the grid size vanishes. Finally, on the algorithmic side, we propose a B-spline-based algorithm to solve the grid-based problem, and we demonstrate its numerical feasibility experimentally. On both of these aspects, we leverage the uniqueness of the solution of the original problem. △ Less

Submitted 10 February, 2022; originally announced February 2022.

On Tempered Discrete and Lévy White Noises

Authors: Julien Fageot

Abstract: We study the growth properties of the family of i.i.d. random sequences, also known as discrete white noises, and of their continuous-domain generalization, the family of Lévy white noises. More precisely, we characterize the members of both families which are tempered in terms of their moment properties. We recover the characterization of tempered Lévy white noises obtained by Robert Dalang and T… ▽ More We study the growth properties of the family of i.i.d. random sequences, also known as discrete white noises, and of their continuous-domain generalization, the family of Lévy white noises. More precisely, we characterize the members of both families which are tempered in terms of their moment properties. We recover the characterization of tempered Lévy white noises obtained by Robert Dalang and Thomas Humeau and provide a new proof of there fundamental result. Our approach is based on a fruitful connection between the discrete and continuous-domain white noises. △ Less

Submitted 3 January, 2022; originally announced January 2022.

MSC Class: 60G20; 60G51; 46F05

Functional Estimation of Anisotropic Covariance and Autocovariance Operators on the Sphere

Authors: Alessia Caponera, Julien Fageot, Matthieu Simeoni, Victor M. Panaretos

Abstract: We propose nonparametric estimators for the second-order central moments of possibly anisotropic spherical random fields, within a functional data analysis context. We consider a measurement framework where each random field among an identically distributed collection of spherical random fields is sampled at a few random directions, possibly subject to measurement error. The collection of random f… ▽ More We propose nonparametric estimators for the second-order central moments of possibly anisotropic spherical random fields, within a functional data analysis context. We consider a measurement framework where each random field among an identically distributed collection of spherical random fields is sampled at a few random directions, possibly subject to measurement error. The collection of random fields could be i.i.d. or serially dependent. Though similar setups have already been explored for random functions defined on the unit interval, the nonparametric estimators proposed in the literature often rely on local polynomials, which do not readily extend to the (product) spherical setting. We therefore formulate our estimation procedure as a variational problem involving a generalized Tikhonov regularization term. The latter favours smooth covariance/autocovariance functions, where the smoothness is specified by means of suitable Sobolev-like pseudo-differential operators. Using the machinery of reproducing kernel Hilbert spaces, we establish representer theorems that fully characterize the form of our estimators. We determine their uniform rates of convergence as the number of random fields diverges, both for the dense (increasing number of spatial samples) and sparse (bounded number of spatial samples) regimes. We moreover demonstrate the computational feasibility and practical merits of our estimation procedure in a simulation setting, assuming a fixed number of samples per random field. Our numerical estimation procedure leverages the sparsity and second-order Kronecker structure of our setup to reduce the computational and memory requirements by approximately three orders of magnitude compared to a naive implementation would require. △ Less

Submitted 25 June, 2022; v1 submitted 23 December, 2021; originally announced December 2021.

A Fast and Scalable Polyatomic Frank-Wolfe Algorithm for the LASSO

Authors: Adrian Jarret, Julien Fageot, Matthieu Simeoni

Abstract: We propose a fast and scalable Polyatomic Frank-Wolfe (P-FW) algorithm for the resolution of high-dimensional LASSO regression problems. The latter improves upon traditional Frank-Wolfe methods by considering generalized greedy steps with polyatomic (i.e. linear combinations of multiple atoms) update directions, hence allowing for a more efficient exploration of the search space. To preserve spars… ▽ More We propose a fast and scalable Polyatomic Frank-Wolfe (P-FW) algorithm for the resolution of high-dimensional LASSO regression problems. The latter improves upon traditional Frank-Wolfe methods by considering generalized greedy steps with polyatomic (i.e. linear combinations of multiple atoms) update directions, hence allowing for a more efficient exploration of the search space. To preserve sparsity of the intermediate iterates, we re-optimize the LASSO problem over the set of selected atoms at each iteration. For efficiency reasons, the accuracy of this re-optimization step is relatively low for early iterations and gradually increases with the iteration count. We provide convergence guarantees for our algorithm and validate it in simulated compressed sensing setups. Our experiments reveal that P-FW outperforms state-of-the-art methods in terms of runtime, both for FW methods and optimal first-order proximal gradient methods such as the Fast Iterative Soft-Thresholding Algorithm (FISTA). △ Less

Submitted 3 February, 2022; v1 submitted 6 December, 2021; originally announced December 2021.

Comments: Published in IEEE Signal Processing Letters

The Critical Smoothness of Generalized Functions

Authors: Julien Fageot, John Paul Ward

Abstract: For each integrability parameter $p \in (0,\infty]$, the critical smoothness of a periodic generalized function $f$, denoted by $s_f(p)$ is the supremum over the smoothness parameters $s$ for which $f$ belongs to the Besov space $B_{p,p}^s$ (or other similar function spaces). This paper investigates the evolution of the critical smoothness with respect to the integrability parameter $p$. Our main… ▽ More For each integrability parameter $p \in (0,\infty]$, the critical smoothness of a periodic generalized function $f$, denoted by $s_f(p)$ is the supremum over the smoothness parameters $s$ for which $f$ belongs to the Besov space $B_{p,p}^s$ (or other similar function spaces). This paper investigates the evolution of the critical smoothness with respect to the integrability parameter $p$. Our main result is a simple characterization of all the possible critical smoothness functions $p\mapsto s_f(p)$ when $f$ describes the space of generalized periodic functions. We moreover characterize the compressibility of generalized periodic functions in wavelet bases from the knowledge of their critical smoothness function. △ Less

Submitted 25 September, 2020; originally announced September 2020.

Comments: 27 pages, 3 figures

MSC Class: 46E35; 42C40

On the Uniqueness of Solutions for the Basis Pursuit in the Continuum

Authors: Thomas Debarre, Quentin Denoyelle, Julien Fageot

Abstract: This paper studies the continuous-domain inverse problem of recovering Radon measures on the one-dimensional torus from low-frequency Fourier coefficients, where Kc is the cutoff frequency. Our approach consists in minimizing the total-variation norm among all Radon measures that are consistent with the observations. We call this problem the basis pursuit in the continuum (BPC). We characterize th… ▽ More This paper studies the continuous-domain inverse problem of recovering Radon measures on the one-dimensional torus from low-frequency Fourier coefficients, where Kc is the cutoff frequency. Our approach consists in minimizing the total-variation norm among all Radon measures that are consistent with the observations. We call this problem the basis pursuit in the continuum (BPC). We characterize the solution set of (BPC) in terms of uniqueness and describe its sparse solutions which are sums of few signed Dirac masses. The characterization is determined by the spectrum of a Toeplitz and Hermitian-symmetric matrix that solely depends on the observations. More precisely, we prove that (BPC) has a unique solution if and only if this matrix is neither positive definite nor negative definite. If it has both a positive and negative eigenvalue, then the unique solution is the sum of at most 2Kc Dirac masses, with at least one positive and one negative weight. If this matrix is positive (respectively negative) semi-definite and rank deficient, then the unique solution is composed of a number of Dirac masses equal to the rank of the matrix, all of which have nonnegative (respectively nonpositive) weights. Finally, in cases where (BPC) has multiple solutions, we demonstrate that there are infinitely many solutions composed of Kc+1 Dirac masses, with nonnegative (respectively nonpositive) weights if the matrix is positive (respectively negative) definite. △ Less

Submitted 21 November, 2022; v1 submitted 24 September, 2020; originally announced September 2020.

Comments: 19 pages

MSC Class: 46N10; 42B10

Journal ref: 2022 Inverse Problems 38 125005

Entropic Compressibility of Lévy Processes

Authors: Julien Fageot, Alireza Fallah, Thibaut Horel

Abstract: In contrast to their seemingly simple and shared structure of independence and stationarity, Lévy processes exhibit a wide variety of behaviors, from the self-similar Wiener process to piecewise-constant compound Poisson processes. Inspired by the recent paper of Ghourchian, Amini, and Gohari (2018), we characterize their compressibility by studying the entropy of their double discretization (both… ▽ More In contrast to their seemingly simple and shared structure of independence and stationarity, Lévy processes exhibit a wide variety of behaviors, from the self-similar Wiener process to piecewise-constant compound Poisson processes. Inspired by the recent paper of Ghourchian, Amini, and Gohari (2018), we characterize their compressibility by studying the entropy of their double discretization (both in time and amplitude) in the regime of vanishing discretization steps. For a Lévy process with absolutely continuous marginals, this reduces to understanding the asymptotics of the differential entropy of its marginals at small times, for which we obtain a new local central limit theorem. We generalize known results for stable processes to the non-stable case, with a special focus on Lévy processes that are locally self-similar, and conceptualize a new compressibility hierarchy of Lévy processes, captured by their Blumenthal-Getoor index. △ Less

Submitted 15 May, 2022; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: 34 pages, 1 figure

MSC Class: 60E07; 94A17; 60G18

TV-based Reconstruction of Periodic Functions

Authors: Julien Fageot, Matthieu Simeoni

Abstract: We introduce a general framework for the reconstruction of periodic multivariate functions from finitely many and possibly noisy linear measurements. The reconstruction task is formulated as a penalized convex optimization problem, taking the form of a sum between a convex data fidelity functional and a sparsity-promoting total variation based penalty involving a suitable spline-admissible regular… ▽ More We introduce a general framework for the reconstruction of periodic multivariate functions from finitely many and possibly noisy linear measurements. The reconstruction task is formulated as a penalized convex optimization problem, taking the form of a sum between a convex data fidelity functional and a sparsity-promoting total variation based penalty involving a suitable spline-admissible regularizing operator L. In this context, we establish a periodic representer theorem, showing that the extreme-point solutions are periodic L-splines with less knots than the number of measurements. The main results are specified for the broadest classes of measurement functionals, spline-admissible operators, and convex data fidelity functionals. We exemplify our results for various regularization operators and measurement types (e.g., spatial sampling, Fourier sampling, or square-integrable functions). We also consider the reconstruction of both univariate and multivariate periodic functions. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: 31 pages, 10 figures

3D Solid Spherical Bispectrum CNNs for Biomedical Texture Analysis

Authors: Valentin Oreiller, Vincent Andrearczyk, Julien Fageot, John O. Prior, Adrien Depeursinge

Abstract: Locally Rotation Invariant (LRI) operators have shown great potential in biomedical texture analysis where patterns appear at random positions and orientations. LRI operators can be obtained by computing the responses to the discrete rotation of local descriptors, such as Local Binary Patterns (LBP) or the Scale Invariant Feature Transform (SIFT). Other strategies achieve this invariance using Lap… ▽ More Locally Rotation Invariant (LRI) operators have shown great potential in biomedical texture analysis where patterns appear at random positions and orientations. LRI operators can be obtained by computing the responses to the discrete rotation of local descriptors, such as Local Binary Patterns (LBP) or the Scale Invariant Feature Transform (SIFT). Other strategies achieve this invariance using Laplacian of Gaussian or steerable wavelets for instance, preventing the introduction of sampling errors during the discretization of the rotations. In this work, we obtain LRI operators via the local projection of the image on the spherical harmonics basis, followed by the computation of the bispectrum, which shares and extends the invariance properties of the spectrum. We investigate the benefits of using the bispectrum over the spectrum in the design of a LRI layer embedded in a shallow Convolutional Neural Network (CNN) for 3D image analysis. The performance of each design is evaluated on two datasets and compared against a standard 3D CNN. The first dataset is made of 3D volumes composed of synthetically generated rotated patterns, while the second contains malignant and benign pulmonary nodules in Computed Tomography (CT) images. The results indicate that bispectrum CNNs allows for a significantly better characterization of 3D textures than both the spectral and standard CNN. In addition, it can efficiently learn with fewer training examples and trainable parameters when compared to a standard convolutional layer. △ Less

Submitted 2 June, 2020; v1 submitted 28 April, 2020; originally announced April 2020.

Comments: 10 pages

Wavelet Compressibility of Compound Poisson Processes

Authors: Shayan Aziznejad, Julien Fageot

Abstract: In this paper, we precisely quantify the wavelet compressibility of compound Poisson processes. To that end, we expand the given random process over the Haar wavelet basis and we analyse its asymptotic approximation properties. By only considering the nonzero wavelet coefficients up to a given scale, what we call the greedy approximation, we exploit the extreme sparsity of the wavelet expansion th… ▽ More In this paper, we precisely quantify the wavelet compressibility of compound Poisson processes. To that end, we expand the given random process over the Haar wavelet basis and we analyse its asymptotic approximation properties. By only considering the nonzero wavelet coefficients up to a given scale, what we call the greedy approximation, we exploit the extreme sparsity of the wavelet expansion that derives from the piecewise-constant nature of compound Poisson processes. More precisely, we provide lower and upper bounds for the mean squared error of greedy approximation of compound Poisson processes. We are then able to deduce that the greedy approximation error has a sub-exponential and super-polynomial asymptotic behavior. Finally, we provide numerical experiments to highlight the remarkable ability of wavelet-based dictionaries in achieving highly compressible approximations of compound Poisson processes. △ Less

Submitted 17 December, 2021; v1 submitted 25 March, 2020; originally announced March 2020.

Sparsest Piecewise-Linear Regression of One-Dimensional Data

Authors: Thomas Debarre, Quentin Denoyelle, Michael Unser, Julien Fageot

Abstract: We study the problem of one-dimensional regression of data points with total-variation (TV) regularization (in the sense of measures) on the second derivative, which is known to promote piecewise-linear solutions with few knots. While there are efficient algorithms for determining such adaptive splines, the difficulty with TV regularization is that the solution is generally non-unique, an aspect t… ▽ More We study the problem of one-dimensional regression of data points with total-variation (TV) regularization (in the sense of measures) on the second derivative, which is known to promote piecewise-linear solutions with few knots. While there are efficient algorithms for determining such adaptive splines, the difficulty with TV regularization is that the solution is generally non-unique, an aspect that is often ignored in practice. In this paper, we present a systematic analysis that results in a complete description of the solution set with a clear distinction between the cases where the solution is unique and those, much more frequent, where it is not. For the latter scenario, we identify the sparsest solutions, i.e., those with the minimum number of knots, and we derive a formula to compute the minimum number of knots based solely on the data points. To achieve this, we first consider the problem of exact interpolation which leads to an easier theoretical analysis. Next, we relax the exact interpolation requirement to a regression setting, and we consider a penalized optimization problem with a strictly convex data-fidelity cost function. We show that the underlying penalized problem can be reformulated as a constrained problem, and thus that all our previous results still apply. Based on our theoretical analysis, we propose a simple and fast two-step algorithm, agnostic to uniqueness, to reach a sparsest solution of this penalized problem. △ Less

Submitted 21 December, 2021; v1 submitted 23 March, 2020; originally announced March 2020.

Local Rotation Invariance in 3D CNNs

Authors: Vincent Andrearczyk, Julien Fageot, Valentin Oreiller, Xavier Montet, Adrien Depeursinge

Abstract: Locally Rotation Invariant (LRI) image analysis was shown to be fundamental in many applications and in particular in medical imaging where local structures of tissues occur at arbitrary rotations. LRI constituted the cornerstone of several breakthroughs in texture analysis, including Local Binary Patterns (LBP), Maximum Response 8 (MR8) and steerable filterbanks. Whereas globally rotation invaria… ▽ More Locally Rotation Invariant (LRI) image analysis was shown to be fundamental in many applications and in particular in medical imaging where local structures of tissues occur at arbitrary rotations. LRI constituted the cornerstone of several breakthroughs in texture analysis, including Local Binary Patterns (LBP), Maximum Response 8 (MR8) and steerable filterbanks. Whereas globally rotation invariant Convolutional Neural Networks (CNN) were recently proposed, LRI was very little investigated in the context of deep learning. LRI designs allow learning filters accounting for all orientations, which enables a drastic reduction of trainable parameters and training data when compared to standard 3D CNNs. In this paper, we propose and compare several methods to obtain LRI CNNs with directional sensitivity. Two methods use orientation channels (responses to rotated kernels), either by explicitly rotating the kernels or using steerable filters. These orientation channels constitute a locally rotation equivariant representation of the data. Local pooling across orientations yields LRI image analysis. Steerable filters are used to achieve a fine and efficient sampling of 3D rotations as well as a reduction of trainable parameters and operations, thanks to a parametric representations involving solid Spherical Harmonics (SH), which are products of SH with associated learned radial profiles.Finally, we investigate a third strategy to obtain LRI based on rotational invariants calculated from responses to a learned set of solid SHs. The proposed methods are evaluated and compared to standard CNNs on 3D datasets including synthetic textured volumes composed of rotated patterns, and pulmonary nodule classification in CT. The results show the importance of LRI image analysis while resulting in a drastic reduction of trainable parameters, outperforming standard 3D CNNs trained with data augmentation. △ Less

Submitted 19 March, 2020; originally announced March 2020.

Native Banach spaces for splines and variational inverse problems

Authors: Michael Unser, Julien Fageot

Abstract: We propose a systematic construction of native Banach spaces for general spline-admissible operators ${\rm L}$. In short, the native space for ${\rm L}$ and the (dual) norm $\|\cdot\|_{\mathcal{X}'}$ is the largest space of functions $f: \mathbb{R}^d \to \mathbb{R}$ such that $\|{\rm L} f\|_{\mathcal{X}'}<\infty$, subject to the constraint that the growth-restricted null space of ${\rm L}$be finit… ▽ More We propose a systematic construction of native Banach spaces for general spline-admissible operators ${\rm L}$. In short, the native space for ${\rm L}$ and the (dual) norm $\|\cdot\|_{\mathcal{X}'}$ is the largest space of functions $f: \mathbb{R}^d \to \mathbb{R}$ such that $\|{\rm L} f\|_{\mathcal{X}'}<\infty$, subject to the constraint that the growth-restricted null space of ${\rm L}$be finite-dimensional. This space, denoted by $\mathcal{X}'_{\rm L}$, is specified as the dual of the pre-native space $\mathcal{X}_{\rm L}$, which is itself obtained through a suitable completion process. The main difference with prior constructions (e.g., reproducing kernel Hilbert spaces) is that our approach involves test functions rather than sums of atoms (e.g, kernels), which makes it applicable to a much broader class of norms, including total variation. Under specific admissibility and compatibility hypotheses, we lay out the direct-sum topology of $\mathcal{X}_{\rm L}$ and $\mathcal{X}'_{\rm L}$, and identify the whole family of equivalent norms. Our construction ensures that the native space and its pre-dual are endowed with a fundamental Schwartz-Banach property. In practical terms, this means that $\mathcal{X}'_{\rm L}$ is rich enough to reproduce any function with an arbitrary degree of precision. △ Less

Submitted 24 April, 2019; originally announced April 2019.

MSC Class: 41A15; 49N45; 65D07; 46B10; 46B20

Dictionary Learning for Two-Dimensional Kendall Shapes

Authors: Anna Song, Virginie Uhlmann, Julien Fageot, Michael Unser

Abstract: We propose a novel sparse dictionary learning method for planar shapes in the sense of Kendall, namely configurations of landmarks in the plane considered up to similitudes. Our shape dictionary method provides a good trade-off between algorithmic simplicity and faithfulness with respect to the nonlinear geometric structure of Kendall's shape space. Remarkably, it boils down to a classical diction… ▽ More We propose a novel sparse dictionary learning method for planar shapes in the sense of Kendall, namely configurations of landmarks in the plane considered up to similitudes. Our shape dictionary method provides a good trade-off between algorithmic simplicity and faithfulness with respect to the nonlinear geometric structure of Kendall's shape space. Remarkably, it boils down to a classical dictionary learning formulation modified using complex weights. Existing dictionary learning methods extended to nonlinear spaces either map the manifold to a reproducing kernel Hilbert space or to a tangent space. The first approach is unnecessarily heavy in the case of Kendall's shape space and causes the geometrical understanding of shapes to be lost, while the second one induces distortions and theoretical complexity. Our approach does not suffer from these drawbacks. Instead of embedding the shape space into a linear space, we rely on the hyperplane of centered configurations, including pre-shapes from which shapes are defined as rotation orbits. In this linear space, the dictionary atoms are scaled and rotated using complex weights before summation. Furthermore, our formulation is more general than Kendall's original one: it applies to discretely-defined configurations of landmarks as well as continuously-defined interpolating curves. We implemented our algorithm by adapting the method of optimal directions combined to a Cholesky-optimized order recursive matching pursuit. An interesting feature of our shape dictionary is that it produces visually realistic atoms, while guaranteeing reconstruction accuracy. Its efficiency can mostly be attributed to a clear formulation of the framework with complex numbers. We illustrate the strong potential of our approach for the characterization of datasets of shapes up to similitudes and the analysis of patterns in deforming 2D shapes. △ Less

Submitted 11 January, 2020; v1 submitted 27 March, 2019; originally announced March 2019.

Comments: 33 pages, 13 figures

Support and Approximation Properties of Hermite Splines

Authors: Julien Fageot, Shayan Aziznejad, Michael Unser, Virginie Uhlmann

Abstract: In this paper, we formally investigate two mathematical aspects of Hermite splines which translate to features that are relevant to their practical applications. We first demonstrate that Hermite splines are maximally localized in the sense that their support sizes are minimal among pairs of functions with identical reproduction properties. Then, we precisely quantify the approximation power of He… ▽ More In this paper, we formally investigate two mathematical aspects of Hermite splines which translate to features that are relevant to their practical applications. We first demonstrate that Hermite splines are maximally localized in the sense that their support sizes are minimal among pairs of functions with identical reproduction properties. Then, we precisely quantify the approximation power of Hermite splines for reconstructing functions and their derivatives, and show that they are asymptotically identical to cubic B-splines for these tasks. Hermite splines therefore combine optimal localization and excellent approximation power, while retaining interpolation properties and closed-form expression, in contrast to existing similar approaches. These findings shed a new light on the convenience of Hermite splines for use in computer graphics and geometrical design. △ Less

Submitted 8 February, 2019; v1 submitted 7 February, 2019; originally announced February 2019.

Principled Design and Implementation of Steerable Detectors

Authors: Julien Fageot, Virginie Uhlmann, Zsuzsanna Püspöki, Benjamin Beck, Michael Unser, Adrien Depeursinge

Abstract: We provide a complete pipeline for the detection of patterns of interest in an image. In our approach, the patterns are assumed to be adequately modeled by a known template, and are located at unknown positions and orientations that we aim at retrieving. We propose a continuous-domain additive image model, where the analyzed image is the sum of the patterns to localize and a background with self-s… ▽ More We provide a complete pipeline for the detection of patterns of interest in an image. In our approach, the patterns are assumed to be adequately modeled by a known template, and are located at unknown positions and orientations that we aim at retrieving. We propose a continuous-domain additive image model, where the analyzed image is the sum of the patterns to localize and a background with self-similar isotropic power-spectrum. We are then able to compute the optimal filter fulfilling the SNR criterion based on one single template and background pair: it strongly responds to the template while being optimally decoupled from the background model. In addition, we constrain our filter to be steerable, which allows for a fast template detection together with orientation estimation. In practice, the implementation requires to discretize a continuous-domain formulation on polar grids, which is performed using quadratic radial B-splines. We demonstrate the practical usefulness of our method on a variety of template approximation and pattern detection experiments. We show that the detection performance drastically improves when we exploit the statistics of the background via its power-spectrum decay, which we refer to as spectral-sha**. The proposed scheme outperforms state-of-the-art steerable methods by up to 50% of absolute detection performance. △ Less

Submitted 14 April, 2021; v1 submitted 23 October, 2018; originally announced November 2018.

MSC Class: 68U10; 65T40; 65D07

Periodic Splines and Gaussian Processes for the Resolution of Linear Inverse Problems

Authors: Anaïs Badoual, Julien Fageot, Michael Unser

Abstract: This paper deals with the resolution of inverse problems in a periodic setting or, in other terms, the reconstruction of periodic continuous-domain signals from their noisy measurements. We focus on two reconstruction paradigms: variational and statistical. In the variational approach, the reconstructed signal is solution to an optimization problem that establishes a tradeoff between fidelity to t… ▽ More This paper deals with the resolution of inverse problems in a periodic setting or, in other terms, the reconstruction of periodic continuous-domain signals from their noisy measurements. We focus on two reconstruction paradigms: variational and statistical. In the variational approach, the reconstructed signal is solution to an optimization problem that establishes a tradeoff between fidelity to the data and smoothness conditions via a quadratic regularization associated to a linear operator. In the statistical approach, the signal is modeled as a stationary random process defined from a Gaussian white noise and a whitening operator; one then looks for the optimal estimator in the mean-square sense. We give a generic form of the reconstructed signals for both approaches, allowing for a rigorous comparison of the two.We fully characterize the conditions under which the two formulations yield the same solution, which is a periodic spline in the case of sampling measurements. We also show that this equivalence between the two approaches remains valid on simulations for a broad class of problems. This extends the practical range of applicability of the variational method. △ Less

Submitted 23 September, 2018; originally announced September 2018.

MSC Class: 65K10; 62D05; 46E22; 41A15

Continuous-Domain Solutions of Linear Inverse Problems with Tikhonov vs. Generalized TV Regularization

Authors: Harshit Gupta, Julien Fageot, Michael Unser

Abstract: We consider linear inverse problems that are formulated in the continuous domain. The object of recovery is a function that is assumed to minimize a convex objective functional. The solutions are constrained by imposing a continuous-domain regularization. We derive the parametric form of the solution (representer theorems) for Tikhonov (quadratic) and generalized total-variation (gTV) regularizati… ▽ More We consider linear inverse problems that are formulated in the continuous domain. The object of recovery is a function that is assumed to minimize a convex objective functional. The solutions are constrained by imposing a continuous-domain regularization. We derive the parametric form of the solution (representer theorems) for Tikhonov (quadratic) and generalized total-variation (gTV) regularizations. We show that, in both cases, the solutions are splines that are intimately related to the regularization operator. In the Tikhonov case, the solution is smooth and constrained to live in a fixed subspace that depends on the measurement operator. By contrast, the gTV regularization results in a sparse solution composed of only a few dictionary elements that are upper-bounded by the number of measurements and independent of the measurement operator. Our findings for the gTV regularization resonates with the minimization of the $l_1$ norm, which is its discrete counterpart and also produces sparse solutions. Finally, we find the experimental solutions for some measurement models in one dimension. We discuss the special case when the gTV regularization results in multiple solutions and devise an algorithm to find an extreme point of the solution set which is guaranteed to be sparse. △ Less

Submitted 5 February, 2018; originally announced February 2018.

Wavelet Analysis of the Besov Regularity of Lévy White Noises

Authors: Shayan Aziznejad, Julien Fageot

Abstract: We characterize the local smoothness and the asymptotic growth rate of the Lévy white noise. We do so by characterizing the weighted Besov spaces in which it is located. We extend known results in two ways. First, we obtain new bounds for the local smoothness via the Blumenthal-Getoor indices of the Lévy white noise. We also deduce the critical local smoothness when the two indices coincide, which… ▽ More We characterize the local smoothness and the asymptotic growth rate of the Lévy white noise. We do so by characterizing the weighted Besov spaces in which it is located. We extend known results in two ways. First, we obtain new bounds for the local smoothness via the Blumenthal-Getoor indices of the Lévy white noise. We also deduce the critical local smoothness when the two indices coincide, which is true for symmetric-alpha-stable, compound Poisson, and symmetric-gamma white noises to name a few. Second, we express the critical asymptotic growth rate in terms of the moment properties of the Lévy white noise. Previous analyses only provided lower bounds for both the local smoothness and the asymptotic growth rate. Showing the sharpness of these bounds requires us to determine in which Besov spaces a given Lévy white noise is (almost surely) not. Our methods are based on the wavelet-domain characterization of Besov spaces and precise moment estimates for the wavelet coefficients of the Lévy white noise. △ Less

Submitted 11 December, 2020; v1 submitted 28 January, 2018; originally announced January 2018.

Comments: 38 pages

MSC Class: 60G51; 60G20; 46E35; 42C40

Beyond Wiener's Lemma: Nuclear Convolution Algebras and the Inversion of Digital Filters

Authors: Julien Fageot, Michael Unser, John Paul Ward

Abstract: A convolution algebra is a topological vector space $\mathcal{X}$ that is closed under the convolution operation. It is said to be inverse-closed if each element of $\mathcal{X}$ whose spectrum is bounded away from zero has a convolution inverse that is also part of the algebra. The theory of discrete Banach convolution algebras is well established with a complete characterization of the weighted… ▽ More A convolution algebra is a topological vector space $\mathcal{X}$ that is closed under the convolution operation. It is said to be inverse-closed if each element of $\mathcal{X}$ whose spectrum is bounded away from zero has a convolution inverse that is also part of the algebra. The theory of discrete Banach convolution algebras is well established with a complete characterization of the weighted $\ell_1$ algebras that are inverse-closed and referred to as the Gelfand-Raikov-Shilov (GRS) spaces. Our starting point here is the observation that the space $\mathcal{S}(\mathbb{Z}^d)$ of rapidly decreasing sequences, {which is not Banach but nuclear}, is an inverse-closed convolution algebra. This property propagates to the more constrained space of exponentially decreasing sequences $\mathcal{E}(\mathbb{Z}^d)$ that we prove to be nuclear as well. Using a recent extended version of the GRS condition, we then show that $\mathcal{E}(\mathbb{Z}^d)$ is actually the smallest inverse-closed convolution algebra. This allows us to describe the hierarchy of the inverse-closed convolution algebras from the smallest, $\mathcal{E}(\mathbb{Z}^d)$, to the largest, $\ell_{1}(\mathbb{Z}^d)$. In addition, we prove that, in contrast to $\mathcal{S}(\mathbb{Z}^d)$, all members of $\mathcal{E}(\mathbb{Z}^d)$ admit well-defined convolution inverses in $\mathcal{S}'(\mathbb{Z}^d)$ with the "unstable" scenario (when some frequencies are vanishing) giving rise to inverse filters with slowly-increasing impulse responses. Finally, we use those results to reveal the decay and reproduction properties of an extended family of cardinal spline interpolants. △ Less

Submitted 10 November, 2017; originally announced November 2017.

Comments: 1 figure

MSC Class: 46H05; 11M45; 46A45; 47B37

Angular Accuracy of Steerable Feature Detectors

Authors: Zsuzsanna Püspöki, Arash Amini, Julien Fageot, John Paul Ward, Michael Unser

Abstract: The detection of landmarks or patterns is of interest for extracting features in biological images. Hence, algorithms for finding these keypoints have been extensively investigated in the literature, and their localization and detection properties are well known. In this paper, we study the complementary topic of local orientation estimation, which has not received similar attention. Simply stated… ▽ More The detection of landmarks or patterns is of interest for extracting features in biological images. Hence, algorithms for finding these keypoints have been extensively investigated in the literature, and their localization and detection properties are well known. In this paper, we study the complementary topic of local orientation estimation, which has not received similar attention. Simply stated, the problem that we address is the following: estimate the angle of rotation of a pattern with steerable filters centered at the same location, where the image is corrupted by colored isotropic Gaussian noise. For this problem, we use a statistical framework based on the Cramér-Rao lower bound (CRLB) that sets a fundamental limit on the accuracy of the corresponding class of estimators. We propose a scheme to measure the performance of estimators based on steerable filters (as a lower bound), while considering the connection to maximum likelihood estimation. Beyond the general results, we analyze the asymptotic behaviour of the lower bound in terms of the order of steerablility and propose an optimal subset of components that minimizes the bound. We define a mechanism for selecting optimal subspaces of the span of the detectors. These are characterized by the most relevant angular frequencies. Finally, we project our template to a basis of steerable functions and experimentally show that the prediction accuracy achieves the predicted CRLB. As an extension, we also consider steerable wavelet detectors. △ Less

Submitted 10 October, 2017; originally announced October 2017.

Comments: 13 pages, 3 figures

Compactly-Supported Smooth Interpolators for Shape Modeling with Varying Resolution

Authors: Daniel Schmitter, Julien Fageot, Anaïs Badoual, Pablo Garcia-Amorena, Michael Unser

Abstract: In applications that involve interactive curve and surface modeling, the intuitive manipulation of shapes is crucial. For instance, user interaction is facilitated if a geometrical object can be manipulated through control points that interpolate the shape itself. Additionally, models for shape representation often need to provide local shape control and they need to be able to reproduce common sh… ▽ More In applications that involve interactive curve and surface modeling, the intuitive manipulation of shapes is crucial. For instance, user interaction is facilitated if a geometrical object can be manipulated through control points that interpolate the shape itself. Additionally, models for shape representation often need to provide local shape control and they need to be able to reproduce common shape primitives such as ellipsoids, spheres, cylinders, or tori. We present a general framework to construct families of compactly-supported interpolators that are piecewise-exponential polynomial. They can be designed to satisfy regularity constraints of any order and they enable one to build parametric deformable shape models by suitable linear combinations of interpolators. They allow to change the resolution of shapes based on the refinability of B-splines. We illustrate their use on examples to construct shape models that involve curves and surfaces with applications to interactive modeling and character design. △ Less

Submitted 10 October, 2017; originally announced October 2017.

Comments: 26 pages, 12 figures

The Domain of Definition of the Lévy White Noise

Authors: Julien Fageot, Thomas Humeau

Abstract: It is possible to construct Lévy white noises as generalized random processes in the sense of Gel'fand and Vilenkin, or as an independently scattered random measures introduced by Rajput and Rosinski. In this article, we unify those two approaches by extending the Lévy white noise, defined as a generalized random process, to an independently scattered random measure. We are then able to give gener… ▽ More It is possible to construct Lévy white noises as generalized random processes in the sense of Gel'fand and Vilenkin, or as an independently scattered random measures introduced by Rajput and Rosinski. In this article, we unify those two approaches by extending the Lévy white noise, defined as a generalized random process, to an independently scattered random measure. We are then able to give general integrability conditions for Lévy white noises, thereby maximally enlarging their domain of definition. Based on this connection, we provide new criteria for the practical determination of the domain of definition, including specific results for the subfamilies of Gaussian, symmetric-α-stable, generalized Laplace, and compound Poisson white noises. We also apply our results to formulate a general criterion for the existence of generalized solutions of linear stochastic partial differential equations driven by a Lévy white noise. △ Less

Submitted 2 February, 2021; v1 submitted 8 August, 2017; originally announced August 2017.

Comments: 26 pages

MSC Class: 60G20; 60G57; 60G51; 60H15; 60H40

Gaussian and Sparse Processes Are Limits of Generalized Poisson Processes

Authors: Julien Fageot, Virginie Uhlmann, Michael Unser

Abstract: The theory of sparse stochastic processes offers a broad class of statistical models to study signals. In this framework, signals are represented as realizations of random processes that are solution of linear stochastic differential equations driven by white Lévy noises. Among these processes, generalized Poisson processes based on compound-Poisson noises admit an interpretation as random L-splin… ▽ More The theory of sparse stochastic processes offers a broad class of statistical models to study signals. In this framework, signals are represented as realizations of random processes that are solution of linear stochastic differential equations driven by white Lévy noises. Among these processes, generalized Poisson processes based on compound-Poisson noises admit an interpretation as random L-splines with random knots and weights. We demonstrate that every generalized Lévy process-from Gaussian to sparse-can be understood as the limit in law of a sequence of generalized Poisson processes. This enables a new conceptual understanding of sparse processes and suggests simple algorithms for the numerical generation of such objects. △ Less

Submitted 16 February, 2017; originally announced February 2017.

Comments: 16 pages, 11 figures

The n-term Approximation of Periodic Generalized Lévy Processes

Authors: Julien Fageot, Michael Unser, John Paul Ward

Abstract: In this paper, we study the compressibility of random processes and fields, called generalized Lévy processes, that are solutions of stochastic differential equations driven by $d$-dimensional periodic Lévy white noises. Our results are based on the estimation of the Besov regularity of Lévy white noises and generalized Lévy processes. We show in particular that non-Gaussian generalized Lévy proce… ▽ More In this paper, we study the compressibility of random processes and fields, called generalized Lévy processes, that are solutions of stochastic differential equations driven by $d$-dimensional periodic Lévy white noises. Our results are based on the estimation of the Besov regularity of Lévy white noises and generalized Lévy processes. We show in particular that non-Gaussian generalized Lévy processes are more compressible in a wavelet basis than the corresponding Gaussian processes, in the sense that their $n$-term approximation error decays faster. We quantify this compressibility in terms of the Blumenthal-Getoor index of the underlying Lévy white noise. △ Less

Submitted 1 February, 2018; v1 submitted 10 February, 2017; originally announced February 2017.

Comments: 23 pages

MSC Class: 60G20; 41A25

Scaling Limits of Solutions of SPDE Driven by Lévy White Noises

Authors: Julien Fageot, Michael Unser

Abstract: Consider a random process s solution of the stochastic partial differential equation Ls = w with L a homogeneous operator and w a multidimensional Lévy white noise. In this paper, we study the asymptotic effect of zooming in or zooming out of the process s. More precisely, we give sufficient conditions on L and w so that the rescaled versions of s converges in law to a self-similar process of orde… ▽ More Consider a random process s solution of the stochastic partial differential equation Ls = w with L a homogeneous operator and w a multidimensional Lévy white noise. In this paper, we study the asymptotic effect of zooming in or zooming out of the process s. More precisely, we give sufficient conditions on L and w so that the rescaled versions of s converges in law to a self-similar process of order H at coarse scales and at fine scales. The parameter H depends on the homogeneity order of the operator L and the Blumenthal-Getoor indices associated to the Lévy white noise w. Finally, we apply our general results to several notorious classes of random processes and random fields. △ Less

Submitted 10 January, 2018; v1 submitted 21 October, 2016; originally announced October 2016.

Comments: 17 pages, 2 figures

MSC Class: 60H15; 60F05; 60G18; 60G20

Multidimensional Lévy White Noises in Weighted Besov Spaces

Authors: Julien Fageot, Alireza Fallah, Michael Unser

Abstract: In this paper, we study the Besov regularity of d-dimensional Lévy white noises. More precisely, we describe new sample paths properties of a given white noise in terms of weighted Besov spaces. In particular, the smoothness and integrability properties of Lévy white noises are characterized using the Blumenthal-Getoor indices. Our techniques rely on wavelet methods and generalized moments estimat… ▽ More In this paper, we study the Besov regularity of d-dimensional Lévy white noises. More precisely, we describe new sample paths properties of a given white noise in terms of weighted Besov spaces. In particular, the smoothness and integrability properties of Lévy white noises are characterized using the Blumenthal-Getoor indices. Our techniques rely on wavelet methods and generalized moments estimates for Lévy white noises. △ Less

Submitted 4 March, 2016; originally announced March 2016.

Comments: 26 pages, 2 figures

Splines are Universal Solutions of Linear Inverse Problems with Generalized-TV regularization

Authors: Michael Unser, Julien Fageot, John Paul Ward

Abstract: Splines come in a variety of flavors that can be characterized in terms of some differential operator L. The simplest piecewise-constant model corresponds to the derivative operator. Likewise, one can extend the traditional notion of total variation by considering more general operators than the derivative. This leads us to the definition of the generalized Beppo-Levi space M, which is further ide… ▽ More Splines come in a variety of flavors that can be characterized in terms of some differential operator L. The simplest piecewise-constant model corresponds to the derivative operator. Likewise, one can extend the traditional notion of total variation by considering more general operators than the derivative. This leads us to the definition of the generalized Beppo-Levi space M, which is further identified as the direct sum of two Banach spaces. We then prove that the minimization of the generalized total variation (gTV) over M, subject to some arbitrary (convex) consistency constraints on the linear measurements of the signal, admits nonuniform L-spline solutions with fewer knots than the number of measurements. This shows that non-uniform splines are universal solutions of continuous-domain linear inverse problems with LASSO, L1, or TV-like regularization constraints. Remarkably, the spline-type is fully determined by the choice of L and does not depend on the actual nature of the measurements. △ Less

Submitted 8 December, 2016; v1 submitted 4 March, 2016; originally announced March 2016.

Comments: 28 pages, 1 figure

MSC Class: 41A15; 47A52; 94A20; 46E27; 46N20; 47F05; 34A08; 26A33

On the Besov Regularity of Periodic Lévy Noises

Authors: Julien Fageot, Michael Unser, John Paul Ward

Abstract: In this paper, we study the Besov regularity of Lévy white noises on the $d$-dimensional torus. Due to their rough sample paths, the white noises that we consider are defined as generalized stochastic fields. We, initially, obtain regularity results for general Lévy white noises. Then, we focus on two subclasses of noises: compound Poisson and symmetric-$α$-stable (including Gaussian), for which w… ▽ More In this paper, we study the Besov regularity of Lévy white noises on the $d$-dimensional torus. Due to their rough sample paths, the white noises that we consider are defined as generalized stochastic fields. We, initially, obtain regularity results for general Lévy white noises. Then, we focus on two subclasses of noises: compound Poisson and symmetric-$α$-stable (including Gaussian), for which we make more precise statements. Before measuring regularity, we show that the question is well-posed; we prove that Besov spaces are in the cylindrical $σ$-field of the space of generalized functions. These results pave the way to the characterization of the $n$-term wavelet approximation properties of stochastic processes. △ Less

Submitted 18 June, 2015; originally announced June 2015.

Comments: 24 pages

MSC Class: 60G05; 60G17; 60G20; 60G52; 60H40; 42C40; 46E35

On the Continuity of Characteristic Functionals and Sparse Stochastic Modeling

Authors: Julien Fageot, Arash Amini, Michael Unser

Abstract: The characteristic functional is the infinite-dimensional generalization of the Fourier transform for measures on function spaces. It characterizes the statistical law of the associated stochastic process in the same way as a characteristic function specifies the probability distribution of its corresponding random variable. Our goal in this work is to lay the foundations of the innovation model,… ▽ More The characteristic functional is the infinite-dimensional generalization of the Fourier transform for measures on function spaces. It characterizes the statistical law of the associated stochastic process in the same way as a characteristic function specifies the probability distribution of its corresponding random variable. Our goal in this work is to lay the foundations of the innovation model, a (possibly) non-Gaussian probabilistic model for sparse signals. This is achieved by using the characteristic functional to specify sparse stochastic processes that are defined as linear transformations of general continuous-domain white noises (also called innovation processes). We prove the existence of a broad class of sparse processes by using the Minlos-Bochner theorem. This requires a careful study of the regularity properties, especially the boundedness in Lp-spaces, of the characteristic functional of the innovations. We are especially interested in the functionals that are only defined for p<1 since they appear to be associated with the sparser kind of processes. Finally, we apply our main theorem of existence to two specific subclasses of processes with specific invariance properties. △ Less

Submitted 28 January, 2014; v1 submitted 27 January, 2014; originally announced January 2014.

Comments: 24 pages