-
Denoising Sphere-Valued Data by Relaxed Total Variation Regularization
Authors:
Robert Beinert,
Jonas Bresch
Abstract:
Circle- and sphere-valued data play a significant role in inverse problems like magnetic resonance phase imaging and radar interferometry, in the analysis of directional information, and in color restoration tasks. In this paper, we aim to restore $(d-1)$-sphere-valued signals exploiting the classical anisotropic total variation on the surrounding $d$-dimensional Euclidean space. For this, we prop…
▽ More
Circle- and sphere-valued data play a significant role in inverse problems like magnetic resonance phase imaging and radar interferometry, in the analysis of directional information, and in color restoration tasks. In this paper, we aim to restore $(d-1)$-sphere-valued signals exploiting the classical anisotropic total variation on the surrounding $d$-dimensional Euclidean space. For this, we propose a novel variational formulation, whose data fidelity is based on inner products instead of the usually employed squared norms. Convexifying the resulting non-convex problem and using ADMM, we derive an efficient and fast numerical denoiser. In the special case of binary (0-sphere-valued) signals, the relaxation is provable tight, i.e. the relaxed solution can be used to construct a solution of the original non-convex problem. Moreover, the tightness can be numerically observed for barcode and QR code denoising as well as in higher dimensional experiments like the color restoration using hue and chromaticity and the recovery of SO(3)-valued signals.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
Tangential Fixpoint Iterations for Gromov-Wasserstein Barycenters
Authors:
Florian Beier,
Robert Beinert
Abstract:
The Gromov-Wasserstein (GW) transport problem is a relaxation of classic optimal transport, which seeks a transport between two measures while preserving their internal geometry. Due to meeting this theoretical underpinning, it is a valuable tool for the analysis of objects that do not possess a natural embedding or should be studied independently of it. Prime applications can thus be found in e.g…
▽ More
The Gromov-Wasserstein (GW) transport problem is a relaxation of classic optimal transport, which seeks a transport between two measures while preserving their internal geometry. Due to meeting this theoretical underpinning, it is a valuable tool for the analysis of objects that do not possess a natural embedding or should be studied independently of it. Prime applications can thus be found in e.g. shape matching, classification and interpolation tasks. To tackle the latter, one theoretically justified approach is the employment of multi-marginal GW transport and GW barycenters, which are Fréchet means with respect to the GW distance. However, because the computation of GW itself already poses a quadratic and non-convex optimization problem, the determination of GW barycenters is a hard task and algorithms for their computation are scarce. In this paper, we revisit a known procedure for the determination of Fréchet means in Riemannian manifolds via tangential approximations in the context of GW. We provide a characterization of barycenters in the GW tangent space, which ultimately gives rise to a fixpoint iteration for approximating GW barycenters using multi-marginal plans. We propose a relaxation of this fixpoint iteration and show that it monotonously decreases the barycenter loss. In certain cases our proposed method naturally provides us with barycentric embeddings. The resulting algorithm is capable of producing qualitative shape interpolations between multiple 3d shapes with support sizes of over thousands of points in reasonable time. In addition, we verify our method on shape classification and multi-graph matching tasks.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernel
Authors:
Paul Hagemann,
Johannes Hertrich,
Fabian Altekrüger,
Robert Beinert,
Jannis Chemseddine,
Gabriele Steidl
Abstract:
We propose conditional flows of the maximum mean discrepancy (MMD) with the negative distance kernel for posterior sampling and conditional generative modeling. This MMD, which is also known as energy distance, has several advantageous properties like efficient computation via slicing and sorting. We approximate the joint distribution of the ground truth and the observations using discrete Wassers…
▽ More
We propose conditional flows of the maximum mean discrepancy (MMD) with the negative distance kernel for posterior sampling and conditional generative modeling. This MMD, which is also known as energy distance, has several advantageous properties like efficient computation via slicing and sorting. We approximate the joint distribution of the ground truth and the observations using discrete Wasserstein gradient flows and establish an error bound for the posterior distributions. Further, we prove that our particle flow is indeed a Wasserstein gradient flow of an appropriate functional. The power of our method is demonstrated by numerical examples including conditional image generation and inverse problems like superresolution, inpainting and computed tomography in low-dose and limited-angle settings.
△ Less
Submitted 21 March, 2024; v1 submitted 4 October, 2023;
originally announced October 2023.
-
Denoising of Sphere- and SO(3)-Valued Data by Relaxed Tikhonov Regularization
Authors:
Robert Beinert,
Jonas Bresch,
Gabriele Steidl
Abstract:
Manifold-valued signal- and image processing has received attention due to modern image acquisition techniques. Recently, a convex relaxation of the otherwise nonconvex Tikhonov-regularization for denoising circle-valued data has been proposed by Condat (2022). The circle constraints are here encoded in a series of low-dimensional, positive semi-definite matrices. Using Schur complement arguments,…
▽ More
Manifold-valued signal- and image processing has received attention due to modern image acquisition techniques. Recently, a convex relaxation of the otherwise nonconvex Tikhonov-regularization for denoising circle-valued data has been proposed by Condat (2022). The circle constraints are here encoded in a series of low-dimensional, positive semi-definite matrices. Using Schur complement arguments, we show that the resulting variational model can be simplified while leading to the same solution. The simplified model can be generalized to higher dimensional spheres and to SO(3)-valued data, where we rely on the quaternion representation of the latter. Standard algorithms from convex analysis can be applied to solve the resulting convex minimization problem. As proof-of-the-concept, we use the alternating direction method of multipliers to demonstrate the denoising behavior of the proposed method. In a series of experiments, we demonstrate the numerical convergence of the signal- or image values to the underlying manifold.
△ Less
Submitted 16 May, 2024; v1 submitted 20 July, 2023;
originally announced July 2023.
-
Sliced Optimal Transport on the Sphere
Authors:
Michael Quellmalz,
Robert Beinert,
Gabriele Steidl
Abstract:
Sliced optimal transport reduces optimal transport on multi-dimensional domains to transport on the line. More precisely, sliced optimal transport is the concatenation of the well-known Radon transform and the cumulative density transform, which analytically yields the solutions of the reduced transport problems. Inspired by this concept, we propose two adaptions for optimal transport on the 2-sph…
▽ More
Sliced optimal transport reduces optimal transport on multi-dimensional domains to transport on the line. More precisely, sliced optimal transport is the concatenation of the well-known Radon transform and the cumulative density transform, which analytically yields the solutions of the reduced transport problems. Inspired by this concept, we propose two adaptions for optimal transport on the 2-sphere. Firstly, as counterpart to the Radon transform, we introduce the vertical slice transform, which integrates along all circles orthogonal to a given direction. Secondly, we introduce a semicircle transform, which integrates along all half great circles with an appropriate weight function. Both transforms are generalized to arbitrary measures on the sphere. While the vertical slice transform can be combined with optimal transport on the interval and leads to a sliced Wasserstein distance restricted to even probability measures, the semicircle transform is related to optimal transport on the circle and results in a different sliced Wasserstein distance for arbitrary probability measures. The applicability of both novel sliced optimal transport concepts on the sphere is demonstrated by proof-of-concept examples dealing with the interpolation and classification of spherical probability measures. The numerical implementation relies on the singular value decompositions of both transforms and fast Fourier techniques. For the inversion with respect to probability measures, we propose the minimization of an entropy-regularized Kullback--Leibler divergence, which can be numerically realized using a primal-dual proximal splitting algorithm.
△ Less
Submitted 2 August, 2023; v1 submitted 18 April, 2023;
originally announced April 2023.
-
Prony-Based Super-Resolution Phase Retrieval of Sparse, Multivariate Signals
Authors:
Robert Beinert,
Saghar Rezaei
Abstract:
Phase retrieval consists in the recovery of an unknown signal from phaseless measurements of its usually complex-valued Fourier transform. Without further assumptions, this problem is notorious to be severe ill posed such that the recovery of the true signal is nearly impossible. In certain applications like crystallography, speckle imaging in astronomy, or blind channel estimation in communicatio…
▽ More
Phase retrieval consists in the recovery of an unknown signal from phaseless measurements of its usually complex-valued Fourier transform. Without further assumptions, this problem is notorious to be severe ill posed such that the recovery of the true signal is nearly impossible. In certain applications like crystallography, speckle imaging in astronomy, or blind channel estimation in communications, the unknown signal has a specific, sparse structure. In this paper, we exploit these sparse structure to recover the unknown signal uniquely up to inevitable ambiguities as global phase shifts, transitions, and conjugated reflections. Although using a constructive proof essentially based on Prony's method, our focus lies on the derivation of a recovery guarantee for multivariate signals using an adaptive sampling scheme. Instead of sampling the entire multivariate Fourier intensity, we only employ Fourier samples along certain adaptively chosen lines. For bivariate signals, an analogous result can be established for samples in generic directions. The number of samples here scales quadratically to the sparsity level of the unknown signal.
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Wasserstein Gradient Flows of the Discrepancy with Distance Kernel on the Line
Authors:
Johannes Hertrich,
Robert Beinert,
Manuel Gräf,
Gabriele Steidl
Abstract:
This paper provides results on Wasserstein gradient flows between measures on the real line. Utilizing the isometric embedding of the Wasserstein space $\mathcal P_2(\mathbb R)$ into the Hilbert space $L_2((0,1))$, Wasserstein gradient flows of functionals on $\mathcal P_2(\mathbb R)$ can be characterized as subgradient flows of associated functionals on $L_2((0,1))$. For the maximum mean discrepa…
▽ More
This paper provides results on Wasserstein gradient flows between measures on the real line. Utilizing the isometric embedding of the Wasserstein space $\mathcal P_2(\mathbb R)$ into the Hilbert space $L_2((0,1))$, Wasserstein gradient flows of functionals on $\mathcal P_2(\mathbb R)$ can be characterized as subgradient flows of associated functionals on $L_2((0,1))$. For the maximum mean discrepancy functional $\mathcal F_ν:= \mathcal D^2_K(\cdot, ν)$ with the non-smooth negative distance kernel $K(x,y) = -|x-y|$, we deduce a formula for the associated functional. This functional appears to be convex, and we show that $\mathcal F_ν$ is convex along (generalized) geodesics. For the Dirac measure $ν= δ_q$, $q \in \mathbb R$ as end point of the flow, this enables us to determine the Wasserstein gradient flows analytically. Various examples of Wasserstein gradient flows are given for illustration.
△ Less
Submitted 11 January, 2023;
originally announced January 2023.
-
Wasserstein Steepest Descent Flows of Discrepancies with Riesz Kernels
Authors:
Johannes Hertrich,
Manuel Gräf,
Robert Beinert,
Gabriele Steidl
Abstract:
The aim of this paper is twofold. Based on the geometric Wasserstein tangent space, we first introduce Wasserstein steepest descent flows. These are locally absolutely continuous curves in the Wasserstein space whose tangent vectors point into a steepest descent direction of a given functional. This allows the use of Euler forward schemes instead of Jordan--Kinderlehrer--Otto schemes. For $λ$-conv…
▽ More
The aim of this paper is twofold. Based on the geometric Wasserstein tangent space, we first introduce Wasserstein steepest descent flows. These are locally absolutely continuous curves in the Wasserstein space whose tangent vectors point into a steepest descent direction of a given functional. This allows the use of Euler forward schemes instead of Jordan--Kinderlehrer--Otto schemes. For $λ$-convex functionals, we show that Wasserstein steepest descent flows are an equivalent characterization of Wasserstein gradient flows. The second aim is to study Wasserstein flows of the maximum mean discrepancy with respect to certain Riesz kernels. The crucial part is hereby the treatment of the interaction energy. Although it is not $λ$-convex along generalized geodesics, we give analytic expressions for Wasserstein steepest descent flows of the interaction energy starting at Dirac measures. In contrast to smooth kernels, the particle may explode, i.e., a Dirac measure becomes a non-Dirac one. The computation of steepest descent flows amounts to finding equilibrium measures with external fields, which nicely links Wasserstein flows of interaction energies with potential theory. Finally, we provide numerical simulations of Wasserstein steepest descent flows of discrepancies.
△ Less
Submitted 4 October, 2023; v1 submitted 2 November, 2022;
originally announced November 2022.
-
Total Variation-Based Reconstruction and Phase Retrieval for Diffraction Tomography with an Arbitrarily Moving Object
Authors:
Robert Beinert,
Michael Quellmalz
Abstract:
We consider the imaging problem of the reconstruction of a three-dimensional object via optical diffraction tomography under the assumptions of the Born approximation. Our focus lies in the situation that a rigid object performs an irregular, time-dependent rotation under acoustical or optical forces. In this study, we compare reconstruction algorithms in case i) that two-dimensional images of the…
▽ More
We consider the imaging problem of the reconstruction of a three-dimensional object via optical diffraction tomography under the assumptions of the Born approximation. Our focus lies in the situation that a rigid object performs an irregular, time-dependent rotation under acoustical or optical forces. In this study, we compare reconstruction algorithms in case i) that two-dimensional images of the complex-valued wave are known, or ii) that only the intensity (absolute value) of these images can be measured, which is the case in many practical setups. The latter phase-retrieval problem can be solved by an all-at-once approach based utilizing a hybrid input-output scheme with TV regularization.
△ Less
Submitted 15 November, 2022; v1 submitted 7 October, 2022;
originally announced October 2022.
-
Multi-marginal Approximation of the Linear Gromov-Wasserstein Distance
Authors:
Florian Beier,
Robert Beinert
Abstract:
Recently, two concepts from optimal transport theory have successfully been brought to the Gromov--Wasserstein (GW) setting. This introduces a linear version of the GW distance and multi-marginal GW transport. The former can reduce the computational complexity when computing all GW distances of a large set of inputs. The latter allows for a simultaneous matching of more than two marginals, which c…
▽ More
Recently, two concepts from optimal transport theory have successfully been brought to the Gromov--Wasserstein (GW) setting. This introduces a linear version of the GW distance and multi-marginal GW transport. The former can reduce the computational complexity when computing all GW distances of a large set of inputs. The latter allows for a simultaneous matching of more than two marginals, which can for example be used to compute GW barycenters. The aim of this paper is to show an approximation result which characterizes the linear version as a limit of a multi-marginal GW formulation.
△ Less
Submitted 15 November, 2022; v1 submitted 4 October, 2022;
originally announced October 2022.
-
On Assignment Problems Related to Gromov-Wasserstein Distances on the Real Line
Authors:
Robert Beinert,
Cosmas Heiss,
Gabriele Steidl
Abstract:
Let $x_1 < \dots < x_n$ and $y_1 < \dots < y_n$, $n \in \mathbb N$, be real numbers. We show by an example that the assignment problem $$ \max_{σ\in S_n} F_σ(x,y) := \frac12 \sum_{i,k=1}^n |x_i - x_k|^α\, |y_{σ(i)} - y_{σ(k)}|^α, \quad α>0, $$ is in general neither solved by the identical permutation (id) nor the anti-identical permutation (a-id) if $n > 2 +2^α$. Indeed the above maximum can be, d…
▽ More
Let $x_1 < \dots < x_n$ and $y_1 < \dots < y_n$, $n \in \mathbb N$, be real numbers. We show by an example that the assignment problem $$ \max_{σ\in S_n} F_σ(x,y) := \frac12 \sum_{i,k=1}^n |x_i - x_k|^α\, |y_{σ(i)} - y_{σ(k)}|^α, \quad α>0, $$ is in general neither solved by the identical permutation (id) nor the anti-identical permutation (a-id) if $n > 2 +2^α$. Indeed the above maximum can be, depending on the number of points, arbitrary far away from $F_\text{id}(x,y)$ and $F_\text{a-id}(x,y)$. The motivation to deal with such assignment problems came from their relation to Gromov-Wasserstein divergences which have recently attained a lot of attention.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Multi-Marginal Gromov-Wasserstein Transport and Barycenters
Authors:
Florian Beier,
Robert Beinert,
Gabriele Steidl
Abstract:
Gromov-Wasserstein (GW) distances are combinations of Gromov-Hausdorff and Wasserstein distances that allow the comparison of two different metric measure spaces (mm-spaces). Due to their invariance under measure- and distance-preserving transformations, they are well suited for many applications in graph and shape analysis. In this paper, we introduce the concept of multi-marginal GW transport be…
▽ More
Gromov-Wasserstein (GW) distances are combinations of Gromov-Hausdorff and Wasserstein distances that allow the comparison of two different metric measure spaces (mm-spaces). Due to their invariance under measure- and distance-preserving transformations, they are well suited for many applications in graph and shape analysis. In this paper, we introduce the concept of multi-marginal GW transport between a set of mm-spaces as well as its regularized and unbalanced versions. As a special case, we discuss multi-marginal fused variants, which combine the structure information of an mm-space with label information from an additional label space. To tackle the new formulations numerically, we consider the bi-convex relaxation of the multi-marginal GW problem, which is tight in the balanced case if the cost function is conditionally negative definite. The relaxed model can be solved by an alternating minimization, where each step can be performed by a multi-marginal Sinkhorn scheme. We show relations of our multi-marginal GW problem to (unbalanced, fused) GW barycenters and present various numerical results, which indicate the potential of the concept.
△ Less
Submitted 13 July, 2023; v1 submitted 13 May, 2022;
originally announced May 2022.
-
Total variation-based reconstruction and phase retrieval for diffraction tomography
Authors:
Robert Beinert,
Michael Quellmalz
Abstract:
In optical diffraction tomography (ODT), the three-dimensional scattering potential of a microscopic object rotating around its center is recovered by a series of illuminations with coherent light. Reconstruction algorithms such as the filtered backpropagation require knowledge of the complex-valued wave at the measurement plane, whereas often only intensities, i.e., phaseless measurements, are av…
▽ More
In optical diffraction tomography (ODT), the three-dimensional scattering potential of a microscopic object rotating around its center is recovered by a series of illuminations with coherent light. Reconstruction algorithms such as the filtered backpropagation require knowledge of the complex-valued wave at the measurement plane, whereas often only intensities, i.e., phaseless measurements, are available in practice.
We propose a new reconstruction approach for ODT with unknown phase information based on three key ingredients. First, the light propagation is modeled using Born's approximation enabling us to use the Fourier diffraction theorem. Second, we stabilize the inversion of the non-uniform discrete Fourier transform via total variation regularization utilizing a primal-dual iteration, which also yields a novel numerical inversion formula for ODT with known phase. The third ingredient is a hybrid input-output scheme. We achieved convincing numerical results, which indicate that ODT with phaseless data is possible. The so-obtained 2D and 3D reconstructions are even comparable to the ones with known phase.
△ Less
Submitted 1 June, 2022; v1 submitted 27 January, 2022;
originally announced January 2022.
-
On a linear Gromov-Wasserstein distance
Authors:
Florian Beier,
Robert Beinert,
Gabriele Steidl
Abstract:
Gromov-Wasserstein distances are generalization of Wasserstein distances, which are invariant under distance preserving transformations. Although a simplified version of optimal transport in Wasserstein spaces, called linear optimal transport (LOT), was successfully used in practice, there does not exist a notion of linear Gromov-Wasserstein distances so far. In this paper, we propose a definition…
▽ More
Gromov-Wasserstein distances are generalization of Wasserstein distances, which are invariant under distance preserving transformations. Although a simplified version of optimal transport in Wasserstein spaces, called linear optimal transport (LOT), was successfully used in practice, there does not exist a notion of linear Gromov-Wasserstein distances so far. In this paper, we propose a definition of linear Gromov-Wasserstein distances. We motivate our approach by a generalized LOT model, which is based on barycentric projection maps of transport plans. Numerical examples illustrate that the linear Gromov-Wasserstein distances, similarly as LOT, can replace the expensive computation of pairwise Gromov-Wasserstein distances in applications like shape classification.
△ Less
Submitted 5 July, 2022; v1 submitted 22 December, 2021;
originally announced December 2021.
-
Approximation of Curve-based Sleeve Functions in High Dimensions
Authors:
Robert Beinert
Abstract:
Sleeve functions are generalizations of the well-established ridge functions that play a major role in the theory of partial differential equation, medical imaging, statistics, and neural networks. Where ridge functions are non-linear, univariate functions of the distance to hyperplanes, sleeve functions are based on the squared distance to lower-dimensional manifolds. The present work is a first…
▽ More
Sleeve functions are generalizations of the well-established ridge functions that play a major role in the theory of partial differential equation, medical imaging, statistics, and neural networks. Where ridge functions are non-linear, univariate functions of the distance to hyperplanes, sleeve functions are based on the squared distance to lower-dimensional manifolds. The present work is a first step to study general sleeve functions by starting with sleeve functions based on finite-length curves. To capture these curve-based sleeve functions, we propose and study a two-step method, where first the outer univariate function - the profile - is recovered, and second the underlying curve is represented by a polygonal chain. Introducing a concept of well-separation, we ensure that the proposed method always terminates and approximate the true sleeve function with a certain quality. Investigating the local geometry, we study an inexact version of our method and show its success under certain conditions.
△ Less
Submitted 14 September, 2021;
originally announced September 2021.
-
On the Dynamical System of Principal Curves in $\mathbb R^d$
Authors:
Robert Beinert,
Arian Bërdëllima,
Manuel Gräf,
Gabriele Steidl
Abstract:
Principal curves are natural generalizations of principal lines arising as first principal components in the Principal Component Analysis. They can be characterized from a stochastic point of view as so-called self-consistent curves based on the conditional expectation and from the variational-calculus point of view as saddle points of the expected difference of a random variable and its projectio…
▽ More
Principal curves are natural generalizations of principal lines arising as first principal components in the Principal Component Analysis. They can be characterized from a stochastic point of view as so-called self-consistent curves based on the conditional expectation and from the variational-calculus point of view as saddle points of the expected difference of a random variable and its projection onto some curve, where the current curve acts as argument of the energy functional. Beyond that, Duchamp and Stützle (1993,1996) showed that planar curves can by computed as solutions of a system of ordinary differential equations. The aim of this paper is to generalize this characterization of principal curves to $\mathbb R^d$ with $d \ge 3$. Having derived such a dynamical system, we provide several examples for principal curves related to uniform distribution on certain domains in $\mathbb R^3$.
△ Less
Submitted 31 July, 2021;
originally announced August 2021.
-
Phase Retrieval and System Identification in Dynamical Sampling via Prony's Method
Authors:
Robert Beinert,
Marzieh Hasannasab
Abstract:
Phase retrieval in dynamical sampling is a novel research direction, where an unknown signal has to be recovered from the phaseless measurements with respect to a dynamical frame, i.e. a sequence of sampling vectors constructed by the repeated action of an operator. The loss of the phase here turns the well-posed dynamical sampling into a severe ill-posed inverse problem. In the existing literatur…
▽ More
Phase retrieval in dynamical sampling is a novel research direction, where an unknown signal has to be recovered from the phaseless measurements with respect to a dynamical frame, i.e. a sequence of sampling vectors constructed by the repeated action of an operator. The loss of the phase here turns the well-posed dynamical sampling into a severe ill-posed inverse problem. In the existing literature, the involved operator is usually completely known. In this paper, we combine phase retrieval in dynamical sampling with the identification of the system. For instance, if the dynamical frame is based on a repeated convolution, then we want to recover the unknown convolution kernel in advance. Using Prony's method, we establish several recovery guarantees for signal and system, whose proofs are constructive and yield analytic recovery methods. The required assumptions are satisfied by almost all signals, operators, and sampling vectors. Moreover, these guarantees not only hold for the finite-dimensional setting but also carry over to infinite-dimensional spaces. Studying the sensitivity of the analytic recovery procedures, we also establish error bounds for the applied approximate Prony method with respect to complex exponential sums.
△ Less
Submitted 18 March, 2021;
originally announced March 2021.
-
Phase Retrieval via Polarization in Dynamical Sampling
Authors:
Robert Beinert,
Marzieh Hasannasab
Abstract:
In this paper we consider the nonlinear inverse problem of phase retrieval in the context of dynamical sampling. Where phase retrieval deals with the recovery of signals & images from phaseless measurements, dynamical sampling was introduced by Aldroubi et al in 2015 as a tool to recover diffusion fields from spatiotemporal samples. Considering finite-dimensional signals evolving in time under the…
▽ More
In this paper we consider the nonlinear inverse problem of phase retrieval in the context of dynamical sampling. Where phase retrieval deals with the recovery of signals & images from phaseless measurements, dynamical sampling was introduced by Aldroubi et al in 2015 as a tool to recover diffusion fields from spatiotemporal samples. Considering finite-dimensional signals evolving in time under the action of a known matrix, our aim is to recover the signal up to global phase in a stable way from the absolute value of certain space-time measurements. First, we state necessary conditions for the dynamical system of sampling vectors to make the recovery of the unknown signal possible. The conditions deal with the spectrum of the given matrix and the initial sampling vector. Then, assuming that we have access to a specific set of further measurements related to aligned sampling vectors, we provide a feasible procedure to recover almost every signal up to global phase using polarization techniques. Moreover, we show that by adding extra conditions like full spark, the recovery of all signals is possible without exceptions.
△ Less
Submitted 31 January, 2021;
originally announced February 2021.
-
Super-Resolution for Doubly-Dispersive Channel Estimation
Authors:
Robert Beinert,
Peter Jung,
Gabriele Steidl,
Tom Szollmann
Abstract:
In this work we consider the problem of identification and reconstruction of doubly-dispersive channel operators which are given by finite linear combinations of time-frequency shifts. Such operators arise as time-varying linear systems for example in radar and wireless communications. In particular, for information transmission in highly non-stationary environments the channel needs to be estimat…
▽ More
In this work we consider the problem of identification and reconstruction of doubly-dispersive channel operators which are given by finite linear combinations of time-frequency shifts. Such operators arise as time-varying linear systems for example in radar and wireless communications. In particular, for information transmission in highly non-stationary environments the channel needs to be estimated quickly with identification signals of short duration and for vehicular application simultaneous high-resolution radar is desired as well. We consider the time-continuous setting and prove an exact resampling reformulation of the involved channel operator when applied to a trigonometric polynomial as identifier in terms of sparse linear combinations of real-valued atoms. Motivated by recent works of Heckel et al. we present an exact approach for off-the-grid superresolution which allows to perform the identification with realizable signals having compact support. Then we show how an alternating descent conditional gradient algorithm can be adapted to solve the reformulated problem. Numerical examples demonstrate the performance of this algorithm, in particular in comparison with a simple adaptive grid refinement strategy and an orthogonal matching pursuit algorithm.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Robust PCA via Regularized REAPER with a Matrix-Free Proximal Algorithm
Authors:
Robert Beinert,
Gabriele Steidl
Abstract:
Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex optimization problem. Usually the number of principal components must be determined in advance and the minimization is performed over symmetric positive semi-definite ma…
▽ More
Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex optimization problem. Usually the number of principal components must be determined in advance and the minimization is performed over symmetric positive semi-definite matrices having the size of the data, although the number of principal components is substantially smaller. This prohibits its use if the dimension of the data is large which is often the case in image processing.
In this paper, we propose a regularized version of REAPER which enforces the sparsity of the number of principal components by penalizing the nuclear norm of the corresponding orthogonal projector. This has the advantage that only an upper bound on the number of principal components is required. Our second contribution is a matrix-free algorithm to find a minimizer of the regularized REAPER which is also suited for high dimensional data. The algorithm couples a primal-dual minimization approach with a thick-restarted Lanczos process. As a side result, we discuss the topic of the bias in robust PCA. Numerical examples demonstrate the performance of our algorithm.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
Tensor-Free Proximal Methods for Lifted Bilinear/Quadratic Inverse Problems with Applications to Phase Retrieval
Authors:
Robert Beinert,
Kristian Bredies
Abstract:
We propose and study a class of novel algorithms that aim at solving bilinear and quadratic inverse problems. Using a convex relaxation based on tensorial lifting, and applying first-order proximal algorithms, these problems could be solved numerically by singular value thresholding methods. However, a direct realization of these algorithms for, e.g., image recovery problems is often impracticable…
▽ More
We propose and study a class of novel algorithms that aim at solving bilinear and quadratic inverse problems. Using a convex relaxation based on tensorial lifting, and applying first-order proximal algorithms, these problems could be solved numerically by singular value thresholding methods. However, a direct realization of these algorithms for, e.g., image recovery problems is often impracticable, since computations have to be performed on the tensor-product space, whose dimension is usually tremendous. To overcome this limitation, we derive tensor-free versions of common singular value thresholding methods by exploiting low-rank representations and incorporating an augmented Lanczos process. Using a novel reweighting technique, we further improve the convergence behavior and rank evolution of the iterative algorithms. Applying the method to the two-dimensional masked Fourier phase retrieval problem, we obtain an efficient recovery method. Moreover, the tensor-free algorithms are flexible enough to incorporate a-priori smoothness constraints that greatly improve the recovery results.
△ Less
Submitted 10 July, 2019;
originally announced July 2019.
-
Non-convex regularization of bilinear and quadratic inverse problems by tensorial lifting
Authors:
Robert Beinert,
Kristian Bredies
Abstract:
Considering the question: how non-linear may a non-linear operator be in order to extend the linear regularization theory, we introduce the class of dilinear map**s, which covers linear, bilinear, and quadratic operators between Banach spaces. The corresponding dilinear inverse problems cover blind deconvolution, deautoconvolution, parallel imaging in MRI, and the phase retrieval problem. Based…
▽ More
Considering the question: how non-linear may a non-linear operator be in order to extend the linear regularization theory, we introduce the class of dilinear map**s, which covers linear, bilinear, and quadratic operators between Banach spaces. The corresponding dilinear inverse problems cover blind deconvolution, deautoconvolution, parallel imaging in MRI, and the phase retrieval problem. Based on the universal property of the tensor product, the central idea is here to lift the non-linear map**s to linear representatives on a suitable topological tensor space. At the same time, we extend the class of usually convex regularization functionals to the class of diconvex functionals, which are likewise defined by a tensorial lifting. Generalizing the concepts of subgradients and Bregman distances from convex analysis to the new framework, we analyse the novel class of dilinear inverse problems and establish convergence rates under similar conditions than in the linear setting. Considering the deautoconvolution problem as specific application, we derive satisfiable source conditions and validate the theoretical convergence rates numerically.
△ Less
Submitted 27 April, 2018;
originally announced April 2018.
-
Sparse phase retrieval of one-dimensional signals by Prony's method
Authors:
Robert Beinert,
Gerlind Plonka
Abstract:
In this paper, we show that sparse signals f representable as a linear combination of a finite number N of spikes at arbitrary real locations or as a finite linear combination of B-splines of order m with arbitrary real knots can be almost surely recovered from O(N^2) Fourier intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the…
▽ More
In this paper, we show that sparse signals f representable as a linear combination of a finite number N of spikes at arbitrary real locations or as a finite linear combination of B-splines of order m with arbitrary real knots can be almost surely recovered from O(N^2) Fourier intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the Prony method is applied to recover all parameters of the autocorrelation function and in the second step the parameters of f are derived. Moreover, we present an algorithm to evaluate f from its Fourier intensities and illustrate it at different numerical examples.
△ Less
Submitted 31 January, 2017;
originally announced January 2017.
-
Ambiguities in one-dimensional phase retrieval from magnitudes of a linear canonical transform
Authors:
Robert Beinert
Abstract:
Phase retrieval problems occur in a wide range of applications in physics and engineering. Usually, these problems consist in the recovery of an unknown signal from the magnitudes of its Fourier transform. In some applications, however, the given intensity arises from a different transformation such as the Fresnel or fractional Fourier transform. More generally, we here consider the phase retrieva…
▽ More
Phase retrieval problems occur in a wide range of applications in physics and engineering. Usually, these problems consist in the recovery of an unknown signal from the magnitudes of its Fourier transform. In some applications, however, the given intensity arises from a different transformation such as the Fresnel or fractional Fourier transform. More generally, we here consider the phase retrieval of an unknown signal from the magnitudes of an arbitrary linear canonical transform. Using the close relation between the Fourier and the linear canonical transform, we investigate the arising ambiguities of these phase retrieval problems and transfer the well-known characterizations of the solution sets from the classical Fourier phase retrieval problem to the new setting.
△ Less
Submitted 15 June, 2016;
originally announced June 2016.
-
Non-negativity constraints in the one-dimensional discrete-time phase retrieval problem
Authors:
Robert Beinert
Abstract:
Phase retrieval problems occur in a width range of applications in physics and engineering such as crystallography, astronomy, and laser optics. Common to all of them is the recovery of an unknown signal from the intensity of its Fourier transform. Because of the well-known ambiguousness of these problems, the determination of the original signal is generally challenging. Although there are many a…
▽ More
Phase retrieval problems occur in a width range of applications in physics and engineering such as crystallography, astronomy, and laser optics. Common to all of them is the recovery of an unknown signal from the intensity of its Fourier transform. Because of the well-known ambiguousness of these problems, the determination of the original signal is generally challenging. Although there are many approaches in the literature to incorporate the assumption of non-negativity of the solution into numerical algorithms, theoretical considerations about the solvability with this constraint occur rarely. In this paper, we consider the one-dimensional discrete-time setting and investigate whether the usually applied a priori non-negativity can overcame the ambiguousness of the phase retrieval problem or not. We show that the assumed non-negativity of the solution is usually not a sufficient a priori condition to ensure uniqueness in one-dimensional phase retrieval. More precisely, using an appropriate characterization of the occurring ambiguities, we show that neither the uniqueness nor the ambiguousness are rare exceptions.
△ Less
Submitted 18 May, 2016;
originally announced May 2016.
-
Enforcing uniqueness in one-dimensional phase retrieval by additional signal information in time domain
Authors:
Robert Beinert,
Gerlind Plonka
Abstract:
Considering the ambiguousness of the discrete-time phase retrieval problem to recover a signal from its Fourier intensities, one can ask the question: what additional information about the unknown signal do we need to select the correct solution within the large solution set? Based on a characterization of the occurring ambiguities, we investigate different a priori conditions in order to reduce t…
▽ More
Considering the ambiguousness of the discrete-time phase retrieval problem to recover a signal from its Fourier intensities, one can ask the question: what additional information about the unknown signal do we need to select the correct solution within the large solution set? Based on a characterization of the occurring ambiguities, we investigate different a priori conditions in order to reduce the number of ambiguities or even to receive a unique solution. Particularly, if we have access to additional magnitudes of the unknown signal in the time domain, we can show that almost all signals with finite support can be uniquely recovered. Moreover, we prove that an analogous result can be obtained by exploiting additional phase information.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
-
One-dimensional phase retrieval with additional interference measurements
Authors:
Robert Beinert
Abstract:
The one-dimensional phase retrieval problem consists in the recovery of a complex-valued signal from its Fourier intensity. Due to the well-known ambiguousness of this problem, the determination of the original signal within the extensive solution set is challenging and can only be done under suitable a priori assumption or additional information about the unknown signal. Depending on the applicat…
▽ More
The one-dimensional phase retrieval problem consists in the recovery of a complex-valued signal from its Fourier intensity. Due to the well-known ambiguousness of this problem, the determination of the original signal within the extensive solution set is challenging and can only be done under suitable a priori assumption or additional information about the unknown signal. Depending on the application, one has sometimes access to further interference measurements between the unknown signal and a reference signal. Beginning with the reconstruction in the discrete-time setting, we show that each signal can be uniquely recovered from its Fourier intensity and two further interference measurements between the unknown signal and a modulation of the signal itself. Afterwards, we consider the continuous-time problem, where we obtain an equivalent result. Moreover, the unique recovery of a continuous-time signal can also be ensured by using interference measurements with a known or an unknown reference which is unrelated to the unknown signal.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
