Showing 1–14 of 14 results for author: Edidin, D

A transversality theorem for semi-algebraic sets with application to signal recovery from the second moment and cryo-EM

Authors: Tamir Bendory, Nadav Dym, Dan Edidin, Arun Suresh

Abstract: Semi-algebraic priors are ubiquitous in signal processing and machine learning. Prevalent examples include a) linear models where the signal lies in a low-dimensional subspace; b) sparse models where the signal can be represented by only a few coefficients under a suitable basis; and c) a large family of neural network generative models. In this paper, we prove a transversality theorem for semi-al… ▽ More Semi-algebraic priors are ubiquitous in signal processing and machine learning. Prevalent examples include a) linear models where the signal lies in a low-dimensional subspace; b) sparse models where the signal can be represented by only a few coefficients under a suitable basis; and c) a large family of neural network generative models. In this paper, we prove a transversality theorem for semi-algebraic sets in orthogonal or unitary representations of groups: with a suitable dimension bound, a generic translate of any semi-algebraic set is transverse to the orbits of the group action. This, in turn, implies that if a signal lies in a low-dimensional semi-algebraic set, then it can be recovered uniquely from measurements that separate orbits. As an application, we consider the implications of the transversality theorem to the problem of recovering signals that are translated by random group actions from their second moment. As a special case, we discuss cryo-EM: a leading technology to constitute the spatial structure of biological molecules, which serves as our prime motivation. In particular, we derive explicit bounds for recovering a molecular structure from the second moment under a semi-algebraic prior and deduce information-theoretic implications. We also obtain information-theoretic bounds for three additional applications: factoring Gram matrices, multi-reference alignment, and phase retrieval. Finally, we deduce bounds for designing permutation invariant separators in machine learning. △ Less

Submitted 10 June, 2024; v1 submitted 7 May, 2024; originally announced May 2024.

Phase retrieval with semi-algebraic and ReLU neural network priors

Authors: Tamir Bendory, Nadav Dym, Dan Edidin, Arun Suresh

Abstract: The key ingredient to retrieving a signal from its Fourier magnitudes, namely, to solve the phase retrieval problem, is an effective prior on the sought signal. In this paper, we study the phase retrieval problem under the prior that the signal lies in a semi-algebraic set. This is a very general prior as semi-algebraic sets include linear models, sparse models, and ReLU neural network generative… ▽ More The key ingredient to retrieving a signal from its Fourier magnitudes, namely, to solve the phase retrieval problem, is an effective prior on the sought signal. In this paper, we study the phase retrieval problem under the prior that the signal lies in a semi-algebraic set. This is a very general prior as semi-algebraic sets include linear models, sparse models, and ReLU neural network generative models. The latter is the main motivation of this paper, due to the remarkable success of deep generative models in a variety of imaging tasks, including phase retrieval. We prove that almost all signals in R^N can be determined from their Fourier magnitudes, up to a sign, if they lie in a (generic) semi-algebraic set of dimension N/2. The same is true for all signals if the semi-algebraic set is of dimension N/4. We also generalize these results to the problem of signal recovery from the second moment in multi-reference alignment models with multiplicity free representations of compact groups. This general result is then used to derive improved sample complexity bounds for recovering band-limited functions on the sphere from their noisy copies, each acted upon by a random element of SO(3). △ Less

Submitted 15 November, 2023; originally announced November 2023.

The generic crystallographic phase retrieval problem

Authors: Dan Edidin, Arun Suresh

Abstract: In this paper we consider the problem of recovering a signal $x \in \mathbb{R}^N$ from its power spectrum assuming that the signal is sparse with respect to a generic basis for $\mathbb{R}^N$. Our main result is that if the sparsity level is at most $\sim\! N/2$ in this basis then the generic sparse vector is uniquely determined up to sign from its power spectrum. We also prove that if the sparsit… ▽ More In this paper we consider the problem of recovering a signal $x \in \mathbb{R}^N$ from its power spectrum assuming that the signal is sparse with respect to a generic basis for $\mathbb{R}^N$. Our main result is that if the sparsity level is at most $\sim\! N/2$ in this basis then the generic sparse vector is uniquely determined up to sign from its power spectrum. We also prove that if the sparsity level is $\sim\! N/4$ then every sparse vector is determined up to sign from its power spectrum. Analogous results are also obtained for the power spectrum of a vector in $\mathbb{C}^N$ which extend earlier results of Wang and Xu \cite{arXiv:1310.0873}. △ Less

Submitted 24 July, 2023; v1 submitted 13 July, 2023; originally announced July 2023.

Comments: 20 pages

MSC Class: 42A10; 94A12; 94A15

Orbit recovery for band-limited functions

Authors: Dan Edidin, Matthew Satriano

Abstract: We study the third moment for functions on arbitrary compact Lie groups. We use techniques of representation theory to generalize the notion of band-limited functions in classical Fourier theory to functions on the compact groups $SU(n), SO(n), Sp(n)$. We then prove that for generic band-limited functions the third moment or, its Fourier equivalent, the bispectrum determines the function up to tra… ▽ More We study the third moment for functions on arbitrary compact Lie groups. We use techniques of representation theory to generalize the notion of band-limited functions in classical Fourier theory to functions on the compact groups $SU(n), SO(n), Sp(n)$. We then prove that for generic band-limited functions the third moment or, its Fourier equivalent, the bispectrum determines the function up to translation by a single unitary matrix. Moreover, if $G=SU(n)$ or $G=SO(2n+1)$ we prove that the third moment determines the $G$-orbit of a band-limited function. As a corollary we obtain a large class of finite-dimensional representations of these groups for which the third moment determines the orbit of a generic vector. When $G=SO(3)$ this gives a result relevant to cryo-EM which was our original motivation for studying this problem. △ Less

Submitted 31 May, 2023; originally announced June 2023.

Comments: 17 pages

MSC Class: 94A12; 22D10

Finite alphabet phase retrieval

Authors: Tamir Bendory, Dan Edidin, Ivan Gonzalez

Abstract: We consider the finite alphabet phase retrieval problem: recovering a signal whose entries lie in a small alphabet of possible values from its Fourier magnitudes. This problem arises in the celebrated technology of X-ray crystallography to determine the atomic structure of biological molecules. Our main result states that for generic values of the alphabet, two signals have the same Fourier magnit… ▽ More We consider the finite alphabet phase retrieval problem: recovering a signal whose entries lie in a small alphabet of possible values from its Fourier magnitudes. This problem arises in the celebrated technology of X-ray crystallography to determine the atomic structure of biological molecules. Our main result states that for generic values of the alphabet, two signals have the same Fourier magnitudes if and only if several partitions have the same difference sets. Thus, the finite alphabet phase retrieval problem reduces to the combinatorial problem of determining a signal from those difference sets. Notably, this result holds true when one of the letters of the alphabet is zero, namely, for sparse signals with finite alphabet, which is the situation in X-ray crystallography. △ Less

Submitted 7 April, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

The sample complexity of sparse multi-reference alignment and single-particle cryo-electron microscopy

Authors: Tamir Bendory, Dan Edidin

Abstract: Multi-reference alignment (MRA) is the problem of recovering a signal from its multiple noisy copies, each acted upon by a random group element. MRA is mainly motivated by single-particle cryo-electron microscopy (cryo-EM) that has recently joined X-ray crystallography as one of the two leading technologies to reconstruct biological molecular structures. Previous papers have shown that in the high… ▽ More Multi-reference alignment (MRA) is the problem of recovering a signal from its multiple noisy copies, each acted upon by a random group element. MRA is mainly motivated by single-particle cryo-electron microscopy (cryo-EM) that has recently joined X-ray crystallography as one of the two leading technologies to reconstruct biological molecular structures. Previous papers have shown that in the high noise regime, the sample complexity of MRA and cryo-EM is $n=ω(σ^{2d})$, where $n$ is the number of observations, $σ^2$ is the variance of the noise, and $d$ is the lowest-order moment of the observations that uniquely determines the signal. In particular, it was shown that in many cases, $d=3$ for generic signals, and thus the sample complexity is $n=ω(σ^6)$. In this paper, we analyze the second moment of the MRA and cryo-EM models. First, we show that in both models the second moment determines the signal up to a set of unitary matrices, whose dimension is governed by the decomposition of the space of signals into irreducible representations of the group. Second, we derive sparsity conditions under which a signal can be recovered from the second moment, implying sample complexity of $n=ω(σ^4)$. Notably, we show that the sample complexity of cryo-EM is $n=ω(σ^4)$ if at most one third of the coefficients representing the molecular structure are non-zero; this bound is near-optimal. The analysis is based on tools from representation theory and algebraic geometry. We also derive bounds on recovering a sparse signal from its power spectrum, which is the main computational problem of X-ray crystallography. △ Less

Submitted 14 August, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

Algebraic theory of phase retrieval

Authors: Tamir Bendory, Dan Edidin

Abstract: The purpose of this article is to discuss recent advances in the growing field of phase retrieval, and to publicize open problems that we believe will be of interest to mathematicians in general, and algebraists in particular. The purpose of this article is to discuss recent advances in the growing field of phase retrieval, and to publicize open problems that we believe will be of interest to mathematicians in general, and algebraists in particular. △ Less

Submitted 5 March, 2022; originally announced March 2022.

Near-optimal bounds for signal recovery from blind phaseless periodic short-time Fourier transform

Authors: Tamir Bendory, Chi-yu Cheng, Dan Edidin

Abstract: We study the problem of recovering a signal $x\in\mathbb{C}^N$ from samples of its phaseless periodic short-time Fourier transform (STFT): the magnitude of the Fourier transform of the signal multiplied by a sliding window $w\in \mathbb{C}^W$. We show that if the window $w$ is known, then a generic signal can be recovered, up to a global phase, from less than 4N phaseless STFT measurements. In the… ▽ More We study the problem of recovering a signal $x\in\mathbb{C}^N$ from samples of its phaseless periodic short-time Fourier transform (STFT): the magnitude of the Fourier transform of the signal multiplied by a sliding window $w\in \mathbb{C}^W$. We show that if the window $w$ is known, then a generic signal can be recovered, up to a global phase, from less than 4N phaseless STFT measurements. In the blind case, when the window is unknown, we show that the signal and the window can be determined simultaneously, up to a group of unavoidable ambiguities, from less than 4N+2W measurements. In both cases, our bounds are optimal, up to a constant smaller than two. △ Less

Submitted 22 September, 2022; v1 submitted 6 December, 2021; originally announced December 2021.

Dihedral multi-reference alignment

Authors: Tamir Bendory, Dan Edidin, William Leeb, Nir Sharon

Abstract: We study the dihedral multi-reference alignment problem of estimating the orbit of a signal from multiple noisy observations of the signal, acted on by random elements of the dihedral group. We show that if the group elements are drawn from a generic distribution, the orbit of a generic signal is uniquely determined from the second moment of the observations. This implies that the optimal estimati… ▽ More We study the dihedral multi-reference alignment problem of estimating the orbit of a signal from multiple noisy observations of the signal, acted on by random elements of the dihedral group. We show that if the group elements are drawn from a generic distribution, the orbit of a generic signal is uniquely determined from the second moment of the observations. This implies that the optimal estimation rate in the high noise regime is proportional to the square of the variance of the noise. This is the first result of this type for multi-reference alignment over a non-abelian group with a non-uniform distribution of group elements. Based on tools from invariant theory and algebraic geometry, we also delineate conditions for unique orbit recovery for multi-reference alignment models over finite groups (namely, when the dihedral group is replaced by a general finite group) when the group elements are drawn from a generic distribution. Finally, we design and study numerically three computational frameworks for estimating the signal based on group synchronization, expectation-maximization, and the method of moments. △ Less

Submitted 4 January, 2022; v1 submitted 12 July, 2021; originally announced July 2021.

Signal recovery from a few linear measurements of its high-order spectra

Authors: Tamir Bendory, Dan Edidin, Shay Kreymer

Abstract: The $q$-th order spectrum is a polynomial of degree $q$ in the entries of a signal $x\in\mathbb{C}^N$, which is invariant under circular shifts of the signal. For $q\geq 3$, this polynomial determines the signal uniquely, up to a circular shift, and is called a high-order spectrum. The high-order spectra, and in particular the bispectrum ($q=3$) and the trispectrum ($q=4$), play a prominent role i… ▽ More The $q$-th order spectrum is a polynomial of degree $q$ in the entries of a signal $x\in\mathbb{C}^N$, which is invariant under circular shifts of the signal. For $q\geq 3$, this polynomial determines the signal uniquely, up to a circular shift, and is called a high-order spectrum. The high-order spectra, and in particular the bispectrum ($q=3$) and the trispectrum ($q=4$), play a prominent role in various statistical signal processing and imaging applications, such as phase retrieval and single-particle reconstruction. However, the dimension of the $q$-th order spectrum is $N^{q-1}$, far exceeding the dimension of $x$, leading to increased computational load and storage requirements. In this work, we show that it is unnecessary to store and process the full high-order spectra: a signal can be characterized uniquely, up to symmetries, from only $N+1$ linear measurements of its high-order spectra. The proof relies on tools from algebraic geometry and is corroborated by numerical experiments. △ Less

Submitted 31 August, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Toward a mathematical theory of the crystallographic phase retrieval problem

Authors: Tamir Bendory, Dan Edidin

Abstract: Motivated by the X-ray crystallography technology to determine the atomic structure of biological molecules, we study the crystallographic phase retrieval problem, arguably the leading and hardest phase retrieval setup. This problem entails recovering a K-sparse signal of length N from its Fourier magnitude or, equivalently, from its periodic auto-correlation. Specifically, this work focuses on th… ▽ More Motivated by the X-ray crystallography technology to determine the atomic structure of biological molecules, we study the crystallographic phase retrieval problem, arguably the leading and hardest phase retrieval setup. This problem entails recovering a K-sparse signal of length N from its Fourier magnitude or, equivalently, from its periodic auto-correlation. Specifically, this work focuses on the fundamental question of uniqueness: what is the maximal sparsity level K/N that allows unique map** between a signal and its Fourier magnitude, up to intrinsic symmetries. We design a systemic computational technique to affirm uniqueness for any specific pair (K,N), and establish the following conjecture: the Fourier magnitude determines a generic signal uniquely, up to intrinsic symmetries, as long as K<=N/2. Based on group-theoretic considerations and an additional computational technique, we formulate a second conjecture: if K<N/2, then for any signal the set of solutions to the crystallographic phase retrieval problem has measure zero in the set of all signals with a given Fourier magnitude. Together, these conjectures constitute the first attempt to establish a mathematical theory for the crystallographic phase retrieval problem. △ Less

Submitted 2 July, 2020; v1 submitted 24 February, 2020; originally announced February 2020.

Blind Phaseless Short-Time Fourier Transform Recovery

Authors: Tamir Bendory, Dan Edidin, Yonina C. Eldar

Abstract: The problem of recovering a pair of signals from their blind phaseless short-time Fourier transform measurements arises in several important phase retrieval applications, including ptychography and ultra-short pulse characterization. In this paper, we prove that in order to determine a pair of generic signals uniquely, up to trivial ambiguities, the number of phaseless measurements one needs to co… ▽ More The problem of recovering a pair of signals from their blind phaseless short-time Fourier transform measurements arises in several important phase retrieval applications, including ptychography and ultra-short pulse characterization. In this paper, we prove that in order to determine a pair of generic signals uniquely, up to trivial ambiguities, the number of phaseless measurements one needs to collect is, at most, five times the number of parameters required to describe the signals. This result improves significantly upon previous papers, which required the number of measurements to be quadratic in the number of parameters rather than linear. In addition, we consider the simpler problem of recovering a pair of generic signals from their blind short-time Fourier transform, when the phases are known. In this setting, which can be understood as a special case of the blind deconvolution problem, we show that the number of measurements required to determine the two signals, up to trivial ambiguities, equals exactly the number of parameters to be recovered. As a side result, we study the classical phase retrieval problem---that is, recovering a signal from its Fourier magnitudes---when some entries of the signal are known apriori. We derive a bound on the number of required measurements as a function of the size of the set of known entries. Specifically, we show that if most of the signal's entries are known, then only a few Fourier magnitudes are necessary to determine a signal uniquely. △ Less

Submitted 9 April, 2019; v1 submitted 22 August, 2018; originally announced August 2018.

On Signal Reconstruction from FROG Measurements

Authors: Tamir Bendory, Dan Edidin, Yonina C. Eldar

Abstract: Phase retrieval refers to recovering a signal from its Fourier magnitude. This problem arises naturally in many scientific applications, such as ultra-short laser pulse characterization and diffraction imaging. Unfortunately, phase retrieval is ill-posed for almost all one-dimensional signals. In order to characterize a laser pulse and overcome the ill-posedness, it is common to use a technique ca… ▽ More Phase retrieval refers to recovering a signal from its Fourier magnitude. This problem arises naturally in many scientific applications, such as ultra-short laser pulse characterization and diffraction imaging. Unfortunately, phase retrieval is ill-posed for almost all one-dimensional signals. In order to characterize a laser pulse and overcome the ill-posedness, it is common to use a technique called Frequency-Resolved Optical Gating (FROG). In FROG, the measured data, referred to as FROG trace, is the Fourier magnitude of the product of the underlying signal with several translated versions of itself. The FROG trace results in a system of phaseless quartic Fourier measurements. In this paper, we prove that it suffices to consider only three translations of the signal to determine almost all bandlimited signals, up to trivial ambiguities. In practice, one usually also has access to the signal's Fourier magnitude. We show that in this case only two translations suffice. Our results significantly improve upon earlier work. △ Less

Submitted 3 April, 2018; v1 submitted 26 June, 2017; originally announced June 2017.

An algebraic characterization of injectivity in phase retrieval

Authors: Aldo Conca, Dan Edidin, Milena Hering, Cynthia Vinzant

Abstract: A complex frame is a collection of vectors that span $\mathbb{C}^M$ and define measurements, called intensity measurements, on vectors in $\mathbb{C}^M$. In purely mathematical terms, the problem of phase retrieval is to recover a complex vector from its intensity measurements, namely the modulus of its inner product with these frame vectors. We show that any vector is uniquely determined (up to a… ▽ More A complex frame is a collection of vectors that span $\mathbb{C}^M$ and define measurements, called intensity measurements, on vectors in $\mathbb{C}^M$. In purely mathematical terms, the problem of phase retrieval is to recover a complex vector from its intensity measurements, namely the modulus of its inner product with these frame vectors. We show that any vector is uniquely determined (up to a global phase factor) from $4M-4$ generic measurements. To prove this, we identify the set of frames defining non-injective measurements with the projection of a real variety and bound its dimension. △ Less

Submitted 30 November, 2013; originally announced December 2013.

Comments: 11 pages

Journal ref: Applied and Computational Harmonic Analysis 38:2 (2015) pp. 346-356