-
Wavelets Are All You Need for Autoregressive Image Generation
Authors:
Wael Mattar,
Idan Levy,
Nir Sharon,
Shai Dekel
Abstract:
In this paper, we take a new approach to autoregressive image generation that is based on two main ingredients. The first is wavelet image coding, which allows to tokenize the visual details of an image from coarse to fine details by ordering the information starting with the most significant bits of the most significant wavelet coefficients. The second is a variant of a language transformer whose…
▽ More
In this paper, we take a new approach to autoregressive image generation that is based on two main ingredients. The first is wavelet image coding, which allows to tokenize the visual details of an image from coarse to fine details by ordering the information starting with the most significant bits of the most significant wavelet coefficients. The second is a variant of a language transformer whose architecture is re-designed and optimized for token sequences in this 'wavelet language'. The transformer learns the significant statistical correlations within a token sequence, which are the manifestations of well-known correlations between the wavelet subbands at various resolutions. We show experimental results with conditioning on the generation process.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Efficient Trajectory Inference in Wasserstein Space Using Consecutive Averaging
Authors:
Amartya Banerjee,
Harlin Lee,
Nir Sharon,
Caroline Moosmüller
Abstract:
Capturing data from dynamic processes through cross-sectional measurements is seen in many fields such as computational biology. Trajectory inference deals with the challenge of reconstructing continuous processes from such observations. In this work, we propose methods for B-spline approximation and interpolation of point clouds through consecutive averaging that is instrinsic to the Wasserstein…
▽ More
Capturing data from dynamic processes through cross-sectional measurements is seen in many fields such as computational biology. Trajectory inference deals with the challenge of reconstructing continuous processes from such observations. In this work, we propose methods for B-spline approximation and interpolation of point clouds through consecutive averaging that is instrinsic to the Wasserstein space. Combining subdivision schemes with optimal transport-based geodesic, our methods carry out trajectory inference at a chosen level of precision and smoothness, and can automatically handle scenarios where particles undergo division over time. We rigorously evaluate our method by providing convergence guarantees and testing it on simulated cell data characterized by bifurcations and merges, comparing its performance against state-of-the-art trajectory inference and interpolation methods. The results not only underscore the effectiveness of our method in inferring trajectories, but also highlight the benefit of performing interpolation and approximation that respect the inherent geometric properties of the data.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Function Extrapolation with Neural Networks and Its Application for Manifolds
Authors:
Guy Hay,
Nir Sharon
Abstract:
This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior knowledge of the function. In addition, by carefully analyzing the problem, we obtain a bound on the error over the extrapolation domain and define a condition nu…
▽ More
This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior knowledge of the function. In addition, by carefully analyzing the problem, we obtain a bound on the error over the extrapolation domain and define a condition number for this problem that quantifies the level of difficulty of the setup. Compared to other machine learning methods that provide time series prediction, such as transformers, our approach is suitable for setups where the interpolation and extrapolation regions are general subdomains and, in particular, manifolds. In addition, our construction leads to an improved loss function that helps us boost the accuracy and robustness of our neural network. We conduct comprehensive numerical tests and comparisons of our extrapolation versus standard methods. The results illustrate the effectiveness of our approach in various scenarios.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Improving the convergence analysis of linear subdivision schemes
Authors:
Nira Dyn,
Nir Sharon
Abstract:
This work presents several new results concerning the analysis of the convergence of binary, univariate, and linear subdivision schemes, all related to the {\it contractivity factor} of a convergent scheme. First, we prove that a convergent scheme cannot have a contractivity factor lower than half. Since the lower this factor is, the faster is the convergence of the scheme, schemes with contractiv…
▽ More
This work presents several new results concerning the analysis of the convergence of binary, univariate, and linear subdivision schemes, all related to the {\it contractivity factor} of a convergent scheme. First, we prove that a convergent scheme cannot have a contractivity factor lower than half. Since the lower this factor is, the faster is the convergence of the scheme, schemes with contractivity factor $\frac{1}{2}$, such as those generating spline functions, have optimal convergence rate.
Additionally, we provide further insights and conditions for the convergence of linear schemes and demonstrate their applicability in an improved algorithm for determining the convergence of such subdivision schemes.
△ Less
Submitted 21 May, 2024; v1 submitted 15 May, 2024;
originally announced May 2024.
-
$ \mathrm{SE} (3) $ Synchronization by Eigenvectors of Dual Quaternion Matrices
Authors:
Ido Hadi,
Tamir Bendory,
Nir Sharon
Abstract:
In synchronization problems, the goal is to estimate elements of a group from noisy measurements of their ratios. A popular estimation method for synchronization is the spectral method. It extracts the group elements from eigenvectors of a block matrix formed from the measurements. The eigenvectors must be projected, or "rounded", onto the group. The rounding procedures are constructed ad hoc and…
▽ More
In synchronization problems, the goal is to estimate elements of a group from noisy measurements of their ratios. A popular estimation method for synchronization is the spectral method. It extracts the group elements from eigenvectors of a block matrix formed from the measurements. The eigenvectors must be projected, or "rounded", onto the group. The rounding procedures are constructed ad hoc and increasingly so when applied to synchronization problems over non-compact groups.
In this paper, we develop a spectral approach to synchronization over the non-compact group $\mathrm{SE}(3)$, the group of rigid motions of $\mathbb{R}^3$. We based our method on embedding $\mathrm{SE}(3)$ into the algebra of dual quaternions, which has deep algebraic connections with the group $\mathrm{SE}(3)$. These connections suggest a natural rounding procedure considerably more straightforward than the current state-of-the-art for spectral $\mathrm{SE}(3)$ synchronization, which uses a matrix embedding of $\mathrm{SE}(3)$. We show by numerical experiments that our approach yields comparable results to the current state-of-the-art in $\mathrm{SE}(3)$ synchronization via the spectral method. Thus, our approach reaps the benefits of the dual quaternion embedding of $\mathrm{SE}(3)$, while yielding estimators of similar quality.
△ Less
Submitted 14 July, 2023;
originally announced July 2023.
-
Pseudo-reversing and its application for multiscaling of manifold-valued data
Authors:
Wael Mattar,
Nir Sharon
Abstract:
The well-known Wiener's lemma is a valuable statement in harmonic analysis; in the Banach space of functions with absolutely convergent Fourier series, the lemma proposes a sufficient condition for the existence of a pointwise multiplicative inverse. We call the functions that admit an inverse as \emph{reversible}. In this paper, we introduce a simple and efficient method for approximating the inv…
▽ More
The well-known Wiener's lemma is a valuable statement in harmonic analysis; in the Banach space of functions with absolutely convergent Fourier series, the lemma proposes a sufficient condition for the existence of a pointwise multiplicative inverse. We call the functions that admit an inverse as \emph{reversible}. In this paper, we introduce a simple and efficient method for approximating the inverse of functions, which are not necessarily reversible, with elements from the space. We term this process \emph{pseudo-reversing}. In addition, we define a condition number to measure the reversibility of functions and study the reversibility under pseudo-reversing. Then, we exploit pseudo-reversing to construct a multiscale pyramid transform based on a refinement operator and its pseudo-reverse for analyzing real and manifold-valued data. Finally, we present the properties of the resulting multiscale methods and numerically illustrate different aspects of pseudo-reversing, including the applications of its resulting multiscale transform to data compression and contrast enhancement of manifold-valued sequence.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
Deep Neural-network Prior for Orbit Recovery from Method of Moments
Authors:
Yuehaw Khoo,
Sounak Paul,
Nir Sharon
Abstract:
Orbit recovery problems are a class of problems that often arise in practice and various forms. In these problems, we aim to estimate an unknown function after being distorted by a group action and observed via a known operator. Typically, the observations are contaminated with a non-trivial level of noise. Two particular orbit recovery problems of interest in this paper are multireference alignme…
▽ More
Orbit recovery problems are a class of problems that often arise in practice and various forms. In these problems, we aim to estimate an unknown function after being distorted by a group action and observed via a known operator. Typically, the observations are contaminated with a non-trivial level of noise. Two particular orbit recovery problems of interest in this paper are multireference alignment and single-particle cryo-EM modelling. In order to suppress the noise, we suggest using the method of moments approach for both problems while introducing deep neural network priors. In particular, our neural networks should output the signals and the distribution of group elements, with moments being the input. In the multireference alignment case, we demonstrate the advantage of using the NN to accelerate the convergence for the reconstruction of signals from the moments. Finally, we use our method to reconstruct simulated and biological volumes in the cryo-EM setting.
△ Less
Submitted 30 January, 2024; v1 submitted 27 April, 2023;
originally announced April 2023.
-
On multiscale quasi-interpolation of scattered scalar- and manifold-valued functions
Authors:
Nir Sharon,
Rafael Sherbu Cohen,
Holger Wendland
Abstract:
We address the problem of approximating an unknown function from its discrete samples given at arbitrarily scattered sites. This problem is essential in numerical sciences, where modern applications also highlight the need for a solution to the case of functions with manifold values. In this paper, we introduce and analyze a combination of kernel-based quasi-interpolation and multiscale approximat…
▽ More
We address the problem of approximating an unknown function from its discrete samples given at arbitrarily scattered sites. This problem is essential in numerical sciences, where modern applications also highlight the need for a solution to the case of functions with manifold values. In this paper, we introduce and analyze a combination of kernel-based quasi-interpolation and multiscale approximations for both scalar- and manifold-valued functions. While quasi-interpolation provides a powerful tool for approximation problems if the data is defined on infinite grids, the situation is more complicated when it comes to scattered data. Here, higher-order quasi-interpolation schemes either require derivative information or become numerically unstable. Hence, this paper principally studies the improvement achieved by combining quasi-interpolation with a multiscale technique. The main contributions of this paper are as follows. First, we introduce the multiscale quasi-interpolation technique for scalar-valued functions. Second, we show how this technique can be carried over using moving least-squares operators to the manifold-valued setting. Third, we give a mathematical proof that converging quasi-interpolation will also lead to converging multiscale quasi-interpolation. Fourth, we provide ample numerical evidence that multiscale quasi-interpolation has superior convergence to quasi-interpolation. In addition, we will provide examples showing that the multiscale quasi-interpolation approach offers a powerful tool for many data analysis tasks, such as denoising and anomaly detection. It is especially attractive for cases of massive data points and high dimensionality.
△ Less
Submitted 13 May, 2023; v1 submitted 25 October, 2022;
originally announced October 2022.
-
Geometric Hermite Interpolation in $\mathbb{R}^n$ by Refinements
Authors:
Hofit Ben-Zion Vardi,
Nira Dyn,
Nir Sharon
Abstract:
We describe a general approach for constructing a broad class of operators approximating high-dimensional curves based on geometric Hermite data. The geometric Hermite data consists of point samples and their associated tangent vectors of unit length. Extending the classical Hermite interpolation of functions, this geometric Hermite problem has become popular in recent years and has ignited a seri…
▽ More
We describe a general approach for constructing a broad class of operators approximating high-dimensional curves based on geometric Hermite data. The geometric Hermite data consists of point samples and their associated tangent vectors of unit length. Extending the classical Hermite interpolation of functions, this geometric Hermite problem has become popular in recent years and has ignited a series of solutions in the 2D plane and 3D space. Here, we present a method for approximating curves, which is valid in any dimension. A basic building block of our approach is a Hermite average - a notion introduced in this paper. We provide an example of such an average and show, via an illustrative interpolating subdivision scheme, how the limits of the subdivision scheme inherit geometric properties of the average. Finally, we prove the convergence of this subdivision scheme, whose limit interpolates the geometric Hermite data and approximates the sampled curve. We conclude the paper with various numerical examples that elucidate the advantages of our approach.
△ Less
Submitted 6 March, 2022;
originally announced March 2022.
-
Flexible rational approximation and its application for matrix functions
Authors:
Nir Sharon,
Vinesha Peiris,
Nadia Sukhorukova,
Julien Ugon
Abstract:
This paper proposes a unique optimization approach for estimating the minimax rational approximation and its application for evaluating matrix functions. Our method enables the extension to generalized rational approximations and has the flexibility of adding constraints. In particular, the latter allows us to control specific properties preferred in matrix function evaluation. For example, in the…
▽ More
This paper proposes a unique optimization approach for estimating the minimax rational approximation and its application for evaluating matrix functions. Our method enables the extension to generalized rational approximations and has the flexibility of adding constraints. In particular, the latter allows us to control specific properties preferred in matrix function evaluation. For example, in the case of a normal matrix, we can guarantee a bound over the condition number of the matrix, which one needs to invert for evaluating the rational matrix function. We demonstrate the efficiency of our approach for several applications of matrix functions based on direct spectrum filtering.
△ Less
Submitted 25 December, 2022; v1 submitted 20 August, 2021;
originally announced August 2021.
-
Dihedral multi-reference alignment
Authors:
Tamir Bendory,
Dan Edidin,
William Leeb,
Nir Sharon
Abstract:
We study the dihedral multi-reference alignment problem of estimating the orbit of a signal from multiple noisy observations of the signal, acted on by random elements of the dihedral group. We show that if the group elements are drawn from a generic distribution, the orbit of a generic signal is uniquely determined from the second moment of the observations. This implies that the optimal estimati…
▽ More
We study the dihedral multi-reference alignment problem of estimating the orbit of a signal from multiple noisy observations of the signal, acted on by random elements of the dihedral group. We show that if the group elements are drawn from a generic distribution, the orbit of a generic signal is uniquely determined from the second moment of the observations. This implies that the optimal estimation rate in the high noise regime is proportional to the square of the variance of the noise. This is the first result of this type for multi-reference alignment over a non-abelian group with a non-uniform distribution of group elements. Based on tools from invariant theory and algebraic geometry, we also delineate conditions for unique orbit recovery for multi-reference alignment models over finite groups (namely, when the dihedral group is replaced by a general finite group) when the group elements are drawn from a generic distribution. Finally, we design and study numerically three computational frameworks for estimating the signal based on group synchronization, expectation-maximization, and the method of moments.
△ Less
Submitted 4 January, 2022; v1 submitted 12 July, 2021;
originally announced July 2021.
-
Compactification of the Rigid Motions Group in Image Processing
Authors:
Tamir Bendory,
Ido Hadi,
Nir Sharon
Abstract:
Image processing problems in general, and in particular in the field of single-particle cryo-electron microscopy, often require considering images up to their rotations and translations. Such problems were tackled successfully when considering images up to rotations only, using quantities which are invariant to the action of rotations on images. Extending these methods to cases where translations…
▽ More
Image processing problems in general, and in particular in the field of single-particle cryo-electron microscopy, often require considering images up to their rotations and translations. Such problems were tackled successfully when considering images up to rotations only, using quantities which are invariant to the action of rotations on images. Extending these methods to cases where translations are involved is more complicated. Here we present a computationally feasible and theoretically sound approximate invariant to the action of rotations and translations on images. It allows one to approximately reduce image processing problems to similar problems over the sphere, a compact domain acted on by the group of 3D rotations, a compact group. We show that this invariant is induced by a family of map**s deforming, and thereby compactifying, the group structure of rotations and translations of the plane, i.e., the group of rigid motions, into the group of 3D rotations. Furthermore, we demonstrate its viability in two image processing tasks: multi-reference alignment and classification. To our knowledge, this is the first instance of a quantity that is either exactly or approximately invariant to rotations and translations of images that both rests on a sound theoretical foundation and also applicable in practice.
△ Less
Submitted 2 February, 2022; v1 submitted 25 June, 2021;
originally announced June 2021.
-
The generalized method of moments for multi-reference alignment
Authors:
Asaf Abas,
Tamir Bendory,
Nir Sharon
Abstract:
This paper studies the application of the generalized method of moments (GMM) to multi-reference alignment (MRA): the problem of estimating a signal from its circularly-translated and noisy copies. We begin by proving that the GMM estimator maintains its asymptotic optimality for statistical models with group symmetry, including MRA. Then, we conduct a comprehensive numerical study and show that t…
▽ More
This paper studies the application of the generalized method of moments (GMM) to multi-reference alignment (MRA): the problem of estimating a signal from its circularly-translated and noisy copies. We begin by proving that the GMM estimator maintains its asymptotic optimality for statistical models with group symmetry, including MRA. Then, we conduct a comprehensive numerical study and show that the GMM substantially outperforms the classical method of moments, whose application to MRA has been studied thoroughly in the literature. We also formulate the GMM to estimate a three-dimensional molecular structure using cryo-electron microscopy and present numerical results on simulated data.
△ Less
Submitted 26 September, 2021; v1 submitted 3 March, 2021;
originally announced March 2021.
-
Pyramid Transform of Manifold Data via Subdivision Operators
Authors:
Wael Mattar,
Nir Sharon
Abstract:
Multiscale transforms have become a key ingredient in many data processing tasks. With technological development, we observe a growing demand for methods to cope with non-linear data structures such as manifold values. In this paper, we propose a multiscale approach for analyzing manifold-valued data using a pyramid transform. The transform uses a unique class of downsampling operators that enable…
▽ More
Multiscale transforms have become a key ingredient in many data processing tasks. With technological development, we observe a growing demand for methods to cope with non-linear data structures such as manifold values. In this paper, we propose a multiscale approach for analyzing manifold-valued data using a pyramid transform. The transform uses a unique class of downsampling operators that enable a non-interpolating subdivision schemes as upsampling operators. We describe this construction in detail and present its analytical properties, including stability and coefficient decay. Next, we numerically demonstrate the results and show the application of our method to denoising and anomaly detection.
△ Less
Submitted 15 August, 2021; v1 submitted 1 March, 2021;
originally announced March 2021.
-
Centering noisy images with application to cryo-EM
Authors:
Ayelet Heimowitz,
Nir Sharon,
Amit Singer
Abstract:
We target the problem of estimating the center of mass of noisy 2-D images. We assume that the noise dominates the image, and thus many standard approaches are vulnerable to estimation errors. Our approach uses a surrogate function to the geometric median, which is a robust estimator of the center of mass. We mathematically analyze cases in which the geometric median fails to provide a reasonable…
▽ More
We target the problem of estimating the center of mass of noisy 2-D images. We assume that the noise dominates the image, and thus many standard approaches are vulnerable to estimation errors. Our approach uses a surrogate function to the geometric median, which is a robust estimator of the center of mass. We mathematically analyze cases in which the geometric median fails to provide a reasonable estimate of the center of mass, and prove that our surrogate function leads to a successful estimate.
One particular application for our method is to improve 3-D reconstruction in single-particle cryo-electron microscopy (cryo-EM). We show how to apply our approach for a better translational alignment of macromolecules picked from experimental data. In this way, we facilitate the succeeding steps of reconstruction and streamline the entire cryo-EM pipeline, saving valuable computational time and supporting resolution enhancement.
△ Less
Submitted 3 March, 2021; v1 submitted 10 September, 2020;
originally announced September 2020.
-
Super-resolution multi-reference alignment
Authors:
Tamir Bendory,
Ariel Jaffe,
William Leeb,
Nir Sharon,
Amit Singer
Abstract:
We study super-resolution multi-reference alignment, the problem of estimating a signal from many circularly shifted, down-sampled, and noisy observations. We focus on the low SNR regime, and show that a signal in $\mathbb{R}^M$ is uniquely determined when the number $L$ of samples per observation is of the order of the square root of the signal's length $(L=O(\sqrt{M}))$. Phrased more informally,…
▽ More
We study super-resolution multi-reference alignment, the problem of estimating a signal from many circularly shifted, down-sampled, and noisy observations. We focus on the low SNR regime, and show that a signal in $\mathbb{R}^M$ is uniquely determined when the number $L$ of samples per observation is of the order of the square root of the signal's length $(L=O(\sqrt{M}))$. Phrased more informally, one can square the resolution. This result holds if the number of observations is proportional to at least 1/SNR$^3$. In contrast, with fewer observations recovery is impossible even when the observations are not down-sampled ($L=M$). The analysis combines tools from statistical signal processing and invariant theory. We design an expectation-maximization algorithm and demonstrate that it can super-resolve the signal in challenging SNR regimes.
△ Less
Submitted 9 November, 2020; v1 submitted 27 June, 2020;
originally announced June 2020.
-
Rational approximation and its application to improving deep learning classifiers
Authors:
V. Peiris,
N. Sharon,
N. Sukhorukova J. Ugon
Abstract:
A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial approximations are not efficient. We prove that the optimisation problems appearing in the best uniform rational approximation are quasiconvex, and show how to us…
▽ More
A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial approximations are not efficient. We prove that the optimisation problems appearing in the best uniform rational approximation are quasiconvex, and show how to use this fact for calculating the best approximation in a fast and efficient method. The paper presents a theoretical study of the arising optimisation problems and provides results of several numerical experiments. In all our computations, the algorithms terminated at optimal solutions. We apply our approximation as a preprocess step to deep learning classifiers and demonstrate that the classification accuracy is significantly improved compared to the classification of the raw signals.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
Method of moments for 3-D single particle ab initio modeling with non-uniform distribution of viewing angles
Authors:
Nir Sharon,
Joe Kileel,
Yuehaw Khoo,
Boris Landa,
Amit Singer
Abstract:
Single-particle reconstruction in cryo-electron microscopy (cryo-EM) is an increasingly popular technique for determining the 3-D structure of a molecule from several noisy 2-D projections images taken at unknown viewing angles. Most reconstruction algorithms require a low-resolution initialization for the 3-D structure, which is the goal of ab initio modeling. Suggested by Zvi Kam in 1980, the me…
▽ More
Single-particle reconstruction in cryo-electron microscopy (cryo-EM) is an increasingly popular technique for determining the 3-D structure of a molecule from several noisy 2-D projections images taken at unknown viewing angles. Most reconstruction algorithms require a low-resolution initialization for the 3-D structure, which is the goal of ab initio modeling. Suggested by Zvi Kam in 1980, the method of moments (MoM) offers one approach, wherein low-order statistics of the 2-D images are computed and a 3-D structure is estimated by solving a system of polynomial equations. Unfortunately, Kam's method suffers from restrictive assumptions, most notably that viewing angles should be distributed uniformly. Often unrealistic, uniformity entails the computation of higher-order correlations, as in this case first and second moments fail to determine the 3-D structure. In the present paper, we remove this hypothesis, by permitting an unknown, non-uniform distribution of viewing angles in MoM. Perhaps surprisingly, we show that this case is statistically easier than the uniform case, as now first and second moments generically suffice to determine low-resolution expansions of the molecule. In the idealized setting of a known, non-uniform distribution, we find an efficient provable algorithm inverting first and second moments. For unknown, non-uniform distributions, we use non-convex optimization methods to solve for both the molecule and distribution.
△ Less
Submitted 23 November, 2019; v1 submitted 11 July, 2019;
originally announced July 2019.
-
Multireference Alignment is Easier with an Aperiodic Translation Distribution
Authors:
Emmanuel Abbe,
Tamir Bendory,
William Leeb,
João Pereira,
Nir Sharon,
Amit Singer
Abstract:
In the multireference alignment model, a signal is observed by the action of a random circular translation and the addition of Gaussian noise. The goal is to recover the signal's orbit by accessing multiple independent observations. Of particular interest is the sample complexity, i.e., the number of observations/samples needed in terms of the signal-to-noise ratio (the signal energy divided by th…
▽ More
In the multireference alignment model, a signal is observed by the action of a random circular translation and the addition of Gaussian noise. The goal is to recover the signal's orbit by accessing multiple independent observations. Of particular interest is the sample complexity, i.e., the number of observations/samples needed in terms of the signal-to-noise ratio (the signal energy divided by the noise variance) in order to drive the mean-square error (MSE) to zero. Previous work showed that if the translations are drawn from the uniform distribution, then, in the low SNR regime, the sample complexity of the problem scales as $ω(1/\text{SNR}^3)$. In this work, using a generalization of the Chapman--Robbins bound for orbits and expansions of the $χ^2$ divergence at low SNR, we show that in the same regime the sample complexity for any aperiodic translation distribution scales as $ω(1/\text{SNR}^2)$. This rate is achieved by a simple spectral algorithm. We propose two additional algorithms based on non-convex optimization and expectation-maximization. We also draw a connection between the multireference alignment problem and the spiked covariance model.
△ Less
Submitted 3 November, 2018; v1 submitted 8 October, 2017;
originally announced October 2017.
-
Symmetric rank-one updates from partial spectrum with an application to out-of-sample extension
Authors:
Roy Mitz,
Nir Sharon,
Yoel Shkolnisky
Abstract:
Rank-one update of the spectrum of a matrix is a fundamental problem in classical perturbation theory. In this paper, we consider its variant where only part of the spectrum is known. We address this variant using an efficient scheme for updating the known eigenpairs with guaranteed error bounds. Then, we apply our scheme to the extension of the top eigenvectors of the graph Laplacian to a new dat…
▽ More
Rank-one update of the spectrum of a matrix is a fundamental problem in classical perturbation theory. In this paper, we consider its variant where only part of the spectrum is known. We address this variant using an efficient scheme for updating the known eigenpairs with guaranteed error bounds. Then, we apply our scheme to the extension of the top eigenvectors of the graph Laplacian to a new data sample. In particular, we model this extension as a perturbation problem and show how to solve it using our rank-one updating scheme. We provide a theoretical analysis of this extension method, and back it up with numerical results that illustrate its advantages.
△ Less
Submitted 8 July, 2019; v1 submitted 7 October, 2017;
originally announced October 2017.
-
Synchronization over Cartan motion groups via contraction
Authors:
Onur Ozyesil,
Nir Sharon,
Amit Singer
Abstract:
Group contraction is an algebraic map that relates two classes of Lie groups by a limiting process. We utilize this notion for the compactification of the class of Cartan motion groups. The compactification process is then applied to reduce a non-compact synchronization problem to a problem where the solution can be obtained by means of a unitary, faithful representation. We describe this method o…
▽ More
Group contraction is an algebraic map that relates two classes of Lie groups by a limiting process. We utilize this notion for the compactification of the class of Cartan motion groups. The compactification process is then applied to reduce a non-compact synchronization problem to a problem where the solution can be obtained by means of a unitary, faithful representation. We describe this method of synchronization via contraction in detail and analyze several important aspects of this application. One important special case of Cartan motion groups is the group of rigid motions, also called the special Euclidean group. We thoroughly discuss the synchronization over this group and show numerically the advantages of our approach compared to some current state-of-the-art synchronization methods on both synthetic and real data.
△ Less
Submitted 8 December, 2017; v1 submitted 30 November, 2016;
originally announced December 2016.
-
Approximation operators for matrix-valued functions based on matrix decompositions
Authors:
Nira Dyn,
Uri Itai,
Nir Sharon
Abstract:
Given a set of matrices, modeled as samples of a matrix-valued function, we suggest a method to approximate the underline function using a product approximation operator. This operator extends known approximation methods by exploiting the structure of the matrices in the samples set, and based on decomposition theorems. We introduce our approach in detail and discuss its advantages using a few exa…
▽ More
Given a set of matrices, modeled as samples of a matrix-valued function, we suggest a method to approximate the underline function using a product approximation operator. This operator extends known approximation methods by exploiting the structure of the matrices in the samples set, and based on decomposition theorems. We introduce our approach in detail and discuss its advantages using a few examples. In addition, we provide basic tools for analyzing properties of the matrix functions generated by our approximation operators.
△ Less
Submitted 3 November, 2016;
originally announced November 2016.
-
Evaluating Non-Analytic Functions of Matrices
Authors:
Nir Sharon,
Yoel Shkolnisky
Abstract:
The paper revisits the classical problem of evaluating $f(A)$ for a real function $f$ and a matrix $A$ with real spectrum. The evaluation is based on expanding $f$ in Chebyshev polynomials, and the focus of the paper is to study the convergence rates of these expansions. In particular, we derive bounds on the convergence rates which reveal the relation between the smoothness of $f$ and the diagona…
▽ More
The paper revisits the classical problem of evaluating $f(A)$ for a real function $f$ and a matrix $A$ with real spectrum. The evaluation is based on expanding $f$ in Chebyshev polynomials, and the focus of the paper is to study the convergence rates of these expansions. In particular, we derive bounds on the convergence rates which reveal the relation between the smoothness of $f$ and the diagonalizability of the matrix A. We present several numerical examples to illustrate our analysis.
△ Less
Submitted 22 December, 2018; v1 submitted 14 July, 2015;
originally announced July 2015.
-
An algorithm for improving Non-Local Means operators via low-rank approximation
Authors:
Victor May,
Yosi Keller,
Nir Sharon,
Yoel Shkolnisky
Abstract:
We present a method for improving a Non Local Means operator by computing its low-rank approximation. The low-rank operator is constructed by applying a filter to the spectrum of the original Non Local Means operator. This results in an operator which is less sensitive to noise while preserving important properties of the original operator. The method is efficiently implemented based on Chebyshev…
▽ More
We present a method for improving a Non Local Means operator by computing its low-rank approximation. The low-rank operator is constructed by applying a filter to the spectrum of the original Non Local Means operator. This results in an operator which is less sensitive to noise while preserving important properties of the original operator. The method is efficiently implemented based on Chebyshev polynomials and is demonstrated on the application of natural images denoising. For this application, we provide a comprehensive comparison of our method with leading denoising methods.
△ Less
Submitted 20 November, 2014;
originally announced December 2014.
-
A global approach to the refinement of manifold data
Authors:
Nira Dyn,
Nir Sharon
Abstract:
A refinement of manifold data is a computational process, which produces a denser set of discrete data from a given one. Such refinements are closely related to multiresolution representations of manifold data by pyramid transforms, and approximation of manifold-valued functions by repeated refinements schemes. Most refinement methods compute each refined element separately, independently of the c…
▽ More
A refinement of manifold data is a computational process, which produces a denser set of discrete data from a given one. Such refinements are closely related to multiresolution representations of manifold data by pyramid transforms, and approximation of manifold-valued functions by repeated refinements schemes. Most refinement methods compute each refined element separately, independently of the computations of the other elements. Here we propose a global method which computes all the refined elements simultaneously, using geodesic averages. We analyse repeated refinements schemes based on this global approach, and derive conditions guaranteeing strong convergence.
△ Less
Submitted 14 August, 2014;
originally announced August 2014.
-
Manifold-valued subdivision schemes based on geodesic inductive averaging
Authors:
Nira Dyn,
Nir Sharon
Abstract:
Subdivision schemes have become an important tool for approximation of manifold-valued functions. In this paper, we describe a construction of manifold-valued subdivision schemes for geodesically complete manifolds. Our construction is based upon the adaptation of linear subdivision schemes using the notion of repeated binary averaging, where as a repeated binary average we propose to use the geod…
▽ More
Subdivision schemes have become an important tool for approximation of manifold-valued functions. In this paper, we describe a construction of manifold-valued subdivision schemes for geodesically complete manifolds. Our construction is based upon the adaptation of linear subdivision schemes using the notion of repeated binary averaging, where as a repeated binary average we propose to use the geodesic inductive mean. We derive conditions on the adapted schemes which guarantee convergence from any initial manifold-valued sequence. The definition and analysis of convergence are intrinsic to the manifold. The adaptation technique and the convergence analysis are demonstrated by several important examples.
△ Less
Submitted 1 March, 2016; v1 submitted 31 July, 2014;
originally announced July 2014.
-
Univariate subdivision schemes for noisy data
Authors:
Nira Dyn,
Allison Heard,
Kai Hormann,
Nir Sharon
Abstract:
We introduce and analyse univariate, linear, and stationary subdivision schemes for refining noisy data, by fitting local least squares polynomials. We first present primal schemes, based on fitting linear polynomials to the data, and study their convergence, smoothness, and basic limit functions. We provide several numerical experiments that illustrate the limit functions generated by these schem…
▽ More
We introduce and analyse univariate, linear, and stationary subdivision schemes for refining noisy data, by fitting local least squares polynomials. We first present primal schemes, based on fitting linear polynomials to the data, and study their convergence, smoothness, and basic limit functions. We provide several numerical experiments that illustrate the limit functions generated by these schemes from initial noisy data, and compare the results with approximations obtained from noisy data by an advanced local linear regression method. We conclude by discussing several extension and variants.
△ Less
Submitted 11 July, 2013;
originally announced July 2013.
