-
Unsupervised Multimodal Surface Registration with Geometric Deep Learning
Authors:
Mohamed A. Suliman,
Logan Z. J. Williams,
Abdulah Fawaz,
Emma C. Robinson
Abstract:
This paper introduces GeoMorph, a novel geometric deep-learning framework designed for image registration of cortical surfaces. The registration process consists of two main steps. First, independent feature extraction is performed on each input surface using graph convolutions, generating low-dimensional feature representations that capture important cortical surface characteristics. Subsequently…
▽ More
This paper introduces GeoMorph, a novel geometric deep-learning framework designed for image registration of cortical surfaces. The registration process consists of two main steps. First, independent feature extraction is performed on each input surface using graph convolutions, generating low-dimensional feature representations that capture important cortical surface characteristics. Subsequently, features are registered in a deep-discrete manner to optimize the overlap of common structures across surfaces by learning displacements of a set of control points. To ensure smooth and biologically plausible deformations, we implement regularization through a deep conditional random field implemented with a recurrent neural network. Experimental results demonstrate that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Furthermore, GeoMorph exhibits competitive performance compared to classical frameworks. Such versatility and robustness suggest strong potential for various neuroscience applications.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Infinite Lewis Weights in Spectral Graph Theory
Authors:
Amit Suliman,
Omri Weinstein
Abstract:
We study the spectral implications of re-weighting a graph by the $\ell_\infty$-Lewis weights of its edges. Our main motivation is the ER-Minimization problem (Saberi et al., SIAM'08): Given an undirected graph $G$, the goal is to find positive normalized edge-weights $w\in \mathbb{R}_+^m$ which minimize the sum of pairwise \emph{effective-resistances} of $G_w$ (Kirchhoff's index). By contrast,…
▽ More
We study the spectral implications of re-weighting a graph by the $\ell_\infty$-Lewis weights of its edges. Our main motivation is the ER-Minimization problem (Saberi et al., SIAM'08): Given an undirected graph $G$, the goal is to find positive normalized edge-weights $w\in \mathbb{R}_+^m$ which minimize the sum of pairwise \emph{effective-resistances} of $G_w$ (Kirchhoff's index). By contrast, $\ell_\infty$-Lewis weights minimize the \emph{maximum} effective-resistance of \emph{edges}, but are much cheaper to approximate, especially for Laplacians. With this algorithmic motivation, we study the ER-approximation ratio obtained by Lewis weights.
Our first main result is that $\ell_\infty$-Lewis weights provide a constant ($\approx 3.12$) approximation for ER-minimization on \emph{trees}. The proof introduces a new technique, a local polarization process for effective-resistances ($\ell_2$-congestion) on trees, which is of independent interest in electrical network analysis. For general graphs, we prove an upper bound $α(G)$ on the approximation ratio obtained by Lewis weights, which is always $\leq \min\{ \text{diam}(G), κ(L_{w_\infty})\}$, where $κ$ is the condition number of the weighted Laplacian. All our approximation algorithms run in \emph{input-sparsity} time $\tilde{O}(m)$, a major improvement over Saberi et al.'s $O(m^{3.5})$ SDP for exact ER-minimization.
Finally, we demonstrate the favorable effects of $\ell_\infty$-LW reweighting on the \emph{spectral-gap} of graphs and on their \emph{spectral-thinness} (Anari and Gharan, 2015). En-route to our results, we prove a weighted analogue of Mohar's classical bound on $λ_2(G)$, and provide a new characterization of leverage-scores of a matrix, as the gradient (w.r.t weights) of the volume of the enclosing ellipsoid.
△ Less
Submitted 12 February, 2023;
originally announced February 2023.
-
A Deep-Discrete Learning Framework for Spherical Surface Registration
Authors:
Mohamed A. Suliman,
Logan Z. J. Williams,
Abdulah Fawaz,
Emma C. Robinson
Abstract:
Cortical surface registration is a fundamental tool for neuroimaging analysis that has been shown to improve the alignment of functional regions relative to volumetric approaches. Classically, image registration is performed by optimizing a complex objective similarity function, leading to long run times. This contributes to a convention for aligning all data to a global average reference frame th…
▽ More
Cortical surface registration is a fundamental tool for neuroimaging analysis that has been shown to improve the alignment of functional regions relative to volumetric approaches. Classically, image registration is performed by optimizing a complex objective similarity function, leading to long run times. This contributes to a convention for aligning all data to a global average reference frame that poorly reflects the underlying cortical heterogeneity. In this paper, we propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem, where each point in a low-resolution control grid deforms to one of fixed, finite number of endpoints. This is learned using a spherical geometric deep learning architecture, in an end-to-end unsupervised way, with regularization imposed using a deep Conditional Random Field (CRF). Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms and generates smoother deformations than other learning-based surface registration methods, even in subjects with atypical cortical morphology.
△ Less
Submitted 24 March, 2022;
originally announced March 2022.
-
Mathematical Theory of Atomic Norm Denoising In Blind Two-Dimensional Super-Resolution (Extended Version)
Authors:
Mohamed A. Suliman,
Wei Dai
Abstract:
This paper develops a new mathematical framework for denoising in blind two-dimensional (2D) super-resolution upon using the atomic norm. The framework denoises a signal that consists of a weighted sum of an unknown number of time-delayed and frequency-shifted unknown waveforms from its noisy measurements. Moreover, the framework also provides an approach for estimating the unknown parameters in t…
▽ More
This paper develops a new mathematical framework for denoising in blind two-dimensional (2D) super-resolution upon using the atomic norm. The framework denoises a signal that consists of a weighted sum of an unknown number of time-delayed and frequency-shifted unknown waveforms from its noisy measurements. Moreover, the framework also provides an approach for estimating the unknown parameters in the signal. We prove that when the number of the observed samples satisfies certain lower bound that is a function of the system parameters, we can estimate the noise-free signal, with very high accuracy, upon solving a regularized least-squares atomic norm minimization problem. We derive the theoretical mean-squared error of the estimator, and we show that it depends on the noise variance, the number of unknown waveforms, the number of samples, and the dimension of the low-dimensional space where the unknown waveforms lie. Finally, we verify the theoretical findings of the paper by using extensive simulation experiments.
△ Less
Submitted 18 May, 2021; v1 submitted 9 June, 2020;
originally announced June 2020.
-
Blind Two-Dimensional Super-Resolution and Its Performance Guarantee (Extended Version)
Authors:
Mohamed A. Suliman,
Wei Dai
Abstract:
We study the problem of identifying the parameters of a linear system from its response to multiple unknown waveforms. We assume that the system response is a scaled superposition of time-delayed and frequency-shifted versions of the unknown waveforms. Such kind of problem is severely ill-posed and does not yield a unique solution without introducing further constraints. To fully characterize the…
▽ More
We study the problem of identifying the parameters of a linear system from its response to multiple unknown waveforms. We assume that the system response is a scaled superposition of time-delayed and frequency-shifted versions of the unknown waveforms. Such kind of problem is severely ill-posed and does not yield a unique solution without introducing further constraints. To fully characterize the system, we assume that the unknown waveforms lie in a common known low-dimensional subspace that satisfies certain properties. Then, we develop a blind two-dimensional (2D) super-resolution framework that applies to a large number of applications. In this framework, we show that under a minimum separation between the time-frequency shifts, all the unknowns that characterize the system can be recovered precisely and with high probability provided that a lower bound on the number of the observed samples is satisfied. The proposed framework is based on a 2D atomic norm minimization problem, which is shown to be reformulated and solved via semidefinite programming. Simulation results that confirm the theoretical findings of the paper are provided.
△ Less
Submitted 24 May, 2022; v1 submitted 5 November, 2018;
originally announced November 2018.
-
SNR Estimation in Linear Systems with Gaussian Matrices
Authors:
Mohamed A. Suliman,
Ayed M. Alrashdi,
Tarig Ballal,
Tareq Y. Al-Naffouri
Abstract:
This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left correlation. The unknown entries of the signal and the noise are assumed to be independent and identically distributed with zero mean and can be drawn from any dis…
▽ More
This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left correlation. The unknown entries of the signal and the noise are assumed to be independent and identically distributed with zero mean and can be drawn from any distribution. We use the ridge regression function of this linear model in company with tools and techniques adapted from random matrix theory to achieve, in closed form, accurate estimation of the SNR without prior statistical knowledge on the signal or the noise. Simulation results are provided, and show that the proposed method is very accurate.
△ Less
Submitted 8 October, 2017; v1 submitted 4 August, 2017;
originally announced August 2017.
-
Perturbation-Based Regularization for Signal Estimation in Linear Discrete Ill-posed Problems
Authors:
Mohamed Suliman,
Tarig Ballal,
Tareq Y. Al-Naffouri
Abstract:
Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work, we propose a new regularization approach and a new regularization parameter selection approach for linear least-squares discrete ill-posed problems. The propose…
▽ More
Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work, we propose a new regularization approach and a new regularization parameter selection approach for linear least-squares discrete ill-posed problems. The proposed approach is based on enhancing the singular-value structure of the ill-posed model matrix to acquire a better solution. Unlike many other regularization algorithms that seek to minimize the estimated data error, the proposed approach is developed to minimize the mean-squared error of the estimator which is the objective in many typical estimation scenarios. The performance of the proposed approach is demonstrated by applying it to a large set of real-world discrete ill-posed problems. Simulation results demonstrate that the proposed approach outperforms a set of benchmark regularization methods in most cases. In addition, the approach also enjoys the lowest runtime and offers the highest level of robustness amongst all the tested benchmark regularization methods.
△ Less
Submitted 10 January, 2017; v1 submitted 29 November, 2016;
originally announced November 2016.
-
Robust Regularized Least-Squares Beamforming Approach to Signal Estimation
Authors:
Mohamed Suliman,
Tarig Ballal,
Tareq Y. Al-Naffouri
Abstract:
In this paper, we address the problem of robust adaptive beamforming of signals received by a linear array. The challenge associated with the beamforming problem is twofold. Firstly, the process requires the inversion of the usually ill-conditioned covariance matrix of the received signals. Secondly, the steering vector pertaining to the direction of arrival of the signal of interest is not known…
▽ More
In this paper, we address the problem of robust adaptive beamforming of signals received by a linear array. The challenge associated with the beamforming problem is twofold. Firstly, the process requires the inversion of the usually ill-conditioned covariance matrix of the received signals. Secondly, the steering vector pertaining to the direction of arrival of the signal of interest is not known precisely. To tackle these two challenges, the standard capon beamformer is manipulated to a form where the beamformer output is obtained as a scaled version of the inner product of two vectors. The two vectors are linearly related to the steering vector and the received signal snapshot, respectively. The linear operator, in both cases, is the square root of the covariance matrix. A regularized least-squares (RLS) approach is proposed to estimate these two vectors and to provide robustness without exploiting prior information. Simulation results show that the RLS beamformer using the proposed regularization algorithm outperforms state-of-the-art beamforming algorithms, as well as another RLS beamformers using a standard regularization approaches.
△ Less
Submitted 20 November, 2016;
originally announced November 2016.
-
Supplementary Appendix for: Constrained Perturbation Regularization Approach for Signal Estimation Using Random Matrix Theory
Authors:
Mohamed Suliman,
Tarig Ballal,
Abla Kammoun,
Tareq Y. Al-Naffouri
Abstract:
In this supplementary appendix we provide proofs and additional extensive simulations that complement the analysis of the main paper (constrained perturbation regularization approach for signal estimation using random matrix theory).
In this supplementary appendix we provide proofs and additional extensive simulations that complement the analysis of the main paper (constrained perturbation regularization approach for signal estimation using random matrix theory).
△ Less
Submitted 30 June, 2016;
originally announced June 2016.
