-
Small-Noise Sensitivity Analysis of Locating Pulses in the Presence of Adversarial Perturbation
Authors:
Meghna Kalra,
Maxime Ferreira Da Costa,
Kiryung Lee
Abstract:
A fundamental small-noise sensitivity analysis of spike localization in the presence of adversarial perturbations and arbitrary point spread function (PSF) is presented. The analysis leverages the local Lipschitz property of the inverse map from measurement noise to parameter estimate. In the small noise regime, the local Lipschitz constant converges to the spectral norm of the noiseless Jacobian…
▽ More
A fundamental small-noise sensitivity analysis of spike localization in the presence of adversarial perturbations and arbitrary point spread function (PSF) is presented. The analysis leverages the local Lipschitz property of the inverse map from measurement noise to parameter estimate. In the small noise regime, the local Lipschitz constant converges to the spectral norm of the noiseless Jacobian of the inverse map. An interpretable upper bound in terms of the minimum separation of spikes, norms, and flatness of the PSF and its derivative, and the distribution of spike amplitudes is provided. Numerical experiments highlighting the relevance of the theoretical bound as a proxy to the local Lipschitz constant and its dependence on the key attributes of the problem are presented.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Physical Layer Location Privacy in SIMO Communication Using Fake Paths Injection
Authors:
Trong Duy Tran,
Maxime Ferreira Da Costa,
Linh Trung Nguyen
Abstract:
Fake path injection is an emerging paradigm for inducing privacy over wireless networks. In this paper, fake paths are injected by the transmitter into a SIMO multipath communication channel to preserve her physical location from an eavesdropper. A novel statistical privacy metric is defined as the ratio between the largest (resp. smallest) eigenvalues of Bob's (resp. Eve's) Cramér-Rao lower bound…
▽ More
Fake path injection is an emerging paradigm for inducing privacy over wireless networks. In this paper, fake paths are injected by the transmitter into a SIMO multipath communication channel to preserve her physical location from an eavesdropper. A novel statistical privacy metric is defined as the ratio between the largest (resp. smallest) eigenvalues of Bob's (resp. Eve's) Cramér-Rao lower bound on the SIMO multipath channel parameters to assess the privacy enhancements. Leveraging the spectral properties of generalized Vandermonde matrices, bounds on the privacy margin of the proposed scheme are derived. Specifically, it is shown that the privacy margin increases quadratically in the inverse of the separation between the true and the fake paths under Eve's perspective. Numerical simulations further showcase the approach's benefit.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
Guaranteed Private Communication with Secret Block Structure
Authors:
Maxime Ferreira Da Costa,
Jianxiu Li,
Urbashi Mitra
Abstract:
A novel private communication framework is proposed where privacy is induced by transmitting over channel instances of linear inverse problems that are identifiable to the legitimate receiver, but unidentifiable to an eavesdropper. The gap in identifiability is created in the framework by leveraging secret knowledge between the transmitter and the legitimate receiver. Specifically, the case where…
▽ More
A novel private communication framework is proposed where privacy is induced by transmitting over channel instances of linear inverse problems that are identifiable to the legitimate receiver, but unidentifiable to an eavesdropper. The gap in identifiability is created in the framework by leveraging secret knowledge between the transmitter and the legitimate receiver. Specifically, the case where the legitimate receiver harnesses a secret block structure to decode a transmitted block-sparse message from underdetermined linear measurements in conditions where classical compressed sensing would provably fail is examined. The applicability of the proposed scheme to practical multiple access wireless communication systems is discussed. The protocol's privacy is studied under a single transmission, and under multiple transmissions without refreshing the secret block structure. It is shown that, under a specific scaling of the channel dimensions and transmission parameters, the eavesdropper can attempt to overhear the block structure from the fourth-order moments of the channel output. Computation of a statistical lower bound, suggests that the proposed fourth-order moment secret block estimation strategy is near optimal. The performance of a spectral clustering algorithm is studied to that end, defining scaling laws on the lifespan of the secret key before the communication is compromised. Finally, numerical experiments corroborating the theoretical findings are conducted.
△ Less
Submitted 22 September, 2023;
originally announced September 2023.
-
Local Geometry of Nonconvex Spike Deconvolution from Low-Pass Measurements
Authors:
Maxime Ferreira Da Costa,
Yuejie Chi
Abstract:
Spike deconvolution is the problem of recovering the point sources from their convolution with a known point spread function, which plays a fundamental role in many sensing and imaging applications. In this paper, we investigate the local geometry of recovering the parameters of point sources$\unicode{x2014}$including both amplitudes and locations$\unicode{x2014}$by minimizing a natural nonconvex…
▽ More
Spike deconvolution is the problem of recovering the point sources from their convolution with a known point spread function, which plays a fundamental role in many sensing and imaging applications. In this paper, we investigate the local geometry of recovering the parameters of point sources$\unicode{x2014}$including both amplitudes and locations$\unicode{x2014}$by minimizing a natural nonconvex least-squares loss function measuring the observation residuals. We propose preconditioned variants of gradient descent (GD), where the search direction is scaled via some carefully designed preconditioning matrices. We begin with a simple fixed preconditioner design, which adjusts the learning rates of the locations at a different scale from those of the amplitudes, and show it achieves a linear rate of convergence$\unicode{x2014}$in terms of entrywise errors$\unicode{x2014}$when initialized close to the ground truth, as long as the separation between the true spikes is sufficiently large. However, the convergence rate slows down significantly when the dynamic range of the source amplitudes is large. To bridge this issue, we introduce an adaptive preconditioner design, which compensates for the learning rates of different sources in an iteration-varying manner based on the current estimate. The adaptive design provably leads to an accelerated convergence rate that is independent of the dynamic range, highlighting the benefit of adaptive preconditioning in nonconvex spike deconvolution. Numerical experiments are provided to corroborate the theoretical findings.
△ Less
Submitted 27 February, 2023; v1 submitted 22 August, 2022;
originally announced August 2022.
-
Joint Localization and Orientation Estimation in Millimeter-Wave MIMO OFDM Systems via Atomic Norm Minimization
Authors:
Jianxiu Li,
Maxime Ferreira Da Costa,
Urbashi Mitra
Abstract:
Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel virtual channel matrix is introduced and an algorithm to extract localization-relevant channel parameters from its atomic norm decomposition is designed. Then, base…
▽ More
Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel virtual channel matrix is introduced and an algorithm to extract localization-relevant channel parameters from its atomic norm decomposition is designed. Then, based on the extended invariance principle, a weighted least squares problem is proposed to accurately recover the location and orientation using both line-of-sight and non-line-of-sight channel information. The conditions for the optimality and uniqueness of the estimate and theoretical guarantees for the estimation error are characterized for the noiseless and the noisy scenarios. Theoretical results are confirmed via simulation. Numerical results investigate the robustness of the proposed algorithm to incorrect model order selection or synchronization error, and highlight performance improvements over a prior method. The resultant performance nearly achieves the Cramer-Rao lower bound on the estimation error.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
On the Stability of Super-Resolution and a Beurling-Selberg Type Extremal Problem
Authors:
Maxime Ferreira Da Costa,
Urbashi Mitra
Abstract:
Super-resolution estimation is the problem of recovering a stream of spikes (point sources) from the noisy observation of a few numbers of its first trigonometric moments. The performance of super-resolution is recognized to be intimately related to the separation between the spikes to recover. A novel notion of stability of the Fisher information matrix (FIM) of the super-resolution problem is in…
▽ More
Super-resolution estimation is the problem of recovering a stream of spikes (point sources) from the noisy observation of a few numbers of its first trigonometric moments. The performance of super-resolution is recognized to be intimately related to the separation between the spikes to recover. A novel notion of stability of the Fisher information matrix (FIM) of the super-resolution problem is introduced when the minimal eigenvalue of the FIM is not asymptotically vanishing. The regime where the minimal separation is inversely proportional to the number of acquired moments is considered. It is shown that there is a separation threshold above which the eigenvalues of the FIM can be bounded by a quantity that does not depend on the number of moments. The proof relies on characterizing the connection between the stability of the FIM and a generalization of the Beurling-Selberg box approximation problem.
△ Less
Submitted 15 May, 2022; v1 submitted 6 February, 2022;
originally announced February 2022.
-
Atomic Norm Based Localization and Orientation Estimation for Millimeter-Wave MIMO OFDM Systems
Authors:
Jianxiu Li,
Maxime Ferreira Da Costa,
Urbashi Mitra
Abstract:
Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel virtual channel matrix is introduced and an algorithm to extract localization-relevant channel parameters from its atomic norm decomposition is designed. Then, base…
▽ More
Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel virtual channel matrix is introduced and an algorithm to extract localization-relevant channel parameters from its atomic norm decomposition is designed. Then, based on the extended invariance principle, a weighted least squares problem is proposed to accurately recover the location and orientation using both line-of-sight and non-line-of-sight channel information. Numerical results highlight performance improvements over a prior method and the resultant performance nearly achieves the Cramer-Rao lower bound.
△ Less
Submitted 8 October, 2021;
originally announced October 2021.
-
A Framework for Private Communication with Secret Block Structure
Authors:
Maxime Ferreira Da Costa,
Urbashi Mitra
Abstract:
Harnessing a block-sparse prior to recover signals through underdetermined linear measurements has been extensively shown to allow exact recovery in conditions where classical compressed sensing would provably fail. We exploit this result to propose a novel private communication framework where the secrecy is achieved by transmitting instances of an unidentifiable compressed sensing problem over a…
▽ More
Harnessing a block-sparse prior to recover signals through underdetermined linear measurements has been extensively shown to allow exact recovery in conditions where classical compressed sensing would provably fail. We exploit this result to propose a novel private communication framework where the secrecy is achieved by transmitting instances of an unidentifiable compressed sensing problem over a public channel. The legitimate receiver can attempt to overcome this ill-posedness by leveraging secret knowledge of a block structure that was used to encode the transmitter's message. We study the privacy guarantees of this communication protocol to a single transmission, and to multiple transmissions without refreshing the shared secret. Additionally, we propose an algorithm for an eavesdropper to learn the block structure via the method of moments and highlight the privacy benefits of this framework through numerical experiments.
△ Less
Submitted 8 October, 2021;
originally announced October 2021.
-
Compressed Super-Resolution of Positive Sources
Authors:
Maxime Ferreira Da Costa,
Yuejie Chi
Abstract:
Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources are positive, a positive atomic norm can be formulated, and exact recovery can be ensured without imposing a separation between the sources, as long as the numb…
▽ More
Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources are positive, a positive atomic norm can be formulated, and exact recovery can be ensured without imposing a separation between the sources, as long as the number of observations is greater than the number of sources. However, the classic formulation of the atomic norm requires to solve a semidefinite program involving a linear matrix inequality of a size on the order of the signal dimension, which can be prohibitive. In this letter, we introduce a novel "compressed" semidefinite program, which involves a linear matrix inequality of a reduced dimension on the order of the number of sources. We guarantee the tightness of this program under certain conditions on the operator involved in the dimensionality reduction. Finally, we apply the proposed method to direction finding over sparse arrays based on second-order statistics and achieve significant computational savings.
△ Less
Submitted 11 December, 2020; v1 submitted 20 October, 2020;
originally announced October 2020.
-
On the Stable Resolution Limit of Total Variation Regularization for Spike Deconvolution
Authors:
Maxime Ferreira Da Costa,
Yuejie Chi
Abstract:
The stability of spike deconvolution, which aims at recovering point sources from their convolution with a point spread function (PSF), is known to be related to the separation between those sources. When the observations are noisy, it is critical to ensure support stability, where the deconvolution does not lead to spurious, or oppositely, missing estimates of the point sources. In this paper, we…
▽ More
The stability of spike deconvolution, which aims at recovering point sources from their convolution with a point spread function (PSF), is known to be related to the separation between those sources. When the observations are noisy, it is critical to ensure support stability, where the deconvolution does not lead to spurious, or oppositely, missing estimates of the point sources. In this paper, we study the resolution limit of stably recovering the support of two closely located point sources using the Beurling-LASSO estimator, which is a convex optimization approach based on total variation regularization. We establish a sufficient separation criterion between the sources, depending only on the PSF, above which the Beurling-LASSO estimator is guaranteed to return a stable estimate of the point sources, with the same number of estimated elements as that of the ground truth. Our result highlights the impact of PSF on the resolution limit in the noisy setting, which was not evident in previous studies of the noiseless setting. Towards the end, we show that the same resolution limit applies to resolving two close-located sources in conjunction of other well-separated sources.
△ Less
Submitted 10 March, 2020; v1 submitted 3 October, 2019;
originally announced October 2019.
-
Harnessing Sparsity over the Continuum: Atomic Norm Minimization for Super Resolution
Authors:
Yuejie Chi,
Maxime Ferreira Da Costa
Abstract:
Convex optimization recently emerges as a compelling framework for performing super resolution, garnering significant attention from multiple communities spanning signal processing, applied mathematics, and optimization. This article offers a friendly exposition to atomic norm minimization as a canonical convex approach to solve super resolution problems. The mathematical foundations and performan…
▽ More
Convex optimization recently emerges as a compelling framework for performing super resolution, garnering significant attention from multiple communities spanning signal processing, applied mathematics, and optimization. This article offers a friendly exposition to atomic norm minimization as a canonical convex approach to solve super resolution problems. The mathematical foundations and performances guarantees of this approach are presented, and its application in super resolution image reconstruction for single-molecule fluorescence microscopy are highlighted.
△ Less
Submitted 23 December, 2019; v1 submitted 8 April, 2019;
originally announced April 2019.
-
A Tight Converse to the Spectral Resolution Limit via Convex Programming
Authors:
Maxime Ferreira Da Costa,
Wei Dai
Abstract:
It is now well understood that convex programming can be used to estimate the frequency components of a spectrally sparse signal from $2m+1$ uniform temporal measurements. It is conjectured that a phase transition on the success of the total-variation regularization occurs when the distance between the spectral components of the signal to estimate crosses $1/m$. We prove the necessity part of this…
▽ More
It is now well understood that convex programming can be used to estimate the frequency components of a spectrally sparse signal from $2m+1$ uniform temporal measurements. It is conjectured that a phase transition on the success of the total-variation regularization occurs when the distance between the spectral components of the signal to estimate crosses $1/m$. We prove the necessity part of this conjecture by demonstrating that this regularization can fail whenever the spectral distance of the signal of interest is asymptotically equal to $1/m$.
△ Less
Submitted 14 May, 2018; v1 submitted 15 January, 2018;
originally announced January 2018.
-
Low Dimensional Atomic Norm Representations in Line Spectral Estimation
Authors:
Maxime Ferreira Da Costa,
Wei Dai
Abstract:
The line spectral estimation problem consists in recovering the frequencies of a complex valued time signal that is assumed to be sparse in the spectral domain from its discrete observations. Unlike the gridding required by the classical compressed sensing framework, line spectral estimation reconstructs signals whose spectral supports lie continuously in the Fourier domain. If recent advances hav…
▽ More
The line spectral estimation problem consists in recovering the frequencies of a complex valued time signal that is assumed to be sparse in the spectral domain from its discrete observations. Unlike the gridding required by the classical compressed sensing framework, line spectral estimation reconstructs signals whose spectral supports lie continuously in the Fourier domain. If recent advances have shown that atomic norm relaxation produces highly robust estimates in this context, the computational cost of this approach remains, however, the major flaw for its application to practical systems.
In this work, we aim to bridge the complexity issue by studying the atomic norm minimization problem from low dimensional projection of the signal samples. We derive conditions on the sub-sampling matrix under which the partial atomic norm can be expressed by a low-dimensional semidefinite program. Moreover, we illustrate the tightness of this relaxation by showing that it is possible to recover the original signal in poly-logarithmic time for two specific sub-sampling patterns.
△ Less
Submitted 30 January, 2017;
originally announced January 2017.
-
Exact Dimensionality Reduction for Partial Line Spectra Estimation Problems
Authors:
Maxime Ferreira Da Costa,
Wei Dai
Abstract:
Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal observations via the use of convex programming. However, the computational cost of such approaches remains the major flaw to their application to practical systems…
▽ More
Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal observations via the use of convex programming. However, the computational cost of such approaches remains the major flaw to their application to practical systems. This work investigates the recovery of spectrally sparse signal from low-dimensional partial measurements. It is shown in the first part of this paper that, under a light assumption on the sub-sampling matrix, the partial line spectral estimation problems can be relaxed into a low-dimensional semidefinite program. The proof technique relies on a novel extension of the Gram parametrization to subspaces of trigonometric polynomials.
The second part of this work focuses on the analysis of two particular sub-sampling patterns: multirate sampling and random selection sampling. It is shown that those sampling patterns guarantee perfect recovery of the line spectra, and that the reconstruction can be achieved in a poly-logarithmic time with respect to the full observation case. Moreover, the sub-Nyquist recovery capabilities of such sampling patterns are highlighted. The atomic soft thresholding method is adapted in the presented framework to estimate sparse spectra in noisy environments, and a scalable algorithm for its resolution is proposed.
△ Less
Submitted 30 January, 2017; v1 submitted 11 September, 2016;
originally announced September 2016.
-
Achieving Super-Resolution in Multi-Rate Sampling Systems via Efficient Semidefinite Programming
Authors:
M. Ferreira Da Costa,
W. Dai
Abstract:
Super-resolution theory aims to estimate the discrete components lying in a continuous space that constitute a sparse signal with optimal precision. This work investigates the potential of recent super-resolution techniques for spectral estimation in multi-rate sampling systems. It shows that, under the existence of a common supporting grid, and under a minimal separation constraint, the frequenci…
▽ More
Super-resolution theory aims to estimate the discrete components lying in a continuous space that constitute a sparse signal with optimal precision. This work investigates the potential of recent super-resolution techniques for spectral estimation in multi-rate sampling systems. It shows that, under the existence of a common supporting grid, and under a minimal separation constraint, the frequencies of a spectrally sparse signal can be exactly jointly recovered from the output of a semidefinite program (SDP). The algorithmic complexity of this approach is discussed, and an equivalent SDP of minimal dimension is derived by extending the Gram parametrization properties of sparse trigonometric polynomials.
△ Less
Submitted 2 August, 2016; v1 submitted 19 April, 2016;
originally announced April 2016.
-
SIMPLE Dark Matter Search Results
Authors:
TA Girard,
F. Giuliani,
T. Morlat,
M. Felizardo da Costa,
J. I. Collar,
D. Limagne,
G. Waysand,
J. Puibasset,
H. S. Miley,
M. Auguste,
D. Boyer,
A. Cavaillou,
J. G. Marques,
C. Oliveira,
M. Felizardo,
A. C. Fernandes,
A. R. Ramos,
R. C. Martins
Abstract:
We report an improved SIMPLE experiment comprising four superheated droplet detectors with a total exposure of 0.42 kgd. The result yields ~ factor 10 improvement in the previously-reported results, and -- despite the low exposure -- is seen to provide restrictions on the allowed phase space of spin-dependent coupling strengths almost equivalent to those from the significantly larger exposure NA…
▽ More
We report an improved SIMPLE experiment comprising four superheated droplet detectors with a total exposure of 0.42 kgd. The result yields ~ factor 10 improvement in the previously-reported results, and -- despite the low exposure -- is seen to provide restrictions on the allowed phase space of spin-dependent coupling strengths almost equivalent to those from the significantly larger exposure NAIADCDMS/ZEPLIN searches.
△ Less
Submitted 17 May, 2005;
originally announced May 2005.