-
Sparse recovery guarantees for block orthogonal binary matrices constructed via Generalized Euler Squares
Authors:
Pradip Sasmal,
Phanindra Jampana,
C. S. Sastry
Abstract:
In recent times, the construction of deterministic matrices has gained popularity as an alternative of random matrices as they provide guarantees for recovery of sparse signals. In particular, the construction of binary matrices has attained significance due to their potential for hardware-friendly implementation and appealing applications. Our present work aims at constructing incoherent binary m…
▽ More
In recent times, the construction of deterministic matrices has gained popularity as an alternative of random matrices as they provide guarantees for recovery of sparse signals. In particular, the construction of binary matrices has attained significance due to their potential for hardware-friendly implementation and appealing applications. Our present work aims at constructing incoherent binary matrices consisting of orthogonal blocks with small block coherence. We show that the binary matrices constructed from Euler squares exhibit block orthogonality and possess low block coherence. With a goal of obtaining better aspect ratios, the present work generalizes the notion of Euler Squares and obtains a new class of deterministic binary matrices of more general size. For realizing the stated objectives, to begin with, the paper revisits the connection of finite field theory to Euler Squares and their construction. Using the stated connection, the work proposes Generalized Euler Squares (GES) and then presents a construction procedure. Binary matrices with low coherence and general row-sizes are obtained, whose column size is in the maximum possible order. Finally, the paper shows that the special structure possessed by GES is helpful in resulting in block orthogonal structure with small block coherence, which supports the recovery of block sparse signals.
△ Less
Submitted 17 July, 2019;
originally announced July 2019.
-
Construction of Structured Incoherent Unit Norm Tight Frames
Authors:
Pradip Sasmal,
Phanindra Jampana,
C. S. Sastry
Abstract:
The exact recovery property of Basis pursuit (BP) and Orthogonal Matching Pursuit (OMP) has a relation with the coherence of the underlying frame. A frame with low coherence provides better guarantees for exact recovery. In particular, Incoherent Unit Norm Tight Frames (IUNTFs) play a significant role in sparse representations. IUNTFs with special structure, in particular those given by a union of…
▽ More
The exact recovery property of Basis pursuit (BP) and Orthogonal Matching Pursuit (OMP) has a relation with the coherence of the underlying frame. A frame with low coherence provides better guarantees for exact recovery. In particular, Incoherent Unit Norm Tight Frames (IUNTFs) play a significant role in sparse representations. IUNTFs with special structure, in particular those given by a union of several orthonormal bases, are known to satisfy better theoretical guarantees for recovering sparse signals. In the present work, we propose to construct structured IUNTFs consisting of large number of orthonormal bases. For a given $r, k, m$ with $k$ being less than or equal to the smallest prime power factor of $m$ and $r<k,$ we construct a CS matrix of size $mk \times (mk\times m^{r})$ with coherence at most $\frac{r}{k},$ which consists of $m^{r}$ number of orthonormal bases and with density $\frac{1}{m}$. We also present numerical results of recovery performance of union of orthonormal bases as against their Gaussian counterparts.
△ Less
Submitted 2 July, 2017;
originally announced July 2017.
-
Nullspace Property for Optimality of Minimum Frame Angle Under Invertible Linear Operators
Authors:
Pradip Sasmal,
Prasad Theeda,
Phanindra Jampana,
C. S. Sastry
Abstract:
Orthogonal Matching Pursuit and Basis Pursuit are popular reconstruction algorithms for recovery of sparse signals. The exact recovery property of both the methods has a relation with the coherence of the underlying redundant dictionary, i.e. a frame. A frame with low coherence provides better guarantees for exact recovery. An equivalent formulation of the associated linear system is obtained via…
▽ More
Orthogonal Matching Pursuit and Basis Pursuit are popular reconstruction algorithms for recovery of sparse signals. The exact recovery property of both the methods has a relation with the coherence of the underlying redundant dictionary, i.e. a frame. A frame with low coherence provides better guarantees for exact recovery. An equivalent formulation of the associated linear system is obtained via premultiplication by a non-singular matrix. In view of bounds that guarantee sparse recovery, it is very useful to generate the preconditioner in such way that the preconditioned frame has low coherence as compared to the original. In this paper, we discuss the impact of preconditioning on sparse recovery. Further, we formulate a convex optimization problem for designing the preconditioner that yields a frame with improved coherence. In addition to reducing coherence, we focus on designing well conditioned frames and numerically study the relationship between the condition number of the preconditioner and the coherence of the new frame. Alongside theoretical justifications, we demonstrate through simulations the efficacy of the preconditioner in reducing coherence as well as recovering sparse signals.
△ Less
Submitted 9 June, 2021; v1 submitted 22 April, 2016;
originally announced April 2016.
-
Deterministic construction of sparse binary and ternary matrices from existing binary sensing matrices
Authors:
Pradip Sasmal,
R. Ramu Naidu,
C. S. Sastry,
P. V. Jampana
Abstract:
In the present work, we discuss a procedure for constructing sparse binary and ternary matrices from existing two binary sensing matrices. The matrices that we construct have several attractive properties such as smaller density, which supports algorithms with low computational complexity. As an application of our method, we show that a CS matrix of general row size different from $p, p^2, pq$ (fo…
▽ More
In the present work, we discuss a procedure for constructing sparse binary and ternary matrices from existing two binary sensing matrices. The matrices that we construct have several attractive properties such as smaller density, which supports algorithms with low computational complexity. As an application of our method, we show that a CS matrix of general row size different from $p, p^2, pq$ (for different primes $p,q$) can be constructed.
△ Less
Submitted 4 March, 2015;
originally announced March 2015.
-
Deterministic compressed sensing matrices: Construction via Euler Squares and applications
Authors:
R. Ramu Naidu,
C. S. Sastry,
Phanindra Jampana
Abstract:
In Compressed Sensing the matrices that satisfy the Restricted Isometry Property (RIP) play an important role. But to date, very few results for designing such matrices are available. For applications such as multiplier-less data compression, binary sensing matrices are of interest. The present work constructs deterministic and binary sensing matrices using Euler Squares. In particular, given a po…
▽ More
In Compressed Sensing the matrices that satisfy the Restricted Isometry Property (RIP) play an important role. But to date, very few results for designing such matrices are available. For applications such as multiplier-less data compression, binary sensing matrices are of interest. The present work constructs deterministic and binary sensing matrices using Euler Squares. In particular, given a positive integer $m$ different from $p, p^2$ for a prime $p$, we show that it is possible to construct a binary sensing matrix of size $m \times c (mμ)^2$, where $μ$ is the coherence parameter of the matrix and $c \in [1,2)$. The matrices that we construct have smaller density (that is, percentage of nonzero entries in the matrix is small) with no function evaluation in their construction, which support algorithms with low computational complexity. Through experimental work, we show that our binary sensing matrices can be used for such applications as content based image retrieval. Our simulation results demonstrate that the Euler Square based CS matrices give better performance than their Gaussian counterparts.
△ Less
Submitted 26 March, 2016; v1 submitted 27 January, 2015;
originally announced January 2015.
-
Sparse solution of overdetermined linear systems when the columns of $A$ are orthogonal
Authors:
Phanindra V. Jampana,
Sastry S. Challa
Abstract:
In this paper, we consider the problem of obtaining the best $k$-sparse solution of $Ax=y$ subject to the constraint that the columns of $A$ are orthogonal. The naive approach for obtaining a solution to this problem has exponential complexity and there exist $l_1$ regularization methods such as Lasso to obtain approximate solutions. In this paper, we show that we can obtain an exact solution to t…
▽ More
In this paper, we consider the problem of obtaining the best $k$-sparse solution of $Ax=y$ subject to the constraint that the columns of $A$ are orthogonal. The naive approach for obtaining a solution to this problem has exponential complexity and there exist $l_1$ regularization methods such as Lasso to obtain approximate solutions. In this paper, we show that we can obtain an exact solution to the problem, with much less computational effort compared to the brute force search when the columns of $A$ are orthogonal.
△ Less
Submitted 9 April, 2012; v1 submitted 24 March, 2012;
originally announced March 2012.
