Showing 1–14 of 14 results for author: Chilappagari, S K

LDPC Codes from Latin Squares Free of Small Trap** Sets

Authors: Dung Viet Nguyen, Shashi Kiran Chilappagari, Michael W. Marcellin, Bane Vasic

Abstract: This paper is concerned with the construction of low-density parity-check (LDPC) codes with low error floors. Two main contributions are made. First, a new class of structured LDPC codes is introduced. The parity check matrices of these codes are arrays of permutation matrices which are obtained from Latin squares and form a finite field under some matrix operations. Second, a method to construct… ▽ More This paper is concerned with the construction of low-density parity-check (LDPC) codes with low error floors. Two main contributions are made. First, a new class of structured LDPC codes is introduced. The parity check matrices of these codes are arrays of permutation matrices which are obtained from Latin squares and form a finite field under some matrix operations. Second, a method to construct LDPC codes with low error floors on the binary symmetric channel (BSC) is presented. Codes are constructed so that their Tanner graphs are free of certain small trap** sets. These trap** sets are selected from the Trap** Set Ontology for the Gallager A/B decoder. They are selected based on their relative harmfulness for a given decoding algorithm. We evaluate the relative harmfulness of different trap** sets for the sum product algorithm (SPA) by using the topological relations among them and by analyzing the decoding failures on one trap** set in the presence or absence of other trap** sets. △ Less

Submitted 23 August, 2011; v1 submitted 24 August, 2010; originally announced August 2010.

Comments: This is a 21 page paper. It contains 18 figures and 4 tables. This paper was submitted to IEEE Transactions on Information Theory

Structured LDPC Codes from Permutation Matrices Free of Small Trap** Sets

Authors: Dung Viet Nguyen, Bane Vasic, Michael Marcellin, Shashi Kiran Chilappagari

Abstract: This paper introduces a class of structured lowdensity parity-check (LDPC) codes whose parity check matrices are arrays of permutation matrices. The permutation matrices are obtained from Latin squares and form a finite field under some matrix operations. They are chosen so that the Tanner graphs do not contain subgraphs harmful to iterative decoding algorithms. The construction of column-weight-t… ▽ More This paper introduces a class of structured lowdensity parity-check (LDPC) codes whose parity check matrices are arrays of permutation matrices. The permutation matrices are obtained from Latin squares and form a finite field under some matrix operations. They are chosen so that the Tanner graphs do not contain subgraphs harmful to iterative decoding algorithms. The construction of column-weight-three codes is presented. Although the codes are optimized for the Gallager A/B algorithm over the binary symmetric channel (BSC), their error performance is very good on the additive white Gaussian noise channel (AWGNC) as well. △ Less

Submitted 7 April, 2010; originally announced April 2010.

Comments: 5 pages, 3 figures, submitted to ITW Dublin 2010

Worst Configurations (Instantons) for Compressed Sensing over Reals: a Channel Coding Approach

Authors: Shashi Kiran Chilappagari, Michael Chertkov, Bane Vasic

Abstract: We consider the Linear Programming (LP) solution of the Compressed Sensing (CS) problem over reals, also known as the Basis Pursuit (BasP) algorithm. The BasP allows interpretation as a channel-coding problem, and it guarantees error-free reconstruction with a properly chosen measurement matrix and sufficiently sparse error vectors. In this manuscript, we examine how the BasP performs on a given… ▽ More We consider the Linear Programming (LP) solution of the Compressed Sensing (CS) problem over reals, also known as the Basis Pursuit (BasP) algorithm. The BasP allows interpretation as a channel-coding problem, and it guarantees error-free reconstruction with a properly chosen measurement matrix and sufficiently sparse error vectors. In this manuscript, we examine how the BasP performs on a given measurement matrix and develop an algorithm to discover the sparsest vectors for which the BasP fails. The resulting algorithm is a generalization of our previous results on finding the most probable error-patterns degrading performance of a finite size Low-Density Parity-Check (LDPC) code in the error-floor regime. The BasP fails when its output is different from the actual error-pattern. We design a CS-Instanton Search Algorithm (ISA) generating a sparse vector, called a CS-instanton, such that the BasP fails on the CS-instanton, while the BasP recovery is successful for any modification of the CS-instanton replacing a nonzero element by zero. We also prove that, given a sufficiently dense random input for the error-vector, the CS-ISA converges to an instanton in a small finite number of steps. The performance of the CS-ISA is illustrated on a randomly generated $120\times 512$ matrix. For this example, the CS-ISA outputs the shortest instanton (error vector) pattern of length 11. △ Less

Submitted 27 April, 2010; v1 submitted 28 January, 2010; originally announced January 2010.

Comments: Accepted to be presented at the IEEE International Symposium on Information Theory (ISIT 2010). 5 pages, 2 Figures. Minor edits from previous version. Added a new reference.

Multilevel Decoders Surpassing Belief Propagation on the Binary Symmetric Channel

Authors: Shiva Kumar Planjery, David Declercq, Shashi Kiran Chilappagari, Bane Vasić

Abstract: In this paper, we propose a new class of quantized message-passing decoders for LDPC codes over the BSC. The messages take values (or levels) from a finite set. The update rules do not mimic belief propagation but instead are derived using the knowledge of trap** sets. We show that the update rules can be derived to correct certain error patterns that are uncorrectable by algorithms such as BP a… ▽ More In this paper, we propose a new class of quantized message-passing decoders for LDPC codes over the BSC. The messages take values (or levels) from a finite set. The update rules do not mimic belief propagation but instead are derived using the knowledge of trap** sets. We show that the update rules can be derived to correct certain error patterns that are uncorrectable by algorithms such as BP and min-sum. In some cases even with a small message set, these decoders can guarantee correction of a higher number of errors than BP and min-sum. We provide particularly good 3-bit decoders for 3-left-regular LDPC codes. They significantly outperform the BP and min-sum decoders, but more importantly, they achieve this at only a fraction of the complexity of the BP and min-sum decoders. △ Less

Submitted 3 March, 2011; v1 submitted 19 January, 2010; originally announced January 2010.

Comments: 5 pages, in Proc. of 2010 IEEE International Symposium on Information Theory (ISIT)

Instanton-based Techniques for Analysis and Reduction of Error Floors of LDPC Codes

Authors: Shashi Kiran Chilappagari, Michael Chertkov, Mikhail G. Stepanov, Bane Vasic

Abstract: We describe a family of instanton-based optimization methods developed recently for the analysis of the error floors of low-density parity-check (LDPC) codes. Instantons are the most probable configurations of the channel noise which result in decoding failures. We show that the general idea and the respective optimization technique are applicable broadly to a variety of channels, discrete or co… ▽ More We describe a family of instanton-based optimization methods developed recently for the analysis of the error floors of low-density parity-check (LDPC) codes. Instantons are the most probable configurations of the channel noise which result in decoding failures. We show that the general idea and the respective optimization technique are applicable broadly to a variety of channels, discrete or continuous, and variety of sub-optimal decoders. Specifically, we consider: iterative belief propagation (BP) decoders, Gallager type decoders, and linear programming (LP) decoders performing over the additive white Gaussian noise channel (AWGNC) and the binary symmetric channel (BSC). The instanton analysis suggests that the underlying topological structures of the most probable instanton of the same code but different channels and decoders are related to each other. Armed with this understanding of the graphical structure of the instanton and its relation to the decoding failures, we suggest a method to construct codes whose Tanner graphs are free of these structures, and thus have less significant error floors. △ Less

Submitted 9 March, 2009; originally announced March 2009.

Comments: To appear in IEEE JSAC On Capacity Approaching Codes. 11 Pages and 6 Figures

Two-Bit Message Passing Decoders for LDPC Codes Over the Binary Symmetric Channel

Authors: Lucile Sassatelli, Shashi Kiran Chilappagari, Bane Vasic, David Declercq

Abstract: In this paper, we consider quantized decoding of LDPC codes on the binary symmetric channel. The binary message passing algorithms, while allowing extremely fast hardware implementation, are not very attractive from the perspective of performance. More complex decoders such as the ones based on belief propagation exhibit superior performance but lead to slower decoders. The approach in this pape… ▽ More In this paper, we consider quantized decoding of LDPC codes on the binary symmetric channel. The binary message passing algorithms, while allowing extremely fast hardware implementation, are not very attractive from the perspective of performance. More complex decoders such as the ones based on belief propagation exhibit superior performance but lead to slower decoders. The approach in this paper is to consider message passing decoders that have larger message alphabet (thereby providing performance improvement) as well as low complexity (thereby ensuring fast decoding). We propose a class of message-passing decoders whose messages are represented by two bits. The thresholds for various decoders in this class are derived using density evolution. The problem of correcting a fixed number of errors assumes significance in the error floor region. For a specific decoder, the sufficient conditions for correcting all patterns with up to three errors are derived. By comparing these conditions and thresholds to the similar ones when Gallager B decoder is used, we emphasize the advantage of decoding on a higher number of bits, even if the channel observation is still one bit. △ Less

Submitted 6 March, 2009; v1 submitted 14 January, 2009; originally announced January 2009.

Comments: submitted to IEEE Transactions on Communications

Low-Density Parity-Check Codes Which Can Correct Three Errors Under Iterative Decoding

Authors: Shashi Kiran Chilappagari, Anantha Raman Krishnan, Bane Vasic, Michael W. Marcellin

Abstract: In this paper, we give necessary and sufficient conditions for low-density parity-check (LDPC) codes with column-weight three to correct three errors when decoded using hard-decision message-passing decoding. Additionally, we give necessary and sufficient conditions for column-weight-four codes to correct three errors in four iterations of hard-decision message-passing decoding. We then give a c… ▽ More In this paper, we give necessary and sufficient conditions for low-density parity-check (LDPC) codes with column-weight three to correct three errors when decoded using hard-decision message-passing decoding. Additionally, we give necessary and sufficient conditions for column-weight-four codes to correct three errors in four iterations of hard-decision message-passing decoding. We then give a construction technique which results in codes satisfying these conditions. We also provide numerical assessment of code performance via simulation results. △ Less

Submitted 7 October, 2008; originally announced October 2008.

Comments: 25 pages. 11 Figures. Part of the work was presented at the Information Theory Workshop (ITW), May 5-9 2008, Porto, Portugal. submitted to IEEE Transactions on Information Theory

Provably efficient instanton search algorithm for LP decoding of LDPC codes over the BSC

Authors: Shashi Kiran Chilappagari, Michael Chertkov, Bane Vasic

Abstract: We consider Linear Programming (LP) decoding of a fixed Low-Density Parity-Check (LDPC) code over the Binary Symmetric Channel (BSC). The LP decoder fails when it outputs a pseudo-codeword which is not a codeword. We design an efficient algorithm termed the Instanton Search Algorithm (ISA) which, given a random input, generates a set of flips called the BSC-instanton. We prove that: (a) the LP d… ▽ More We consider Linear Programming (LP) decoding of a fixed Low-Density Parity-Check (LDPC) code over the Binary Symmetric Channel (BSC). The LP decoder fails when it outputs a pseudo-codeword which is not a codeword. We design an efficient algorithm termed the Instanton Search Algorithm (ISA) which, given a random input, generates a set of flips called the BSC-instanton. We prove that: (a) the LP decoder fails for any set of flips with support vector including an instanton; (b) for any input, the algorithm outputs an instanton in the number of steps upper-bounded by twice the number of flips in the input. Repeated sufficient number of times, the ISA outcomes the number of unique instantons of different sizes. △ Less

Submitted 2 September, 2008; v1 submitted 18 August, 2008; originally announced August 2008.

Comments: Submitted to IEEE Transactions on Information Theory. 9 Pages, 4 Figures; Dr. Bane Vasic added as an author; Changes made to the introduction and abstract; Acknowledgment section added; Some references added; Figures modified to make them more clear;

Report number: LA-UR-08-05304

Error Correction Capability of Column-Weight-Three LDPC Codes: Part II

Authors: Shashi Kiran Chilappagari, Dung Viet Nguyen, Bane Vasic, Michael W. Marcellin

Abstract: The relation between the girth and the error correction capability of column-weight-three LDPC codes is investigated. Specifically, it is shown that the Gallager A algorithm can correct $g/2-1$ errors in $g/2$ iterations on a Tanner graph of girth $g \geq 10$. The relation between the girth and the error correction capability of column-weight-three LDPC codes is investigated. Specifically, it is shown that the Gallager A algorithm can correct $g/2-1$ errors in $g/2$ iterations on a Tanner graph of girth $g \geq 10$. △ Less

Submitted 22 July, 2008; originally announced July 2008.

Comments: 7 pages, 7 figures, submitted to IEEE Transactions on Information Theory (July 2008)

On Trap** Sets and Guaranteed Error Correction Capability of LDPC Codes and GLDPC Codes

Authors: Shashi Kiran Chilappagari, Dung Viet Nguyen, Bane Vasic, Michael W. Marcellin

Abstract: The relation between the girth and the guaranteed error correction capability of $γ$-left regular LDPC codes when decoded using the bit flip** (serial and parallel) algorithms is investigated. A lower bound on the size of variable node sets which expand by a factor of at least $3 γ/4$ is found based on the Moore bound. An upper bound on the guaranteed error correction capability is established… ▽ More The relation between the girth and the guaranteed error correction capability of $γ$-left regular LDPC codes when decoded using the bit flip** (serial and parallel) algorithms is investigated. A lower bound on the size of variable node sets which expand by a factor of at least $3 γ/4$ is found based on the Moore bound. An upper bound on the guaranteed error correction capability is established by studying the sizes of smallest possible trap** sets. The results are extended to generalized LDPC codes. It is shown that generalized LDPC codes can correct a linear fraction of errors under the parallel bit flip** algorithm when the underlying Tanner graph is a good expander. It is also shown that the bound cannot be improved when $γ$ is even by studying a class of trap** sets. A lower bound on the size of variable node sets which have the required expansion is established. △ Less

Submitted 15 May, 2008; originally announced May 2008.

Comments: 17 pages. Submitted to IEEE Transactions on Information Theory. Parts of this work have been accepted for presentation at the International Symposium on Information Theory (ISIT'08) and the International Telemetering Conference (ITC'08)

LDPC Codes Which Can Correct Three Errors Under Iterative Decoding

Authors: Shashi Kiran Chilappagari, Anantha Raman Krishnan, Bane Vasic

Abstract: In this paper, we provide necessary and sufficient conditions for a column-weight-three LDPC code to correct three errors when decoded using Gallager A algorithm. We then provide a construction technique which results in a code satisfying the above conditions. We also provide numerical assessment of code performance via simulation results. In this paper, we provide necessary and sufficient conditions for a column-weight-three LDPC code to correct three errors when decoded using Gallager A algorithm. We then provide a construction technique which results in a code satisfying the above conditions. We also provide numerical assessment of code performance via simulation results. △ Less

Submitted 8 January, 2008; originally announced January 2008.

Comments: 5 pages, 3 figures, submitted to IEEE Information Theory Workshop (ITW), 2008

On the guaranteed error correction capability of LDPC codes

Authors: Shashi Kiran Chilappagari, Dung Viet Nguyen, Bane Vasic, Michael Marcellin

Abstract: We investigate the relation between the girth and the guaranteed error correction capability of $γ$-left regular LDPC codes when decoded using the bit flip** (serial and parallel) algorithms. A lower bound on the number of variable nodes which expand by a factor of at least $3 γ/4$ is found based on the Moore bound. An upper bound on the guaranteed correction capability is established by study… ▽ More We investigate the relation between the girth and the guaranteed error correction capability of $γ$-left regular LDPC codes when decoded using the bit flip** (serial and parallel) algorithms. A lower bound on the number of variable nodes which expand by a factor of at least $3 γ/4$ is found based on the Moore bound. An upper bound on the guaranteed correction capability is established by studying the sizes of smallest possible trap** sets. △ Less

Submitted 8 January, 2008; originally announced January 2008.

Comments: 5 pages, submitted to IEEE International Symposium on Information Theory (ISIT), 2008

Error Correction Capability of Column-Weight-Three LDPC Codes

Authors: Shashi Kiran Chilappagari, Bane Vasic

Abstract: In this paper, we investigate the error correction capability of column-weight-three LDPC codes when decoded using the Gallager A algorithm. We prove that the necessary condition for a code to correct $k \geq 5$ errors is to avoid cycles of length up to $2k$ in its Tanner graph. As a consequence of this result, we show that given any $α>0, \exists N $ such that $\forall n>N$, no code in the ense… ▽ More In this paper, we investigate the error correction capability of column-weight-three LDPC codes when decoded using the Gallager A algorithm. We prove that the necessary condition for a code to correct $k \geq 5$ errors is to avoid cycles of length up to $2k$ in its Tanner graph. As a consequence of this result, we show that given any $α>0, \exists N $ such that $\forall n>N$, no code in the ensemble of column-weight-three codes can correct all $αn$ or fewer errors. We extend these results to the bit flip** algorithm. △ Less

Submitted 17 October, 2007; originally announced October 2007.

Comments: 16 pages, 3 figures. Submitted to IEEE Transactions on Information Theory

Reliable Memories Built from Unreliable Components Based on Expander Graphs

Authors: Shashi Kiran Chilappagari, Bane Vasic

Abstract: In this paper, memories built from components subject to transient faults are considered. A fault-tolerant memory architecture based on low-density parity-check codes is proposed and the existence of reliable memories for the adversarial failure model is proved. The proof relies on the expansion property of the underlying Tanner graph of the code. An equivalence between the Taylor-Kuznetsov (TK)… ▽ More In this paper, memories built from components subject to transient faults are considered. A fault-tolerant memory architecture based on low-density parity-check codes is proposed and the existence of reliable memories for the adversarial failure model is proved. The proof relies on the expansion property of the underlying Tanner graph of the code. An equivalence between the Taylor-Kuznetsov (TK) scheme and Gallager B algorithm is established and the results are extended to the independent failure model. It is also shown that the proposed memory architecture has lower redundancy compared to the TK scheme. The results are illustrated with specific numerical examples. △ Less

Submitted 30 April, 2007; originally announced May 2007.

Comments: Submitted to IEEE Transactions on Information Theory