-
Overflow-Avoiding Memory AMP
Authors:
Shunqi Huang,
Lei Liu,
Brian M. Kurkoski
Abstract:
Approximate Message Passing (AMP) type algorithms are widely used for signal recovery in high-dimensional noisy linear systems. Recently, a principle called Memory AMP (MAMP) was proposed. Leveraging this principle, the gradient descent MAMP (GD-MAMP) algorithm was designed, inheriting the strengths of AMP and OAMP/VAMP. In this paper, we first provide an overflow-avoiding GD-MAMP (OA-GD-MAMP) to…
▽ More
Approximate Message Passing (AMP) type algorithms are widely used for signal recovery in high-dimensional noisy linear systems. Recently, a principle called Memory AMP (MAMP) was proposed. Leveraging this principle, the gradient descent MAMP (GD-MAMP) algorithm was designed, inheriting the strengths of AMP and OAMP/VAMP. In this paper, we first provide an overflow-avoiding GD-MAMP (OA-GD-MAMP) to address the overflow problem that arises from some intermediate variables exceeding the range of floating point numbers. Second, we develop a complexity-reduced GD-MAMP (CR-GD-MAMP) to reduce the number of matrix-vector products per iteration by 1/3 (from 3 to 2) with little to no impact on the convergence speed.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
On the Existence of Cyclic Lattice Codes
Authors:
Chengpin Luo,
Brian M. Kurkoski
Abstract:
A coding lattice $Λ_c$ and a sha** lattice $Λ_s$ forms a nested lattice code $\mathcal{C}$ if $Λ_s \subseteq Λ_c$. Under some conditions, $\mathcal{C}$ is a finite cyclic group formed by rectangular encoding. This paper presents the conditions for the existence of such $\mathcal{C}$ and provides some designs. These designs correspond to solutions to linear Diophantine equations so that a cyclic…
▽ More
A coding lattice $Λ_c$ and a sha** lattice $Λ_s$ forms a nested lattice code $\mathcal{C}$ if $Λ_s \subseteq Λ_c$. Under some conditions, $\mathcal{C}$ is a finite cyclic group formed by rectangular encoding. This paper presents the conditions for the existence of such $\mathcal{C}$ and provides some designs. These designs correspond to solutions to linear Diophantine equations so that a cyclic lattice code $\mathcal C$ of arbitrary codebook size $M$ can possess group isomorphism, which is an essential property for a nested lattice code to be applied in physical layer network relaying techniques such as compute and forward.
△ Less
Submitted 9 May, 2024; v1 submitted 28 February, 2024;
originally announced February 2024.
-
Algebra of L-banded Matrices
Authors:
Shunqi Huang,
Lei Liu,
Brian M. Kurkoski
Abstract:
Convergence is a crucial issue in iterative algorithms. Dam** is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of dam** are scalar-wise, and either heuristic or empirical. Recently, an analytically optimized vector dam** was proposed for memory message-passing (iterative) algorithms. As a result, it yields a special class of covariance matrices ca…
▽ More
Convergence is a crucial issue in iterative algorithms. Dam** is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of dam** are scalar-wise, and either heuristic or empirical. Recently, an analytically optimized vector dam** was proposed for memory message-passing (iterative) algorithms. As a result, it yields a special class of covariance matrices called L-banded matrices. In this paper, we show these matrices have broad algebraic properties arising from their L-banded structure. In particular, compact analytic expressions for the LDL decomposition, the Cholesky decomposition, the determinant after a column substitution, minors, and cofactors are derived. Furthermore, necessary and sufficient conditions for an L-banded matrix to be definite, a recurrence to obtain the characteristic polynomial, and some other properties are given. In addition, we give new derivations of the determinant and the inverse. (It's crucial to emphasize that some works have independently studied matrices with this special structure, named as L-matrices. Specifically, L-banded matrices are regarded as L-matrices with real and finite entries.)
△ Less
Submitted 15 November, 2023; v1 submitted 20 December, 2022;
originally announced December 2022.
-
Sufficient Statistic Memory Approximate Message Passing
Authors:
Lei Liu,
Shunqi Huang,
Brian M. Kurkoski
Abstract:
Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. However, state evolution does not necessarily guarantee the convergence of iterative algorithms. To solve the convergence problem of AMP-type algori…
▽ More
Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. However, state evolution does not necessarily guarantee the convergence of iterative algorithms. To solve the convergence problem of AMP-type algorithms in principle, this paper proposes a memory AMP (MAMP) under a sufficient statistic condition, named sufficient statistic MAMP (SS-MAMP). We show that the covariance matrices of SS-MAMP are L-banded and convergent. Given an arbitrary MAMP, we can construct the SS-MAMP by dam**, which not only ensures the convergence, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution.
△ Less
Submitted 23 June, 2022;
originally announced June 2022.
-
Sufficient-Statistic Memory AMP
Authors:
Lei Liu,
Shunqi Huang,
YuZhi Yang,
Zhaoyang Zhang,
Brian M. Kurkoski
Abstract:
Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-t…
▽ More
Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-type algorithms in principle, this paper proposes a sufficient-statistic memory AMP (SS-MAMP) algorithm framework under the conditions of right-unitarily invariant sensing matrices, Lipschitz-continuous local processors and the sufficient-statistic constraint (i.e., the current message of each local processor is a sufficient statistic of the signal vector given the current and all preceding messages). We show that the covariance matrices of SS-MAMP are L-banded and convergent, which is an optimal framework (from the local MMSE/LMMSE perspective) for AMP-type algorithms given the Lipschitz-continuous local processors. Given an arbitrary MAMP, we can construct an SS-MAMP by dam**, which not only ensures the convergence of the state evolution, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution. As a byproduct, we prove that the Bayes-optimal orthogonal/vector AMP (BO-OAMP/VAMP) is an SS-MAMP. As an example, we construct a sufficient-statistic Bayes-optimal MAMP (SS-BO-MAMP) whose state evolution converges to the minimum (i.e., Bayes-optimal) mean square error (MSE) predicted by replica methods when it has a unique fixed point. In addition, the MSE of SS-BO-MAMP is not worse than the original BO-MAMP. Finally, simulations are provided to support the theoretical results.
△ Less
Submitted 29 June, 2023; v1 submitted 31 December, 2021;
originally announced December 2021.
-
Memory Approximate Message Passing
Authors:
Lei Liu,
Shunqi Huang,
Brian M. Kurkoski
Abstract:
Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OA…
▽ More
Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP requires high-complexity linear minimum mean square error estimator. To solve the disadvantages of AMP and OAMP/VAMP, this paper proposes a memory AMP (MAMP), in which a long-memory matched filter is proposed for interference suppression. The complexity of MAMP is comparable to AMP. The asymptotic Gaussianity of estimation errors in MAMP is guaranteed by the orthogonality principle. A state evolution is derived to asymptotically characterize the performance of MAMP. Based on the state evolution, the relaxation parameters and dam** vector in MAMP are optimized. For all right-unitarily-invariant matrices, the optimized MAMP converges to OAMP/VAMP, and thus is Bayes-optimal if it has a unique fixed point. Finally, simulations are provided to verify the validity and accuracy of the theoretical results.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
Irregularly Clipped Sparse Regression Codes
Authors:
Wencong Li,
Lei Liu,
Brian M. Kurkoski
Abstract:
Recently, it was found that clip** can significantly improve the section error rate (SER) performance of sparse regression (SR) codes if an optimal clip** threshold is chosen. In this paper, we propose irregularly clipped SR codes, where multiple clip** thresholds are applied to symbols according to a distribution, to further improve the SER performance of SR codes. Orthogonal approximate me…
▽ More
Recently, it was found that clip** can significantly improve the section error rate (SER) performance of sparse regression (SR) codes if an optimal clip** threshold is chosen. In this paper, we propose irregularly clipped SR codes, where multiple clip** thresholds are applied to symbols according to a distribution, to further improve the SER performance of SR codes. Orthogonal approximate message passing (OAMP) algorithm is used for decoding. Using state evolution, the distribution of irregular clip** thresholds is optimized to minimize the SER of OAMP decoding. As a result, optimized irregularly clipped SR codes achieve a better tradeoff between clip** distortion and noise distortion than regularly clipped SR codes. Numerical results demonstrate that irregularly clipped SR codes achieve 0.4 dB gain in signal-to-noise-ratio (SNR) over regularly clipped SR codes at code length$\,\approx2.5\!\times\! 10^4$ and SER$\,\approx10^{-5}$. We further show that irregularly clipped SR codes are robust over a wide range of code rates.
△ Less
Submitted 2 June, 2021;
originally announced June 2021.
-
Construction D' Lattices for Power-Constrained Communications
Authors:
Fan Zhou,
Brian M. Kurkoski
Abstract:
Designs and methods for nested lattice codes using Construction D' lattices for coding and convolutional code lattices for sha** are described. Two encoding methods and a decoding algorithm for Construction D' coding lattices that can be used with sha** lattices for power-constrained channels are given. We construct nested lattice codes with good coding properties, a high sha** gain, and low…
▽ More
Designs and methods for nested lattice codes using Construction D' lattices for coding and convolutional code lattices for sha** are described. Two encoding methods and a decoding algorithm for Construction D' coding lattices that can be used with sha** lattices for power-constrained channels are given. We construct nested lattice codes with good coding properties, a high sha** gain, and low-complexity encoding and decoding. Convolutional code generator polynomials for Construction A lattices with the greatest sha** gain are given, as a result of an extensive search. It is shown that rate 1/3 convolutional codes provide a more favorable performance-complexity trade-off than rate 1/2 convolutional codes. Tail-biting convolutional codes have higher sha** gain than that of zero-tailed convolutional codes. A design for quasi-cyclic low-density parity-check (QC-LDPC) codes to form Construction D' lattices which have efficient encoding and indexing is presented. The resulting QC-LDPC Construction D' lattices are evaluated using four sha** lattices: the $E_8$ lattice, the $BW_{16}$ lattice, the Leech lattice and our best-found convolutional code lattice, showing a sha** gain of approximately 0.65 dB, 0.86 dB, 1.03 dB and 1.25 dB at dimension 2304.
△ Less
Submitted 31 December, 2021; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Encoding and Decoding Construction D' Lattices for Power-Constrained Communications
Authors:
Fan Zhou,
Arini Fitri,
Khoirul Anwar,
Brian M. Kurkoski
Abstract:
This paper focuses on the encoding and decoding of Construction D' coding lattices that can be used with sha** lattices for power-constrained channels. Two encoding methods and a decoding algorithm for Construction D' lattices are given. A design of quasi-cyclic low-density parity-check (QC-LDPC) codes to form Construction D' lattices is presented. This allows construction of nested lattice code…
▽ More
This paper focuses on the encoding and decoding of Construction D' coding lattices that can be used with sha** lattices for power-constrained channels. Two encoding methods and a decoding algorithm for Construction D' lattices are given. A design of quasi-cyclic low-density parity-check (QC-LDPC) codes to form Construction D' lattices is presented. This allows construction of nested lattice codes which are good for coding, good for sha**, and have low complexity encoding and decoding. Numerical results of using $E_8$, $BW_{16}$ and Leech lattices for sha** a Construction D' lattice indicate that the sha** gains 0.65 dB, 0.86 dB and 1.03 dB are preserved, respectively.
△ Less
Submitted 9 February, 2021;
originally announced February 2021.
-
Design of Polar Code Lattices of Small Dimension
Authors:
Obed Rhesa Ludwiniananda,
Ning Liu,
Khoirul Anwar,
Brian M. Kurkoski
Abstract:
Polar code lattices are formed from binary polar codes using Construction D. In this paper, we propose a design technique for finite-dimension polar code lattices. The dimension $n$ and target probability of decoding error are parameters for this design. To select the rates of the Construction D component codes, rather than using the capacity as in past work, we use the explicit finite-length prop…
▽ More
Polar code lattices are formed from binary polar codes using Construction D. In this paper, we propose a design technique for finite-dimension polar code lattices. The dimension $n$ and target probability of decoding error are parameters for this design. To select the rates of the Construction D component codes, rather than using the capacity as in past work, we use the explicit finite-length properties of the polar code. Under successive cancellation decoding, density evolution allows choosing code rates that satisfy the equal error probability rule. At an error-rate of $10^{-4}$, a dimension $n=128$ polar code lattice achieves a VNR of 2.5 dB, within 0.2 dB of the best-known BCH code lattice, but with significantly lower decoding complexity.
△ Less
Submitted 7 February, 2021;
originally announced February 2021.
-
Memory AMP
Authors:
Lei Liu,
Shunqi Huang,
Brian M. Kurkoski
Abstract:
Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable (e.g., perform poorly or even diverge) for other matrix ensembles, especially for ill-conditioned ones. To solve this issue, o…
▽ More
Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable (e.g., perform poorly or even diverge) for other matrix ensembles, especially for ill-conditioned ones. To solve this issue, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP (BO-OAMP/VAMP) requires a high-complexity linear minimum mean square error (MMSE) estimator. This prevents OAMP/VAMP from being used in large-scale systems.
To address the drawbacks of AMP and BO-OAMP/VAMP, this paper offers a memory AMP (MAMP) framework based on the orthogonality principle, which ensures that estimation errors in MAMP are asymptotically IID Gaussian. To realize the required orthogonality for MAMP, we provide an orthogonalization procedure for the local memory estimators. In addition, we propose a Bayes-optimal MAMP (BO-MAMP), in which a long-memory matched filter is used for interference suppression. The complexity of BO-MAMP is comparable to AMP. To asymptotically characterize the performance of BO-MAMP, a state evolution is derived. The relaxation parameters and dam** vector in BO-MAMP are optimized based on state evolution. Most crucially, the state evolution of the optimized BO-MAMP converges to the same fixed point as that of the high-complexity BO-OAMP/VAMP for all right-unitarily-invariant matrices, and achieves the Bayes optimal MSE predicted by the replica method if its state evolution has a unique fixed point. Finally, simulations are provided to verify the theoretical results' validity and accuracy.
△ Less
Submitted 22 June, 2022; v1 submitted 20 December, 2020;
originally announced December 2020.
-
Opportunistic Cooperation Strategies for Multiple Access Relay Channels with Compute-and-Forward
Authors:
Mohammad Nur Hasan,
Brian M. Kurkoski
Abstract:
This paper studies the application of compute-and-forward to multiple access relay channels (MARC). Despite its promising advantage of improving network throughput, it is not straightforward to apply compute-and-forward to the MARC. This paper proposes two efficient cooperation strategies for the MARC with compute-and-forward. Both proposed strategies are opportunistic in the sense that the cooper…
▽ More
This paper studies the application of compute-and-forward to multiple access relay channels (MARC). Despite its promising advantage of improving network throughput, it is not straightforward to apply compute-and-forward to the MARC. This paper proposes two efficient cooperation strategies for the MARC with compute-and-forward. Both proposed strategies are opportunistic in the sense that the cooperation between the relay and the destination are performed only when it is needed for the sake of high transmission efficiency. In the first strategy, the relay helps the destination by sending its local optimal integer coefficient vector without taking into account that the resulting integer coefficient matrix at the destination is full rank. In contrast, in the second strategy, the relay forwards its ``best'' coefficient vector that always ensures a full rank coefficient matrix at the destination. Both of the proposed strategies achieve twice the network throughput of the existing strategies at high signal-to-noise power ratio (SNR). They also have lower outage probability, independent of relay placement. Furthermore, the first strategy nearly achieves diversity gain of order two, and the second one achieves exactly the diversity gain of order two, which cannot be achieved by the existing strategies.
△ Less
Submitted 8 August, 2020;
originally announced August 2020.
-
GuardRider: Towards Sustainable Backscattering System over WiFi in the Wild
Authors:
Xin He,
Weiwei Jiang,
Meng Cheng,
Xiaobo Zhou,
Peng-Jun Wan,
Panlong Yang,
Brian Kurkoski
Abstract:
The WiFi backscatter communications offer ultra-low power and ubiquitous connections for IoT systems. Caused by the intermittent-nature of the WiFi traffics, state-of-the-art WiFi backscatter communications are not reliable for backscatter link or simple for tag to do adaptive transmission. In order to build sustainable (reliable and simple) WiFi backscatter communications, we present GuardRider,…
▽ More
The WiFi backscatter communications offer ultra-low power and ubiquitous connections for IoT systems. Caused by the intermittent-nature of the WiFi traffics, state-of-the-art WiFi backscatter communications are not reliable for backscatter link or simple for tag to do adaptive transmission. In order to build sustainable (reliable and simple) WiFi backscatter communications, we present GuardRider, a WiFi backscatter system that enables backscatter communications riding on WiFi signals in the wild. The key contribution of GuardRider is an optimization algorithm of designing RS codes to follow the statistical knowledge of WiFi traffics and adjust backscatter transmission. With GuardRider, the reliable baskscatter link is guaranteed and a backscatter tag is able to adaptively transmit information without heavily listening the excitation channel. We built a hardware prototype of GuardRider using a customized tag with FPGA implementation. Both the simulations and field experiments verify that GuardRider could achieve a notably gains in bit error rate and frame error rate, which are hundredfold reduction in simulations and around 99% in filed experiments.
△ Less
Submitted 12 December, 2019;
originally announced December 2019.
-
Steepest Gradient-Based Orthogonal Precoder For Integer-Forcing MIMO
Authors:
Mohammad Nur Hasan,
Brian M. Kurkoski,
Amin Sakzad,
Emanuele Viterbo
Abstract:
In this paper, we develop an orthogonal precoding scheme for integer-forcing (IF) linear receivers using the steepest gradient algorithm. Although this scheme can be viewed as a special case of the unitary precoded integer-forcing (UPIF), it has two major advantages. First, the orthogonal precoding outperforms its unitary counterpart in terms of achievable rate, outage probability, and error rate.…
▽ More
In this paper, we develop an orthogonal precoding scheme for integer-forcing (IF) linear receivers using the steepest gradient algorithm. Although this scheme can be viewed as a special case of the unitary precoded integer-forcing (UPIF), it has two major advantages. First, the orthogonal precoding outperforms its unitary counterpart in terms of achievable rate, outage probability, and error rate. We verify this advantage via theoretical and numerical analyses. Second, it exhibits lower complexity as the dimension of orthogonal matrices is half that of unitary matrices in the real-valued domain. For finding ``good'' orthogonal precoder matrices, we propose an efficient algorithm based on the steepest gradient algorithm that exploits the geometrical properties of orthogonal matrices as a Lie group. The proposed algorithm has low complexity and can be easily applied to an arbitrary MIMO configuration. We also confirm numerically that the proposed orthogonal precoding outperforms UPIF type II in some scenarios and the X-precoder in high-order QAM schemes, e.g., $64$- and $256$-QAM.
△ Less
Submitted 19 April, 2019;
originally announced April 2019.
-
Construction D$^\prime$ Lattices from Quasi-Cyclic Low-Density Parity-Check Codes
Authors:
Siyu Chen,
Brian M. Kurkoski,
Eirik Rosnes
Abstract:
Recently, Branco da Silva and Silva described an efficient encoding and decoding algorithm for Construction D$^\prime$ lattices. Using their algorithm, we propose a Construction D$^\prime$ lattice based on binary quasi-cyclic low-density parity-check (QC-LPDC) codes and single parity-check product codes. The underlying codes designed by the balanced-distances rule contribute in a balanced manner t…
▽ More
Recently, Branco da Silva and Silva described an efficient encoding and decoding algorithm for Construction D$^\prime$ lattices. Using their algorithm, we propose a Construction D$^\prime$ lattice based on binary quasi-cyclic low-density parity-check (QC-LPDC) codes and single parity-check product codes. The underlying codes designed by the balanced-distances rule contribute in a balanced manner to the squared minimum distance of the constructed lattice, which results in a high lattice coding gain. The proposed lattice based on IEEE 802.16e QC-LDPC codes is shown to provide competitive error-rate performance on the power-unconstrained additive white Gaussian noise channel.
△ Less
Submitted 4 October, 2018;
originally announced October 2018.
-
Proceedings of Workshop AEW10: Concepts in Information Theory and Communications
Authors:
Kees A. Schouhamer Immink,
Stan Baggen,
Ferdaous Chaabane,
Yanling Chen,
Peter H. N. de With,
Hela Gassara,
Hamed Gharbi,
Adel Ghazel,
Khaled Grati,
Naira M. Grigoryan,
Ashot Harutyunyan,
Masayuki Imanishi,
Mitsugu Iwamoto,
Ken-ichi Iwata,
Hiroshi Kamabe,
Brian M. Kurkoski,
Shigeaki Kuzuoka,
Patrick Langenhuizen,
Jan Lewandowsky,
Akiko Manada,
Shigeki Miyake,
Hiroyoshi Morita,
Jun Muramatsu,
Safa Najjar,
Arnak V. Poghosyan
, et al. (9 additional authors not shown)
Abstract:
The 10th Asia-Europe workshop in "Concepts in Information Theory and Communications" AEW10 was held in Boppard, Germany on June 21-23, 2017. It is based on a longstanding cooperation between Asian and European scientists. The first workshop was held in Eindhoven, the Netherlands in 1989. The idea of the workshop is threefold: 1) to improve the communication between the scientist in the different p…
▽ More
The 10th Asia-Europe workshop in "Concepts in Information Theory and Communications" AEW10 was held in Boppard, Germany on June 21-23, 2017. It is based on a longstanding cooperation between Asian and European scientists. The first workshop was held in Eindhoven, the Netherlands in 1989. The idea of the workshop is threefold: 1) to improve the communication between the scientist in the different parts of the world; 2) to exchange knowledge and ideas; and 3) to pay a tribute to a well respected and special scientist.
△ Less
Submitted 27 July, 2017;
originally announced July 2017.
-
Low-Dimensional Sha** for High-Dimensional Lattice Codes
Authors:
Nuwan S. Ferdinand,
Brian M. Kurkoski,
Matthew Nokleby,
Behnaam Aazhang
Abstract:
We propose two low-complexity lattice code constructions that have competitive coding and sha** gains. The first construction, named systematic Voronoi sha**, maps short blocks of integers to the dithered Voronoi integers, which are dithered integers that are uniformly distributed over the Voronoi region of a low-dimensional sha** lattice. Then, these dithered Voronoi integers are encoded us…
▽ More
We propose two low-complexity lattice code constructions that have competitive coding and sha** gains. The first construction, named systematic Voronoi sha**, maps short blocks of integers to the dithered Voronoi integers, which are dithered integers that are uniformly distributed over the Voronoi region of a low-dimensional sha** lattice. Then, these dithered Voronoi integers are encoded using a high-dimensional lattice retaining the same sha** and coding gains of low and high-dimensional lattices. A drawback to this construction is that there is no isomorphism between the underlying message and the lattice code, preventing its use in applications such as compute-and- forward. Therefore we propose a second construction, called mixed nested lattice codes, in which a high-dimensional coding lattice is nested inside a concatenation of low-dimensional sha** lattices. This construction not only retains the same sha**/coding gains as first construction but also provides the desired algebraic structure. We numerically study these methods, for point-to-point channels as well as compute-and-forward using low-density lattice codes (LDLCs) as coding lattices and E8 and Barnes-Wall as sha** lattices. Numerical results indicate a sha** gain of up to 0.86 dB, compared to the state-of-the-art of 0.4 dB; furthermore, the proposed method has lower complexity than state-of-the-art approaches.
△ Less
Submitted 3 August, 2016;
originally announced August 2016.
-
Encoding and Indexing of Lattice Codes
Authors:
Brian M. Kurkoski
Abstract:
Encoding and indexing of lattice codes is generalized from self-similar lattice codes to a broader class of lattices. If coding lattice $Λ_{\textrm{c}}$ and sha** lattice $Λ_{\textrm{s}}$ satisfy $Λ_{\textrm{s}} \subseteq Λ_{\textrm{c}}$, then $Λ_{\textrm{c}} / Λ_{\textrm{s}}$ is a quotient group that can be used to form a (nested) lattice code $\mathcal{C}$. Conway and Sloane's method of encodi…
▽ More
Encoding and indexing of lattice codes is generalized from self-similar lattice codes to a broader class of lattices. If coding lattice $Λ_{\textrm{c}}$ and sha** lattice $Λ_{\textrm{s}}$ satisfy $Λ_{\textrm{s}} \subseteq Λ_{\textrm{c}}$, then $Λ_{\textrm{c}} / Λ_{\textrm{s}}$ is a quotient group that can be used to form a (nested) lattice code $\mathcal{C}$. Conway and Sloane's method of encoding and indexing does not apply when the lattices are not self-similar. Results are provided for two classes of lattices. (1) If $Λ_{\textrm{c}}$ and $Λ_{\textrm{s}}$ both have generator matrices in triangular form, then encoding is always possible. (2) When $Λ_{\textrm{c}}$ and $Λ_{\textrm{s}}$ are described by full generator matrices, if a solution to a linear diophantine equation exists, then encoding is possible. In addition, special cases where $\mathcal{C}$ is a cyclic code are also considered. A condition for the existence of a group homomorphism between the information and $\mathcal{C}$ is given. The results are applicable to a variety of coding lattices, including Construction A, Construction D and LDLCs. The $D_4$, $E_8$ and convolutional code lattices are shown to be good choices for the sha** lattice. Thus, a lattice code $\mathcal{C}$ can be designed by selecting $Λ_{\textrm{c}}$ and $Λ_{\textrm{s}}$ separately, avoiding competing design requirements of self-similar lattice codes.
△ Less
Submitted 12 July, 2016;
originally announced July 2016.
-
An Improved Analytical Expression for Write Amplification in NAND Flash
Authors:
Luojie Xiang,
Brian Kurkoski
Abstract:
Agarwal et al. gave an closed-form expression for write amplification in NAND flash memory by finding the probability of a page being valid over the whole flash memory. This paper gives an improved analytic expression for write amplification in NAND flash memory by finding the probability of a page being invalid over the block selected for garbage collection. The improved expression uses Lambert W…
▽ More
Agarwal et al. gave an closed-form expression for write amplification in NAND flash memory by finding the probability of a page being valid over the whole flash memory. This paper gives an improved analytic expression for write amplification in NAND flash memory by finding the probability of a page being invalid over the block selected for garbage collection. The improved expression uses Lambert W function. Through asymptotic analysis, write amplification is shown to depend on overprovisioning factor only, consistent with the previous work. Comparison with numerical simulations shows that the improved expression achieves a more accurate prediction of write amplification. For example, when the overprovisioning factor is 0.3, the expression proposed by this paper gives a write amplification of 2.36 whereas that of the previous work gives 2.17, when the actual value is 2.35.
△ Less
Submitted 19 October, 2011;
originally announced October 2011.
-
Quantization of Binary-Input Discrete Memoryless Channels
Authors:
Brian M. Kurkoski,
Hideki Yagi
Abstract:
The quantization of the output of a binary-input discrete memoryless channel to a smaller number of levels is considered. An algorithm which finds an optimal quantizer, in the sense of maximizing mutual information between the channel input and the quantizer output is given. This result holds for arbitrary channels, in contrast to previous results for restricted channels or a restricted number of…
▽ More
The quantization of the output of a binary-input discrete memoryless channel to a smaller number of levels is considered. An algorithm which finds an optimal quantizer, in the sense of maximizing mutual information between the channel input and the quantizer output is given. This result holds for arbitrary channels, in contrast to previous results for restricted channels or a restricted number of quantizer outputs. In the worst case, the algorithm complexity is cubic $M^3$ in the number of channel outputs $M$. Optimality is proved using the theorem of Burshtein, Della Pietra, Kanevsky, and Nádas for map**s which minimize average impurity for classification and regression trees.
△ Less
Submitted 15 May, 2014; v1 submitted 28 July, 2011;
originally announced July 2011.
-
Threshold Improvement of Low-Density Lattice Codes via Spatial Coupling
Authors:
Hironori Uchikawa,
Brian M. Kurkoski,
Kenta Kasai,
Kohichi Sakaniwa
Abstract:
Spatially-coupled low-density lattice codes (LDLC) are constructed using protographs. Using Monte Carlo density evolution using single-Gaussian messages, we observe that the threshold of the spatially-coupled LDLC is within 0.22 dB of capacity of the unconstrained power channel. This is in contrast with a 0.5 dB noise threshold for the conventional LDLC lattice construction.
Spatially-coupled low-density lattice codes (LDLC) are constructed using protographs. Using Monte Carlo density evolution using single-Gaussian messages, we observe that the threshold of the spatially-coupled LDLC is within 0.22 dB of capacity of the unconstrained power channel. This is in contrast with a 0.5 dB noise threshold for the conventional LDLC lattice construction.
△ Less
Submitted 25 July, 2011;
originally announced July 2011.
-
The E8 Lattice and Error Correction in Multi-Level Flash Memory
Authors:
Brian M. Kurkoski
Abstract:
A construction using the E8 lattice and Reed-Solomon codes for error-correction in flash memory is given. Since E8 lattice decoding errors are bursty, a Reed-Solomon code over GF($2^8$) is well suited. This is a type of coded modulation, where the Euclidean distance of the lattice, which is an eight-dimensional signal constellation, is combined with the Hamming distance of the code. This system is…
▽ More
A construction using the E8 lattice and Reed-Solomon codes for error-correction in flash memory is given. Since E8 lattice decoding errors are bursty, a Reed-Solomon code over GF($2^8$) is well suited. This is a type of coded modulation, where the Euclidean distance of the lattice, which is an eight-dimensional signal constellation, is combined with the Hamming distance of the code. This system is compared with the conventional technique for flash memories, BCH codes using Gray-coded PAM. The described construction has a performance advantage of 1.6 to 1.8 dB at a probability of word error of $10^{-6}$. Evaluation is at high data rates of 2.9 bits/cell for flash memory cells that have an uncoded data density of 3 bits/cell.
△ Less
Submitted 15 February, 2011; v1 submitted 28 September, 2010;
originally announced September 2010.
-
Rewritable Codes for Flash Memories Based Upon Lattices, and an Example Using the E8 Lattice
Authors:
Brian M. Kurkoski
Abstract:
A rewriting code construction for flash memories based upon lattices is described. The values stored in flash cells correspond to lattice points. This construction encodes information to lattice points in such a way that data can be written to the memory multiple times without decreasing the cell values. The construction partitions the flash memory's cubic signal space into blocks. The minimum num…
▽ More
A rewriting code construction for flash memories based upon lattices is described. The values stored in flash cells correspond to lattice points. This construction encodes information to lattice points in such a way that data can be written to the memory multiple times without decreasing the cell values. The construction partitions the flash memory's cubic signal space into blocks. The minimum number of writes is shown to be linear in one of the code parameters. An example using the E8 lattice is given, with numerical results.
△ Less
Submitted 12 July, 2010;
originally announced July 2010.
-
Belief-Propagation Decoding of Lattices Using Gaussian Mixtures
Authors:
Brian M. Kurkoski,
Justin Dauwels
Abstract:
A belief-propagation decoder for low-density lattice codes is given which represents messages explicitly as a mixture of Gaussians functions. The key component is an algorithm for approximating a mixture of several Gaussians with another mixture with a smaller number of Gaussians. This Gaussian mixture reduction algorithm iteratively reduces the number of Gaussians by minimizing the distance bet…
▽ More
A belief-propagation decoder for low-density lattice codes is given which represents messages explicitly as a mixture of Gaussians functions. The key component is an algorithm for approximating a mixture of several Gaussians with another mixture with a smaller number of Gaussians. This Gaussian mixture reduction algorithm iteratively reduces the number of Gaussians by minimizing the distance between the original mixture and an approximation with one fewer Gaussians.
Error rates and noise thresholds of this decoder are compared with those for the previously-proposed decoder which discretely quantizes the messages. The error rates are indistinguishable for dimension 1000 and 10000 lattices, and the Gaussian-mixture decoder has a 0.2 dB loss for dimension 100 lattices. The Gaussian-mixture decoder has a loss of about 0.03 dB in the noise threshold, which is evaluated via Monte Carlo density evolution. Further, the Gaussian-mixture decoder uses far less storage for the messages.
△ Less
Submitted 30 April, 2009;
originally announced April 2009.
-
Message-Passing Decoding of Lattices Using Gaussian Mixtures
Authors:
Brian M. Kurkoski,
Justin Dauwels
Abstract:
A lattice decoder which represents messages explicitly as a mixture of Gaussians functions is given. In order to prevent the number of functions in a mixture from growing as the decoder iterations progress, a method for replacing N Gaussian functions with M Gaussian functions, with M < N, is given. A squared distance metric is used to select functions for combining. A pair of selected Gaussians…
▽ More
A lattice decoder which represents messages explicitly as a mixture of Gaussians functions is given. In order to prevent the number of functions in a mixture from growing as the decoder iterations progress, a method for replacing N Gaussian functions with M Gaussian functions, with M < N, is given. A squared distance metric is used to select functions for combining. A pair of selected Gaussians is replaced by a single Gaussian with the same first and second moments. The metric can be computed efficiently, and at the same time, the proposed algorithm empirically gives good results, for example, a dimension 100 lattice has a loss of 0.2 dB in signal-to-noise ratio at a probability of symbol error of 10^{-5}.
△ Less
Submitted 5 February, 2008;
originally announced February 2008.
