-
Scalable Polar Code Construction for Successive Cancellation List Decoding: A Graph Neural Network-Based Approach
Authors:
Yun Liao,
Seyyed Ali Hashemi,
Hengjie Yang,
John M. Cioffi
Abstract:
While constructing polar codes for successive-cancellation decoding can be implemented efficiently by sorting the bit-channels, finding optimal polar codes for cyclic-redundancy-check-aided successive-cancellation list (CA-SCL) decoding in an efficient and scalable manner still awaits investigation. This paper first maps a polar code to a unique heterogeneous graph called the polar-code-constructi…
▽ More
While constructing polar codes for successive-cancellation decoding can be implemented efficiently by sorting the bit-channels, finding optimal polar codes for cyclic-redundancy-check-aided successive-cancellation list (CA-SCL) decoding in an efficient and scalable manner still awaits investigation. This paper first maps a polar code to a unique heterogeneous graph called the polar-code-construction message-passing (PCCMP) graph. Next, a heterogeneous graph-neural-network-based iterative message-passing (IMP) algorithm is proposed which aims to find a PCCMP graph that corresponds to the polar code with minimum frame error rate under CA-SCL decoding. This new IMP algorithm's major advantage lies in its scalability power. That is, the model complexity is independent of the blocklength and code rate, and a trained IMP model over a short polar code can be readily applied to a long polar code's construction. Numerical experiments show that IMP-based polar-code constructions outperform classical constructions under CA-SCL decoding. In addition, when an IMP model trained on a length-128 polar code directly applies to the construction of polar codes with different code rates and blocklengths, simulations show that these polar code constructions deliver comparable performance to the 5G polar codes.
△ Less
Submitted 13 May, 2023; v1 submitted 3 July, 2022;
originally announced July 2022.
-
Adaptive Read Thresholds for NAND Flash
Authors:
Borja Peleato,
Rajiv Agarwal,
John Cioffi,
Minghai Qin,
Paul H. Siegel
Abstract:
A primary source of increased read time on NAND flash comes from the fact that in the presence of noise, the flash medium must be read several times using different read threshold voltages for the decoder to succeed. This paper proposes an algorithm that uses a limited number of re-reads to characterize the noise distribution and recover the stored information. Both hard and soft decoding are cons…
▽ More
A primary source of increased read time on NAND flash comes from the fact that in the presence of noise, the flash medium must be read several times using different read threshold voltages for the decoder to succeed. This paper proposes an algorithm that uses a limited number of re-reads to characterize the noise distribution and recover the stored information. Both hard and soft decoding are considered. For hard decoding, the paper attempts to find a read threshold minimizing bit-error-rate (BER) and derives an expression for the resulting codeword-error-rate. For soft decoding, it shows that minimizing BER and minimizing codeword-error-rate are competing objectives in the presence of a limited number of allowed re-reads, and proposes a trade-off between the two.
The proposed method does not require any prior knowledge about the noise distribution, but can take advantage of such information when it is available. Each read threshold is chosen based on the results of previous reads, following an optimal policy derived through a dynamic programming backward recursion. The method and results are studied from the perspective of an SLC Flash memory with Gaussian noise for each level but the paper explains how the method could be extended to other scenarios.
△ Less
Submitted 11 February, 2022;
originally announced February 2022.
-
Successive Syndrome-Check Decoding of Polar Codes
Authors:
Seyyed Ali Hashemi,
Marco Mondelli,
John Cioffi,
Andrea Goldsmith
Abstract:
A two-part successive syndrome-check decoding of polar codes is proposed with the first part successively refining the received codeword and the second part checking its syndrome. A new formulation of the successive-cancellation (SC) decoding algorithm is presented that allows for successively refining the received codeword by comparing the log-likelihood ratio value of a frozen bit with its prede…
▽ More
A two-part successive syndrome-check decoding of polar codes is proposed with the first part successively refining the received codeword and the second part checking its syndrome. A new formulation of the successive-cancellation (SC) decoding algorithm is presented that allows for successively refining the received codeword by comparing the log-likelihood ratio value of a frozen bit with its predefined value. The syndrome of the refined received codeword is then checked for possible errors. In case there are no errors, the decoding process is terminated. Otherwise, the decoder continues to refine the received codeword. The proposed method is extended to the case of SC list (SCL) decoding by terminating the decoding process when the syndrome of the best candidate in the list indicates no errors. Simulation results show that the proposed method reduces the time-complexity of SC and SCL decoders and their fast variants, especially at high signal-to-noise ratios.
△ Less
Submitted 30 November, 2021;
originally announced December 2021.
-
A Tree Search Approach for Maximum-Likelihood Decoding of Reed-Muller Codes
Authors:
Seyyed Ali Hashemi,
Nghia Doan,
Warren J. Gross,
John Cioffi,
Andrea Goldsmith
Abstract:
A low-complexity tree search approach is presented that achieves the maximum-likelihood (ML) decoding performance of Reed-Muller (RM) codes. The proposed approach generates a bit-flip** tree that is traversed to find the ML decoding result by performing successive-cancellation decoding after each node visit. A depth-first search (DFS) and a breadth-first search (BFS) scheme are developed and a l…
▽ More
A low-complexity tree search approach is presented that achieves the maximum-likelihood (ML) decoding performance of Reed-Muller (RM) codes. The proposed approach generates a bit-flip** tree that is traversed to find the ML decoding result by performing successive-cancellation decoding after each node visit. A depth-first search (DFS) and a breadth-first search (BFS) scheme are developed and a log-likelihood-ratio-based bit-flip** metric is utilized to avoid redundant node visits in the tree. Several enhancements to the proposed algorithm are presented to further reduce the number of node visits. Simulation results confirm that the BFS scheme provides a lower average number of node visits than the existing tree search approach to decode RM codes.
△ Less
Submitted 19 July, 2021;
originally announced July 2021.
-
Parallelism versus Latency in Simplified Successive-Cancellation Decoding of Polar Codes
Authors:
Seyyed Ali Hashemi,
Marco Mondelli,
Arman Fazeli,
Alexander Vardy,
John Cioffi,
Andrea Goldsmith
Abstract:
This paper characterizes the latency of the simplified successive-cancellation (SSC) decoding scheme for polar codes under hardware resource constraints. In particular, when the number of processing elements $P$ that can perform SSC decoding operations in parallel is limited, as is the case in practice, the latency of SSC decoding is $O\left(N^{1-1/μ}+\frac{N}{P}\log_2\log_2\frac{N}{P}\right)$, wh…
▽ More
This paper characterizes the latency of the simplified successive-cancellation (SSC) decoding scheme for polar codes under hardware resource constraints. In particular, when the number of processing elements $P$ that can perform SSC decoding operations in parallel is limited, as is the case in practice, the latency of SSC decoding is $O\left(N^{1-1/μ}+\frac{N}{P}\log_2\log_2\frac{N}{P}\right)$, where $N$ is the block length of the code and $μ$ is the scaling exponent of the channel. Three direct consequences of this bound are presented. First, in a fully-parallel implementation where $P=\frac{N}{2}$, the latency of SSC decoding is $O\left(N^{1-1/μ}\right)$, which is sublinear in the block length. This recovers a result from our earlier work. Second, in a fully-serial implementation where $P=1$, the latency of SSC decoding scales as $O\left(N\log_2\log_2 N\right)$. The multiplicative constant is also calculated: we show that the latency of SSC decoding when $P=1$ is given by $\left(2+o(1)\right) N\log_2\log_2 N$. Third, in a semi-parallel implementation, the smallest $P$ that gives the same latency as that of the fully-parallel implementation is $P=N^{1/μ}$. The tightness of our bound on SSC decoding latency and the applicability of the foregoing results is validated through extensive simulations.
△ Less
Submitted 24 December, 2020;
originally announced December 2020.
-
Construction of Polar Codes with Reinforcement Learning
Authors:
Yun Liao,
Seyyed Ali Hashemi,
John Cioffi,
Andrea Goldsmith
Abstract:
This paper formulates the polar-code construction problem for the successive-cancellation list (SCL) decoder as a maze-traversing game, which can be solved by reinforcement learning techniques. The proposed method provides a novel technique for polar-code construction that no longer depends on sorting and selecting bit-channels by reliability. Instead, this technique decides whether the input bits…
▽ More
This paper formulates the polar-code construction problem for the successive-cancellation list (SCL) decoder as a maze-traversing game, which can be solved by reinforcement learning techniques. The proposed method provides a novel technique for polar-code construction that no longer depends on sorting and selecting bit-channels by reliability. Instead, this technique decides whether the input bits should be frozen in a purely sequential manner. The equivalence of optimizing the polar-code construction for the SCL decoder under this technique and maximizing the expected reward of traversing a maze is drawn. Simulation results show that the standard polar-code constructions that are designed for the successive-cancellation decoder are no longer optimal for the SCL decoder with respect to the frame error rate. In contrast, the simulations show that, with a reasonable amount of training, the game-based construction method finds code constructions that have lower frame-error rate for various code lengths and decoders compared to standard constructions.
△ Less
Submitted 19 September, 2020;
originally announced September 2020.
-
Threshold-Based Fast Successive-Cancellation Decoding of Polar Codes
Authors:
Haotian Zheng,
Seyyed Ali Hashemi,
Alexios Balatsoukas-Stimming,
Zizheng Cao,
Ton Koonen,
John Cioffi,
Andrea Goldsmith
Abstract:
Fast SC decoding overcomes the latency caused by the serial nature of the SC decoding by identifying new nodes in the upper levels of the SC decoding tree and implementing their fast parallel decoders. In this work, we first present a novel sequence repetition node corresponding to a particular class of bit sequences. Most existing special node types are special cases of the proposed sequence repe…
▽ More
Fast SC decoding overcomes the latency caused by the serial nature of the SC decoding by identifying new nodes in the upper levels of the SC decoding tree and implementing their fast parallel decoders. In this work, we first present a novel sequence repetition node corresponding to a particular class of bit sequences. Most existing special node types are special cases of the proposed sequence repetition node. Then, a fast parallel decoder is proposed for this class of node. To further speed up the decoding process of general nodes outside this class, a threshold-based hard-decision-aided scheme is introduced. The threshold value that guarantees a given error-correction performance in the proposed scheme is derived theoretically. Analysis and hardware implementation results on a polar code of length $1024$ with code rates $1/4$, $1/2$, and $3/4$ show that our proposed algorithm reduces the required clock cycles by up to $8\%$, and leads to a $10\%$ improvement in the maximum operating frequency compared to state-of-the-art decoders without tangibly altering the error-correction performance. In addition, using the proposed threshold-based hard-decision-aided scheme, the decoding latency can be further reduced by $57\%$ at $\mathrm{E_b}/\mathrm{N_0} = 5.0$~dB.
△ Less
Submitted 27 November, 2020; v1 submitted 9 May, 2020;
originally announced May 2020.
-
Sublinear Latency for Simplified Successive Cancellation Decoding of Polar Codes
Authors:
Marco Mondelli,
Seyyed Ali Hashemi,
John Cioffi,
Andrea Goldsmith
Abstract:
This work analyzes the latency of the simplified successive cancellation (SSC) decoding scheme for polar codes proposed by Alamdar-Yazdi and Kschischang. It is shown that, unlike conventional successive cancellation decoding, where latency is linear in the block length, the latency of SSC decoding is sublinear. More specifically, the latency of SSC decoding is $O(N^{1-1/μ})$, where $N$ is the bloc…
▽ More
This work analyzes the latency of the simplified successive cancellation (SSC) decoding scheme for polar codes proposed by Alamdar-Yazdi and Kschischang. It is shown that, unlike conventional successive cancellation decoding, where latency is linear in the block length, the latency of SSC decoding is sublinear. More specifically, the latency of SSC decoding is $O(N^{1-1/μ})$, where $N$ is the block length and $μ$ is the scaling exponent of the channel, which captures the speed of convergence of the rate to capacity. Numerical results demonstrate the tightness of the bound and show that most of the latency reduction arises from the parallel decoding of subcodes of rate $0$ or $1$.
△ Less
Submitted 5 September, 2020; v1 submitted 11 September, 2019;
originally announced September 2019.
-
Energy-Efficient Caching for Scalable Videos in Heterogeneous Networks
Authors:
Xuewei Zhang,
Tiejun Lv,
Wei Ni,
John M. Cioffi,
Norman C. Beaulieu,
Y. Jay Guo
Abstract:
By suppressing repeated content deliveries, wireless caching has the potential to substantially improve the energy efficiency (EE) of the fifth generation (5G) communication networks. In this paper, we propose two novel energy-efficient caching schemes in heterogeneous networks, namely, scalable video coding (SVC)-based fractional caching and SVC-based random caching, which can provide on-demand v…
▽ More
By suppressing repeated content deliveries, wireless caching has the potential to substantially improve the energy efficiency (EE) of the fifth generation (5G) communication networks. In this paper, we propose two novel energy-efficient caching schemes in heterogeneous networks, namely, scalable video coding (SVC)-based fractional caching and SVC-based random caching, which can provide on-demand video services with different perceptual qualities. We derive the expressions for successful transmission probabilities and ergodic service rates. Based on the derivations and the established power consumption models, the EE maximization problems are formulated for the two proposed caching schemes. By taking logarithmic approximations of the l0-norm, the problems are efficiently solved by the standard gradient projection method. Numerical results validate the theoretical analysis and demonstrate the superiority of our proposed caching schemes, compared to three benchmark strategies.
△ Less
Submitted 30 May, 2018;
originally announced May 2018.
-
Random Deployment of Data Collectors for Serving Randomly-Located Sensors
Authors:
Taesoo Kwon,
John. M. Cioffi
Abstract:
Recently, wireless communication industries have begun to extend their services to machine-type communication devices as well as to user equipments. Such machine-type communication devices as meters and sensors need intermittent uplink resources to report measured or sensed data to their serving data collector. It is however hard to dedicate limited uplink resources to each of them. Thus, efficien…
▽ More
Recently, wireless communication industries have begun to extend their services to machine-type communication devices as well as to user equipments. Such machine-type communication devices as meters and sensors need intermittent uplink resources to report measured or sensed data to their serving data collector. It is however hard to dedicate limited uplink resources to each of them. Thus, efficient service of a tremendous number of devices with low activities may consider simple random access as a solution. The data collectors receiving the measured data from many sensors simultaneously can successfully decode only signals with signal-to-interference-plus-noise-ratio (SINR) above a certain value. The main design issues for this environment become how many data collectors are needed, how much power sensor nodes transmit with, and how wireless channels affect the performance. This paper provides answers to those questions through a stochastic analysis based on a spatial point process and on simulations.
△ Less
Submitted 23 June, 2011; v1 submitted 4 June, 2011;
originally announced June 2011.
-
Crystallized Rates Region of the Interference Channel via Correlated Equilibrium with Interference as Noise
Authors:
Mohamad Charafeddine,
Zhu Han,
Arogyaswami Paulraj,
John Cioffi
Abstract:
Treating the interference as noise in the n-user interference channel, the paper describes a novel approach to the rates region, composed by the time-sharing convex hull of 2^n-1 corner points achieved through On/Off binary power control. The resulting rates region is denoted crystallized rates region. By treating the interference as noise, the n-user rates region frontiers has been found in the l…
▽ More
Treating the interference as noise in the n-user interference channel, the paper describes a novel approach to the rates region, composed by the time-sharing convex hull of 2^n-1 corner points achieved through On/Off binary power control. The resulting rates region is denoted crystallized rates region. By treating the interference as noise, the n-user rates region frontiers has been found in the literature to be the convex hull of n hyper-surfaces. The rates region bounded by these hyper-surfaces is not necessarily convex, and thereby a convex hull operation is imposed through the strategy of time-sharing. This paper simplifies this rates region in the n-dimensional space by having only an On/Off binary power control. This consequently leads to 2^n-1 corner points situated within the rates region. A time-sharing convex hull is imposed onto those corner points, forming the crystallized rates region. The paper focuses on game theoretic concepts to achieve that crystallized convex hull via correlated equilibrium. In game theory, the correlated equilibrium set is convex, and it consists of the time-sharing mixed strategies of the Nash equilibriums. In addition, the paper considers a mechanism design approach to carefully design a utility function, particularly the Vickrey-Clarke-Groves auction utility, where the solution point is situated on the correlated equilibrium set. Finally, the paper proposes a self learning algorithm, namely the regret-matching algorithm, that converges to the solution point on the correlated equilibrium set in a distributed fashion.
△ Less
Submitted 21 August, 2010;
originally announced August 2010.
-
On the Generality of $1+\mathbf{i}$ as a Non-Norm Element
Authors:
Hua-Chieh Li,
Ming-Yang Chen,
John M. Cioffi
Abstract:
Full-rate space-time block codes with nonvanishing determinants have been extensively designed with cyclic division algebras. For these designs, smaller pairwise error probabilities of maximum likelihood detections require larger normalized diversity products, which can be obtained by choosing integer non-norm elements with smaller absolute values. All known methods have constructed $1+\bi$ and…
▽ More
Full-rate space-time block codes with nonvanishing determinants have been extensively designed with cyclic division algebras. For these designs, smaller pairwise error probabilities of maximum likelihood detections require larger normalized diversity products, which can be obtained by choosing integer non-norm elements with smaller absolute values. All known methods have constructed $1+\bi$ and $2+\bi$ to be integer non-norm elements with the smallest absolute values over QAM for the number of transmit antennas $n$: $\{n:5\leq n\leq 40,8\nmid n\}$ and $\{n:5\leq n\leq 40,8\mid n\}$, respectively. Via explicit constructions, this paper proves that $1+\bi$ is an integer non-norm element with the smallest absolute value over QAM for every $n\geq 5$.
△ Less
Submitted 23 February, 2010; v1 submitted 1 February, 2010;
originally announced February 2010.
-
Exploiting Opportunistic Multiuser Detection in Decentralized Multiuser MIMO Systems
Authors:
Rui Zhang,
John M. Cioffi
Abstract:
This paper studies the design of a decentralized multiuser multi-antenna (MIMO) system for spectrum sharing over a fixed narrow band, where the coexisting users independently update their transmit covariance matrices for individual transmit-rate maximization via an iterative manner. This design problem was usually investigated in the literature by assuming that each user treats the co-channel in…
▽ More
This paper studies the design of a decentralized multiuser multi-antenna (MIMO) system for spectrum sharing over a fixed narrow band, where the coexisting users independently update their transmit covariance matrices for individual transmit-rate maximization via an iterative manner. This design problem was usually investigated in the literature by assuming that each user treats the co-channel interference from all the other users as additional (colored) noise at the receiver, i.e., the conventional single-user decoder (SUD) is applied. This paper proposes a new decoding method for the decentralized multiuser MIMO system, whereby each user opportunistically cancels the co-channel interference from some or all of the other users via applying multiuser detection techniques, thus termed opportunistic multiuser detection (OMD). This paper studies the optimal transmit covariance design for users' iterative maximization of individual transmit rates with the proposed OMD, and demonstrates the resulting capacity gains in decentralized multiuser MIMO systems against the conventional SUD.
△ Less
Submitted 21 May, 2009;
originally announced May 2009.
-
Iterative Spectrum Sha** with Opportunistic Multiuser Detection
Authors:
Rui Zhang,
John Cioffi
Abstract:
This paper studies a new decentralized resource allocation strategy, named iterative spectrum sha** (ISS), for the multi-carrier-based multiuser communication system, where two coexisting users independently and sequentially update transmit power allocations over parallel subcarriers to maximize their individual transmit rates. Unlike the conventional iterative water-filling (IWF) algorithm th…
▽ More
This paper studies a new decentralized resource allocation strategy, named iterative spectrum sha** (ISS), for the multi-carrier-based multiuser communication system, where two coexisting users independently and sequentially update transmit power allocations over parallel subcarriers to maximize their individual transmit rates. Unlike the conventional iterative water-filling (IWF) algorithm that applies the single-user detection (SD) at each user's receiver by treating the interference from the other user as additional noise, the proposed ISS algorithm applies multiuser detection techniques to decode both the desired user's and interference user's messages if it is feasible, thus termed as opportunistic multiuser detection (OMD). Two encoding methods are considered for ISS: One is carrier independent encoding where independent codewords are modulated by different subcarriers for which different decoding methods can be applied; the other is carrier joint encoding where a single codeword is modulated by all the subcarriers for which a single decoder is applied. For each encoding method, this paper presents the associated optimal user power and rate allocation strategy at each iteration of transmit adaptation. It is shown that under many circumstances the proposed ISS algorithm employing OMD is able to achieve substantial throughput gains over the conventional IWF algorithm employing SD for decentralized spectrum sharing. Applications of ISS in cognitive radio communication systems are also discussed.
△ Less
Submitted 15 January, 2009;
originally announced January 2009.
-
On the Capacity of Gaussian Relay Channels
Authors:
Shao-Lun Huang,
Ming-Yang Chen,
Kwang-Cheng Chen,
John M. Cioffi
Abstract:
This paper has been withdrawn due to that the same conclusion has been proposed before.
This paper has been withdrawn due to that the same conclusion has been proposed before.
△ Less
Submitted 10 June, 2008; v1 submitted 5 June, 2008;
originally announced June 2008.
-
On Multiuser Power Region of Fading Multiple-Access Channel with Multiple Antennas
Authors:
Rui Zhang,
Mehdi Mohseni,
John M. Cioffi
Abstract:
This paper is concerned with the fading MIMO-MAC with multiple receive antennas at the base station (BS) and multiple transmit antennas at each mobile terminal (MT). Two multiple-access techniques are considered for scheduling transmissions from each MT to the BS at the same frequency, which are space-division multiple-access (SDMA) and time-division multiple-access (TDMA). For SDMA, all MTs tra…
▽ More
This paper is concerned with the fading MIMO-MAC with multiple receive antennas at the base station (BS) and multiple transmit antennas at each mobile terminal (MT). Two multiple-access techniques are considered for scheduling transmissions from each MT to the BS at the same frequency, which are space-division multiple-access (SDMA) and time-division multiple-access (TDMA). For SDMA, all MTs transmit simultaneously to the BS and their individual signals are resolved at the BS via multiple receive antennas while for TDMA, each MT transmits independently to the BS during mutually orthogonal time slots. It is assumed that the channel-state information (CSI) of the fading channel from each MT to the BS is unknown at each MT transmitter, but is perfectly known at the BS receiver. Thereby, the BS can acquire the long-term channel-distribution information (CDI) for each MT. This paper extends the well-known transmit-covariance feedback scheme for the point-to-point fading MIMO channel to the fading MIMO-MAC, whereby the BS jointly optimizes the transmit signal covariance matrices for all MTs based on their CDI, and then sends each transmit covariance matrix back to the corresponding MT via a feedback channel. The main goal of this paper is to characterize the so-called multiuser power region under the multiuser transmit-covariance feedback scheme for both SDMA and TDMA. The power region is defined as the constitution of all user transmit power-tuples that can achieve reliable transmissions for a given set of user target rates. Simulation results show that SDMA can achieve substantial power savings over TDMA for the fading MIMO-MAC. Moreover, this paper demonstrates the usefulness of the multiuser power region for maintaining proportionally-fair power consumption among the MTs.
△ Less
Submitted 21 April, 2008;
originally announced April 2008.
