Showing 1–6 of 6 results for author: Kurkoski, B

Algebra of L-banded Matrices

Authors: Shunqi Huang, Lei Liu, Brian M. Kurkoski

Abstract: Convergence is a crucial issue in iterative algorithms. Dam** is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of dam** are scalar-wise, and either heuristic or empirical. Recently, an analytically optimized vector dam** was proposed for memory message-passing (iterative) algorithms. As a result, it yields a special class of covariance matrices ca… ▽ More Convergence is a crucial issue in iterative algorithms. Dam** is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of dam** are scalar-wise, and either heuristic or empirical. Recently, an analytically optimized vector dam** was proposed for memory message-passing (iterative) algorithms. As a result, it yields a special class of covariance matrices called L-banded matrices. In this paper, we show these matrices have broad algebraic properties arising from their L-banded structure. In particular, compact analytic expressions for the LDL decomposition, the Cholesky decomposition, the determinant after a column substitution, minors, and cofactors are derived. Furthermore, necessary and sufficient conditions for an L-banded matrix to be definite, a recurrence to obtain the characteristic polynomial, and some other properties are given. In addition, we give new derivations of the determinant and the inverse. (It's crucial to emphasize that some works have independently studied matrices with this special structure, named as L-matrices. Specifically, L-banded matrices are regarded as L-matrices with real and finite entries.) △ Less

Submitted 15 November, 2023; v1 submitted 20 December, 2022; originally announced December 2022.

Sufficient Statistic Memory Approximate Message Passing

Authors: Lei Liu, Shunqi Huang, Brian M. Kurkoski

Abstract: Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. However, state evolution does not necessarily guarantee the convergence of iterative algorithms. To solve the convergence problem of AMP-type algori… ▽ More Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. However, state evolution does not necessarily guarantee the convergence of iterative algorithms. To solve the convergence problem of AMP-type algorithms in principle, this paper proposes a memory AMP (MAMP) under a sufficient statistic condition, named sufficient statistic MAMP (SS-MAMP). We show that the covariance matrices of SS-MAMP are L-banded and convergent. Given an arbitrary MAMP, we can construct the SS-MAMP by dam**, which not only ensures the convergence, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Comments: Accepted by the 2022 IEEE International Symposium on Information Theory (ISIT). arXiv admin note: substantial text overlap with arXiv:2112.15327

Sufficient-Statistic Memory AMP

Authors: Lei Liu, Shunqi Huang, YuZhi Yang, Zhaoyang Zhang, Brian M. Kurkoski

Abstract: Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-t… ▽ More Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-type algorithms in principle, this paper proposes a sufficient-statistic memory AMP (SS-MAMP) algorithm framework under the conditions of right-unitarily invariant sensing matrices, Lipschitz-continuous local processors and the sufficient-statistic constraint (i.e., the current message of each local processor is a sufficient statistic of the signal vector given the current and all preceding messages). We show that the covariance matrices of SS-MAMP are L-banded and convergent, which is an optimal framework (from the local MMSE/LMMSE perspective) for AMP-type algorithms given the Lipschitz-continuous local processors. Given an arbitrary MAMP, we can construct an SS-MAMP by dam**, which not only ensures the convergence of the state evolution, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution. As a byproduct, we prove that the Bayes-optimal orthogonal/vector AMP (BO-OAMP/VAMP) is an SS-MAMP. As an example, we construct a sufficient-statistic Bayes-optimal MAMP (SS-BO-MAMP) whose state evolution converges to the minimum (i.e., Bayes-optimal) mean square error (MSE) predicted by replica methods when it has a unique fixed point. In addition, the MSE of SS-BO-MAMP is not worse than the original BO-MAMP. Finally, simulations are provided to support the theoretical results. △ Less

Submitted 29 June, 2023; v1 submitted 31 December, 2021; originally announced December 2021.

Comments: Double-column, 21 pages, submitted to IEEE Transactions on Information Theory

Memory Approximate Message Passing

Authors: Lei Liu, Shunqi Huang, Brian M. Kurkoski

Abstract: Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OA… ▽ More Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP requires high-complexity linear minimum mean square error estimator. To solve the disadvantages of AMP and OAMP/VAMP, this paper proposes a memory AMP (MAMP), in which a long-memory matched filter is proposed for interference suppression. The complexity of MAMP is comparable to AMP. The asymptotic Gaussianity of estimation errors in MAMP is guaranteed by the orthogonality principle. A state evolution is derived to asymptotically characterize the performance of MAMP. Based on the state evolution, the relaxation parameters and dam** vector in MAMP are optimized. For all right-unitarily-invariant matrices, the optimized MAMP converges to OAMP/VAMP, and thus is Bayes-optimal if it has a unique fixed point. Finally, simulations are provided to verify the validity and accuracy of the theoretical results. △ Less

Submitted 3 June, 2021; originally announced June 2021.

Comments: 6 pages, 5 figures, accepted by IEEE ISIT 2021. arXiv admin note: substantial text overlap with arXiv:2012.10861

Memory AMP

Authors: Lei Liu, Shunqi Huang, Brian M. Kurkoski

Abstract: Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable (e.g., perform poorly or even diverge) for other matrix ensembles, especially for ill-conditioned ones. To solve this issue, o… ▽ More Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable (e.g., perform poorly or even diverge) for other matrix ensembles, especially for ill-conditioned ones. To solve this issue, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP (BO-OAMP/VAMP) requires a high-complexity linear minimum mean square error (MMSE) estimator. This prevents OAMP/VAMP from being used in large-scale systems. To address the drawbacks of AMP and BO-OAMP/VAMP, this paper offers a memory AMP (MAMP) framework based on the orthogonality principle, which ensures that estimation errors in MAMP are asymptotically IID Gaussian. To realize the required orthogonality for MAMP, we provide an orthogonalization procedure for the local memory estimators. In addition, we propose a Bayes-optimal MAMP (BO-MAMP), in which a long-memory matched filter is used for interference suppression. The complexity of BO-MAMP is comparable to AMP. To asymptotically characterize the performance of BO-MAMP, a state evolution is derived. The relaxation parameters and dam** vector in BO-MAMP are optimized based on state evolution. Most crucially, the state evolution of the optimized BO-MAMP converges to the same fixed point as that of the high-complexity BO-OAMP/VAMP for all right-unitarily-invariant matrices, and achieves the Bayes optimal MSE predicted by the replica method if its state evolution has a unique fixed point. Finally, simulations are provided to verify the theoretical results' validity and accuracy. △ Less

Submitted 22 June, 2022; v1 submitted 20 December, 2020; originally announced December 2020.

Comments: Accepted by IEEE Trans. on Information Theory. [Memory AMP inherits the strengths of AMP and OAMP/VAMP such as low complexity, Bayes optimality and applicability to unitarily-inavariant matrices while avoiding the weakness of AMP (e.g. limited to IID matrices), OAMP/VAMP (e.g. needs high-complexity LMMSE) and CAMP (e.g., Fails to converge in high condition numbers).]

GuardRider: Towards Sustainable Backscattering System over WiFi in the Wild

Authors: Xin He, Weiwei Jiang, Meng Cheng, Xiaobo Zhou, Peng-Jun Wan, Panlong Yang, Brian Kurkoski

Abstract: The WiFi backscatter communications offer ultra-low power and ubiquitous connections for IoT systems. Caused by the intermittent-nature of the WiFi traffics, state-of-the-art WiFi backscatter communications are not reliable for backscatter link or simple for tag to do adaptive transmission. In order to build sustainable (reliable and simple) WiFi backscatter communications, we present GuardRider,… ▽ More The WiFi backscatter communications offer ultra-low power and ubiquitous connections for IoT systems. Caused by the intermittent-nature of the WiFi traffics, state-of-the-art WiFi backscatter communications are not reliable for backscatter link or simple for tag to do adaptive transmission. In order to build sustainable (reliable and simple) WiFi backscatter communications, we present GuardRider, a WiFi backscatter system that enables backscatter communications riding on WiFi signals in the wild. The key contribution of GuardRider is an optimization algorithm of designing RS codes to follow the statistical knowledge of WiFi traffics and adjust backscatter transmission. With GuardRider, the reliable baskscatter link is guaranteed and a backscatter tag is able to adaptively transmit information without heavily listening the excitation channel. We built a hardware prototype of GuardRider using a customized tag with FPGA implementation. Both the simulations and field experiments verify that GuardRider could achieve a notably gains in bit error rate and frame error rate, which are hundredfold reduction in simulations and around 99% in filed experiments. △ Less

Submitted 12 December, 2019; originally announced December 2019.