-
Coded Computing for Fault-Tolerant Parallel QR Decomposition
Authors:
Quang Minh Nguyen,
Iain Weissburg,
Haewon Jeong
Abstract:
QR decomposition is an essential operation for solving linear equations and obtaining least-squares solutions. In high-performance computing systems, large-scale parallel QR decomposition often faces node faults. We address this issue by proposing a fault-tolerant algorithm that incorporates `coded computing' into the parallel Gram-Schmidt method, commonly used for QR decomposition. Coded computin…
▽ More
QR decomposition is an essential operation for solving linear equations and obtaining least-squares solutions. In high-performance computing systems, large-scale parallel QR decomposition often faces node faults. We address this issue by proposing a fault-tolerant algorithm that incorporates `coded computing' into the parallel Gram-Schmidt method, commonly used for QR decomposition. Coded computing introduces error-correcting codes into computational processes to enhance resilience against intermediate failures. While traditional coding strategies cannot preserve the orthogonality of $Q$, recent work has proven a post-orthogonalization condition that allows low-cost restoration of the degraded orthogonality. In this paper, we construct a checksum-generator matrix for multiple-node failures that satisfies the post-orthogonalization condition and prove that our code satisfies the maximum-distance separable (MDS) property with high probability. Furthermore, we consider in-node checksum storage setting where checksums are stored in original nodes. We obtain the minimal number of checksums required to be resilient to any $f$ failures under the in-node checksum storage, and also propose an in-node systematic MDS coding strategy that achieves the lower bound. Extensive experiments validate our theories and showcase the negligible overhead of our coded computing framework for fault-tolerant QR decomposition.
△ Less
Submitted 20 November, 2023;
originally announced November 2023.
-
Learning to Schedule in Non-Stationary Wireless Networks With Unknown Statistics
Authors:
Quang Minh Nguyen,
Eytan Modiano
Abstract:
The emergence of large-scale wireless networks with partially-observable and time-varying dynamics has imposed new challenges on the design of optimal control policies. This paper studies efficient scheduling algorithms for wireless networks subject to generalized interference constraint, where mean arrival and mean service rates are unknown and non-stationary. This model exemplifies realistic edg…
▽ More
The emergence of large-scale wireless networks with partially-observable and time-varying dynamics has imposed new challenges on the design of optimal control policies. This paper studies efficient scheduling algorithms for wireless networks subject to generalized interference constraint, where mean arrival and mean service rates are unknown and non-stationary. This model exemplifies realistic edge devices' characteristics of wireless communication in modern networks. We propose a novel algorithm termed MW-UCB for generalized wireless network scheduling, which is based on the Max-Weight policy and leverages the Sliding-Window Upper-Confidence Bound to learn the channels' statistics under non-stationarity. MW-UCB is provably throughput-optimal under mild assumptions on the variability of mean service rates. Specifically, as long as the total variation in mean service rates over any time period grows sub-linearly in time, we show that MW-UCB can achieve the stability region arbitrarily close to the stability region of the class of policies with full knowledge of the channel statistics. Extensive simulations validate our theoretical results and demonstrate the favorable performance of MW-UCB.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Reconfigurable-Metasurface-Aided Multi-State Generalized Polarization-Space Modulation for Next-Generation Wireless Communications
Authors:
John A. Hodge,
Kumar Vijay Mishra,
Quang M. Nguyen,
Amir. I. Zaghloul
Abstract:
We propose a low-cost reconfigurable metasurface transmitter to implement generalized polarization-space modulation (GPSM) that has been proposed for next-generation wireless communications. Unlike conventional multiple-input multiple-output GPSM, our electromagnetically-compliant, reduced form-factor design using Barium-Strontium-Titanate film yields more than two polarization states. Full-wave s…
▽ More
We propose a low-cost reconfigurable metasurface transmitter to implement generalized polarization-space modulation (GPSM) that has been proposed for next-generation wireless communications. Unlike conventional multiple-input multiple-output GPSM, our electromagnetically-compliant, reduced form-factor design using Barium-Strontium-Titanate film yields more than two polarization states. Full-wave simulations show our optimized design achieves 0.08-0.95 polarization conversion ratio with 5% bandwidth at 28 GHz and bit error rates comparable or better than conventional systems.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
VAIS ASR: Building a conversational speech recognition system using language model combination
Authors:
Quang Minh Nguyen,
Thai Binh Nguyen,
Ngoc Phuong Pham,
The Loc Nguyen
Abstract:
Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from situation where the speaking style is conversation and in noisy environments. It is not straight-forward to tackle such problems due to difficulties in data col…
▽ More
Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from situation where the speaking style is conversation and in noisy environments. It is not straight-forward to tackle such problems due to difficulties in data collection for both speech and text. In this paper, we attempt to mitigate the problems using language models combination techniques that allows us to utilize both large amount of writing style text and small number of conversation text data. Evaluation on the VLSP 2019 ASR challenges showed that our system achieved 4.85% WER on the VLSP 2018 and 15.09% WER on the VLSP 2019 data sets.
△ Less
Submitted 12 October, 2019;
originally announced October 2019.
