-
Cellular LTE and Solar Energy Harvesting for Long-Term, Reliable Urban Sensor Networks: Challenges and Opportunities
Authors:
Alex Cabral,
Vaishnavi Ranganathan,
Jim Waldo
Abstract:
In a world driven by data, cities are increasingly interested in deploying networks of smart city devices for urban and environmental monitoring. To be successful, these networks must be reliable, scalable, real-time, low-cost, and easy to install and maintain -- criteria that are all significantly affected by the design choices around connectivity and power. LTE networks and solar energy can seem…
▽ More
In a world driven by data, cities are increasingly interested in deploying networks of smart city devices for urban and environmental monitoring. To be successful, these networks must be reliable, scalable, real-time, low-cost, and easy to install and maintain -- criteria that are all significantly affected by the design choices around connectivity and power. LTE networks and solar energy can seemingly both satisfy the necessary criteria and are often used in real-world sensor network deployments. However, there have not been extensive real-world studies to examine how well such networks perform and the challenges they encounter in urban settings over long periods. In this work, we analyze the performance of a stationary 118-node LTE-connected, solar-powered sensor network over one year in Chicago. Results show the promise of LTE networks and solar panels for city-wide IoT deployments, but also reveal areas for improvement. Notably, we find 11 sites with inadequate RSS to support sensing nodes and over 33,000 hours of data loss due to solar energy availability issues between October and March. Furthermore, we discover that the neighborhoods most affected by connectivity and charging issues are socioeconomically disadvantaged areas with a majority Black and Latine residents. This work presents observations from a networking and powering perspective of the urban sensor network to help drive reliable, scalable future smart city deployments. The work also analyzes the impact of land use, adaptive energy harvesting management strategies, and shortcomings of open data, to support the need for increased real-world deployments that ensure the design of equitable smart city networks.
△ Less
Submitted 8 July, 2023;
originally announced July 2023.
-
Towards a Cost vs. Quality Sweet Spot for Monitoring Networks
Authors:
Nofel Yaseen,
Behnaz Arzani,
Krishna Chintalapudi,
Vaishnavi Ranganathan,
Felipe Frujeri,
Kevin Hsieh,
Daniel Berger,
Vincent Liu,
Srikanth Kandula
Abstract:
Continuously monitoring a wide variety of performance and fault metrics has become a crucial part of operating large-scale datacenter networks. In this work, we ask whether we can reduce the costs to monitor -- in terms of collection, storage and analysis -- by judiciously controlling how much and which measurements we collect. By positing that we can treat almost all measured signals as sampled t…
▽ More
Continuously monitoring a wide variety of performance and fault metrics has become a crucial part of operating large-scale datacenter networks. In this work, we ask whether we can reduce the costs to monitor -- in terms of collection, storage and analysis -- by judiciously controlling how much and which measurements we collect. By positing that we can treat almost all measured signals as sampled time-series, we show that we can use signal processing techniques such as the Nyquist-Shannon theorem to avoid wasteful data collection. We show that large savings appear possible by analyzing tens of popular measurements from a production datacenter network. We also discuss the technical challenges that must be solved when applying these techniques in practice.
△ Less
Submitted 11 October, 2021;
originally announced October 2021.
-
ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks
Authors:
Varun Ranganathan,
Alex Lewandowski
Abstract:
Gradient descent and backpropagation have enabled neural networks to achieve remarkable results in many real-world applications. Despite ongoing success, training a neural network with gradient descent can be a slow and strenuous affair. We present a simple yet faster training algorithm called Zeroth-Order Relaxed Backpropagation (ZORB). Instead of calculating gradients, ZORB uses the pseudoinvers…
▽ More
Gradient descent and backpropagation have enabled neural networks to achieve remarkable results in many real-world applications. Despite ongoing success, training a neural network with gradient descent can be a slow and strenuous affair. We present a simple yet faster training algorithm called Zeroth-Order Relaxed Backpropagation (ZORB). Instead of calculating gradients, ZORB uses the pseudoinverse of targets to backpropagate information. ZORB is designed to reduce the time required to train deep neural networks without penalizing performance. To illustrate the speed up, we trained a feed-forward neural network with 11 layers on MNIST and observed that ZORB converged 300 times faster than Adam while achieving a comparable error rate, without any hyperparameter tuning. We also broaden the scope of ZORB to convolutional neural networks, and apply it to subsamples of the CIFAR-10 dataset. Experiments on standard classification and regression benchmarks demonstrate ZORB's advantage over traditional backpropagation with Gradient Descent.
△ Less
Submitted 17 November, 2020;
originally announced November 2020.
-
A New Backpropagation Algorithm without Gradient Descent
Authors:
Varun Ranganathan,
S. Natarajan
Abstract:
The backpropagation algorithm, which had been originally introduced in the 1970s, is the workhorse of learning in neural networks. This backpropagation algorithm makes use of the famous machine learning algorithm known as Gradient Descent, which is a first-order iterative optimization algorithm for finding the minimum of a function. To find a local minimum of a function using gradient descent, one…
▽ More
The backpropagation algorithm, which had been originally introduced in the 1970s, is the workhorse of learning in neural networks. This backpropagation algorithm makes use of the famous machine learning algorithm known as Gradient Descent, which is a first-order iterative optimization algorithm for finding the minimum of a function. To find a local minimum of a function using gradient descent, one takes steps proportional to the negative of the gradient (or of the approximate gradient) of the function at the current point. In this paper, we develop an alternative to the backpropagation without the use of the Gradient Descent Algorithm, but instead we are going to devise a new algorithm to find the error in the weights and biases of an artificial neuron using Moore-Penrose Pseudo Inverse. The numerical studies and the experiments performed on various datasets are used to verify the working of this alternative algorithm.
△ Less
Submitted 25 January, 2018;
originally announced February 2018.
-
Design of Improved Quasi-Cyclic Protograph-Based Raptor-Like LDPC Codes for Short Block-Lengths
Authors:
Sudarsan V. S. Ranganathan,
Dariush Divsalar,
Richard D. Wesel
Abstract:
Protograph-based Raptor-like low-density parity-check codes (PBRL codes) are a recently proposed family of easily encodable and decodable rate-compatible LDPC (RC-LDPC) codes. These codes have an excellent iterative decoding threshold and performance across all design rates. PBRL codes designed thus far, for both long and short block-lengths, have been based on optimizing the iterative decoding th…
▽ More
Protograph-based Raptor-like low-density parity-check codes (PBRL codes) are a recently proposed family of easily encodable and decodable rate-compatible LDPC (RC-LDPC) codes. These codes have an excellent iterative decoding threshold and performance across all design rates. PBRL codes designed thus far, for both long and short block-lengths, have been based on optimizing the iterative decoding threshold of the protograph of the RC code family at various design rates.
In this work, we propose a design method to obtain better quasi-cyclic (QC) RC-LDPC codes with PBRL structure for short block-lengths (of a few hundred bits). We achieve this by maximizing an upper bound on the minimum distance of any QC-LDPC code that can be obtained from the protograph of a PBRL ensemble. The obtained codes outperform the original PBRL codes at short block-lengths by significantly improving the error floor behavior at all design rates. Furthermore, we identify a reduction in complexity of the design procedure, facilitated by the general structure of a PBRL ensemble.
△ Less
Submitted 6 June, 2017; v1 submitted 25 January, 2017;
originally announced January 2017.
-
Optimizing Transmission Lengths for Limited Feedback with Non-Binary LDPC Examples
Authors:
Kasra Vakilinia,
Sudarsan V. S. Ranganathan,
Dariush Divsalar,
Richard D. Wesel
Abstract:
This paper presents a general approach for optimizing the number of symbols in increments (packets of incremental redundancy) in a feedback communication system with a limited number of increments. This approach is based on a tight normal approximation on the rate for successful decoding. Applying this approach to a variety of feedback systems using non-binary (NB) low-density parity-check (LDPC)…
▽ More
This paper presents a general approach for optimizing the number of symbols in increments (packets of incremental redundancy) in a feedback communication system with a limited number of increments. This approach is based on a tight normal approximation on the rate for successful decoding. Applying this approach to a variety of feedback systems using non-binary (NB) low-density parity-check (LDPC) codes shows that greater than 90% of capacity can be achieved with average blocklengths fewer than 500 transmitted bits. One result is that the performance with ten increments closely approaches the performance with an infinite number of increments. The paper focuses on binary- input additive-white Gaussian noise (BI-AWGN) channels but also demonstrates that the normal approximation works well on examples of fading channels as well as high-SNR AWGN channels that require larger QAM constellations. The paper explores both variable-length feedback codes with termination (VLFT) and the more practical variable length feedback (VLF) codes without termination that require no assumption of noiseless transmitter confirmation. For VLF we consider both a two-phase scheme and CRC-based scheme.
△ Less
Submitted 16 February, 2016;
originally announced February 2016.
-
Optimality and Rate-Compatibility for Erasure-Coded Packet Transmissions when Fading Channel Diversity Increases with Packet Length
Authors:
Sudarsan V. S. Ranganathan,
Tong Mu,
Richard D. Wesel
Abstract:
A message composed of packets is transmitted using erasure and channel coding over a fading channel with no feedback. For this scenario, the paper explores the trade-off between the redundancies allocated to the packet-level erasure code and the channel code, along with an objective of a low probability of failure to recover the message.
To this end, we consider a fading model that we term propo…
▽ More
A message composed of packets is transmitted using erasure and channel coding over a fading channel with no feedback. For this scenario, the paper explores the trade-off between the redundancies allocated to the packet-level erasure code and the channel code, along with an objective of a low probability of failure to recover the message.
To this end, we consider a fading model that we term proportional-diversity block fading (PD block fading). For a fixed overall code rate and transmit power, we formulate an optimization problem to numerically find the optimal channel-coding rate (and thus the optimal erasure-coding rate) that minimizes the probability of failure for various approximations of the problem.
Furthermore, an interpretation of the results from an incremental redundancy point of view shows how rate-compatibility affects the possible trajectories of the failure probability as a function of the overall code rate. Our numerical results suggest that an optimal, rateless, hybrid coding scheme for a single-user wireless system over the PD block-fading channel should have the rate of the erasure code approach one.
△ Less
Submitted 1 February, 2016;
originally announced February 2016.
-
On the Girth of (3,L) Quasi-Cyclic LDPC Codes based on Complete Protographs
Authors:
Sudarsan V. S. Ranganathan,
Dariush Divsalar,
Richard D. Wesel
Abstract:
We consider the problem of constructing $(3,L)$ quasi-cyclic low-density parity-check (LDPC) codes from complete protographs. A complete protograph is a small bipartite graph with two disjoint vertex sets such that every vertex in the variable-node set is connected to every vertex in the check-node set by a unique edge. This paper analyzes the required lifting factor for achieving girths of six or…
▽ More
We consider the problem of constructing $(3,L)$ quasi-cyclic low-density parity-check (LDPC) codes from complete protographs. A complete protograph is a small bipartite graph with two disjoint vertex sets such that every vertex in the variable-node set is connected to every vertex in the check-node set by a unique edge. This paper analyzes the required lifting factor for achieving girths of six or eight in the resulting quasi-cyclic codes with constraints on lifting. The required lifting factors provide lower bounds on the block-length of such codes.
△ Less
Submitted 29 May, 2015; v1 submitted 20 April, 2015;
originally announced April 2015.