-
Federated Learning Cost Disparity for IoT Devices
Authors:
Sheeraz A. Alvi,
Yi Hong,
Salman Durrani
Abstract:
Federated learning (FL) promotes predictive model training at the Internet of things (IoT) devices by evading data collection cost in terms of energy, time, and privacy. We model the learning gain achieved by an IoT device against its participation cost as its utility. Due to the device-heterogeneity, the local model learning cost and its quality, which can be time-varying, differs from device to…
▽ More
Federated learning (FL) promotes predictive model training at the Internet of things (IoT) devices by evading data collection cost in terms of energy, time, and privacy. We model the learning gain achieved by an IoT device against its participation cost as its utility. Due to the device-heterogeneity, the local model learning cost and its quality, which can be time-varying, differs from device to device. We show that this variation results in utility unfairness because the same global model is shared among the devices. By default, the master is unaware of the local model computation and transmission costs of the devices, thus it is unable to address the utility unfairness problem. Also, a device may exploit this lack of knowledge at the master to intentionally reduce its expenditure and thereby enhance its utility. We propose to control the quality of the global model shared with the devices, in each round, based on their contribution and expenditure. This is achieved by employing differential privacy to curtail global model divulgence based on the learning contribution. In addition, we devise adaptive computation and transmission policies for each device to control its expenditure in order to mitigate utility unfairness. Our results show that the proposed scheme reduces the standard deviation of the energy cost of devices by 99% in comparison to the benchmark scheme, while the standard deviation of the training loss of devices varies around 0.103.
△ Less
Submitted 17 April, 2022;
originally announced April 2022.
-
Utility Fairness for the Differentially Private Federated Learning
Authors:
Sheeraz A. Alvi,
Yi Hong,
Salman Durrani
Abstract:
Federated learning (FL) allows predictive model training on the sensed data in a wireless Internet of things (IoT) network evading data collection cost in terms of energy, time, and privacy. In this paper, for a FL setting, we model the learning gain achieved by an IoT device against its participation cost as its utility. The local model quality and the associated cost differs from device to devic…
▽ More
Federated learning (FL) allows predictive model training on the sensed data in a wireless Internet of things (IoT) network evading data collection cost in terms of energy, time, and privacy. In this paper, for a FL setting, we model the learning gain achieved by an IoT device against its participation cost as its utility. The local model quality and the associated cost differs from device to device due to the device-heterogeneity which could be time-varying. We identify that this results in utility unfairness because the same global model is shared among the devices. In the vanilla FL setting, the master is unaware of devices' local model computation and transmission costs, thus it is unable to address the utility unfairness problem. In addition, a device may exploit this lack of knowledge at the master to intentionally reduce its expenditure and thereby boost its utility. We propose to control the quality of the global model shared with the devices, in each round, based on their contribution and expenditure. This is achieved by employing differential privacy to curtail global model divulgence based on the learning contribution. Furthermore, we devise adaptive computation and transmission policies for each device to control its expenditure in order to mitigate utility unfairness. Our results show that the proposed scheme reduces the standard deviation of the energy cost of devices by 99% in comparison to the benchmark scheme, while the standard deviation of the training loss of devices varies around 0.103.
△ Less
Submitted 11 September, 2021;
originally announced September 2021.
-
Sequencing and Scheduling for Multi-User Machine-Type Communication
Authors:
Sheeraz A. Alvi,
Xiangyun Zhou,
Salman Durrani,
Duy T. Ngo
Abstract:
In this paper, we propose joint sequencing and scheduling optimization for uplink machine-type communication (MTC). We consider multiple energy-constrained MTC devices that transmit data to a base station following the time division multiple access (TDMA) protocol. Conventionally, the energy efficiency performance in TDMA is optimized through multi-user scheduling, i.e., changing the transmission…
▽ More
In this paper, we propose joint sequencing and scheduling optimization for uplink machine-type communication (MTC). We consider multiple energy-constrained MTC devices that transmit data to a base station following the time division multiple access (TDMA) protocol. Conventionally, the energy efficiency performance in TDMA is optimized through multi-user scheduling, i.e., changing the transmission block length allocated to different devices. In such a system, the sequence of devices for transmission, i.e., who transmits first and who transmits second, etc., has not been considered as it does not have any impact on the energy efficiency. In this work, we consider that data compression is performed before transmission and show that the multi-user sequencing is indeed important. We apply three popular energy-minimization system objectives, which differ in terms of the overall system performance and fairness among the devices. We jointly optimize both multi-user sequencing and scheduling along with the compression and transmission rate control. Our results show that multi-user sequence optimization significantly improves the energy efficiency performance of the system. Notably, it makes the TDMA-based multi-user transmissions more likely to be feasible in the lower latency regime, and the performance gain is larger when the delay bound is stringent.
△ Less
Submitted 4 September, 2019; v1 submitted 2 April, 2019;
originally announced April 2019.
-
Optimal Compression and Transmission Rate Control for Node-Lifetime Maximization
Authors:
Sheeraz A. Alvi,
Xiangyun Zhou,
Salman Durrani
Abstract:
We consider a system that is composed of an energy constrained sensor node and a sink node, and devise optimal data compression and transmission policies with an objective to prolong the lifetime of the sensor node. While applying compression before transmission reduces the energy consumption of transmitting the sensed data, blindly applying too much compression may even exceed the cost of transmi…
▽ More
We consider a system that is composed of an energy constrained sensor node and a sink node, and devise optimal data compression and transmission policies with an objective to prolong the lifetime of the sensor node. While applying compression before transmission reduces the energy consumption of transmitting the sensed data, blindly applying too much compression may even exceed the cost of transmitting raw data, thereby losing its purpose. Hence, it is important to investigate the trade-off between data compression and transmission energy costs. In this paper, we study the joint optimal compression-transmission design in three scenarios which differ in terms of the available channel information at the sensor node, and cover a wide range of practical situations. We formulate and solve joint optimization problems aiming to maximize the lifetime of the sensor node whilst satisfying specific delay and bit error rate (BER) constraints. Our results show that a jointly optimized compression-transmission policy achieves significantly longer lifetime (90% to 2000%) as compared to optimizing transmission only without compression. Importantly, this performance advantage is most profound when the delay constraint is stringent, which demonstrates its suitability for low latency communication in future wireless networks.
△ Less
Submitted 13 September, 2018; v1 submitted 23 March, 2018;
originally announced March 2018.
