Showing 1–9 of 9 results for author: Alam, S E

A Communication-efficient Local Differentially Private Algorithm in Federated Optimization

Authors: Syed Eqbal Alam, Dhirendra Shukla, Shrisha Rao

Abstract: Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest from the research community. In this context, agents demand resources based on their local computation. Due to the exchange of optimization parameters such as sta… ▽ More Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest from the research community. In this context, agents demand resources based on their local computation. Due to the exchange of optimization parameters such as states, constraints, or objective functions with a central server, an adversary may infer sensitive information of agents. We develop a differentially-private additive-increase and multiplicative-decrease algorithm to allocate multiple divisible shared heterogeneous resources to agents in a network. The developed algorithm provides a differential privacy guarantee to each agent in the network. The algorithm does not require inter-agent communication, and the agents do not need to share their cost function or their derivatives with other agents or a central server; however, they share their allocation states with a central server that keeps track of the aggregate consumption of resources. The algorithm incurs very little communication overhead; for m heterogeneous resources in the system, the asymptotic upper bound on the communication complexity is O(m) bits at a time step. Furthermore, if the algorithm converges in K time steps, then the upper bound communication complexity will be O(mK) bits. The algorithm can find applications in several areas, including smart cities, smart energy systems, resource management in the sixth generation (6G) wireless networks with privacy guarantees, etc. We present experimental results to check the efficacy of the algorithm. Furthermore, we present empirical analyses for the trade-off between privacy and algorithm efficiency. △ Less

Submitted 19 October, 2023; v1 submitted 3 April, 2023; originally announced April 2023.

ACM Class: I.2.11

Journal ref: IEEE Access, vol. 11, pp. 58254-58268, 2023

On Unique Ergodicity Of Coupled AIMD Flows

Authors: Pietro Ferraro, Jia Yuan Yu, Ramen Ghosh, Syed Eqbal Alam, Jakub Marecek, Fabian Wirth, Robert Shorten

Abstract: The AIMD algorithm, which underpins the Transmission Control Protocol (TCP) for transporting data packets in communication networks, is perhaps the most successful control algorithm ever deployed. Recently, its use has been extended beyond communication networks, and successful applications of the AIMD algorithm have been reported in transportation, energy, and mathematical biology. A very recent… ▽ More The AIMD algorithm, which underpins the Transmission Control Protocol (TCP) for transporting data packets in communication networks, is perhaps the most successful control algorithm ever deployed. Recently, its use has been extended beyond communication networks, and successful applications of the AIMD algorithm have been reported in transportation, energy, and mathematical biology. A very recent development in the use of AIMD is its application in solving large-scale optimization and distributed control problems without the need for inter-agent communication. In this context, an interesting problem arises when multiple AIMD networks that are coupled in some sense (usually through a nonlinearity). The purpose of this note is to prove that such systems in certain settings inherit the ergodic properties of individual AIMD networks. This result has important consequences for the convergence of the aforementioned optimization algorithms. The arguments in the paper also correct conceptual and technical errors in [1]. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Journal ref: International Journal of Control, 2024

Optimal Regulation of Prosumers and Consumers in Smart Energy Communities

Authors: Syed Eqbal Alam, Dhirendra Shukla

Abstract: In smart energy communities, households of a particular geographical location make a cooperative group to achieve the community's social welfare. Prosumers are the users that both consume and produce energy. In this paper, we develop stochastic and distributed algorithms to regulate the number of consumers and the number of prosumers with heterogeneous energy sources in the smart energy community.… ▽ More In smart energy communities, households of a particular geographical location make a cooperative group to achieve the community's social welfare. Prosumers are the users that both consume and produce energy. In this paper, we develop stochastic and distributed algorithms to regulate the number of consumers and the number of prosumers with heterogeneous energy sources in the smart energy community. In the community, each prosumer has one of the heterogeneous energy sources such as solar photovoltaic panels or wind turbines installed in their household. The prosumers and consumers decide in a probabilistic way when to be active. They keep their information private and do not need to share it with other prosumers or consumers in the community. Moreover, we consider a central server that keeps track of the total number of active prosumers and consumers and sends feedback signals in the community at each time step; the prosumers and consumers use these signals to calculate their probabilistic intent. We present experimental results to check the efficacy of the algorithms. We observe that the average number of times prosumers and consumers are active reaches the optimal value over time, and the community asymptotically achieves the social optimum value. △ Less

Submitted 28 December, 2022; v1 submitted 25 June, 2022; originally announced June 2022.

Comments: Published in the 2022 IEEE International Smart Cities Conference (ISC2), September 2022

Multi-resource allocation for federated settings: A non-homogeneous Markov chain model

Authors: Syed Eqbal Alam, Fabian Wirth, Jia Yuan Yu

Abstract: In a federated setting, agents coordinate with a central agent or a server to solve an optimization problem in which agents do not share their information with each other. Wirth and his co-authors, in a recent paper, describe how the basic additive-increase multiplicative-decrease (AIMD) algorithm can be modified in a straightforward manner to solve a class of optimization problems for federated s… ▽ More In a federated setting, agents coordinate with a central agent or a server to solve an optimization problem in which agents do not share their information with each other. Wirth and his co-authors, in a recent paper, describe how the basic additive-increase multiplicative-decrease (AIMD) algorithm can be modified in a straightforward manner to solve a class of optimization problems for federated settings for a single shared resource with no inter-agent communication. The AIMD algorithm is one of the most successful distributed resource allocation algorithms currently deployed in practice. It is best known as the backbone of the Internet and is also widely explored in other application areas. We extend the single-resource algorithm to multiple heterogeneous shared resources that emerge in smart cities, sharing economy, and many other applications. Our main results show the convergence of the average allocations to the optimal values. We model the system as a non-homogeneous Markov chain with place-dependent probabilities. Furthermore, simulation results are presented to demonstrate the efficacy of the algorithms and to highlight the main features of our analysis. △ Less

Submitted 24 May, 2021; v1 submitted 26 April, 2021; originally announced April 2021.

Comments: The paper was published without the co-authors' notice, and it is withdrawn due to their objection and due to authorship conflicts

The Convergence of Finite-Averaging of AIMD for Distributed Heterogeneous Resource Allocations

Authors: Syed Eqbal Alam, Fabian Wirth, Jia Yuan Yu, Robert Shorten

Abstract: In several social choice problems, agents collectively make decisions over the allocation of multiple divisible and heterogeneous resources with capacity constraints to maximize utilitarian social welfare. The agents are constrained through computational or communication resources or privacy considerations. In this paper, we analyze the convergence of a recently proposed distributed solution that… ▽ More In several social choice problems, agents collectively make decisions over the allocation of multiple divisible and heterogeneous resources with capacity constraints to maximize utilitarian social welfare. The agents are constrained through computational or communication resources or privacy considerations. In this paper, we analyze the convergence of a recently proposed distributed solution that allocates such resources to agents with minimal communication. It is based on the randomized additive-increase and multiplicative-decrease (AIMD) algorithm. The agents are not required to exchange information with each other, but little with a central agent that keeps track of the aggregate resource allocated at a time. We formulate the time-averaged allocations over finite window size and model the system as a Markov chain with place-dependent probabilities. Furthermore, we show that the time-averaged allocations vector converges to a unique invariant measure, and also, the ergodic property holds. △ Less

Submitted 24 January, 2020; v1 submitted 18 January, 2020; originally announced January 2020.

Journal ref: Updated versions are published at IJC and ACC 2023

Derandomized Distributed Multi-resource Allocation with Little Communication Overhead

Authors: Syed Eqbal Alam, Robert Shorten, Fabian Wirth, Jia Yuan Yu

Abstract: We study a class of distributed optimization problems for multiple shared resource allocation in Internet-connected devices. We propose a derandomized version of an existing stochastic additive-increase and multiplicative-decrease (AIMD) algorithm. The proposed solution uses one bit feedback signal for each resource between the system and the Internet-connected devices and does not require inter-d… ▽ More We study a class of distributed optimization problems for multiple shared resource allocation in Internet-connected devices. We propose a derandomized version of an existing stochastic additive-increase and multiplicative-decrease (AIMD) algorithm. The proposed solution uses one bit feedback signal for each resource between the system and the Internet-connected devices and does not require inter-device communication. Additionally, the Internet-connected devices do not compromise their privacy and the solution does not dependent on the number of participating devices. In the system, each Internet-connected device has private cost functions which are strictly convex, twice continuously differentiable and increasing. We show empirically that the long-term average allocations of multiple shared resources converge to optimal allocations and the system achieves minimum social cost. Furthermore, we show that the proposed derandomized AIMD algorithm converges faster than the stochastic AIMD algorithm and both the approaches provide approximately same solutions. △ Less

Submitted 21 December, 2018; originally announced December 2018.

Journal ref: 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)

Distributed Algorithms for Internet-of-Things-enabled Prosumer Markets: A Control Theoretic Perspective

Authors: Syed Eqbal Alam, Robert Shorten, Fabian Wirth, Jia Yuan Yu

Abstract: Internet-of-Things (IoT) enables the development of sharing economy applications. In many sharing economy scenarios, agents both produce as well as consume a resource; we call them prosumers. A community of prosumers agrees to sell excess resource to another community in a prosumer market. In this chapter, we propose a control theoretic approach to regulate the number of prosumers in a prosumer co… ▽ More Internet-of-Things (IoT) enables the development of sharing economy applications. In many sharing economy scenarios, agents both produce as well as consume a resource; we call them prosumers. A community of prosumers agrees to sell excess resource to another community in a prosumer market. In this chapter, we propose a control theoretic approach to regulate the number of prosumers in a prosumer community, where each prosumer has a cost function that is coupled through its time-averaged production and consumption of the resource. Furthermore, each prosumer runs its distributed algorithm and takes only binary decisions in a probabilistic way, whether to produce one unit of the resource or not and to consume one unit of the resource or not. In the proposed approach, prosumers do not explicitly exchange information with each other due to privacy reasons, but little exchange of information is required for feedback signals, broadcast by a central agency. In the proposed approach, prosumers achieve the optimal values asymptotically. Furthermore, the proposed approach is suitable to implement in an IoT context with minimal demands on infrastructure. We describe two use cases; community-based car sharing and collaborative energy storage for prosumer markets. We also present simulation results to check the efficacy of the algorithms. △ Less

Submitted 25 March, 2019; v1 submitted 18 December, 2018; originally announced December 2018.

Comments: To appear as a chapter in "Analytics for the Sharing Economy: Mathematics, Engineering and Business Perspectives", Editors: E. Crisostomi et al., Springer, 2019 (forthcoming book)

Journal ref: Analytics for the Sharing Economy: Mathematics, Engineering and Business Perspectives, Springer, Cham, 2020

Communication-efficient Distributed Multi-resource Allocation

Authors: Syed Eqbal Alam, Robert Shorten, Fabian Wirth, Jia Yuan Yu

Abstract: In several smart city applications, multiple resources must be allocated among competing agents that are coupled through such shared resources and are constrained --- either through limitations of communication infrastructure or privacy considerations. We propose a distributed algorithm to solve such distributed multi-resource allocation problems with no direct inter-agent communication. We do so… ▽ More In several smart city applications, multiple resources must be allocated among competing agents that are coupled through such shared resources and are constrained --- either through limitations of communication infrastructure or privacy considerations. We propose a distributed algorithm to solve such distributed multi-resource allocation problems with no direct inter-agent communication. We do so by extending a recently introduced additive-increase multiplicative-decrease (AIMD) algorithm, which only uses very little communication between the system and agents. Namely, a control unit broadcasts a one-bit signal to agents whenever one of the allocated resources exceeds capacity. Agents then respond to this signal in a probabilistic manner. In the proposed algorithm, each agent makes decision of its resource demand locally and an agent is unaware of the resource allocation of other agents. In empirical results, we observe that the average allocations converge over time to optimal allocations. △ Less

Submitted 27 July, 2018; originally announced July 2018.

Comments: To appear in IEEE International Smart Cities Conference (ISC2 2018), Kansas City, USA, September, 2018. arXiv admin note: substantial text overlap with arXiv:1711.01977

Journal ref: 2018 IEEE International Smart Cities Conference (ISC2)

On the Control of Agents Coupled through Shared Unit-demand Resources

Authors: Syed Eqbal Alam, Robert Shorten, Fabian Wirth, Jia Yuan Yu

Abstract: We consider a control problem involving several agents coupled through multiple unit-demand resources. Such resources are indivisible, and each agent's consumption is modeled as a Bernoulli random variable. Controlling the number of such agents in a probabilistic manner, subject to capacity constraints, is ubiquitous in smart cities. For instance, such agents can be humans in a feedback loop---who… ▽ More We consider a control problem involving several agents coupled through multiple unit-demand resources. Such resources are indivisible, and each agent's consumption is modeled as a Bernoulli random variable. Controlling the number of such agents in a probabilistic manner, subject to capacity constraints, is ubiquitous in smart cities. For instance, such agents can be humans in a feedback loop---who respond to a price signal, or automated decision-support systems that strive toward system-level goals. In this paper, we consider both single feedback loop corresponding to a single resource and multiple coupled feedback loops corresponding to multiple resources consumed by the same population of agents. For example, when a network of devices allocates resources to deliver several services, these services are coupled through capacity constraints on the resources. We propose a new algorithm with fundamental guarantees of convergence and optimality, as well as present an example illustrating its performance. △ Less

Submitted 29 April, 2019; v1 submitted 27 March, 2018; originally announced March 2018.

MSC Class: 93E20; 93C10; 93C35