-
Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, bas…
▽ More
This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, based on standard assumptions. Subsequently, leveraging the assumption of Sub-Gaussian noise in stochastic subgradients, we present refined concentration bounds for this discrepancy.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Convergence Analysis of Stochastic Saddle Point Mirror Descent Algorithm -- A Projected Dynamical View Point
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain.…
▽ More
Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain. This involves computing the (sub/super) gradient of the min-max function within a Riemannian metric. Additionally, we establish viable Caratheodory solutions also prove the Lyapunov stability and asymptotic set stability of the proposed continuous time dynamical system. Next, we present the Stochastic Saddle Point Mirror Descent (SSPMD) algorithm and establish its equivalence with the proposed continuous-time dynamics. Leveraging stability analysis of the continuous-time dynamics, we demonstrate the almost sure convergence of the algorithm's iterates. Furthermore, we introduce the Zeroth-Order Saddle Point Mirror Descent (SZSPMD) algorithm, which approximates gradients using Nesterov's Gaussian Approximation, showcasing convergence to a neighborhood around saddle points. The analysis in this paper provides geometric insights into the mirror descent algorithm and demonstrates how these insights offer theoretical foundations for various practical applications of the mirror descent algorithm in diverse scenarios.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
Optimal Pinning Control for Synchronization over Temporal Networks
Authors:
Aandrew Baggio S,
Rachel Kalpana Kalaimani
Abstract:
In this paper, we address the finite time synchronization of a network of dynamical systems with time-varying interactions modeled using temporal networks. We synchronize a few nodes initially using external control inputs. These nodes are termed as pinning nodes. The other nodes are synchronized by interacting with the pinning nodes and with each other. We first provide sufficient conditions for…
▽ More
In this paper, we address the finite time synchronization of a network of dynamical systems with time-varying interactions modeled using temporal networks. We synchronize a few nodes initially using external control inputs. These nodes are termed as pinning nodes. The other nodes are synchronized by interacting with the pinning nodes and with each other. We first provide sufficient conditions for the network to be synchronized. Then we formulate an optimization problem to minimize the number of pinning nodes for synchronizing the entire network. Finally, we address the problem of maximizing the number of synchronized nodes when there are constraints on the number of nodes that could be pinned. We show that this problem belongs to the class of NP-hard problems and propose a greedy heuristic. We illustrate the results using numerical simulations.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We…
▽ More
This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We prove an almost sure convergence of the iterates' function value to the neighbourhood of optimal function value, which can not be made arbitrarily small, a manifestation of a biased oracle. This letter ends with a concentration inequality, which is a finite time analysis that predicts the likelihood that the function value of the iterates is in the neighbourhood of the optimal value at any finite iteration.
△ Less
Submitted 30 June, 2024; v1 submitted 17 March, 2023;
originally announced March 2023.
-
Resilient Dynamic Average Consensus based on Trusted agents
Authors:
Shamik Bhattacharyya,
Rachel Kalpana Kalaimani
Abstract:
In this paper, we address the discrete-time dynamic average consensus (DAC) of a multi-agent system in the presence of adversarial attacks. The adversarial attack is considered to be of Byzantine type, which compromises the computation capabilities of the agent and sends arbitrary false data to its neighbours. We assume a few of the agents cannot be compromised by adversaries, which we term truste…
▽ More
In this paper, we address the discrete-time dynamic average consensus (DAC) of a multi-agent system in the presence of adversarial attacks. The adversarial attack is considered to be of Byzantine type, which compromises the computation capabilities of the agent and sends arbitrary false data to its neighbours. We assume a few of the agents cannot be compromised by adversaries, which we term trusted agents. We first formally define resilient DAC in the presence of Byzantine adversaries. Then we propose our novel Resilient Dynamic Average Consensus (ResDAC) algorithm that ensures the trusted and ordinary agents achieve resilient DAC in the presence of adversarial agents. The only requirements are that of the trusted agents forming a connected dominating set and the first-order differences of the reference signals being bounded. We do not impose any restriction on the tolerable number of adversarial agents that can be present in the network. We also do not restrict the reference signals to be bounded. Finally, we provide numerical simulations to illustrate the effectiveness of the proposed ResDAC algorithm.
△ Less
Submitted 14 March, 2023;
originally announced March 2023.
-
Online Distributed Algorithm for Optimal Power Flow problem with Regret Analysis
Authors:
Sushobhan Chatterjee,
Rachel Kalpana Kalaimani
Abstract:
We investigate the distributed DC-Optimal Power Flow (DC-OPF) problem for a dynamic and uncertain environment. The unpredictable supply of renewable resources and varying prices of the electricity market are a few factors responsible for the uncertainty. We propose to address this problem using the framework of online convex optimization, where the cost functions are not known apriori because of t…
▽ More
We investigate the distributed DC-Optimal Power Flow (DC-OPF) problem for a dynamic and uncertain environment. The unpredictable supply of renewable resources and varying prices of the electricity market are a few factors responsible for the uncertainty. We propose to address this problem using the framework of online convex optimization, where the cost functions are not known apriori because of the uncertainty and are revealed only incrementally over time. We also consider a distributed setting, where each agent (generators and loads) in the power network is only privy to their own local objectives and constraints but can communicate with their neighbours. A distributed online algorithm is proposed based on the modified primal-dual approach. The performance of the online algorithm is evaluated using the regret (static) function, which is the difference between the actual cost incurred by employing the proposed algorithm and the optimal fixed decision in hindsight. Since we deal with a constrained optimization problem, analogous to the notion of regret the accumulation of the constraint violation is also calculated at each step. We establish a sub-linear bound on the static regret and constraint violation under suitable assumptions on step-size and cost function. Finally, we use the standard IEEE-14 bus system to demonstrate the performance of our algorithm.
△ Less
Submitted 9 August, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
ADMM based Distributed State Observer Design under Sparse Sensor Attacks
Authors:
Vinaya Mary Prinse,
Rachel Kalpana Kalaimani
Abstract:
This paper considers the design of a distributed state-observer for discrete-time Linear Time-Invariant (LTI) systems in the presence of sensor attacks. We assume there is a network of observer nodes, communicating with each other over an undirected graph, each with partial measurements of the output corrupted by some adversarial attack. We address the case of sparse attacks where the attacker tar…
▽ More
This paper considers the design of a distributed state-observer for discrete-time Linear Time-Invariant (LTI) systems in the presence of sensor attacks. We assume there is a network of observer nodes, communicating with each other over an undirected graph, each with partial measurements of the output corrupted by some adversarial attack. We address the case of sparse attacks where the attacker targets a small subset of sensors. An algorithm based on Alternating Direction Method of Multipliers (ADMM) is developed which provides an update law for each observer which ensures convergence of each observer node to the actual state asymptotically.
△ Less
Submitted 8 December, 2022; v1 submitted 13 September, 2022;
originally announced September 2022.
-
Distributed Optimization of Average Consensus Containment with Multiple Stationary Leaders
Authors:
Sushobhan Chatterjee,
Rachel Kalpana Kalaimani
Abstract:
In this paper, we consider the problem of containment control of multi-agent systems with multiple stationary leaders, interacting over a directed network. While, containment control refers to just ensuring that the follower agents reach the convex hull of the leaders states, we focus on the problem where the followers achieve a consensus to the average values of the leaders states. We propose an…
▽ More
In this paper, we consider the problem of containment control of multi-agent systems with multiple stationary leaders, interacting over a directed network. While, containment control refers to just ensuring that the follower agents reach the convex hull of the leaders states, we focus on the problem where the followers achieve a consensus to the average values of the leaders states. We propose an algorithm that can be implemented in a distributed manner to achieve the above consensus among followers. Next we optimize the convergence rate of the followers to the average consensus by proper choice of weights for the interaction graph. This optimization is also performed in a distributed manner using Alternating Direction Method of Multipliers (ADMM). Finally, we complement our results by illustrating them with numerical examples.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
Distributed Online Optimization with Byzantine Adversarial Agents
Authors:
Sourav Sahoo,
Anand Gokhale,
Rachel Kalpana Kalaimani
Abstract:
We study the problem of non-constrained, discrete-time, online distributed optimization in a multi-agent system where some of the agents do not follow the prescribed update rule either due to failures or malicious intentions. None of the agents have prior information about the identities of the faulty agents and any agent can communicate only with its immediate neighbours. At each time step, a loc…
▽ More
We study the problem of non-constrained, discrete-time, online distributed optimization in a multi-agent system where some of the agents do not follow the prescribed update rule either due to failures or malicious intentions. None of the agents have prior information about the identities of the faulty agents and any agent can communicate only with its immediate neighbours. At each time step, a locally Lipschitz strongly convex cost function is revealed locally to all the agents and the non-faulty agents update their states using their local information and the information obtained from their neighbours. We measure the performance of the online algorithm by comparing it to its offline version, when the cost functions are known apriori. The difference between the same is termed as regret. Under sufficient conditions on the graph topology, the number and location of the adversaries, the defined regret grows sublinearly. We further conduct numerical experiments to validate our theoretical results.
△ Less
Submitted 9 April, 2022; v1 submitted 25 September, 2021;
originally announced September 2021.
-
Distributed Estimation over Directed Graphs Resilient to Sensor Spoofing
Authors:
Shamik Bhattacharyya,
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
This paper addresses the problem of distributed estimation of an unknown dynamic parameter by a multi-agent system over a directed communication network in the presence of an adversarial attack on the agents' sensors. The mode of attack of the adversaries is to corrupt the sensor measurements of some of the agents, while the communication and information processing capabilities of those agents rem…
▽ More
This paper addresses the problem of distributed estimation of an unknown dynamic parameter by a multi-agent system over a directed communication network in the presence of an adversarial attack on the agents' sensors. The mode of attack of the adversaries is to corrupt the sensor measurements of some of the agents, while the communication and information processing capabilities of those agents remain unaffected. To ensure that all the agents, both normal as well as those under attack, are able to correctly estimate the parameter value, the Resilient Estimation through Weight Balancing (REWB) algorithm is introduced. The only condition required for the REWB algorithm to guarantee resilient estimation is that at any given point in time, less than half of the total number of agents are under attack. The paper discusses the development of the REWB algorithm using the concepts of weight balancing of directed graphs, and the consensus+innovations approach for linear estimation. Numerical simulations are presented to illustrate the performance of our algorithm over directed graphs under different conditions of adversarial attacks.
△ Less
Submitted 9 January, 2023; v1 submitted 10 April, 2021;
originally announced April 2021.
-
Distributed ADMM with linear updates over directed networks
Authors:
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our distributed ADMM algorithm achieves a geometric rate of convergence to the optimal point. Our algorithm exploits the robustness inherent to ADMM by not enforcing ac…
▽ More
We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our distributed ADMM algorithm achieves a geometric rate of convergence to the optimal point. Our algorithm exploits the robustness inherent to ADMM by not enforcing accurate consensus, thereby significantly improving the convergence rate. We illustrate this by numerical examples, where we compare the performance of our algorithm with that of state-of-the-art ADMM methods over directed graphs.
△ Less
Submitted 19 September, 2023; v1 submitted 20 October, 2020;
originally announced October 2020.
-
Distributed computation of fast consensus weights using ADMM
Authors:
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a weighted average of its own value and those of its neighbours. Given a graph, it is known that there exists a set of 'optimal weights' such that the agents reach ave…
▽ More
We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a weighted average of its own value and those of its neighbours. Given a graph, it is known that there exists a set of 'optimal weights' such that the agents reach average consensus asymptotically with an optimal rate of convergence. However, existing methods require the knowledge of the entire graph to compute these optimal weights. We propose a method for each agent to compute its set of optimal weights locally, i.e., each agent only has to know who are its neighbours. The method is derived by solving a matrix norm minimization problem subject to linear constraints in a distributed manner using the Alternating Direction Method of Multipliers (ADMM). We illustrate our results using numerical examples and compare our method with an existing method called the Metropolis weights, which are also computed locally.
△ Less
Submitted 28 November, 2021; v1 submitted 19 February, 2020;
originally announced February 2020.
-
Using Personal Environmental Comfort Systems to Mitigate the Impact of Occupancy Prediction Errors on HVAC Performance
Authors:
Milan Jain,
Rachel K Kalaimani,
Srinivasan Keshav,
Catherine Rosenberg
Abstract:
Heating, Ventilation and Air Conditioning (HVAC) consumes a significant fraction of energy in commercial buildings. Hence, the use of optimization techniques to reduce HVAC energy consumption has been widely studied. Model predictive control (MPC) is one state of the art optimization technique for HVAC control which converts the control problem to a sequence of optimization problems, each over a f…
▽ More
Heating, Ventilation and Air Conditioning (HVAC) consumes a significant fraction of energy in commercial buildings. Hence, the use of optimization techniques to reduce HVAC energy consumption has been widely studied. Model predictive control (MPC) is one state of the art optimization technique for HVAC control which converts the control problem to a sequence of optimization problems, each over a finite time horizon. In a typical MPC, future system state is estimated from a model using predictions of model inputs, such as building occupancy and outside air temperature. Consequently, as prediction accuracy deteriorates, MPC performance--in terms of occupant comfort and building energy use--degrades. In this work, we use a custom-built building thermal simulator to systematically investigate the impact of occupancy prediction errors on occupant comfort and energy consumption. Our analysis shows that in our test building, as occupancy prediction error increases from 5\% to 20\% the performance of an MPC-based HVAC controller becomes worse than that of even a simple static schedule. However, when combined with a personal environmental control (PEC) system, HVAC controllers are considerably more robust to prediction errors. Thus, we quantify the effectiveness of PECs in mitigating the impact of forecast errors on MPC control for HVAC systems.
△ Less
Submitted 24 October, 2018;
originally announced October 2018.
-
Formation control with pole placement for multi-agent systems
Authors:
Ameer K. Mulla,
Rachel K. Kalaimani,
Debraj Chakraborty,
Madhu N. Belur
Abstract:
The problem of distributed controller synthesis for formation control of multi-agent systems is considered. The agents (single integrators) communicate over a communication graph and a decentralized linear feedback structure is assumed. One of the agents is designated as the leader. If the communication graph contains a directed spanning tree with the leader node as the root, then it is possible t…
▽ More
The problem of distributed controller synthesis for formation control of multi-agent systems is considered. The agents (single integrators) communicate over a communication graph and a decentralized linear feedback structure is assumed. One of the agents is designated as the leader. If the communication graph contains a directed spanning tree with the leader node as the root, then it is possible to place the poles of the ensemble system with purely local feedback controller gains. Given a desired formation, first one of the poles is placed at the origin. Then it is shown that the inter-agent weights can be independently adjusted to assign an eigenvector corresponding to the formation positions, to the zero eigenvalue. Then, only the leader input is enough to bring the agents to the desired formation and keep it there with no further inputs. Moreover, given a formation, the computation of the inter-agent weights that encode the formation information, can be calculated in a decentralized fashion using only local information.
△ Less
Submitted 16 May, 2013;
originally announced May 2013.
