-
Performance-Guaranteed Solutions for Multi-Agent Optimal Coverage Problems using Submodularity, Curvature, and Greedy Algorithms
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
We consider a class of multi-agent optimal coverage problems in which the goal is to determine the optimal placement of a group of agents in a given mission space so that they maximize a coverage objective that represents a blend of individual and collaborative event detection capabilities. This class of problems is extremely challenging due to the non-convex nature of the mission space and of the…
▽ More
We consider a class of multi-agent optimal coverage problems in which the goal is to determine the optimal placement of a group of agents in a given mission space so that they maximize a coverage objective that represents a blend of individual and collaborative event detection capabilities. This class of problems is extremely challenging due to the non-convex nature of the mission space and of the coverage objective. With this motivation, greedy algorithms are often used as means of getting feasible coverage solutions efficiently. Even though such greedy solutions are suboptimal, the submodularity (diminishing returns) property of the coverage objective can be exploited to provide performance bound guarantees. Moreover, we show that improved performance bound guarantees (beyond the standard (1-1/e) performance bound) can be established using various curvature measures of the coverage problem. In particular, we provide a brief review of all existing popular applicable curvature measures, including a recent curvature measure that we proposed, and discuss their effectiveness and computational complexity, in the context of optimal coverage problems. We also propose novel computationally efficient techniques to estimate some curvature measures. Finally, we provide several numerical results to support our findings and propose several potential future research directions.
△ Less
Submitted 22 March, 2024; v1 submitted 20 March, 2024;
originally announced March 2024.
-
A Decentralized Analysis and Control Synthesis Approach for Networked Systems with Arbitrary Interconnections
Authors:
Shirantha Welikala,
Hai Lin,
Panos Antsaklis
Abstract:
This paper considers the problem of decentralized analysis and control synthesis to verify and ensure properties like stability and dissipativity of a large-scale networked system comprised of linear subsystems interconnected in an arbitrary topology. In particular, we design systematic networked system analysis and control synthesis processes that can be executed in a decentralized manner at the…
▽ More
This paper considers the problem of decentralized analysis and control synthesis to verify and ensure properties like stability and dissipativity of a large-scale networked system comprised of linear subsystems interconnected in an arbitrary topology. In particular, we design systematic networked system analysis and control synthesis processes that can be executed in a decentralized manner at the subsystem level with minimal information sharing among the subsystems. Compared to our most recent work on the same topic, we consider a substantially more generalized problem setup in this paper and develop decentralized processes to verify and ensure a broader range of networked system properties. We show that for such decentralized processes: optimizing the used subsystem indexing scheme can substantially reduce the required inter-subsystem information-sharing sessions, and in some network topologies, information sharing among only neighboring subsystems is sufficient (distributed!). Moreover, the proposed networked system analysis and control synthesis processes are compositional/resilient to subsystem removals, which enable them to conveniently and efficiently handle situations where new subsystems are being added/removed to/from an existing network. We also provide significant insights into our decentralized approach so that it can be quickly adopted to verify and ensure properties beyond the stability and dissipativity of networked systems. Towards develo** such decentralized techniques, we have also derived new centralized solutions for dissipative observer and dynamic output feedback controller design problems. Subsequently, we also specialize all the derived results for discrete-time networked systems. We conclude this paper by providing several simulation results demonstrating the proposed novel decentralized analysis and control synthesis processes and dissipativity-based results.
△ Less
Submitted 1 September, 2022; v1 submitted 20 April, 2022;
originally announced April 2022.
-
On-line Estimation of Stability and Passivity Metrics
Authors:
Shirantha Welikala,
Hai Lin,
Panos J. Antsaklis
Abstract:
We consider the problem of on-line evaluation of critical characteristic parameters such as the L_2-gain (L2G), input feedforward passivity index (IFP) and output feedback passivity index (OFP) of non-linear systems using their input-output data. Typically, having an accurate measure of such "system indices" enables the application of systematic control design techniques. Moreover, if such system…
▽ More
We consider the problem of on-line evaluation of critical characteristic parameters such as the L_2-gain (L2G), input feedforward passivity index (IFP) and output feedback passivity index (OFP) of non-linear systems using their input-output data. Typically, having an accurate measure of such "system indices" enables the application of systematic control design techniques. Moreover, if such system indices can efficiently be evaluated on-line, they can be exploited to device intelligent controller reconfiguration and fault-tolerant control techniques. However, the existing estimation methods of such system indices (i.e., L2G, IFP and OFP) are predominantly off-line, computationally inefficient, and require a large amount of actual or synthetically generated input-output trajectory data under some specific initial/terminal conditions. On the other hand, the existing on-line estimation methods take an averaging-based approach, which may be sub-optimal, computationally inefficient and susceptible to estimate saturation. In this paper, to overcome these challenges (in the on-line estimation of system indices), we establish and exploit several interesting theoretical results on a particular class of fractional function optimization problems. For comparison purposes, the details of an existing averaging-based approach are provided for the same on-line estimation problem. Finally, several numerical examples are discussed to demonstrate the proposed on-line estimation approach and to highlight our contributions.
△ Less
Submitted 31 March, 2022;
originally announced April 2022.
-
Event-Driven Receding Horizon Control of Energy-Aware Dynamic Agents For Distributed Persistent Monitoring
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to jointly optimize the overall agent energy consumption and a measure of overall node state uncertainty, evaluated over a finite period of interest. To achieve these objectives, we…
▽ More
This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to jointly optimize the overall agent energy consumption and a measure of overall node state uncertainty, evaluated over a finite period of interest. To achieve these objectives, we extend an established event-driven Receding Horizon Control (RHC) solution by adding an optimal controller to account for agent motion dynamics and associated energy consumption. The resulting RHC solution is computationally efficient, distributed and on-line. Finally, numerical results are provided highlighting improvements compared to an existing RHC solution that uses energy-agnostic first-order agents.
△ Less
Submitted 25 February, 2021;
originally announced February 2021.
-
Event-Driven Receding Horizon Control for Distributed Estimation in Network Systems
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
We consider the problem of estimating the states of a distributed network of nodes (targets) through a team of cooperating agents (sensors) persistently visiting the nodes so that an overall measure of estimation error covariance evaluated over a finite period is minimized. We formulate this as a multi-agent persistent monitoring problem where the goal is to control each agent's trajectory defined…
▽ More
We consider the problem of estimating the states of a distributed network of nodes (targets) through a team of cooperating agents (sensors) persistently visiting the nodes so that an overall measure of estimation error covariance evaluated over a finite period is minimized. We formulate this as a multi-agent persistent monitoring problem where the goal is to control each agent's trajectory defined as a sequence of target visits and the corresponding dwell times spent making observations at each visited target. A distributed on-line agent controller is developed where each agent solves a sequence of receding horizon control problems (RHCPs) in an event-driven manner. A novel objective function is proposed for these RHCPs so as to optimize the effectiveness of this distributed estimation process and its unimodality property is established under some assumptions. Moreover, a machine learning solution is proposed to improve the computational efficiency of this distributed estimation process by exploiting the history of each agent's trajectory. Finally, extensive numerical results are provided indicating significant improvements compared to other state-of-the-art agent controllers.
△ Less
Submitted 12 October, 2021; v1 submitted 24 September, 2020;
originally announced September 2020.
-
Event-Driven Receding Horizon Control For Distributed Persistent Monitoring in Network Systems
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally…
▽ More
We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally efficient, distributed and on-line. The proposed controller differs from the existing on-line gradient-based parametric controllers and off-line greedy cycle search methods that often lead to either low-performing local optima or computationally intensive centralized solutions. A critical novel element in this controller is that it automatically optimizes its planning horizon length, thus making it parameter-free. We show that explicit globally optimal solutions can be obtained for every distributed optimization problem encountered at each event where the receding horizon controller is invoked. Numerical results are provided showing improvements compared to state of the art distributed on-line parametric control solutions.
△ Less
Submitted 3 October, 2020; v1 submitted 25 March, 2020;
originally announced March 2020.
-
Optimal Composition of Heterogeneous Multi-Agent Teams for Coverage Problems with Performance Bound Guarantees
Authors:
Chuangchuang Sun,
Shirantha Welikala,
Christos G. Cassandras
Abstract:
We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Grad…
▽ More
We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Gradient Ascent (PGA) algorithm to solve the optimal team composition problem. To deal with non-convexity, we initialize the algorithm using a greedy method and exploit the submodularity and curvature properties of the coverage objective function to derive novel tighter performance bound guarantees on the optimization problem solution. Numerical examples are included to validate the effectiveness of this approach in diverse mission space configurations and different heterogeneous multi-agent collections. Comparative results obtained using a commercial mixed-integer nonlinear programming problem solver demonstrate both the accuracy and computational efficiency of the distributed PGA algorithm.
△ Less
Submitted 11 March, 2020;
originally announced March 2020.
-
Asymptotic Analysis for Greedy Initialization of Threshold-Based Distributed Optimization of Persistent Monitoring on Graphs
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed i…
▽ More
This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed in prior work to control agent dwell times at nodes and next-node destinations by enforcing thresholds on the respective node states. Under such a Threshold Control Policy (TCP), an on-line gradient technique was used to determine optimal threshold values. However, due to the non-convexity of the problem, this approach often leads to a poor local optima highly dependent on the initial thresholds used. To overcome this initialization challenge, we develop a computationally efficient off-line greedy technique based on the asymptotic analysis of the network system. This analysis is then used to generate a high-performing set of initial thresholds. Extensive numerical results show that such initial thresholds are almost immediately (locally) optimal or quickly lead to optimal values. In all cases, they perform significantly better than the locally optimal solutions known to date.
△ Less
Submitted 10 December, 2020; v1 submitted 6 November, 2019;
originally announced November 2019.
-
Distributed Non-convex Optimization of Multi-agent Systems Using Boosting Functions to Escape Local Optima: Theory and Applications
Authors:
Shirantha Welikala,
Christos G. Cassandras
Abstract:
We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distri…
▽ More
We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distributed Boosting Scheme (DBS) based on a gradient-based optimization algorithm using a novel optimal variable step size mechanism so as to guarantee convergence. Even though our motivation is based on the coverage control problem setting, our analysis applies to a broad class of multi-agent problems. Simulation results are provided to compare the performance of different boosting functions families and to demonstrate the effectiveness of the boosting function approach in attaining improved (still generally local) optima.
△ Less
Submitted 15 July, 2020; v1 submitted 11 March, 2019;
originally announced March 2019.