Showing 1–50 of 58 results for author: Cassandras, C G

Online Trajectory Optimization for Persistent Monitoring Problems in Partitioned Environments

Authors: Jonas Hall, Christos G. Cassandras, Sean B. Andersson

Abstract: We consider the problem of using an autonomous agent to persistently monitor a collection of dynamic targets distributed in an environment. We generalize existing work by allowing the agent's dynamics to vary throughout the environment, leading to a hybrid dynamical system. This introduces an additional layer of complexity towards the planning portion of the problem: we must not only identify in w… ▽ More We consider the problem of using an autonomous agent to persistently monitor a collection of dynamic targets distributed in an environment. We generalize existing work by allowing the agent's dynamics to vary throughout the environment, leading to a hybrid dynamical system. This introduces an additional layer of complexity towards the planning portion of the problem: we must not only identify in which order to visit the points of interest, but also in which order to traverse the regions. We design an offline high-level sequence planner together with an online trajectory optimizer realizing the computed visiting sequence. We provide numerical experiments to illustrate the performance of our approach. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Comments: all code available at https://github.com/hallfjonas/hytoperm

Performance-Guaranteed Solutions for Multi-Agent Optimal Coverage Problems using Submodularity, Curvature, and Greedy Algorithms

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We consider a class of multi-agent optimal coverage problems in which the goal is to determine the optimal placement of a group of agents in a given mission space so that they maximize a coverage objective that represents a blend of individual and collaborative event detection capabilities. This class of problems is extremely challenging due to the non-convex nature of the mission space and of the… ▽ More We consider a class of multi-agent optimal coverage problems in which the goal is to determine the optimal placement of a group of agents in a given mission space so that they maximize a coverage objective that represents a blend of individual and collaborative event detection capabilities. This class of problems is extremely challenging due to the non-convex nature of the mission space and of the coverage objective. With this motivation, greedy algorithms are often used as means of getting feasible coverage solutions efficiently. Even though such greedy solutions are suboptimal, the submodularity (diminishing returns) property of the coverage objective can be exploited to provide performance bound guarantees. Moreover, we show that improved performance bound guarantees (beyond the standard (1-1/e) performance bound) can be established using various curvature measures of the coverage problem. In particular, we provide a brief review of all existing popular applicable curvature measures, including a recent curvature measure that we proposed, and discuss their effectiveness and computational complexity, in the context of optimal coverage problems. We also propose novel computationally efficient techniques to estimate some curvature measures. Finally, we provide several numerical results to support our findings and propose several potential future research directions. △ Less

Submitted 22 March, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

Comments: Will be submitted to CDC 2024

A Bilevel Optimization Scheme for Persistent Monitoring

Authors: Jonas Hall, Logan E. Beaver, Christos G. Cassandras, Sean B. Andersson

Abstract: In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajecto… ▽ More In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajectory over which each of the target uncertainties is driven down to zero during each visit. A hierarchical decomposition leads to purely local optimal control problems, coupled via boundary conditions. We optimize both the local trajectory segments as well as the boundary conditions in an on-line bilevel optimization scheme. △ Less

Submitted 7 April, 2023; originally announced April 2023.

Learning Feasibility Constraints for Control Barrier Functions

Authors: Wei Xiao, Christos G. Cassandras, Calin A. Belta

Abstract: It has been shown that optimizing quadratic costs while stabilizing affine control systems to desired (sets of) states subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). In this paper, we employ machine learning techniques to ensure the feasibility of these QPs, which is… ▽ More It has been shown that optimizing quadratic costs while stabilizing affine control systems to desired (sets of) states subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). In this paper, we employ machine learning techniques to ensure the feasibility of these QPs, which is a challenging problem, especially for high relative degree constraints where High Order CBFs (HOCBFs) are required. To this end, we propose a sampling-based learning approach to learn a new feasibility constraint for CBFs; this constraint is then enforced by another HOCBF added to the QPs. The accuracy of the learned feasibility constraint is recursively improved by a recurrent training algorithm. We demonstrate the advantages of the proposed learning approach to constrained optimal control problems with specific focus on a robot control problem and on autonomous driving in an unknown environment. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 8 pages, to appear in ECC 2023

Minimally Disruptive Cooperative Lane-change Maneuvers

Authors: Behdad Chalaki, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Jovin D'sa, Ehsan Moradi-Pari, Andres S. Chavez Armijos, Anni Li, Christos G. Cassandras

Abstract: A lane-change maneuver on a congested highway could be severely disruptive or even infeasible without the cooperation of neighboring cars. However, cooperation with other vehicles does not guarantee that the performed maneuver will not have a negative impact on traffic flow unless it is explicitly considered in the cooperative controller design. In this letter, we present a socially compliant fram… ▽ More A lane-change maneuver on a congested highway could be severely disruptive or even infeasible without the cooperation of neighboring cars. However, cooperation with other vehicles does not guarantee that the performed maneuver will not have a negative impact on traffic flow unless it is explicitly considered in the cooperative controller design. In this letter, we present a socially compliant framework for cooperative lane-change maneuvers for an arbitrary number of CAVs on highways that aims to interrupt traffic flow as minimally as possible. Moreover, we explicitly impose feasibility constraints in the optimization formulation by using reachability set theory, leading to a unified design that removes the need for an iterative procedure used in prior work. We quantitatively evaluate the effectiveness of our framework and compare it against previously offered approaches in terms of maneuver time and incurred throughput disruption. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 6 pages, 2 figures

Journal ref: IEEE Control Systems Letters, vol. 7, pp. 1766-1771, 2023

A Graph-Based Approach to Generate Energy-Optimal Robot Trajectories in Polygonal Environments

Authors: Logan E. Beaver, Roberto Tron, Christos G. Cassandras

Abstract: As robotic systems continue to address emerging issues in areas such as logistics, mobility, manufacturing, and disaster response, it is increasingly important to rapidly generate safe and energy-efficient trajectories. In this article, we present a new approach to plan energy-optimal trajectories through cluttered environments containing polygonal obstacles. In particular, we develop a method to… ▽ More As robotic systems continue to address emerging issues in areas such as logistics, mobility, manufacturing, and disaster response, it is increasingly important to rapidly generate safe and energy-efficient trajectories. In this article, we present a new approach to plan energy-optimal trajectories through cluttered environments containing polygonal obstacles. In particular, we develop a method to quickly generate optimal trajectories for a double-integrator system, and we show that optimal path planning reduces to an integer program. To find an efficient solution, we present a distance-informed prefix search to efficiently generate optimal trajectories for a large class of environments. We demonstrate that our approach, while matching the performance of RRT* and Probabilistic Road Maps in terms of path length, outperforms both in terms of energy cost and computational time by up to an order of magnitude. We also demonstrate that our approach yields implementable trajectories in an experiment with a Crazyflie quadrotor. △ Less

Submitted 11 November, 2022; v1 submitted 9 November, 2022; originally announced November 2022.

Comments: 9 pages, 7 figures

Optimal Persistent Monitoring of Mobile Targets in One Dimension

Authors: Jonas Hall, Sean B. Andersson, Christos G. Cassandras

Abstract: This work shows the existence of optimal control laws for persistent monitoring of mobile targets in a one-dimensional mission space and derives explicit solutions. The underlying performance metric consists of minimizing the total uncertainty accumulated over a finite mission time. We first demonstrate that the corresponding optimal control problem can be reduced to a finite-dimensional optimizat… ▽ More This work shows the existence of optimal control laws for persistent monitoring of mobile targets in a one-dimensional mission space and derives explicit solutions. The underlying performance metric consists of minimizing the total uncertainty accumulated over a finite mission time. We first demonstrate that the corresponding optimal control problem can be reduced to a finite-dimensional optimization problem, and then establish existence of an optimal solution. Motivated by this result, we construct a parametric reformulation for which an event based gradient descent method is utilized with the goal of deriving (locally optimal) solutions. We additionally provide a more practical parameterization that has attractive properties such as simplicity, flexibility, and robustness. Both parameterizations are validated through simulation. △ Less

Submitted 3 October, 2022; originally announced October 2022.

Comments: Submitted to ACC 2023

Planning Strategies for Lane Reversals in Transportation Networks

Authors: Salomon Wollenstein-Betech, Ioannis Ch. Paschalidis, Christos G. Cassandras

Abstract: This paper studies strategies to optimize the lane configuration of a transportation network for a given set of Origin-Destination demands using a planning macroscopic network flow model. The lane reversal problem is, in general, NP-hard since the optimization is made over integer variables. To overcome this burden, we reformulate the problem using a piecewise affine approximation of the travel la… ▽ More This paper studies strategies to optimize the lane configuration of a transportation network for a given set of Origin-Destination demands using a planning macroscopic network flow model. The lane reversal problem is, in general, NP-hard since the optimization is made over integer variables. To overcome this burden, we reformulate the problem using a piecewise affine approximation of the travel latency function which allows us to exploit the total unimodularity property of Integer Linear Programming (ILP). Consequently, we transform the ILP problem to a linear program by relaxing the integer variables. In addition, our method is capable of solving the problem for a desired number of lane reversals which serves to perform cost-benefit analysis. We perform a case study using the transportation network of Eastern Massachusetts (EMA) and we test our method against the original lane configuration and a projected lower bound solution. Our empirical results quantify the travel time savings for different levels of demand intensity. We observe reduction in travel times up to 40% for certain links in the network. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Comments: Proc. IEEE Int. Conf. on Intelligent Transportation Systems, Indianapolis, USA, 2021. (In Press)

Event-Driven Receding Horizon Control of Energy-Aware Dynamic Agents For Distributed Persistent Monitoring

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to jointly optimize the overall agent energy consumption and a measure of overall node state uncertainty, evaluated over a finite period of interest. To achieve these objectives, we… ▽ More This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to jointly optimize the overall agent energy consumption and a measure of overall node state uncertainty, evaluated over a finite period of interest. To achieve these objectives, we extend an established event-driven Receding Horizon Control (RHC) solution by adding an optimal controller to account for agent motion dynamics and associated energy consumption. The resulting RHC solution is computationally efficient, distributed and on-line. Finally, numerical results are provided highlighting improvements compared to an existing RHC solution that uses energy-agnostic first-order agents. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Comments: Submitted to the 60th IEEE Conference on Decision and Control

Sufficient Conditions for Feasibility of Optimal Control Problems Using Control Barrier Functions

Authors: Wei Xiao, Calin Belta, Christos G. Cassandras

Abstract: It has been shown that satisfying state and control constraints while optimizing quadratic costs subject to desired (sets of) state convergence for affine control systems can be reduced to a sequence of quadratic programs (QPs) by using Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in this approach is ensuring the feasibility of these QPs, espec… ▽ More It has been shown that satisfying state and control constraints while optimizing quadratic costs subject to desired (sets of) state convergence for affine control systems can be reduced to a sequence of quadratic programs (QPs) by using Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in this approach is ensuring the feasibility of these QPs, especially under tight control bounds and safety constraints of high relative degree. In this paper, we provide sufficient conditions for guranteed feasibility. The sufficient conditions are captured by a single constraint that is enforced by a CBF, which is added to the QPs such that their feasibility is always guaranteed. The additional constraint is designed to be always compatible with the existing constraints, therefore, it cannot make a feasible set of constraints infeasible - it can only increase the overall feasibility. We illustrate the effectiveness of the proposed approach on an adaptive cruise control problem. △ Less

Submitted 16 November, 2020; originally announced November 2020.

Comments: 10 pages, submitted to Automatica

A General Framework for Decentralized Safe Optimal Control of Connected and Automated Vehicles in Multi-Lane Intersections

Authors: Huile Xu, Wei Xiao, Christos G. Cassandras, Yi Zhang, Li Li

Abstract: We address the problem of optimally controlling Connected and Automated Vehicles (CAVs) arriving from four multi-lane roads at an intersection where they conflict in terms of safely crossing (including turns) with no collision. The objective is to jointly minimize the travel time and energy consumption of each CAV while ensuring safety. This problem was solved in prior work for single-lane roads.… ▽ More We address the problem of optimally controlling Connected and Automated Vehicles (CAVs) arriving from four multi-lane roads at an intersection where they conflict in terms of safely crossing (including turns) with no collision. The objective is to jointly minimize the travel time and energy consumption of each CAV while ensuring safety. This problem was solved in prior work for single-lane roads. A direct extension to multiple lanes on each road is limited by the computational complexity required to obtain an explicit optimal control solution. Instead, we propose a general framework that first converts a multi-lane intersection problem into a decentralized optimal control problem for each CAV with less conservative safety constraints than prior work. We then employ a method combining optimal control and control barrier functions, which has been shown to efficiently track tractable unconstrained optimal CAV trajectories while also guaranteeing the satisfaction of all constraints. Simulation examples are included to show the effectiveness of the proposed framework under symmetric and asymmetric intersection geometries and different schemes for CAV sequencing. △ Less

Submitted 6 October, 2020; originally announced October 2020.

Event-Driven Receding Horizon Control for Distributed Estimation in Network Systems

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We consider the problem of estimating the states of a distributed network of nodes (targets) through a team of cooperating agents (sensors) persistently visiting the nodes so that an overall measure of estimation error covariance evaluated over a finite period is minimized. We formulate this as a multi-agent persistent monitoring problem where the goal is to control each agent's trajectory defined… ▽ More We consider the problem of estimating the states of a distributed network of nodes (targets) through a team of cooperating agents (sensors) persistently visiting the nodes so that an overall measure of estimation error covariance evaluated over a finite period is minimized. We formulate this as a multi-agent persistent monitoring problem where the goal is to control each agent's trajectory defined as a sequence of target visits and the corresponding dwell times spent making observations at each visited target. A distributed on-line agent controller is developed where each agent solves a sequence of receding horizon control problems (RHCPs) in an event-driven manner. A novel objective function is proposed for these RHCPs so as to optimize the effectiveness of this distributed estimation process and its unimodality property is established under some assumptions. Moreover, a machine learning solution is proposed to improve the computational efficiency of this distributed estimation process by exploiting the history of each agent's trajectory. Finally, extensive numerical results are provided indicating significant improvements compared to other state-of-the-art agent controllers. △ Less

Submitted 12 October, 2021; v1 submitted 24 September, 2020; originally announced September 2020.

Comments: Submitted to IEEE Transactions on Automatic Control

Comparison of Centralized and Decentralized Approaches in Cooperative Coverage Problems with Energy-Constrained Agents

Authors: Xiangyu Meng, Xinmiao Sun, Christos G. Cassandras, Kaiyuan Xu

Abstract: A multi-agent coverage problem is considered with energy-constrained agents. The objective of this paper is to compare the coverage performance between centralized and decentralized approaches. To this end, a near-optimal centralized coverage control method is developed under energy depletion and repletion constraints. The optimal coverage formation corresponds to the locations of agents where the… ▽ More A multi-agent coverage problem is considered with energy-constrained agents. The objective of this paper is to compare the coverage performance between centralized and decentralized approaches. To this end, a near-optimal centralized coverage control method is developed under energy depletion and repletion constraints. The optimal coverage formation corresponds to the locations of agents where the coverage performance is maximized. The optimal charging formation corresponds to the locations of agents with one agent fixed at the charging station and the remaining agents maximizing the coverage performance. We control the behavior of this cooperative multi-agent system by switching between the optimal coverage formation and the optimal charging formation. Finally, the optimal dwell times at coverage locations, charging time, and agent trajectories are determined so as to maximize coverage over a given time interval. In particular, our controller guarantees that at any time there is at most one agent leaving the team for energy repletion. △ Less

Submitted 25 August, 2020; originally announced August 2020.

Combined Eco-Routing and Power-Train Control of Plug-In Hybrid Electric Vehicles in Transportation Networks

Authors: Arian Houshmand, Christos G. Cassandras, Nan Zhou, Nasser Hashemi, Boqi Li, Huei Peng

Abstract: We study the problem of eco-routing for Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption cost. We propose an algorithm which can simultaneously calculate an energy-optimal route (eco-route) for a PHEV and an optimal power-train control strategy over this route. In order to show the effectiveness of our method in practice, we use a HERE Maps API to apply our algor… ▽ More We study the problem of eco-routing for Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption cost. We propose an algorithm which can simultaneously calculate an energy-optimal route (eco-route) for a PHEV and an optimal power-train control strategy over this route. In order to show the effectiveness of our method in practice, we use a HERE Maps API to apply our algorithms based on traffic data in the city of Boston with more than 110,000 links. Moreover, we validate the performance of our eco-routing algorithm using speed profiles collected from a traffic simulator (SUMO) as input to a high-fidelity energy model to calculate energy consumption costs. Our results show significant energy savings (around 12%) for PHEVs with a near real-time execution time for the algorithm. △ Less

Submitted 9 April, 2020; originally announced April 2020.

Comments: arXiv admin note: text overlap with arXiv:1810.01443

Joint Pricing and Rebalancing of Autonomous Mobility-on-Demand Systems

Authors: Salomón Wollenstein-Betech, Ioannis Ch. Paschalidis, Christos G. Cassandras

Abstract: This paper studies optimal pricing and rebalancing policies for Autonomous Mobility-on-Demand (AMoD) systems. We take a macroscopic planning perspective to tackle a profit maximization problem while ensuring that the system is load-balanced. We begin by describing the system using a dynamic fluid model to show the existence and stability of an equilibrium (i.e., load balance) through pricing polic… ▽ More This paper studies optimal pricing and rebalancing policies for Autonomous Mobility-on-Demand (AMoD) systems. We take a macroscopic planning perspective to tackle a profit maximization problem while ensuring that the system is load-balanced. We begin by describing the system using a dynamic fluid model to show the existence and stability of an equilibrium (i.e., load balance) through pricing policies. We then develop an optimization framework that allows us to find optimal policies in terms of pricing and rebalancing. We first maximize profit by only using pricing policies, then incorporate rebalancing, and finally we consider whether the solution is found sequentially or jointly. We apply each approach on a data-driven case study using real taxi data from New York City. Depending on which benchmarking solution we use, the joint problem (i.e., pricing and rebalancing) increases profits by 7% to 40% △ Less

Submitted 30 March, 2020; originally announced March 2020.

Comments: Submitted to the 59th IEEE Conference on Decision and Control (CDC 2020)

Event-Driven Receding Horizon Control For Distributed Persistent Monitoring in Network Systems

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally… ▽ More We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally efficient, distributed and on-line. The proposed controller differs from the existing on-line gradient-based parametric controllers and off-line greedy cycle search methods that often lead to either low-performing local optima or computationally intensive centralized solutions. A critical novel element in this controller is that it automatically optimizes its planning horizon length, thus making it parameter-free. We show that explicit globally optimal solutions can be obtained for every distributed optimization problem encountered at each event where the receding horizon controller is invoked. Numerical results are provided showing improvements compared to state of the art distributed on-line parametric control solutions. △ Less

Submitted 3 October, 2020; v1 submitted 25 March, 2020; originally announced March 2020.

Comments: Submitted to Automatica

Optimal Composition of Heterogeneous Multi-Agent Teams for Coverage Problems with Performance Bound Guarantees

Authors: Chuangchuang Sun, Shirantha Welikala, Christos G. Cassandras

Abstract: We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Grad… ▽ More We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Gradient Ascent (PGA) algorithm to solve the optimal team composition problem. To deal with non-convexity, we initialize the algorithm using a greedy method and exploit the submodularity and curvature properties of the coverage objective function to derive novel tighter performance bound guarantees on the optimization problem solution. Numerical examples are included to validate the effectiveness of this approach in diverse mission space configurations and different heterogeneous multi-agent collections. Comparative results obtained using a commercial mixed-integer nonlinear programming problem solver demonstrate both the accuracy and computational efficiency of the distributed PGA algorithm. △ Less

Submitted 11 March, 2020; originally announced March 2020.

Comments: To be published in Automatica

Report number: 00051098

Journal ref: Automatica (2020) 117

Congestion-aware Routing and Rebalancing of Autonomous Mobility-on-Demand Systems in Mixed Traffic

Authors: Salomón Wollenstein-Betech, Arian Houshmand, Mauro Salazar, Marco Pavone, Christos G. Cassandras, Ioannis Ch. Paschalidis

Abstract: This paper studies congestion-aware route-planning policies for Autonomous Mobility-on-Demand (AMoD) systems, whereby a fleet of autonomous vehicles provides on-demand mobility under mixed traffic conditions. Specifically, we first devise a network flow model to optimize the AMoD routing and rebalancing strategies in a congestion-aware fashion by accounting for the endogenous impact of AMoD flows… ▽ More This paper studies congestion-aware route-planning policies for Autonomous Mobility-on-Demand (AMoD) systems, whereby a fleet of autonomous vehicles provides on-demand mobility under mixed traffic conditions. Specifically, we first devise a network flow model to optimize the AMoD routing and rebalancing strategies in a congestion-aware fashion by accounting for the endogenous impact of AMoD flows on travel time. Second, we capture reactive exogenous traffic consisting of private vehicles selfishly adapting to the AMoD flows in a user-centric fashion by leveraging an iterative approach. Finally, we showcase the effectiveness of our framework with two case-studies considering the transportation sub-networks in Eastern Massachusetts and New York City. Our results suggest that for high levels of demand, pure AMoD travel can be detrimental due to the additional traffic stemming from its rebalancing flows, while the combination of AMoD with walking or micromobility options can significantly improve the overall system performance. △ Less

Submitted 9 March, 2020; originally announced March 2020.

Comments: Submitted to the 23rd IEEE International Conference on Intelligent Transportation Systems (ITSC'20)

A Bi-Level Cooperative Driving Strategy Allowing Lane Changes

Authors: Huile Xu, Yi Zhang, Christos G. Cassandras, Li Li, Shuo Feng

Abstract: This paper studies the cooperative driving of connected and automated vehicles (CAVs) at conflict areas (e.g., non-signalized intersections and ram** regions). Due to safety concerns, most existing studies prohibit lane change since this may cause lateral collisions when coordination is not appropriately performed. However, in many traffic scenarios (e.g., work zones), vehicles must change lanes… ▽ More This paper studies the cooperative driving of connected and automated vehicles (CAVs) at conflict areas (e.g., non-signalized intersections and ram** regions). Due to safety concerns, most existing studies prohibit lane change since this may cause lateral collisions when coordination is not appropriately performed. However, in many traffic scenarios (e.g., work zones), vehicles must change lanes. To solve this problem, we categorize the potential collision into two kinds and thus establish a bi-level planning problem. The right-of-way of vehicles for the critical conflict zone is considered in the upper-level, and the right-of-way of vehicles during lane changes is then resolved in the lower-level. The solutions of the upper-level problem are represented in tree space, and a near-optimal solution is searched for by combining Monte Carlo Tree Search (MCTS) with some heuristic rules within a very short planning time. The proposed strategy is suitable for not only the shortest delay objective but also other objectives (e.g., energy-saving and passenger comfort). Numerical examples show that the proposed strategy leads to good traffic performance in real-time. △ Less

Submitted 24 December, 2019; originally announced December 2019.

Feasibility-Guided Learning for Robust Control in Constrained Optimal Control Problems

Authors: Wei Xiao, Calin A. Belta, Christos G. Cassandras

Abstract: Optimal control problems with constraints ensuring safety and convergence to desired states can be mapped onto a sequence of real time optimization problems through the use of Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in these approaches is ensuring the feasibility of the resulting quadratic programs (QPs) if the system is affine in controls… ▽ More Optimal control problems with constraints ensuring safety and convergence to desired states can be mapped onto a sequence of real time optimization problems through the use of Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in these approaches is ensuring the feasibility of the resulting quadratic programs (QPs) if the system is affine in controls. The recently proposed penalty method has the potential to improve the existence of feasible solutions to such problems. In this paper, we further improve the feasibility robustness (i.e., feasibility maintenance in the presence of time-varying and unknown unsafe sets) through the definition of a High Order CBF (HOCBF) that works for arbitrary relative degree constraints; this is achieved by a proposed feasibility-guided learning approach. Specifically, we apply machine learning techniques to classify the parameter space of a HOCBF into feasible and infeasible sets, and get a differentiable classifier that is then added to the learning process. The proposed feasibility-guided learning approach is compared with the gradient-descent method on a robot control problem. The simulation results show an improved ability of the feasibility-guided learning approach over the gradient-decent method to determine the optimal parameters in the definition of a HOCBF for the feasibility robustness, as well as show the potential of the CBF method for robot safe navigation in an unknown environment. △ Less

Submitted 6 December, 2019; originally announced December 2019.

Comments: 8 pages, submitted to L-CSS

Collision-Free Trajectory Design for 2D Persistent Monitoring Using Second-Order Agents

Authors: Yan-Wu Wang, Ming-Jie Zhao, Wu Yang, Nan Zhou, Christos G. Cassandras

Abstract: This paper considers a two-dimensional persistent monitoring problem by controlling movements of second-order agents to minimize some uncertainty metric associated with targets in a dynamic environment. In contrast to common sensing models depending only on the distance from a target, we introduce an active sensing model which considers the distance between an agent and a target, as well as the ag… ▽ More This paper considers a two-dimensional persistent monitoring problem by controlling movements of second-order agents to minimize some uncertainty metric associated with targets in a dynamic environment. In contrast to common sensing models depending only on the distance from a target, we introduce an active sensing model which considers the distance between an agent and a target, as well as the agent's velocity. We propose an objective function which can achieve a collision-free agent trajectory by penalizing all possible collisions. Applying structural properties of the optimal control derived from the Hamiltonian analysis, we limit agent trajectories to a simpler parametric form under a family of 2D curves depending on the problem setting, e.g. ellipses and Fourier trajectories. Our collision-free trajectories are optimized through an event-driven Infinitesimal Perturbation Analysis (IPA) and gradient descent method. Although the solution is generally locally optimal, this method is computationally efficient and offers an alternative to other traditional time-driven methods. Finally, simulation examples are provided to demonstrate our proposed results. △ Less

Submitted 11 November, 2019; originally announced November 2019.

Comments: 13 pages arXiv, to be published in IEEE Transactions on Control of Network Systems

Asymptotic Analysis for Greedy Initialization of Threshold-Based Distributed Optimization of Persistent Monitoring on Graphs

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed i… ▽ More This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed in prior work to control agent dwell times at nodes and next-node destinations by enforcing thresholds on the respective node states. Under such a Threshold Control Policy (TCP), an on-line gradient technique was used to determine optimal threshold values. However, due to the non-convexity of the problem, this approach often leads to a poor local optima highly dependent on the initial thresholds used. To overcome this initialization challenge, we develop a computationally efficient off-line greedy technique based on the asymptotic analysis of the network system. This analysis is then used to generate a high-performing set of initial thresholds. Extensive numerical results show that such initial thresholds are almost immediately (locally) optimal or quickly lead to optimal values. In all cases, they perform significantly better than the locally optimal solutions known to date. △ Less

Submitted 10 December, 2020; v1 submitted 6 November, 2019; originally announced November 2019.

Comments: Submitted to Automatica

The Penetration Rate Effect of Connected and Automated Vehicles in Mixed Traffic Routing

Authors: Arian Houshmand, Salomón Wollenstein-Betech, Christos G. Cassandras

Abstract: We study the problem of routing Connected and Automated Vehicles (CAVs) in the presence of mixed traffic (coexistence of regular vehicles and CAVs). In this setting, we assume that all CAVs belong to the same fleet, and can be routed using a centralized controller. The routing objective is to minimize a given overall fleet traveling cost (travel time or energy consumption). We assume that regular… ▽ More We study the problem of routing Connected and Automated Vehicles (CAVs) in the presence of mixed traffic (coexistence of regular vehicles and CAVs). In this setting, we assume that all CAVs belong to the same fleet, and can be routed using a centralized controller. The routing objective is to minimize a given overall fleet traveling cost (travel time or energy consumption). We assume that regular vehicles (non-CAVs) choose their routing decisions selfishly to minimize their traveling time. We propose an algorithm that deals with the routing interaction between CAVs and regular uncontrolled vehicles. We investigate the effect of assigning system-centric routes under different penetration rates (fractions) of CAVs. To validate our method, we apply the proposed routing algorithms to the Braess Network and to a sub-network of the Eastern Massachusetts (EMA) transportation network using actual traffic data provided by the Boston Region Metropolitan Planning Organization. The results suggest that collaborative routing decisions of CAVs improve not only the cost of CAVs, but also that of the non-CAVs. Furthermore, even a small CAV penetration rate can ease congestion for the entire network. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Joint Time and Energy-Optimal Control of Connected Automated Vehicles at Signal-Free Intersections with Speed-Dependent Safety Guarantees

Authors: Yue Zhang, Christos G. Cassandras

Abstract: We extend earlier work establishing a framework for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal free intersection by jointly optimizing energy and travel time. We derive explicit optimal control solutions in a decentralized manner that guarantee both a speed-dependent rear-end safety constraint and a time-dependent lateral collision constraint, in addition to lower/… ▽ More We extend earlier work establishing a framework for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal free intersection by jointly optimizing energy and travel time. We derive explicit optimal control solutions in a decentralized manner that guarantee both a speed-dependent rear-end safety constraint and a time-dependent lateral collision constraint, in addition to lower/upper bounds on speed and acceleration. Extensive simulation examples are included to illustrate this framework. △ Less

Submitted 30 August, 2019; v1 submitted 13 March, 2019; originally announced March 2019.

Comments: 11 pages. This article draws from arXiv:1903.04600 and is submitted to CDC19

Decentralized Optimal Control of Connected Automated Vehicles at Signal-Free Intersections Including Comfort-Constrained Turns and Safety Guarantees

Authors: Yue Zhang, Christos G. Cassandras

Abstract: We extend earlier work for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal-free intersection by including all possible turns taken so as to optimize a passenger comfort metric along with energy and travel time minimization. We show that it is possible to achieve this goal in a decentralized manner with each CAV solving an optimal control problem, and derive explicit sol… ▽ More We extend earlier work for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal-free intersection by including all possible turns taken so as to optimize a passenger comfort metric along with energy and travel time minimization. We show that it is possible to achieve this goal in a decentralized manner with each CAV solving an optimal control problem, and derive explicit solutions that guarantee collision avoidance and safe distance constraints within a control zone. We investigate the associated tradeoffs between minimizing energy and vehicle travel time, as well as the passenger comfort metric and include extensive simulations to illustrate this framework. △ Less

Submitted 11 March, 2019; originally announced March 2019.

Comments: 16 pages

Distributed Non-convex Optimization of Multi-agent Systems Using Boosting Functions to Escape Local Optima: Theory and Applications

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distri… ▽ More We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distributed Boosting Scheme (DBS) based on a gradient-based optimization algorithm using a novel optimal variable step size mechanism so as to guarantee convergence. Even though our motivation is based on the coverage control problem setting, our analysis applies to a broad class of multi-agent problems. Simulation results are provided to compare the performance of different boosting functions families and to demonstrate the effectiveness of the boosting function approach in attaining improved (still generally local) optima. △ Less

Submitted 15 July, 2020; v1 submitted 11 March, 2019; originally announced March 2019.

Comments: Submitted to IEEE Transactions on Automatic Control

Eco-Routing of Plug-In Hybrid Electric Vehicles in Transportation Networks

Authors: Arian Houshmand, Christos G. Cassandras

Abstract: We study the problem of eco-routing Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption costs. Unlike the traditional Charge Depleting First (CDF) approaches in the literature where the power-train control strategy is fixed, we propose a Combined Routing and Power-train Control (CRPTC) algorithm which can simultaneously calculate the optimal energy route as well as… ▽ More We study the problem of eco-routing Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption costs. Unlike the traditional Charge Depleting First (CDF) approaches in the literature where the power-train control strategy is fixed, we propose a Combined Routing and Power-train Control (CRPTC) algorithm which can simultaneously calculate the optimal energy route as well as the optimal power-train control strategy. To validate our method, we apply our eco-routing algorithm to a subnetwork of the Eastern Massachusetts (EMA) transportation network using actual traffic data provided by the Boston Region Metropolitan Planning Organization. As an alternative benchmark, we also simulate the traffic behavior of the network using the extracted flow data from the aforementioned traffic dataset. We show that the CRPTC approach outperforms the traditional CDF approach and we quantify the trade-off between saving energy and time in using eco-routing algorithms. △ Less

Submitted 2 October, 2018; originally announced October 2018.

A Decentralized Optimal Control Framework for Connected Automated Vehicles at Urban Intersections with Dynamic Resequencing

Authors: Yue Zhang, Christos G. Cassandras

Abstract: Earlier work has established a decentralized framework to optimally control Connected Automated Vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling while following a strict First-In-First-Out (FIFO) queueing structure. The proposed solution minimizes energy consumption subject to a FIFO-based throughput maximization requirement. In this paper, we extend the solu… ▽ More Earlier work has established a decentralized framework to optimally control Connected Automated Vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling while following a strict First-In-First-Out (FIFO) queueing structure. The proposed solution minimizes energy consumption subject to a FIFO-based throughput maximization requirement. In this paper, we extend the solution to account for asymmetric intersections by relaxing the FIFO constraint and including a dynamic resequencing process so as to maximize traffic throughput. To investigate the tradeoff between throughput maximization and energy minimization objectives, we exploit several alternative problem formulations. In addition, the computational complexity of the resequencing process is analyzed and proved to be bounded, which makes the online implementation computationally feasible. The effectiveness of the dynamic resequencing process in terms of throughput maximization is illustrated through simulation △ Less

Submitted 1 September, 2018; originally announced September 2018.

The Penetration Effect of Connected Automated Vehicles in Urban Traffic: An Energy Impact Study

Authors: Yue Zhang, Christos G. Cassandras

Abstract: Earlier work has established a decentralized framework of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling. The proposed solution is capable of minimizing energy consumption subject to a throughput maximization requirement. In this paper, we address the problem of optimally controlling CAVs under mixed traffic con… ▽ More Earlier work has established a decentralized framework of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling. The proposed solution is capable of minimizing energy consumption subject to a throughput maximization requirement. In this paper, we address the problem of optimally controlling CAVs under mixed traffic conditions where both CAVs and human-driven vehicles (non-CAVs) travel on the roads, so as to minimize energy consumption while guaranteeing safety constraints. The impact of CAVs on overall energy consumption is also investigated under different traffic scenarios. The benefit from CAV penetration (i.e., the fraction of CAVs relative to all vehicles) is validated through simulation in MATLAB and VISSIM. The results indicate that the energy efficiency improvement becomes more significant as the CAV penetration rate increases, while the significance diminishes as the traffic becomes heavier △ Less

Submitted 14 March, 2018; originally announced March 2018.

Comments: 8 pages

Optimal Threshold-Based Control Policies for Persistent Monitoring on Graphs

Authors: Nan Zhou, Christos G. Cassandras, Xi Yu, Sean B. Andersson

Abstract: We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since… ▽ More We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since such optimal trajectories are generally intractable, we propose a class of distributed threshold-based parametric controllers through which agent transitions from one node to the next are controlled by threshold parameters on the node uncertainty states. The resulting behavior of the agent-target system can be described by a hybrid dynamic system. This enables the use of Infinitesimal Perturbation Analysis (IPA) to determine on line (locally) optimal threshold parameters through gradient descent methods and thus obtain optimal controllers within this family of threshold-based policies. We further show that in a single-agent case the IPA gradient is monotonic, which implies a simple structure whereby an agent visiting a node should reduce the uncertainty state to zero before moving to the next node. Simulation examples are included to illustrate our results and compare them to optimal solutions derived through dynamic programming when this is possible. △ Less

Submitted 7 March, 2018; originally announced March 2018.

Comments: 11 pages full version

Decentralized Event-Driven Algorithms for Multi-Agent Persistent Monitoring

Authors: Nan Zhou, Christos G. Cassandras, Xi Yu, Sean B. Andersson

Abstract: We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-… ▽ More We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-dimensional setting, it has been shown that the optimal solution can be reduced to a simpler parametric optimization problem and that the behavior of agents under optimal control is described by a hybrid system. This hybrid system can be analyzed using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven centralized gradient-based algorithm. We show that the IPA gradient can be recovered in a distributed manner in which each agent optimizes its trajectory based on local information, except for one event requiring communication from a non-neighbor agent. Simulation examples are included to illustrate the effectiveness of this "almost decentralized" algorithm and its fully decentralized counterpart where the aforementioned non-local event is ignored. △ Less

Submitted 21 August, 2017; originally announced August 2017.

Comments: 9 pages full version, IEEE Conference on Decision and Control, 2017

A Submodularity-Based Approach for Multi-Agent Optimal Coverage Problems

Authors: Xinmiao Sun, Christos G. Cassandras, Xiangyu Meng

Abstract: We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is guaranteed by gradient-based algorithms developed to date. We first show that the objective function is monotone submodular, a class of functions for which a s… ▽ More We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is guaranteed by gradient-based algorithms developed to date. We first show that the objective function is monotone submodular, a class of functions for which a simple greedy algorithm is known to be within 0.63 of the optimal solution. We then derive two tighter lower bounds by exploiting the curvature information (total curvature and elemental curvature) of the objective function. We further show that the tightness of these lower bounds is complementary with respect to the sensing capabilities of the agents. The greedy algorithm solution can be subsequently used as an initial point for a gradient-based algorithm to obtain solutions even closer to the global optimum. Simulation results show that this approach leads to significantly better performance relative to previously used algorithms. △ Less

Submitted 14 August, 2017; originally announced August 2017.

Decentralized Optimal Control for Connected Automated Vehicles at Intersections Including Left and Right Turns

Authors: Yue Zhang, Andreas A. Malikopoulos, Christos G. Cassandras

Abstract: In prior work, we addressed the problem of optimally controlling on line connected and automated vehicles crossing two adjacent intersections in an urban area to minimize fuel consumption while achieving maximal throughput without any explicit traffic signaling and without considering left and right turns. In this paper, we extend the solution of this problem to account for left and right turns un… ▽ More In prior work, we addressed the problem of optimally controlling on line connected and automated vehicles crossing two adjacent intersections in an urban area to minimize fuel consumption while achieving maximal throughput without any explicit traffic signaling and without considering left and right turns. In this paper, we extend the solution of this problem to account for left and right turns under hard safety constraints. Furthermore, we formulate and solve another optimization problem to minimize a measure of passenger discomfort while the vehicle turns at the intersection and we investigate the associated tradeoff between minimizing fuel consumption and passenger discomfort. △ Less

Submitted 11 September, 2017; v1 submitted 20 March, 2017; originally announced March 2017.

Event-driven Trajectory Optimization for Data Harvesting in Multi-Agent Systems

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We propose a new event-driven method for on-line trajectory optimization to solve the data harvesting problem: in a two-dimensional mission space, N mobile agents are tasked with the collection of data generated at M stationary sources and delivery to a base with the goal of minimizing expected collection and delivery delays. We define a new performance measure that addresses the event excitation… ▽ More We propose a new event-driven method for on-line trajectory optimization to solve the data harvesting problem: in a two-dimensional mission space, N mobile agents are tasked with the collection of data generated at M stationary sources and delivery to a base with the goal of minimizing expected collection and delivery delays. We define a new performance measure that addresses the event excitation problem in event-driven controllers and formulate an optimal control problem. The solution of this problem provides some insights on its structure, but it is computationally intractable, especially in the case where the data generating processes are stochastic. We propose an agent trajectory parameterization in terms of general function families which can be subsequently optimized on line through the use of Infinitesimal Perturbation Analysis (IPA). Properties of the solutions are identified, including robustness with respect to the stochastic data generation process and scalability in the size of the event set characterizing the underlying hybrid dynamical system. Explicit results are provided for the case of elliptical and Fourier series trajectories and comparisons with a state-of-the-art graph-based algorithm are given. △ Less

Submitted 22 August, 2016; originally announced August 2016.

Comments: arXiv admin note: substantial text overlap with arXiv:1503.06133

Optimal Control of Connected Automated Vehicles at Urban Traffic Intersections: A Feasibility Enforcement Analysis

Authors: Yue Zhang, Christos G. Cassandras, Andreas A. Malikopoulos

Abstract: Earlier work has established a decentralized optimal control framework for coordinating online a continuous flow of connected automated vehicles (CAVs) entering a control zone and crossing two adjacent intersections in an urban area. A solution, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and… ▽ More Earlier work has established a decentralized optimal control framework for coordinating online a continuous flow of connected automated vehicles (CAVs) entering a control zone and crossing two adjacent intersections in an urban area. A solution, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and under the hard safety constraint of collision avoidance. We establish the conditions under which such solutions exist and show that they can be enforced through an appropriately designed feasibility enforcement zone that precedes the control zone. The proposed solution and overall control architecture are illustrated through simulation. △ Less

Submitted 20 February, 2017; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 8 pages, 7 figures. arXiv admin note: text overlap with arXiv:1509.08689

The Price of Anarchy in Transportation Networks: Data-Driven Evaluation and Reduction Strategies

Authors: **g Zhang, Sepideh Pourazarm, Christos G. Cassandras, Ioannis Ch. Paschalidis

Abstract: Among the many functions a Smart City must support, transportation dominates in terms of resource consumption, strain on the environment, and frustration of its citizens. We study transportation networks under two different routing policies, the commonly assumed selfish user-centric routing policy and a socially-optimal system-centric one. We consider a performance metric of efficiency - the Price… ▽ More Among the many functions a Smart City must support, transportation dominates in terms of resource consumption, strain on the environment, and frustration of its citizens. We study transportation networks under two different routing policies, the commonly assumed selfish user-centric routing policy and a socially-optimal system-centric one. We consider a performance metric of efficiency - the Price of Anarchy (PoA) - defined as the ratio of the total travel latency cost under selfish routing over the corresponding quantity under socially-optimal routing. We develop a data-driven approach to estimate the PoA, which we subsequently use to conduct a case study using extensive actual traffic data from the Eastern Massachusetts road network. To estimate the PoA, our approach learns from data a complete model of the transportation network, including origin-destination demand and user preferences. We leverage this model to propose possible strategies to reduce the PoA and increase efficiency. △ Less

Submitted 3 January, 2018; v1 submitted 7 June, 2016; originally announced June 2016.

MSC Class: 90C33; 90C90; 90C30

Event excitation for event-driven control and optimization of multi-agent systems

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We consider event-driven methods in a general framework for the control and optimization of multi-agent systems, viewing them as stochastic hybrid systems. Such systems often have feasible realizations in which the events needed to excite an on-line event-driven controller cannot occur, rendering the use of such controllers ineffective. We show that this commonly happens in environments which cont… ▽ More We consider event-driven methods in a general framework for the control and optimization of multi-agent systems, viewing them as stochastic hybrid systems. Such systems often have feasible realizations in which the events needed to excite an on-line event-driven controller cannot occur, rendering the use of such controllers ineffective. We show that this commonly happens in environments which contain discrete points of interest which the agents must visit. To address this problem in event-driven gradient-based optimization problems, we propose a new metric for the objective function which creates a potential field guaranteeing that gradient values are non-zero when no events are present and which results in eventual event excitation. We apply this approach to the class of cooperative multi-agent data collection problems using the event-driven Infinitesimal Perturbation Analysis (IPA) methodology and include numerical examples illustrating its effectiveness. △ Less

Submitted 3 April, 2016; originally announced April 2016.

Comments: Accepted for Presentation in WODES 2016

Optimal Energy-Efficient Downlink Transmission Scheduling for Real-Time Wireless Networks

Authors: Lei Miao, Jianfeng Mao, Christos G. Cassandras

Abstract: It has been shown that using appropriate channel coding schemes in wireless environments, transmission energy can be significantly reduced by controlling the packet transmission rate. This paper seeks optimal solutions for downlink transmission control problems, motivated by this observation and by the need to minimize energy consumption in real-time wireless networks. Our problem formulation deal… ▽ More It has been shown that using appropriate channel coding schemes in wireless environments, transmission energy can be significantly reduced by controlling the packet transmission rate. This paper seeks optimal solutions for downlink transmission control problems, motivated by this observation and by the need to minimize energy consumption in real-time wireless networks. Our problem formulation deals with a more general setting than the paper authored by Gamal et. al., in which the MoveRight algorithm is proposed. The MoveRight algorithm is an iterative algorithm that converges to the optimal solution. We show that even under the more general setting, the optimal solution can be efficiently obtained through an approach decomposing the optimal sample path through certain "critical tasks" which in turn can be efficiently identified. We include simulation results showing that our algorithm is significantly faster than the MoveRight algorithm. We also discuss how to utilize our results and receding horizon control to perform on-line transmission scheduling where future task information is unknown. △ Less

Submitted 17 March, 2016; originally announced March 2016.

Comments: Submitted to IEEE Transactions on Control of Network Systems

Optimal Event-Driven Multi-Agent Persistent Monitoring of a Finite Set of Targets

Authors: Nan Zhou, Xi Yu, Sean B. Andersson, Christos G. Cassandras

Abstract: We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite… ▽ More We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite amount of time and then switch direction. This amounts to a hybrid system which we analyze using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven gradient-based algorithm which is also robust with respect to the uncertainty model used. The resulting controller depends on observing the events required to excite the gradient-based algorithm, which cannot be guaranteed. We solve this problem by proposing a new metric for the objective function which creates a potential field guaranteeing that gradient values are non-zero. This approach is compared to an alternative graph-based task scheduling algorithm for determining an optimal sequence of target visits. Simulation examples are included to demonstrate the proposed methods. △ Less

Submitted 13 March, 2016; originally announced March 2016.

Comments: 12 pages full version, IEEE Conference on Decision and Control, 2016

Personalized Cancer Therapy Design: Robustness vs. Optimality

Authors: Julia L. Fleck, Christos G. Cassandras

Abstract: Intermittent Androgen Suppression (IAS) is a treatment strategy for delaying or even preventing time to relapse of advanced prostate cancer. IAS consists of alternating cycles of therapy (in the form of androgen suppression) and off-treatment periods. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy an… ▽ More Intermittent Androgen Suppression (IAS) is a treatment strategy for delaying or even preventing time to relapse of advanced prostate cancer. IAS consists of alternating cycles of therapy (in the form of androgen suppression) and off-treatment periods. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy and when therapy will resume. In spite of extensive recent clinical experience with IAS, the design of an ideal protocol for any given patient remains one of the main challenges associated with effectively implementing this therapy. We use a threshold-based policy for optimal IAS therapy design that is parameterized by lower and upper PSA threshold values and is associated with a cost metric that combines clinically relevant measures of therapy success. We apply Infinitesimal Perturbation Analysis (IPA) to a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under IAS and derive unbiased estimators of the cost metric gradient with respect to various model and therapy parameters. These estimators are subsequently used for system analysis. By evaluating sensitivity estimates with respect to several model parameters, we identify critical parameters and demonstrate that relaxing the optimality condition in favor of increased robustness to modeling errors provides an alternative objective to therapy design for at least some patients. △ Less

Submitted 2 March, 2016; originally announced March 2016.

A Decentralized Energy-Optimal Control Framework for Connected Automated Vehicles at Signal-Free Intersections

Authors: Andreas A. Malikopoulos, Christos G. Cassandras, Yue J. Zhang

Abstract: We address the problem of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without any explicit traffic signaling, so as to minimize energy consumption subject to a throughput maximization requirement. We show that the solution of the throughput maximization problem depends only on the hard safety constraints imposed on CAVs and its structure enables a d… ▽ More We address the problem of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without any explicit traffic signaling, so as to minimize energy consumption subject to a throughput maximization requirement. We show that the solution of the throughput maximization problem depends only on the hard safety constraints imposed on CAVs and its structure enables a decentralized optimal control problem formulation for energy minimization. We present a complete analytical solution of these decentralized problems and derive conditions under which feasible solutions satisfying all safety constraints always exist. The effectiveness of the proposed solution is illustrated through simulation which shows substantial dual benefits of the proposed decentralized framework by allowing CAVs to conserve momentum and fuel while also improving travel time. △ Less

Submitted 31 March, 2018; v1 submitted 11 February, 2016; originally announced February 2016.

Comments: 17 pages, 7 figures, Automatica, 2018

Solving A Class of Discrete Event Simulation-based Optimization Problems Using "Optimality in Probability"

Authors: Jianfeng Mao, Christos G. Cassandras

Abstract: We approach a class of discrete event simulation-based optimization problems using optimality in probability, an approach which yields what is termed a "champion solution". Compared to the traditional optimality in expectation, this approach favors the solution whose actual performance is more likely better than that of any other solution; this is an effective alternative to the traditional optima… ▽ More We approach a class of discrete event simulation-based optimization problems using optimality in probability, an approach which yields what is termed a "champion solution". Compared to the traditional optimality in expectation, this approach favors the solution whose actual performance is more likely better than that of any other solution; this is an effective alternative to the traditional optimality sense, especially when facing a dynamic and nonstationary environment. Moreover, using optimality in probability is computationally promising for a class of discrete event simulation-based optimization problems, since it can reduce computational complexity by orders of magnitude compared to general simulation-based optimization methods using optimality in expectation. Accordingly, we have developed an "Omega Median Algorithm" in order to effectively obtain the champion solution and to fully utilize the efficiency of well-developed off-line algorithms to further facilitate timely decision making. An inventory control problem with nonstationary demand is included to illustrate and interpret the use of the Omega Median Algorithm, whose performance is tested using simulations. △ Less

Submitted 14 January, 2016; originally announced January 2016.

Optimal Control and Coordination of Connected and Automated Vehicles at Urban Traffic Intersections

Authors: Yue J. Zhang, Andreas A. Malikopoulos, Christos G. Cassandras

Abstract: We address the problem of coordinating online a continuous flow of connected and automated vehicles (CAVs) crossing two adjacent intersections in an urban area. We present a decentralized optimal control framework whose solution yields for each vehicle the optimal acceleration/deceleration at any time in the sense of minimizing fuel consumption. The solu- tion, when it exists, allows the vehicles… ▽ More We address the problem of coordinating online a continuous flow of connected and automated vehicles (CAVs) crossing two adjacent intersections in an urban area. We present a decentralized optimal control framework whose solution yields for each vehicle the optimal acceleration/deceleration at any time in the sense of minimizing fuel consumption. The solu- tion, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and under the hard safety constraint of collision avoidance. The effectiveness of the proposed solution is validated through simulation considering two intersections located in downtown Boston, and it is shown that coordination of CAVs can reduce significantly both fuel consumption and travel time. △ Less

Submitted 16 June, 2017; v1 submitted 29 September, 2015; originally announced September 2015.

Comments: 6 pages, 4 figures

Lifetime Maximization of Wireless Sensor Networks with a Mobile Source Node

Authors: Sepideh Pourazarm, Christos G. Cassandras

Abstract: We study the problem of routing in sensor networks where the goal is to maximize the network's lifetime. Previous work has considered this problem for fixed-topology networks. Here, we add mobility to the source node, which requires a new definition of the network lifetime. In particular, we redefine lifetime to be the time until the source node depletes its energy. When the mobile node's trajecto… ▽ More We study the problem of routing in sensor networks where the goal is to maximize the network's lifetime. Previous work has considered this problem for fixed-topology networks. Here, we add mobility to the source node, which requires a new definition of the network lifetime. In particular, we redefine lifetime to be the time until the source node depletes its energy. When the mobile node's trajectory is unknown in advance, we formulate three versions of an optimal control problem aiming at this lifetime maximization. We show that in all cases, the solution can be reduced to a sequence of Non- Linear Programming (NLP) problems solved on line as the source node trajectory evolves. △ Less

Submitted 28 August, 2015; originally announced August 2015.

Comments: A shorter version of this work will be published in Proceedings of 2016 IEEE Conference on Decision and Control

Optimal Dynamic Formation Control of Multi-Agent Systems in Environments with Obstacles

Authors: Xinmiao Sun, Christos G. Cassandras

Abstract: We address the optimal dynamic formation problem in mobile leader-follower networks where an optimal formation is generated to maximize a given objective function while continuously preserving connectivity. We show that in a convex mission space, the connectivity constraints can be satisfied by any feasible solution to a mixed integer nonlinear optimization problem. When the optimal formation obje… ▽ More We address the optimal dynamic formation problem in mobile leader-follower networks where an optimal formation is generated to maximize a given objective function while continuously preserving connectivity. We show that in a convex mission space, the connectivity constraints can be satisfied by any feasible solution to a mixed integer nonlinear optimization problem. When the optimal formation objective is to maximize coverage in a mission space cluttered with obstacles, we separate the process into intervals with no obstacles detected and intervals where one or more obstacles are detected. In the latter case, we propose a minimum-effort reconfiguration approach for the formation which still optimizes the objective function while avoiding the obstacles and ensuring connectivity. We include simulation results illustrating this dynamic formation process. △ Less

Submitted 19 August, 2015; originally announced August 2015.

Infinitesimal Perturbation Analysis for Personalized Cancer Therapy Design

Authors: Julia L. Fleck, Christos G. Cassandras

Abstract: We use a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under intermittent androgen suppression (IAS) to study a threshold-based policy for therapy design. IAS is currently one of the most widely used treatments for advanced prostate cancer. Patients undergoing IAS are submitted to cycles of treatment (in the form of androgen deprivation) and off-treatment periods in an alter… ▽ More We use a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under intermittent androgen suppression (IAS) to study a threshold-based policy for therapy design. IAS is currently one of the most widely used treatments for advanced prostate cancer. Patients undergoing IAS are submitted to cycles of treatment (in the form of androgen deprivation) and off-treatment periods in an alternating manner. One of the main challenges in IAS is to optimally design a therapy scheme, i.e., to determine when to discontinue and recommence androgen suppression. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy and when therapy will resume. The threshold-based policy we propose is parameterized by lower and upper PSA threshold values and is associated with a cost metric that combines clinically relevant measures of therapy success. Using Infinitesimal Perturbation Analysis (IPA), we derive unbiased gradient estimators of this cost metric with respect to the controllable PSA threshold values based on actual data and show how these estimators can be used to adaptively adjust controllable parameters so as to improve therapy outcomes based on the cost metric defined. △ Less

Submitted 28 April, 2015; originally announced April 2015.

An Optimal Control Approach for the Data Harvesting Problem

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We propose a new method for trajectory planning to solve the data harvesting problem. In a two-dimensional mission space, $N$ mobile agents are tasked with the collection of data generated at $M$ stationary sources and delivery to a base aiming at minimizing expected delays. An optimal control formulation of this problem provides some initial insights regarding its solution, but it is computationa… ▽ More We propose a new method for trajectory planning to solve the data harvesting problem. In a two-dimensional mission space, $N$ mobile agents are tasked with the collection of data generated at $M$ stationary sources and delivery to a base aiming at minimizing expected delays. An optimal control formulation of this problem provides some initial insights regarding its solution, but it is computationally intractable, especially in the case where the data generating processes are stochastic. We propose an agent trajectory parameterization in terms of general function families which can be subsequently optimized on line through the use of Infinitesimal Perturbation Analysis (IPA). Explicit results are provided for the case of elliptical and Fourier series trajectories and some properties of the solution are identified, including robustness with respect to the data generation processes and scalability in the size of an event set characterizing the underlying hybrid dynamic system. △ Less

Submitted 31 August, 2015; v1 submitted 20 March, 2015; originally announced March 2015.

Esca** Local Optima in a Class of Multi-Agent Distributed Optimization Problems: A Boosting Function Approach

Authors: Xinmiao Sun, Christos G. Cassandras, Kagan Gokbayrak

Abstract: We address the problem of multiple local optima commonly arising in optimization problems for multi-agent systems, where objective functions are nonlinear and nonconvex. For the class of coverage control problems, we propose a systematic approach for esca** a local optimum, rather than randomly perturbing controllable variables away from it. We show that the objective function for these problems… ▽ More We address the problem of multiple local optima commonly arising in optimization problems for multi-agent systems, where objective functions are nonlinear and nonconvex. For the class of coverage control problems, we propose a systematic approach for esca** a local optimum, rather than randomly perturbing controllable variables away from it. We show that the objective function for these problems can be decomposed to facilitate the evaluation of the local partial derivative of each node in the system and to provide insights into its structure. This structure is exploited by defining "boosting functions" applied to the aforementioned local partial derivative at an equilibrium point where its value is zero so as to transform it in a way that induces nodes to explore poorly covered areas of the mission space until a new equilibrium point is reached. The proposed boosting process ensures that, at its conclusion, the objective function is no worse than its pre-boosting value. However, the global optima cannot be guaranteed. We define three families of boosting functions with different properties and provide simulation results illustrating how this approach improves the solutions obtained for this class of distributed optimization problems. △ Less

Submitted 6 September, 2014; v1 submitted 2 September, 2014; originally announced September 2014.

Optimal Routing of Energy-aware Vehicles in Networks with Inhomogeneous Charging Nodes

Authors: Sepideh Pourazarm, Christos G. Cassandras

Abstract: We study the routing problem for vehicles with limited energy through a network of inhomogeneous charging nodes. This is substantially more complicated than the homogeneous node case studied in [1]. We seek to minimize the total elapsed time for vehicles to reach their destinations considering both traveling and recharging times at nodes when the vehicles do not have adequate energy for the entire… ▽ More We study the routing problem for vehicles with limited energy through a network of inhomogeneous charging nodes. This is substantially more complicated than the homogeneous node case studied in [1]. We seek to minimize the total elapsed time for vehicles to reach their destinations considering both traveling and recharging times at nodes when the vehicles do not have adequate energy for the entire journey. We study two versions of the problem. In the single vehicle routing problem, we formulate a mixed-integer nonlinear programming (MINLP) problem and show that it can be reduced to a lower dimensionality problem by exploiting properties of an optimal solution. We also obtain a Linear Programming (LP) formulation allowing us to decompose it into two simpler problems yielding near-optimal solutions. For a multi-vehicle problem, where traffic congestion effects are included, we use a similar approach by grou** vehicles into "subflows". We also provide an alternative flow optimization formulation leading to a computationally simpler problem solution with minimal loss in accuracy. Numerical results are included to illustrate these approaches. △ Less

Submitted 24 April, 2014; originally announced April 2014.

Comments: To appear in proceeding of 22nd Mediterranean Conference on Control and Automation, MED'14

A New Event-Driven Cooperative Receding Horizon Controller for Multi-agent Systems in Uncertain Environments

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: In previous work, a Cooperative Receding Horizon (CRH) controller was developed for solving cooperative multi-agent problems in uncertain environments. In this paper, we overcome several limitations of this controller, including potential instabilities in the agent trajectories and poor performance due to inaccurate estimation of a reward-to-go function. We propose an event-driven CRH controller t… ▽ More In previous work, a Cooperative Receding Horizon (CRH) controller was developed for solving cooperative multi-agent problems in uncertain environments. In this paper, we overcome several limitations of this controller, including potential instabilities in the agent trajectories and poor performance due to inaccurate estimation of a reward-to-go function. We propose an event-driven CRH controller to solve the maximum reward collection problem (MRCP) where multiple agents cooperate to maximize the total reward collected from a set of stationary targets in a given mission space. Rewards are non-increasing functions of time and the environment is uncertain with new targets detected by agents at random time instants. The controller sequentially solves optimization problems over a planning horizon and executes the control for a shorter action horizon, where both are defined by certain events associated with new information becoming available. In contrast to the earlier CRH controller, we reduce the originally infinite-dimensional feasible control set to a finite set at each time step. We prove some properties of this new controller and include simulation results showing its improved performance compared to the original one. △ Less

Submitted 29 August, 2014; v1 submitted 13 March, 2014; originally announced March 2014.

Comments: One results subsection added. Some typos corrected