Showing 51–100 of 113 results for author: Cassandras, C G

Explainability of Intelligent Transportation Systems using Knowledge Compilation: a Traffic Light Controller Case

Authors: Salomón Wollenstein-Betech, Christian Muise, Christos G. Cassandras, Ioannis Ch. Paschalidis, Yasaman Khazaeni

Abstract: Usage of automated controllers which make decisions on an environment are widespread and are often based on black-box models. We use Knowledge Compilation theory to bring explainability to the controller's decision given the state of the system. For this, we use simulated historical state-action data as input and build a compact and structured representation which relates states with actions. We i… ▽ More Usage of automated controllers which make decisions on an environment are widespread and are often based on black-box models. We use Knowledge Compilation theory to bring explainability to the controller's decision given the state of the system. For this, we use simulated historical state-action data as input and build a compact and structured representation which relates states with actions. We implement this method in a Traffic Light Control scenario where the controller selects the light cycle by observing the presence (or absence) of vehicles in different regions of the incoming roads. △ Less

Submitted 9 July, 2020; originally announced July 2020.

Comments: Proc. IEEE Int. Conf. on Intelligent Transportation Systems, Rhodes, Greece, 2020. (In Press)

Decentralized Optimal Control in Multi-lane Merging for Connected and Automated Vehicles

Authors: Wei Xiao, Christos G. Cassandras, Calin Belta

Abstract: We address the problem of optimally controlling Connected and Automated Vehicles (CAVs) arriving from two multi-lane roads and merging at multiple points where the objective is to jointly minimize the travel time and energy consumption of each CAV subject to speed-dependent safety constraints, as well as speed and acceleration constraints. This problem was solved in prior work for two single-lane… ▽ More We address the problem of optimally controlling Connected and Automated Vehicles (CAVs) arriving from two multi-lane roads and merging at multiple points where the objective is to jointly minimize the travel time and energy consumption of each CAV subject to speed-dependent safety constraints, as well as speed and acceleration constraints. This problem was solved in prior work for two single-lane roads. A direct extension to multi-lane roads is limited by the computational complexity required to obtain an explicit optimal control solution. Instead, we propose a general framework that converts a multi-lane merging problem into a decentralized optimal control problem for each CAV in a less-conservative way. To accomplish this, we employ a joint optimal control and barrier function method to efficiently get an optimal control for each CAV with guaranteed satisfaction of all constraints. Simulation examples are included to compare the performance of the proposed framework to a baseline provided by human-driven vehicles with results showing significant improvements in both time and energy metrics. △ Less

Submitted 30 May, 2020; originally announced June 2020.

Comments: To appear in ITSC2020, complete version with 8 pages

Multi-Agent Persistent Monitoring of Targets with Uncertain States

Authors: Samuel C. Pinto, Sean B. Andersson, Julien M. Hendrickx, Christos G. Cassandras

Abstract: We address the problem of persistent monitoring, where a finite set of mobile agents has to persistently visit a finite set of targets. Each of these targets has an internal state that evolves with linear stochastic dynamics. The agents can observe these states, and the observation quality is a function of the distance between the agent and a given target. The goal is then to minimize the mean squ… ▽ More We address the problem of persistent monitoring, where a finite set of mobile agents has to persistently visit a finite set of targets. Each of these targets has an internal state that evolves with linear stochastic dynamics. The agents can observe these states, and the observation quality is a function of the distance between the agent and a given target. The goal is then to minimize the mean squared estimation error of these target states. We approach the problem from an infinite horizon perspective, where we prove that, under some natural assumptions, the covariance matrix of each target converges to a limit cycle. The goal, therefore, becomes to minimize the steady state uncertainty. Assuming that the trajectory is parameterized, we provide tools for computing the steady state cost gradient. We show that, in one-dimensional (1D) environments with bounded control and non-overlap** targets, when an optimal control exists it can be represented using a finite number of parameters. We also propose an efficient parameterization of the agent trajectories for multidimensional settings using Fourier curves. Simulation results show the efficacy of the proposed technique in 1D, 2D and 3D scenarios. △ Less

Submitted 22 April, 2020; v1 submitted 20 April, 2020; originally announced April 2020.

Comments: 15 pages, 8 figures

Combined Eco-Routing and Power-Train Control of Plug-In Hybrid Electric Vehicles in Transportation Networks

Authors: Arian Houshmand, Christos G. Cassandras, Nan Zhou, Nasser Hashemi, Boqi Li, Huei Peng

Abstract: We study the problem of eco-routing for Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption cost. We propose an algorithm which can simultaneously calculate an energy-optimal route (eco-route) for a PHEV and an optimal power-train control strategy over this route. In order to show the effectiveness of our method in practice, we use a HERE Maps API to apply our algor… ▽ More We study the problem of eco-routing for Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption cost. We propose an algorithm which can simultaneously calculate an energy-optimal route (eco-route) for a PHEV and an optimal power-train control strategy over this route. In order to show the effectiveness of our method in practice, we use a HERE Maps API to apply our algorithms based on traffic data in the city of Boston with more than 110,000 links. Moreover, we validate the performance of our eco-routing algorithm using speed profiles collected from a traffic simulator (SUMO) as input to a high-fidelity energy model to calculate energy consumption costs. Our results show significant energy savings (around 12%) for PHEVs with a near real-time execution time for the algorithm. △ Less

Submitted 9 April, 2020; originally announced April 2020.

Comments: arXiv admin note: text overlap with arXiv:1810.01443

Joint Pricing and Rebalancing of Autonomous Mobility-on-Demand Systems

Authors: Salomón Wollenstein-Betech, Ioannis Ch. Paschalidis, Christos G. Cassandras

Abstract: This paper studies optimal pricing and rebalancing policies for Autonomous Mobility-on-Demand (AMoD) systems. We take a macroscopic planning perspective to tackle a profit maximization problem while ensuring that the system is load-balanced. We begin by describing the system using a dynamic fluid model to show the existence and stability of an equilibrium (i.e., load balance) through pricing polic… ▽ More This paper studies optimal pricing and rebalancing policies for Autonomous Mobility-on-Demand (AMoD) systems. We take a macroscopic planning perspective to tackle a profit maximization problem while ensuring that the system is load-balanced. We begin by describing the system using a dynamic fluid model to show the existence and stability of an equilibrium (i.e., load balance) through pricing policies. We then develop an optimization framework that allows us to find optimal policies in terms of pricing and rebalancing. We first maximize profit by only using pricing policies, then incorporate rebalancing, and finally we consider whether the solution is found sequentially or jointly. We apply each approach on a data-driven case study using real taxi data from New York City. Depending on which benchmarking solution we use, the joint problem (i.e., pricing and rebalancing) increases profits by 7% to 40% △ Less

Submitted 30 March, 2020; originally announced March 2020.

Comments: Submitted to the 59th IEEE Conference on Decision and Control (CDC 2020)

Event-Driven Receding Horizon Control For Distributed Persistent Monitoring in Network Systems

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally… ▽ More We address the multi-agent persistent monitoring problem defined on a set of nodes (targets) interconnected over a network topology. A measure of mean overall node state uncertainty evaluated over a finite period is to be minimized by controlling the motion of a cooperating team of agents. To address this problem, we propose an event-driven receding horizon control approach that is computationally efficient, distributed and on-line. The proposed controller differs from the existing on-line gradient-based parametric controllers and off-line greedy cycle search methods that often lead to either low-performing local optima or computationally intensive centralized solutions. A critical novel element in this controller is that it automatically optimizes its planning horizon length, thus making it parameter-free. We show that explicit globally optimal solutions can be obtained for every distributed optimization problem encountered at each event where the receding horizon controller is invoked. Numerical results are provided showing improvements compared to state of the art distributed on-line parametric control solutions. △ Less

Submitted 3 October, 2020; v1 submitted 25 March, 2020; originally announced March 2020.

Comments: Submitted to Automatica

Optimal Composition of Heterogeneous Multi-Agent Teams for Coverage Problems with Performance Bound Guarantees

Authors: Chuangchuang Sun, Shirantha Welikala, Christos G. Cassandras

Abstract: We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Grad… ▽ More We consider the problem of determining the optimal composition of a heterogeneous multi-agent team for coverage problems by including costs associated with different agents and subject to an upper bound on the maximal allowable number of agents. We formulate a resource allocation problem without introducing additional non-convexities to the original problem. We develop a distributed Projected Gradient Ascent (PGA) algorithm to solve the optimal team composition problem. To deal with non-convexity, we initialize the algorithm using a greedy method and exploit the submodularity and curvature properties of the coverage objective function to derive novel tighter performance bound guarantees on the optimization problem solution. Numerical examples are included to validate the effectiveness of this approach in diverse mission space configurations and different heterogeneous multi-agent collections. Comparative results obtained using a commercial mixed-integer nonlinear programming problem solver demonstrate both the accuracy and computational efficiency of the distributed PGA algorithm. △ Less

Submitted 11 March, 2020; originally announced March 2020.

Comments: To be published in Automatica

Report number: 00051098

Journal ref: Automatica (2020) 117

Congestion-aware Routing and Rebalancing of Autonomous Mobility-on-Demand Systems in Mixed Traffic

Authors: Salomón Wollenstein-Betech, Arian Houshmand, Mauro Salazar, Marco Pavone, Christos G. Cassandras, Ioannis Ch. Paschalidis

Abstract: This paper studies congestion-aware route-planning policies for Autonomous Mobility-on-Demand (AMoD) systems, whereby a fleet of autonomous vehicles provides on-demand mobility under mixed traffic conditions. Specifically, we first devise a network flow model to optimize the AMoD routing and rebalancing strategies in a congestion-aware fashion by accounting for the endogenous impact of AMoD flows… ▽ More This paper studies congestion-aware route-planning policies for Autonomous Mobility-on-Demand (AMoD) systems, whereby a fleet of autonomous vehicles provides on-demand mobility under mixed traffic conditions. Specifically, we first devise a network flow model to optimize the AMoD routing and rebalancing strategies in a congestion-aware fashion by accounting for the endogenous impact of AMoD flows on travel time. Second, we capture reactive exogenous traffic consisting of private vehicles selfishly adapting to the AMoD flows in a user-centric fashion by leveraging an iterative approach. Finally, we showcase the effectiveness of our framework with two case-studies considering the transportation sub-networks in Eastern Massachusetts and New York City. Our results suggest that for high levels of demand, pure AMoD travel can be detrimental due to the additional traffic stemming from its rebalancing flows, while the combination of AMoD with walking or micromobility options can significantly improve the overall system performance. △ Less

Submitted 9 March, 2020; originally announced March 2020.

Comments: Submitted to the 23rd IEEE International Conference on Intelligent Transportation Systems (ITSC'20)

Adaptive Control Barrier Functions for Safety-Critical Systems

Authors: Wei Xiao, Calin Belta, Christos G. Cassandras

Abstract: Recent work showed that stabilizing affine control systems to desired (sets of) states while optimizing quadratic costs and observing state and control constraints can be reduced to quadratic programs (QP) by using control barrier functions (CBF) and control Lyapunov functions. In our own recent work, we defined high order CBFs (HOCBFs) to accommodating systems and constraints with arbitrary relat… ▽ More Recent work showed that stabilizing affine control systems to desired (sets of) states while optimizing quadratic costs and observing state and control constraints can be reduced to quadratic programs (QP) by using control barrier functions (CBF) and control Lyapunov functions. In our own recent work, we defined high order CBFs (HOCBFs) to accommodating systems and constraints with arbitrary relative degrees, and a penalty method to increase the feasibility of the corresponding QPs. In this paper, we introduce adaptive CBF (AdaCBFs) that can accommodate time-varying control bounds and dynamics noise, and also address the feasibility problem. Central to our approach is the introduction of penalty functions in the definition of an AdaCBF and the definition of auxiliary dynamics for these penalty functions that are HOCBFs and are stabilized by CLFs. We demonstrate the advantages of the proposed method by applying it to a cruise control problem with different road surfaces, tires slip**, and dynamics noise. △ Less

Submitted 11 February, 2020; originally announced February 2020.

Comments: 11 pages, 7 figures, submitted to CDC2020

A Bi-Level Cooperative Driving Strategy Allowing Lane Changes

Authors: Huile Xu, Yi Zhang, Christos G. Cassandras, Li Li, Shuo Feng

Abstract: This paper studies the cooperative driving of connected and automated vehicles (CAVs) at conflict areas (e.g., non-signalized intersections and ram** regions). Due to safety concerns, most existing studies prohibit lane change since this may cause lateral collisions when coordination is not appropriately performed. However, in many traffic scenarios (e.g., work zones), vehicles must change lanes… ▽ More This paper studies the cooperative driving of connected and automated vehicles (CAVs) at conflict areas (e.g., non-signalized intersections and ram** regions). Due to safety concerns, most existing studies prohibit lane change since this may cause lateral collisions when coordination is not appropriately performed. However, in many traffic scenarios (e.g., work zones), vehicles must change lanes. To solve this problem, we categorize the potential collision into two kinds and thus establish a bi-level planning problem. The right-of-way of vehicles for the critical conflict zone is considered in the upper-level, and the right-of-way of vehicles during lane changes is then resolved in the lower-level. The solutions of the upper-level problem are represented in tree space, and a near-optimal solution is searched for by combining Monte Carlo Tree Search (MCTS) with some heuristic rules within a very short planning time. The proposed strategy is suitable for not only the shortest delay objective but also other objectives (e.g., energy-saving and passenger comfort). Numerical examples show that the proposed strategy leads to good traffic performance in real-time. △ Less

Submitted 24 December, 2019; originally announced December 2019.

Feasibility-Guided Learning for Robust Control in Constrained Optimal Control Problems

Authors: Wei Xiao, Calin A. Belta, Christos G. Cassandras

Abstract: Optimal control problems with constraints ensuring safety and convergence to desired states can be mapped onto a sequence of real time optimization problems through the use of Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in these approaches is ensuring the feasibility of the resulting quadratic programs (QPs) if the system is affine in controls… ▽ More Optimal control problems with constraints ensuring safety and convergence to desired states can be mapped onto a sequence of real time optimization problems through the use of Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). One of the main challenges in these approaches is ensuring the feasibility of the resulting quadratic programs (QPs) if the system is affine in controls. The recently proposed penalty method has the potential to improve the existence of feasible solutions to such problems. In this paper, we further improve the feasibility robustness (i.e., feasibility maintenance in the presence of time-varying and unknown unsafe sets) through the definition of a High Order CBF (HOCBF) that works for arbitrary relative degree constraints; this is achieved by a proposed feasibility-guided learning approach. Specifically, we apply machine learning techniques to classify the parameter space of a HOCBF into feasible and infeasible sets, and get a differentiable classifier that is then added to the learning process. The proposed feasibility-guided learning approach is compared with the gradient-descent method on a robot control problem. The simulation results show an improved ability of the feasibility-guided learning approach over the gradient-decent method to determine the optimal parameters in the definition of a HOCBF for the feasibility robustness, as well as show the potential of the CBF method for robot safe navigation in an unknown environment. △ Less

Submitted 6 December, 2019; originally announced December 2019.

Comments: 8 pages, submitted to L-CSS

Collision-Free Trajectory Design for 2D Persistent Monitoring Using Second-Order Agents

Authors: Yan-Wu Wang, Ming-Jie Zhao, Wu Yang, Nan Zhou, Christos G. Cassandras

Abstract: This paper considers a two-dimensional persistent monitoring problem by controlling movements of second-order agents to minimize some uncertainty metric associated with targets in a dynamic environment. In contrast to common sensing models depending only on the distance from a target, we introduce an active sensing model which considers the distance between an agent and a target, as well as the ag… ▽ More This paper considers a two-dimensional persistent monitoring problem by controlling movements of second-order agents to minimize some uncertainty metric associated with targets in a dynamic environment. In contrast to common sensing models depending only on the distance from a target, we introduce an active sensing model which considers the distance between an agent and a target, as well as the agent's velocity. We propose an objective function which can achieve a collision-free agent trajectory by penalizing all possible collisions. Applying structural properties of the optimal control derived from the Hamiltonian analysis, we limit agent trajectories to a simpler parametric form under a family of 2D curves depending on the problem setting, e.g. ellipses and Fourier trajectories. Our collision-free trajectories are optimized through an event-driven Infinitesimal Perturbation Analysis (IPA) and gradient descent method. Although the solution is generally locally optimal, this method is computationally efficient and offers an alternative to other traditional time-driven methods. Finally, simulation examples are provided to demonstrate our proposed results. △ Less

Submitted 11 November, 2019; originally announced November 2019.

Comments: 13 pages arXiv, to be published in IEEE Transactions on Control of Network Systems

Asymptotic Analysis for Greedy Initialization of Threshold-Based Distributed Optimization of Persistent Monitoring on Graphs

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed i… ▽ More This paper considers the optimal multi-agent persistent monitoring problem defined for a team of agents on a set of nodes (targets) interconnected according to a fixed network topology. The aim is to control this team so as to minimize a measure of overall node state uncertainty evaluated over a finite time interval. A class of distributed threshold-based parametric controllers has been proposed in prior work to control agent dwell times at nodes and next-node destinations by enforcing thresholds on the respective node states. Under such a Threshold Control Policy (TCP), an on-line gradient technique was used to determine optimal threshold values. However, due to the non-convexity of the problem, this approach often leads to a poor local optima highly dependent on the initial thresholds used. To overcome this initialization challenge, we develop a computationally efficient off-line greedy technique based on the asymptotic analysis of the network system. This analysis is then used to generate a high-performing set of initial thresholds. Extensive numerical results show that such initial thresholds are almost immediately (locally) optimal or quickly lead to optimal values. In all cases, they perform significantly better than the locally optimal solutions known to date. △ Less

Submitted 10 December, 2020; v1 submitted 6 November, 2019; originally announced November 2019.

Comments: Submitted to Automatica

Optimal Periodic Multi-Agent Persistent Monitoring of a Finite Set of Targets with Uncertain States

Authors: Samuel C. Pinto, Sean B. Andersson, Julien M. Hendrickx, Christos G. Cassandras

Abstract: We investigate the problem of persistently monitoring a finite set of targets with internal states that evolve with linear stochastic dynamics using a finite set of mobile agents. We approach the problem from the infinite-horizon perspective, looking for periodic movement schedules for the agents. Under linear dynamics and some standard assumptions on the noise distribution, the optimal estimator… ▽ More We investigate the problem of persistently monitoring a finite set of targets with internal states that evolve with linear stochastic dynamics using a finite set of mobile agents. We approach the problem from the infinite-horizon perspective, looking for periodic movement schedules for the agents. Under linear dynamics and some standard assumptions on the noise distribution, the optimal estimator is a Kalman-Bucy filter and the mean estimation error is a function of its covariance matrix, which evolves as a differential Riccati equation. It is shown that when the agents are constrained to move only over a line and they can see at most one target at a time, the movement policy that minimizes the mean estimation error over time is such that the agent is always either moving with maximum speed or dwelling at a fixed position. This type of trajectory can be fully defined by a finite set of parameters. For periodic trajectories, under some observability conditions, the estimation error converges to a steady state condition and the stochastic gradient estimate of the cost with respect to the trajectory parameters of each agent and the global period can be explicitly computed using Infinitesimal Perturbation Analysis. A gradient-descent approach is used to compute locally optimal parameters. This approach allows us to deal with a very long persistent monitoring horizon using a small number of parameters. △ Less

Submitted 30 September, 2019; originally announced September 2019.

Comments: 10 pages, 3 figures

The Penetration Rate Effect of Connected and Automated Vehicles in Mixed Traffic Routing

Authors: Arian Houshmand, Salomón Wollenstein-Betech, Christos G. Cassandras

Abstract: We study the problem of routing Connected and Automated Vehicles (CAVs) in the presence of mixed traffic (coexistence of regular vehicles and CAVs). In this setting, we assume that all CAVs belong to the same fleet, and can be routed using a centralized controller. The routing objective is to minimize a given overall fleet traveling cost (travel time or energy consumption). We assume that regular… ▽ More We study the problem of routing Connected and Automated Vehicles (CAVs) in the presence of mixed traffic (coexistence of regular vehicles and CAVs). In this setting, we assume that all CAVs belong to the same fleet, and can be routed using a centralized controller. The routing objective is to minimize a given overall fleet traveling cost (travel time or energy consumption). We assume that regular vehicles (non-CAVs) choose their routing decisions selfishly to minimize their traveling time. We propose an algorithm that deals with the routing interaction between CAVs and regular uncontrolled vehicles. We investigate the effect of assigning system-centric routes under different penetration rates (fractions) of CAVs. To validate our method, we apply the proposed routing algorithms to the Braess Network and to a sub-network of the Eastern Massachusetts (EMA) transportation network using actual traffic data provided by the Boston Region Metropolitan Planning Organization. The results suggest that collaborative routing decisions of CAVs improve not only the cost of CAVs, but also that of the non-CAVs. Furthermore, even a small CAV penetration rate can ease congestion for the entire network. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Joint Time and Energy-Optimal Control of Connected Automated Vehicles at Signal-Free Intersections with Speed-Dependent Safety Guarantees

Authors: Yue Zhang, Christos G. Cassandras

Abstract: We extend earlier work establishing a framework for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal free intersection by jointly optimizing energy and travel time. We derive explicit optimal control solutions in a decentralized manner that guarantee both a speed-dependent rear-end safety constraint and a time-dependent lateral collision constraint, in addition to lower/… ▽ More We extend earlier work establishing a framework for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal free intersection by jointly optimizing energy and travel time. We derive explicit optimal control solutions in a decentralized manner that guarantee both a speed-dependent rear-end safety constraint and a time-dependent lateral collision constraint, in addition to lower/upper bounds on speed and acceleration. Extensive simulation examples are included to illustrate this framework. △ Less

Submitted 30 August, 2019; v1 submitted 13 March, 2019; originally announced March 2019.

Comments: 11 pages. This article draws from arXiv:1903.04600 and is submitted to CDC19

Decentralized Optimal Control of Connected Automated Vehicles at Signal-Free Intersections Including Comfort-Constrained Turns and Safety Guarantees

Authors: Yue Zhang, Christos G. Cassandras

Abstract: We extend earlier work for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal-free intersection by including all possible turns taken so as to optimize a passenger comfort metric along with energy and travel time minimization. We show that it is possible to achieve this goal in a decentralized manner with each CAV solving an optimal control problem, and derive explicit sol… ▽ More We extend earlier work for optimally controlling Connected Automated Vehicles (CAVs) crossing a signal-free intersection by including all possible turns taken so as to optimize a passenger comfort metric along with energy and travel time minimization. We show that it is possible to achieve this goal in a decentralized manner with each CAV solving an optimal control problem, and derive explicit solutions that guarantee collision avoidance and safe distance constraints within a control zone. We investigate the associated tradeoffs between minimizing energy and vehicle travel time, as well as the passenger comfort metric and include extensive simulations to illustrate this framework. △ Less

Submitted 11 March, 2019; originally announced March 2019.

Comments: 16 pages

Distributed Non-convex Optimization of Multi-agent Systems Using Boosting Functions to Escape Local Optima: Theory and Applications

Authors: Shirantha Welikala, Christos G. Cassandras

Abstract: We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distri… ▽ More We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distributed Boosting Scheme (DBS) based on a gradient-based optimization algorithm using a novel optimal variable step size mechanism so as to guarantee convergence. Even though our motivation is based on the coverage control problem setting, our analysis applies to a broad class of multi-agent problems. Simulation results are provided to compare the performance of different boosting functions families and to demonstrate the effectiveness of the boosting function approach in attaining improved (still generally local) optima. △ Less

Submitted 15 July, 2020; v1 submitted 11 March, 2019; originally announced March 2019.

Comments: Submitted to IEEE Transactions on Automatic Control

Time and Energy-Optimal Lane Change Maneuvers for Cooperating Connected Automated Vehicles

Authors: Rui Chen, Christos G. Cassandras, Amin Tahmasbi-Sarvestani

Abstract: We derive optimal control policies for a Connected and Automated Vehicle (CAV) cooperating with neighboring CAVs to implement a highway lane change maneuver. We optimize the maneuver time and subsequently minimize the associated energy consumption of all cooperating vehicles in this maneuver. We prove structural properties of the optimal policies which simplify the solution derivations and lead to… ▽ More We derive optimal control policies for a Connected and Automated Vehicle (CAV) cooperating with neighboring CAVs to implement a highway lane change maneuver. We optimize the maneuver time and subsequently minimize the associated energy consumption of all cooperating vehicles in this maneuver. We prove structural properties of the optimal policies which simplify the solution derivations and lead to analytical optimal control expressions. The solutions, when they exist, are guaranteed to satisfy safety constraints for all vehicles involved in the maneuver. Simulation results show the effectiveness of the proposed solution and significant performance improvements compared to maneuvers performed by human-driven vehicles. △ Less

Submitted 30 November, 2019; v1 submitted 21 February, 2019; originally announced February 2019.

Comments: 10 pages, 9 figures

A Real-Time Optimal Eco-driving for Autonomous Vehicles Crossing Multiple Signalized Intersections

Authors: Xiangyu Meng, Christos G. Cassandras

Abstract: This paper develops an optimal acceleration/speed profile for a single autonomous vehicle crossing multiple signalized intersections without stop** in free flow mode. The design objective is to produce both time and energy efficient acceleration profiles of autonomous vehicles based on vehicle to infrastructure communication. Our design approach differs from most existing approaches based on num… ▽ More This paper develops an optimal acceleration/speed profile for a single autonomous vehicle crossing multiple signalized intersections without stop** in free flow mode. The design objective is to produce both time and energy efficient acceleration profiles of autonomous vehicles based on vehicle to infrastructure communication. Our design approach differs from most existing approaches based on numerical calculations: it begins with identifying the structure of the optimal acceleration profile and then showing that it is characterized by several parameters, which are used for design optimization. Therefore, the infinite dimensional optimal control problem is transformed into a finite dimensional parametric optimization problem, which enables a real-time online analytical solution. The simulation results show quantitatively the advantages of considering multiple intersections jointly rather than dealing with them individually. Based on mild assumptions, the optimal eco-driving algorithm is readily extended to include interfering traffic. △ Less

Submitted 31 January, 2019; originally announced January 2019.

Optimization of Ride Sharing Systems Using Event-driven Receding Horizon Control

Authors: Rui Chen, Christos G. Cassandras

Abstract: We develop an event-driven Receding Horizon Control (RHC) scheme for a Ride Sharing System (RSS) in a transportation network where vehicles are shared to pick up and drop off passengers so as to minimize a weighted sum of passenger waiting and traveling times. The RSS is modeled as a discrete event system and the event-driven nature of the controller significantly reduces the complexity of the veh… ▽ More We develop an event-driven Receding Horizon Control (RHC) scheme for a Ride Sharing System (RSS) in a transportation network where vehicles are shared to pick up and drop off passengers so as to minimize a weighted sum of passenger waiting and traveling times. The RSS is modeled as a discrete event system and the event-driven nature of the controller significantly reduces the complexity of the vehicle assignment problem, thus enabling its real-time implementation. Simulation results using actual city maps and real taxi traffic data illustrate the effectiveness of the RH controller in terms of real-time implementation and performance relative to known greedy heuristics. △ Less

Submitted 8 January, 2019; v1 submitted 7 January, 2019; originally announced January 2019.

Comments: 14 pages, 12 figures

Eco-Routing of Plug-In Hybrid Electric Vehicles in Transportation Networks

Authors: Arian Houshmand, Christos G. Cassandras

Abstract: We study the problem of eco-routing Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption costs. Unlike the traditional Charge Depleting First (CDF) approaches in the literature where the power-train control strategy is fixed, we propose a Combined Routing and Power-train Control (CRPTC) algorithm which can simultaneously calculate the optimal energy route as well as… ▽ More We study the problem of eco-routing Plug-In Hybrid Electric Vehicles (PHEVs) to minimize the overall energy consumption costs. Unlike the traditional Charge Depleting First (CDF) approaches in the literature where the power-train control strategy is fixed, we propose a Combined Routing and Power-train Control (CRPTC) algorithm which can simultaneously calculate the optimal energy route as well as the optimal power-train control strategy. To validate our method, we apply our eco-routing algorithm to a subnetwork of the Eastern Massachusetts (EMA) transportation network using actual traffic data provided by the Boston Region Metropolitan Planning Organization. As an alternative benchmark, we also simulate the traffic behavior of the network using the extracted flow data from the aforementioned traffic dataset. We show that the CRPTC approach outperforms the traditional CDF approach and we quantify the trade-off between saving energy and time in using eco-routing algorithms. △ Less

Submitted 2 October, 2018; originally announced October 2018.

Decentralized Optimal Merging Control for Connected and Automated Vehicles

Authors: Wei Xiao, Christos G. Cassandras

Abstract: This paper addresses the optimal control of Connected and Automated Vehicles (CAVs) arriving from two roads at a merging point where the objective is to jointly minimize the travel time and energy consumption of each CAV. The solution guarantees that a speed-dependent safety constraint is always satisfied, both at the merging point and everywhere within a control zone which precedes it. We first a… ▽ More This paper addresses the optimal control of Connected and Automated Vehicles (CAVs) arriving from two roads at a merging point where the objective is to jointly minimize the travel time and energy consumption of each CAV. The solution guarantees that a speed-dependent safety constraint is always satisfied, both at the merging point and everywhere within a control zone which precedes it. We first analyze the case of no active constraints and prove that under certain conditions the safety constraint remains inactive, thus significantly simplifying the determination of an explicit decentralized solution. When these conditions do not apply, an explicit solution is still obtained that includes intervals over which the safety constraint is active. Our analysis allows us to study the tradeoff between the two objective function components (travel time and energy within the control zone). Simulation examples are included to compare the performance of the optimal controller to a baseline with human-driven vehicles with results showing improvements in both metrics. △ Less

Submitted 26 November, 2018; v1 submitted 20 September, 2018; originally announced September 2018.

Comments: 16 pages, 2nd version, 20 figures

A Decentralized Optimal Control Framework for Connected Automated Vehicles at Urban Intersections with Dynamic Resequencing

Authors: Yue Zhang, Christos G. Cassandras

Abstract: Earlier work has established a decentralized framework to optimally control Connected Automated Vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling while following a strict First-In-First-Out (FIFO) queueing structure. The proposed solution minimizes energy consumption subject to a FIFO-based throughput maximization requirement. In this paper, we extend the solu… ▽ More Earlier work has established a decentralized framework to optimally control Connected Automated Vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling while following a strict First-In-First-Out (FIFO) queueing structure. The proposed solution minimizes energy consumption subject to a FIFO-based throughput maximization requirement. In this paper, we extend the solution to account for asymmetric intersections by relaxing the FIFO constraint and including a dynamic resequencing process so as to maximize traffic throughput. To investigate the tradeoff between throughput maximization and energy minimization objectives, we exploit several alternative problem formulations. In addition, the computational complexity of the resequencing process is analyzed and proved to be bounded, which makes the online implementation computationally feasible. The effectiveness of the dynamic resequencing process in terms of throughput maximization is illustrated through simulation △ Less

Submitted 1 September, 2018; originally announced September 2018.

Multi-Agent Coverage Control with Energy Depletion and Repletion

Authors: Xiangyu Meng, Arian Houshmand, Christos G. Cassandras

Abstract: We develop a hybrid system model to describe the behavior of multiple agents cooperatively solving an optimal coverage problem under energy depletion and repletion constraints. The model captures the controlled switching of agents between coverage (when energy is depleted) and battery charging (when energy is replenished) modes. It guarantees the feasibility of the coverage problem by defining a g… ▽ More We develop a hybrid system model to describe the behavior of multiple agents cooperatively solving an optimal coverage problem under energy depletion and repletion constraints. The model captures the controlled switching of agents between coverage (when energy is depleted) and battery charging (when energy is replenished) modes. It guarantees the feasibility of the coverage problem by defining a guard function on each agent's battery level to prevent it from dying on its way to a charging station. The charging station plays the role of a centralized scheduler to solve the contention problem of agents competing for the only charging resource in the mission space. The optimal coverage problem is transformed into a parametric optimization problem to determine an optimal recharging policy. This problem is solved through the use of Infinitesimal Perturbation Analysis (IPA), with simulation results showing that a full recharging policy is optimal. △ Less

Submitted 24 July, 2018; originally announced July 2018.

Journal ref: IEEE Conference on Decision and Control 2018

The Penetration Effect of Connected Automated Vehicles in Urban Traffic: An Energy Impact Study

Authors: Yue Zhang, Christos G. Cassandras

Abstract: Earlier work has established a decentralized framework of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling. The proposed solution is capable of minimizing energy consumption subject to a throughput maximization requirement. In this paper, we address the problem of optimally controlling CAVs under mixed traffic con… ▽ More Earlier work has established a decentralized framework of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without using explicit traffic signaling. The proposed solution is capable of minimizing energy consumption subject to a throughput maximization requirement. In this paper, we address the problem of optimally controlling CAVs under mixed traffic conditions where both CAVs and human-driven vehicles (non-CAVs) travel on the roads, so as to minimize energy consumption while guaranteeing safety constraints. The impact of CAVs on overall energy consumption is also investigated under different traffic scenarios. The benefit from CAV penetration (i.e., the fraction of CAVs relative to all vehicles) is validated through simulation in MATLAB and VISSIM. The results indicate that the energy efficiency improvement becomes more significant as the CAV penetration rate increases, while the significance diminishes as the traffic becomes heavier △ Less

Submitted 14 March, 2018; originally announced March 2018.

Comments: 8 pages

Optimal Threshold-Based Control Policies for Persistent Monitoring on Graphs

Authors: Nan Zhou, Christos G. Cassandras, Xi Yu, Sean B. Andersson

Abstract: We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since… ▽ More We consider the optimal multi-agent persistent monitoring problem defined by a team of cooperating agents visiting a set of nodes (targets) on a graph with the objective of minimizing a measure of overall node state uncertainty. The solution to this problem involves agent trajectories defined both by the sequence of nodes to be visited by each agent and the amount of time spent at each node. Since such optimal trajectories are generally intractable, we propose a class of distributed threshold-based parametric controllers through which agent transitions from one node to the next are controlled by threshold parameters on the node uncertainty states. The resulting behavior of the agent-target system can be described by a hybrid dynamic system. This enables the use of Infinitesimal Perturbation Analysis (IPA) to determine on line (locally) optimal threshold parameters through gradient descent methods and thus obtain optimal controllers within this family of threshold-based policies. We further show that in a single-agent case the IPA gradient is monotonic, which implies a simple structure whereby an agent visiting a node should reduce the uncertainty state to zero before moving to the next node. Simulation examples are included to illustrate our results and compare them to optimal solutions derived through dynamic programming when this is possible. △ Less

Submitted 7 March, 2018; originally announced March 2018.

Comments: 11 pages full version

Optimal Control of Autonomous Vehicles Approaching A Traffic Light

Authors: Xiangyu Meng, Christos G. Cassandras

Abstract: This paper devotes to the development of an optimal acceleration/speed profile for autonomous vehicles approaching a traffic light. The design objective is to achieve both short travel time and low energy consumption as well as avoid idling at a red light. This is achieved by taking full advantage of the traffic light information based on vehicle-to-infrastructure communication. The problem is mod… ▽ More This paper devotes to the development of an optimal acceleration/speed profile for autonomous vehicles approaching a traffic light. The design objective is to achieve both short travel time and low energy consumption as well as avoid idling at a red light. This is achieved by taking full advantage of the traffic light information based on vehicle-to-infrastructure communication. The problem is modeled as a mixed integer programming, which is equivalently transformed into optimal control problems by relaxing the integer constraint. Then the direct adjoining approach is used to solve both free and fixed terminal time optimal control problems subject to state constraints. By an elaborate analysis, we are able to produce a real-time online analytical solution, distinguishing our method from most existing approaches based on numerical calculations. Extensive simulations are executed to compare the performance of autonomous vehicles under the proposed speed profile and human driving vehicles. The results show quantitatively the advantages of the proposed algorithm in terms of energy consumption and travel time. △ Less

Submitted 26 February, 2018; originally announced February 2018.

Decentralized Event-Driven Algorithms for Multi-Agent Persistent Monitoring

Authors: Nan Zhou, Christos G. Cassandras, Xi Yu, Sean B. Andersson

Abstract: We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-… ▽ More We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact with a finite number of targets and the objective is to control their movement in order to minimize an uncertainty metric associated with the targets. In a one-dimensional setting, it has been shown that the optimal solution can be reduced to a simpler parametric optimization problem and that the behavior of agents under optimal control is described by a hybrid system. This hybrid system can be analyzed using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven centralized gradient-based algorithm. We show that the IPA gradient can be recovered in a distributed manner in which each agent optimizes its trajectory based on local information, except for one event requiring communication from a non-neighbor agent. Simulation examples are included to illustrate the effectiveness of this "almost decentralized" algorithm and its fully decentralized counterpart where the aforementioned non-local event is ignored. △ Less

Submitted 21 August, 2017; originally announced August 2017.

Comments: 9 pages full version, IEEE Conference on Decision and Control, 2017

A Submodularity-Based Approach for Multi-Agent Optimal Coverage Problems

Authors: Xinmiao Sun, Christos G. Cassandras, Xiangyu Meng

Abstract: We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is guaranteed by gradient-based algorithms developed to date. We first show that the objective function is monotone submodular, a class of functions for which a s… ▽ More We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is guaranteed by gradient-based algorithms developed to date. We first show that the objective function is monotone submodular, a class of functions for which a simple greedy algorithm is known to be within 0.63 of the optimal solution. We then derive two tighter lower bounds by exploiting the curvature information (total curvature and elemental curvature) of the objective function. We further show that the tightness of these lower bounds is complementary with respect to the sensing capabilities of the agents. The greedy algorithm solution can be subsequently used as an initial point for a gradient-based algorithm to obtain solutions even closer to the global optimum. Simulation results show that this approach leads to significantly better performance relative to previously used algorithms. △ Less

Submitted 14 August, 2017; originally announced August 2017.

City-Scale Intelligent Systems and Platforms

Authors: Klara Nahrstedt, Christos G. Cassandras, Charlie Catlett

Abstract: As of 2014, 54% of the earth's population resides in urban areas, and it is steadily increasing, expecting to reach 66% by 2050. Urban areas range from small cities with tens of thousands of people to megacities with greater than 10 million people. Roughly 12% of the global population today lives in 28 megacities, and at least 40 are projected by 2030. At these scales, the urban infrastructure suc… ▽ More As of 2014, 54% of the earth's population resides in urban areas, and it is steadily increasing, expecting to reach 66% by 2050. Urban areas range from small cities with tens of thousands of people to megacities with greater than 10 million people. Roughly 12% of the global population today lives in 28 megacities, and at least 40 are projected by 2030. At these scales, the urban infrastructure such as roads, buildings, and utility networks will cover areas as large as New England. This steady urbanization and the resulting expansion of infrastructure, combined with renewal of aging urban infrastructure, represent tens of trillion of dollars in new urban infrastructure investment over the coming decades. These investments must balance factors including impact on clean air and water, energy and maintenance costs, and the productivity and health of city dwellers. Moreover, cost-effective management and sustainability of these growing urban areas will be one of the most critical challenges to our society, motivating the concept of science- and data-driven urban design, retrofit, and operation-that is, "Smart Cities". △ Less

Submitted 4 May, 2017; originally announced May 2017.

Comments: A Computing Community Consortium (CCC) white paper, 8 pages

Decentralized Optimal Control for Connected Automated Vehicles at Intersections Including Left and Right Turns

Authors: Yue Zhang, Andreas A. Malikopoulos, Christos G. Cassandras

Abstract: In prior work, we addressed the problem of optimally controlling on line connected and automated vehicles crossing two adjacent intersections in an urban area to minimize fuel consumption while achieving maximal throughput without any explicit traffic signaling and without considering left and right turns. In this paper, we extend the solution of this problem to account for left and right turns un… ▽ More In prior work, we addressed the problem of optimally controlling on line connected and automated vehicles crossing two adjacent intersections in an urban area to minimize fuel consumption while achieving maximal throughput without any explicit traffic signaling and without considering left and right turns. In this paper, we extend the solution of this problem to account for left and right turns under hard safety constraints. Furthermore, we formulate and solve another optimization problem to minimize a measure of passenger discomfort while the vehicle turns at the intersection and we investigate the associated tradeoff between minimizing fuel consumption and passenger discomfort. △ Less

Submitted 11 September, 2017; v1 submitted 20 March, 2017; originally announced March 2017.

Stochastic Flow Models with Delays and Applications to Multi-Intersection Traffic Light Control

Authors: Rui Chen, Christos G. Cassandras

Abstract: We extend Stochastic Flow Models (SFMs), used for a large class of discrete event and hybrid systems, by including the delays which typically arise in flow movement. We apply this framework to the multi-intersection traffic light control problem by including transit delays for vehicles moving from one intersection to the next. Using Infinitesimal Perturbation Analysis (IPA) for this SFM with delay… ▽ More We extend Stochastic Flow Models (SFMs), used for a large class of discrete event and hybrid systems, by including the delays which typically arise in flow movement. We apply this framework to the multi-intersection traffic light control problem by including transit delays for vehicles moving from one intersection to the next. Using Infinitesimal Perturbation Analysis (IPA) for this SFM with delays, we derive new on-line gradient estimates of several congestion cost metrics with respect to the controllable green and red cycle lengths. The IPA estimators are used to iteratively adjust light cycle lengths to improve performance and, in conjunction with a standard gradient-based algorithm, to obtain optimal values which adapt to changing traffic conditions. We introduce two new cost metrics to better capture congestion and show that the inclusion of delays in our analysis leads to improved performance relative to models that ignore delays. △ Less

Submitted 7 November, 2017; v1 submitted 17 March, 2017; originally announced March 2017.

Data-driven Estimation of Origin-Destination Demand and User Cost Functions for the Optimization of Transportation Networks

Authors: **g Zhang, Sepideh Pourazarm, Christos G. Cassandras, Ioannis Ch. Paschalidis

Abstract: In earlier work (Zhang et al., 2016) we used actual traffic data from the Eastern Massachusetts transportation network in the form of spatial average speeds and road segment flow capacities in order to estimate Origin-Destination (OD) flow demand matrices for the network. Based on a Traffic Assignment Problem (TAP) formulation (termed "forward problem"), in this paper we use a scheme similar to ou… ▽ More In earlier work (Zhang et al., 2016) we used actual traffic data from the Eastern Massachusetts transportation network in the form of spatial average speeds and road segment flow capacities in order to estimate Origin-Destination (OD) flow demand matrices for the network. Based on a Traffic Assignment Problem (TAP) formulation (termed "forward problem"), in this paper we use a scheme similar to our earlier work to estimate initial OD demand matrices and then propose a new inverse problem formulation in order to estimate user cost functions. This new formulation allows us to efficiently overcome numerical difficulties that limited our prior work to relatively small subnetworks and, assuming the travel latency cost functions are available, to adjust the values of the OD demands accordingly so that the flow observations are as close as possible to the solutions of the forward problem. We also derive sensitivity analysis results for the total user latency cost with respect to important parameters such as road capacities and minimum travel times. Finally, using the same actual traffic data from the Eastern Massachusetts transportation network, we quantify the Price of Anarchy (POA) for a much larger network than that in Zhang et al. (2016). △ Less

Submitted 29 October, 2016; originally announced October 2016.

Comments: Preprint submitted to The 20th World Congress of the International Federation of Automatic Control, July 9-14, 2017, Toulouse, France

MSC Class: 90B06

Event-driven Trajectory Optimization for Data Harvesting in Multi-Agent Systems

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We propose a new event-driven method for on-line trajectory optimization to solve the data harvesting problem: in a two-dimensional mission space, N mobile agents are tasked with the collection of data generated at M stationary sources and delivery to a base with the goal of minimizing expected collection and delivery delays. We define a new performance measure that addresses the event excitation… ▽ More We propose a new event-driven method for on-line trajectory optimization to solve the data harvesting problem: in a two-dimensional mission space, N mobile agents are tasked with the collection of data generated at M stationary sources and delivery to a base with the goal of minimizing expected collection and delivery delays. We define a new performance measure that addresses the event excitation problem in event-driven controllers and formulate an optimal control problem. The solution of this problem provides some insights on its structure, but it is computationally intractable, especially in the case where the data generating processes are stochastic. We propose an agent trajectory parameterization in terms of general function families which can be subsequently optimized on line through the use of Infinitesimal Perturbation Analysis (IPA). Properties of the solutions are identified, including robustness with respect to the stochastic data generation process and scalability in the size of the event set characterizing the underlying hybrid dynamical system. Explicit results are provided for the case of elliptical and Fourier series trajectories and comparisons with a state-of-the-art graph-based algorithm are given. △ Less

Submitted 22 August, 2016; originally announced August 2016.

Comments: arXiv admin note: substantial text overlap with arXiv:1503.06133

Optimal Control of Connected Automated Vehicles at Urban Traffic Intersections: A Feasibility Enforcement Analysis

Authors: Yue Zhang, Christos G. Cassandras, Andreas A. Malikopoulos

Abstract: Earlier work has established a decentralized optimal control framework for coordinating online a continuous flow of connected automated vehicles (CAVs) entering a control zone and crossing two adjacent intersections in an urban area. A solution, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and… ▽ More Earlier work has established a decentralized optimal control framework for coordinating online a continuous flow of connected automated vehicles (CAVs) entering a control zone and crossing two adjacent intersections in an urban area. A solution, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and under the hard safety constraint of collision avoidance. We establish the conditions under which such solutions exist and show that they can be enforced through an appropriately designed feasibility enforcement zone that precedes the control zone. The proposed solution and overall control architecture are illustrated through simulation. △ Less

Submitted 20 February, 2017; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 8 pages, 7 figures. arXiv admin note: text overlap with arXiv:1509.08689

Optimal control for a robotic exploration, pick-up and delivery problem

Authors: Vladislav Nenchev, Christos G. Cassandras, Jörg Raisch

Abstract: This paper addresses an optimal control problem for a robot that has to find and collect a finite number of objects and move them to a depot in minimum time. The robot has fourth-order dynamics that change instantaneously at any pick-up or drop-off of an object. The objects are modeled by point masses with a-priori unknown locations in a bounded two-dimensional space that may contain unknown obsta… ▽ More This paper addresses an optimal control problem for a robot that has to find and collect a finite number of objects and move them to a depot in minimum time. The robot has fourth-order dynamics that change instantaneously at any pick-up or drop-off of an object. The objects are modeled by point masses with a-priori unknown locations in a bounded two-dimensional space that may contain unknown obstacles. For this hybrid system, an Optimal Control Problem (OCP) is approximately solved by a receding horizon scheme, where the derived lower bound for the cost-to-go is evaluated for the worst and for a probabilistic case, assuming a uniform distribution of the objects. First, a time-driven approximate solution based on time and position space discretization and mixed integer programming is presented. Due to the high computational cost of this solution, an alternative event-driven approximate approach based on a suitable motion parameterization and gradient-based optimization is proposed. The solutions are compared in a numerical example, suggesting that the latter approach offers a significant computational advantage while yielding similar qualitative results compared to the former. The methods are particularly relevant for various robotic applications like automated cleaning, search and rescue, harvesting or manufacturing. △ Less

Submitted 5 July, 2016; originally announced July 2016.

Comments: 14 pages, 23 figures

The Price of Anarchy in Transportation Networks: Data-Driven Evaluation and Reduction Strategies

Authors: **g Zhang, Sepideh Pourazarm, Christos G. Cassandras, Ioannis Ch. Paschalidis

Abstract: Among the many functions a Smart City must support, transportation dominates in terms of resource consumption, strain on the environment, and frustration of its citizens. We study transportation networks under two different routing policies, the commonly assumed selfish user-centric routing policy and a socially-optimal system-centric one. We consider a performance metric of efficiency - the Price… ▽ More Among the many functions a Smart City must support, transportation dominates in terms of resource consumption, strain on the environment, and frustration of its citizens. We study transportation networks under two different routing policies, the commonly assumed selfish user-centric routing policy and a socially-optimal system-centric one. We consider a performance metric of efficiency - the Price of Anarchy (PoA) - defined as the ratio of the total travel latency cost under selfish routing over the corresponding quantity under socially-optimal routing. We develop a data-driven approach to estimate the PoA, which we subsequently use to conduct a case study using extensive actual traffic data from the Eastern Massachusetts road network. To estimate the PoA, our approach learns from data a complete model of the transportation network, including origin-destination demand and user preferences. We leverage this model to propose possible strategies to reduce the PoA and increase efficiency. △ Less

Submitted 3 January, 2018; v1 submitted 7 June, 2016; originally announced June 2016.

MSC Class: 90C33; 90C90; 90C30

Event excitation for event-driven control and optimization of multi-agent systems

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We consider event-driven methods in a general framework for the control and optimization of multi-agent systems, viewing them as stochastic hybrid systems. Such systems often have feasible realizations in which the events needed to excite an on-line event-driven controller cannot occur, rendering the use of such controllers ineffective. We show that this commonly happens in environments which cont… ▽ More We consider event-driven methods in a general framework for the control and optimization of multi-agent systems, viewing them as stochastic hybrid systems. Such systems often have feasible realizations in which the events needed to excite an on-line event-driven controller cannot occur, rendering the use of such controllers ineffective. We show that this commonly happens in environments which contain discrete points of interest which the agents must visit. To address this problem in event-driven gradient-based optimization problems, we propose a new metric for the objective function which creates a potential field guaranteeing that gradient values are non-zero when no events are present and which results in eventual event excitation. We apply this approach to the class of cooperative multi-agent data collection problems using the event-driven Infinitesimal Perturbation Analysis (IPA) methodology and include numerical examples illustrating its effectiveness. △ Less

Submitted 3 April, 2016; originally announced April 2016.

Comments: Accepted for Presentation in WODES 2016

Optimal Energy-Efficient Downlink Transmission Scheduling for Real-Time Wireless Networks

Authors: Lei Miao, Jianfeng Mao, Christos G. Cassandras

Abstract: It has been shown that using appropriate channel coding schemes in wireless environments, transmission energy can be significantly reduced by controlling the packet transmission rate. This paper seeks optimal solutions for downlink transmission control problems, motivated by this observation and by the need to minimize energy consumption in real-time wireless networks. Our problem formulation deal… ▽ More It has been shown that using appropriate channel coding schemes in wireless environments, transmission energy can be significantly reduced by controlling the packet transmission rate. This paper seeks optimal solutions for downlink transmission control problems, motivated by this observation and by the need to minimize energy consumption in real-time wireless networks. Our problem formulation deals with a more general setting than the paper authored by Gamal et. al., in which the MoveRight algorithm is proposed. The MoveRight algorithm is an iterative algorithm that converges to the optimal solution. We show that even under the more general setting, the optimal solution can be efficiently obtained through an approach decomposing the optimal sample path through certain "critical tasks" which in turn can be efficiently identified. We include simulation results showing that our algorithm is significantly faster than the MoveRight algorithm. We also discuss how to utilize our results and receding horizon control to perform on-line transmission scheduling where future task information is unknown. △ Less

Submitted 17 March, 2016; originally announced March 2016.

Comments: Submitted to IEEE Transactions on Control of Network Systems

Optimal Event-Driven Multi-Agent Persistent Monitoring of a Finite Set of Targets

Authors: Nan Zhou, Xi Yu, Sean B. Andersson, Christos G. Cassandras

Abstract: We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite… ▽ More We consider the problem of controlling the movement of multiple cooperating agents so as to minimize an uncertainty metric associated with a finite number of targets. In a one-dimensional mission space, we adopt an optimal control framework and show that the solution is reduced to a simpler parametric optimization problem: determining a sequence of locations where each agent may dwell for a finite amount of time and then switch direction. This amounts to a hybrid system which we analyze using Infinitesimal Perturbation Analysis (IPA) to obtain a complete on-line solution through an event-driven gradient-based algorithm which is also robust with respect to the uncertainty model used. The resulting controller depends on observing the events required to excite the gradient-based algorithm, which cannot be guaranteed. We solve this problem by proposing a new metric for the objective function which creates a potential field guaranteeing that gradient values are non-zero. This approach is compared to an alternative graph-based task scheduling algorithm for determining an optimal sequence of target visits. Simulation examples are included to demonstrate the proposed methods. △ Less

Submitted 13 March, 2016; originally announced March 2016.

Comments: 12 pages full version, IEEE Conference on Decision and Control, 2016

Personalized Cancer Therapy Design: Robustness vs. Optimality

Authors: Julia L. Fleck, Christos G. Cassandras

Abstract: Intermittent Androgen Suppression (IAS) is a treatment strategy for delaying or even preventing time to relapse of advanced prostate cancer. IAS consists of alternating cycles of therapy (in the form of androgen suppression) and off-treatment periods. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy an… ▽ More Intermittent Androgen Suppression (IAS) is a treatment strategy for delaying or even preventing time to relapse of advanced prostate cancer. IAS consists of alternating cycles of therapy (in the form of androgen suppression) and off-treatment periods. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy and when therapy will resume. In spite of extensive recent clinical experience with IAS, the design of an ideal protocol for any given patient remains one of the main challenges associated with effectively implementing this therapy. We use a threshold-based policy for optimal IAS therapy design that is parameterized by lower and upper PSA threshold values and is associated with a cost metric that combines clinically relevant measures of therapy success. We apply Infinitesimal Perturbation Analysis (IPA) to a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under IAS and derive unbiased estimators of the cost metric gradient with respect to various model and therapy parameters. These estimators are subsequently used for system analysis. By evaluating sensitivity estimates with respect to several model parameters, we identify critical parameters and demonstrate that relaxing the optimality condition in favor of increased robustness to modeling errors provides an alternative objective to therapy design for at least some patients. △ Less

Submitted 2 March, 2016; originally announced March 2016.

A Decentralized Energy-Optimal Control Framework for Connected Automated Vehicles at Signal-Free Intersections

Authors: Andreas A. Malikopoulos, Christos G. Cassandras, Yue J. Zhang

Abstract: We address the problem of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without any explicit traffic signaling, so as to minimize energy consumption subject to a throughput maximization requirement. We show that the solution of the throughput maximization problem depends only on the hard safety constraints imposed on CAVs and its structure enables a d… ▽ More We address the problem of optimally controlling connected and automated vehicles (CAVs) crossing an urban intersection without any explicit traffic signaling, so as to minimize energy consumption subject to a throughput maximization requirement. We show that the solution of the throughput maximization problem depends only on the hard safety constraints imposed on CAVs and its structure enables a decentralized optimal control problem formulation for energy minimization. We present a complete analytical solution of these decentralized problems and derive conditions under which feasible solutions satisfying all safety constraints always exist. The effectiveness of the proposed solution is illustrated through simulation which shows substantial dual benefits of the proposed decentralized framework by allowing CAVs to conserve momentum and fuel while also improving travel time. △ Less

Submitted 31 March, 2018; v1 submitted 11 February, 2016; originally announced February 2016.

Comments: 17 pages, 7 figures, Automatica, 2018

Solving A Class of Discrete Event Simulation-based Optimization Problems Using "Optimality in Probability"

Authors: Jianfeng Mao, Christos G. Cassandras

Abstract: We approach a class of discrete event simulation-based optimization problems using optimality in probability, an approach which yields what is termed a "champion solution". Compared to the traditional optimality in expectation, this approach favors the solution whose actual performance is more likely better than that of any other solution; this is an effective alternative to the traditional optima… ▽ More We approach a class of discrete event simulation-based optimization problems using optimality in probability, an approach which yields what is termed a "champion solution". Compared to the traditional optimality in expectation, this approach favors the solution whose actual performance is more likely better than that of any other solution; this is an effective alternative to the traditional optimality sense, especially when facing a dynamic and nonstationary environment. Moreover, using optimality in probability is computationally promising for a class of discrete event simulation-based optimization problems, since it can reduce computational complexity by orders of magnitude compared to general simulation-based optimization methods using optimality in expectation. Accordingly, we have developed an "Omega Median Algorithm" in order to effectively obtain the champion solution and to fully utilize the efficiency of well-developed off-line algorithms to further facilitate timely decision making. An inventory control problem with nonstationary demand is included to illustrate and interpret the use of the Omega Median Algorithm, whose performance is tested using simulations. △ Less

Submitted 14 January, 2016; originally announced January 2016.

Optimal Control and Coordination of Connected and Automated Vehicles at Urban Traffic Intersections

Authors: Yue J. Zhang, Andreas A. Malikopoulos, Christos G. Cassandras

Abstract: We address the problem of coordinating online a continuous flow of connected and automated vehicles (CAVs) crossing two adjacent intersections in an urban area. We present a decentralized optimal control framework whose solution yields for each vehicle the optimal acceleration/deceleration at any time in the sense of minimizing fuel consumption. The solu- tion, when it exists, allows the vehicles… ▽ More We address the problem of coordinating online a continuous flow of connected and automated vehicles (CAVs) crossing two adjacent intersections in an urban area. We present a decentralized optimal control framework whose solution yields for each vehicle the optimal acceleration/deceleration at any time in the sense of minimizing fuel consumption. The solu- tion, when it exists, allows the vehicles to cross the intersections without the use of traffic lights, without creating congestion on the connecting road, and under the hard safety constraint of collision avoidance. The effectiveness of the proposed solution is validated through simulation considering two intersections located in downtown Boston, and it is shown that coordination of CAVs can reduce significantly both fuel consumption and travel time. △ Less

Submitted 16 June, 2017; v1 submitted 29 September, 2015; originally announced September 2015.

Comments: 6 pages, 4 figures

Lifetime Maximization of Wireless Sensor Networks with a Mobile Source Node

Authors: Sepideh Pourazarm, Christos G. Cassandras

Abstract: We study the problem of routing in sensor networks where the goal is to maximize the network's lifetime. Previous work has considered this problem for fixed-topology networks. Here, we add mobility to the source node, which requires a new definition of the network lifetime. In particular, we redefine lifetime to be the time until the source node depletes its energy. When the mobile node's trajecto… ▽ More We study the problem of routing in sensor networks where the goal is to maximize the network's lifetime. Previous work has considered this problem for fixed-topology networks. Here, we add mobility to the source node, which requires a new definition of the network lifetime. In particular, we redefine lifetime to be the time until the source node depletes its energy. When the mobile node's trajectory is unknown in advance, we formulate three versions of an optimal control problem aiming at this lifetime maximization. We show that in all cases, the solution can be reduced to a sequence of Non- Linear Programming (NLP) problems solved on line as the source node trajectory evolves. △ Less

Submitted 28 August, 2015; originally announced August 2015.

Comments: A shorter version of this work will be published in Proceedings of 2016 IEEE Conference on Decision and Control

Optimal Dynamic Formation Control of Multi-Agent Systems in Environments with Obstacles

Authors: Xinmiao Sun, Christos G. Cassandras

Abstract: We address the optimal dynamic formation problem in mobile leader-follower networks where an optimal formation is generated to maximize a given objective function while continuously preserving connectivity. We show that in a convex mission space, the connectivity constraints can be satisfied by any feasible solution to a mixed integer nonlinear optimization problem. When the optimal formation obje… ▽ More We address the optimal dynamic formation problem in mobile leader-follower networks where an optimal formation is generated to maximize a given objective function while continuously preserving connectivity. We show that in a convex mission space, the connectivity constraints can be satisfied by any feasible solution to a mixed integer nonlinear optimization problem. When the optimal formation objective is to maximize coverage in a mission space cluttered with obstacles, we separate the process into intervals with no obstacles detected and intervals where one or more obstacles are detected. In the latter case, we propose a minimum-effort reconfiguration approach for the formation which still optimizes the objective function while avoiding the obstacles and ensuring connectivity. We include simulation results illustrating this dynamic formation process. △ Less

Submitted 19 August, 2015; originally announced August 2015.

Infinitesimal Perturbation Analysis for Personalized Cancer Therapy Design

Authors: Julia L. Fleck, Christos G. Cassandras

Abstract: We use a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under intermittent androgen suppression (IAS) to study a threshold-based policy for therapy design. IAS is currently one of the most widely used treatments for advanced prostate cancer. Patients undergoing IAS are submitted to cycles of treatment (in the form of androgen deprivation) and off-treatment periods in an alter… ▽ More We use a Stochastic Hybrid Automaton (SHA) model of prostate cancer evolution under intermittent androgen suppression (IAS) to study a threshold-based policy for therapy design. IAS is currently one of the most widely used treatments for advanced prostate cancer. Patients undergoing IAS are submitted to cycles of treatment (in the form of androgen deprivation) and off-treatment periods in an alternating manner. One of the main challenges in IAS is to optimally design a therapy scheme, i.e., to determine when to discontinue and recommence androgen suppression. The level of prostate specific antigen (PSA) in a patient's serum is frequently monitored to determine when the patient will be taken off therapy and when therapy will resume. The threshold-based policy we propose is parameterized by lower and upper PSA threshold values and is associated with a cost metric that combines clinically relevant measures of therapy success. Using Infinitesimal Perturbation Analysis (IPA), we derive unbiased gradient estimators of this cost metric with respect to the controllable PSA threshold values based on actual data and show how these estimators can be used to adaptively adjust controllable parameters so as to improve therapy outcomes based on the cost metric defined. △ Less

Submitted 28 April, 2015; originally announced April 2015.

An Optimal Control Approach for the Data Harvesting Problem

Authors: Yasaman Khazaeni, Christos G. Cassandras

Abstract: We propose a new method for trajectory planning to solve the data harvesting problem. In a two-dimensional mission space, $N$ mobile agents are tasked with the collection of data generated at $M$ stationary sources and delivery to a base aiming at minimizing expected delays. An optimal control formulation of this problem provides some initial insights regarding its solution, but it is computationa… ▽ More We propose a new method for trajectory planning to solve the data harvesting problem. In a two-dimensional mission space, $N$ mobile agents are tasked with the collection of data generated at $M$ stationary sources and delivery to a base aiming at minimizing expected delays. An optimal control formulation of this problem provides some initial insights regarding its solution, but it is computationally intractable, especially in the case where the data generating processes are stochastic. We propose an agent trajectory parameterization in terms of general function families which can be subsequently optimized on line through the use of Infinitesimal Perturbation Analysis (IPA). Explicit results are provided for the case of elliptical and Fourier series trajectories and some properties of the solution are identified, including robustness with respect to the data generation processes and scalability in the size of an event set characterizing the underlying hybrid dynamic system. △ Less

Submitted 31 August, 2015; v1 submitted 20 March, 2015; originally announced March 2015.

Esca** Local Optima in a Class of Multi-Agent Distributed Optimization Problems: A Boosting Function Approach

Authors: Xinmiao Sun, Christos G. Cassandras, Kagan Gokbayrak

Abstract: We address the problem of multiple local optima commonly arising in optimization problems for multi-agent systems, where objective functions are nonlinear and nonconvex. For the class of coverage control problems, we propose a systematic approach for esca** a local optimum, rather than randomly perturbing controllable variables away from it. We show that the objective function for these problems… ▽ More We address the problem of multiple local optima commonly arising in optimization problems for multi-agent systems, where objective functions are nonlinear and nonconvex. For the class of coverage control problems, we propose a systematic approach for esca** a local optimum, rather than randomly perturbing controllable variables away from it. We show that the objective function for these problems can be decomposed to facilitate the evaluation of the local partial derivative of each node in the system and to provide insights into its structure. This structure is exploited by defining "boosting functions" applied to the aforementioned local partial derivative at an equilibrium point where its value is zero so as to transform it in a way that induces nodes to explore poorly covered areas of the mission space until a new equilibrium point is reached. The proposed boosting process ensures that, at its conclusion, the objective function is no worse than its pre-boosting value. However, the global optima cannot be guaranteed. We define three families of boosting functions with different properties and provide simulation results illustrating how this approach improves the solutions obtained for this class of distributed optimization problems. △ Less

Submitted 6 September, 2014; v1 submitted 2 September, 2014; originally announced September 2014.