Showing 1–50 of 71 results for author: Malikopoulos, A

A Note for CPS Data-driven Approaches Developed in the IDS Lab

Authors: Andreas A. Malikopoulos

Abstract: The rapid evolution of Cyber-Physical Systems (CPS) across various domains like mobility systems, networked control systems, sustainable manufacturing, smart power grids, and the Internet of Things necessitates innovative solutions that merge control and learning [1]. Traditional model-based control methodologies often fail to adapt to the dynamism and complexity of modern CPS. This report outline… ▽ More The rapid evolution of Cyber-Physical Systems (CPS) across various domains like mobility systems, networked control systems, sustainable manufacturing, smart power grids, and the Internet of Things necessitates innovative solutions that merge control and learning [1]. Traditional model-based control methodologies often fail to adapt to the dynamism and complexity of modern CPS. This report outlines a comprehensive approach undertaken by the Information and Decision Science (IDS) Lab, focusing on integrating data-driven techniques with control strategies to enhance CPS performance, particularly in the context of energy efficiency and environmental impact. CPS are intricate networks where physical and software components are deeply intertwined, operating as systems of systems. These systems are characterized by their informationally decentralized nature, posing significant challenges in optimization and control. Classical control methods depend heavily on precise models, which often do not capture the full complexity of real-world CPS. As these systems generate large volumes of real-time data, there is a growing need for control algorithms that can leverage this data effectively. The IDS Lab is at the forefront of develo** such data-driven approaches for CPS. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Comments: 13 pages

A Feasibility Analysis at Signal-Free Intersections

Authors: Filippos N. Tzortzoglou, Logan E. Beaver, Andreas A. Malikopoulos

Abstract: In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increas… ▽ More In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increases, the domain of the feasible trajectories decreases. We use concepts of numerical interpolation to identify appropriate polynomials that can serve as alternative trajectories of the CAVs, expanding the domain of the feasible CAV trajectories. We provide the conditions under which such polynomials exist. Finally, we demonstrate the efficacy of our approach through numerical simulations. △ Less

Submitted 8 March, 2024; originally announced March 2024.

Stochastic Control with Distributionally Robust Constraints for Cyber-Physical Systems Vulnerable to Attacks

Authors: Nishanth Venkatesh, Aditya Dave, Ioannis Faros, Andreas A. Malikopoulos

Abstract: In this paper, we investigate the control of a cyber-physical system (CPS) while accounting for its vulnerability to external attacks. We formulate a constrained stochastic problem with a robust constraint to ensure robust operation against potential attacks. We seek to minimize the expected cost subject to a constraint limiting the worst-case expected damage an attacker can impose on the CPS. We… ▽ More In this paper, we investigate the control of a cyber-physical system (CPS) while accounting for its vulnerability to external attacks. We formulate a constrained stochastic problem with a robust constraint to ensure robust operation against potential attacks. We seek to minimize the expected cost subject to a constraint limiting the worst-case expected damage an attacker can impose on the CPS. We present a dynamic programming decomposition to compute the optimal control strategy in this robust-constrained formulation and prove its recursive feasibility. We also illustrate the utility of our results by applying them to a numerical simulation. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Comments: 8 pages, 2 Figures with 3 sub-figures each, submitted to the ECC 2024 conference for review

Combining Learning and Control in Linear Systems

Authors: Andreas A. Malikopoulos

Abstract: In this paper, we provide a theoretical framework that separates the control and learning tasks in a linear system. This separation allows us to combine offline model-based control with online learning approaches and thus circumvent current challenges in deriving optimal control strategies in applications where a large volume of data is added to the system gradually in real time and not altogether… ▽ More In this paper, we provide a theoretical framework that separates the control and learning tasks in a linear system. This separation allows us to combine offline model-based control with online learning approaches and thus circumvent current challenges in deriving optimal control strategies in applications where a large volume of data is added to the system gradually in real time and not altogether in advance. We provide an analytical example to illustrate the framework. △ Less

Submitted 25 March, 2024; v1 submitted 22 October, 2023; originally announced October 2023.

Comments: 6 pages, 1 figure. arXiv admin note: text overlap with arXiv:2211.14972

Addressing Mixed Traffic Through Platooning of Vehicles

Authors: Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better operating decisions to improve safety and reduce pollution, energy consumption, and travel delays. While several studies have shown the benefits of CAVs in reducing energy and alleviating traffic congestion in specific traffic scenar… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better operating decisions to improve safety and reduce pollution, energy consumption, and travel delays. While several studies have shown the benefits of CAVs in reducing energy and alleviating traffic congestion in specific traffic scenarios, e.g., crossing signal-free intersections, merging at roadways and roundabouts, cruising in congested traffic, passing through speed reduction zones, and lane-merging or passing maneuvers, most of these efforts have focused on 100% CAV penetration rates without considering human-driven vehicles (HDVs). One key question that still remains unanswered is ``how can CAVs and HDVs be coordinated safely?'' In this paper, we report on an optimal control framework to coordinate CAVs and HDVs at any traffic scenario. The idea is to directly control the CAVs to force the trailing HDVs to form platoons. Thus, we indirectly control the HDVs by coordinating the platoon of HDVs led by CAVs. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 20 pages, 7 figures. arXiv admin note: substantial text overlap with arXiv:2003.12183, arXiv:2103.03393

A Hierarchical Approach to Optimal Flow-Based Routing and Coordination of Connected and Automated Vehicles

Authors: Heeseung Bang, Andreas A. Malikopoulos

Abstract: This paper addresses the challenge of generating optimal vehicle flow at the macroscopic level. Although several studies have focused on optimizing vehicle flow, little attention has been given to ensuring it can be practically achieved. To overcome this issue, we propose a route-recovery and eco-driving strategy for connected and automated vehicles (CAVs) that guarantees optimal flow generation.… ▽ More This paper addresses the challenge of generating optimal vehicle flow at the macroscopic level. Although several studies have focused on optimizing vehicle flow, little attention has been given to ensuring it can be practically achieved. To overcome this issue, we propose a route-recovery and eco-driving strategy for connected and automated vehicles (CAVs) that guarantees optimal flow generation. Our approach involves identifying the optimal vehicle flow that minimizes total travel time, given the constant travel demands in urban areas. We then develop a heuristic route-recovery algorithm to assign routes to CAVs. Finally, we present an efficient coordination framework to minimize the energy consumption of CAVs while safely crossing intersections. The proposed method can effectively generate optimal vehicle flow and potentially reduce travel time and energy consumption in urban areas. △ Less

Submitted 6 September, 2023; v1 submitted 30 March, 2023; originally announced March 2023.

Comments: 6 pages, 5 figures

Worst-Case Control and Learning Using Partial Observations Over an Infinite Time-Horizon

Authors: Aditya Dave, Ioannis Faros, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning in partially observed systems to minimize the worst-case discounted cost over an infinite time horizon. We model disturbances to the system as finite-valued un… ▽ More Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning in partially observed systems to minimize the worst-case discounted cost over an infinite time horizon. We model disturbances to the system as finite-valued uncertain variables with unknown probability distributions. For problems with known system dynamics, we construct a dynamic programming (DP) decomposition to compute the optimal control strategy. Our first contribution is to define information states that improve the computational tractability of this DP without loss of optimality. Then, we describe a simplification for a class of problems where the incurred cost is observable at each time instance. Our second contribution is defining an approximate information state that can be constructed or learned directly from observed data for problems with observable costs. We derive bounds on the performance loss of the resulting approximate control strategy and illustrate the effectiveness of our approach in partially observed decision-making problems with a numerical example. △ Less

Submitted 31 March, 2023; v1 submitted 28 March, 2023; originally announced March 2023.

Approximate Information States for Worst-Case Control and Learning in Uncertain Systems

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we investigate discrete-time decision-making problems in uncertain systems with partially observed states. We consider a non-stochastic model, where uncontrolled disturbances acting on the system take values in bounded sets with unknown distributions. We present a general framework for decision-making in such problems by using the notion of the information state and approximate info… ▽ More In this paper, we investigate discrete-time decision-making problems in uncertain systems with partially observed states. We consider a non-stochastic model, where uncontrolled disturbances acting on the system take values in bounded sets with unknown distributions. We present a general framework for decision-making in such problems by using the notion of the information state and approximate information state, and introduce conditions to identify an uncertain variable that can be used to compute an optimal strategy through a dynamic program (DP). Next, we relax these conditions and define approximate information states that can be learned from output data without knowledge of system dynamics. We use approximate information states to formulate a DP that yields a strategy with a bounded performance loss. Finally, we illustrate the application of our results in control and reinforcement learning using numerical examples. △ Less

Submitted 5 April, 2024; v1 submitted 12 January, 2023; originally announced January 2023.

Comments: Preliminary results related to this article were reported in arXiv:2203.15271

A Control Framework for Socially-Optimal Emerging Mobility Systems

Authors: Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to significantly improve safety and transportation efficiency by monitoring network conditions and making better operating decisions. CAVs, however, could alter the tendency to travel, eventually leading to a high traffic demand and causing rebound effects (e.g., increasing vehicle miles traveled). T… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity for enabling users to significantly improve safety and transportation efficiency by monitoring network conditions and making better operating decisions. CAVs, however, could alter the tendency to travel, eventually leading to a high traffic demand and causing rebound effects (e.g., increasing vehicle miles traveled). This chapter provides a control framework to distribute travel demand in a given transportation network, resulting in a socially optimal mobility system that travelers would be willing to accept. A "socially optimal mobility system" implies a mobility system that (1) is efficient (in terms of energy consumption and travel time), (2) mitigates rebound effects, and (3) ensures equity in transportation. △ Less

Submitted 20 September, 2023; v1 submitted 6 January, 2023; originally announced January 2023.

Comments: 17 pages, 6 figures. arXiv admin note: text overlap with arXiv:2011.14399

On Separation Between Learning and Control in Partially Observed Markov Decision Processes

Authors: Andreas A. Malikopoulos

Abstract: Cyber-physical systems (CPS) encounter a large volume of data which is added to the system gradually in real time and not altogether in advance. As the volume of data increases, the domain of the control strategies also increases, and thus it becomes challenging to search for an optimal strategy. Even if an optimal control strategy is found, implementing such strategies with increasing domains is… ▽ More Cyber-physical systems (CPS) encounter a large volume of data which is added to the system gradually in real time and not altogether in advance. As the volume of data increases, the domain of the control strategies also increases, and thus it becomes challenging to search for an optimal strategy. Even if an optimal control strategy is found, implementing such strategies with increasing domains is burdensome. To derive an optimal control strategy in CPS, we typically assume an ideal model of the system. Such model-based control approaches cannot effectively facilitate optimal solutions with performance guarantees due to the discrepancy between the model and the actual CPS. Alternatively, traditional supervised learning approaches cannot always facilitate robust solutions using data derived offline. Similarly, applying reinforcement learning approaches directly to the actual CPS might impose significant implications on safety and robust operation of the system. The goal of this chapter is to provide a theoretical framework that aims at separating the control and learning tasks which allows us to combine offline model-based control with online learning approaches, and thus circumvent the challenges in deriving optimal control strategies for CPS. △ Less

Submitted 27 November, 2022; originally announced November 2022.

Comments: 18 pages, 5 figures. arXiv admin note: text overlap with arXiv:2101.10992

Connected and Integrated Transportation Systems

Authors: Andreas A. Malikopoulos

Abstract: The article provides an overview of the latest developments on control approaches for connected and automated vehicles along with their effectiveness on energy and transportation efficiency. The article provides an overview of the latest developments on control approaches for connected and automated vehicles along with their effectiveness on energy and transportation efficiency. △ Less

Submitted 15 November, 2022; originally announced November 2022.

Comments: 9 pagers, 3 figures

On Robust Control of Partially Observed Uncertain Systems with Additive Costs

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we consider the problem of optimizing the worst-case behavior of a partially observed system. All uncontrolled disturbances are modeled as finite-valued uncertain variables. Using the theory of cost distributions, we present a dynamic programming (DP) approach to compute a control strategy that minimizes the maximum possible total cost over a given time horizon. To improve the compu… ▽ More In this paper, we consider the problem of optimizing the worst-case behavior of a partially observed system. All uncontrolled disturbances are modeled as finite-valued uncertain variables. Using the theory of cost distributions, we present a dynamic programming (DP) approach to compute a control strategy that minimizes the maximum possible total cost over a given time horizon. To improve the computational efficiency of the optimal DP, we introduce a general definition for information states and show that many information states constructed in previous research efforts are special cases of ours. Additionally, we define approximate information states and an approximate DP that can further improve computational tractability by conceding a bounded performance loss. We illustrate the utility of these results using a numerical example. △ Less

Submitted 18 February, 2023; v1 submitted 27 September, 2022; originally announced September 2022.

Comments: This article is specializes to additive cost problems the theory and results presented for terminal cost problems in arXiv:2203.15271

A Constraint-Driven Approach to Line Flocking: The V Formation as an Energy-Saving Strategy

Authors: Logan E. Beaver, Christopher Kroninger, Michael Dorothy, Andreas A. Malikopoulos

Abstract: The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents… ▽ More The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents to the system. First, we present an analytical model for the trailing upwash behind a fixed-wing UAV, and we derive the optimal air speed for trailing UAVs to maximize their travel endurance. Next, we prove that simply flying at the optimal airspeed will never lead to emergent flocking behavior, and we propose a new decentralized "anseroid" behavior that yields emergent V formations. We encode these behaviors in a constraint-driven control algorithm that minimizes the locomotive power of each UAV. Finally, we prove that UAVs initialized in an approximate V or echelon formation will converge under our proposed control law, and we demonstrate this emergence occurs in real-time in simulation and in physical experiments with a fleet of Crazyflie quadrotors. △ Less

Submitted 23 September, 2022; originally announced September 2022.

Comments: 12 pages, 7 figures

A Safety-Prioritized Receding Horizon Control Framework for Platoon Formation in a Mixed Traffic Environment

Authors: A M Ishtiaque Mahbub, Viet-Anh Le, Andreas A. Malikopoulos

Abstract: Platoon formation with connected and automated vehicles (CAVs) in a mixed traffic environment poses significant challenges due to the presence of human-driven vehicles (HDVs) with unknown dynamics and control actions. In this paper, we develop a safety-prioritized receding horizon control framework for creating platoons of HDVs preceded by a CAV. Our framework ensures indirect control of the follo… ▽ More Platoon formation with connected and automated vehicles (CAVs) in a mixed traffic environment poses significant challenges due to the presence of human-driven vehicles (HDVs) with unknown dynamics and control actions. In this paper, we develop a safety-prioritized receding horizon control framework for creating platoons of HDVs preceded by a CAV. Our framework ensures indirect control of the following HDVs by directly controlling the leading CAV given the safety constraints. The framework utilizes a data-driven prediction model that is based on the recursive least squares algorithm and the constant time headway relative velocity car-following model to predict future trajectories of human-driven vehicles. To demonstrate the efficacy of the proposed framework, we conduct numerical simulations and provide the associated scalability, robustness, and performance analyses. △ Less

Submitted 22 February, 2023; v1 submitted 21 May, 2022; originally announced May 2022.

A Barrier-Certified Optimal Coordination Framework for Connected and Automated Vehicles

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection by integrating a safety layer using control barrier functions. First, in our motion planning module, each CAV computes the optimal control trajectory using simple vehicle dynamics. The trajectory does not make any of the state, control, and safety… ▽ More In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection by integrating a safety layer using control barrier functions. First, in our motion planning module, each CAV computes the optimal control trajectory using simple vehicle dynamics. The trajectory does not make any of the state, control, and safety constraints active. A vehicle-level tracking controller employs a combined feedforward-feedback control law to track the resulting optimal trajectory from the motion planning module. Then, a barrier-certificate module, acting as a middle layer between the vehicle-level tracking controller and physical vehicle, receives the control law from the vehicle-level tracking controller and using realistic vehicle dynamics ensures that none of the state, control, and safety constraints becomes active. The latter is achieved through a quadratic program, which can be solved efficiently in real time. We demonstrate the effectiveness of our extended framework through a numerical simulation. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: 8 pages, 5 figures, 1 table

Journal ref: IEEE Conference on Decision and Control, (2022), 2264-2269

Approximate Information States for Worst-case Control of Uncertain Systems

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we investigate a worst-case-scenario control problem with a partially observed state. We consider a non-stochastic formulation, where noises and disturbances in our dynamics are uncertain variables which take values in finite sets. In such problems, the optimal control strategy can be derived using a dynamic program (DP) with respect to the memory. The computational complexity of th… ▽ More In this paper, we investigate a worst-case-scenario control problem with a partially observed state. We consider a non-stochastic formulation, where noises and disturbances in our dynamics are uncertain variables which take values in finite sets. In such problems, the optimal control strategy can be derived using a dynamic program (DP) with respect to the memory. The computational complexity of this DP can be improved using a conditional range of the state instead of the memory. We present a more general definition of an information state which is sufficient to construct a DP without loss of optimality, and show that the conditional range is an example of an information state. Next, we extend this notion to define an approximate information state and an approximate DP. We also bound the maximum loss of optimality when using an approximate DP to derive the control strategy. Finally, we illustrate our results in a numerical example. △ Less

Submitted 24 September, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Journal ref: Proceedings of 61st IEEE Conference on Decision and Control, pp. 4945-4950, 2022

Constraint-Driven Optimal Control for Emergent Swarming and Predator Avoidance

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: In this letter, we present a constraint-driven optimal control framework that achieves emergent cluster flocking within a constrained 2D environment. We formulate a decentralized optimal control problem that includes safety, flocking, and predator avoidance constraints. We explicitly derive conditions for constraint compatibility and propose an event-driven constraint relaxation scheme, which we m… ▽ More In this letter, we present a constraint-driven optimal control framework that achieves emergent cluster flocking within a constrained 2D environment. We formulate a decentralized optimal control problem that includes safety, flocking, and predator avoidance constraints. We explicitly derive conditions for constraint compatibility and propose an event-driven constraint relaxation scheme, which we map to an equivalent finite state machine that intuitively describes the behavior of each agent in the system. Instead of minimizing control effort, as it is common in the ecologically-inspired robotics literature, in our approach, we minimize each agent's deviation from their most efficient locomotion speed. Finally, we demonstrate our approach in simulation both with and without the presence of a predator. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Comments: 6 pages, 5 figures

Safety-Aware and Data-Driven Predictive Control for Connected Automated Vehicles at a Mixed Traffic Signalized Intersection

Authors: A M Ishtiaque Mahbub, Viet-Anh Le, Andreas A. Malikopoulos

Abstract: A typical urban signalized intersection poses significant modeling and control challenges in a mixed traffic environment consisting of connected automated vehicles (CAVs) and human-driven vehicles (HDVs). In this paper, we address the problem of deriving safe trajectories for CAVs in a mixed traffic environment that prioritizes rear-end collision avoidance when the preceding HDVs approach the yell… ▽ More A typical urban signalized intersection poses significant modeling and control challenges in a mixed traffic environment consisting of connected automated vehicles (CAVs) and human-driven vehicles (HDVs). In this paper, we address the problem of deriving safe trajectories for CAVs in a mixed traffic environment that prioritizes rear-end collision avoidance when the preceding HDVs approach the yellow and red signal phases of the intersection. We present a predictive control framework that employs a recursive least squares algorithm to approximate in real time the driving behavior of the preceding HDVs and then uses this approximation to derive safety-aware trajectory in a finite horizon. We validate the effectiveness of our proposed framework through numerical simulation and analyze the robustness of the control framework. △ Less

Submitted 21 May, 2022; v1 submitted 10 March, 2022; originally announced March 2022.

A Constrained Optimal Control Framework for Vehicle Platoons with Delayed Communication

Authors: A M Ishtiaque Mahbub, Behdad Chalaki, Andreas A. Malikopoulos

Abstract: Vehicle platooning using connected and automated vehicles (CAVs) has attracted considerable attention. In this paper, we address the problem of optimal coordination of CAV platoons at a highway on-ramp merging. We present a single-level constrained optimal control framework that optimizes fuel economy and travel time of the platoons while satisfying the state, control, and safety constraints. We a… ▽ More Vehicle platooning using connected and automated vehicles (CAVs) has attracted considerable attention. In this paper, we address the problem of optimal coordination of CAV platoons at a highway on-ramp merging. We present a single-level constrained optimal control framework that optimizes fuel economy and travel time of the platoons while satisfying the state, control, and safety constraints. We also explore the effect of delayed communication among the CAV platoons and propose a robust coordination framework to enforce lateral and rear-end collision avoidance constraints in the presence of bounded delays. We provide a closed-form analytical solution of the optimal control problem with safety guarantees that can be implemented in real time. Finally, we validate the effectiveness of the proposed control framework using a high-fidelity commercial simulation environment. △ Less

Submitted 15 November, 2021; originally announced November 2021.

A First-Order Approach to Model Simultaneous Control of Multiple Microrobots

Authors: Logan E. Beaver, Sambeeta Das, Andreas A. Malikopoulos

Abstract: The control of swarm systems is relatively well understood for simple robotic platforms at the macro scale. However, there are still several unanswered questions about how similar results can be achieved for microrobots. In this paper, we propose a modeling framework based on a dynamic model of magnetized self-propelling Janus microrobots under a global magnetic field. We verify our model experime… ▽ More The control of swarm systems is relatively well understood for simple robotic platforms at the macro scale. However, there are still several unanswered questions about how similar results can be achieved for microrobots. In this paper, we propose a modeling framework based on a dynamic model of magnetized self-propelling Janus microrobots under a global magnetic field. We verify our model experimentally and provide methods that can aim at accurately describing the behavior of microrobots while modeling their simultaneous control. The model can be generalized to other microrobotic platforms in low Reynolds number environments. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Comments: 7 pages, 2 figures

Congestion-Aware Routing, Rebalancing, and Charging Scheduling for Electric Autonomous Mobility-on-Demand System

Authors: Heeseung Bang, Andreas A. Malikopoulos

Abstract: In this paper, we investigate the problem of routing, rebalancing, and charging for electric autonomous mobility-on-demand systems concerning traffic congestion. We analyze the problem at the macroscopical level and use a volume-delay function to capture traffic congestion. To address this problem, we first formulate an optimization problem for routing and rebalancing. Then, we present heuristic a… ▽ More In this paper, we investigate the problem of routing, rebalancing, and charging for electric autonomous mobility-on-demand systems concerning traffic congestion. We analyze the problem at the macroscopical level and use a volume-delay function to capture traffic congestion. To address this problem, we first formulate an optimization problem for routing and rebalancing. Then, we present heuristic algorithms to find the loop of the traffic flow and examine the energy constraints within the resulting loop. We impose charging constraints on the re-routing problem so that the new solution satisfies the energy constraint. Finally, we verify the effectiveness of our method through simulation. △ Less

Submitted 7 March, 2022; v1 submitted 10 October, 2021; originally announced October 2021.

Comments: 6 pages, 2 figures

Journal ref: Proceedings of 2022 American Control Conference (ACC), Atlanta, GA, 2022

Platoon Formation in a Mixed Traffic Environment: A Model-Agnostic Optimal Control Approach

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Coordination of connected and automated vehicles (CAVs) in a mixed traffic environment poses significant challenges due to the presence of human-driven vehicles (HDVs) with stochastic dynamics and driving behavior. In earlier work, we addressed the problem of platoon formation of HDVs led by a CAV using a model-dependent controller. In this paper, we develop a comprehensive model-agnostic, multi-o… ▽ More Coordination of connected and automated vehicles (CAVs) in a mixed traffic environment poses significant challenges due to the presence of human-driven vehicles (HDVs) with stochastic dynamics and driving behavior. In earlier work, we addressed the problem of platoon formation of HDVs led by a CAV using a model-dependent controller. In this paper, we develop a comprehensive model-agnostic, multi-objective optimal controller which ensures platoon formation by directly controlling the leading CAV without having explicit knowledge of the trailing HDV dynamics. We provide a detailed exposition of the control framework that uses instantaneous motion information from multiple successive HDVs to enforce safety while achieving the optimization objectives. To demonstrate the efficacy of the proposed control framework, we evaluate its performance using numerical simulation and provide associated sensitivity and robustness analysis. △ Less

Submitted 10 March, 2022; v1 submitted 10 October, 2021; originally announced October 2021.

Comments: arXiv admin note: text overlap with arXiv:2103.03393

Journal ref: 2022 American Control Conference (ACC), pp. 4746--4751

Decentralized Control of Two Agents with Nested Accessible Information

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we investigate a decentralized stochastic control problem with two agents, where a part of the memory of the second agent is also available to the first agent at each instance of time. We derive a structural form for optimal control strategies which allows us to restrict their domain to a set which does not grow in size with time. We also present a dynamic programming (DP) decomposi… ▽ More In this paper, we investigate a decentralized stochastic control problem with two agents, where a part of the memory of the second agent is also available to the first agent at each instance of time. We derive a structural form for optimal control strategies which allows us to restrict their domain to a set which does not grow in size with time. We also present a dynamic programming (DP) decomposition which can utilize our results to derive optimal strategies for arbitrarily long time horizons. Since obtaining optimal control strategies by solving this DP decomposition is computationally intensive, we present potential resolutions in the form of simplified strategies by imposing additional conditions on our model, and an approximation technique which can be used to implement our results with a bounded loss of optimality. △ Less

Submitted 9 March, 2022; v1 submitted 23 September, 2021; originally announced September 2021.

Journal ref: Proceedings of 2022 American Control Conference (ACC), pp. 3423-3430, 2022

Combining Learning and Control for Data-driven Approaches of Cyber-Physical Systems

Authors: Andreas Malikopoulos

Abstract: Cyber-physical systems (CPS), in most instances, represent systems of systems with an informationally decentralized structure such as emerging mobility systems, networked control systems, sustainable manufacturing, smart power grids, power systems, mobility markets, social media platforms, cooperation of robots, and internet of things. To optimize the operation of such systems, we typically assume… ▽ More Cyber-physical systems (CPS), in most instances, represent systems of systems with an informationally decentralized structure such as emerging mobility systems, networked control systems, sustainable manufacturing, smart power grids, power systems, mobility markets, social media platforms, cooperation of robots, and internet of things. To optimize the operation of such systems, we typically assume an ideal model. Such model-based control approaches cannot effectively facilitate optimal solutions with performance guarantees due to the discrepancy between the model and the actual CPS. On the other hand, in most CPS there is a large volume of data with a dynamic nature which is added to the system gradually in real time and not altogether in advance. Thus, traditional supervised learning approaches cannot always facilitate robust solutions using data derived offline. By contrast, applying reinforcement learning approaches directly to the actual CPS might impose significant implications on the safety and robust operation of the system. The overarching goal of the Information and Decision Science (IDS) Lab is to investigate how to circumvent these challenges by develo** data-driven system approaches at the intersection of learning and control. The emphasis is on how to improve energy efficiency and reduce greenhouse gas emissions in applications related to emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, sociotechnical systems, and smart cities, and thus contribute to the health of the planet. △ Less

Submitted 13 May, 2024; v1 submitted 18 September, 2021; originally announced September 2021.

Comments: 17

On Decentralized Minimax Control with Nested Subsystems

Authors: Aditya Dave, Nishanth Venkatesh, Andreas A. Malikopoulos

Abstract: In this paper, we investigate a decentralized control problem with nested subsystems, which is a general model for one-directional communication amongst many subsystems. The noises in our dynamics are modelled as uncertain variables which take values in finite sets. The objective is to minimize a worst-case shared cost. We demonstrate how the prescription approach can simplify the information stru… ▽ More In this paper, we investigate a decentralized control problem with nested subsystems, which is a general model for one-directional communication amongst many subsystems. The noises in our dynamics are modelled as uncertain variables which take values in finite sets. The objective is to minimize a worst-case shared cost. We demonstrate how the prescription approach can simplify the information structure and derive a structural form for optimal control strategies. The structural form allows us to restrict attention to control strategies whose domains do not grow in size with time, and thus, this form can be utilized in systems with long time horizons. Finally, we present a dynamic program to derive the optimal control strategies and validate our results with a numerical example. △ Less

Submitted 20 March, 2022; v1 submitted 13 September, 2021; originally announced September 2021.

Journal ref: Proceedings of 2022 American Control Conference (ACC), pp. 3437-3444, 2022

Constraint-Driven Optimal Control of Multi-Agent Systems: A Highway Platooning Case Study

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: Platooning has been exploited as a method for vehicles to minimize energy consumption. In this article, we present a constraint-driven optimal control framework that yields emergent platooning behavior for connected and automated vehicles operating in an open transportation system. Our approach combines recent insights in constraint-driven optimal control with the physical aerodynamic interactions… ▽ More Platooning has been exploited as a method for vehicles to minimize energy consumption. In this article, we present a constraint-driven optimal control framework that yields emergent platooning behavior for connected and automated vehicles operating in an open transportation system. Our approach combines recent insights in constraint-driven optimal control with the physical aerodynamic interactions between vehicles in a highway setting. The result is a set of equations that describes when platooning is an appropriate strategy, as well as a descriptive optimal control law that yields emergent platooning behavior. Finally, we demonstrate these properties in simulation. △ Less

Submitted 6 December, 2021; v1 submitted 13 September, 2021; originally announced September 2021.

Comments: 6 pages, 3 figures

Journal ref: IEEE Control Systems Letters, vol. 6, pp. 1754-1759, 2021

A Priority-Aware Replanning and Resequencing Framework for Coordination of Connected and Automated Vehicles

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: Deriving optimal control strategies for coordination of connected and automated vehicles (CAVs) often requires re-evaluating the strategies in order to respond to unexpected changes in the presence of disturbances and uncertainties. In this paper, we first extend a decentralized framework that we developed earlier for coordination of CAVs at a signal-free intersection to incorporate replanning. Th… ▽ More Deriving optimal control strategies for coordination of connected and automated vehicles (CAVs) often requires re-evaluating the strategies in order to respond to unexpected changes in the presence of disturbances and uncertainties. In this paper, we first extend a decentralized framework that we developed earlier for coordination of CAVs at a signal-free intersection to incorporate replanning. Then, we further enhance the framework by introducing a priority-aware resequencing mechanism which designates the order of decision making of CAVs based on theory from the job-shop scheduling problem. Our enhanced framework relaxes the first-come-first-serve decision order which has been used extensively in these problems. We illustrate the effectiveness of our proposed approach through numerical simulations. △ Less

Submitted 9 December, 2021; v1 submitted 12 September, 2021; originally announced September 2021.

Comments: 6 pages, 4 figures

Journal ref: IEEE Control Systems Letters (2022) 1772-1777

A Research and Educational Robotic Testbed for Real-time Control of Emerging Mobility Systems: From Theory to Scaled Experiments

Authors: Behdad Chalaki, Logan E. Beaver, A M Ishtiaque Mahbub, Heeseung Bang, Andreas A. Malikopoulos

Abstract: Emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, and electric vehicles, provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. However, before connectivity and automation are deployed en masse, a thorough evaluation of CAVs… ▽ More Emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, and electric vehicles, provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. However, before connectivity and automation are deployed en masse, a thorough evaluation of CAVs is required-ranging from numerical simulation to real-world public roads. Assessment of the performance of CAVs in scaled testbeds has recently gained momentum due to the flexibility they offer to conduct quick, repeatable experiments that could go one step beyond simulation. This article introduces the Information and Decision Science Lab's Scaled Smart City (IDS$^3$C), a 1:25 research and educational scaled robotic testbed that is capable of replicating different real-world urban traffic scenarios. IDS$^3$C was designed to investigate the effect of emerging mobility systems on safety and transportation efficiency. On the educational front, IDS$^3$C can be used for (a) training and educating graduate students by exposing them to a balanced mix of theory and practice, (b) integrating the research outcomes into existing courses, (c) involving undergraduate students in research, (d) creating interactive educational demos, and (e) reaching out to high-school students. In our exposition, we also present a real-time control framework that can be used to coordinate CAVs at traffic scenarios such as crossing signal-free intersections, merging at roadways and roundabouts, cruising in congested traffic, passing through speed reduction zones, and lane-merging or passing maneuvers. Finally, we provide a tutorial for applying our framework in coordinating robotic CAVs to a multi-lane roundabout scenario and a transportation corridor in IDS$^3$C. △ Less

Submitted 28 March, 2022; v1 submitted 11 September, 2021; originally announced September 2021.

Comments: 35 pages, 9 figures

Journal ref: IEEE Control Systems Magazine (2022)

Separation of Learning and Control for Cyber-Physical Systems

Authors: Andreas A. Malikopoulos

Abstract: Most cyber-physical systems (CPS) encounter a large volume of data which is added to the system gradually in real time and not altogether in advance. In this paper, we provide a theoretical framework that yields optimal control strategies for such CPS at the intersection of control theory and learning. In the proposed framework, we use the actual CPS, i.e., the "true" system that we seek to optima… ▽ More Most cyber-physical systems (CPS) encounter a large volume of data which is added to the system gradually in real time and not altogether in advance. In this paper, we provide a theoretical framework that yields optimal control strategies for such CPS at the intersection of control theory and learning. In the proposed framework, we use the actual CPS, i.e., the "true" system that we seek to optimally control online, in parallel with a model of the CPS that is available. We then institute an information state for the system which does not depend on the control strategy. An important consequence of this independence is that for any given choice of a control strategy and a realization of the system's variables until time t, the information states at future times do not depend on the choice of the control strategy at time t but only on the realization of the decision at time t, and thus they are related to the concept of separation between estimation of the state and control. Namely, the future information states are separated from the choice of the current control strategy. Such control strategies are called separated control strategies. Hence, we can derive offline the optimal control strategy of the system with respect to the information state, which might not be precisely known due to model uncertainties or complexity of the system, and then use standard learning approaches to learn the information state online while data are added gradually to the system in real time. We show that after the information state becomes known, the separated control strategy of the CPS model derived offline is optimal for the actual system. We illustrate the proposed framework in a dynamic system consisting of two subsystems with a delayed sharing information structure. △ Less

Submitted 19 December, 2022; v1 submitted 13 July, 2021; originally announced July 2021.

Comments: 19 pages, 2 figures. arXiv admin note: text overlap with arXiv:2101.10992

A Dynamic Program for a Team of Two Agents with Nested Information

Authors: Aditya Dave, Andreas A. Malikopoulos

Abstract: In this paper, we investigate a sequential dynamic team problem consisting of two agents with a nested information structure. We use a combination of the person-by-person and prescription approach to derive structural results for optimal control strategies for the team. We then use these structural results to present a dynamic programming (DP) decomposition to derive the optimal control strategies… ▽ More In this paper, we investigate a sequential dynamic team problem consisting of two agents with a nested information structure. We use a combination of the person-by-person and prescription approach to derive structural results for optimal control strategies for the team. We then use these structural results to present a dynamic programming (DP) decomposition to derive the optimal control strategies for a finite time horizon. We show that our DP utilizes the nested information structure to simplify the computation of the optimal control laws for the team at the final time step. △ Less

Submitted 12 September, 2021; v1 submitted 18 March, 2021; originally announced March 2021.

Journal ref: Proceedings of the 60th IEEE Conference on Decision and Control, pp. 3768-3773, 2021

A Platoon Formation Framework in a Mixed Traffic Environment

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce pollution, energy consumption, and travel delays. In this paper, we address the problem of vehicle platoon formation in a traffic network with partial CAV penetration rates. We investigate the interaction between CAV and human-driven vehicle (HDV) dynamics, and provide a rigorous control framework that enable… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce pollution, energy consumption, and travel delays. In this paper, we address the problem of vehicle platoon formation in a traffic network with partial CAV penetration rates. We investigate the interaction between CAV and human-driven vehicle (HDV) dynamics, and provide a rigorous control framework that enables platoon formation with the HDVs by only controlling the CAVs within the network. We present a complete analytical solution of the CAV control policy and the conditions under which a platoon formation is feasible. We evaluate the solution and demonstrate the efficacy of the proposed framework using numerical simulation. △ Less

Submitted 21 June, 2021; v1 submitted 4 March, 2021; originally announced March 2021.

Optimal Control of Differentially Flat Systems is Surprisingly Easy

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise… ▽ More As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise during optimization, and this simplification eliminates the numerical instabilities that plague optimal control in general. We also present an explicit differential equation that describes the evolution of the optimal state trajectory, and we extend our results to consider both the unconstrained and constrained cases. Furthermore, we demonstrate the performance of our approach by generating the optimal trajectory for a planar manipulator with two revolute joints. We show in simulation that our approach is able to generate the constrained optimal trajectory in $4.5$ ms while respecting workspace constraints and switching between a `left' and `right' bend in the elbow joint. △ Less

Submitted 26 August, 2023; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: 14 pages, 4 figures

Robust Learning-Based Trajectory Planning for Emerging Mobility Systems

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection to incorporate uncertainty. Using the possibly noisy observations of actual time trajectories and leveraging Gaussian process regression, we learn the bounded confidence intervals for deviations from the nominal trajectories of CAVs online. Incorp… ▽ More In this paper, we extend a framework that we developed earlier for coordination of connected and automated vehicles (CAVs) at a signal-free intersection to incorporate uncertainty. Using the possibly noisy observations of actual time trajectories and leveraging Gaussian process regression, we learn the bounded confidence intervals for deviations from the nominal trajectories of CAVs online. Incorporating these confidence intervals, we reformulate the trajectory planning as a robust coordination problem, the solution of which guarantees that constraints in the system are satisfied in the presence of bounded deviations from the nominal trajectories. We demonstrate the effectiveness of our extended framework through a numerical simulation. △ Less

Submitted 7 October, 2021; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: 8 pages, 6 figures

Journal ref: 2022 American Control Conference (ACC), (2022), 2154-2159

On Team Decision Problems with Nonclassical Information Structures

Authors: Andreas A. Malikopoulos

Abstract: In this paper, we consider sequential dynamic team decision problems with nonclassical information structures. First, we address the problem from the point of view of a ``manager" who seeks to derive the optimal strategy of the team in a centralized process. We derive structural results that yield an information state for the team which does not depend on the control strategy, and thus it can lead… ▽ More In this paper, we consider sequential dynamic team decision problems with nonclassical information structures. First, we address the problem from the point of view of a ``manager" who seeks to derive the optimal strategy of the team in a centralized process. We derive structural results that yield an information state for the team which does not depend on the control strategy, and thus it can lead to a dynamic programming decomposition where the optimization problem is over the space of the team's decisions. We, then, derive structural results for each team member that yield an information state which does not depend on their control strategy, and thus it can lead to a dynamic programming decomposition where the optimization problem for each team member is over the space of their decisions. Finally, we show that the solution of each team member is the same as the one derived by the manager. We present an illustrative example of a dynamic team with a delayed sharing information structure. △ Less

Submitted 11 November, 2022; v1 submitted 26 January, 2021; originally announced January 2021.

Comments: 16 pages

A Hysteretic Q-learning Coordination Framework for Emerging Mobility Systems in Smart Cities

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) can alleviate traffic congestion, air pollution, and improve safety. In this paper, we provide a decentralized coordination framework for CAVs at a signal-free intersection to minimize travel time and improve fuel efficiency. We employ a simple yet powerful reinforcement learning approach, an off-policy temporal difference learning called Q-learning, enhance… ▽ More Connected and automated vehicles (CAVs) can alleviate traffic congestion, air pollution, and improve safety. In this paper, we provide a decentralized coordination framework for CAVs at a signal-free intersection to minimize travel time and improve fuel efficiency. We employ a simple yet powerful reinforcement learning approach, an off-policy temporal difference learning called Q-learning, enhanced with a coordination mechanism to address this problem. Then, we integrate a first-in-first-out queuing policy to improve the performance of our system. We demonstrate the efficacy of our proposed approach through simulation and comparison with the classical optimal control method based on Pontryagin's minimum principle. △ Less

Submitted 5 November, 2020; originally announced November 2020.

Comments: 8 pages, 5 figures, 2 tables

Journal ref: 2021 European Control Conference (ECC), 17-22

An Overview on Optimal Flocking

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: The study of robotic flocking has received considerable attention in the past twenty years. As we begin to deploy flocking control algorithms on physical multi-agent and swarm systems, there is an increasing necessity for rigorous promises on safety and performance. In this paper, we present an overview the literature focusing on optimization approaches to achieve flocking behavior that provide st… ▽ More The study of robotic flocking has received considerable attention in the past twenty years. As we begin to deploy flocking control algorithms on physical multi-agent and swarm systems, there is an increasing necessity for rigorous promises on safety and performance. In this paper, we present an overview the literature focusing on optimization approaches to achieve flocking behavior that provide strong safety guarantees. We separate the literature into cluster and line flocking, and categorize cluster flocking with respect to the system-level objective, which may be realized by a reactive or planning control algorithm. We also categorize the line flocking literature by the energy-saving mechanism that is exploited by the agents. We present several approaches aimed at minimizing the communication and computational requirements in real systems via neighbor filtering and event-driven planning, and conclude with our perspective on the outlook and future research direction of optimal flocking as a field. △ Less

Submitted 22 January, 2021; v1 submitted 29 September, 2020; originally announced September 2020.

Comments: 21 pages, 5 figures

Journal ref: Annual Reviews in Control, April 2021

Energy-Optimal Motion Planning for Agents: Barycentric Motion and Collision Avoidance Constraints

Authors: Logan E. Beaver, Michael Dorothy, Christopher Kroninger, Andreas A. Malikopoulos

Abstract: As robotic swarm systems emerge, it is increasingly important to provide strong guarantees on energy consumption and safety to maximize system performance. One approach to achieve these guarantees is through constraint-driven control, where agents seek to minimize energy consumption subject to a set of safety and task constraints. In this paper, we provide a sufficient and necessary condition for… ▽ More As robotic swarm systems emerge, it is increasingly important to provide strong guarantees on energy consumption and safety to maximize system performance. One approach to achieve these guarantees is through constraint-driven control, where agents seek to minimize energy consumption subject to a set of safety and task constraints. In this paper, we provide a sufficient and necessary condition for an energy-minimizing agent with integrator dynamics to have a continuous control input at the transition between unconstrained and constrained trajectories. In addition, we present and analyze barycentric motion and collision avoidance constraints to be used in constraint-driven control of swarms. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: 6 pages, no figures

Journal ref: 2021 American Control Conference (ACC), pp 1037-1042

Optimal Control of Connected and Automated Vehicles at Multiple Adjacent Intersections

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we establish a decentralized optimal control framework for connected and automated vehicles (CAVs) crossing multiple adjacent, multi-lane signal-free intersections to minimize energy consumption and improve traffic throughput. Our framework consists of two layers of planning. In the upper-level planning, each CAV computes its optimal arrival time at each intersection recursively alo… ▽ More In this paper, we establish a decentralized optimal control framework for connected and automated vehicles (CAVs) crossing multiple adjacent, multi-lane signal-free intersections to minimize energy consumption and improve traffic throughput. Our framework consists of two layers of planning. In the upper-level planning, each CAV computes its optimal arrival time at each intersection recursively along with the optimal lane to improve the traffic throughput. In the low-level planning, we formulate an energy-optimal control problem with interior-point constraints, the solution of which yields the optimal control input (acceleration/deceleration) of each CAV to cross the intersections at the time specified by the upper-level planning. Moreover, we extend the results of the proposed bi-level framework to include a bounded steady-state error in tracking the optimal position of the CAVs. Finally, we demonstrate the effectiveness of the proposed framework through simulation for symmetric and asymmetric intersections and comparison with traditional signalized intersections. △ Less

Submitted 18 May, 2021; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: 14 pages, 9 figures, 5 tables

Journal ref: IEEE Transactions on Control Systems Technology (2022) vol. 30, no. 3, pp. 972-984

Conditions to Provable System-Wide Optimal Coordination of Connected and Automated Vehicles

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity to improve energy efficiency, traffic flow, and safety. In earlier work, we addressed the constrained optimal coordination problem of CAVs at different traffic scenarios using Hamiltonian analysis. In this paper, we investigate the properties of the unconstrained problem and provide conditions under which different com… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity to improve energy efficiency, traffic flow, and safety. In earlier work, we addressed the constrained optimal coordination problem of CAVs at different traffic scenarios using Hamiltonian analysis. In this paper, we investigate the properties of the unconstrained problem and provide conditions under which different combination of the state and control constraints become active. We present a condition-based computational framework that improves on the standard iterative solution procedure of the constrained Hamiltonian analysis. Finally, we derive a closed-form analytical solution of the constrained optimal control problem and validate the proposed framework using numerical simulation. The solution can be derived without any recursive steps, and thus it is appropriate for real-time implementation on-board the CAVs. △ Less

Submitted 16 April, 2021; v1 submitted 29 May, 2020; originally announced May 2020.

Optimal Time Trajectory and Coordination for Connected and Automated Vehicles

Authors: Andreas A. Malikopoulos, Logan E. Beaver, Ioannis Vasileios Chremos

Abstract: In this paper, we provide a decentralized theoretical framework for coordination of connected and automated vehicles (CAVs) at different traffic scenarios. The framework includes: (1) an upper-level optimization that yields for each CAV its optimal time trajectory and lane to pass through a given traffic scenario while alleviating congestion; and (2) a low-level optimization that yields for each C… ▽ More In this paper, we provide a decentralized theoretical framework for coordination of connected and automated vehicles (CAVs) at different traffic scenarios. The framework includes: (1) an upper-level optimization that yields for each CAV its optimal time trajectory and lane to pass through a given traffic scenario while alleviating congestion; and (2) a low-level optimization that yields for each CAV its optimal control input (acceleration/deceleration). We provide a complete, analytical solution of the low-level optimization problem that includes the rear-end, speed-dependent safety constraint. Furthermore, we provide a problem formulation for the upper-level optimization in which there is no duality gap. The latter implies that the optimal time trajectory for each CAV does not activate any of the state, control, and safety constraints of the low-level optimization, thus allowing for online implementation. Finally, we present a geometric duality framework with hyperplanes to derive the condition under which the optimal solution of the upper-level optimization always exists. We validate the effectiveness of the proposed theoretical framework through simulation. △ Less

Submitted 9 January, 2021; v1 submitted 26 March, 2020; originally announced March 2020.

Comments: 19 pages, 5 figures

Journal ref: Automatica, 125, 2021

Decentralized Optimal Coordination of Connected and Automated Vehicles for Multiple Traffic Scenarios

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos, Liuhui Zhao

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity to optimize energy consumption and travel time. Several approaches have been proposed in the literature that allow CAVs to coordinate in situations where there is a potential conflict, for example, in signalized intersections, merging at roadways and roundabouts, to reduce energy consumption and optimize traffic flow.… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity to optimize energy consumption and travel time. Several approaches have been proposed in the literature that allow CAVs to coordinate in situations where there is a potential conflict, for example, in signalized intersections, merging at roadways and roundabouts, to reduce energy consumption and optimize traffic flow. In this paper, we consider the problem of coordinating CAVs in a corridor consisting of multiple traffic scenarios. We formulate a two-level optimization problem in which we maximize traffic throughput in the upper-level problem, and derive a closed-form analytical solution that yields the optimal control input for each CAV, in terms of fuel consumption, in the low-level problem. We validate the effectiveness of the solution through simulation under 100% CAVpenetration rate. Fuel consumption and travel time for the vehicles are significantly reduced compared to a baseline scenario consisting of human-driven vehicles. △ Less

Submitted 9 March, 2020; originally announced March 2020.

Comments: arXiv admin note: text overlap with arXiv:1909.10106

Decentralized Cooperative Merging of Platoons of Connected and Automated Vehicles at Highway On-Ramps

Authors: Sharmila Devi Kumaravel, Andreas A. Malikopoulos, Ramakalyan Ayyagari

Abstract: In this paper, we propose an optimization framework for cooperative merging of platoons of connected and automated vehicles at highway on-ramps. The framework includes (1) an optimal scheduling algorithm, through which, each platoon derives the sequence and time to enter the highway safely, and (2) an optimal control algorithm that allows each platoon to derive its optimal control input (accelerat… ▽ More In this paper, we propose an optimization framework for cooperative merging of platoons of connected and automated vehicles at highway on-ramps. The framework includes (1) an optimal scheduling algorithm, through which, each platoon derives the sequence and time to enter the highway safely, and (2) an optimal control algorithm that allows each platoon to derive its optimal control input (acceleration/deceleration) in terms of fuel consumption. We evaluate the efficacy of the proposed optimization framework through VISSIM-MATLAB simulation environment. The proposed framework significantly reduces the crossing time and fuel consumption of platoons at the highway on-ramps. △ Less

Submitted 21 February, 2021; v1 submitted 12 February, 2020; originally announced February 2020.

Comments: 6 pages, 5 figures

Journal ref: 2021 American Control Conference (ACC), 2021, pp. 2055-2060,

Experimental Validation of a Real-Time Optimal Controller for Coordination of CAVs in a Multi-Lane Roundabout

Authors: Behdad Chalaki, Logan E. Beaver, Andreas A. Malikopoulos

Abstract: Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In th… ▽ More Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In this paper, we validate an optimal control framework developed earlier in a multi-lane roundabout scenario using the University of Delaware's scaled smart city (UDSSC). We first provide conditions where the solution is optimal. Then, we demonstrate the feasibility of the solution using experiments at UDSSC, and show that the optimal solution completely eliminates stop-and-go driving while preserving safety. △ Less

Submitted 18 May, 2020; v1 submitted 29 January, 2020; originally announced January 2020.

Comments: 6 Pages, 4 Figures, 1 table

Journal ref: IEEE Intelligent Vehicles Symposium (IV), (2020), 504-509

Optimal Coordination of Platoons of Connected and Automated Vehicles at Signal-Free Intersections

Authors: Sharmila Devi Kumaravel, Andreas A. Malikopoulos, Ramakalyan Ayyagari

Abstract: In this paper, we address the problem of coordinating platoons of connected and automated vehicles at signal-free intersections. We present a decentralized, two-level optimal framework to coordinate the platoons with the objective to minimize travel delay and fuel consumption of every platoon crossing the intersection. In the upper-level, each platoon derives an optimal schedule to enter the inter… ▽ More In this paper, we address the problem of coordinating platoons of connected and automated vehicles at signal-free intersections. We present a decentralized, two-level optimal framework to coordinate the platoons with the objective to minimize travel delay and fuel consumption of every platoon crossing the intersection. In the upper-level, each platoon derives an optimal schedule to enter the intersection. In the low-level, the platoons derive their optimal control input (acceleration/deceleration) for the optimal schedule derived in the upper-level. We validate the effectiveness of the proposed framework in simulation and show significant improvements both in travel delay and fuel consumption compared to the baseline scenario with fixed time traffic signals at the intersection. △ Less

Submitted 11 July, 2021; v1 submitted 14 January, 2020; originally announced January 2020.

Comments: 12 pages, 9 figures

Journal ref: IEEE Transactions on Intelligent Vehicles, 2021

Time-Optimal Coordination for Connected and Automated Vehicles at Adjacent Intersections

Authors: Behdad Chalaki, Andreas A. Malikopoulos

Abstract: In this paper, we provide a hierarchical coordination framework for connected and automated vehicles (CAVs) at two adjacent intersections. This framework consists of an upper-level scheduling problem and a low-level optimal control problem. By partitioning the area around two adjacent intersections into different zones, we formulate a scheduling problem for each individual CAV aimed at minimizing… ▽ More In this paper, we provide a hierarchical coordination framework for connected and automated vehicles (CAVs) at two adjacent intersections. This framework consists of an upper-level scheduling problem and a low-level optimal control problem. By partitioning the area around two adjacent intersections into different zones, we formulate a scheduling problem for each individual CAV aimed at minimizing its total travel time. For each CAV, the solution of the upper-level problem designates the arrival times at each zones on its path which becomes the inputs of the low-level problem. The solution of the low-level problem yields the optimal control input (acceleration/deceleration) of each CAV to exit the intersections at the time specified in the upper-level scheduling problem. We validate the performance of our proposed hierarchical framework through extensive numerical simulations and comparison with signalized intersections, centralized scheduling, and FIFO queuing policy. △ Less

Submitted 24 October, 2021; v1 submitted 11 November, 2019; originally announced November 2019.

Comments: 17 pages, 7 figures, 3 tables

Journal ref: IEEE Transactions on Intelligent Transportation Systems (2021) 1-16

Concurrent Optimization of Vehicle Dynamics and Powertrain Operation Using Connectivity and Automation

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos

Abstract: Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce energy consumption and travel delays. In this paper, we propose a two-level control architecture for CAVs to optimize (1) the vehicle's speed profile, aimed at minimizing stop-and-go driving, and (2) the powertrain efficiency of the vehicle for the optimal speed profile derived in (1). The proposed hierarchic… ▽ More Connected and automated vehicles (CAVs) provide the most intriguing opportunity to reduce energy consumption and travel delays. In this paper, we propose a two-level control architecture for CAVs to optimize (1) the vehicle's speed profile, aimed at minimizing stop-and-go driving, and (2) the powertrain efficiency of the vehicle for the optimal speed profile derived in (1). The proposed hierarchical control framework can be implemented onboard the vehicle in real time with minimal computational effort. We evaluate the effectiveness of the efficiency of the proposed architecture through simulation in Mcity using a 100% penetration rate of CAVs. The results show that the proposed approach yields significant benefits in terms of energy efficiency. △ Less

Submitted 24 January, 2020; v1 submitted 8 November, 2019; originally announced November 2019.

Comments: Updating and replacing the old version of arXiv:1911.03475 with the finalized manuscript

A Decentralized Time- and Energy-Optimal Control Framework for Connected Automated Vehicles: From Simulation to Field Test

Authors: A M Ishtiaque Mahbub, Vasanthi Karri, Darshil Parikh, Shyam Jade, Andreas A. Malikopoulos

Abstract: The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control aimed at optimizing energy consumption with associated benefits. In this paper, we implement an optimal control framework, developed previously, in an Audi A3 etron plug-in hybrid electric vehicle, and demonstrate that we can improve the vehicle's efficiency and tr… ▽ More The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework for real-time control aimed at optimizing energy consumption with associated benefits. In this paper, we implement an optimal control framework, developed previously, in an Audi A3 etron plug-in hybrid electric vehicle, and demonstrate that we can improve the vehicle's efficiency and travel time in a corridor including an on-ramp merging, a speed reduction zone, and a roundabout. Our exposition includes the development, integration, implementation and validation of the proposed framework in (1) simulation, (2) hardware-in-the-loop (HIL) testing, (3) connectivity enabled virtual reality based bench-test, and (4) field test in Mcity. We show that by adopting such inexpensive, yet effective process, we can efficiently integrate and test the controller framework, ensure proper connectivity and data transmission between different modules of the system, and reduce uncertainty. We evaluate the performance and effectiveness of the control framework and observe significant improvement in terms of energy and travel time compared to the baseline scenario. △ Less

Submitted 24 January, 2020; v1 submitted 4 November, 2019; originally announced November 2019.

An Energy-Optimal Framework for Assignment and Trajectory Generation in Teams of Autonomous Agents

Authors: Logan E. Beaver, Andreas A. Malikopoulos

Abstract: In this paper, we present an approach for solving the problem of moving $N$ homogeneous agents into $M \geq N$ goal locations along energy-minimizing trajectories. We propose a decentralized framework that only requires knowledge of the goal locations and partial observations of the global state by each agent. The framework includes guarantees on safety through dynamic constraints, and a method to… ▽ More In this paper, we present an approach for solving the problem of moving $N$ homogeneous agents into $M \geq N$ goal locations along energy-minimizing trajectories. We propose a decentralized framework that only requires knowledge of the goal locations and partial observations of the global state by each agent. The framework includes guarantees on safety through dynamic constraints, and a method to impose a dynamic, global priority ordering on the agents. A solution to the goal assignment and trajectory generation problems are derived in the form of a binary program and a nonlinear system of equations. Then, we present the conditions for optimality and characterize the conditions under which our algorithm is guaranteed to converge to a unique assignment of agents to goals. We also solve the fully constrained decentralized trajectory generation problem considering the state, control, and safety constraints. Finally, we validate the efficacy of our approach through a numerical simulation in MATLAB. △ Less

Submitted 9 March, 2020; v1 submitted 21 October, 2019; originally announced October 2019.

Comments: 16 pages, 3 figures

Journal ref: Systems & Control Letters 138 (2020)

An Optimal Control Approach to Flocking

Authors: Logan E. Beaver, Chris Kroninger, Andreas A. Malikopoulos

Abstract: Flocking behavior has attracted considerable attention in multi-agent systems. The structure of flocking has been predominantly studied through the application of artificial potential fields coupled with velocity consensus. These approaches, however, do not consider the energy cost of the agents during flocking, which is especially important in large-scale robot swarms. This paper introduces an op… ▽ More Flocking behavior has attracted considerable attention in multi-agent systems. The structure of flocking has been predominantly studied through the application of artificial potential fields coupled with velocity consensus. These approaches, however, do not consider the energy cost of the agents during flocking, which is especially important in large-scale robot swarms. This paper introduces an optimal control framework to induce flocking in a group of agents. Guarantees of energy minimization and safety are provided, along with a decentralized algorithm that satisfies the optimality conditions and can be realized in real time. The efficacy of the proposed control algorithm is evaluated through simulation in both MATLAB and Gazebo. △ Less

Submitted 14 March, 2020; v1 submitted 26 September, 2019; originally announced September 2019.

Comments: 6 pages, 4 figures. To appear at the 2020 American Control Conference

Impact of Connected and Automated Vehicles in a Corridor

Authors: A M Ishtiaque Mahbub, Andreas A. Malikopoulos, Liuhui Zhao

Abstract: Several approaches have been proposed in the literature that allow connected and automated vehicles (CAVs) to coordinate in areas where there is a potential conflict, for example, in intersections, merging at roadways and roundabouts. In this paper, we consider the problem of coordinating CAVs in a corridor consisting of several conflict areas where collision may occur. We derive a solution that y… ▽ More Several approaches have been proposed in the literature that allow connected and automated vehicles (CAVs) to coordinate in areas where there is a potential conflict, for example, in intersections, merging at roadways and roundabouts. In this paper, we consider the problem of coordinating CAVs in a corridor consisting of several conflict areas where collision may occur. We derive a solution that yields the optimal control input, in terms of fuel consumption, for each CAV to cross the corridor under the hard safety constraints. We validate the effectiveness of the solution through simulation, and we show that both fuel consumption and travel time can be improved significantly. △ Less

Submitted 12 March, 2020; v1 submitted 22 September, 2019; originally announced September 2019.

Comments: 6 pages, 9 figures

Journal ref: Proceedings of the 2020 American Control Conference