-
Control of Microrobots Using Model Predictive Control and Gaussian Processes for Disturbance Estimation
Authors:
Mehdi Kermanshah,
Logan E. Beaver,
Max Sokolich,
Sambeeta Das,
Ron Weiss,
Roberto Tron,
Calin Belta
Abstract:
This paper presents a control framework for magnetically actuated micron-scale robots ($μ$bots) designed to mitigate disturbances and improve trajectory tracking. To address the challenges posed by unmodeled dynamics and environmental variability, we combine data-driven modeling with model-based control to accurately track desired trajectories using a relatively small amount of data. The system is…
▽ More
This paper presents a control framework for magnetically actuated micron-scale robots ($μ$bots) designed to mitigate disturbances and improve trajectory tracking. To address the challenges posed by unmodeled dynamics and environmental variability, we combine data-driven modeling with model-based control to accurately track desired trajectories using a relatively small amount of data. The system is represented with a simple linear model, and Gaussian Processes (GP) are employed to capture and estimate disturbances. This disturbance-enhanced model is then integrated into a Model Predictive Controller (MPC). Our approach demonstrates promising performance in both simulation and experimental setups, showcasing its potential for precise and reliable microrobot control in complex environments.
△ Less
Submitted 4 June, 2024;
originally announced June 2024.
-
Global Games with Negative Feedback for Autonomous Colony Maintenance using Robot Teams
Authors:
Logan E. Beaver
Abstract:
In this article we address the colony maintenance problem, where a team of robots are tasked with continuously maintaining the energy supply of an autonomous colony. We model this as a global game, where robots measure the energy level of a central nest to determine whether or not to forage for energy sources. We design a mechanism that avoids the trivial equilibrium where all robots always forage…
▽ More
In this article we address the colony maintenance problem, where a team of robots are tasked with continuously maintaining the energy supply of an autonomous colony. We model this as a global game, where robots measure the energy level of a central nest to determine whether or not to forage for energy sources. We design a mechanism that avoids the trivial equilibrium where all robots always forage. Furthermore, we demonstrate that when the game is played iteratively a negative feedback term stabilizes the number of foraging robots at a non-trivial Nash equilibrium. We compare our approach qualitatively to existing global games, where a positive positive feedback term admits threshold-based decision making, and encourages many robots to forage simultaneously. We discuss how positive feedback can lead to a cascading failure in the presence of a human who recruits robots for external tasks, and we demonstrate the performance of our approach in simulation.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
A Feasibility Analysis at Signal-Free Intersections
Authors:
Filippos N. Tzortzoglou,
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increas…
▽ More
In this letter, we address the problem of improving the feasible domain of the solution of a decentralized control framework for coordinating connected and automated vehicles (CAVs) at signal-free intersections as the traffic volume increases. The framework provides the optimal trajectories of CAVs to cross the intersection safely without stop-and-go driving. However, as the traffic volume increases, the domain of the feasible trajectories decreases. We use concepts of numerical interpolation to identify appropriate polynomials that can serve as alternative trajectories of the CAVs, expanding the domain of the feasible CAV trajectories. We provide the conditions under which such polynomials exist. Finally, we demonstrate the efficacy of our approach through numerical simulations.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
Optimal Control Barrier Functions: Maximizing the Action Space Subject to Control Bounds
Authors:
Logan E. Beaver
Abstract:
This letter addresses the constraint compatibility problem of control barrier functions (CBFs), which occurs when a safety-critical CBF requires a system to apply more control effort than it is capable of generating. This inevitably leads to a safety violation, which transitions the system to an unsafe (and possibly dangerous) trajectory. We resolve the constraint compatibility problem by construc…
▽ More
This letter addresses the constraint compatibility problem of control barrier functions (CBFs), which occurs when a safety-critical CBF requires a system to apply more control effort than it is capable of generating. This inevitably leads to a safety violation, which transitions the system to an unsafe (and possibly dangerous) trajectory. We resolve the constraint compatibility problem by constructing a control barrier function that maximizes the feasible action space for first and second-order constraints, and we prove that the optimal CBF encodes a dynamical motion primitive. Furthermore, we show that this dynamical motion primitive contains an implicit model for the future trajectory for time-varying components of the system. We validate our optimal CBF in simulation, and compare its behavior with a linear CBF.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
LQ-OCP: Energy-Optimal Control for LQ Problems
Authors:
Logan E. Beaver
Abstract:
This article presents a method to automatically generate energy-optimal trajectories for systems with linear dynamics, linear constraints, and a quadratic cost functional (LQ systems). First, using recent advancements in optimal control, we derive the optimal motion primitive generator for LQ systems--this yields linear differential equations that describe all dynamical motion primitives that the…
▽ More
This article presents a method to automatically generate energy-optimal trajectories for systems with linear dynamics, linear constraints, and a quadratic cost functional (LQ systems). First, using recent advancements in optimal control, we derive the optimal motion primitive generator for LQ systems--this yields linear differential equations that describe all dynamical motion primitives that the optimal system follows. We also derive the optimality conditions where the system switches between motion primitives--a system of equations that are bilinear in the unknown junction time. Finally, we demonstrate the performance of our approach on an energy-minimizing submersible robot with state and control constraints. We compare our approach to an energy-optimizing Linear Quadratic Regulator (LQR), where we learn the optimal weights of the LQR cost function to minimize energy consumption while ensuring convergence and constraint satisfaction. Our approach converges to the optimal solution 6,400% faster than the LQR weight optimization, and that our solution is 350% more energy efficient. Finally, we disturb the initial state of the submersible to show that our approach still finds energy-efficient solutions faster than LQR when the unconstrained solution is infeasible.
△ Less
Submitted 29 September, 2023;
originally announced October 2023.
-
A Bilevel Optimization Scheme for Persistent Monitoring
Authors:
Jonas Hall,
Logan E. Beaver,
Christos G. Cassandras,
Sean B. Andersson
Abstract:
In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajecto…
▽ More
In this paper we study an infinite-horizon persistent monitoring problem in a two-dimensional mission space containing a finite number of statically placed targets, at each of which we assume a constant rate of uncertainty accumulation. Equipped with a sensor of finite range, the agent is capable of reducing the uncertainty of nearby targets. We derive a steady-state minimum time periodic trajectory over which each of the target uncertainties is driven down to zero during each visit. A hierarchical decomposition leads to purely local optimal control problems, coupled via boundary conditions. We optimize both the local trajectory segments as well as the boundary conditions in an on-line bilevel optimization scheme.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
Learning a Tracking Controller for Rolling $μ$bots
Authors:
Logan E Beaver,
Max Sokolich,
Suhail Alsalehi,
Ron Weiss,
Sambeeta Das,
Calin Belta
Abstract:
Micron-scale robots ($μ$bots) have recently shown great promise for emerging medical applications. Accurate controlling $μ$bots, while critical to their successful deployment, is challenging. In this work, we consider the problem of tracking a reference trajectory using a $μ$bot in the presence of disturbances and uncertainty. The disturbances primarily come from Brownian motion and other environm…
▽ More
Micron-scale robots ($μ$bots) have recently shown great promise for emerging medical applications. Accurate controlling $μ$bots, while critical to their successful deployment, is challenging. In this work, we consider the problem of tracking a reference trajectory using a $μ$bot in the presence of disturbances and uncertainty. The disturbances primarily come from Brownian motion and other environmental phenomena, while the uncertainty originates from errors in the model parameters. We model the $μ$bot as an uncertain unicycle that is controlled by a global magnetic field. To compensate for disturbances and uncertainties, we develop a nonlinear mismatch controller. We define the model mismatch error as the difference between our model's predicted velocity and the actual velocity of the $μ$bot. We employ a Gaussian Process to learn the model mismatch error as a function of the applied control input. Then we use a least-squares minimization to select a control action that minimizes the difference between the actual velocity of the $μ$bot and a reference velocity. We demonstrate the online performance of our joint learning and control algorithm in simulation, where our approach accurately learns the model mismatch and improves tracking performance. We also validate our approach in an experiment and show that certain error metrics are reduced by up to $40\%$.
△ Less
Submitted 13 August, 2023; v1 submitted 30 November, 2022;
originally announced December 2022.
-
A Graph-Based Approach to Generate Energy-Optimal Robot Trajectories in Polygonal Environments
Authors:
Logan E. Beaver,
Roberto Tron,
Christos G. Cassandras
Abstract:
As robotic systems continue to address emerging issues in areas such as logistics, mobility, manufacturing, and disaster response, it is increasingly important to rapidly generate safe and energy-efficient trajectories. In this article, we present a new approach to plan energy-optimal trajectories through cluttered environments containing polygonal obstacles. In particular, we develop a method to…
▽ More
As robotic systems continue to address emerging issues in areas such as logistics, mobility, manufacturing, and disaster response, it is increasingly important to rapidly generate safe and energy-efficient trajectories. In this article, we present a new approach to plan energy-optimal trajectories through cluttered environments containing polygonal obstacles. In particular, we develop a method to quickly generate optimal trajectories for a double-integrator system, and we show that optimal path planning reduces to an integer program. To find an efficient solution, we present a distance-informed prefix search to efficiently generate optimal trajectories for a large class of environments. We demonstrate that our approach, while matching the performance of RRT* and Probabilistic Road Maps in terms of path length, outperforms both in terms of energy cost and computational time by up to an order of magnitude. We also demonstrate that our approach yields implementable trajectories in an experiment with a Crazyflie quadrotor.
△ Less
Submitted 11 November, 2022; v1 submitted 9 November, 2022;
originally announced November 2022.
-
A Constraint-Driven Approach to Line Flocking: The V Formation as an Energy-Saving Strategy
Authors:
Logan E. Beaver,
Christopher Kroninger,
Michael Dorothy,
Andreas A. Malikopoulos
Abstract:
The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents…
▽ More
The study of robotic flocking has received significant attention in the past twenty years. In this article, we present a constraint-driven control algorithm that minimizes the energy consumption of individual agents and yields an emergent V formation. As the formation emerges from the decentralized interaction between agents, our approach is robust to the spontaneous addition or removal of agents to the system. First, we present an analytical model for the trailing upwash behind a fixed-wing UAV, and we derive the optimal air speed for trailing UAVs to maximize their travel endurance. Next, we prove that simply flying at the optimal airspeed will never lead to emergent flocking behavior, and we propose a new decentralized "anseroid" behavior that yields emergent V formations. We encode these behaviors in a constraint-driven control algorithm that minimizes the locomotive power of each UAV. Finally, we prove that UAVs initialized in an approximate V or echelon formation will converge under our proposed control law, and we demonstrate this emergence occurs in real-time in simulation and in physical experiments with a fleet of Crazyflie quadrotors.
△ Less
Submitted 23 September, 2022;
originally announced September 2022.
-
Constraint-Driven Optimal Control for Emergent Swarming and Predator Avoidance
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
In this letter, we present a constraint-driven optimal control framework that achieves emergent cluster flocking within a constrained 2D environment. We formulate a decentralized optimal control problem that includes safety, flocking, and predator avoidance constraints. We explicitly derive conditions for constraint compatibility and propose an event-driven constraint relaxation scheme, which we m…
▽ More
In this letter, we present a constraint-driven optimal control framework that achieves emergent cluster flocking within a constrained 2D environment. We formulate a decentralized optimal control problem that includes safety, flocking, and predator avoidance constraints. We explicitly derive conditions for constraint compatibility and propose an event-driven constraint relaxation scheme, which we map to an equivalent finite state machine that intuitively describes the behavior of each agent in the system. Instead of minimizing control effort, as it is common in the ecologically-inspired robotics literature, in our approach, we minimize each agent's deviation from their most efficient locomotion speed. Finally, we demonstrate our approach in simulation both with and without the presence of a predator.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
A First-Order Approach to Model Simultaneous Control of Multiple Microrobots
Authors:
Logan E. Beaver,
Sambeeta Das,
Andreas A. Malikopoulos
Abstract:
The control of swarm systems is relatively well understood for simple robotic platforms at the macro scale. However, there are still several unanswered questions about how similar results can be achieved for microrobots. In this paper, we propose a modeling framework based on a dynamic model of magnetized self-propelling Janus microrobots under a global magnetic field. We verify our model experime…
▽ More
The control of swarm systems is relatively well understood for simple robotic platforms at the macro scale. However, there are still several unanswered questions about how similar results can be achieved for microrobots. In this paper, we propose a modeling framework based on a dynamic model of magnetized self-propelling Janus microrobots under a global magnetic field. We verify our model experimentally and provide methods that can aim at accurately describing the behavior of microrobots while modeling their simultaneous control. The model can be generalized to other microrobotic platforms in low Reynolds number environments.
△ Less
Submitted 4 November, 2021;
originally announced November 2021.
-
A Scalable Last-Mile Delivery Service: From Simulation to Scaled Experiment
Authors:
Meera Ratnagiri,
Clare O'Dwyer,
Logan E. Beaver,
Heeseung Bang,
Behdad Chalaki,
Andreas A. Malikopoulos
Abstract:
In this paper, we investigate the problem of a last-mile delivery service that selects up to $N$ available vehicles to deliver $M$ packages from a centralized depot to $M$ delivery locations. The objective of the last-mile delivery service is to jointly maximize customer satisfaction (minimize delivery time) and minimize operating cost (minimize total travel time) by selecting the optimal number o…
▽ More
In this paper, we investigate the problem of a last-mile delivery service that selects up to $N$ available vehicles to deliver $M$ packages from a centralized depot to $M$ delivery locations. The objective of the last-mile delivery service is to jointly maximize customer satisfaction (minimize delivery time) and minimize operating cost (minimize total travel time) by selecting the optimal number of vehicles to perform the deliveries. We model this as an assignment (vehicles to packages) and path planning (determining the delivery order and route) problem, which is equivalent to the NP-hard multiple traveling salesperson problem. We propose a scalable heuristic algorithm, which sacrifices some optimality to achieve a reasonable computational cost for a high number of packages. The algorithm combines hierarchical clustering with a greedy search. To validate our approach, we compare the results of our simulation to experiments in a $1$:$25$ scale robotic testbed for future mobility systems.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Constraint-Driven Optimal Control of Multi-Agent Systems: A Highway Platooning Case Study
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
Platooning has been exploited as a method for vehicles to minimize energy consumption. In this article, we present a constraint-driven optimal control framework that yields emergent platooning behavior for connected and automated vehicles operating in an open transportation system. Our approach combines recent insights in constraint-driven optimal control with the physical aerodynamic interactions…
▽ More
Platooning has been exploited as a method for vehicles to minimize energy consumption. In this article, we present a constraint-driven optimal control framework that yields emergent platooning behavior for connected and automated vehicles operating in an open transportation system. Our approach combines recent insights in constraint-driven optimal control with the physical aerodynamic interactions between vehicles in a highway setting. The result is a set of equations that describes when platooning is an appropriate strategy, as well as a descriptive optimal control law that yields emergent platooning behavior. Finally, we demonstrate these properties in simulation.
△ Less
Submitted 6 December, 2021; v1 submitted 13 September, 2021;
originally announced September 2021.
-
A Research and Educational Robotic Testbed for Real-time Control of Emerging Mobility Systems: From Theory to Scaled Experiments
Authors:
Behdad Chalaki,
Logan E. Beaver,
A M Ishtiaque Mahbub,
Heeseung Bang,
Andreas A. Malikopoulos
Abstract:
Emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, and electric vehicles, provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. However, before connectivity and automation are deployed en masse, a thorough evaluation of CAVs…
▽ More
Emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, and electric vehicles, provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. However, before connectivity and automation are deployed en masse, a thorough evaluation of CAVs is required-ranging from numerical simulation to real-world public roads. Assessment of the performance of CAVs in scaled testbeds has recently gained momentum due to the flexibility they offer to conduct quick, repeatable experiments that could go one step beyond simulation. This article introduces the Information and Decision Science Lab's Scaled Smart City (IDS$^3$C), a 1:25 research and educational scaled robotic testbed that is capable of replicating different real-world urban traffic scenarios. IDS$^3$C was designed to investigate the effect of emerging mobility systems on safety and transportation efficiency. On the educational front, IDS$^3$C can be used for (a) training and educating graduate students by exposing them to a balanced mix of theory and practice, (b) integrating the research outcomes into existing courses, (c) involving undergraduate students in research, (d) creating interactive educational demos, and (e) reaching out to high-school students. In our exposition, we also present a real-time control framework that can be used to coordinate CAVs at traffic scenarios such as crossing signal-free intersections, merging at roadways and roundabouts, cruising in congested traffic, passing through speed reduction zones, and lane-merging or passing maneuvers. Finally, we provide a tutorial for applying our framework in coordinating robotic CAVs to a multi-lane roundabout scenario and a transportation corridor in IDS$^3$C.
△ Less
Submitted 28 March, 2022; v1 submitted 11 September, 2021;
originally announced September 2021.
-
A Digital Smart City for Emerging Mobility Systems
Authors:
Raymond M. Zayas,
Logan E. Beaver,
Behdad Chalaki,
Heeseung Bang,
Andreas A. Malikopoulos
Abstract:
The increasing demand for emerging mobility systems with connected and automated vehicles has imposed the necessity for quality testing environments to support their development. In this paper, we introduce a Unity-based virtual simulation environment for emerging mobility systems, called the Information and Decision Science Lab's Scaled Smart Digital City (IDS 3D City), intended to operate alongs…
▽ More
The increasing demand for emerging mobility systems with connected and automated vehicles has imposed the necessity for quality testing environments to support their development. In this paper, we introduce a Unity-based virtual simulation environment for emerging mobility systems, called the Information and Decision Science Lab's Scaled Smart Digital City (IDS 3D City), intended to operate alongside its physical peer and its established control framework. By utilizing the Robot Operation System, AirSim, and Unity, we constructed a simulation environment capable of iteratively designing experiments significantly faster than it is possible in a physical testbed. This environment provides an intermediate step to validate the effectiveness of our control algorithms prior to their implementation in the physical testbed. The IDS 3D City also enables us to demonstrate that our control algorithms work independently of the underlying vehicle dynamics, as the vehicle dynamics introduced by AirSim operate at a different scale than our scaled smart city. Finally, we demonstrate the behavior of our digital environment by performing an experiment in both the virtual and physical environments and comparing their outputs.
△ Less
Submitted 11 January, 2023; v1 submitted 6 September, 2021;
originally announced September 2021.
-
Optimal Control of Differentially Flat Systems is Surprisingly Easy
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise…
▽ More
As we move to increasingly complex cyber-physical systems (CPS), new approaches are needed to plan efficient state trajectories in real-time. In this paper, we propose an approach to significantly reduce the complexity of solving optimal control problems for a class of CPS with nonlinear dynamics. We exploit the property of differential flatness to simplify the Euler-Lagrange equations that arise during optimization, and this simplification eliminates the numerical instabilities that plague optimal control in general. We also present an explicit differential equation that describes the evolution of the optimal state trajectory, and we extend our results to consider both the unconstrained and constrained cases. Furthermore, we demonstrate the performance of our approach by generating the optimal trajectory for a planar manipulator with two revolute joints. We show in simulation that our approach is able to generate the constrained optimal trajectory in $4.5$ ms while respecting workspace constraints and switching between a `left' and `right' bend in the elbow joint.
△ Less
Submitted 26 August, 2023; v1 submitted 4 March, 2021;
originally announced March 2021.
-
An Overview on Optimal Flocking
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
The study of robotic flocking has received considerable attention in the past twenty years. As we begin to deploy flocking control algorithms on physical multi-agent and swarm systems, there is an increasing necessity for rigorous promises on safety and performance. In this paper, we present an overview the literature focusing on optimization approaches to achieve flocking behavior that provide st…
▽ More
The study of robotic flocking has received considerable attention in the past twenty years. As we begin to deploy flocking control algorithms on physical multi-agent and swarm systems, there is an increasing necessity for rigorous promises on safety and performance. In this paper, we present an overview the literature focusing on optimization approaches to achieve flocking behavior that provide strong safety guarantees. We separate the literature into cluster and line flocking, and categorize cluster flocking with respect to the system-level objective, which may be realized by a reactive or planning control algorithm. We also categorize the line flocking literature by the energy-saving mechanism that is exploited by the agents. We present several approaches aimed at minimizing the communication and computational requirements in real systems via neighbor filtering and event-driven planning, and conclude with our perspective on the outlook and future research direction of optimal flocking as a field.
△ Less
Submitted 22 January, 2021; v1 submitted 29 September, 2020;
originally announced September 2020.
-
Energy-Optimal Motion Planning for Agents: Barycentric Motion and Collision Avoidance Constraints
Authors:
Logan E. Beaver,
Michael Dorothy,
Christopher Kroninger,
Andreas A. Malikopoulos
Abstract:
As robotic swarm systems emerge, it is increasingly important to provide strong guarantees on energy consumption and safety to maximize system performance. One approach to achieve these guarantees is through constraint-driven control, where agents seek to minimize energy consumption subject to a set of safety and task constraints. In this paper, we provide a sufficient and necessary condition for…
▽ More
As robotic swarm systems emerge, it is increasingly important to provide strong guarantees on energy consumption and safety to maximize system performance. One approach to achieve these guarantees is through constraint-driven control, where agents seek to minimize energy consumption subject to a set of safety and task constraints. In this paper, we provide a sufficient and necessary condition for an energy-minimizing agent with integrator dynamics to have a continuous control input at the transition between unconstrained and constrained trajectories. In addition, we present and analyze barycentric motion and collision avoidance constraints to be used in constraint-driven control of swarms.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
-
Optimal Time Trajectory and Coordination for Connected and Automated Vehicles
Authors:
Andreas A. Malikopoulos,
Logan E. Beaver,
Ioannis Vasileios Chremos
Abstract:
In this paper, we provide a decentralized theoretical framework for coordination of connected and automated vehicles (CAVs) at different traffic scenarios. The framework includes: (1) an upper-level optimization that yields for each CAV its optimal time trajectory and lane to pass through a given traffic scenario while alleviating congestion; and (2) a low-level optimization that yields for each C…
▽ More
In this paper, we provide a decentralized theoretical framework for coordination of connected and automated vehicles (CAVs) at different traffic scenarios. The framework includes: (1) an upper-level optimization that yields for each CAV its optimal time trajectory and lane to pass through a given traffic scenario while alleviating congestion; and (2) a low-level optimization that yields for each CAV its optimal control input (acceleration/deceleration). We provide a complete, analytical solution of the low-level optimization problem that includes the rear-end, speed-dependent safety constraint. Furthermore, we provide a problem formulation for the upper-level optimization in which there is no duality gap. The latter implies that the optimal time trajectory for each CAV does not activate any of the state, control, and safety constraints of the low-level optimization, thus allowing for online implementation. Finally, we present a geometric duality framework with hyperplanes to derive the condition under which the optimal solution of the upper-level optimization always exists. We validate the effectiveness of the proposed theoretical framework through simulation.
△ Less
Submitted 9 January, 2021; v1 submitted 26 March, 2020;
originally announced March 2020.
-
Beyond Reynolds: A Constraint-Driven Approach to Cluster Flocking
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
In this paper, we present an original set of flocking rules using an ecologically-inspired paradigm for control of multi-robot systems. We translate these rules into a constraint-driven optimal control problem where the agents minimize energy consumption subject to safety and task constraints. We prove several properties about the feasible space of the optimal control problem and show that velocit…
▽ More
In this paper, we present an original set of flocking rules using an ecologically-inspired paradigm for control of multi-robot systems. We translate these rules into a constraint-driven optimal control problem where the agents minimize energy consumption subject to safety and task constraints. We prove several properties about the feasible space of the optimal control problem and show that velocity consensus is an optimal solution. We also motivate the inclusion of slack variables in constraint-driven problems when the global state is only partially observable by each agent. Finally, we analyze the case where the communication topology is fixed and connected, and prove that our proposed flocking rules achieve velocity consensus.
△ Less
Submitted 5 May, 2020; v1 submitted 16 March, 2020;
originally announced March 2020.
-
Experimental Validation of a Real-Time Optimal Controller for Coordination of CAVs in a Multi-Lane Roundabout
Authors:
Behdad Chalaki,
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In th…
▽ More
Roundabouts in conjunction with other traffic scenarios, e.g., intersections, merging roadways, speed reduction zones, can induce congestion in a transportation network due to driver responses to various disturbances. Research efforts have shown that smoothing traffic flow and eliminating stop-and-go driving can both improve fuel efficiency of the vehicles and the throughput of a roundabout. In this paper, we validate an optimal control framework developed earlier in a multi-lane roundabout scenario using the University of Delaware's scaled smart city (UDSSC). We first provide conditions where the solution is optimal. Then, we demonstrate the feasibility of the solution using experiments at UDSSC, and show that the optimal solution completely eliminates stop-and-go driving while preserving safety.
△ Less
Submitted 18 May, 2020; v1 submitted 29 January, 2020;
originally announced January 2020.
-
An Energy-Optimal Framework for Assignment and Trajectory Generation in Teams of Autonomous Agents
Authors:
Logan E. Beaver,
Andreas A. Malikopoulos
Abstract:
In this paper, we present an approach for solving the problem of moving $N$ homogeneous agents into $M \geq N$ goal locations along energy-minimizing trajectories. We propose a decentralized framework that only requires knowledge of the goal locations and partial observations of the global state by each agent. The framework includes guarantees on safety through dynamic constraints, and a method to…
▽ More
In this paper, we present an approach for solving the problem of moving $N$ homogeneous agents into $M \geq N$ goal locations along energy-minimizing trajectories. We propose a decentralized framework that only requires knowledge of the goal locations and partial observations of the global state by each agent. The framework includes guarantees on safety through dynamic constraints, and a method to impose a dynamic, global priority ordering on the agents. A solution to the goal assignment and trajectory generation problems are derived in the form of a binary program and a nonlinear system of equations. Then, we present the conditions for optimality and characterize the conditions under which our algorithm is guaranteed to converge to a unique assignment of agents to goals. We also solve the fully constrained decentralized trajectory generation problem considering the state, control, and safety constraints. Finally, we validate the efficacy of our approach through a numerical simulation in MATLAB.
△ Less
Submitted 9 March, 2020; v1 submitted 21 October, 2019;
originally announced October 2019.
-
An Optimal Control Approach to Flocking
Authors:
Logan E. Beaver,
Chris Kroninger,
Andreas A. Malikopoulos
Abstract:
Flocking behavior has attracted considerable attention in multi-agent systems. The structure of flocking has been predominantly studied through the application of artificial potential fields coupled with velocity consensus. These approaches, however, do not consider the energy cost of the agents during flocking, which is especially important in large-scale robot swarms. This paper introduces an op…
▽ More
Flocking behavior has attracted considerable attention in multi-agent systems. The structure of flocking has been predominantly studied through the application of artificial potential fields coupled with velocity consensus. These approaches, however, do not consider the energy cost of the agents during flocking, which is especially important in large-scale robot swarms. This paper introduces an optimal control framework to induce flocking in a group of agents. Guarantees of energy minimization and safety are provided, along with a decentralized algorithm that satisfies the optimality conditions and can be realized in real time. The efficacy of the proposed control algorithm is evaluated through simulation in both MATLAB and Gazebo.
△ Less
Submitted 14 March, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Zero-Shot Autonomous Vehicle Policy Transfer: From Simulation to Real-World via Adversarial Learning
Authors:
Behdad Chalaki,
Logan E. Beaver,
Ben Remer,
Kathy Jang,
Eugene Vinitsky,
Alexandre M. Bayen,
Andreas A. Malikopoulos
Abstract:
In this article, we demonstrate a zero-shot transfer of an autonomous driving policy from simulation to University of Delaware's scaled smart city with adversarial multi-agent reinforcement learning, in which an adversary attempts to decrease the net reward by perturbing both the inputs and outputs of the autonomous vehicles during training. We train the autonomous vehicles to coordinate with each…
▽ More
In this article, we demonstrate a zero-shot transfer of an autonomous driving policy from simulation to University of Delaware's scaled smart city with adversarial multi-agent reinforcement learning, in which an adversary attempts to decrease the net reward by perturbing both the inputs and outputs of the autonomous vehicles during training. We train the autonomous vehicles to coordinate with each other while crossing a roundabout in the presence of an adversary in simulation. The adversarial policy successfully reproduces the simulated behavior and incidentally outperforms, in terms of travel time, both a human-driving baseline and adversary-free trained policies. Finally, we demonstrate that the addition of adversarial training considerably improves the performance \eat{stability and robustness} of the policies after transfer to the real world compared to Gaussian noise injection.
△ Less
Submitted 22 June, 2020; v1 submitted 12 March, 2019;
originally announced March 2019.
-
Demonstration of a Time-Efficient Mobility System Using a Scaled Smart City
Authors:
Logan E. Beaver,
Behdad Chalaki,
AM Ishtiaque Mahbub,
Liuhui Zhao,
Ray Zayas,
Andreas A. Malikopoulos
Abstract:
The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAV…
▽ More
The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAVs have proven to be a significant barrier. In this paper, we present the implementation of a decentralized control framework, which was developed previously, in a scaled-city using robotic CAVs, and discuss the implications of CAVs on travel time. Supplemental information and videos can be found at https://sites.google.com/view/ud-ids-lab/tfms.
△ Less
Submitted 21 November, 2019; v1 submitted 4 March, 2019;
originally announced March 2019.
