-
A Learning-based Nonlinear Model Predictive Controller for a Real Go-Kart based on Black-box Dynamics Modeling through Gaussian Processes
Authors:
Enrico Picotti,
Enrico Mion,
Alberto Dalla Libera,
Josip Pavlovic,
Andrea Censi,
Emilio Frazzoli,
Alessandro Beghi,
Mattia Bruschetta
Abstract:
Lately, Nonlinear Model Predictive Control (NMPC)has been successfully applied to (semi-) autonomous driving problems and has proven to be a very promising technique. However, accurate control models for real vehicles could require costly and time-demanding specific measurements. To address this problem, the exploitation of system data to complement or derive the prediction model of the NMPC has b…
▽ More
Lately, Nonlinear Model Predictive Control (NMPC)has been successfully applied to (semi-) autonomous driving problems and has proven to be a very promising technique. However, accurate control models for real vehicles could require costly and time-demanding specific measurements. To address this problem, the exploitation of system data to complement or derive the prediction model of the NMPC has been explored, employing learning dynamics approaches within Learning-based NMPC (LbNMPC). Its application to the automotive field has focused on discrete grey-box modeling, in which a nominal dynamics model is enhanced by the data-driven component. In this manuscript, we present an LbNMPC controller for a real go-kart based on a continuous black-box model of the accelerations obtained by Gaussian Processes. We show the effectiveness of the proposed approach by testing the controller on a real go-kart vehicle, highlighting the approximation steps required to get an exploitable GP model on a real-time application.
△ Less
Submitted 29 May, 2023;
originally announced May 2023.
-
CARMA: Fair and efficient bottleneck congestion management via non-tradable karma credits
Authors:
Ezzat Elokda,
Carlo Cenedese,
Kenan Zhang,
Andrea Censi,
John Lygeros,
Emilio Frazzoli,
Florian Dörfler
Abstract:
This paper proposes a non-monetary traffic demand management scheme, named CARMA, as a fair solution to the morning commute congestion. We consider heterogeneous commuters traveling through a single bottleneck that differ in both the desired arrival time and Value of Time (VOT). We consider a generalized notion of VOT by allowing it to vary dynamically on each day (e.g., according to trip purpose…
▽ More
This paper proposes a non-monetary traffic demand management scheme, named CARMA, as a fair solution to the morning commute congestion. We consider heterogeneous commuters traveling through a single bottleneck that differ in both the desired arrival time and Value of Time (VOT). We consider a generalized notion of VOT by allowing it to vary dynamically on each day (e.g., according to trip purpose and urgency), rather than being a static characteristic of each individual. In our CARMA scheme, the bottleneck is divided into a fast lane that is kept in free flow and a slow lane that is subject to congestion. We introduce a non-tradable mobility credit, named karma, that is used by commuters to bid for access to the fast lane. Commuters who get outbid or do not participate in the CARMA scheme instead use the slow lane. At the end of each day, karma collected from the bidders is redistributed, and the process repeats day by day. We model the collective commuter behaviors under CARMA as a Dynamic Population Game (DPG), in which a Stationary Nash Equilibrium (SNE) is guaranteed to exist. Unlike existing monetary schemes, CARMA is demonstrated, both analytically and numerically, to achieve a) an equitable traffic assignment with respect to heterogeneous income classes and b) a strong Pareto improvement in the long-term average travel disutility with respect to no policy intervention. With extensive numerical analysis, we show that CARMA is able to retain the same congestion reduction as an optimal monetary tolling scheme under uniform karma redistribution and even outperform tolling under a well-designed redistribution scheme. We also highlight the privacy-preserving feature of CARMA, i.e., its ability to tailor to the private preferences of commuters without centrally collecting the information.
△ Less
Submitted 18 September, 2023; v1 submitted 15 August, 2022;
originally announced August 2022.
-
A self-contained karma economy for the dynamic allocation of common resources
Authors:
Ezzat Elokda,
Saverio Bolognani,
Andrea Censi,
Florian Dörfler,
Emilio Frazzoli
Abstract:
This paper presents karma mechanisms, a novel approach to the repeated allocation of a scarce resource among competing agents over an infinite time. Examples include deciding which ride hailing trip requests to serve during peak demand, granting the right of way in intersections or lane mergers, or admitting internet content to a regulated fast channel. We study a simplified yet insightful formula…
▽ More
This paper presents karma mechanisms, a novel approach to the repeated allocation of a scarce resource among competing agents over an infinite time. Examples include deciding which ride hailing trip requests to serve during peak demand, granting the right of way in intersections or lane mergers, or admitting internet content to a regulated fast channel. We study a simplified yet insightful formulation of these problems where at every instant two agents from a large population get randomly matched to compete over the resource. The intuitive interpretation of a karma mechanism is "If I give in now, I will be rewarded in the future." Agents compete in an auction-like setting where they bid units of karma, which circulates directly among them and is self-contained in the system. We demonstrate that this allows a society of self-interested agents to achieve high levels of efficiency without resorting to a (possibly problematic) monetary pricing of the resource. We model karma mechanisms as dynamic population games and guarantee the existence of a stationary Nash equilibrium. We then analyze the performance at the stationary Nash equilibrium numerically. For the case of homogeneous agents, we compare different mechanism design choices, showing that it is possible to achieve an efficient and ex-post fair allocation when the agents are future aware. Finally, we test the robustness against agent heterogeneity and propose remedies to some of the observed phenomena via karma redistribution.
△ Less
Submitted 8 May, 2023; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Task-driven Modular Co-design of Vehicle Control Systems
Authors:
Gioele Zardini,
Zelio Suter,
Andrea Censi,
Emilio Frazzoli
Abstract:
When designing autonomous systems, we need to consider multiple trade-offs at various abstraction levels, and the choices of single (hardware and software) components need to be studied jointly. In this work we consider the problem of designing the control algorithm as well as the platform on which it is executed. In particular, we focus on vehicle control systems, and formalize state-of-the-art c…
▽ More
When designing autonomous systems, we need to consider multiple trade-offs at various abstraction levels, and the choices of single (hardware and software) components need to be studied jointly. In this work we consider the problem of designing the control algorithm as well as the platform on which it is executed. In particular, we focus on vehicle control systems, and formalize state-of-the-art control schemes as monotone feasibility relations. We then show how, leveraging a monotone theory of co-design, we can study the embedding of control synthesis problems into the task-driven co-design problem of a robotic platform. The properties of the proposed approach are illustrated by considering urban driving scenarios. We show how, given a particular task, we can efficiently compute Pareto optimal design solutions.
△ Less
Submitted 20 September, 2022; v1 submitted 30 March, 2022;
originally announced March 2022.
-
Formal Estimation of Collision Risks for Autonomous Vehicles: A Compositional Data-Driven Approach
Authors:
Abolfazl Lavaei,
Luigi Di Lillo,
Andrea Censi,
Emilio Frazzoli
Abstract:
In this work, we propose a compositional data-driven approach for the formal estimation of collision risks for autonomous vehicles (AVs) while acting in a stochastic multi-agent framework. The proposed approach is based on the construction of sub-barrier certificates for each stochastic agent via a set of data collected from its trajectories while providing an a-priori guaranteed confidence on the…
▽ More
In this work, we propose a compositional data-driven approach for the formal estimation of collision risks for autonomous vehicles (AVs) while acting in a stochastic multi-agent framework. The proposed approach is based on the construction of sub-barrier certificates for each stochastic agent via a set of data collected from its trajectories while providing an a-priori guaranteed confidence on the data-driven estimation. In our proposed setting, we first cast the original collision risk problem for each agent as a robust optimization program (ROP). Solving the acquired ROP is not tractable due to an unknown model that appears in one of its constraints. To tackle this difficulty, we collect finite numbers of data from trajectories of each agent and provide a scenario optimization program (SOP) corresponding to the original ROP. We then establish a probabilistic bridge between the optimal value of SOP and that of ROP, and accordingly, we formally construct the sub-barrier certificate for each unknown agent based on the number of data and a required level of confidence. We then propose a compositional technique based on small-gain reasoning to quantify the collision risk for multi-agent AVs with some desirable confidence based on sub-barrier certificates of individual agents constructed from data. For the case that the proposed compositionality conditions are not satisfied, we provide a relaxed version of compositional results without requiring any compositionality conditions but at the cost of providing a potentially conservative collision risk. Eventually, we also present our approaches for non-stochastic multi-agent AVs. We demonstrate the effectiveness of our proposed results by applying them to a vehicle platooning consisting of 100 vehicles with 1 leader and 99 followers. We formally estimate the collision risk by collecting data from trajectories of each agent.
△ Less
Submitted 20 July, 2022; v1 submitted 14 December, 2021;
originally announced December 2021.
-
Posetal Games: Efficiency, Existence, and Refinement of Equilibria in Games with Prioritized Metrics
Authors:
Alessandro Zanardi,
Gioele Zardini,
Sirish Srinivasan,
Saverio Bolognani,
Andrea Censi,
Florian Dörfler,
Emilio Frazzoli
Abstract:
Modern applications require robots to comply with multiple, often conflicting rules and to interact with the other agents. We present Posetal Games as a class of games in which each player expresses a preference over the outcomes via a partially ordered set of metrics. This allows one to combine hierarchical priorities of each player with the interactive nature of the environment. By contextualizi…
▽ More
Modern applications require robots to comply with multiple, often conflicting rules and to interact with the other agents. We present Posetal Games as a class of games in which each player expresses a preference over the outcomes via a partially ordered set of metrics. This allows one to combine hierarchical priorities of each player with the interactive nature of the environment. By contextualizing standard game theoretical notions, we provide two sufficient conditions on the preference of the players to prove existence of pure Nash Equilibria in finite action sets. Moreover, we define formal operations on the preference structures and link them to a refinement of the game solutions, showing how the set of equilibria can be systematically shrunk. The presented results are showcased in a driving game where autonomous vehicles select from a finite set of trajectories. The results demonstrate the interpretability of results in terms of minimum-rank-violation for each player.
△ Less
Submitted 13 November, 2021;
originally announced November 2021.
-
On Assessing the Usefulness of Proxy Domains for Develo** and Evaluating Embodied Agents
Authors:
Anthony Courchesne,
Andrea Censi,
Liam Paull
Abstract:
In many situations it is either impossible or impractical to develop and evaluate agents entirely on the target domain on which they will be deployed. This is particularly true in robotics, where doing experiments on hardware is much more arduous than in simulation. This has become arguably more so in the case of learning-based agents. To this end, considerable recent effort has been devoted to de…
▽ More
In many situations it is either impossible or impractical to develop and evaluate agents entirely on the target domain on which they will be deployed. This is particularly true in robotics, where doing experiments on hardware is much more arduous than in simulation. This has become arguably more so in the case of learning-based agents. To this end, considerable recent effort has been devoted to develo** increasingly realistic and higher fidelity simulators. However, we lack any principled way to evaluate how good a "proxy domain" is, specifically in terms of how useful it is in hel** us achieve our end objective of building an agent that performs well in the target domain. In this work, we investigate methods to address this need. We begin by clearly separating two uses of proxy domains that are often conflated: 1) their ability to be a faithful predictor of agent performance and 2) their ability to be a useful tool for learning. In this paper, we attempt to clarify the role of proxy domains and establish new proxy usefulness (PU) metrics to compare the usefulness of different proxy domains. We propose the relative predictive PU to assess the predictive ability of a proxy domain and the learning PU to quantify the usefulness of a proxy as a tool to generate learning data. Furthermore, we argue that the value of a proxy is conditioned on the task that it is being used to help solve. We demonstrate how these new metrics can be used to optimize parameters of the proxy domain for which obtaining ground truth via system identification is not trivial.
△ Less
Submitted 7 October, 2021; v1 submitted 29 September, 2021;
originally announced September 2021.
-
Dynamic Population Games: A Tractable Intersection of Mean-Field Games and Population Games
Authors:
Ezzat Elokda,
Saverio Bolognani,
Andrea Censi,
Florian Dörfler,
Emilio Frazzoli
Abstract:
In many real-world large-scale decision problems, self-interested agents have individual dynamics and optimize their own long-term payoffs. Important examples include the competitive access to shared resources (e.g., roads, energy, or bandwidth) but also non-engineering domains like epidemic propagation and control. These problems are natural to model as mean-field games. Existing mathematical for…
▽ More
In many real-world large-scale decision problems, self-interested agents have individual dynamics and optimize their own long-term payoffs. Important examples include the competitive access to shared resources (e.g., roads, energy, or bandwidth) but also non-engineering domains like epidemic propagation and control. These problems are natural to model as mean-field games. Existing mathematical formulations of mean field games have had limited applicability in practice, since they require solving non-standard initial-terminal-value problems that are tractable only in limited special cases. In this letter, we propose a novel formulation, along with computational tools, for a practically relevant class of Dynamic Population Games (DPGs), which correspond to discrete-time, finite-state-and-action, stationary mean-field games. Our main contribution is a mathematical reduction of Stationary Nash Equilibria (SNE) in DPGs to standard Nash Equilibria (NE) in static population games. This reduction is leveraged to guarantee the existence of a SNE, develop an evolutionary dynamics-based SNE computation algorithm, and derive simple conditions that guarantee stability and uniqueness of the SNE. We provide two examples of applications: fair resource allocation with heterogeneous agents and control of epidemic propagation. Open source software for SNE computation: https://gitlab.ethz.ch/elokdae/dynamic-population-games
△ Less
Submitted 4 June, 2024; v1 submitted 29 April, 2021;
originally announced April 2021.
-
Co-Design of Autonomous Systems: From Hardware Selection to Control Synthesis
Authors:
Gioele Zardini,
Andrea Censi,
Emilio Frazzoli
Abstract:
Designing cyber-physical systems is a complex task which requires insights at multiple abstraction levels. The choices of single components are deeply interconnected and need to be jointly studied. In this work, we consider the problem of co-designing the control algorithm as well as the platform around it. In particular, we leverage a monotone theory of co-design to formalize variations of the LQ…
▽ More
Designing cyber-physical systems is a complex task which requires insights at multiple abstraction levels. The choices of single components are deeply interconnected and need to be jointly studied. In this work, we consider the problem of co-designing the control algorithm as well as the platform around it. In particular, we leverage a monotone theory of co-design to formalize variations of the LQG control problem as monotone feasibility relations. We then show how this enables the embedding of control co-design problems in the higher level co-design problem of a robotic platform. We illustrate the properties of our formalization by analyzing the co-design of an autonomous drone performing search-and-rescue tasks and show how, given a set of desired robot behaviors, we can compute Pareto efficient design solutions.
△ Less
Submitted 27 March, 2021; v1 submitted 21 November, 2020;
originally announced November 2020.
-
Co-Design of Embodied Intelligence: A Structured Approach
Authors:
Gioele Zardini,
Dejan Milojevic,
Andrea Censi,
Emilio Frazzoli
Abstract:
We consider the problem of co-designing embodied intelligence as a whole in a structured way, from hardware components such as propulsion systems and sensors to software modules such as control and perception pipelines. We propose a principled approach to formulate and solve complex embodied intelligence co-design problems, leveraging a monotone co-design theory. The methods we propose are intuiti…
▽ More
We consider the problem of co-designing embodied intelligence as a whole in a structured way, from hardware components such as propulsion systems and sensors to software modules such as control and perception pipelines. We propose a principled approach to formulate and solve complex embodied intelligence co-design problems, leveraging a monotone co-design theory. The methods we propose are intuitive and integrate heterogeneous engineering disciplines, allowing analytical and simulation-based modeling techniques and enabling interdisciplinarity. We illustrate through a case study how, given a set of desired behaviors, our framework is able to compute Pareto efficient solutions for the entire hardware and software stack of a self-driving vehicle.
△ Less
Submitted 30 July, 2021; v1 submitted 21 November, 2020;
originally announced November 2020.
-
Co-Design to Enable User-Friendly Tools to Assess the Impact of Future Mobility Solutions
Authors:
Gioele Zardini,
Nicolas Lanzetti,
Andrea Censi,
Emilio Frazzoli,
Marco Pavone
Abstract:
The design of future mobility solutions and the design of the mobility systems they enable are closely coupled. Indeed, knowledge about the intended service of novel mobility solutions would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management policies. This requires tools to study such a coupling and…
▽ More
The design of future mobility solutions and the design of the mobility systems they enable are closely coupled. Indeed, knowledge about the intended service of novel mobility solutions would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management policies. This requires tools to study such a coupling and co-design mobility systems in terms of different objectives. We present a framework to address such co-design problems, leveraging a mathematical theory of co-design to frame and solve the problem of designing and deploying an intermodal mobility system, whereby autonomous vehicles service travel demands jointly with micromobility solutions and public transit, in terms of fleets sizing, vehicle characteristics, and public transit service frequency. Our framework is modular and compositional, allowing one to describe the design as the interconnection of simple components and to tackle it from a systemic perspective. Moreover, it requires general monotonicity assumptions and naturally handles multiple objectives, delivering rational, actionable solutions for policy makers. We showcase our methodology in a case study of Washington D.C., USA. Our work suggests the possibility to create user-friendly optimization tools to systematically assess costs and benefits of interventions, and to inform policy-making in the future.
△ Less
Submitted 19 November, 2022; v1 submitted 19 August, 2020;
originally announced August 2020.
-
A Compositional Sheaf-Theoretic Framework for Event-Based Systems (Extended Version)
Authors:
Gioele Zardini,
David I. Spivak,
Andrea Censi,
Emilio Frazzoli
Abstract:
A compositional sheaf-theoretic framework for the modeling of complex event-based systems is presented. We show that event-based systems are machines, with inputs and outputs, and that they can be composed with machines of different types, all within a unified, sheaf-theoretic formalism. We take robotic systems as an exemplar of complex systems and rigorously describe actuators, sensors, and algor…
▽ More
A compositional sheaf-theoretic framework for the modeling of complex event-based systems is presented. We show that event-based systems are machines, with inputs and outputs, and that they can be composed with machines of different types, all within a unified, sheaf-theoretic formalism. We take robotic systems as an exemplar of complex systems and rigorously describe actuators, sensors, and algorithms using this framework.
△ Less
Submitted 22 June, 2020; v1 submitted 10 May, 2020;
originally announced May 2020.
-
On the Co-Design of AV-Enabled Mobility Systems
Authors:
Gioele Zardini,
Nicolas Lanzetti,
Mauro Salazar,
Andrea Censi,
Emilio Frazzoli,
Marco Pavone
Abstract:
The design of autonomous vehicles (AVs) and the design of AV-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management decisions. This calls for tools to study such a coupling and co-design AVs and AV-en…
▽ More
The design of autonomous vehicles (AVs) and the design of AV-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management decisions. This calls for tools to study such a coupling and co-design AVs and AV-enabled mobility systems in terms of different objectives. In this paper, we instantiate a framework to address such co-design problems. In particular, we leverage the recently developed theory of co-design to frame and solve the problem of designing and deploying an intermodal Autonomous Mobility-on-Demand system, whereby AVs service travel demands jointly with public transit, in terms of fleet sizing, vehicle autonomy, and public transit service frequency. Our framework is modular and compositional, allowing one to describe the design problem as the interconnection of its individual components and to tackle it from a system-level perspective. To showcase our methodology, we present a real-world case study for Washington D.C., USA. Our work suggests that it is possible to create user-friendly optimization tools to systematically assess costs and benefits of interventions, and that such analytical techniques might gain a momentous role in policy-making in the future.
△ Less
Submitted 6 March, 2021; v1 submitted 7 March, 2020;
originally announced March 2020.
-
Towards a Co-Design Framework for Future Mobility Systems
Authors:
Gioele Zardini,
Nicolas Lanzetti,
Mauro Salazar,
Andrea Censi,
Emilio Frazzoli,
Marco Pavone
Abstract:
The design of Autonomous Vehicles (AVs) and the design of AVs-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management decisions. This calls for tools to study such a coupling and co-design AVs and AVs-…
▽ More
The design of Autonomous Vehicles (AVs) and the design of AVs-enabled mobility systems are closely coupled. Indeed, knowledge about the intended service of AVs would impact their design and deployment process, whilst insights about their technological development could significantly affect transportation management decisions. This calls for tools to study such a coupling and co-design AVs and AVs-enabled mobility systems in terms of different objectives. In this paper, we instantiate a framework to address such co-design problems. In particular, we leverage the recently developed theory of co-design to frame and solve the problem of designing and deploying an intermodal Autonomous Mobility-on-Demand system, whereby AVs service travel demands jointly with public transit, in terms of fleet sizing, vehicle autonomy, and public transit service frequency. Our framework is modular and compositional, allowing to describe the design problem as the interconnection of its individual components and to tackle it from a system-level perspective. Moreover, it only requires very general monotonicity assumptions and it naturally handles multiple objectives, delivering the rational solutions on the Pareto front and thus enabling policy makers to select a solution through political criteria. To showcase our methodology, we present a real-world case study for Washington D.C., USA. Our work suggests that it is possible to create user-friendly optimization tools to systematically assess the costs and benefits of interventions, and that such analytical techniques might gain a momentous role in policy-making in the future.
△ Less
Submitted 21 May, 2020; v1 submitted 17 October, 2019;
originally announced October 2019.
