-
Active Exploration in Iterative Gaussian Process Regression for Uncertainty Modeling in Autonomous Racing
Authors:
Tommaso Benciolini,
Chen Tang,
Marion Leibold,
Catherine Weaver,
Masayoshi Tomizuka,
Wei Zhan
Abstract:
Autonomous racing creates challenging control problems, but Model Predictive Control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary for model-based control, including models of vehicle dynamics and opponent behavior. Both dynamics model error and opponent behavior can be modeled with Gaussian…
▽ More
Autonomous racing creates challenging control problems, but Model Predictive Control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary for model-based control, including models of vehicle dynamics and opponent behavior. Both dynamics model error and opponent behavior can be modeled with Gaussian Process (GP) regression. GP models can be updated iteratively from data collected using the controller, but the strength of the GP model depends on the diversity of the training data. We propose a novel active exploration mechanism for iterative GP regression that purposefully collects additional data at regions of higher uncertainty in the GP model. In the exploration, a MPC collects diverse data by balancing the racing objectives and the exploration criterion; then the GP is re-trained. The process is repeated iteratively; in later iterations, the exploration is deactivated, and only the racing objectives are optimized. Thus, the MPC can achieve better performance by leveraging the improved GP model. We validate our approach in the highly realistic racing simulation platform Gran Turismo Sport of Sony Interactive Entertainment Inc for a minimum lap time challenge, and in numerical simulation of head-to-head. Our active exploration mechanism yields a significant improvement in the GP prediction accuracy compared to previous approaches and, thus, an improved racing performance.
△ Less
Submitted 3 November, 2023;
originally announced November 2023.
-
Double-Iterative Gaussian Process Regression for Modeling Error Compensation in Autonomous Racing
Authors:
Shaoshu Su,
Ce Hao,
Catherine Weaver,
Chen Tang,
Wei Zhan,
Masayoshi Tomizuka
Abstract:
Autonomous racing control is a challenging research problem as vehicles are pushed to their limits of handling to achieve an optimal lap time; therefore, vehicles exhibit highly nonlinear and complex dynamics. Difficult-to-model effects, such as drifting, aerodynamics, chassis weight transfer, and suspension can lead to infeasible and suboptimal trajectories. While offline planning allows optimizi…
▽ More
Autonomous racing control is a challenging research problem as vehicles are pushed to their limits of handling to achieve an optimal lap time; therefore, vehicles exhibit highly nonlinear and complex dynamics. Difficult-to-model effects, such as drifting, aerodynamics, chassis weight transfer, and suspension can lead to infeasible and suboptimal trajectories. While offline planning allows optimizing a full reference trajectory for the minimum lap time objective, such modeling discrepancies are particularly detrimental when using offline planning, as planning model errors compound with controller modeling errors. Gaussian Process Regression (GPR) can compensate for modeling errors. However, previous works primarily focus on modeling error in real-time control without consideration for how the model used in offline planning can affect the overall performance. In this work, we propose a double-GPR error compensation algorithm to reduce model uncertainties; specifically, we compensate both the planner's model and controller's model with two respective GPR-based error compensation functions. Furthermore, we design an iterative framework to re-collect error-rich data using the racing control system. We test our method in the high-fidelity racing simulator Gran Turismo Sport (GTS); we find that our iterative, double-GPR compensation functions improve racing performance and iteration stability in comparison to a single compensation function applied merely for real-time control.
△ Less
Submitted 26 June, 2023; v1 submitted 12 May, 2023;
originally announced May 2023.
-
Outracing Human Racers with Model-based Planning and Control for Time-trial Racing
Authors:
Ce Hao,
Chen Tang,
Eric Bergkvist,
Catherine Weaver,
Liting Sun,
Wei Zhan,
Masayoshi Tomizuka
Abstract:
Autonomous racing has become a popular sub-topic of autonomous driving in recent years. The goal of autonomous racing research is to develop software to control the vehicle at its limit of handling and achieve human-level racing performance. In this work, we investigate how to approach human expert-level racing performance with model-based planning and control methods using the high-fidelity racin…
▽ More
Autonomous racing has become a popular sub-topic of autonomous driving in recent years. The goal of autonomous racing research is to develop software to control the vehicle at its limit of handling and achieve human-level racing performance. In this work, we investigate how to approach human expert-level racing performance with model-based planning and control methods using the high-fidelity racing simulator Gran Turismo Sport (GTS). GTS enables a unique opportunity for autonomous racing research, as many recordings of racing from highly skilled human players can served as expert emonstrations. By comparing the performance of the autonomous racing software with human experts, we better understand the performance gap of existing software and explore new methodologies in a principled manner. In particular, we focus on the commonly adopted model-based racing framework, consisting of an offline trajectory planner and an online Model Predictive Control-based (MPC) tracking controller. We thoroughly investigate the design challenges from three perspective, namely vehicle model, planning algorithm, and controller design, and propose novel solutions to improve the baseline approach toward human expert-level performance. We showed that the proposed control framework can achieve top 0.95% lap time among human-expert players in GTS. Furthermore, we conducted comprehensive ablation studies to validate the necessity of proposed modules, and pointed out potential future directions to reach human-best performance.
△ Less
Submitted 25 October, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
The First Orbital Flight of the ELROI Optical Satellite License Plate
Authors:
David M. Palmer,
Rebecca M. Holmes,
Charles T. Weaver
Abstract:
Space Object Identification is one of the cornerstones of Space Traffic Control and a requirement for successful operation of a spacecraft.
ELROI, the Extremely Low Resource Optical Identifier, is a new concept that can provide a self-powered satellite identification beacon in a package the size of a thick postage stamp. Its small size, low cost, and fully autonomous operation make it usable by…
▽ More
Space Object Identification is one of the cornerstones of Space Traffic Control and a requirement for successful operation of a spacecraft.
ELROI, the Extremely Low Resource Optical Identifier, is a new concept that can provide a self-powered satellite identification beacon in a package the size of a thick postage stamp. Its small size, low cost, and fully autonomous operation make it usable by all space objects, including CubeSats and inert debris objects.
The beacon's signal is received on the ground using a small telescope equipped with a photon-counting detector which can unambiguously determine the satellite identification number during a single pass overhead. Additional information can be included in the signal to aid in anomaly diagnosis and resolution, further improving spaceflight reliability and safety.
The first ELROI unit in orbit was launched December, 2018 as a payload on the student CubeSat NMTSat. We are now searching for the identification signal.
△ Less
Submitted 29 July, 2019;
originally announced July 2019.
-
Self-Organizing Mobility Robustness Optimization in LTE Networks with eICIC
Authors:
Carl Weaver,
Pantelis Monogioudis
Abstract:
We address the problem of Mobility Robustness Optimization (MRO) and describe centralized Self Organizing Network (SON) solutions that can optimize connected-mode mobility Key Performance Indicators (KPIs). Our solution extends the earlier work of eICIC parameter optimization [7], to heterogeneous networks with mobility, and outline methods of progressive complexity that optimize the Retaining/Off…
▽ More
We address the problem of Mobility Robustness Optimization (MRO) and describe centralized Self Organizing Network (SON) solutions that can optimize connected-mode mobility Key Performance Indicators (KPIs). Our solution extends the earlier work of eICIC parameter optimization [7], to heterogeneous networks with mobility, and outline methods of progressive complexity that optimize the Retaining/Offloading Bias which are macro/pico views of Cell Individual Offset parameters. Simulation results under real LTE network deployment assumptions of a US metropolitan area demonstrate the effects of such solutions on the mobility KPIs. To our knowledge, this solution is the first that demonstrates the joint optimization of eICIC and MRO.
△ Less
Submitted 23 October, 2013;
originally announced October 2013.