-
Data-Driven Personalized Energy Consumption Range Estimation for Plug-in Hybrid Electric Vehicles in Urban Traffic
Authors:
Mehmet Fatih Ozkan,
James Farrell,
Marcello Telloni,
Luis Mendez,
Radu Pirvan,
Jeffrey P. Chrstos,
Marcello Canova,
Stephanie Stockar
Abstract:
In urban traffic environments, driver behaviors exhibit considerable diversity in vehicle operation, encompassing a range of acceleration and braking maneuvers as well as adherence to traffic regulations, such as speed limits. It is well-established that these intrinsic driving behaviors significantly influence vehicle energy consumption. Therefore, establishing a quantitative relationship between…
▽ More
In urban traffic environments, driver behaviors exhibit considerable diversity in vehicle operation, encompassing a range of acceleration and braking maneuvers as well as adherence to traffic regulations, such as speed limits. It is well-established that these intrinsic driving behaviors significantly influence vehicle energy consumption. Therefore, establishing a quantitative relationship between driver behavior and energy usage is essential for identifying energy-efficient driving practices and optimizing routes within urban traffic. This study introduces a data-driven approach to predict the equivalent fuel consumption of a plug-in hybrid electric vehicle (PHEV) based on an integrated model of driver behavior and vehicle energy consumption. Unlike traditional models that provide point predictions of fuel consumption, this approach uses Conformalized Quantile Regression (CQR) to offer prediction intervals that capture the variability and uncertainty in fuel consumption. These intervals reflect changes in fuel consumption, as well as variations in driver behavior, and vehicle and route conditions. To develop this model, driver-specific data were collected through a driver-in-the-loop simulator, which tested different human drivers responses. The CQR model was then trained and validated using the experimental data from the driver-in-the-loop simulator, augmented by the synthetic data generated from Monte Carlo simulations conducted using a calibrated microscopic driver behavior and vehicle energy model. The CQR model was evaluated by comparing its predictions of equivalent fuel consumption intervals with those of baseline prediction interval methods that rely solely on conformal prediction.
△ Less
Submitted 9 June, 2024; v1 submitted 27 May, 2024;
originally announced May 2024.
-
Parameter Identification for Electrochemical Models of Lithium-Ion Batteries Using Bayesian Optimization
Authors:
Jianzong Pi,
Samuel Filgueira da Silva,
Mehmet Fatih Ozkan,
Abhishek Gupta,
Marcello Canova
Abstract:
Efficient parameter identification of electrochemical models is crucial for accurate monitoring and control of lithium-ion cells. This process becomes challenging when applied to complex models that rely on a considerable number of interdependent parameters that affect the output response. Gradient-based and metaheuristic optimization techniques, although previously employed for this task, are lim…
▽ More
Efficient parameter identification of electrochemical models is crucial for accurate monitoring and control of lithium-ion cells. This process becomes challenging when applied to complex models that rely on a considerable number of interdependent parameters that affect the output response. Gradient-based and metaheuristic optimization techniques, although previously employed for this task, are limited by their lack of robustness, high computational costs, and susceptibility to local minima. In this study, Bayesian Optimization is used for tuning the dynamic parameters of an electrochemical equivalent circuit battery model (E-ECM) for a nickel-manganese-cobalt (NMC)-graphite cell. The performance of the Bayesian Optimization is compared with baseline methods based on gradient-based and metaheuristic approaches. The robustness of the parameter optimization method is tested by performing verification using an experimental drive cycle. The results indicate that Bayesian Optimization outperforms Gradient Descent and PSO optimization techniques, achieving reductions on average testing loss by 28.8% and 5.8%, respectively. Moreover, Bayesian optimization significantly reduces the variance in testing loss by 95.8% and 72.7%, respectively.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Data-driven Driver Model for Speed Advisory Systems in Partially Automated Vehicles
Authors:
Olivia Jacome,
Shobhit Gupta,
Stephanie Stockar,
Marcello Canova
Abstract:
Vehicle control algorithms exploiting connectivity and automation, such as Connected and Automated Vehicles (CAVs) or Advanced Driver Assistance Systems (ADAS), have the opportunity to improve energy savings. However, lower levels of automation involve a human-machine interaction stage, where the presence of a human driver affects the performance of the control algorithm in closed loop. This occur…
▽ More
Vehicle control algorithms exploiting connectivity and automation, such as Connected and Automated Vehicles (CAVs) or Advanced Driver Assistance Systems (ADAS), have the opportunity to improve energy savings. However, lower levels of automation involve a human-machine interaction stage, where the presence of a human driver affects the performance of the control algorithm in closed loop. This occurs for instance in the case of Eco-Driving control algorithms implemented as a velocity advisory system, where the driver is displayed an optimal speed trajectory to follow to reduce energy consumption. Achieving the control objectives relies on the human driver perfectly following the recommended speed. If the driver is unable to follow the recommended speed, a decline in energy savings and poor vehicle performance may occur. This warrants the creation of methods to model and forecast the response of a human driver when operating in the loop with a speed advisory system.
This work focuses on develo** a sequence to sequence long-short term memory (LSTM)-based driver behavior model that models the interaction of the human driver to a suggested desired vehicle speed trajectory in real-world conditions. A driving simulator is used for data collection and training the driver model, which is then compared against the driving data and a deterministic model. Results show close proximity of the LSTM-based model with the driving data, demonstrating that the model can be adopted as a tool to design human-centered speed advisory systems.
△ Less
Submitted 17 May, 2022;
originally announced May 2022.
-
Model Predictive Control for Automotive Climate Control Systems via Value Function Approximation
Authors:
Dennis Kibalama,
Yuxing Liu,
Stephanie Stockar,
Marcello Canova
Abstract:
Among the auxiliary loads in light-duty vehicles, the air conditioning system is the single largest energy consumer. For electrified vehicles, the impact of heating and cooling loads becomes even more significant, as they compete with the powertrain for battery energy use and can significantly reduce the range or performance. While considerable work has been made in the field of optimal energy man…
▽ More
Among the auxiliary loads in light-duty vehicles, the air conditioning system is the single largest energy consumer. For electrified vehicles, the impact of heating and cooling loads becomes even more significant, as they compete with the powertrain for battery energy use and can significantly reduce the range or performance. While considerable work has been made in the field of optimal energy management for electrified vehicles and optimization of vehicle velocity for eco-driving, few contributions have addressed the application of energy-optimal control for heating and cooling loads.
This paper proposes an energy management strategy for the thermal management system of an electrified powertrain, based on Model Predictive Control. Starting from a nonlinear model of the vapor compression refrigeration system that captures the dynamics of the refrigerant in the heat exchangers and the power consumption of the system, a constrained multi-objective optimal control problem is formulated to reduce energy consumption while tracking a desired thermal set point. An efficient implementation of MPC is proposed for real-time applications by introducing a terminal cost obtained from the approximation of the global optimal solution.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Real-time Eco-Driving Control in Electrified Connected and Autonomous Vehicles using Approximate Dynamic Programming
Authors:
Shreshta Rajakumar Deshpande,
Shobhit Gupta,
Abhishek Gupta,
Marcello Canova
Abstract:
Connected and Automated Vehicles (CAVs), particularly those with a hybrid electric powertrain, have the potential to significantly improve vehicle energy savings in real-world driving conditions. In particular, the Eco-Driving problem seeks to design optimal speed and power usage profiles based on available information from connectivity and advanced map** features to minimize the fuel consumptio…
▽ More
Connected and Automated Vehicles (CAVs), particularly those with a hybrid electric powertrain, have the potential to significantly improve vehicle energy savings in real-world driving conditions. In particular, the Eco-Driving problem seeks to design optimal speed and power usage profiles based on available information from connectivity and advanced map** features to minimize the fuel consumption over an itinerary. This paper presents a hierarchical multi-layer Model Predictive Control (MPC) approach for improving the fuel economy of a 48V mild-hybrid powertrain in a connected vehicle environment. Approximate Dynamic Programming (ADP) is used to solve the Receding Horizon Optimal Control Problem (RHOCP), where the terminal cost for the RHOCP is approximated as the base-policy obtained from the long-term optimization.
The controller was extensively tested virtually (using both deterministic and Monte Carlo simulations) across multiple real-world routes where energy savings of more than 20\% have been demonstrated. Further, the developed controller was deployed and tested at a proving ground in real-time on a test vehicle equipped with a rapid prototy** embedded controller. Real-time in-vehicle testing confirmed the energy savings observed in simulation and demonstrated the ability of the developed controller to be effective in real-time applications.
△ Less
Submitted 5 August, 2021;
originally announced August 2021.
-
Eco-Driving of Connected and Autonomous Vehicles with Sequence-to-Sequence Prediction of Target Vehicle Velocity
Authors:
Shobhit Gupta,
Marcello Canova
Abstract:
The Eco-Driving control problem seeks to perform fuel efficient speed planning for a Connected and Autonomous Vehicle (CAV) that can exploit information available from advanced map**, and from Vehicle-to-Everything (V2X) communication. The ability of an Eco-Driving strategy to adapt in real time to variable traffic scenarios where surrounding vehicles can be either connected or unconnected is cr…
▽ More
The Eco-Driving control problem seeks to perform fuel efficient speed planning for a Connected and Autonomous Vehicle (CAV) that can exploit information available from advanced map**, and from Vehicle-to-Everything (V2X) communication. The ability of an Eco-Driving strategy to adapt in real time to variable traffic scenarios where surrounding vehicles can be either connected or unconnected is critical for further development and deployment of this technology in the transportation sector. In this work, the Eco-Driving strategy, formulated as a receding-horizon optimal control problem, is integrated with a target vehicle speed prediction model and solved via Dynamic Programming (DP) to determine the optimal speed trajectory in the presence of a human-driven target vehicle. An encoder-decoder architecture analyzes the patterns in the target vehicle velocity recorded over a historic window using a Gated-Recurrent-Unit (GRU) based encoder and generates an estimate of the future velocity trajectory using the GRU based decoder. A sensitivity study is done to analyze the effect of the historical and prediction windows on the accuracy of the velocity predictor. The proposed Eco-Driving controller is evaluated through microscopic simulations using a traffic simulator.
△ Less
Submitted 30 May, 2021;
originally announced May 2021.
-
Safe Model-based Off-policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles
Authors:
Zhaoxuan Zhu,
Nicola Pivaro,
Shobhit Gupta,
Abhishek Gupta,
Marcello Canova
Abstract:
Connected and Automated Hybrid Electric Vehicles have the potential to reduce fuel consumption and travel time in real-world driving conditions. The eco-driving problem seeks to design optimal speed and power usage profiles based upon look-ahead information from connectivity and advanced map** features. Recently, Deep Reinforcement Learning (DRL) has been applied to the eco-driving problem. Whil…
▽ More
Connected and Automated Hybrid Electric Vehicles have the potential to reduce fuel consumption and travel time in real-world driving conditions. The eco-driving problem seeks to design optimal speed and power usage profiles based upon look-ahead information from connectivity and advanced map** features. Recently, Deep Reinforcement Learning (DRL) has been applied to the eco-driving problem. While the previous studies synthesize simulators and model-free DRL to reduce online computation, this work proposes a Safe Off-policy Model-Based Reinforcement Learning algorithm for the eco-driving problem. The advantages over the existing literature are three-fold. First, the combination of off-policy learning and the use of a physics-based model improves the sample efficiency. Second, the training does not require any extrinsic rewarding mechanism for constraint satisfaction. Third, the feasibility of trajectory is guaranteed by using a safe set approximated by deep generative models.
The performance of the proposed method is benchmarked against a baseline controller representing human drivers, a previously designed model-free DRL strategy, and the wait-and-see optimal solution. In simulation, the proposed algorithm leads to a policy with a higher average speed and a better fuel economy compared to the model-free agent. Compared to the baseline controller, the learned strategy reduces the fuel consumption by more than 21\% while kee** the average speed comparable.
△ Less
Submitted 30 January, 2022; v1 submitted 24 May, 2021;
originally announced May 2021.
-
A GPU Implementation of a Look-Ahead Optimal Controller for Eco-Driving Based on Dynamic Programming
Authors:
Zhaoxuan Zhu,
Shobhit Gupta,
Nicola Pivaro,
Shreshta Rajakumar Deshpande,
Marcello Canova
Abstract:
Predictive energy management of Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, has the potential to significantly improve energy savings in real-world driving conditions. In particular, the eco-driving problem seeks to design optimal speed and power usage profiles based upon available information from connectivity and advanced map** features to minimize…
▽ More
Predictive energy management of Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, has the potential to significantly improve energy savings in real-world driving conditions. In particular, the eco-driving problem seeks to design optimal speed and power usage profiles based upon available information from connectivity and advanced map** features to minimize the fuel consumption between two designated locations.
In this work, the eco-driving problem is formulated as a three-state receding horizon optimal control problem and solved via Dynamic Programming (DP). The optimal solution, in terms of vehicle speed and battery State of Charge (SoC) trajectories, allows a connected and automated hybrid electric vehicle to intelligently pass the signalized intersections and minimize fuel consumption over a prescribed route. To enable real-time implementation, a parallel architecture of DP is proposed for an NVIDIA GPU with CUDA programming. Simulation results indicate that the proposed optimal controller delivers more than 15% fuel economy benefits compared to a baseline control strategy and that the solver time can be reduced by more than 90% by the parallel implementation when compared to a serial implementation.
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
-
An Algorithm to Warm Start Perturbed (WASP) Constrained Dynamic Programs
Authors:
Abhishek Gupta,
Shreshta Rajakumar Deshpande,
Marcello Canova
Abstract:
Receding horizon optimal control problems compute the solution at each time step to operate the system on a near-optimal path. However, in many practical cases, the boundary conditions, such as external inputs, constraint equations, or the objective function, vary only marginally from one time step to the next. In this case, recomputing the optimal solution at each time represents a significant bu…
▽ More
Receding horizon optimal control problems compute the solution at each time step to operate the system on a near-optimal path. However, in many practical cases, the boundary conditions, such as external inputs, constraint equations, or the objective function, vary only marginally from one time step to the next. In this case, recomputing the optimal solution at each time represents a significant burden for real-time applications. This paper proposes a novel algorithm to approximately solve a perturbed constrained dynamic program that significantly improves the computational burden when the objective function and the constraints are perturbed slightly. The method hinges on determining closed-form expressions for first-order perturbations in the optimal strategy and the Lagrange multipliers of the perturbed constrained dynamic programming problem are obtained. This information can be used to initialize any algorithm (such as the method of Lagrange multipliers, or the augmented Lagrangian method) to solve the perturbed dynamic programming problem with minimal computational resources.
△ Less
Submitted 31 January, 2021;
originally announced February 2021.
-
A Deep Reinforcement Learning Framework for Eco-driving in Connected and Automated Hybrid Electric Vehicles
Authors:
Zhaoxuan Zhu,
Shobhit Gupta,
Abhishek Gupta,
Marcello Canova
Abstract:
Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, have the potential to significantly reduce fuel consumption and travel time in real-world driving conditions. In particular, the Eco-driving problem seeks to design optimal speed and power usage profiles based upon look-ahead information from connectivity and advanced map** features, to minimize the fuel co…
▽ More
Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, have the potential to significantly reduce fuel consumption and travel time in real-world driving conditions. In particular, the Eco-driving problem seeks to design optimal speed and power usage profiles based upon look-ahead information from connectivity and advanced map** features, to minimize the fuel consumption over a given itinerary.
In this work, the Eco-driving problem is formulated as a Partially Observable Markov Decision Process (POMDP), which is then solved with a state-of-art Deep Reinforcement Learning (DRL) Actor Critic algorithm, Proximal Policy Optimization. An Eco-driving simulation environment is developed for training and evaluation purposes. To benchmark the performance of the DRL controller, a baseline controller representing the human driver, a trajectory optimization algorithm and the wait-and-see deterministic optimal solution are presented. With a minimal onboard computational requirement and a comparable travel time, the DRL controller reduces the fuel consumption by more than 17% compared against the baseline controller by modulating the vehicle velocity over the route and performing energy-efficient approach and departure at signalized intersections, over-performing the more computationally demanding trajectory optimization method
△ Less
Submitted 20 September, 2023; v1 submitted 13 January, 2021;
originally announced January 2021.
-
Integrated Approximate Dynamic Programming and Equivalent Consumption Minimization Strategy for Eco-Driving in a Connected and Automated Vehicle
Authors:
Shreshta Rajakumar Deshpande,
Daniel Jung,
Marcello Canova
Abstract:
This paper focuses on the velocity planning and energy management problems for Connected and Automated Vehicles (CAVs) with hybrid electric powertrains. The eco-driving problem is formulated in the spatial domain as a nonlinear dynamic optimization problem, in which information about the upcoming speed limits and road topography is assumed to be known a priori. To solve this problem, a novel Dynam…
▽ More
This paper focuses on the velocity planning and energy management problems for Connected and Automated Vehicles (CAVs) with hybrid electric powertrains. The eco-driving problem is formulated in the spatial domain as a nonlinear dynamic optimization problem, in which information about the upcoming speed limits and road topography is assumed to be known a priori. To solve this problem, a novel Dynamic Programming (DP) based optimization method is proposed, in which a causal Equivalent Consumption Minimization Strategy (ECMS) is embedded. The underlying vehicle model to predict energy consumption over real-world routes is validated using experimental data.
Further, a multi-layer hierarchical control architecture is proposed as a pathway to real-time implementation in a vehicle. The DP-ECMS algorithm is introduced for a long-horizon optimization problem, and then adapted for a receding horizon implementation using principles in Approximate Dynamic Programming (ADP). This computationally economical alternative to the traditional DP solution is then benchmarked and evaluated.
△ Less
Submitted 7 October, 2020;
originally announced October 2020.
