Showing 1–14 of 14 results for author: Moura, S J

Planning for Electric Vehicles Coupled with Urban Mobility

Authors: Yanyan Xu, Serdar Colak, Emre C. Kara, Scott J. Moura, Marta C. Gonzalez

Abstract: The rising adoption of plug-in electric vehicles (PEVs) leads to the alignment of their electricity and their mobility demands. Therefore, transportation and power infrastructures are becoming increasingly interdependent. In this work, we uncover patterns of PEV mobility by integrating for the first time two unique data sets: (i) mobile phone activity of 1.39 million Bay Area residents and (ii) ch… ▽ More The rising adoption of plug-in electric vehicles (PEVs) leads to the alignment of their electricity and their mobility demands. Therefore, transportation and power infrastructures are becoming increasingly interdependent. In this work, we uncover patterns of PEV mobility by integrating for the first time two unique data sets: (i) mobile phone activity of 1.39 million Bay Area residents and (ii) charging activity of PEVs in 580,000 sessions obtained in the same region. We present a method to estimate individual mobility of PEV drivers at fine temporal and spatial resolution integrating survey data with mobile phone data and income information obtained from census. Thereupon, we recommend changes in PEVs charging times of commuters at their work stations that take into account individual travel needs and shave the pronounced peak in power demand. Informed by the tariff of electricity, we calculate the12 monetary gains to incentivize the adoption of the recommendations. These results open avenues for planning for the future of coupled transportation and electricity needs using personalized data. △ Less

Submitted 27 March, 2023; originally announced March 2023.

Journal ref: Nature Energy 3, 484-493 (2018)

Valuation of Public Bus Electrification with Open Data

Authors: Upadhi Vijay, Soomin Woo, Scott J. Moura, Akshat Jain, David Rodriguez, Sergio Gambacorta, Giuseppe Ferrara, Luigi Lanuzza, Christian Zulberti, Erika Mellekas, Carlo Papa

Abstract: This research provides a novel framework to estimate the economic, environmental, and social values of electrifying public transit buses, for cities across the world, based on open-source data. Electric buses are a compelling candidate to replace diesel buses for the environmental and social benefits. However, the state-of-art models to evaluate the value of bus electrification are limited in appl… ▽ More This research provides a novel framework to estimate the economic, environmental, and social values of electrifying public transit buses, for cities across the world, based on open-source data. Electric buses are a compelling candidate to replace diesel buses for the environmental and social benefits. However, the state-of-art models to evaluate the value of bus electrification are limited in applicability because they require granular and bespoke data on bus operation that can be difficult to procure. Our valuation tool uses General Transit Feed Specification, a standard data format used by transit agencies worldwide, to provide high-level guidance on develo** a prioritization strategy for electrifying a bus fleet. We develop physics-informed machine learning models to evaluate the energy consumption, the carbon emissions, the health impacts, and the total cost of ownership for each transit route. We demonstrate the scalability of our tool with a case study of the bus lines in the Greater Boston and Milan metropolitan areas. △ Less

Submitted 24 September, 2022; originally announced September 2022.

A Learning-based Optimal Market Bidding Strategy for Price-Maker Energy Storage

Authors: Mathilde D. Badoual, Scott J. Moura

Abstract: Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the electricity market is a challenging task. Meanwhile, model-free reinforcement learning such as the Actor-Critic are becoming increasingly popular for designing… ▽ More Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the electricity market is a challenging task. Meanwhile, model-free reinforcement learning such as the Actor-Critic are becoming increasingly popular for designing energy system controllers. Yet implementation frequently requires lengthy, data-intense, and unsafe trial-and-error training. To fill these gaps, we implement an online Supervised Actor-Critic (SAC) algorithm, supervised with a model-based controller -- Model Predictive Control (MPC). The energy storage agent is trained with this algorithm to optimally bid while learning and adjusting to its impact on the market clearing prices. We compare the supervised Actor-Critic algorithm with the MPC algorithm as a supervisor, finding that the former reaps higher profits via learning. Our contribution, thus, is an online and safe SAC algorithm that outperforms the current model-based state-of-the-art. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: Presented at the 2021 American Control Conference (ACC), New Orleans, USA, May 25-28, 2021

Risk-Aware Lane Selection on Highway with Dynamic Obstacles

Authors: Sangjae Bae, David Isele, Kikuo Fujimura, Scott J. Moura

Abstract: This paper proposes a discretionary lane selection algorithm. In particular, highway driving is considered as a targeted scenario, where each lane has a different level of traffic flow. When lane-changing is discretionary, it is advised not to change lanes unless highly beneficial, e.g., reducing travel time significantly or securing higher safety. Evaluating such "benefit" is a challenge, along w… ▽ More This paper proposes a discretionary lane selection algorithm. In particular, highway driving is considered as a targeted scenario, where each lane has a different level of traffic flow. When lane-changing is discretionary, it is advised not to change lanes unless highly beneficial, e.g., reducing travel time significantly or securing higher safety. Evaluating such "benefit" is a challenge, along with multiple surrounding vehicles in dynamic speed and heading with uncertainty. We propose a real-time lane-selection algorithm with careful cost considerations and with modularity in design. The algorithm is a search-based optimization method that evaluates uncertain dynamic positions of other vehicles under a continuous time and space domain. For demonstration, we incorporate a state-of-the-art motion planner framework (Neural Networks integrated Model Predictive Control) under a CARLA simulation environment. △ Less

Submitted 8 April, 2021; originally announced April 2021.

Comments: Submitted to 32nd IEEE Intelligent Vehicles Symposium

State Estimation for a Zero-Dimensional Electrochemical Model of Lithium-Sulfur Batteries

Authors: Zhijia Huang, Dong Zhang, Luis D. Couto, Quan-Hong Yang, Scott J. Moura

Abstract: Lithium-sulfur (Li-S) batteries have become one of the most attractive alternatives over conventional Li-ion batteries due to their high theoretical specific energy density (2500 Wh/kg for Li-S vs. $\sim$250 Wh/kg for Li-ion). Accurate state estimation in Li-S batteries is urgently needed for safe and efficient operation. To the best of the authors' knowledge, electrochemical model-based observers… ▽ More Lithium-sulfur (Li-S) batteries have become one of the most attractive alternatives over conventional Li-ion batteries due to their high theoretical specific energy density (2500 Wh/kg for Li-S vs. $\sim$250 Wh/kg for Li-ion). Accurate state estimation in Li-S batteries is urgently needed for safe and efficient operation. To the best of the authors' knowledge, electrochemical model-based observers have not been reported for Li-S batteries, primarily due to the complex dynamics that make state observer design a challenging problem. In this work, we demonstrate a state estimation scheme based on a zero-dimensional electrochemical model for Li-S batteries. The nonlinear differential-algebraic equation (DAE) model is incorporated into an extend Kalman filter. This observer design estimates both differential and algebraic states that represent the dynamic behavior inside the cell, from voltage and current measurements only. The effectiveness of the proposed estimation algorithm is illustrated by numerical simulation results. Our study unlocks how an electrochemical model can be utilized for practical state estimation of Li-S batteries. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Safe Learning MPC with Limited Model Knowledge and Data

Authors: Aaron Kandel, Scott J. Moura

Abstract: This paper presents an end-to-end framework for safe learning-based control (LbC) using nonlinear stochastic MPC and distributionally robust optimization (DRO). This work is motivated by several open challenges in LbC literature. In particular, many control-theoretic LbC methods require subject matter expertise in order to translate their own safety guarantees, often manifested as preexisting data… ▽ More This paper presents an end-to-end framework for safe learning-based control (LbC) using nonlinear stochastic MPC and distributionally robust optimization (DRO). This work is motivated by several open challenges in LbC literature. In particular, many control-theoretic LbC methods require subject matter expertise in order to translate their own safety guarantees, often manifested as preexisting data of safe trajectories or structural model knowledge. In this paper, we focus on LbC where the controller is applied directly to a system of which it has no or extremely limited direct experience, towards safety during \textit{tabula-rasa} or ``\textit{blank slate''} model-based learning and control as a challenging case for validation. This explores the boundary of the status-quo in control theory relating to requirements for subject matter expertise. We show under basic and limited assumptions on the underlying problem, we can translate probabilistic guarantees on feasibility to nonlinear systems using results in stochastic MPC and DRO literature whose relevance we formally extend in a mathematical analysis. We also present a coupled and intuitive formulation for persistence of excitation (PoE), and illustrate the connection between PoE and applicability of the proposed method. Our case studies of vehicle obstacle avoidance and safe extreme fast charging of lithium-ion batteries reveal powerful empirical results supporting the underlying DRO theory. Our method is widely applicable within the LbC domain to, for example, airborne wind energy systems, vehicle obstacle avoidance, and energy storage systems management. It is also applicable to quantifying uncertainty beyond the LbC case. △ Less

Submitted 21 August, 2023; v1 submitted 1 April, 2020; originally announced April 2020.

State of Charge Estimation of Parallel Connected Battery Cells via Descriptor System Theory

Authors: Dong Zhang, Luis D. Couto, Sebastien Benjamin, Wente Zeng, Daniel F. Coutinho, Scott J. Moura

Abstract: This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation when multiple cells are connected in parallel, using only terminal voltage and total current measurements. For battery packs consisting of thousands of cells, it is desirable to estimate individual SOCs by only monitoring the total current in order to reduce sensing cost. Mathema… ▽ More This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation when multiple cells are connected in parallel, using only terminal voltage and total current measurements. For battery packs consisting of thousands of cells, it is desirable to estimate individual SOCs by only monitoring the total current in order to reduce sensing cost. Mathematically, series connected cells yield dynamics given by ordinary differential equations under classical full voltage sensing. In contrast, parallel connected cells are evidently more challenging because the dynamics are governed by a nonlinear descriptor system, including differential equations and algebraic equations arising from voltage and current balance across cells. An observer with linear output error injection is formulated, where the individual cell SOCs and local currents are locally observable from the total current and voltage measurements. The asymptotic convergence of differential and algebraic states is established by considering local Lipschitz continuity property of system nonlinearities. Simulation results on LiNiMnCoO$_2$/Graphite (NMC) cells illustrate convergence for SOCs, local currents, and terminal voltage. △ Less

Submitted 17 March, 2020; originally announced March 2020.

Comments: 7 pages, 4 figures, 1 table, accepted by 2020 American Control Conference

Safe Wasserstein Constrained Deep Q-Learning

Authors: Aaron Kandel, Scott J. Moura

Abstract: This paper presents a distributionally robust Q-Learning algorithm (DrQ) which leverages Wasserstein ambiguity sets to provide idealistic probabilistic out-of-sample safety guarantees during online learning. First, we follow past work by separating the constraint functions from the principal objective to create a hierarchy of machines which estimate the feasible state-action space within the const… ▽ More This paper presents a distributionally robust Q-Learning algorithm (DrQ) which leverages Wasserstein ambiguity sets to provide idealistic probabilistic out-of-sample safety guarantees during online learning. First, we follow past work by separating the constraint functions from the principal objective to create a hierarchy of machines which estimate the feasible state-action space within the constrained Markov decision process (CMDP). DrQ works within this framework by augmenting constraint costs with tightening offset variables obtained through Wasserstein distributionally robust optimization (DRO). These offset variables correspond to worst-case distributions of modeling error characterized by the TD-errors of the constraint Q-functions. This procedure allows us to safely approach the nominal constraint boundaries. Using a case study of lithium-ion battery fast charging, we explore how idealistic safety guarantees translate to generally improved safety relative to conventional methods. △ Less

Submitted 25 October, 2021; v1 submitted 7 February, 2020; originally announced February 2020.

Bayesian Hierarchical Methods for Modeling Electrical Grid Component Failures

Authors: Laurel N. Dunn, Ioanna Kavvada, Mathilde Badoual, Scott J. Moura

Abstract: Failure probabilities for grid components are often estimated using parametric models which can capitalize on operational grid data. This work formulates a Bayesian hierarchical framework designed to integrate data and domain expertise to understand the failure properties of a regional power system, where variability in the expected performance of individual components gives rise to failure proces… ▽ More Failure probabilities for grid components are often estimated using parametric models which can capitalize on operational grid data. This work formulates a Bayesian hierarchical framework designed to integrate data and domain expertise to understand the failure properties of a regional power system, where variability in the expected performance of individual components gives rise to failure processes that are heterogeneous and uncertain. We use Bayesian methods to fit failure models to failure data generated in simulation. We test our algorithm by evaluating differences between the data-generating model, our Bayesian hierarchical model, and maximum likelihood parameter estimates. We evaluate how well each model can approximate the failure properties of individual components, and of the system overall. Finally, we define an upgrade policy for achieving targeted reductions in risk exposure, and compare the magnitude of upgrades recommended by each model. △ Less

Submitted 21 January, 2020; originally announced January 2020.

On Wind Speed Sensor Configurations and Altitude Control in Airborne Wind Energy Systems

Authors: Laurel N. Dunn, Christopher Vermillion, Fotini K. Chow, Scott J. Moura

Abstract: Real-time altitude control of airborne wind energy (AWE) systems can improve performance by allowing turbines to track favorable wind speeds across a range of operating altitudes. The current work explores the performance implications of deploying an AWE system with sensor configurations that provide different amounts of data to characterize wind speed profiles. We examine various control objectiv… ▽ More Real-time altitude control of airborne wind energy (AWE) systems can improve performance by allowing turbines to track favorable wind speeds across a range of operating altitudes. The current work explores the performance implications of deploying an AWE system with sensor configurations that provide different amounts of data to characterize wind speed profiles. We examine various control objectives that balance trade-offs between exploration and exploitation, and use a persistence model to generate a probabilistic wind speed forecast to inform control decisions. We assess system performance by comparing power production against baselines such as omniscient control and stationary flight. We show that with few sensors, control strategies that reward exploration are favored. We also show that with comprehensive sensing, the implications of choosing a sub-optimal control strategy decrease. This work informs and motivates the need for future research exploring online learning algorithms to characterize vertical wind speed profiles. △ Less

Submitted 21 January, 2020; originally announced January 2020.

Journal ref: 2019 American Controls Conference

Hopfield Neural Network Flow: A Geometric Viewpoint

Authors: Abhishek Halder, Kenneth F. Caluya, Bertrand Travacca, Scott J. Moura

Abstract: We provide gradient flow interpretations for the continuous-time continuous-state Hopfield neural network (HNN). The ordinary and stochastic differential equations associated with the HNN were introduced in the literature as analog optimizers, and were reported to exhibit good performance in numerical experiments. In this work, we point out that the deterministic HNN can be transcribed into Amari'… ▽ More We provide gradient flow interpretations for the continuous-time continuous-state Hopfield neural network (HNN). The ordinary and stochastic differential equations associated with the HNN were introduced in the literature as analog optimizers, and were reported to exhibit good performance in numerical experiments. In this work, we point out that the deterministic HNN can be transcribed into Amari's natural gradient descent, and thereby uncover the explicit relation between the underlying Riemannian metric and the activation functions. By exploiting an equivalence between the natural gradient descent and the mirror descent, we show how the choice of activation function governs the geometry of the HNN dynamics. For the stochastic HNN, we show that the so-called "diffusion machine", while not a gradient flow itself, induces a gradient flow when lifted in the space of probability measures. We characterize this infinite dimensional flow as the gradient descent of certain free energy with respect to a Wasserstein metric that depends on the geodesic distance on the ground manifold. Furthermore, we demonstrate how this gradient flow interpretation can be used for fast computation via recently developed proximal algorithms. △ Less

Submitted 13 November, 2019; v1 submitted 4 August, 2019; originally announced August 2019.

Joint Fleet Sizing and Charging System Planning for Autonomous Electric Vehicles

Authors: Hongcai Zhang, Colin J. R. Sheppard, Timothy E. Lipman, Scott J. Moura

Abstract: This paper studies the joint fleet sizing and charging system planning problem for a company operating a fleet of autonomous electric vehicles (AEVs) for passenger and goods transportation. Most of the relevant published papers focus on intracity scenarios and adopt heuristic approaches, e.g., agent based simulation, which do not guarantee optimality. In contrast, we propose a mixed integer linear… ▽ More This paper studies the joint fleet sizing and charging system planning problem for a company operating a fleet of autonomous electric vehicles (AEVs) for passenger and goods transportation. Most of the relevant published papers focus on intracity scenarios and adopt heuristic approaches, e.g., agent based simulation, which do not guarantee optimality. In contrast, we propose a mixed integer linear programming model for intercity scenarios. This model incorporates comprehensive considerations of 1) limited AEV driving range; 2) optimal AEV routing and relocating operations; 3) time-varying origin-destination transport demands; and 4) differentiated operation cost structure of passenger and goods transportation. The proposed model can be computational expensive when the scale of the transportation network is large. We then exploit the structure of this program to expedite its solution. Numerical experiments are conducted to validate the proposed method. Our experimental results show that AEVs in passenger and goods transportation have remarkable planning and operation differences. We also demonstrate that intelligent routing and relocating operations, charging system and vehicle parameters, e.g., charging power, battery capacity, driving speed etc., can significantly affect the economic efficiency and the planning results of an AEV fleet. △ Less

Submitted 1 November, 2018; originally announced November 2018.

Data-driven Chance-constrained Regulation Capacity Offering for Distributed Energy Resources

Authors: Hongcai Zhang, Zechun Hu, Eric Munsing, Scott J. Moura, Yonghua Song

Abstract: This paper studies the behavior of a strategic aggregator offering regulation capacity on behalf of a group of distributed energy resources (DERs, e.g. plug-in electric vehicles) in a power market. Our objective is to maximize the aggregator's revenue while controlling the risk of penalties due to poor service delivery. To achieve this goal, we propose data-driven risk-averse strategies to effecti… ▽ More This paper studies the behavior of a strategic aggregator offering regulation capacity on behalf of a group of distributed energy resources (DERs, e.g. plug-in electric vehicles) in a power market. Our objective is to maximize the aggregator's revenue while controlling the risk of penalties due to poor service delivery. To achieve this goal, we propose data-driven risk-averse strategies to effectively handle uncertainties in: 1) The DER parameters (e.g., load demands and flexibilities) and 2) sub-hourly regulation signals (to the accuracy of every few seconds). We design both the day-ahead and the hour-ahead strategies. In the day-ahead model, we develop a two-stage stochastic program to roughly model the above uncertainties, which achieves computational efficiency by leveraging novel aggregate models of both DER parameters and sub-hourly regulation signals. In the hour-ahead model, we formulate a data-driven distributionally robust chance-constrained program to explicitly model the aforementioned uncertainties. This program can effectively control the quality of regulation service based on the aggregator's risk aversion. Furthermore, it learns the distributions of the uncertain parameters from empirical data so that it outperforms existing techniques, (e.g. robust optimization or traditional chance-constrained programming) in both modelling accuracy and cost of robustness. Finally, we derive a conic safe approximation for it which can be efficiently solved by commercial solvers. Numerical experiments are conducted to validate the proposed method. △ Less

Submitted 16 August, 2017; originally announced August 2017.

Joint Planning of PEV Fast-Charging Network and Distributed PV Generation Using the Accelerated Generalized Benders Decomposition

Authors: Hongcai Zhang, Scott J. Moura, Zechun Hu, Wei Qi, Yonghua Song

Abstract: Integration of plug-in electric vehicles (PEVs) with distributed renewable resources will decrease PEVs' well-to-wheels greenhouse gas emissions, promote renewable power adoption and defer power system investments. This paper proposes a multidisciplinary approach to jointly planning PEV fast-charging stations and distributed photovoltaic (PV) power plants on coupled transportation and power networ… ▽ More Integration of plug-in electric vehicles (PEVs) with distributed renewable resources will decrease PEVs' well-to-wheels greenhouse gas emissions, promote renewable power adoption and defer power system investments. This paper proposes a multidisciplinary approach to jointly planning PEV fast-charging stations and distributed photovoltaic (PV) power plants on coupled transportation and power networks. First, we develop models of 1) PEV fast-charging stations; 2) highway transportation networks under PEV driving range constraints; 3) PV power plants with reactive power control. Then, we formulate a two-stage stochastic mixed integer second order cone program (MISOCP) to determine the sites and sizes of 1) PEV fast-charging stations; 2) PV power plants. To address the uncertainty of future scenarios, a significant number of future typical load, traffic flow and PV generation curves are adopted. This makes the problem large scale. We design a Generalized Benders Decomposition Algorithm to efficiently solve it. To the authors' knowledge, this work is the first that jointly plans both PEV fast-charging stations and PV plants with consideration for PEV driving range limits and reactive PV power control. We conduct numerical experiments to illustrate the effectiveness of the proposed method, and validate the benefits of the joint planning and adopting advanced PV reactive power control. △ Less

Submitted 14 March, 2017; v1 submitted 23 February, 2017; originally announced February 2017.