-
Lithium-Ion Battery System Health Monitoring and Fault Analysis from Field Data Using Gaussian Processes
Authors:
Joachim Schaeffer,
Eric Lenz,
Duncan Gulla,
Martin Z. Bazant,
Richard D. Braatz,
Rolf Findeisen
Abstract:
Health monitoring, fault analysis, and detection are critical for the safe and sustainable operation of battery systems. We apply Gaussian process resistance models on lithium iron phosphate battery field data to effectively separate the time-dependent and operating point-dependent resistance. The data set contains 29 battery systems returned to the manufacturer for warranty, each with eight cells…
▽ More
Health monitoring, fault analysis, and detection are critical for the safe and sustainable operation of battery systems. We apply Gaussian process resistance models on lithium iron phosphate battery field data to effectively separate the time-dependent and operating point-dependent resistance. The data set contains 29 battery systems returned to the manufacturer for warranty, each with eight cells in series, totaling 232 cells and 131 million data rows. We develop probabilistic fault detection rules using recursive spatiotemporal Gaussian processes. These processes allow the quick processing of over a million data points, enabling advanced online monitoring and furthering the understanding of battery pack failure in the field. The analysis underlines that often, only a single cell shows abnormal behavior or a knee point, consistent with weakest-link failure for cells connected in series, amplified by local resistive heating. The results further the understanding of how batteries degrade and fail in the field and demonstrate the potential of efficient online monitoring based on data. We open-source the code and publish the large data set upon completion of the review of this article.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
Polynomial Chaos-based Stochastic Model Predictive Control: An Overview and Future Research Directions
Authors:
Prabhat K. Mishra,
Joel A. Paulson,
Richard D. Braatz
Abstract:
This article is devoted to providing a review of mathematical formulations in which Polynomial Chaos Theory (PCT) has been incorporated into stochastic model predictive control (SMPC). In the past decade, PCT has been shown to provide a computationally tractable way to perform complete and accurate uncertainty propagation through (smooth) nonlinear dynamic systems. As such, it represents a very us…
▽ More
This article is devoted to providing a review of mathematical formulations in which Polynomial Chaos Theory (PCT) has been incorporated into stochastic model predictive control (SMPC). In the past decade, PCT has been shown to provide a computationally tractable way to perform complete and accurate uncertainty propagation through (smooth) nonlinear dynamic systems. As such, it represents a very useful computational tool for accelerating the computations needed in SMPC with time invariant uncertainties. It turns out that it can also be used to reduce complexity of chance constraints, which are an important component of SMPC. In this paper, we provide an overview of PCT and discuss how it can be applied in such time invariant settings.
△ Less
Submitted 15 June, 2024;
originally announced June 2024.
-
Accounting for the Effects of Probabilistic Uncertainty During Fast Charging of Lithium-ion Batteries
Authors:
Minsu Kim,
Joachim Schaeffer,
Marc D. Berliner,
Berta Pedret Sagnier,
Rolf Findeisen,
Richard D. Braatz
Abstract:
Batteries are nonlinear dynamical systems that can be modeled by Porous Electrode Theory models. The aim of optimal fast charging is to reduce the charging time while kee** battery degradation low. Most past studies assume that model parameters and ambient temperature are a fixed known value and that all PET model parameters are perfectly known. In real battery operation, however, the ambient te…
▽ More
Batteries are nonlinear dynamical systems that can be modeled by Porous Electrode Theory models. The aim of optimal fast charging is to reduce the charging time while kee** battery degradation low. Most past studies assume that model parameters and ambient temperature are a fixed known value and that all PET model parameters are perfectly known. In real battery operation, however, the ambient temperature and the model parameters are uncertain. To ensure that operational constraints are satisfied at all times in the context of model-based optimal control, uncertainty quantification is required. Here, we analyze optimal fast charging for modest uncertainty in the ambient temperature and 23 model parameters. Uncertainty quantification of the battery model is carried out using non-intrusive polynomial chaos expansion and the results are verified with Monte Carlo simulations. The method is investigated for a constant current--constant voltage charging strategy for a battery for which the strategy is known to be standard for fast charging subject to operating below maximum current and charging constraints. Our results demonstrate that uncertainty in ambient temperature results in violations of constraints on the voltage and temperature. Our results identify a subset of key parameters that contribute to fast charging among the overall uncertain parameters. Additionally, it is shown that the constraints represented by voltage, temperature, and lithium-plating overpotential are violated due to uncertainties in the ambient temperature and parameters. The C-rate and charge constraints are then adjusted so that the probability of violating the degradation acceleration condition is below a pre-specified value. This approach demonstrates a computationally efficient approach for determining fast-charging protocols that take probabilistic uncertainties into account.
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
Learning Model Predictive Control Parameters via Bayesian Optimization for Battery Fast Charging
Authors:
Sebastian Hirt,
Andreas Höhl,
Joachim Schaeffer,
Johannes Pohlodek,
Richard D. Braatz,
Rolf Findeisen
Abstract:
Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may stem from factors like substantial model-plant differences, limited prediction horizons that do not cover the entire time of interest, or unforeseen system distu…
▽ More
Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may stem from factors like substantial model-plant differences, limited prediction horizons that do not cover the entire time of interest, or unforeseen system disturbances. Such mismatches can jeopardize both performance and safety, including constraint satisfaction. Traditional methods address this issue by modifying the finite horizon cost function to better reflect the overall operational cost, learning parts of the prediction model from data, or implementing robust MPC strategies, which might be either computationally intensive or overly cautious. As an alternative, directly optimizing or learning the controller parameters to enhance closed-loop performance has been proposed. We apply Bayesian optimization for efficient learning of unknown model parameters and parameterized constraint backoff terms, aiming to improve closed-loop performance of battery fast charging. This approach establishes a hierarchical control framework where Bayesian optimization directly fine-tunes closed-loop behavior towards a global and long-term objective, while MPC handles lower-level, short-term control tasks. For lithium-ion battery fast charging, we show that the learning approach not only ensures safe operation but also maximizes closed-loop performance. This includes maintaining the battery's operation below its maximum terminal voltage and reducing charging times, all achieved using a standard nominal MPC model with a short horizon and notable initial model-plant mismatch.
△ Less
Submitted 9 April, 2024;
originally announced April 2024.
-
Cycle Life Prediction for Lithium-ion Batteries: Machine Learning and More
Authors:
Joachim Schaeffer,
Giacomo Galuppini,
**wook Rhyu,
Patrick A. Asinger,
Robin Droop,
Rolf Findeisen,
Richard D. Braatz
Abstract:
Batteries are dynamic systems with complicated nonlinear aging, highly dependent on cell design, chemistry, manufacturing, and operational conditions. Prediction of battery cycle life and estimation of aging states is important to accelerate battery R&D, testing, and to further the understanding of how batteries degrade. Beyond testing, battery management systems rely on real-time models and onboa…
▽ More
Batteries are dynamic systems with complicated nonlinear aging, highly dependent on cell design, chemistry, manufacturing, and operational conditions. Prediction of battery cycle life and estimation of aging states is important to accelerate battery R&D, testing, and to further the understanding of how batteries degrade. Beyond testing, battery management systems rely on real-time models and onboard diagnostics and prognostics for safe operation. Estimating the state of health and remaining useful life of a battery is important to optimize performance and use resources optimally.
This tutorial begins with an overview of first-principles, machine learning, and hybrid battery models. Then, a typical pipeline for the development of interpretable machine learning models is explained and showcased for cycle life prediction from laboratory testing data. We highlight the challenges of machine learning models, motivating the incorporation of physics in hybrid modeling approaches, which are needed to decipher the aging trajectory of batteries but require more data and further work on the physics of battery degradation. The tutorial closes with a discussion on generalization and further research directions.
△ Less
Submitted 5 April, 2024;
originally announced April 2024.
-
An Execution-time-certified QP Algorithm for $\ell_1$ penalty-based Soft-constrained MPC
Authors:
Liang Wu,
Richard D. Braatz
Abstract:
Providing an execution time certificate and handling possible infeasibility in closed-loop are two pressing requirements of Model Predictive Control (MPC). To simultaneously meet these two requirements, this paper uses an $\ell_1$ penalty-based soft-constrained MPC formulation and innovatively transforms the resulting non-smooth QP into a box-constrained QP, which is solved by our previously propo…
▽ More
Providing an execution time certificate and handling possible infeasibility in closed-loop are two pressing requirements of Model Predictive Control (MPC). To simultaneously meet these two requirements, this paper uses an $\ell_1$ penalty-based soft-constrained MPC formulation and innovatively transforms the resulting non-smooth QP into a box-constrained QP, which is solved by our previously proposed direct and execution-time certified algorithm with only dimension-dependent (data-independent), simple-calculated and exact number of iterations (Wu and Braatz (2023)). This approach not only overcomes the limitation of our previously proposed algorithm (Wu and Braatz (2023)), only applicable to input-constrained MPC, but also enjoys exact recovery feature (exactly recover the same solution when the original problem is feasible) of $\ell_1$ penalty-based soft-constrained MPC formulation without suffering numerical difficulty of the resulting non-smoothness. Other various real-time QP applications, not limited to MPC, would also benefit from our QP algorithm with execution-time certificate and global feasibility.
△ Less
Submitted 8 April, 2024; v1 submitted 26 March, 2024;
originally announced March 2024.
-
LCEN: A Novel Feature Selection Algorithm for Nonlinear, Interpretable Machine Learning Models
Authors:
Pedro Seber,
Richard D. Braatz
Abstract:
Interpretable architectures can have advantages over black-box architectures, and interpretability is essential for the application of machine learning in critical settings, such as aviation or medicine. However, the simplest, most commonly used interpretable architectures, such as LASSO or elastic net (EN), are limited to linear predictions and have poor feature selection capabilities. In this wo…
▽ More
Interpretable architectures can have advantages over black-box architectures, and interpretability is essential for the application of machine learning in critical settings, such as aviation or medicine. However, the simplest, most commonly used interpretable architectures, such as LASSO or elastic net (EN), are limited to linear predictions and have poor feature selection capabilities. In this work, we introduce the LASSO-Clip-EN (LCEN) algorithm for the creation of nonlinear, interpretable machine learning models. LCEN is tested on a wide variety of artificial and empirical datasets, frequently creating more accurate, sparser models than other architectures, including those for building sparse, nonlinear models. LCEN is robust against many issues typically present in datasets and modeling, including noise, multicollinearity, data scarcity, and hyperparameter variance. LCEN is also able to rediscover multiple physical laws from empirical data and, for processes with no known physical laws, LCEN achieves better results than many other dense and sparse methods -- including using 10.8-fold fewer features than dense methods and 8.1-fold fewer features than EN on one dataset, and is comparable to or better than ANNs on multiple datasets.
△ Less
Submitted 5 June, 2024; v1 submitted 26 February, 2024;
originally announced February 2024.
-
An Execution-time-certified Riccati-based IPM Algorithm for RTI-based Input-constrained NMPC
Authors:
Liang Wu,
Krystian Ganko,
Shimin Wang,
Richard D. Braatz
Abstract:
Establishing an execution time certificate in deploying model predictive control (MPC) is a pressing and challenging requirement. As nonlinear MPC (NMPC) results in nonlinear programs, differing from quadratic programs encountered in linear MPC, deriving an execution time certificate for NMPC seems an impossible task. Our prior work \cite{wu2023direct} introduced an input-constrained MPC algorithm…
▽ More
Establishing an execution time certificate in deploying model predictive control (MPC) is a pressing and challenging requirement. As nonlinear MPC (NMPC) results in nonlinear programs, differing from quadratic programs encountered in linear MPC, deriving an execution time certificate for NMPC seems an impossible task. Our prior work \cite{wu2023direct} introduced an input-constrained MPC algorithm with the exact and only \textit{dimension-dependent} (\textit{data-independent}) number of floating-point operations ([flops]). This paper extends it to input-constrained NMPC problems via the real-time iteration (RTI) scheme, which results in \textit{data-varying} (but \textit{dimension-invariant}) input-constrained MPC problems. Therefore, applying our previous algorithm can certify the execution time based on the assumption that processors perform fixed [flops] in constant time. As the RTI-based scheme generally results in MPC with a long prediction horizon, this paper employs the efficient factorized Riccati recursion, whose computational cost scales linearly with the prediction horizon, to solve the Newton system at each iteration. The execution-time certified capability of the algorithm is theoretically and numerically validated through a case study involving nonlinear control of the chaotic Lorenz system.
△ Less
Submitted 25 February, 2024;
originally announced February 2024.
-
Nonparametric Steady-state Learning for Robust Output Regulation of Nonlinear Output Feedback Systems
Authors:
Shimin Wang,
Martin Guay,
Richard D. Braatz
Abstract:
This article addresses the nonadaptive and robust output regulation problem of the general nonlinear output feedback system with error output. The global robust output regulation problem for a class of general output feedback nonlinear systems with an uncertain exosystem and high relative degree can be tackled by constructing a linear generic internal model provided that a continuous nonlinear map…
▽ More
This article addresses the nonadaptive and robust output regulation problem of the general nonlinear output feedback system with error output. The global robust output regulation problem for a class of general output feedback nonlinear systems with an uncertain exosystem and high relative degree can be tackled by constructing a linear generic internal model provided that a continuous nonlinear map** exists. Leveraging the presented nonadaptive framework facilitates the conversion of the nonlinear robust output regulation problem into a robust nonadaptive stabilization endeavour for the augmented system endowed with Input-to-State Stable dynamics, removing the need for constructing a specific Lyapunov function with positive semidefinite derivatives. To ensure the feasibility of the nonlinear map**, the approach is extended by incorporating the nonparametric learning framework. Moreover, the introduced nonparametric learning framework provides the ability to learn the dynamics of the steady-state/input behaviour from the signal generated from the internal model only using the output error feedback. As a result, the nonadaptive/nonparametric approach can be advantageous by guaranteeing convergence of the estimation and tracking error even when the underlying controlled system dynamics are complex or poorly understood. The effectiveness of the theoretical results is illustrated for a controlled duffing system and a continuously stirred tank reactor
△ Less
Submitted 25 February, 2024;
originally announced February 2024.
-
Physics-based Modeling of Pulse and Relaxation of High-rate Li/CF$_{x}$-SVO batteries in Implantable Medical Devices
Authors:
Qiaohao Liang,
Giacomo Galuppini,
Partha M. Gomadam,
Prabhakar A. Tamirisa,
Jeffrey A. Lemmerman,
Michael J. M. Mazack,
Melani G. Sullivan,
Richard D. Braatz,
Martin Z. Bazant
Abstract:
We present a physics-based model that accurately predicts the performance of Medtronic's implantable medical device battery lithium/carbon monofluoride (CF$_x$) - silver vanadium oxide (SVO) under both low-rate background monitoring and high-rate pulsing currents. The distinct properties of multiple active materials are reflected by parameterizing their thermodynamics, kinetics, and mass transport…
▽ More
We present a physics-based model that accurately predicts the performance of Medtronic's implantable medical device battery lithium/carbon monofluoride (CF$_x$) - silver vanadium oxide (SVO) under both low-rate background monitoring and high-rate pulsing currents. The distinct properties of multiple active materials are reflected by parameterizing their thermodynamics, kinetics, and mass transport properties separately. Diffusion limitations of Li$^+$ in SVO are used to explain cell voltage transient behavior during pulse and post-pulse relaxation. We also introduce change in cathode electronic conductivity, Li metal anode surface morphology, and film resistance buildup to capture evolution of cell internal resistance throughout multi-year electrical tests. We share our insights on how the Li$^+$ redistribution process between active materials can restore pulse capability of the hybrid electrode, allow CF$_x$ to indirectly contribute to capacity release during pulsing, and affect the operation protocols and design principles of batteries with other hybrid electrodes. We also discuss additional complexities in porous electrode model parameterization and electrochemical characterization techniques due to parallel reactions and solid diffusion pathways across active materials. We hope our models implemented in the Hybrid Multiphase Porous Electrode Theory (Hybrid-MPET) framework can complement future experimental research and accelerate development of multi-active material electrodes with targeted performance.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Time-certified Input-constrained NMPC via Koopman Operator
Authors:
Liang Wu,
Krystian Ganko,
Richard D. Braatz
Abstract:
Determining solving-time certificates of nonlinear model predictive control (NMPC) implementations is a pressing requirement when deploying NMPC in production environments. Such a certificate guarantees that the NMPC controller returns a solution before the next sampling time. However, NMPC formulations produce nonlinear programs (NLPs) for which it is very difficult to derive their solving-time c…
▽ More
Determining solving-time certificates of nonlinear model predictive control (NMPC) implementations is a pressing requirement when deploying NMPC in production environments. Such a certificate guarantees that the NMPC controller returns a solution before the next sampling time. However, NMPC formulations produce nonlinear programs (NLPs) for which it is very difficult to derive their solving-time certificates. Our previous work, Wu and Braatz (2023), challenged this limitation with a proposed input-constrained MPC algorithm having exact iteration complexity but was restricted to linear MPC formulations. This work extends the algorithm to solve input-constrained NMPC problems, by using the Koopman operator and a condensing MPC technique. We illustrate the algorithm performance on a high-dimensional, nonlinear partial differential equation (PDE) control case study, in which we theoretically and numerically certify the solving time to be less than the sampling time.
△ Less
Submitted 26 February, 2024; v1 submitted 9 January, 2024;
originally announced January 2024.
-
A nonparametric learning framework for nonlinear robust output regulation
Authors:
Shimin Wang,
Martin Guay,
Zhiyong Chen,
Richard D. Braatz
Abstract:
A nonparametric learning solution framework is proposed for the global nonlinear robust output regulation problem. We first extend the assumption that the steady-state generator is linear in the exogenous signal to the more relaxed assumption that it is polynomial in the exogenous signal. Additionally, a nonparametric learning framework is proposed to eliminate the construction of an explicit regr…
▽ More
A nonparametric learning solution framework is proposed for the global nonlinear robust output regulation problem. We first extend the assumption that the steady-state generator is linear in the exogenous signal to the more relaxed assumption that it is polynomial in the exogenous signal. Additionally, a nonparametric learning framework is proposed to eliminate the construction of an explicit regressor, as required in the adaptive method, which can potentially simplify the implementation and reduce the computational complexity of existing methods. With the help of the proposed framework, the robust nonlinear output regulation problem can be converted into a robust non-adaptive stabilization problem for the augmented system with integral input-to-state stable (iISS) inverse dynamics. Moreover, a dynamic gain approach can adaptively raise the gain to a sufficiently large constant to achieve stabilization without requiring any a priori knowledge of the uncertainties appearing in the dynamics of the exosystem and the system. Furthermore, we apply the nonparametric learning framework to globally reconstruct and estimate multiple sinusoidal signals with unknown frequencies without the need for adaptive parametric techniques. An explicit nonlinear map** can directly provide the estimated parameters, which will exponentially converge to the unknown frequencies. Finally, a feedforward control design is proposed to solve the linear output regulation problem using the nonparametric learning framework. Two simulation examples are provided to illustrate the effectiveness of the theoretical results.
△ Less
Submitted 18 June, 2024; v1 submitted 25 September, 2023;
originally announced September 2023.
-
Interpretation of High-Dimensional Linear Regression: Effects of Nullspace and Regularization Demonstrated on Battery Data
Authors:
Joachim Schaeffer,
Eric Lenz,
William C. Chueh,
Martin Z. Bazant,
Rolf Findeisen,
Richard D. Braatz
Abstract:
High-dimensional linear regression is important in many scientific fields. This article considers discrete measured data of underlying smooth latent processes, as is often obtained from chemical or biological systems. Interpretation in high dimensions is challenging because the nullspace and its interplay with regularization shapes regression coefficients. The data's nullspace contains all coeffic…
▽ More
High-dimensional linear regression is important in many scientific fields. This article considers discrete measured data of underlying smooth latent processes, as is often obtained from chemical or biological systems. Interpretation in high dimensions is challenging because the nullspace and its interplay with regularization shapes regression coefficients. The data's nullspace contains all coefficients that satisfy $\mathbf{Xw}=\mathbf{0}$, thus allowing very different coefficients to yield identical predictions. We developed an optimization formulation to compare regression coefficients and coefficients obtained by physical engineering knowledge to understand which part of the coefficient differences are close to the nullspace. This nullspace method is tested on a synthetic example and lithium-ion battery data. The case studies show that regularization and z-scoring are design choices that, if chosen corresponding to prior physical knowledge, lead to interpretable regression results. Otherwise, the combination of the nullspace and regularization hinders interpretability and can make it impossible to obtain regression coefficients close to the true coefficients when there is a true underlying linear model. Furthermore, we demonstrate that regression methods that do not produce coefficients orthogonal to the nullspace, such as fused lasso, can improve interpretability. In conclusion, the insights gained from the nullspace perspective help to make informed design choices for building regression models on high-dimensional data and reasoning about potential underlying linear models, which are important for system optimization and improving scientific understanding.
△ Less
Submitted 6 September, 2023; v1 submitted 1 September, 2023;
originally announced September 2023.
-
Mechanistic Modeling and Analysis of Thermal Radiation in Conventional, Microwave-assisted, and Hybrid Freeze Drying for Biopharmaceutical Manufacturing
Authors:
Prakitr Srisuma,
George Barbastathis,
Richard D. Braatz
Abstract:
In freeze drying, thermal radiation has a significant effect on the drying process of vials located near the corner and edge of the trays, resulting in non-uniformity of the products. Understanding and being able to predict the impact of thermal radiation are therefore critical to accurate determination of the drying process endpoint given the variation in heat transfer of each vial. This article…
▽ More
In freeze drying, thermal radiation has a significant effect on the drying process of vials located near the corner and edge of the trays, resulting in non-uniformity of the products. Understanding and being able to predict the impact of thermal radiation are therefore critical to accurate determination of the drying process endpoint given the variation in heat transfer of each vial. This article presents a new mechanistic model that describes complex thermal radiation during primary drying in conventional, microwave-assisted, and hybrid freeze drying. Modeling of thermal radiation employs the diffuse gray surface model and radiation network approach, which systematically and accurately incorporates simultaneous radiation exchange between every surface including the chamber wall and vials, allowing the framework to be seamlessly applied for analyzing various freeze-dryer designs. Model validation with data from the literature shows accurate prediction of the drying times for all vials, including inner, edge, and corner vials. The validated model is demonstrated for thermal radiation analysis and parametric studies to guide the design and optimization of freeze dryers.
△ Less
Submitted 26 September, 2023; v1 submitted 3 August, 2023;
originally announced August 2023.
-
Dynamics and Control of Oscillatory Bioreactors
Authors:
Pavan Inguva,
Krystian Ganko,
Alexis B. Dubs,
Richard D. Braatz
Abstract:
Bioreactors are widely used in many industries to generate a range of products using various host cells e.g., yeast, insect, and mammalian cells. Depending on the process, product, and host cell, some bioreactors exhibit sustained periodic behavior in key process variables such as metabolite concentrations, biomass, and product titer. Such dynamical behavior can arise from different mechanisms, in…
▽ More
Bioreactors are widely used in many industries to generate a range of products using various host cells e.g., yeast, insect, and mammalian cells. Depending on the process, product, and host cell, some bioreactors exhibit sustained periodic behavior in key process variables such as metabolite concentrations, biomass, and product titer. Such dynamical behavior can arise from different mechanisms, including predator-prey dynamics, substrate inhibition, and cell sub-population synchrony. Oscillatory dynamical behavior is undesirable as it can impact downstream processes, especially in a continuous operation, and can make process operations and product quality control more challenging. This article provides an overview of oscillatory dynamics. The mechanisms that give rise to the oscillations and process control strategies for suppressing the oscillations are discussed, while providing insights that go beyond past studies. Alternative process configurations are proposed for bypassing the mechanisms that generate oscillations.
△ Less
Submitted 27 June, 2023;
originally announced June 2023.
-
A direct optimization algorithm for input-constrained MPC
Authors:
Liang Wu,
Richard D. Braatz
Abstract:
Providing an execution time certificate is a pressing requirement when deploying Model Predictive Control (MPC) in real-time embedded systems such as microcontrollers. Real-time MPC requires that its worst-case (maximum) execution time must be theoretically guaranteed to be smaller than the sampling time in closed-loop. This technical note considers input-constrained MPC problems and exploits the…
▽ More
Providing an execution time certificate is a pressing requirement when deploying Model Predictive Control (MPC) in real-time embedded systems such as microcontrollers. Real-time MPC requires that its worst-case (maximum) execution time must be theoretically guaranteed to be smaller than the sampling time in closed-loop. This technical note considers input-constrained MPC problems and exploits the structure of the resulting box-constrained QPs. Then, we propose a \textit{cost-free} and \textit{data-independent} initialization strategy, which enables us, for the first time, to remove the initialization assumption of feasible full-Newton interior-point algorithms. We prove that the number of iterations of our proposed algorithm is \textit{only dimension-dependent} (\textit{data-independent}), \textit{simple-calculated}, and \textit{exact} (not \textit{worst-case}) with the value $\left\lceil\frac{\log(\frac{2n}ε)}{-2\log(\frac{\sqrt{2n}}{\sqrt{2n}+\sqrt{2}-1})}\right\rceil \!+ 1$, where $n$ denotes the problem dimension and $ε$ denotes the constant stop** tolerance. These features enable our algorithm to trivially certify the execution time of nonlinear MPC (via online linearized schemes) or adaptive MPC problems. The execution-time-certified capability of our algorithm is theoretically and numerically validated through an open-loop unstable AFTI-16 example.
△ Less
Submitted 30 March, 2024; v1 submitted 26 June, 2023;
originally announced June 2023.
-
Automated Translation and Accelerated Solving of Differential Equations on Multiple GPU Platforms
Authors:
Utkarsh Utkarsh,
Valentin Churavy,
Yingbo Ma,
Tim Besard,
Prakitr Srisuma,
Tim Gymnich,
Adam R. Gerlach,
Alan Edelman,
George Barbastathis,
Richard D. Braatz,
Christopher Rackauckas
Abstract:
We demonstrate a high-performance vendor-agnostic method for massively parallel solving of ensembles of ordinary differential equations (ODEs) and stochastic differential equations (SDEs) on GPUs. The method is integrated with a widely used differential equation solver library in a high-level language (Julia's DifferentialEquations.jl) and enables GPU acceleration without requiring code changes by…
▽ More
We demonstrate a high-performance vendor-agnostic method for massively parallel solving of ensembles of ordinary differential equations (ODEs) and stochastic differential equations (SDEs) on GPUs. The method is integrated with a widely used differential equation solver library in a high-level language (Julia's DifferentialEquations.jl) and enables GPU acceleration without requiring code changes by the user. Our approach achieves state-of-the-art performance compared to hand-optimized CUDA-C++ kernels while performing 20--100$\times$ faster than the vectorizing map (vmap) approach implemented in JAX and PyTorch. Performance evaluation on NVIDIA, AMD, Intel, and Apple GPUs demonstrates performance portability and vendor-agnosticism. We show composability with MPI to enable distributed multi-GPU workflows. The implemented solvers are fully featured -- supporting event handling, automatic differentiation, and incorporation of datasets via the GPU's texture memory -- allowing scientists to take advantage of GPU acceleration on all major current architectures without changing their model code and without loss of performance. We distribute the software as an open-source library https://github.com/SciML/DiffEqGPU.jl
△ Less
Submitted 13 November, 2023; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Machine Learning Benchmarks for the Classification of Equivalent Circuit Models from Electrochemical Impedance Spectra
Authors:
Joachim Schaeffer,
Paul Gasper,
Esteban Garcia-Tamayo,
Raymond Gasper,
Masaki Adachi,
Juan Pablo Gaviria-Cardona,
Simon Montoya-Bedoya,
Anoushka Bhutani,
Andrew Schiek,
Rhys Goodall,
Rolf Findeisen,
Richard D. Braatz,
Simon Engelke
Abstract:
Analysis of Electrochemical Impedance Spectroscopy (EIS) data for electrochemical systems often consists of defining an Equivalent Circuit Model (ECM) using expert knowledge and then optimizing the model parameters to deconvolute various resistance, capacitive, inductive, or diffusion responses. For small data sets, this procedure can be conducted manually; however, it is not feasible to manually…
▽ More
Analysis of Electrochemical Impedance Spectroscopy (EIS) data for electrochemical systems often consists of defining an Equivalent Circuit Model (ECM) using expert knowledge and then optimizing the model parameters to deconvolute various resistance, capacitive, inductive, or diffusion responses. For small data sets, this procedure can be conducted manually; however, it is not feasible to manually define a proper ECM for extensive data sets with a wide range of EIS responses. Automatic identification of an ECM would substantially accelerate the analysis of large sets of EIS data. We showcase machine learning methods to classify the ECMs of 9,300 impedance spectra provided by QuantumScape for the BatteryDEV hackathon. The best-performing approach is a gradient-boosted tree model utilizing a library to automatically generate features, followed by a random forest model using the raw spectral data. A convolutional neural network using boolean images of Nyquist representations is presented as an alternative, although it achieves a lower accuracy. We publish the data and open source the associated code. The approaches described in this article can serve as benchmarks for further studies. A key remaining challenge is the identifiability of the labels, underlined by the model performances and the comparison of misclassified spectra.
△ Less
Submitted 4 May, 2023; v1 submitted 7 February, 2023;
originally announced February 2023.
-
Efficient Numerical Schemes for Multidimensional Population Balance Models
Authors:
Pavan Inguva,
Richard D. Braatz
Abstract:
Multidimensional population balance models (PBMs) describe chemical and biological processes having a distribution over two or more intrinsic properties (such as size and age, or two independent spatial variables). The incorporation of additional intrinsic variables into a PBM improves its descriptive capability and can be necessary to capture specific features of interest. As most PBMs of interes…
▽ More
Multidimensional population balance models (PBMs) describe chemical and biological processes having a distribution over two or more intrinsic properties (such as size and age, or two independent spatial variables). The incorporation of additional intrinsic variables into a PBM improves its descriptive capability and can be necessary to capture specific features of interest. As most PBMs of interest cannot be solved analytically, computationally expensive high-order finite difference or finite volume methods are frequently used to obtain an accurate numerical solution. We propose a finite difference scheme based on operator splitting and solving each sub-problem at the limit of numerical stability that achieves a discretization error that is zero for certain classes of PBMs and low enough to be acceptable for other classes. In conjunction to employing specially constructed meshes and variable transformations, the scheme exploits the commutative property of the differential operators present in many classes of PBMs. The scheme has very low computational cost -- potentially as low as just memory reallocation. Multiple case studies demonstrate the performance of the proposed scheme.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Extracting particle size distribution from laser speckle with a physics-enhanced autocorrelation-based estimator (PEACE)
Authors:
Qihang Zhang,
Janaka C. Gamekkanda,
A**kya Pandit,
Wenlong Tang,
Charles Papageorgiou,
Chris Mitchell,
Yihui Yang,
Michael Schwaerzler,
Tolutola Oyetunde,
Richard D. Braatz,
Allan S. Myerson,
George Barbastathis
Abstract:
Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A…
▽ More
Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A non-invasive and real-time monitoring probe in the drying process is required, but there is no suitable candidate for this purpose. In this report, we develop a theoretical relationship from the PSD to the speckle image and describe a physics-enhanced autocorrelation-based estimator (PEACE) machine learning algorithm for speckle analysis to measure the PSD of a powder surface. This method solves both the forward and inverse problems together and enjoys increased interpretability, since the machine learning approximator is regularized by the physical law.
△ Less
Submitted 2 March, 2023; v1 submitted 20 April, 2022;
originally announced April 2022.
-
A Polynomial Chaos Approach to Robust $\mathcal{H}_\infty$ Static Output-Feedback Control with Bounded Truncation Error
Authors:
Yiming Wan,
Dongying E. Shen,
Sergio Lucia,
Rolf Findeisen,
Richard D. Braatz
Abstract:
This article considers the $\mathcal{H}_\infty$ static output-feedback control for linear time-invariant uncertain systems with polynomial dependence on probabilistic time-invariant parametric uncertainties. By applying polynomial chaos theory, the control synthesis problem is solved using a high-dimensional expanded system which characterizes stochastic state uncertainty propagation. A closed-loo…
▽ More
This article considers the $\mathcal{H}_\infty$ static output-feedback control for linear time-invariant uncertain systems with polynomial dependence on probabilistic time-invariant parametric uncertainties. By applying polynomial chaos theory, the control synthesis problem is solved using a high-dimensional expanded system which characterizes stochastic state uncertainty propagation. A closed-loop polynomial chaos transformation is proposed to derive the closed-loop expanded system. The approach explicitly accounts for the closed-loop dynamics and preserves the $\mathcal{L}_2$-induced gain, which results in smaller transformation errors compared to existing polynomial chaos transformations. The effect of using finite-degree polynomial chaos expansions is first captured by a norm-bounded linear differential inclusion, and then addressed by formulating a robust polynomial chaos based control synthesis problem. This proposed approach avoids the use of high-degree polynomial chaos expansions to alleviate the destabilizing effect of truncation errors, which significantly reduces computational complexity. In addition, some analysis is given for the condition under which the robustly stabilized expanded system implies the robust stability of the original system. A numerical example illustrates the effectiveness of the proposed approach.
△ Less
Submitted 27 February, 2021; v1 submitted 17 February, 2021;
originally announced February 2021.
-
Image Inversion and Uncertainty Quantification for Constitutive Laws of Pattern Formation
Authors:
Hongbo Zhao,
Richard D. Braatz,
Martin Z. Bazant
Abstract:
The forward problems of pattern formation have been greatly empowered by extensive theoretical studies and simulations, however, the inverse problem is less well understood. It remains unclear how accurately one can use images of pattern formation to learn the functional forms of the nonlinear and nonlocal constitutive relations in the governing equation. We use PDE-constrained optimization to inf…
▽ More
The forward problems of pattern formation have been greatly empowered by extensive theoretical studies and simulations, however, the inverse problem is less well understood. It remains unclear how accurately one can use images of pattern formation to learn the functional forms of the nonlinear and nonlocal constitutive relations in the governing equation. We use PDE-constrained optimization to infer the governing dynamics and constitutive relations and use Bayesian inference and linearization to quantify their uncertainties in different systems, operating conditions, and imaging conditions. We discuss the conditions to reduce the uncertainty of the inferred functions and the correlation between them, such as state-dependent free energy and reaction kinetics (or diffusivity). We present the inversion algorithm and illustrate its robustness and uncertainties under limited spatiotemporal resolution, unknown boundary conditions, blurry initial conditions, and other non-ideal situations. Under certain situations, prior physical knowledge can be included to constrain the result. Phase-field, reaction-diffusion, and phase-field-crystal models are used as model systems. The approach developed here can find applications in inferring unknown physical properties of complex pattern-forming systems and in guiding their experimental design.
△ Less
Submitted 15 March, 2021; v1 submitted 20 October, 2020;
originally announced October 2020.
-
Fault Detection and Identification using Bayesian Recurrent Neural Networks
Authors:
Weike Sun,
Antonio R. C. Paiva,
Peng Xu,
Anantha Sundaram,
Richard D. Braatz
Abstract:
In processing and manufacturing industries, there has been a large push to produce higher quality products and ensure maximum efficiency of processes. This requires approaches to effectively detect and resolve disturbances to ensure optimal operations. While the control system can compensate for many types of disturbances, there are changes to the process which it still cannot handle adequately. I…
▽ More
In processing and manufacturing industries, there has been a large push to produce higher quality products and ensure maximum efficiency of processes. This requires approaches to effectively detect and resolve disturbances to ensure optimal operations. While the control system can compensate for many types of disturbances, there are changes to the process which it still cannot handle adequately. It is therefore important to further develop monitoring systems to effectively detect and identify those faults such that they can be quickly resolved by operators. In this paper, a novel probabilistic fault detection and identification method is proposed which adopts a newly developed deep learning approach using Bayesian recurrent neural networks~(BRNNs) with variational dropout. The BRNN model is general and can model complex nonlinear dynamics. Moreover, compared to traditional statistic-based data-driven fault detection and identification methods, the proposed BRNN-based method yields uncertainty estimates which allow for simultaneous fault detection of chemical processes, direct fault identification, and fault propagation analysis. The outstanding performance of this method is demonstrated and contrasted to (dynamic) principal component analysis, which are widely applied in the industry, in the benchmark Tennessee Eastman process~(TEP) and a real chemical manufacturing dataset.
△ Less
Submitted 26 June, 2020; v1 submitted 11 November, 2019;
originally announced November 2019.
-
Optimal Charging of an Electric Vehicle Battery Pack: A Real-Time Sensitivity-Based MPC approach
Authors:
Andrea Pozzi,
Marcello Torchio,
Richard D. Braatz,
Davide M. Raimondo
Abstract:
Lithium-ion battery packs are usually composed of hundreds of cells arranged in series and parallel connections. The proper functioning of these complex devices requires suitable Battery Management Systems (BMSs). Advanced BMSs rely on mathematical models to assure safety and high performance. While many approaches have been proposed for the management of single cells, the control of multiple cell…
▽ More
Lithium-ion battery packs are usually composed of hundreds of cells arranged in series and parallel connections. The proper functioning of these complex devices requires suitable Battery Management Systems (BMSs). Advanced BMSs rely on mathematical models to assure safety and high performance. While many approaches have been proposed for the management of single cells, the control of multiple cells has been less investigated and usually relies on simplified models such as equivalent circuit models. This paper addresses the management of a battery pack in which each cell is explicitly modelled as the Single Particle Model with electrolyte and thermal dynamics. A nonlinear Model Predictive Control (MPC) is presented for optimally charging the battery pack while taking voltage and temperature limits on each cell into account. Since the computational cost of nonlinear MPC grows significantly with the complexity of the underlying model, a sensitivity-based MPC (sMPC) is proposed, in which the model adopted is obtained by linearizing the dynamics along a nominal trajectory that is updated over time. The resulting sMPC optimizations are quadratic programs which can be solved in real-time even for large battery packs (e.g. fully electric motorbike with 156 cells) while achieving the same performance of the nonlinear MPC.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
Stability Analysis of Discrete-time Lure Systems with Slope-restricted Odd Monotonic Nonlinearities
Authors:
Kwang-Ki K. Kim,
Richard D. Braatz
Abstract:
Many nonlinear dynamical systems can be written as Lure systems, which are described by a linear time-invariant system interconnected with a diagonal static sector-bounded nonlinearity. Sufficient conditions are derived for the global asymptotic stability analysis of discrete-time Lure systems in which the nonlinearities have restricted slope and/or are odd, which is the usual case in real applica…
▽ More
Many nonlinear dynamical systems can be written as Lure systems, which are described by a linear time-invariant system interconnected with a diagonal static sector-bounded nonlinearity. Sufficient conditions are derived for the global asymptotic stability analysis of discrete-time Lure systems in which the nonlinearities have restricted slope and/or are odd, which is the usual case in real applications. A Lure-Postnikov-type Lyapunov function is proposed that is used to derive sufficient analysis conditions in terms of linear matrix inequalities (LMIs). The derived stability critera are provably less conservative than criteria published in the literature, with numerical examples indicating that conservatism can be reduced by orders of magnitude.
△ Less
Submitted 3 September, 2015;
originally announced September 2015.
-
Receding-horizon Stochastic Model Predictive Control with Hard Input Constraints and Joint State Chance Constraints
Authors:
Joel A. Paulson,
Edward A. Buehler,
Richard D. Braatz,
Ali Mesbah
Abstract:
This article considers the stochastic optimal control of discrete-time linear systems subject to (possibly) unbounded stochastic disturbances, hard constraints on the manipulated variables, and joint chance constraints on the states. A tractable convex second-order cone program (SOCP) is derived for calculating the receding-horizon control law at each time step. Feedback is incorporated during pre…
▽ More
This article considers the stochastic optimal control of discrete-time linear systems subject to (possibly) unbounded stochastic disturbances, hard constraints on the manipulated variables, and joint chance constraints on the states. A tractable convex second-order cone program (SOCP) is derived for calculating the receding-horizon control law at each time step. Feedback is incorporated during prediction by parametrizing the control law as an affine function of the disturbances. Hard input constraints are guaranteed by saturating the disturbances that appear in the control law parametrization. The joint state chance constraints are conservatively approximated as a collection of individual chance constraints that are subsequently relaxed via the Cantelli-Chebyshev inequality. Feasibility of the SOCP is guaranteed by softening the approximated chance constraints using the exact penalty function method. Closed-loop stability in a stochastic sense is established by establishing that the states satisfy a geometric drift condition outside of a compact set such that their variance is bounded at all times. The SMPC approach is demonstrated using a continuous acetone-butanol-ethanol fermentation process, which is used for production of high-value-added drop-in biofuels.
△ Less
Submitted 28 June, 2015;
originally announced June 2015.
