Showing 1–29 of 29 results for author: Findeisen, R

Lithium-Ion Battery System Health Monitoring and Fault Analysis from Field Data Using Gaussian Processes

Authors: Joachim Schaeffer, Eric Lenz, Duncan Gulla, Martin Z. Bazant, Richard D. Braatz, Rolf Findeisen

Abstract: Health monitoring, fault analysis, and detection are critical for the safe and sustainable operation of battery systems. We apply Gaussian process resistance models on lithium iron phosphate battery field data to effectively separate the time-dependent and operating point-dependent resistance. The data set contains 29 battery systems returned to the manufacturer for warranty, each with eight cells… ▽ More Health monitoring, fault analysis, and detection are critical for the safe and sustainable operation of battery systems. We apply Gaussian process resistance models on lithium iron phosphate battery field data to effectively separate the time-dependent and operating point-dependent resistance. The data set contains 29 battery systems returned to the manufacturer for warranty, each with eight cells in series, totaling 232 cells and 131 million data rows. We develop probabilistic fault detection rules using recursive spatiotemporal Gaussian processes. These processes allow the quick processing of over a million data points, enabling advanced online monitoring and furthering the understanding of battery pack failure in the field. The analysis underlines that often, only a single cell shows abnormal behavior or a knee point, consistent with weakest-link failure for cells connected in series, amplified by local resistive heating. The results further the understanding of how batteries degrade and fail in the field and demonstrate the potential of efficient online monitoring based on data. We open-source the code and publish the large data set upon completion of the review of this article. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Accounting for the Effects of Probabilistic Uncertainty During Fast Charging of Lithium-ion Batteries

Authors: Minsu Kim, Joachim Schaeffer, Marc D. Berliner, Berta Pedret Sagnier, Rolf Findeisen, Richard D. Braatz

Abstract: Batteries are nonlinear dynamical systems that can be modeled by Porous Electrode Theory models. The aim of optimal fast charging is to reduce the charging time while kee** battery degradation low. Most past studies assume that model parameters and ambient temperature are a fixed known value and that all PET model parameters are perfectly known. In real battery operation, however, the ambient te… ▽ More Batteries are nonlinear dynamical systems that can be modeled by Porous Electrode Theory models. The aim of optimal fast charging is to reduce the charging time while kee** battery degradation low. Most past studies assume that model parameters and ambient temperature are a fixed known value and that all PET model parameters are perfectly known. In real battery operation, however, the ambient temperature and the model parameters are uncertain. To ensure that operational constraints are satisfied at all times in the context of model-based optimal control, uncertainty quantification is required. Here, we analyze optimal fast charging for modest uncertainty in the ambient temperature and 23 model parameters. Uncertainty quantification of the battery model is carried out using non-intrusive polynomial chaos expansion and the results are verified with Monte Carlo simulations. The method is investigated for a constant current--constant voltage charging strategy for a battery for which the strategy is known to be standard for fast charging subject to operating below maximum current and charging constraints. Our results demonstrate that uncertainty in ambient temperature results in violations of constraints on the voltage and temperature. Our results identify a subset of key parameters that contribute to fast charging among the overall uncertain parameters. Additionally, it is shown that the constraints represented by voltage, temperature, and lithium-plating overpotential are violated due to uncertainties in the ambient temperature and parameters. The C-rate and charge constraints are then adjusted so that the probability of violating the degradation acceleration condition is below a pre-specified value. This approach demonstrates a computationally efficient approach for determining fast-charging protocols that take probabilistic uncertainties into account. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: 6 pages, 5 figures, accepted for ACC 2024

Stability-informed Bayesian Optimization for MPC Cost Function Learning

Authors: Sebastian Hirt, Maik Pfefferkorn, Ali Mesbah, Rolf Findeisen

Abstract: Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while considering closed-loop stability. We employ constrained Bayesian optimization to learn a model predictive controller's (MPC) cost function parametrized as a feedfo… ▽ More Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while considering closed-loop stability. We employ constrained Bayesian optimization to learn a model predictive controller's (MPC) cost function parametrized as a feedforward neural network, optimizing closed-loop behavior as well as minimizing model-plant mismatch. Doing so offers a high degree of freedom and, thus, the opportunity for efficient and global optimization towards the desired and optimal closed-loop behavior. We extend this framework by stability constraints on the learned controller parameters, exploiting the optimal value function of the underlying MPC as a Lyapunov candidate. The effectiveness of the proposed approach is underlined in simulations, highlighting its performance and safety capabilities. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: 7 pages, 3 figures, accepted for NMPC 2024

Learning Model Predictive Control Parameters via Bayesian Optimization for Battery Fast Charging

Authors: Sebastian Hirt, Andreas Höhl, Joachim Schaeffer, Johannes Pohlodek, Richard D. Braatz, Rolf Findeisen

Abstract: Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may stem from factors like substantial model-plant differences, limited prediction horizons that do not cover the entire time of interest, or unforeseen system distu… ▽ More Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may stem from factors like substantial model-plant differences, limited prediction horizons that do not cover the entire time of interest, or unforeseen system disturbances. Such mismatches can jeopardize both performance and safety, including constraint satisfaction. Traditional methods address this issue by modifying the finite horizon cost function to better reflect the overall operational cost, learning parts of the prediction model from data, or implementing robust MPC strategies, which might be either computationally intensive or overly cautious. As an alternative, directly optimizing or learning the controller parameters to enhance closed-loop performance has been proposed. We apply Bayesian optimization for efficient learning of unknown model parameters and parameterized constraint backoff terms, aiming to improve closed-loop performance of battery fast charging. This approach establishes a hierarchical control framework where Bayesian optimization directly fine-tunes closed-loop behavior towards a global and long-term objective, while MPC handles lower-level, short-term control tasks. For lithium-ion battery fast charging, we show that the learning approach not only ensures safe operation but also maximizes closed-loop performance. This includes maintaining the battery's operation below its maximum terminal voltage and reducing charging times, all achieved using a standard nominal MPC model with a short horizon and notable initial model-plant mismatch. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: 6 pages, 5 figures, accepted for ADCHEM 2024

Cycle Life Prediction for Lithium-ion Batteries: Machine Learning and More

Authors: Joachim Schaeffer, Giacomo Galuppini, **wook Rhyu, Patrick A. Asinger, Robin Droop, Rolf Findeisen, Richard D. Braatz

Abstract: Batteries are dynamic systems with complicated nonlinear aging, highly dependent on cell design, chemistry, manufacturing, and operational conditions. Prediction of battery cycle life and estimation of aging states is important to accelerate battery R&D, testing, and to further the understanding of how batteries degrade. Beyond testing, battery management systems rely on real-time models and onboa… ▽ More Batteries are dynamic systems with complicated nonlinear aging, highly dependent on cell design, chemistry, manufacturing, and operational conditions. Prediction of battery cycle life and estimation of aging states is important to accelerate battery R&D, testing, and to further the understanding of how batteries degrade. Beyond testing, battery management systems rely on real-time models and onboard diagnostics and prognostics for safe operation. Estimating the state of health and remaining useful life of a battery is important to optimize performance and use resources optimally. This tutorial begins with an overview of first-principles, machine learning, and hybrid battery models. Then, a typical pipeline for the development of interpretable machine learning models is explained and showcased for cycle life prediction from laboratory testing data. We highlight the challenges of machine learning models, motivating the incorporation of physics in hybrid modeling approaches, which are needed to decipher the aging trajectory of batteries but require more data and further work on the physics of battery degradation. The tutorial closes with a discussion on generalization and further research directions. △ Less

Submitted 5 April, 2024; originally announced April 2024.

Comments: 6 pages, 3 figures, accepted for ACC 2024

Experimentally implemented dynamic optogenetic optimization of ATPase expression using knowledge-based and Gaussian-process-supported models

Authors: Sebastián Espinel-Ríos, Gerrich Behrendt, Jasmin Bauer, Bruno Morabito, Johannes Pohlodek, Andrea Schütze, Rolf Findeisen, Katja Bettenbrock, Steffen Klamt

Abstract: Optogenetic modulation of adenosine triphosphatase (ATPase) expression represents a novel approach to maximize bioprocess efficiency by leveraging enforced adenosine triphosphate (ATP) turnover. In this study, we experimentally implement a model-based open-loop optimization scheme for optogenetic modulation of the expression of ATPase. Increasing the intracellular concentration of ATPase, and thus… ▽ More Optogenetic modulation of adenosine triphosphatase (ATPase) expression represents a novel approach to maximize bioprocess efficiency by leveraging enforced adenosine triphosphate (ATP) turnover. In this study, we experimentally implement a model-based open-loop optimization scheme for optogenetic modulation of the expression of ATPase. Increasing the intracellular concentration of ATPase, and thus the level of ATP turnover, in bioprocesses with product synthesis coupled with ATP generation, can lead to increased product formation and substrate uptake. Previous simulation studies formulated optimal control problems using dynamic constraint-based models to find optimal light inputs in fermentations with optogenetically mediated ATPase expression. However, using these models poses challenges due to resulting bilevel optimizations and complex parameterization. Here, we outline a simplified unsegregated and quasi-unstructured kinetic modeling approach that reduces the number of dynamic states and leads to single-level optimizations. The models can be augmented with Gaussian processes to compensate for model uncertainties. We implement optimal control constrained by knowledge-based and hybrid models for optogenetic ATPase expression in $\textit{Escherichia coli}$ with lactate as the main product. To do so, we genetically engineer $\textit{E. coli}$ to obtain optogenetic expression of ATPase using the CcaS/CcaR system. This represents the first experimental implementation of model-based optimization of ATPase expression in bioprocesses. △ Less

Submitted 17 January, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Comments: 24 pages, 5 figures, journal submission

Geometric Data-Driven Dimensionality Reduction in MPC with Guarantees

Authors: Roland Schurig, Andreas Himmel, Rolf Findeisen

Abstract: We address the challenge of dimension reduction in the discrete-time optimal control problem which is solved repeatedly online within the framework of model predictive control. Our study demonstrates that a reduced-order approach, aimed at identifying a suboptimal solution within a low-dimensional subspace, retains the stability and recursive feasibility characteristics of the original problem. We… ▽ More We address the challenge of dimension reduction in the discrete-time optimal control problem which is solved repeatedly online within the framework of model predictive control. Our study demonstrates that a reduced-order approach, aimed at identifying a suboptimal solution within a low-dimensional subspace, retains the stability and recursive feasibility characteristics of the original problem. We present a necessary and sufficient condition for ensuring initial feasibility, which is seamlessly integrated into the subspace design process. Additionally, we employ techniques from optimization on Riemannian manifolds to develop a subspace that efficiently represents a collection of pre-specified high-dimensional data points, all while adhering to the initial admissibility constraint. △ Less

Submitted 18 April, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Comments: This paper is presented at ECC 2024

Regret and Conservatism of Distributionally Robust Constrained Stochastic Model Predictive Control

Authors: Maik Pfefferkorn, Venkatraman Renganathan, Rolf Findeisen

Abstract: We analyse the conservatism and regret of distributionally robust (DR) stochastic model predictive control (SMPC) when using moment-based ambiguity sets for modeling unknown uncertainties. To quantify the conservatism, we compare the deterministic constraint tightening while taking a DR approach against the optimal tightening when the exact distributions of the stochastic uncertainties are known.… ▽ More We analyse the conservatism and regret of distributionally robust (DR) stochastic model predictive control (SMPC) when using moment-based ambiguity sets for modeling unknown uncertainties. To quantify the conservatism, we compare the deterministic constraint tightening while taking a DR approach against the optimal tightening when the exact distributions of the stochastic uncertainties are known. Furthermore, we quantify the regret by comparing the performance when the distributions of the stochastic uncertainties are known and unknown. Analysing the accumulated sub-optimality of SMPC due to the lack of knowledge about the true distributions of the uncertainties marks the novel contribution of this work. △ Less

Submitted 14 March, 2024; v1 submitted 21 September, 2023; originally announced September 2023.

Comments: Extended version of a manuscript accepted for ACC (revised version)

Stochastic Model Predictive Control Utilizing Bayesian Neural Networks

Authors: J. Pohlodek, H. Alsmeier, B. Morabito, C. Schlauch, A. Savchenko, R. Findeisen

Abstract: Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive control, can address this by accounting for uncertainty. Gaussian processes are often used but have limitations with larger models and data sets. We explore Bayesi… ▽ More Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive control, can address this by accounting for uncertainty. Gaussian processes are often used but have limitations with larger models and data sets. We explore Bayesian neural networks for stochastic learning-assisted control, comparing their performance to Gaussian processes on a wastewater treatment plant model. Results show Bayesian neural networks achieve similar performance, highlighting their potential as an alternative for control designs, particularly when handling extensive data sets. △ Less

Submitted 25 March, 2023; originally announced March 2023.

LMI-based Data-Driven Robust Model Predictive Control

Authors: Hoang Hai Nguyen, Maurice Friedel, Rolf Findeisen

Abstract: Predictive control, which is based on a model of the system to compute the applied input optimizing the future system behavior, is by now widely used. If the nominal models are not given or are very uncertain, data-driven model predictive control approaches can be employed, where the system model or input is directly obtained from past measured trajectories. Using a data informativity framework an… ▽ More Predictive control, which is based on a model of the system to compute the applied input optimizing the future system behavior, is by now widely used. If the nominal models are not given or are very uncertain, data-driven model predictive control approaches can be employed, where the system model or input is directly obtained from past measured trajectories. Using a data informativity framework and Finsler's lemma, we propose a data-driven robust linear matrix inequality-based model predictive control scheme that considers input and state constraints. Using these data, we formulate the problem as a semi-definite optimization problem, whose solution provides the matrix gain for the linear feedback, while the decisive variables are independent of the length of the measurement data. The designed controller stabilizes the closed-loop system asymptotically and guarantees constraint satisfaction. Numerical examples are conducted to illustrate the method. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Model Predictive Control with Gaussian-Process-Supported Dynamical Constraints for Autonomous Vehicles

Authors: Johanna Bethge, Maik Pfefferkorn, Alexander Rose, Jan Peters, Rolf Findeisen

Abstract: We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve safety. A multi-mode predictive control approach considers the possible intentions of the human drivers. While the intentions are represented by different Gaussian pr… ▽ More We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve safety. A multi-mode predictive control approach considers the possible intentions of the human drivers. While the intentions are represented by different Gaussian processes, their probabilities foreseen in the observed behaviors are determined by a suitable online classification. Intentions below a certain probability threshold are neglected to improve performance. The proposed multi-mode model predictive control approach with Gaussian process regression support enables repeated feasibility and probabilistic constraint satisfaction with high probability. The approach is underlined in simulation, considering real-world measurements for training the Gaussian processes. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Safe Machine-Learning-supported Model Predictive Force and Motion Control in Robotics

Authors: Janine Matschek, Johanna Bethge, Rolf Findeisen

Abstract: Many robotic tasks, such as human-robot interactions or the handling of fragile objects, require tight control and limitation of appearing forces and moments alongside sensible motion control to achieve safe yet high-performance operation. We propose a learning-supported model predictive force and motion control scheme that provides stochastic safety guarantees while adapting to changing situation… ▽ More Many robotic tasks, such as human-robot interactions or the handling of fragile objects, require tight control and limitation of appearing forces and moments alongside sensible motion control to achieve safe yet high-performance operation. We propose a learning-supported model predictive force and motion control scheme that provides stochastic safety guarantees while adapting to changing situations. Gaussian processes are used to learn the uncertain relations that map the robot's states to the forces and moments. The model predictive controller uses these Gaussian process models to achieve precise motion and force control under stochastic constraint satisfaction. As the uncertainty only occurs in the static model parts -- the output equations -- a computationally efficient stochastic MPC formulation is used. Analysis of recursive feasibility of the optimal control problem and convergence of the closed loop system for the static uncertainty case are given. Chance constraint formulation and back-offs are constructed based on the variance of the Gaussian process to guarantee safe operation. The approach is illustrated on a lightweight robot in simulations and experiments. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Towards a modeling, optimization and predictive control framework for fed-batch metabolic cybergenetics

Authors: Sebastián Espinel-Ríos, Bruno Morabito, Johannes Pohlodek, Katja Bettenbrock, Steffen Klamt, Rolf Findeisen

Abstract: Biotechnology offers many opportunities for the sustainable manufacturing of valuable products. The toolbox to optimize bioprocesses includes \textit{extracellular} process elements such as the bioreactor design and mode of operation, medium formulation, culture conditions, feeding rates, etc. However, these elements are frequently insufficient for achieving optimal process performance or precise… ▽ More Biotechnology offers many opportunities for the sustainable manufacturing of valuable products. The toolbox to optimize bioprocesses includes \textit{extracellular} process elements such as the bioreactor design and mode of operation, medium formulation, culture conditions, feeding rates, etc. However, these elements are frequently insufficient for achieving optimal process performance or precise product composition. One can use metabolic and genetic engineering methods for optimization at the intracellular level. Nevertheless, those are often of static nature, failing when applied to dynamic processes or if disturbances occur. Furthermore, many bioprocesses are optimized empirically and implemented with little-to-no feedback control to counteract disturbances. The concept of cybergenetics has opened new possibilities to optimize bioprocesses by enabling online modulation of the gene expression of metabolism-relevant proteins via external inputs (e.g., light intensity in optogenetics). Here, we fuse cybergenetics with model-based optimization and predictive control for optimizing dynamic bioprocesses. To do so, we propose to use dynamic constraint-based models that integrate the dynamics of metabolic reactions, resource allocation, and inducible gene expression. We formulate a model-based optimal control problem to find the optimal process inputs. Furthermore, we propose using model predictive control to address uncertainties via online feedback. We focus on fed-batch processes, where the substrate feeding rate is an additional optimization variable. As a simulation example, we show the optogenetic control of the ATPase enzyme complex for dynamic modulation of enforced ATP wasting to adjust product yield and productivity. △ Less

Submitted 4 February, 2023; originally announced February 2023.

Machine Learning for Process Control of (Bio)Chemical Processes

Authors: Andreas Himmel, Janine Matschek, Rudolph Kok, Bruno Morabito, Hoang Hai Nguyen, Rolf Findeisen

Abstract: The control of manufacturing processes must satisfy high quality and efficiency requirements while meeting safety requirements. A broad spectrum of monitoring and control strategies, such as model- and optimization-based controllers, are utilized to address these issues. Driven by rising demand for flexible yet energy and resource-efficient operations existing approaches are challenged due to high… ▽ More The control of manufacturing processes must satisfy high quality and efficiency requirements while meeting safety requirements. A broad spectrum of monitoring and control strategies, such as model- and optimization-based controllers, are utilized to address these issues. Driven by rising demand for flexible yet energy and resource-efficient operations existing approaches are challenged due to high uncertainties and changes. Machine learning algorithms are becoming increasingly important in tackling these challenges, especially due to the growing amount of available data. The ability for automatic adaptation and learning from human operators offer new opportunities to increase efficiency yet provide flexible operation. Combining machine learning algorithms with safe or robust controls offers novel reliable operation methods. This chapter highlights ways to fuse machine learning and control for the safe and improved operation of chemical and biochemical processes. We outline and summarize both - learning models for control and learning the control components. We offer a general overview, including a literature review, to provide a guideline for utilizing machine learning techniques in control structures. △ Less

Submitted 15 January, 2023; originally announced January 2023.

Safe Hierarchical Model Predictive Control and Planning for Autonomous Systems

Authors: Markus Koegel, Mohamed Ibrahim, Christian Kallies, Rolf Findeisen

Abstract: Planning and control for autonomous vehicles usually are hierarchical separated. However, increasing performance demands and operating in highly dynamic environments requires an frequent re-evaluation of the planning and tight integration of control and planning to guarantee safety. We propose an integrated hierarchical predictive control and planning approach to tackle this challenge. Planner and… ▽ More Planning and control for autonomous vehicles usually are hierarchical separated. However, increasing performance demands and operating in highly dynamic environments requires an frequent re-evaluation of the planning and tight integration of control and planning to guarantee safety. We propose an integrated hierarchical predictive control and planning approach to tackle this challenge. Planner and controller are based on the repeated solution of moving horizon optimal control problems. The planner can choose different low-layer controller modes for increased flexibility and performance instead of using a single controller with a large safety margin for collision avoidance under uncertainty. Planning is based on simplified system dynamics and safety, yet flexible operation is ensured by constraint tightening based on a mixed-integer linear programming formulation. A cyclic horizon tube-based model predictive controller guarantees constraint satisfaction for different control modes and disturbances. Examples of such modes are a slow-speed movement with high precision and fast-speed movements with large uncertainty bounds. Allowing for different control modes reduces the conservatism, while the hierarchical decomposition of the problem reduces the computational cost and enables real-time implementation. We derive conditions for recursive feasibility to ensure constraint satisfaction and obstacle avoidance to guarantee safety and ensure compatibility between the layers and modes. Simulation results illustrate the efficiency and applicability of the proposed hierarchical strategy. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Flexible development and evaluation of machine-learning-supported optimal control and estimation methods via HILO-MPC

Authors: Johannes Pohlodek, Bruno Morabito, Christian Schlauch, Pablo Zometa, Rolf Findeisen

Abstract: Model-based optimization approaches for monitoring and control, such as model predictive control and optimal state and parameter estimation, have been used for decades in many engineering applications. Models describing the dynamics, constraints, and desired performance criteria are fundamental to model-based approaches. Thanks to recent technological advancements in digitalization, machine learni… ▽ More Model-based optimization approaches for monitoring and control, such as model predictive control and optimal state and parameter estimation, have been used for decades in many engineering applications. Models describing the dynamics, constraints, and desired performance criteria are fundamental to model-based approaches. Thanks to recent technological advancements in digitalization, machine learning methods such as deep learning, and computing power, there has been an increasing interest in using machine learning methods alongside model-based approaches for control and estimation. The number of new methods and theoretical findings using machine learning for model-based control and optimization is increasing rapidly. This paper outlines the basic ideas and principles behind an easy-to-use Python toolbox that allows to quickly and efficiently solve machine-learning-supported optimization, model predictive control, and estimation problems. The toolbox leverages state-of-the-art machine learning libraries to train components used to define the problem. It allows to efficiently solve the resulting optimization problems. Machine learning can be used for a broad spectrum of tasks, ranging from model predictive control for stabilization, setpoint tracking, path following, and trajectory tracking to moving horizon estimation and Kalman filtering. For linear systems, it enables quick code generation for embedded MPC applications. HILO-MPC is flexible and adaptable, making it especially suitable for research and fundamental development tasks. Due to its simplicity and numerous already implemented examples, it is also a powerful teaching tool. The usability is underlined, presenting a series of application examples. △ Less

Submitted 25 March, 2022; originally announced March 2022.

Efficient Stochastic Optimal Control through Approximate Bayesian Input Inference

Authors: Joe Watson, Hany Abdulsamad, Rolf Findeisen, Jan Peters

Abstract: Optimal control under uncertainty is a prevailing challenge for many reasons. One of the critical difficulties lies in producing tractable solutions for the underlying stochastic optimization problem. We show how advanced approximate inference techniques can be used to handle the statistical approximations principled and practically by framing the control problem as a problem of input estimation.… ▽ More Optimal control under uncertainty is a prevailing challenge for many reasons. One of the critical difficulties lies in producing tractable solutions for the underlying stochastic optimization problem. We show how advanced approximate inference techniques can be used to handle the statistical approximations principled and practically by framing the control problem as a problem of input estimation. Analyzing the Gaussian setting, we present an inference-based solver that is effective in stochastic and deterministic settings and was found to be superior to popular baselines on nonlinear simulated tasks. We draw connections that relate this inference formulation to previous approaches for stochastic optimal control and outline several advantages that this inference view brings due to its statistical nature. △ Less

Submitted 13 March, 2022; v1 submitted 17 May, 2021; originally announced May 2021.

Comments: Submitted to Transactions on Automatic Control Special Issue: Learning and Control. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Control of Scanning Quantum Dot Microscopy

Authors: Michael Maiworm, Christian Wagner, Taner Esat, Philipp Leinen, Ruslan Temirov, F. Stefan Tautz, Rolf Findeisen

Abstract: Scanning quantum dot microscopy is a recently developed high-resolution microscopy technique that is based on atomic force microscopy and is capable of imaging the electrostatic potential of nanostructures like molecules or single atoms. Recently, it could be shown that it not only yields qualitatively but also quantitatively cutting edge images even on an atomic level. In this paper we present ho… ▽ More Scanning quantum dot microscopy is a recently developed high-resolution microscopy technique that is based on atomic force microscopy and is capable of imaging the electrostatic potential of nanostructures like molecules or single atoms. Recently, it could be shown that it not only yields qualitatively but also quantitatively cutting edge images even on an atomic level. In this paper we present how control is a key enabling element to this. The developed control approach consists of a two-degree-of-freedom control framework that comprises a feedforward and a feedback part. For the latter we design two tailored feedback controllers. The feedforward part generates a reference for the current scanned line based on the previously scanned one. We discuss in detail various aspects of the presented control approach and its implications for scanning quantum dot microscopy. We evaluate the influence of the feedforward part and compare the two proposed feedback controllers. The proposed control algorithms speed up scanning quantum dot microscopy by more than a magnitude and enable to scan large sample areas. △ Less

Submitted 1 March, 2021; v1 submitted 25 February, 2021; originally announced February 2021.

Comments: 13 pages, 23 figures, 4 tables

A Polynomial Chaos Approach to Robust $\mathcal{H}_\infty$ Static Output-Feedback Control with Bounded Truncation Error

Authors: Yiming Wan, Dongying E. Shen, Sergio Lucia, Rolf Findeisen, Richard D. Braatz

Abstract: This article considers the $\mathcal{H}_\infty$ static output-feedback control for linear time-invariant uncertain systems with polynomial dependence on probabilistic time-invariant parametric uncertainties. By applying polynomial chaos theory, the control synthesis problem is solved using a high-dimensional expanded system which characterizes stochastic state uncertainty propagation. A closed-loo… ▽ More This article considers the $\mathcal{H}_\infty$ static output-feedback control for linear time-invariant uncertain systems with polynomial dependence on probabilistic time-invariant parametric uncertainties. By applying polynomial chaos theory, the control synthesis problem is solved using a high-dimensional expanded system which characterizes stochastic state uncertainty propagation. A closed-loop polynomial chaos transformation is proposed to derive the closed-loop expanded system. The approach explicitly accounts for the closed-loop dynamics and preserves the $\mathcal{L}_2$-induced gain, which results in smaller transformation errors compared to existing polynomial chaos transformations. The effect of using finite-degree polynomial chaos expansions is first captured by a norm-bounded linear differential inclusion, and then addressed by formulating a robust polynomial chaos based control synthesis problem. This proposed approach avoids the use of high-degree polynomial chaos expansions to alleviate the destabilizing effect of truncation errors, which significantly reduces computational complexity. In addition, some analysis is given for the condition under which the robustly stabilized expanded system implies the robust stability of the original system. A numerical example illustrates the effectiveness of the proposed approach. △ Less

Submitted 27 February, 2021; v1 submitted 17 February, 2021; originally announced February 2021.

Comments: 11 pages, 3 figures, 1 table; submitted to IEEE Transactions on Automatic Control

Controller tuning in power systems using singular value optimization

Authors: Amer Mešanović, Ulrich Münz, Rolf Findeisen

Abstract: As the share of renewable generation in large power systems continues to increase, the operation of power systems becomes increasingly challenging. The constantly shifting mix of renewable and conventional generation leads to largely changing dynamics, increasing the risk of blackouts. We propose to retune the parameters of the already present controllers in the power systems to account for the se… ▽ More As the share of renewable generation in large power systems continues to increase, the operation of power systems becomes increasingly challenging. The constantly shifting mix of renewable and conventional generation leads to largely changing dynamics, increasing the risk of blackouts. We propose to retune the parameters of the already present controllers in the power systems to account for the seemingly changing operating conditions. To this end, we present an approach for fast and computationally efficient tuning of parameters of structured controllers. The goal of the tuning is to shift system poles to a specified region in the complex plane, e.g. for stabilization or oscillation dam**. The approach exploits singular value optimization in the frequency domain, which enables scaling to large systems and is not limited to power systems. The efficiency of the approach is shown on three systems of increasing size with multiple initial parameterizations. △ Less

Submitted 8 May, 2020; originally announced May 2020.

Fusing Online Gaussian Process-Based Learning and Control for Scanning Quantum Dot Microscopy

Authors: Maik Pfefferkorn, Michael Maiworm, Christian Wagner, F. Stefan Tautz, Rolf Findeisen

Abstract: Elucidating electrostatic surface potentials contributes to a deeper understanding of the nature of matter and its physicochemical properties, which is the basis for a wide field of applications. Scanning quantum dot microscopy, a recently developed technique allows to measure such potentials with atomic resolution. For an efficient deployment in scientific practice, however, it is essential to sp… ▽ More Elucidating electrostatic surface potentials contributes to a deeper understanding of the nature of matter and its physicochemical properties, which is the basis for a wide field of applications. Scanning quantum dot microscopy, a recently developed technique allows to measure such potentials with atomic resolution. For an efficient deployment in scientific practice, however, it is essential to speed up the scanning process. To this end we employ a two-degree-of-freedom control paradigm, in which a Gaussian process is used as the feedforward part. We present a tailored online learning scheme of the Gaussian process, adapted to scanning quantum dot microscopy, that includes hyperparameter optimization during operation to enable fast and precise scanning of arbitrary surface structures. For the potential application in practice, the accompanying computational cost is reduced evaluating different sparse approximation approaches. The fully independent training conditional approximation, used on a reduced set of active training data, is found to be the most promising approach. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: This paper is currently under review for CDC 2020

Learning References with Gaussian Processes in Model Predictive Control applied to Robot Assisted Surgery

Authors: Janine Matschek, Tim Gonschorek, Magnus Hanses, Norbert Elkmann, Frank Ortmeier, Rolf Findeisen

Abstract: One of the key benefits of model predictive control is the capability of controlling a system proactively in the sense of taking the future system evolution into account. However, often external disturbances or references are not a priori known, which renders the predictive controllers shortsighted or uninformed. Adaptive prediction models can be used to overcome this issue and provide predictions… ▽ More One of the key benefits of model predictive control is the capability of controlling a system proactively in the sense of taking the future system evolution into account. However, often external disturbances or references are not a priori known, which renders the predictive controllers shortsighted or uninformed. Adaptive prediction models can be used to overcome this issue and provide predictions of these signals to the controller. In this work we propose to learn references via Gaussian processes for model predictive controllers. To illustrate the approach, we consider robot assisted surgery, where a robotic manipulator needs to follow a learned reference position based on optical tracking measurements. △ Less

Submitted 25 November, 2019; originally announced November 2019.

Online learning-based Model Predictive Control with Gaussian Process Models and Stability Guarantees

Authors: Michael Maiworm, Daniel Limon, Rolf Findeisen

Abstract: Model predictive control allows to provide high performance and safety guarantees in the form of constraint satisfaction. These properties, however, can be satisfied only if the underlying model, used for prediction, of the controlled process is sufficiently accurate. One way to address this challenge is by data-driven and machine learning approaches, such as Gaussian processes, that allow to refi… ▽ More Model predictive control allows to provide high performance and safety guarantees in the form of constraint satisfaction. These properties, however, can be satisfied only if the underlying model, used for prediction, of the controlled process is sufficiently accurate. One way to address this challenge is by data-driven and machine learning approaches, such as Gaussian processes, that allow to refine the model online during operation. We present a combination of an output feedback model predictive control scheme and a Gaussian process-based prediction model that is capable of efficient online learning. To this end, the concept of evolving Gaussian processes is combined with recursive posterior prediction updates. The presented approach guarantees recursive constraint satisfaction and input-to-state stability with respect to the model-plant mismatch. Simulation studies underline that the Gaussian process prediction model can be successfully and efficiently learned online. The resulting computational load is significantly reduced via the combination of the recursive update procedure and by limiting the number of training data points while maintaining good performance. △ Less

Submitted 1 December, 2020; v1 submitted 8 November, 2019; originally announced November 2019.

Comments: 29 pages, 13 figures, 3 tables, 1 algorithm, revision submitted to International Journal of Robust and Nonlinear Control

Scalable and Data Privacy Conserving Controller Tuning for Large-Scale Power Networks

Authors: Amer Mešanović, Ulrich Münz, Rolf Findeisen

Abstract: The increasing share of renewable generation leads to new challenges in reliable power system operation, such as the rising volatility of power generation, which leads to time-varying dynamics and behavior of the system. To counteract the changing dynamics, we propose to adapt the parameters of existing controllers to the changing conditions. Doing so, however, is challenging, as large power syste… ▽ More The increasing share of renewable generation leads to new challenges in reliable power system operation, such as the rising volatility of power generation, which leads to time-varying dynamics and behavior of the system. To counteract the changing dynamics, we propose to adapt the parameters of existing controllers to the changing conditions. Doing so, however, is challenging, as large power systems often involve multiple subsystem operators, which, for safety and privacy reasons, do not want to exchange detailed information about their subsystems. Furthermore, centralized tuning of structured controllers for large-scale systems, such as power networks, is often computationally very challenging. For this reason, we present a hierarchical decentralized approach for controller tuning, which increases data security and scalability. The proposed method is based on the exchange of structured reduced models of subsystems, which conserves data privacy and reduces computational complexity. For this purpose, suitable methods for model reduction and model matching are introduced. Furthermore, we demonstrate how increased renewable penetration leads to time-varying dynamics on the IEEE 68 bus power system, which underlines the importance of the problem. Then, we apply the proposed approach on simulation studies to show its effectiveness. As shown, a similar system performance as with a centralized method can be obtained. Finally, we show the scalability of the approach on a large power system with more than 2500 states and about 1500 controller parameters. △ Less

Submitted 4 November, 2019; originally announced November 2019.

Structured Controller Parameter Tuning for Power Systems

Authors: A. Mesanovic, U. Münz, A. Szabo, M. Mangold, J. Bamberger, M. Metzger, C. Heyde, R. Krebs, R. Findeisen

Abstract: Reliable and secure operation of power systems becomes increasingly challenging as the share of volatile generation rises, leading to largely changing dynamics. Typically, the architecture and structure of controllers in power systems, such as voltage controllers of power generators, are fixed during the design and buildup of the network. As replacing existing controllers is often undesired and ch… ▽ More Reliable and secure operation of power systems becomes increasingly challenging as the share of volatile generation rises, leading to largely changing dynamics. Typically, the architecture and structure of controllers in power systems, such as voltage controllers of power generators, are fixed during the design and buildup of the network. As replacing existing controllers is often undesired and challenging, setpoint adjustments, as well as tuning of the controller parameters, are possibilities to counteract large disturbances and changing dynamics. We present an approach for fast and computationally efficient adaptation of parameters of structured controllers based on H-infinity optimization, also referred to as structured H-infinity controller synthesis, tailored towards power systems. Conditions are established that guarantee that the approach leads to stability.The results are verified in a testbed microgrid consisting of six inverters and a load bank, as well as simulation studies. The proposed method improves the system robustness, as well as the time-response to step disturbances and allows structured controller tuning even for large networks. △ Less

Submitted 5 May, 2020; v1 submitted 27 October, 2019; originally announced October 2019.

Comments on Truncation Errors for Polynomial Chaos Expansions

Authors: Tillmann Mühlpfordt, Rolf Findeisen, Veit Hagenmeyer, Timm Faulwasser

Abstract: Methods based on polynomial chaos expansion allow to approximate the behavior of systems with uncertain parameters by deterministic dynamics. These methods are used in a wide range of applications, spanning from simulation of uncertain systems to estimation and control. For practical purposes the exploited spectral series expansion is typically truncated to allow for efficient computation, which l… ▽ More Methods based on polynomial chaos expansion allow to approximate the behavior of systems with uncertain parameters by deterministic dynamics. These methods are used in a wide range of applications, spanning from simulation of uncertain systems to estimation and control. For practical purposes the exploited spectral series expansion is typically truncated to allow for efficient computation, which leads to approximation errors. Despite the Hilbert space nature of polynomial chaos, there are only a few results in the literature that explicitly discuss and quantify these approximation errors. This work derives error bounds for polynomial chaos approximations of polynomial and non-polynomial map**s. Sufficient conditions are established, which allow investigating the question whether zero truncation errors can be achieved and which series order is required to achieve this. Furthermore, convex quadratic programs, whose argmin operator is a special case of a piecewise polynomial map**, are studied due to their relevance in predictive control. Several simulation examples illustrate our findings. △ Less

Submitted 27 November, 2017; v1 submitted 25 August, 2017; originally announced August 2017.

Comments: 6 pages, 4 figures

MSC Class: 93E25; 93E03; ACM Class: I.2.8

Implementation of Nonlinear Model Predictive Path-Following Control for an Industrial Robot

Authors: Timm Faulwasser, Tobias Weber, Juan Pablo Zometa, Rolf Findeisen

Abstract: Many robotic applications, such as milling, gluing, or high precision measurements, require the exact following of a pre-defined geometric path. In this paper, we investigate the real-time feasible implementation of model predictive path-following control for an industrial robot. We consider constrained output path following with and without reference speed assignment. We present results from an i… ▽ More Many robotic applications, such as milling, gluing, or high precision measurements, require the exact following of a pre-defined geometric path. In this paper, we investigate the real-time feasible implementation of model predictive path-following control for an industrial robot. We consider constrained output path following with and without reference speed assignment. We present results from an implementation of the proposed model predictive path-following controller on a KUKA LWR IV robot. △ Less

Submitted 18 August, 2016; v1 submitted 30 June, 2015; originally announced June 2015.

Comments: 8 pages, 3 figures; final revised version

MSC Class: 93C83; 70Q05

Journal ref: IEEE Transactions on Control System Technology, 2017 25(4), 1505-1511

Nonlinear Model Predictive Control for Constrained Output Path Following

Authors: Timm Faulwasser, Rolf Findeisen

Abstract: We consider the tracking of geometric paths in output spaces of nonlinear systems subject to input and state constraints without pre-specified timing requirements. Such problems are commonly referred to as constrained output path-following problems. Specifically, we propose a predictive control approach to constrained path-following problems with and without velocity assignments and provide suffic… ▽ More We consider the tracking of geometric paths in output spaces of nonlinear systems subject to input and state constraints without pre-specified timing requirements. Such problems are commonly referred to as constrained output path-following problems. Specifically, we propose a predictive control approach to constrained path-following problems with and without velocity assignments and provide sufficient convergence conditions based on terminal regions and end penalties. Furthermore, we analyze the geometric nature of constrained output path-following problems and thereby provide insight into the computation of suitable terminal control laws and terminal regions. We draw upon an example from robotics to illustrate our findings. △ Less

Submitted 9 February, 2015; originally announced February 2015.

Comments: 12 pages, 4 figures

MSC Class: 93C83; 34H05; 70Q05

Journal ref: IEEE Transactions on Automatic Control, 61(4):1026-1039, 2016

Robustness of Prediction Based Delay Compensation for Nonlinear Systems

Authors: Rolf Findeisen, Lars Grüne, Jürgen Pannek, Paolo Varutti

Abstract: Control of systems where the information between the controller, actuator, and sensor can be lost or delayed can be challenging with respect to stability and performance. One way to overcome the resulting problems is the use of prediction based compensation schemes. Instead of a single input, a sequence of (predicted) future controls is submitted and implemented at the actuator. If suitable, so-ca… ▽ More Control of systems where the information between the controller, actuator, and sensor can be lost or delayed can be challenging with respect to stability and performance. One way to overcome the resulting problems is the use of prediction based compensation schemes. Instead of a single input, a sequence of (predicted) future controls is submitted and implemented at the actuator. If suitable, so-called prediction consistent compensation and control schemes, such as certain predictive control approaches, are used, stability of the closed loop in the presence of delays and packet losses can be guaranteed. In this paper, we show that control schemes employing prediction based delay compensation approaches do posses inherent robustness properties. Specifically, if the nominal closed loop system without delay compensation is ISS with respect to perturbation and measurement errors, then the closed loop system employing prediction based delay compensation techniques is robustly stable. We analyze the influence of the prediction horizon on the robustness gains and illustrate the results in simulation. △ Less

Submitted 16 May, 2011; originally announced May 2011.

Comments: 6 pages, 3 figures

Journal ref: Proceedings of the 18th IFAC World Congress, 2011, 203--208