-
Closed-loop training of static output feedback neural network controllers for large systems: A distillation case study
Authors:
E. M. Turan,
J. Jäschke
Abstract:
The online implementation of model predictive control for constrained multivariate systems has two main disadvantages: it requires an estimate of the entire model state and an optimisation problem must be solved online. These issues have typically been treated separately. This work proposes an integrated approach for the offline training of an output feedback neural network controller in closed lo…
▽ More
The online implementation of model predictive control for constrained multivariate systems has two main disadvantages: it requires an estimate of the entire model state and an optimisation problem must be solved online. These issues have typically been treated separately. This work proposes an integrated approach for the offline training of an output feedback neural network controller in closed loop. Online this neural network controller computers the plant inputs cheaply using noisy measurements. In addition, the controller can be trained to only make use of certain predefined measurements. Further, a heuristic approach is proposed to perform the automatic selection of important measurements. The proposed method is demonstrated by extensive simulations using a non-linear distillation column model of 50 states.
△ Less
Submitted 29 February, 2024;
originally announced February 2024.
-
Learning a convex cost-to-go for single step model predictive control
Authors:
E. M. Turan,
Z. Mdoe,
J. Jäschke
Abstract:
For large systems that consider uncertainty the online solution of model predictive control problems can be computationally taxing, and even infeasible. This can be offset by using a shorter horizon, however this can in turn result in poor controller performance. In this work we consider the task of learning convex objective terms to allow the use of a short, potentially single step, control horiz…
▽ More
For large systems that consider uncertainty the online solution of model predictive control problems can be computationally taxing, and even infeasible. This can be offset by using a shorter horizon, however this can in turn result in poor controller performance. In this work we consider the task of learning convex objective terms to allow the use of a short, potentially single step, control horizon to reduce the online computational cost. We consider two surrogates: (1) a convex interpolating function and (2) an input-convex neural network. We highlight that irrespective of the choice of surrogate the behaviour of the surrogate near the origin and ability of the surrogate to describe the feasible region are key concerns for the closed loop performance of the new MPC problem. We address these concerns by tailoring the design of the surrogate to ensure good performance in both aspects.The paper concludes with a numerical example, showing the clear and significant reduction in computational complexity through the use of these convex surrogates.
△ Less
Submitted 6 February, 2024; v1 submitted 5 December, 2023;
originally announced December 2023.
-
Stability Properties of the Adaptive Horizon Multi-Stage MPC
Authors:
Zawadi Mdoe,
Dinesh Krishnamoorthy,
Johannes Jäschke
Abstract:
This paper presents an adaptive horizon multi-stage model-predictive control (MPC) algorithm. It establishes appropriate criteria for recursive feasibility and robust stability using the theory of input-to-state practical stability (ISpS). The proposed algorithm employs parametric nonlinear programming (NLP) sensitivity and terminal ingredients to determine the minimum stabilizing prediction horiz…
▽ More
This paper presents an adaptive horizon multi-stage model-predictive control (MPC) algorithm. It establishes appropriate criteria for recursive feasibility and robust stability using the theory of input-to-state practical stability (ISpS). The proposed algorithm employs parametric nonlinear programming (NLP) sensitivity and terminal ingredients to determine the minimum stabilizing prediction horizon for all the scenarios considered in the subsequent iterations of the multi-stage MPC. This technique notably decreases the computational cost in nonlinear model-predictive control systems with uncertainty, as they involve solving large and complex optimization problems. The efficacy of the controller is illustrated using three numerical examples that illustrate a reduction in computational delay in multi-stage MPC.
△ Less
Submitted 30 May, 2023;
originally announced May 2023.
-
Optimality-Based Discretization Methods for the Global Optimization of Nonconvex Semi-Infinite Programs
Authors:
Evren M. Turan,
Johannes Jäschke,
Rohit Kannan
Abstract:
We use sensitivity analysis to design $\textit{optimality-based}$ discretization (cutting-plane) methods for the global optimization of nonconvex semi-infinite programs (SIPs). We begin by formulating the optimal discretization of SIPs as a max-min problem and propose variants that are more computationally tractable. We then use parametric sensitivity theory to design an efficient method for solvi…
▽ More
We use sensitivity analysis to design $\textit{optimality-based}$ discretization (cutting-plane) methods for the global optimization of nonconvex semi-infinite programs (SIPs). We begin by formulating the optimal discretization of SIPs as a max-min problem and propose variants that are more computationally tractable. We then use parametric sensitivity theory to design an efficient method for solving these max-min problems to local optimality and argue this yields valid discretizations without sacrificing global optimality guarantees. Finally, we formulate optimality-based $\textit{generalized}$ discretization of SIPs as max-min problems and design efficient local optimization algorithms to solve them approximately. Numerical experiments on test instances from the literature demonstrate that our new optimality-based discretization methods can significantly reduce the number of iterations for convergence relative to the classical feasibility-based method.
△ Less
Submitted 28 February, 2023;
originally announced March 2023.
-
Hybrid Machine Learning Modeling of Engineering Systems -- A Probabilistic Perspective Tested on a Multiphase Flow Modeling Case Study
Authors:
Timur Bikmukhametov,
Johannes Jäschke
Abstract:
To operate process engineering systems in a safe and reliable manner, predictive models are often used in decision making. In many cases, these are mechanistic first principles models which aim to accurately describe the process. In practice, the parameters of these models need to be tuned to the process conditions at hand. If the conditions change, which is common in practice, the model becomes i…
▽ More
To operate process engineering systems in a safe and reliable manner, predictive models are often used in decision making. In many cases, these are mechanistic first principles models which aim to accurately describe the process. In practice, the parameters of these models need to be tuned to the process conditions at hand. If the conditions change, which is common in practice, the model becomes inaccurate and needs to be re-tuned. In this paper, we propose a hybrid modeling machine learning framework that allows tuning first principles models to process conditions using two different types of Bayesian Neural Networks. Our approach not only estimates the expected values of the first principles model parameters but also quantifies the uncertainty of these estimates. Such an approach of hybrid machine learning modeling is not yet well described in the literature, so we believe this paper will provide an additional angle at which hybrid machine learning modeling of physical systems can be considered. As an example, we choose a multiphase pipe flow process for which we constructed a three-phase steady state model based on the drift-flux approach which can be used for modeling of pipe and well flow behavior in oil and gas production systems with or without the neural network tuning. In the simulation results, we show how uncertainty estimates of the resulting hybrid models can be used to make better operation decisions.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Mixed-Dimensional Geometric Coupling of Port-Hamiltonian Systems
Authors:
Jens Jäschke,
Nathanael Skrepek,
Matthias Ehrhardt
Abstract:
We propose a new interconnection relation for infinite-dimensional port-Hamiltonian systems that enables the coupling of ports with different spatial dimensions by integrating over the the surplus dimensions. To show the practical relevance, we apply this interconnection to a model system of an actively cooled gas turbine blade. We also show that this interconnection relation behaves well with res…
▽ More
We propose a new interconnection relation for infinite-dimensional port-Hamiltonian systems that enables the coupling of ports with different spatial dimensions by integrating over the the surplus dimensions. To show the practical relevance, we apply this interconnection to a model system of an actively cooled gas turbine blade. We also show that this interconnection relation behaves well with respect to a discretization in finite element space, ensuring its usability for practical applications.
△ Less
Submitted 13 February, 2022;
originally announced February 2022.
-
Multiple shooting for training neural differential equations on time series
Authors:
Evren Mert Turan,
Johannes Jäschke
Abstract:
Neural differential equations have recently emerged as a flexible data-driven/hybrid approach to model time-series data. This work experimentally demonstrates that if the data contains oscillations, then standard fitting of a neural differential equation may result in a flattened out trajectory that fails to describe the data. We then introduce the multiple shooting method and present successful d…
▽ More
Neural differential equations have recently emerged as a flexible data-driven/hybrid approach to model time-series data. This work experimentally demonstrates that if the data contains oscillations, then standard fitting of a neural differential equation may result in a flattened out trajectory that fails to describe the data. We then introduce the multiple shooting method and present successful demonstrations of this method for the fitting of a neural differential equation to two datasets (synthetic and experimental) that the standard approach fails to fit. Constraints introduced by multiple shooting can be satisfied using a penalty or augmented Lagrangian method.
△ Less
Submitted 17 December, 2021; v1 submitted 14 September, 2021;
originally announced September 2021.
-
Steady-state Real-time Optimization Using Transient Measurements on an Experimental Rig
Authors:
J. Matias,
J. P. C. Oliveira,
G. A. C. Le Roux,
J. Jaschke
Abstract:
Real-time optimization with persistent parameter adaptation (ROPA) is an RTO approach, where the steady-state model parameters are updated dynamically using transient measurements. Consequently, we avoid waiting for a steady-state before triggering the optimization cycle, and the steady-state economic optimization can be scheduled at any desired rate. The steady-state wait has been recognized as a…
▽ More
Real-time optimization with persistent parameter adaptation (ROPA) is an RTO approach, where the steady-state model parameters are updated dynamically using transient measurements. Consequently, we avoid waiting for a steady-state before triggering the optimization cycle, and the steady-state economic optimization can be scheduled at any desired rate. The steady-state wait has been recognized as a fundamental limitation of the traditional RTO approach. In this paper, we implement ROPA on an experimental rig that emulates a subsea oil well network. For comparison, we also implement traditional and dynamic RTO. The experimental results confirm the in-silico findings that ROPA's performance is similar to dynamic RTO's performance with a much lower computational cost. Finally, we present some guidelines for ROPA's practical implementation.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
GivEn -- Shape Optimization for Gas Turbines in Volatile Energy Networks
Authors:
Jan Backhaus,
Matthias Bolten,
Onur Tanil Doganay,
Matthias Ehrhardt,
Benedikt Engel,
Christian Frey,
Hanno Gottschalk,
Michael Günther,
Camilla Hahn,
Jens Jäschke,
Peter Jaksch,
Kathrin Klamroth,
Alexander Liefke,
Daniel Luft,
Lucas Mäde,
Vincent Marciniak,
Marco Reese,
Johanna Schultes,
Volker Schulz,
Sebastian Schmitz,
Johannes Steiner,
Michael Stiglmayr
Abstract:
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of fail…
▽ More
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of failure is a design objective of increasing importance. We also describe the underlying coupling structure of the multiphysical simulations and use modern, gradient based multicriteria optimization procedures to enhance the exploration of Pareto-optimal solutions.
△ Less
Submitted 20 February, 2020;
originally announced February 2020.
