-
Hybrid Machine Learning Modeling of Engineering Systems -- A Probabilistic Perspective Tested on a Multiphase Flow Modeling Case Study
Authors:
Timur Bikmukhametov,
Johannes Jäschke
Abstract:
To operate process engineering systems in a safe and reliable manner, predictive models are often used in decision making. In many cases, these are mechanistic first principles models which aim to accurately describe the process. In practice, the parameters of these models need to be tuned to the process conditions at hand. If the conditions change, which is common in practice, the model becomes i…
▽ More
To operate process engineering systems in a safe and reliable manner, predictive models are often used in decision making. In many cases, these are mechanistic first principles models which aim to accurately describe the process. In practice, the parameters of these models need to be tuned to the process conditions at hand. If the conditions change, which is common in practice, the model becomes inaccurate and needs to be re-tuned. In this paper, we propose a hybrid modeling machine learning framework that allows tuning first principles models to process conditions using two different types of Bayesian Neural Networks. Our approach not only estimates the expected values of the first principles model parameters but also quantifies the uncertainty of these estimates. Such an approach of hybrid machine learning modeling is not yet well described in the literature, so we believe this paper will provide an additional angle at which hybrid machine learning modeling of physical systems can be considered. As an example, we choose a multiphase pipe flow process for which we constructed a three-phase steady state model based on the drift-flux approach which can be used for modeling of pipe and well flow behavior in oil and gas production systems with or without the neural network tuning. In the simulation results, we show how uncertainty estimates of the resulting hybrid models can be used to make better operation decisions.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Multiple shooting for training neural differential equations on time series
Authors:
Evren Mert Turan,
Johannes Jäschke
Abstract:
Neural differential equations have recently emerged as a flexible data-driven/hybrid approach to model time-series data. This work experimentally demonstrates that if the data contains oscillations, then standard fitting of a neural differential equation may result in a flattened out trajectory that fails to describe the data. We then introduce the multiple shooting method and present successful d…
▽ More
Neural differential equations have recently emerged as a flexible data-driven/hybrid approach to model time-series data. This work experimentally demonstrates that if the data contains oscillations, then standard fitting of a neural differential equation may result in a flattened out trajectory that fails to describe the data. We then introduce the multiple shooting method and present successful demonstrations of this method for the fitting of a neural differential equation to two datasets (synthetic and experimental) that the standard approach fails to fit. Constraints introduced by multiple shooting can be satisfied using a penalty or augmented Lagrangian method.
△ Less
Submitted 17 December, 2021; v1 submitted 14 September, 2021;
originally announced September 2021.
-
GivEn -- Shape Optimization for Gas Turbines in Volatile Energy Networks
Authors:
Jan Backhaus,
Matthias Bolten,
Onur Tanil Doganay,
Matthias Ehrhardt,
Benedikt Engel,
Christian Frey,
Hanno Gottschalk,
Michael Günther,
Camilla Hahn,
Jens Jäschke,
Peter Jaksch,
Kathrin Klamroth,
Alexander Liefke,
Daniel Luft,
Lucas Mäde,
Vincent Marciniak,
Marco Reese,
Johanna Schultes,
Volker Schulz,
Sebastian Schmitz,
Johannes Steiner,
Michael Stiglmayr
Abstract:
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of fail…
▽ More
This paper describes the project GivEn that develops a novel multicriteria optimization process for gas turbine blades and vanes using modern "adjoint" shape optimization algorithms. Given the many start and shut-down processes of gas power plants in volatile energy grids, besides optimizing gas turbine geometries for efficiency, the durability understood as minimization of the probability of failure is a design objective of increasing importance. We also describe the underlying coupling structure of the multiphysical simulations and use modern, gradient based multicriteria optimization procedures to enhance the exploration of Pareto-optimal solutions.
△ Less
Submitted 20 February, 2020;
originally announced February 2020.
