-
PI-CoF: A Bilevel Optimization Framework for Solving Active Learning Problems using Physics-Information
Authors:
Liqiu Dong,
Marta Zagorowska,
Tong Liu,
Alex Durkin,
Mehmet Mercangöz
Abstract:
Physics informed neural networks (PINNs) have recently been proposed as surrogate models for solving process optimization problems. However, in an active learning setting collecting enough data for reliably training PINNs poses a challenge. This study proposes a broadly applicable method for incorporating physics information into existing machine learning (ML) models of any type. The proposed meth…
▽ More
Physics informed neural networks (PINNs) have recently been proposed as surrogate models for solving process optimization problems. However, in an active learning setting collecting enough data for reliably training PINNs poses a challenge. This study proposes a broadly applicable method for incorporating physics information into existing machine learning (ML) models of any type. The proposed method - referred to as PI-CoF for Physics-Informed Correction Factors - introduces additive or multiplicative correction factors for pointwise inference, which are identified by solving a regularized unconstrained optimization problem for reconciliation of physics information and ML model predictions. When ML models are used in an optimization context, using the proposed approach translates into a bilevel optimization problem, where the reconciliation problem is solved as an inner problem each time before evaluating the objective and constraint functions of the outer problem. The utility of the proposed approach is demonstrated through a numerical example, emphasizing constraint satisfaction in a safe Bayesian optimization (BO) setting. Furthermore, a simulation study is carried out by using PI-CoF for the real-time optimization of a fuel cell system. The results show reduced fuel consumption and better reference tracking performance when using the proposed PI-CoF approach in comparison to a constrained BO algorithm not using physics information.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
Tuning of Online Feedback Optimization for setpoint tracking in centrifugal compressors
Authors:
Marta Zagorowska,
Lukas Ortmann,
Alisa Rupenyan,
Mehmet Mercangoez,
Lars Imsland
Abstract:
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performanc…
▽ More
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performance of the controlled system. OFO controllers are also typically designed to ensure steady-state tracking by fixing the sampling time to be longer than the time constants of the system. In this paper, we first quantify the impact of OFO parameters and the sampling time on the tracking error and number of oscillations of the controlled system, showing that adjusting them without waiting for steady state allows good tracking. We then propose a tuning method for the sampling time of the OFO controller together with the parameters to allow tracking fast trajectories while reducing oscillations. We validate the proposed tuning approach in a pressure controller in a centrifugal compressor, tracking trajectories faster than the time needed to reach the steady state by the compressor. The results of the validation confirm that simultaneous tuning of the sampling time and the parameters of OFO yields up to 87% times better tracking performance than manual tuning based on steady state.
△ Less
Submitted 9 March, 2024; v1 submitted 4 December, 2023;
originally announced December 2023.
-
ARRTOC: Adversarially Robust Real-Time Optimization and Control
Authors:
Akhil Ahmed,
Ehecatl Antonio del Rio-Chanona,
Mehmet Mercangoz
Abstract:
Real-Time Optimization (RTO) plays a crucial role in the process operation hierarchy by determining optimal set-points for the lower-level controllers. However, at the control layer, these set-points may be difficult to track due to challenges in implementation as a result of disturbances, measurement noise, and actuator performance limitations. To address this, in this paper, we present the Adver…
▽ More
Real-Time Optimization (RTO) plays a crucial role in the process operation hierarchy by determining optimal set-points for the lower-level controllers. However, at the control layer, these set-points may be difficult to track due to challenges in implementation as a result of disturbances, measurement noise, and actuator performance limitations. To address this, in this paper, we present the Adversarially Robust Real-Time Optimization and Control (ARRTOC) algorithm. ARRTOC addresses this issue by finding set-points which are both optimal and inherently robust to implementation errors at the control layers. ARRTOC draws inspiration from adversarial machine learning, offering a novel constrained Adversarially Robust Optimization (ARO) solution applied to the RTO layer. By integrating controller design with RTO, ARRTOC enhances overall system performance and robustness by ensuring the chosen set-points are tailored to the underlying controller designs. To validate our claims, we present three case studies: an illustrative example, a bioreactor case study, and a multi-loop evaporator process. The proposed approach is found to improve RTO objectives, such as profit, by as much as $50\%$ in some case studies compared to RTO formulations which ignore the performance of the control layers.
△ Less
Submitted 5 March, 2024; v1 submitted 8 September, 2023;
originally announced September 2023.
-
Online Feedback Optimization of Compressor Stations with Model Adaptation using Gaussian Process Regression
Authors:
M. Zagorowska,
M. Degner,
L. Ortmann,
A. Ahmed,
S. Bolognani,
E. A. del Rio Chanona,
M. Mercangoz
Abstract:
Online Feedback Optimization is a method used to steer the operation of a process plant to its optimal operating point without explicitly solving a nonlinear constrained optimization problem. This is achieved by leveraging a linear plant model and feedback from measurements. However the presence of plant-model mismatch leads to suboptimal results when using this approach. Learning the plant-model…
▽ More
Online Feedback Optimization is a method used to steer the operation of a process plant to its optimal operating point without explicitly solving a nonlinear constrained optimization problem. This is achieved by leveraging a linear plant model and feedback from measurements. However the presence of plant-model mismatch leads to suboptimal results when using this approach. Learning the plant-model mismatch enables Online Feedback Optimization to overcome this shortcoming. In this work we present a novel application of Online Feedback Optimization with online model adaptation using Gaussian Process regression. We demonstrate our approach with a realistic load sharing problem in a compressor station with parametric and structural plant-model mismatch. We assume imperfect knowledge of the compressor maps and design an Online Feedback Optimization controller that minimizes the compressor station power consumption. In the evaluated scenario, imperfect knowledge of the plant leads to a 5\% increase in power consumption compared to the case with perfect knowledge. We demonstrate that Online Feedback Optimization with model adaptation reduces this increase to only 0.8%, closely approximating the case of perfect knowledge of the plant, regardless of the type of mismatch.
△ Less
Submitted 7 December, 2022;
originally announced December 2022.
-
Safe Optimization of an Industrial Refrigeration Process Using an Adaptive and Explorative Framework
Authors:
Buse Sibel Korkmaz,
Marta Zagórowska,
Mehmet Mercangöz
Abstract:
Many industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown process characteristics, real-time optimization becomes challenging, particularly for the satisfaction of safety constraints. In this paper, we demonstrate the application of an adaptive and explorative real-time optimization framework to an industrial refrigeration process, wh…
▽ More
Many industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown process characteristics, real-time optimization becomes challenging, particularly for the satisfaction of safety constraints. In this paper, we demonstrate the application of an adaptive and explorative real-time optimization framework to an industrial refrigeration process, where we learn the process characteristics through changes in process control targets and through exploration to satisfy safety constraints. We quantify the uncertainty in unknown compressor characteristics of the refrigeration plant by using Gaussian processes and incorporate this uncertainty into the objective function of the real-time optimization problem as a weighted cost term. We adaptively control the weight of this term to drive exploration. The results of our simulation experiments indicate the proposed approach can help to increase the energy efficiency of the considered refrigeration process, closely approximating the performance of a solution that has complete information about the compressor performance characteristics.
△ Less
Submitted 2 February, 2023; v1 submitted 21 November, 2022;
originally announced November 2022.
-
Learning Linear Representations of Nonlinear Dynamics Using Deep Learning
Authors:
Akhil Ahmed,
Ehecatl Antonio del Rio-Chanona,
Mehmet Mercangoz
Abstract:
The vast majority of systems of practical interest are characterised by nonlinear dynamics. This renders the control and optimization of such systems a complex task due to their nonlinear behaviour. Additionally, standard methods such as linearizing around a fixed point may not be an effective strategy for many systems, thus requiring an alternative approach. For this reason, we propose a new deep…
▽ More
The vast majority of systems of practical interest are characterised by nonlinear dynamics. This renders the control and optimization of such systems a complex task due to their nonlinear behaviour. Additionally, standard methods such as linearizing around a fixed point may not be an effective strategy for many systems, thus requiring an alternative approach. For this reason, we propose a new deep learning framework to discover a transformation of a nonlinear dynamical system to an equivalent higher dimensional linear representation. We demonstrate that the resulting learned linear representation accurately captures the dynamics of the original system for a wider range of conditions than standard linearization. As a result of this, we show that the learned linear model can subsequently be used for the successful control of the original system. We demonstrate this by applying the proposed framework to two examples; one from the literature and a more complex example in the form of a Continuous Stirred Tank Reactor (CSTR).
△ Less
Submitted 3 April, 2022;
originally announced April 2022.
-
Application of Gaussian Processes to online approximation of compressor maps for load-sharing in a compressor station
Authors:
Akhil Ahmed,
Marta Zagorowska,
Ehecatl Antonio del Rio-Chanona,
Mehmet Mercangöz
Abstract:
Devising optimal operating strategies for a compressor station relies on the knowledge of compressor characteristics. As the compressor characteristics change with time and use, it is necessary to provide accurate models of the characteristics that can be used in optimization of the operating strategy. This paper proposes a new algorithm for online learning of the characteristics of the compressor…
▽ More
Devising optimal operating strategies for a compressor station relies on the knowledge of compressor characteristics. As the compressor characteristics change with time and use, it is necessary to provide accurate models of the characteristics that can be used in optimization of the operating strategy. This paper proposes a new algorithm for online learning of the characteristics of the compressors using Gaussian Processes. The performance of the new approximation is shown in a case study with three compressors. The case study shows that Gaussian Processes accurately capture the characteristics of compressors even if no knowledge about the characteristics is initially available. The results show that the flexible nature of Gaussian Processes allows them to adapt to the data online making them amenable for use in real-time optimization problems.
△ Less
Submitted 23 November, 2021;
originally announced November 2021.