-
PI-CoF: A Bilevel Optimization Framework for Solving Active Learning Problems using Physics-Information
Authors:
Liqiu Dong,
Marta Zagorowska,
Tong Liu,
Alex Durkin,
Mehmet Mercangöz
Abstract:
Physics informed neural networks (PINNs) have recently been proposed as surrogate models for solving process optimization problems. However, in an active learning setting collecting enough data for reliably training PINNs poses a challenge. This study proposes a broadly applicable method for incorporating physics information into existing machine learning (ML) models of any type. The proposed meth…
▽ More
Physics informed neural networks (PINNs) have recently been proposed as surrogate models for solving process optimization problems. However, in an active learning setting collecting enough data for reliably training PINNs poses a challenge. This study proposes a broadly applicable method for incorporating physics information into existing machine learning (ML) models of any type. The proposed method - referred to as PI-CoF for Physics-Informed Correction Factors - introduces additive or multiplicative correction factors for pointwise inference, which are identified by solving a regularized unconstrained optimization problem for reconciliation of physics information and ML model predictions. When ML models are used in an optimization context, using the proposed approach translates into a bilevel optimization problem, where the reconciliation problem is solved as an inner problem each time before evaluating the objective and constraint functions of the outer problem. The utility of the proposed approach is demonstrated through a numerical example, emphasizing constraint satisfaction in a safe Bayesian optimization (BO) setting. Furthermore, a simulation study is carried out by using PI-CoF for the real-time optimization of a fuel cell system. The results show reduced fuel consumption and better reference tracking performance when using the proposed PI-CoF approach in comparison to a constrained BO algorithm not using physics information.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
Tuning of Online Feedback Optimization for setpoint tracking in centrifugal compressors
Authors:
Marta Zagorowska,
Lukas Ortmann,
Alisa Rupenyan,
Mehmet Mercangoez,
Lars Imsland
Abstract:
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performanc…
▽ More
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performance of the controlled system. OFO controllers are also typically designed to ensure steady-state tracking by fixing the sampling time to be longer than the time constants of the system. In this paper, we first quantify the impact of OFO parameters and the sampling time on the tracking error and number of oscillations of the controlled system, showing that adjusting them without waiting for steady state allows good tracking. We then propose a tuning method for the sampling time of the OFO controller together with the parameters to allow tracking fast trajectories while reducing oscillations. We validate the proposed tuning approach in a pressure controller in a centrifugal compressor, tracking trajectories faster than the time needed to reach the steady state by the compressor. The results of the validation confirm that simultaneous tuning of the sampling time and the parameters of OFO yields up to 87% times better tracking performance than manual tuning based on steady state.
△ Less
Submitted 9 March, 2024; v1 submitted 4 December, 2023;
originally announced December 2023.
-
Efficient safe learning for controller tuning with experimental validation
Authors:
Marta Zagorowska,
Christopher König,
Hanlin Yu,
Efe C. Balta,
Alisa Rupenyan,
John Lygeros
Abstract:
Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from measured data. To ensure safety, such data-driven algorithms often rely on exhaustive grid search, which is computationally inefficient. In this paper, we propose…
▽ More
Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from measured data. To ensure safety, such data-driven algorithms often rely on exhaustive grid search, which is computationally inefficient. In this paper, we propose a novel approach to safe learning by formulating a series of optimization problems instead of a grid search. We also develop a method for initializing the optimization problems to guarantee feasibility while using numerical solvers. The performance of the new method is first validated in a simulated precision motion system, demonstrating improved computational efficiency, and illustrating the role of exploiting numerical solvers to reach the desired precision. Experimental validation on an industrial-grade precision motion system confirms that the proposed algorithm achieves 30% better tracking at sub-micrometer precision as a state-of-the-art safe learning algorithm, improves the default auto-tuning solution, and reduces the computational cost seven times compared to learning algorithms based on exhaustive search.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Degradation-aware data-enabled predictive control of energy hubs
Authors:
Varsha Behrunani,
Marta Zagorowska,
Mathias Hudoba de Badyn,
Francesco Ricca,
Philipp Heer,
John Lygeros
Abstract:
Mitigating the energy use in buildings, together with satisfaction of comfort requirements are the main objectives of efficient building control systems. Augmenting building energy systems with batteries can improve the energy use of a building, while posing the challenge of considering battery degradation during control operation. We demonstrate the performance of a data-enabled predictive contro…
▽ More
Mitigating the energy use in buildings, together with satisfaction of comfort requirements are the main objectives of efficient building control systems. Augmenting building energy systems with batteries can improve the energy use of a building, while posing the challenge of considering battery degradation during control operation. We demonstrate the performance of a data-enabled predictive control (DeePC) approach applied to a single multi-zone building and an energy hub comprising an electric heat pump and a battery. In a comparison with a standard rule-based controller, results demonstrate that the performance of DeePC is superior in terms of satisfaction of comfort constraints without increasing grid power consumption. Moreover, DeePC achieved two-fold decrease in battery degradation over one year, as compared to a rule-based controller.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
Automatic scenario generation for efficient solution of robust optimal control problems
Authors:
Marta Zagorowska,
Paola Falugi,
Edward O'Dwyer,
Eric C. Kerrigan
Abstract:
Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as large nonlinear optimization problems. The optimization problems are challenging to solve due to their size, especially if the control problems include time-varying uncertainty. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal…
▽ More
Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as large nonlinear optimization problems. The optimization problems are challenging to solve due to their size, especially if the control problems include time-varying uncertainty. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal control problems with parametric and time-varying uncertainty. By iteratively adding interim worst-case scenarios to the problem, methods based on local reduction provide a way to manage the total number of scenarios. We show that the local reduction method for optimal control problems consists of solving a series of simplified optimal control problems to find worst-case constraint violations. In particular, we present examples where local reduction methods find worst-case scenarios that are not on the boundary of the uncertainty set. We also provide bounds on the error if local solvers are used. The proposed approach is illustrated with two case studies with parametric and additive time-varying uncertainty. In the first case study, the number of scenarios obtained from local reduction is 101, smaller than in the case when all $2^{14+3\times192}$ extreme scenarios are considered. In the second case study, the number of scenarios obtained from the local reduction is two compared to 512 extreme scenarios. Our approach was able to satisfy the constraints both for parametric uncertainty and time-varying disturbances, whereas approaches from literature either violated the constraints or became computationally expensive.
△ Less
Submitted 18 August, 2023; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Online Feedback Optimization of Compressor Stations with Model Adaptation using Gaussian Process Regression
Authors:
M. Zagorowska,
M. Degner,
L. Ortmann,
A. Ahmed,
S. Bolognani,
E. A. del Rio Chanona,
M. Mercangoz
Abstract:
Online Feedback Optimization is a method used to steer the operation of a process plant to its optimal operating point without explicitly solving a nonlinear constrained optimization problem. This is achieved by leveraging a linear plant model and feedback from measurements. However the presence of plant-model mismatch leads to suboptimal results when using this approach. Learning the plant-model…
▽ More
Online Feedback Optimization is a method used to steer the operation of a process plant to its optimal operating point without explicitly solving a nonlinear constrained optimization problem. This is achieved by leveraging a linear plant model and feedback from measurements. However the presence of plant-model mismatch leads to suboptimal results when using this approach. Learning the plant-model mismatch enables Online Feedback Optimization to overcome this shortcoming. In this work we present a novel application of Online Feedback Optimization with online model adaptation using Gaussian Process regression. We demonstrate our approach with a realistic load sharing problem in a compressor station with parametric and structural plant-model mismatch. We assume imperfect knowledge of the compressor maps and design an Online Feedback Optimization controller that minimizes the compressor station power consumption. In the evaluated scenario, imperfect knowledge of the plant leads to a 5\% increase in power consumption compared to the case with perfect knowledge. We demonstrate that Online Feedback Optimization with model adaptation reduces this increase to only 0.8%, closely approximating the case of perfect knowledge of the plant, regardless of the type of mismatch.
△ Less
Submitted 7 December, 2022;
originally announced December 2022.
-
Safe Optimization of an Industrial Refrigeration Process Using an Adaptive and Explorative Framework
Authors:
Buse Sibel Korkmaz,
Marta Zagórowska,
Mehmet Mercangöz
Abstract:
Many industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown process characteristics, real-time optimization becomes challenging, particularly for the satisfaction of safety constraints. In this paper, we demonstrate the application of an adaptive and explorative real-time optimization framework to an industrial refrigeration process, wh…
▽ More
Many industrial applications rely on real-time optimization to improve key performance indicators. In the case of unknown process characteristics, real-time optimization becomes challenging, particularly for the satisfaction of safety constraints. In this paper, we demonstrate the application of an adaptive and explorative real-time optimization framework to an industrial refrigeration process, where we learn the process characteristics through changes in process control targets and through exploration to satisfy safety constraints. We quantify the uncertainty in unknown compressor characteristics of the refrigeration plant by using Gaussian processes and incorporate this uncertainty into the objective function of the real-time optimization problem as a weighted cost term. We adaptively control the weight of this term to drive exploration. The results of our simulation experiments indicate the proposed approach can help to increase the energy efficiency of the considered refrigeration process, closely approximating the performance of a solution that has complete information about the compressor performance characteristics.
△ Less
Submitted 2 February, 2023; v1 submitted 21 November, 2022;
originally announced November 2022.
-
Fast and accurate method for computing non-smooth solutions to constrained control problems
Authors:
Lucian Nita,
Eduardo M. G. Vila,
Marta A. Zagorowska,
Eric C. Kerrigan,
Yuanbo Nie,
Ian McInerney,
Paola Falugi
Abstract:
Introducing flexibility in the time-discretisation mesh can improve convergence and computational time when solving differential equations numerically, particularly when the solutions are discontinuous, as commonly found in control problems with constraints. State-of-the-art methods use fixed mesh schemes, which cannot achieve superlinear convergence in the presence of non-smooth solutions. In thi…
▽ More
Introducing flexibility in the time-discretisation mesh can improve convergence and computational time when solving differential equations numerically, particularly when the solutions are discontinuous, as commonly found in control problems with constraints. State-of-the-art methods use fixed mesh schemes, which cannot achieve superlinear convergence in the presence of non-smooth solutions. In this paper, we propose using a flexible mesh in an integrated residual method. The locations of the mesh nodes are introduced as decision variables, and constraints are added to set upper and lower bounds on the size of the mesh intervals. We compare our approach to a uniform fixed mesh on a real-world satellite reorientation example. This example demonstrates that the flexible mesh enables the solver to automatically locate the discontinuities in the solution, has superlinear convergence and faster solve times, while achieving the same accuracy as a fixed mesh.
△ Less
Submitted 17 May, 2022;
originally announced May 2022.
-
Automatic Scenario Generation for Robust Optimal Control Problems
Authors:
Marta Zagorowska,
Paola Falugi,
Edward O'Dwyer,
Eric C. Kerrigan
Abstract:
Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as nonlinear optimization problems. Increasing the number of scenarios improves robustness, while increasing the size of the optimization problems. Mitigating the size of the problem by reducing the number of scenarios requires knowledge about how the uncertainty affects the system. T…
▽ More
Existing methods for nonlinear robust control often use scenario-based approaches to formulate the control problem as nonlinear optimization problems. Increasing the number of scenarios improves robustness, while increasing the size of the optimization problems. Mitigating the size of the problem by reducing the number of scenarios requires knowledge about how the uncertainty affects the system. This paper draws from local reduction methods used in semi-infinite optimization to solve robust optimal control problems with parametric uncertainty. We show that nonlinear robust optimal control problems are equivalent to semi-infinite optimization problems and can be solved by local reduction. By iteratively adding interim globally worst-case scenarios to the problem, methods based on local reduction provide a way to manage the total number of scenarios. In particular, we show that local reduction methods find worst case scenarios that are not on the boundary of the uncertainty set. The proposed approach is illustrated with a case study with both parametric and additive time-varying uncertainty. The number of scenarios obtained from local reduction is 101, smaller than in the case when all $2^{14+3\times192}$ boundary scenarios are considered. A validation with randomly drawn scenarios shows that our proposed approach reduces the number of scenarios and ensures robustness even if local solvers are used.
△ Less
Submitted 8 June, 2023; v1 submitted 29 April, 2022;
originally announced April 2022.
-
Application of Gaussian Processes to online approximation of compressor maps for load-sharing in a compressor station
Authors:
Akhil Ahmed,
Marta Zagorowska,
Ehecatl Antonio del Rio-Chanona,
Mehmet Mercangöz
Abstract:
Devising optimal operating strategies for a compressor station relies on the knowledge of compressor characteristics. As the compressor characteristics change with time and use, it is necessary to provide accurate models of the characteristics that can be used in optimization of the operating strategy. This paper proposes a new algorithm for online learning of the characteristics of the compressor…
▽ More
Devising optimal operating strategies for a compressor station relies on the knowledge of compressor characteristics. As the compressor characteristics change with time and use, it is necessary to provide accurate models of the characteristics that can be used in optimization of the operating strategy. This paper proposes a new algorithm for online learning of the characteristics of the compressors using Gaussian Processes. The performance of the new approximation is shown in a case study with three compressors. The case study shows that Gaussian Processes accurately capture the characteristics of compressors even if no knowledge about the characteristics is initially available. The results show that the flexible nature of Gaussian Processes allows them to adapt to the data online making them amenable for use in real-time optimization problems.
△ Less
Submitted 23 November, 2021;
originally announced November 2021.
-
Data-driven predictive control with improved performance using segmented trajectories
Authors:
Edward O'Dwyer,
Eric C. Kerrigan,
Paola Falugi,
Marta A. Zagorowska,
Nilay Shah
Abstract:
A class of data-driven control methods has recently emerged based on Willems' fundamental lemma. Such methods can ease the modelling burden in control design but can be sensitive to disturbances acting on the system under control. In this paper, we propose a restructuring of the problem to incorporate segmented prediction trajectories. The proposed segmentation leads to reduced tracking error for…
▽ More
A class of data-driven control methods has recently emerged based on Willems' fundamental lemma. Such methods can ease the modelling burden in control design but can be sensitive to disturbances acting on the system under control. In this paper, we propose a restructuring of the problem to incorporate segmented prediction trajectories. The proposed segmentation leads to reduced tracking error for longer prediction horizons in the presence of unmeasured disturbance and noise when compared to an unsegmented formulation. The performance characteristics are illustrated in a set-point tracking case study in which the segmented formulation enables more consistent performance over a wide range of prediction horizons. The method is then applied to a building energy management problem using a detailed simulation environment. The case studies show that good tracking performance is achieved for a range of horizon choices, whereas performance degrades with longer horizons without segmentation.
△ Less
Submitted 5 December, 2022; v1 submitted 24 August, 2021;
originally announced August 2021.
