-
Model predictive control for tracking using artificial references: Fundamentals, recent results and practical implementation
Authors:
Pablo Krupa,
Johannes Köhler,
Antonio Ferramosca,
Ignacio Alvarado,
Melanie N. Zeilinger,
Teodoro Alamo,
Daniel Limon
Abstract:
This paper provides a comprehensive tutorial on a family of Model Predictive Control (MPC) formulations, known as MPC for tracking, which are characterized by including an artificial reference as part of the decision variables in the optimization problem. These formulations have several benefits with respect to the classical MPC formulations, including guaranteed recursive feasibility under online…
▽ More
This paper provides a comprehensive tutorial on a family of Model Predictive Control (MPC) formulations, known as MPC for tracking, which are characterized by including an artificial reference as part of the decision variables in the optimization problem. These formulations have several benefits with respect to the classical MPC formulations, including guaranteed recursive feasibility under online reference changes, as well as asymptotic stability and an increased domain of attraction. This tutorial paper introduces the concept of using an artificial reference in MPC, presenting the benefits and theoretical guarantees obtained by its use. We then provide a survey of the main advances and extensions of the original linear MPC for tracking, including its non-linear extension. Additionally, we discuss its application to learning-based MPC, and discuss optimization aspects related to its implementation.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Model Predictive Control for setpoint tracking
Authors:
Daniel Limon,
Antonio Ferramosca,
Ignacio Alvarado,
Teodoro Alamo
Abstract:
The main objective of tracking control is to steer the tracking error, that is the difference between the reference and the output, to zero while the plant's operation limits are satisfied. This requires that some assumptions on the evolution of the future values of the reference must be taken into account. Typically a simple evolution of the reference is considered, such as step, ramp, or parabol…
▽ More
The main objective of tracking control is to steer the tracking error, that is the difference between the reference and the output, to zero while the plant's operation limits are satisfied. This requires that some assumptions on the evolution of the future values of the reference must be taken into account. Typically a simple evolution of the reference is considered, such as step, ramp, or parabolic reference signals. It is important to notice that the tracking problem considers possible variations in the reference to be tracked, such as steps or slope variations of the ramps. Then the tracking control problem is inherently uncertain, since the reference may differ from what is expected. If the value of the reference is changed, then there is no guarantee that the feasibility and stability properties of the resulting control law hold. This report presents the MPC for tracking (MPCT) approach, which ensures recursive feasibility and asymptotic stability of the setpoint when the value of the reference is changed.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
CHoKI-based MPC for blood glucose regulation in Artificial Pancreas
Authors:
Beatrice Sonzogni,
José María Manzano,
Marco Polver,
Fabio Previdi,
Antonio Ferramosca
Abstract:
This work presents a Model Predictive Control (MPC) for the artificial pancreas, which is able to autonomously manage basal insulin injections in type 1 diabetic patients. Specifically, the MPC goal is to maintain the patients' blood glucose level inside the safe range of 70-180 mg/dL, acting on the insulin amount and respecting all the imposed constraints, taking into consideration also the Insul…
▽ More
This work presents a Model Predictive Control (MPC) for the artificial pancreas, which is able to autonomously manage basal insulin injections in type 1 diabetic patients. Specifically, the MPC goal is to maintain the patients' blood glucose level inside the safe range of 70-180 mg/dL, acting on the insulin amount and respecting all the imposed constraints, taking into consideration also the Insulin On Board (IOB), to avoid excess of insulin infusion. MPC uses a model to make predictions of the system behaviour. In this work, due to the complexity of the diabetes disease that complicates the identification of a general physiological model, a data-driven learning method is employed instead. The Componentwise Hölder Kinky Inference (CHoKI) method is adopted, to have a customized controller for each patient. For the data collection phase and also to test the proposed controller, the virtual patients of the FDA-accepted UVA/Padova simulator are exploited. The proposed MPC is also tested on a modified version of the simulator, that takes into consideration also the variability of the insulin sensitivity. The final results are satisfying since the proposed controller reduces the time in hypoglycemia (which is more dangerous) if compared to the outcome obtained with the standard constant basal insulin therapy provided by the simulator, satisfying also the time in range requirements and avoiding long-term hyperglycemia events.
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
Set-Point Tracking MPC with Avoidance Features
Authors:
Marcelo A. Santos,
Antonio Ferramosca,
Guilherme V. Raffo
Abstract:
This work proposes a finite-horizon optimal control strategy to solve the tracking problem while providing avoidance features to the closed-loop system. Inspired by the set-point tracking model predictive control (MPC) framework, the central idea of including artificial variables into the optimal control problem is considered. This approach allows us to add avoidance features into the set-point tr…
▽ More
This work proposes a finite-horizon optimal control strategy to solve the tracking problem while providing avoidance features to the closed-loop system. Inspired by the set-point tracking model predictive control (MPC) framework, the central idea of including artificial variables into the optimal control problem is considered. This approach allows us to add avoidance features into the set-point tracking MPC strategy without losing the properties of an enlarged domain of attraction and feasibility insurances in the face of any changing reference. Besides, the artificial variables are considered together with an avoidance cost functional to establish the basis of the strategy, maintaining the recursive feasibility property in the presence of a previously unknown number of regions to be avoided. It is shown that the closed-loop system is recursively feasible and input-to-state-stable under the mild assumption that the avoidance cost is uniformly bounded over time. Finally, two numerical examples illustrate the controller behavior.
△ Less
Submitted 20 July, 2023;
originally announced July 2023.
-
A unified surrogate-based scheme for black-box and preference-based optimization
Authors:
Davide Previtali,
Mirko Mazzoleni,
Antonio Ferramosca,
Fabio Previdi
Abstract:
Black-box and preference-based optimization algorithms are global optimization procedures that aim to find the global solutions of an optimization problem using, respectively, the least amount of function evaluations or sample comparisons as possible. In the black-box case, the analytical expression of the objective function is unknown and it can only be evaluated through a (costly) computer simul…
▽ More
Black-box and preference-based optimization algorithms are global optimization procedures that aim to find the global solutions of an optimization problem using, respectively, the least amount of function evaluations or sample comparisons as possible. In the black-box case, the analytical expression of the objective function is unknown and it can only be evaluated through a (costly) computer simulation or an experiment. In the preference-based case, the objective function is still unknown but it corresponds to the subjective criterion of an individual. So, it is not possible to quantify such criterion in a reliable and consistent way. Therefore, preference-based optimization algorithms seek global solutions using only comparisons between couples of different samples, for which a human decision-maker indicates which of the two is preferred. Quite often, the black-box and preference-based frameworks are covered separately and are handled using different techniques. In this paper, we show that black-box and preference-based optimization problems are closely related and can be solved using the same family of approaches, namely surrogate-based methods. Moreover, we propose the generalized Metric Response Surface (gMRS) algorithm, an optimization scheme that is a generalization of the popular MSRS framework. Finally, we provide a convergence proof for the proposed optimization method.
△ Less
Submitted 3 February, 2022;
originally announced February 2022.
-
GLISp-r: A preference-based optimization algorithm with convergence guarantees
Authors:
Davide Previtali,
Mirko Mazzoleni,
Antonio Ferramosca,
Fabio Previdi
Abstract:
Preference-based optimization algorithms are iterative procedures that seek the optimal calibration of a decision vector based only on comparisons between couples of different tunings. At each iteration, a human decision-maker expresses a preference between two calibrations (samples), highlighting which one, if any, is better than the other. The optimization procedure must use the observed prefere…
▽ More
Preference-based optimization algorithms are iterative procedures that seek the optimal calibration of a decision vector based only on comparisons between couples of different tunings. At each iteration, a human decision-maker expresses a preference between two calibrations (samples), highlighting which one, if any, is better than the other. The optimization procedure must use the observed preferences to find the tuning of the decision vector that is most preferred by the decision-maker, while also minimizing the number of comparisons. In this work, we formulate the preference-based optimization problem from a utility theory perspective. Then, we propose GLISp-r, an extension of a recent preference-based optimization procedure called GLISp. The latter uses a Radial Basis Function surrogate to describe the tastes of the decision-maker. Iteratively, GLISp proposes new samples to compare with the best calibration available by trading off exploitation of the surrogate model and exploration of the decision space. In GLISp-r, we propose a different criterion to use when looking for new candidate samples that is inspired by MSRS, a popular procedure in the black-box optimization framework. Compared to GLISp, GLISp-r is less likely to get stuck on local optima of the preference-based optimization problem. We motivate this claim theoretically, with a proof of global convergence, and empirically, by comparing the performances of GLISp and GLISp-r on several benchmark optimization problems.
△ Less
Submitted 2 October, 2023; v1 submitted 2 February, 2022;
originally announced February 2022.
-
Minimizing the Epidemic Final Size while Containing the Infected Peak Prevalence in SIR Systems
Authors:
J. Sereno,
A. L. Anderson,
A. Ferramosca,
E. A. Hernandez-Vargas,
A. H. Gonzalez
Abstract:
Mathematical models are instrumental to forecast the spread of pathogens and to evaluate the effectiveness of non-pharmaceutical measures. A plethora of optimal strategies has been recently developed to minimize either the infected peak prevalence (IPP) or the epidemic final size (EFS). While most of the control strategies optimize a simple cost function along a fixed finite-time horizon, no conse…
▽ More
Mathematical models are instrumental to forecast the spread of pathogens and to evaluate the effectiveness of non-pharmaceutical measures. A plethora of optimal strategies has been recently developed to minimize either the infected peak prevalence (IPP) or the epidemic final size (EFS). While most of the control strategies optimize a simple cost function along a fixed finite-time horizon, no consensus has been reached about how to simultaneously handle the IPP, the EFS, and the avoiding of new cycles of infections rebounding. In this work, based on the characterization of the dynamical behaviour of SIR-type models under control actions (including the stability of equilibrium sets, in terms of the herd immunity), it is studied how to minimize the EFS while kee** - at any time - the IPP controlled. A procedure is proposed to tailor non-pharmaceutical interventions by separating transient from stationary control objectives and the potential benefits of the strategy are illustrated by a detailed analysis and simulation results related to the COVID-19 pandemic.
△ Less
Submitted 10 November, 2021;
originally announced November 2021.
-
Optimal control strategies to tailor antivirals for acute infectious diseases in the host
Authors:
Mara Perez,
Pablo Abuin,
Marcelo Actis,
Antonio Ferramosca,
Esteban A. Hernandez-Vargas,
Alejandro H. Gonzalez
Abstract:
Several mathematical models in SARS-CoV-2 have shown how target-cell model can help to understand the spread of the virus in the host and how potential candidates of antiviral treatments can help to control the virus. Concepts as equilibrium and stability show to be crucial to qualitatively determine the best alternatives to schedule drugs, according to effectivity in inhibiting the virus infectio…
▽ More
Several mathematical models in SARS-CoV-2 have shown how target-cell model can help to understand the spread of the virus in the host and how potential candidates of antiviral treatments can help to control the virus. Concepts as equilibrium and stability show to be crucial to qualitatively determine the best alternatives to schedule drugs, according to effectivity in inhibiting the virus infection and replication rates. Important biological events such as rebounds of the infections (when antivirals are incorrectly interrupted) can also be explained by means of a dynamic study of the target-cell model. In this work, a full characterization of the dynamical behavior of the target-cell models under control actions is made and, based on this characterization, the optimal fixed-dose antiviral schedule that produces the smallest amount of dead cells (without viral load rebounds) is computed. Several simulation results - performed by considering real patient data - show the potential benefits of both, the model characterization and the control strategy.
△ Less
Submitted 17 June, 2021;
originally announced June 2021.
-
Model predictive control for optimal social distancing in a type SIR-switched model
Authors:
J. E. Sereno,
A. D' Jorge,
A. Ferramosca,
E. A. Hernandez-Vargas,
A. H. Gonzalez
Abstract:
Social distancing strategies have been adopted by governments to manage the COVID-19 pandemic, since the first outbreak began. However, further epidemic waves keep out the return of economic and social activities to their standard levels of intensity. Social distancing interventions based on control theory are needed to consider a formal dynamic characterization of the implemented SIR-type model t…
▽ More
Social distancing strategies have been adopted by governments to manage the COVID-19 pandemic, since the first outbreak began. However, further epidemic waves keep out the return of economic and social activities to their standard levels of intensity. Social distancing interventions based on control theory are needed to consider a formal dynamic characterization of the implemented SIR-type model to avoid unrealistic objectives and prevent further outbreaks. The objective of this work is twofold: to fully understand some dynamical aspects of SIR-type models under control actions (associated with second waves) and, based on it, to propose a switching non-linear model predictive control that optimize the non-pharmaceutical measures strategy. Opposite to other strategies, the objective here is not just to minimize the number of infected individuals at any time, but to minimize the final size of the epidemic while minimizing the time of social restrictions and avoiding the infected prevalence peak to overpass a maximum established by the healthcare system capacity. Simulations illustrate the benefits of the aforementioned proposal.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
Dynamic characterization of control SIR-type systems and optimal single-interval control
Authors:
A. H. González,
A. L. Anderson,
A. Ferramosca,
E. A. Hernandez-Vargas
Abstract:
Although modeling studies are focused on the control of SIR-based systems describing epidemic data sets (particularly the COVID-19), few of them present a formal dynamic characterization in terms of equilibrium sets and stability. Such concepts can be crucial to understand not only how the virus spreads in a population, but also how to tailor government interventions such as social distancing, iso…
▽ More
Although modeling studies are focused on the control of SIR-based systems describing epidemic data sets (particularly the COVID-19), few of them present a formal dynamic characterization in terms of equilibrium sets and stability. Such concepts can be crucial to understand not only how the virus spreads in a population, but also how to tailor government interventions such as social distancing, isolation measures, etc. The objective of this work is to provide a full dynamic characterization of SIR-type systems under single-interval control actions and, based on it, to find the control action that produces the smallest number of infected individuals at the end of the epidemic that avoids second wave outbreaks. %Because of its simplicity, the latter result is intended to be just a reference/baseline for more complex control strategies related to general nonpharmaceutical measure (\textit{i.e}., those accounting for the health system capacity, the number of deaths, etc.). Simulations illustrate the benefits of the aforementioned results in terms of the herd immunity threshold.
△ Less
Submitted 2 June, 2021; v1 submitted 20 March, 2021;
originally announced March 2021.
-
Dynamical Characterization of Antiviral Effects in COVID-19
Authors:
Pablo Abuin,
Alejandro Anderson,
Antonio Ferramosca,
Esteban A. Hernandez-Vargas,
Alejandro H. Gonzalez
Abstract:
Mathematical models describing SARS-CoV-2 dynamics and the corresponding immune responses in patients with COVID-19 can be critical to evaluate possible clinical outcomes of antiviral treatments. In this work, based on the concept of virus spreadability in the host, antiviral effectiveness thresholds are determined to establish whether or not a treatment will be able to clear the infection. In add…
▽ More
Mathematical models describing SARS-CoV-2 dynamics and the corresponding immune responses in patients with COVID-19 can be critical to evaluate possible clinical outcomes of antiviral treatments. In this work, based on the concept of virus spreadability in the host, antiviral effectiveness thresholds are determined to establish whether or not a treatment will be able to clear the infection. In addition, the virus dynamic in the host -- including the time-to-peak and the final monotonically decreasing behavior -- is chracterized as a function of the treatment initial time. Simulation results, based on nine real patient data, show the potential clinical benefits of a treatment classification according to patient critical parameters. This study is aimed at paving the way for the different antivirals being developed to tackle SARS-CoV-2.
△ Less
Submitted 31 December, 2020;
originally announced December 2020.
-
On stability of nonzero set-point for non linear impulsive control systems
Authors:
A. D'Jorge,
A. L. Anderson,
A. Ferramosca,
A. H. González,
M. Actis
Abstract:
The interest in non-linear impulsive systems (NIS) has been growing due to its impact in application problems such as disease treatments (diabetes, HIV, influenza, among many others), where the control action (drug administration) is given by short-duration pulses followed by time periods of null values. Within this framework the concept of equilibrium needs to be extended (redefined) to allows th…
▽ More
The interest in non-linear impulsive systems (NIS) has been growing due to its impact in application problems such as disease treatments (diabetes, HIV, influenza, among many others), where the control action (drug administration) is given by short-duration pulses followed by time periods of null values. Within this framework the concept of equilibrium needs to be extended (redefined) to allows the system to keep orbiting (between two consecutive pulses) in some state space regions out of the origin, according to usual objectives of most real applications. Although such regions can be characterized by means of a discrete-time system obtained by sampling the NIS at the impulsive times, no agreements have reached about their asymptotic stability (AS). This paper studies the asymptotic stability of control equilibrium orbits for NSI, based on the underlying discrete time system, in order to establish the conditions under which the AS for the latter leads to the AS for the former. Furthermore, based on the latter AS characterization, an impulsive Model Predictive Control (i-MPC) that feasibly stabilizes the non-linear impulsive system is presented. Finally, the proposed stable MPC is applied to two control problems of interest: the intravenous bolus administration of Lithium and the administration of antiretrovirals for HIV treatments.
△ Less
Submitted 24 November, 2020;
originally announced November 2020.
-
Discrete-time MPC for switched systems with applications to biomedical problems
Authors:
Alejandro Anderson,
Alejandro Hernan Gonzalez,
Antonio Ferramosca,
Esteban Abelardo Hernandez Vargas
Abstract:
Switched systems in which the manipulated control action is the time-depending switching signal describe many engineering problems, mainly related to biomedical applications. In such a context, to control the system means to select an autonomous system - at each time step - among a given finite family. Even when this selection can be done by solving a Dynamic Programming (DP) problem, such a solut…
▽ More
Switched systems in which the manipulated control action is the time-depending switching signal describe many engineering problems, mainly related to biomedical applications. In such a context, to control the system means to select an autonomous system - at each time step - among a given finite family. Even when this selection can be done by solving a Dynamic Programming (DP) problem, such a solution is often difficult to apply, and state/control constraints cannot be explicitly considered. In this work a new set-based Model Predictive Control (MPC) strategy is proposed to handle switched systems in a tractable form. The optimization problem at the core of the MPC formulation consists in an easy-to-solve mixed-integer optimization problem, whose solution is applied in a receding horizon way. Two biomedical applications are simulated to test the controller: (i) the drug schedule to attenuate the effect of viral mutation and drugs resistance on the viral load, and (ii) the drug schedule for Triple Negative breast cancer treatment. The numerical results suggest that the proposed strategy outperform the schedule for available treatments.
△ Less
Submitted 23 June, 2020;
originally announced June 2020.
-
Characterization of SARS-CoV-2 Dynamics in the Host
Authors:
Pablo Abuin,
Alejandro Anderson,
Antonio Ferramosca,
Esteban A. Hernandez-Vargas,
Alejandro H. Gonzalez
Abstract:
While many epidemiological models have being proposed to understand and handle COVID-19, too little has been invested to understand how the virus replicates in the human body and potential antiviral can be used to control the replication cycle. In this work, using a control theoretical approach, validated mathematical models of SARS-CoV-2 in humans are properly characterized. A complete analysis o…
▽ More
While many epidemiological models have being proposed to understand and handle COVID-19, too little has been invested to understand how the virus replicates in the human body and potential antiviral can be used to control the replication cycle. In this work, using a control theoretical approach, validated mathematical models of SARS-CoV-2 in humans are properly characterized. A complete analysis of the main dynamic characteristic is developed based on the reproduction number. The equilibrium regions of the system are fully characterized, and the stability of such a regions, formally established. Mathematical analysis highlights critical conditions to decrease monotonically SARS-CoV-2 in the host, such conditions are relevant to tailor future antiviral treatments. Simulation results show the potential benefits of the aforementioned system characterization.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
Set-based MPC for discrete-time LTI systems with maximal domain of attraction and minimal predictive control horizon
Authors:
Alejandro Anderson,
Agustina D'Jorge,
Alejandro H. González,
Antonio Ferramosca,
Marcelo Actis
Abstract:
This paper presents a novel set-based model predictive control for tracking, which provides the largest domain of attraction, even with the minimal predictive/control horizon. The formulation - which consists of a single optimization problem - shows a dual behavior: one operating inside the maximal controllable set to the feasible equilibrium set, and the other operating at the N-controllable set…
▽ More
This paper presents a novel set-based model predictive control for tracking, which provides the largest domain of attraction, even with the minimal predictive/control horizon. The formulation - which consists of a single optimization problem - shows a dual behavior: one operating inside the maximal controllable set to the feasible equilibrium set, and the other operating at the N-controllable set to the same equilibrium set. Based on some finite-time convergence results, asymptotic stability of the resulting closed-loop is proved, while recursive feasibility is ensured for any change of the setpoint. The properties and advantages of the proposal have been tested on simulation models.
△ Less
Submitted 16 February, 2023; v1 submitted 1 October, 2019;
originally announced October 2019.