Showing 1–50 of 53 results for author: Streif, S

MPC without Terminal Ingredients Tailored to the SEIR Compartmental Epidemic Model

Authors: Willem Esterhuizen, Philipp Sauerteig, Stefan Streif, Karl Worthmann

Abstract: We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed… ▽ More We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed loop to the continuum of disease-free equilibrium points for suitably designed quadratic running cost and a sufficiently long prediction horizon (forecast window). Moreover, we establish the viability kernel (a.k.a. the admissible set) as a domain of attraction of the continuum of equilibria. △ Less

Submitted 10 June, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

Comments: 28 pages, 6 figures, preprint under peer review

MSC Class: 93B45 (primary); 34H05; 49N90; 93C10

On constructive extractability of measurable selectors of set-valued maps

Authors: Pavel Osinenko, Stefan Streif

Abstract: This paper investigates the possibility of constructive extraction of measurable selector from set-valued maps which may commonly arise in viability theory, optimal control, discontinuous systems etc. For instance, existence of solutions to certain differential inclusions, often requires iterative extraction of measurable selectors. Next, optimal controls are in general non-unique which naturally… ▽ More This paper investigates the possibility of constructive extraction of measurable selector from set-valued maps which may commonly arise in viability theory, optimal control, discontinuous systems etc. For instance, existence of solutions to certain differential inclusions, often requires iterative extraction of measurable selectors. Next, optimal controls are in general non-unique which naturally leads to an optimal set-valued function. Finally, a viable control law can be seen, in general, as a selector. It is known that selector theorems are non-constructive and so selectors cannot always be extracted. In this work, we analyze under which particular conditions selectors are constructively extractable. An algorithm is derived from the theorem and applied in a computational study with a three-wheel robot model. △ Less

Submitted 9 March, 2024; originally announced March 2024.

Comments: Published in IEEE Transactions on Automatic Control

Journal ref: IEEE Transactions on Automatic Control, 66.8 (2021), pp. 3757-3764

Deep Neural Network based Optimal Control of Greenhouses

Authors: Kiran Kumar Sathyanarayanan, Philipp Sauerteig, Stefan Streif

Abstract: Automatic control of greenhouse crop production is of great interest owing to the increasing energy and labor costs. In this work, we use two-level control, where the upper level generates suitable reference trajectories for states and control inputs based on day-ahead predictions. These references are tracked in the lower level using Nonlinear Model Predictive Control (NMPC). In order to apply NM… ▽ More Automatic control of greenhouse crop production is of great interest owing to the increasing energy and labor costs. In this work, we use two-level control, where the upper level generates suitable reference trajectories for states and control inputs based on day-ahead predictions. These references are tracked in the lower level using Nonlinear Model Predictive Control (NMPC). In order to apply NMPC, a model of the greenhouse dynamics is essential. However, the complex nature of the underlying model including discontinuities and nonlinearities results in intractable computational complexity and long sampling times. As a remedy, we employ NMPC as a data generator to learn the tracking control policy using deep neural networks. Then, the references are tracked using the trained Deep Neural Network (DNN) to reduce the computational burden. The efficiency of our approach under real-time disturbances is demonstrated by means of a simulation study. △ Less

Submitted 12 April, 2024; v1 submitted 7 November, 2023; originally announced November 2023.

Comments: To be published in the proceedings of European Control Conference 2024. The tex contains 2 images

Comparison of Unscented Kalman Filter Design for Agricultural Anaerobic Digestion Model

Authors: Simon Hellmann, Terrance Wilms, Stefan Streif, Sören Weinrich

Abstract: Dynamic operation of biological processes, such as anaerobic digestion (AD), requires reliable process monitoring to guarantee stable operating conditions at all times. Unscented Kalman filters (UKF) are an established tool for nonlinear state estimation, and there exist numerous variants of UKF implementations, treating state constraints, improvements of numerical performance and different noise… ▽ More Dynamic operation of biological processes, such as anaerobic digestion (AD), requires reliable process monitoring to guarantee stable operating conditions at all times. Unscented Kalman filters (UKF) are an established tool for nonlinear state estimation, and there exist numerous variants of UKF implementations, treating state constraints, improvements of numerical performance and different noise cases. So far, however, a unified comparison of proposed methods emphasizing the algorithmic details is lacking. The present study thus examines multiple unconstrained and constrained UKF variants, addresses aspects crucial for direct implementation and applies them to a simplified AD model. The constrained UKF considering additive noise delivered the most accurate state estimations. The long run time of the underlying optimization could be vastly reduced through pre-calculated gradients and Hessian of the associated cost function, as well as by reformulation of the cost function as a quadratic program. However, unconstrained UKF variants showed lower run times at competitive estimation accuracy. This study provides useful advice to practitioners working with nonlinear Kalman filters by paying close attention to algorithmic details and modifications crucial for successful implementation. △ Less

Submitted 9 April, 2024; v1 submitted 24 October, 2023; originally announced October 2023.

Comments: Update to accepted version after fixing minor review comments

Experimental verification of an online traction parameter identification method

Authors: Alexander Kobelski, Pavel Osinenko, Stefan Streif

Abstract: Traction parameters, that characterize the ground-wheel contact dynamics, are the central factor in the energy efficiency of vehicles. To optimize fuel consumption, reduce wear of tires, increase productivity etc., knowledge of current traction parameters is unavoidable. Unfortunately, these parameters are difficult to measure and require expensive force and torque sensors. An alternative way is t… ▽ More Traction parameters, that characterize the ground-wheel contact dynamics, are the central factor in the energy efficiency of vehicles. To optimize fuel consumption, reduce wear of tires, increase productivity etc., knowledge of current traction parameters is unavoidable. Unfortunately, these parameters are difficult to measure and require expensive force and torque sensors. An alternative way is to use system identification to determine them. In this work, we validate such a method in field experiments with a mobile robot. The method is based on an adaptive Kalman filter. We show how it estimates the traction parameters online, during the motion on the field, and compare them to their values determined via a 6-directional force-torque sensor installed for verification. Data of adhesion slip ratio curves is recorded and compared to curves from literature for additional validation of the method. The results can establish a foundation for a number of optimal traction methods. △ Less

Submitted 20 March, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

Journal ref: Control Engineering Practice Volume 113, August 2021, 104837

Observability and Identifiability Analyses of Process Models for Agricultural Anaerobic Digestion Plants

Authors: Simon Hellmann, Arne-Jens Hempel, Stefan Streif, Sören Weinrich

Abstract: Dynamic operation of anaerobic digestion plants requires advanced process monitoring and control. Different simplifications of the Anaerobic Digestion Model No. 1 (ADM1) have been proposed recently, which appear promising for model-based process automation and state estimation. As a fundamental requirement, observability and identifiability of these models are analyzed in this work, which was purs… ▽ More Dynamic operation of anaerobic digestion plants requires advanced process monitoring and control. Different simplifications of the Anaerobic Digestion Model No. 1 (ADM1) have been proposed recently, which appear promising for model-based process automation and state estimation. As a fundamental requirement, observability and identifiability of these models are analyzed in this work, which was pursued through algebraic and geometric analysis. Manual algebraic assessment was successfull for small models such as the ADM1-R4 and simplified versions of the ADM1-R3, which were derived in this context. However, for larger model classes the algebraic approach showed to be insufficient. By contrast, the geometric approach, implemented in the STRIKE_GOLDD toolbox, allowed to show observability for more complex models (including ADM1-R4 and ADM1-R3), employing two independent algorithms. The present study lays the groundwork for state observer design, parameter estimation and advanced control resting upon ADM1-based models. △ Less

Submitted 5 April, 2023; v1 submitted 12 January, 2023; originally announced January 2023.

Comments: 34 pages, 3 figures. Extended version. A shortened version was submitted to and accepted for the 24th International Conference on Process Control on April 4, 2023

A map-based model predictive control approach for train operation

Authors: Michael Hauck, Patrick Schmidt, Alexander Kobelski, Stefan Streif

Abstract: Trains are a corner stone of public transport and play an important role in daily life. A challenging task in train operation is to avoid skidding and sliding during fast changes of traction conditions, which can, for example, occur due to changing weather conditions, crossings, tunnels or forest entries. The latter depends on local track conditions and can be recorded in a map together with other… ▽ More Trains are a corner stone of public transport and play an important role in daily life. A challenging task in train operation is to avoid skidding and sliding during fast changes of traction conditions, which can, for example, occur due to changing weather conditions, crossings, tunnels or forest entries. The latter depends on local track conditions and can be recorded in a map together with other location-dependent information like speed limits and inclination. In this paper, a model predictive control (MPC) approach is developed. Thanks to the knowledge of future changes of traction conditions, the approach is able to avoid short-term skidding and sliding even under fast changes of traction conditions. In a first step, an optimal reference trajectory is determined by a multiple-shooting approach. In a second step, the reference trajectory is tracked by an MPC setup. The developed method is simulated along a track with fast-changing traction conditions for different scenarios, like changing weather conditions and unexpected delays. In all cases, skidding and sliding is avoided. △ Less

Submitted 24 April, 2023; v1 submitted 2 January, 2023; originally announced January 2023.

Comments: 6 pages, 7 figures, accepted at ECC 2023

Modeling and optimal control of growth, energy, and resource dynamics of Hermetia illucens in mass production environment

Authors: Murali Padmanabha, Alexander Kobelski, Arne-Jens Hempel, Stefan Streif

Abstract: Mass production of Hermetia illucens insect larvae is now being adopted in many countries and is taking an industrial production approach. Despite abundant literature on factors that affect larvae growth and the optimal static parameters identified in laboratory setup, for an industrial production process it is necessary to identify the trajectories such that the growth as well as the production p… ▽ More Mass production of Hermetia illucens insect larvae is now being adopted in many countries and is taking an industrial production approach. Despite abundant literature on factors that affect larvae growth and the optimal static parameters identified in laboratory setup, for an industrial production process it is necessary to identify the trajectories such that the growth as well as the production process is optimal. To achieve this in this work, some of the important requirements and challenges involved thereof are identified and objectives of the automation process are formulated within a model based optimal control setup. Mechanistic models necessary for the optimization framework are derived as differential equations that describe the dynamic variation of resources (feed, water, O2 etc.), energy, and larval biomass. In addition, the elevated metabolic activity of larvae corresponding to the final instar development is identified and also modelled based on the observation from experiments. The mass and energy balance approach used in modelling enables the quantification and distinction of the mass and energy flux components in various levels (e.g. larvae body, growing medium, production environment, and external environment) while holding its applicability for both open and closed/reactor based production setups. Finally, the trajectories generated using the synthesized optimal controller are tested under different scenarios showcasing significant reduction in resource consumption compared to a fixed set-point operation of the production setup. Results presented in this work not only showcase the potential of the mechanistic models and their application in identifying the relevant process parameters (e.g. reactor properties such as volume, thermal conductivity, actuator capacities), but most importantly in optimizing the process dynamically and tuning the process objectives as desired. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Process Optimization of Black Soldier Fly Egg Production via Model Based Control

Authors: Alexander Kobelski, Arne-Jens Hempel, Murali Padmanabha, Luiz-Carlos Wille, Stefan Streif

Abstract: Black soldier fly (BSF) larvae (\textit{Hermetia illucens}) are a valuable protein source for manufacturing animal feed. To maximize their production, both the quantity and quality of their reproductive cycle, i.e. egg production during oviposition, must be increased. In artificial environments, flies often sit idle in cages without mating, depleting their energy reserves and resulting in lower eg… ▽ More Black soldier fly (BSF) larvae (\textit{Hermetia illucens}) are a valuable protein source for manufacturing animal feed. To maximize their production, both the quantity and quality of their reproductive cycle, i.e. egg production during oviposition, must be increased. In artificial environments, flies often sit idle in cages without mating, depleting their energy reserves and resulting in lower egg production per female. By controlling environmental conditions such as temperature and light inside breeding cages, the flies may be stimulated in a way that improves egg output. However, this stimulation increases the energy demand of the process and may stress the flies, resulting in reduced egg production. Therefore, control must be applied in a careful way, which requires knowledge of the egg production cycle. In this work, a mathematical model describing the various fly life stages and their transition to the egg production process is developed. Relevant factors are identified and their effect on the fly life and egg production is mathematically described. Parameters are identified using data from literature and goodness of fit is evaluated. Using the model, an optimal control problem is formulated with the goal of minimizing the energy costs and increasing the egg production quantity. In Simulation, our approach showed 13\% higher output in shorter time at reduced energy costs compared to a (standard) constant setpoint approach. Optimal control could reach same amount of egg in 60~\% of time compared to standard scenario. △ Less

Submitted 12 December, 2022; originally announced December 2022.

Predictive Control with Learning-Based Terminal Costs Using Approximate Value Iteration

Authors: Francisco Moreno-Mora, Lukas Beckenbach, Stefan Streif

Abstract: Stability under model predictive control (MPC) schemes is frequently ensured by terminal ingredients. Employing a (control) Lyapunov function as the terminal cost constitutes a common choice. Learning-based methods may be used to construct the terminal cost by relating it to, for instance, an infinite-horizon optimal control problem in which the optimal cost is a Lyapunov function. Value iteration… ▽ More Stability under model predictive control (MPC) schemes is frequently ensured by terminal ingredients. Employing a (control) Lyapunov function as the terminal cost constitutes a common choice. Learning-based methods may be used to construct the terminal cost by relating it to, for instance, an infinite-horizon optimal control problem in which the optimal cost is a Lyapunov function. Value iteration, an approximate dynamic programming (ADP) approach, refers to one particular cost approximation technique. In this work, we merge the results of terminally unconstrained predictive control and approximate value iteration to draw benefits from both fields. A prediction horizon is derived in dependence on different factors such as approximation-related errors to render the closed-loop asymptotically stable further allowing a suboptimality estimate in comparison to an infinite horizon optimal cost. The result extends recent studies on predictive control with ADP-based terminal costs, not requiring a local initial stabilizing controller. We compare this controller in simulation with other terminal cost options to show that the proposed approach leads to a shorter minimal horizon in comparison to previous results. △ Less

Submitted 1 December, 2022; originally announced December 2022.

MSC Class: 93B45

Critical Clearing Time Estimates of Power Grid Faults via a Set-Based Method

Authors: Willem Esterhuizen, Gyula Molnár, Tim Aschenbruck, Franz Rußwurm, Halil Askan, Stefan Streif

Abstract: This paper is concerned with estimating critical clearing times in the transient stability problem of power grids without extensive time-domain simulations. We consider a highdimensional post-fault system (the grid after the fault is cleared) which we decouple into many smaller subsystems. Then, for each subsystem, we find the so-called safety sets and simulate the faulted system once to deduce th… ▽ More This paper is concerned with estimating critical clearing times in the transient stability problem of power grids without extensive time-domain simulations. We consider a highdimensional post-fault system (the grid after the fault is cleared) which we decouple into many smaller subsystems. Then, for each subsystem, we find the so-called safety sets and simulate the faulted system once to deduce the so-called safe and unsafe critical clearing times, which specify the intervals of time over which the fault may remain active before safety is compromised. We demonstrate the approach with a numerical example involving the IEEE 14 bus system. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Comments: 6 pages, 3 figures. Paper is under review

MSC Class: 34H05 93D20 90C35 93B70 ACM Class: J.2

A stabilizing reinforcement learning approach for sampled systems with partially unknown models

Authors: Lukas Beckenbach, Pavel Osinenko, Stefan Streif

Abstract: Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system data to train involved parametric architectures. In general, online reinforcement learning does not guarantee closed loop stability unless special measures are tak… ▽ More Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system data to train involved parametric architectures. In general, online reinforcement learning does not guarantee closed loop stability unless special measures are taken, for instance, through learning constraints or tailored training rules. Particularly promising are hybrids of reinforcement learning with "classical" control approaches. In this work, we suggest a method to guarantee practical stability of the system-controller closed loop in a purely online learning setting, i.e., without offline training. Moreover, we assume only partial knowledge of the system model. To achieve the claimed results, we employ techniques of classical adaptive control. The implementation of the overall control scheme is provided explicitly in a digital, sampled setting. That is, the controller receives the state of the system and computes the control action at discrete, specifically, equidistant moments in time. The method is tested in adaptive traction control and cruise control where it proved to significantly reduce the cost. △ Less

Submitted 31 August, 2022; originally announced August 2022.

MSC Class: 93D15

High-gain observer for the nitrification process including sensor dynamics

Authors: Patrick Schmidt, Arne-Jens Hempel, Stefan Streif

Abstract: Fertilization is commonly used to increase harvests. The lack of knowledge of soil properties and the excessive use of fertilizers can result in overfertilization. Current sensor technology is able to measure the concentrations of some of the involved substances only at selected locations and depths. Point measurements of adjacent sensors in coarse sensor networks can be used to infer upon the sta… ▽ More Fertilization is commonly used to increase harvests. The lack of knowledge of soil properties and the excessive use of fertilizers can result in overfertilization. Current sensor technology is able to measure the concentrations of some of the involved substances only at selected locations and depths. Point measurements of adjacent sensors in coarse sensor networks can be used to infer upon the state of nitrate concentrations in the sensor surroundings. For this purpose, a high gain observer is proposed. Models of the nitrification process as well as the measurement dynamics for the observer design are derived and discretized on a grid to obtain a system of ordinary differential equations. It is shown that the nonlinearities of the model can be bounded and how the observer gain can be computed via linear matrix inequalities. Furthermore, a model reduction is proposed, which allows the consideration of more grid points. A simulation study demonstrates the proposed approach. △ Less

Submitted 12 April, 2023; v1 submitted 8 August, 2022; originally announced August 2022.

Comments: 8 pages, 3 figures, accepted for IFAC WC 2023

Synthesis of Lyapunov Functions using Formal Verification

Authors: Lukas Munser, Grigory Devadze, Stefan Streif

Abstract: Recent employments of SMT solvers within the Lyapunov function synthesis provided effective tools for automated construction of Lyapunov functions alongside with sound computer-assisted certificates. The main benefit of the suggested approach is the formal correctness and elimination of the numerical uncertainty. In the present work, we extend the SMT-based synthesis approach for wider classes of… ▽ More Recent employments of SMT solvers within the Lyapunov function synthesis provided effective tools for automated construction of Lyapunov functions alongside with sound computer-assisted certificates. The main benefit of the suggested approach is the formal correctness and elimination of the numerical uncertainty. In the present work, we extend the SMT-based synthesis approach for wider classes of continuous and discrete-time systems. Additionally, we address constructions of Lyapunov functions for state-dependent switching systems. We illustrate our approach by means of various examples from the control systems literature. △ Less

Submitted 3 December, 2021; originally announced December 2021.

Formal verification of a controller implementation in fixed-point arithmetic

Authors: Lars Flessing, Grigory Devadze, Stefan Streif

Abstract: For the implementations of controllers on digital processors, certain limitations, e.g. in the instruction set and register length, need to be taken into account, especially for safety-critical applications. This work aims to provide a computer-certified inductive definition for the control functions that are implemented on such processors accompanied with the fixed-point data type in a proof assi… ▽ More For the implementations of controllers on digital processors, certain limitations, e.g. in the instruction set and register length, need to be taken into account, especially for safety-critical applications. This work aims to provide a computer-certified inductive definition for the control functions that are implemented on such processors accompanied with the fixed-point data type in a proof assistant. Using these inductive definitions we formally ensure correct realization of the controllers on a digital processor. Our results guarantee overflow-free computations of the implemented control algorithm. The method presented in this paper currently supports functions that are defined as polynomials within an arbitrary fixed-point structure. We demonstrate the verification process in the case study on an example with different scenarios of fixed-point type implementations. △ Less

Submitted 2 December, 2021; originally announced December 2021.

Approximate infinite-horizon predictive control

Authors: Lukas Beckenbach, Stefan Streif

Abstract: Predictive control is frequently used for control problems involving constraints. Being an optimization based technique utilizing a user specified so-called stage cost, performance properties, i.e., bounds on the infinite horizon accumulated stage cost, aside closed-loop stability are of interest. To achieve good performance and to influence the region of attraction associated with the prediction… ▽ More Predictive control is frequently used for control problems involving constraints. Being an optimization based technique utilizing a user specified so-called stage cost, performance properties, i.e., bounds on the infinite horizon accumulated stage cost, aside closed-loop stability are of interest. To achieve good performance and to influence the region of attraction associated with the prediction horizon, the terminal cost of the predictive controller's optimization objective is a key design factor. Approximate dynamic programming refers to one particular approximation paradigm that pursues iterative cost adaptation over a state domain. Troubled by approximation errors, the associated approximate optimal controller is, in general, not necessarily stabilizing nor is its performance quantifiable on the entire approximation domain. Using a parametric terminal cost trained via approximate dynamic programming, a stabilizing predictive controller is proposed whose performance can directly be related to cost approximation errors. The controller further ensures closed-loop asymptotic stability beyond the training domain of the approximate optimal controller associated to the terminal cost. △ Less

Submitted 7 September, 2022; v1 submitted 16 November, 2021; originally announced November 2021.

Comments: 7 pages

MSC Class: 93C10; 93C55; 93D20

Performance bounds of adaptive MPC with bounded parameter uncertainties

Authors: Francisco Moreno-Mora, Lukas Beckenbach, Stefan Streif

Abstract: Model predictive control is a control approach that minimizes a stage cost over a predicted system trajectory based on a model of the system and is capable of handling state and input constraints. For uncertain models, robust or adaptive methods can be used. Because the system model is used to calculate the control law, the closed-loop behavior of the system and thus its performance, measured by t… ▽ More Model predictive control is a control approach that minimizes a stage cost over a predicted system trajectory based on a model of the system and is capable of handling state and input constraints. For uncertain models, robust or adaptive methods can be used. Because the system model is used to calculate the control law, the closed-loop behavior of the system and thus its performance, measured by the sum of the stage costs, are related to the model used. If it is adapted online, a performance bound is difficult to obtain and thus the impact of model adaptation is mostly unknown. This work provides a (worst-case) performance bound for a linear adaptive predictive control scheme with a specific model parameter estimation. The proposed bound is expressed in terms of quantities such as the initial system parameter error and the constraint set, among others and can be calculated a priori. The results are discussed in a numerical example. △ Less

Submitted 28 June, 2022; v1 submitted 15 November, 2021; originally announced November 2021.

MSC Class: 93B45; 93C40

Journal ref: European Journal of Control, 2022, 100688, ISSN 0947-3580

Model Predictive Control Tailored to Epidemic Models

Authors: Philipp Sauerteig, Willem Esterhuizen, Mitsuru Wilson, Tobias K. S. Ritschel, Karl Worthmann, Stefan Streif

Abstract: We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted withou… ▽ More We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted without violating the infection cap, we choose a suitable subset of the MRPI to define terminal constraints in our MPC routine and show that the number of infected people decays exponentially within this set. Furthermore, under mild assumptions we prove existence of a uniform bound on the time required to reach this terminal region (without violating the infection cap) starting in the admissible set. The findings are substantiated based on a numerical case study. △ Less

Submitted 4 May, 2022; v1 submitted 12 November, 2021; originally announced November 2021.

Comments: 14 pages, 3 figures

Generating a robustly stabilizable class of nonlinear systems for the converse optimality problem

Authors: Rania Tafat, Thomas Göhrt, Stefan Streif

Abstract: Converse optimality theory addresses an optimal control problem conversely where the system is unknown and the value function is chosen. Previous work treated this problem both in continuous and discrete time and non-extensively considered disturbances. In this paper, the converse optimality theory is extended to the class of affine systems with disturbances in continuous time while considering no… ▽ More Converse optimality theory addresses an optimal control problem conversely where the system is unknown and the value function is chosen. Previous work treated this problem both in continuous and discrete time and non-extensively considered disturbances. In this paper, the converse optimality theory is extended to the class of affine systems with disturbances in continuous time while considering norm constraints on both control inputs and disturbances. The admissibility theorem and the design of the internal dynamics model are generalized in this context. A robust stabilizability condition is added for the initial converse optimality probelm using inverse optimality tool: the robust control Lyapunov function. A design for nonlinear class of systems that are both robustly stabilizable and globally asymptotically stable in open loop is obtained. A case study illustrates the presented theory. △ Less

Submitted 12 August, 2022; v1 submitted 10 November, 2021; originally announced November 2021.

Comments: 6 pages, 3 figures, conference

Journal ref: 2022 European Control Conference (ECC), 2022, pp. 1237-1242

Tracking of stabilizing, optimal control in fixed-time based on time-varying objective function

Authors: Patrick Schmidt, Thomas Göhrt, Stefan Streif

Abstract: The controller of an input-affine system is determined through minimizing a time-varying objective function, where stabilization is ensured via a Lyapunov function decay condition as constraint. This constraint is incorporated into the objective function via a barrier function. The time-varying minimum of the resulting relaxed cost function is determined by a tracking system. This system is constr… ▽ More The controller of an input-affine system is determined through minimizing a time-varying objective function, where stabilization is ensured via a Lyapunov function decay condition as constraint. This constraint is incorporated into the objective function via a barrier function. The time-varying minimum of the resulting relaxed cost function is determined by a tracking system. This system is constructed using derivatives up to second order of the relaxed cost function and improves the existing approaches in time-varying optimization. Under some mild assumptions, the tracking system yields a solution which is feasible for all times, and it converges to the optimal solution of the relaxed objective function in a user-defined fixed-time. The effectiveness of these results in comparison to exponential convergence is demonstrated in a case study. △ Less

Submitted 11 October, 2021; originally announced October 2021.

Comments: 6 pages, 4 figures, accepted for IEEE CDC 2021

Epidemic Management with Admissible and Robust Invariant Sets

Authors: Willem Esterhuizen, Jean Lévine, Stefan Streif

Abstract: We present a detailed set-based analysis of the well-known SIR and SEIR epidemic models subjected to hard caps on the proportion of infective individuals, and bounds on the allowable intervention strategies, such as social distancing, quarantining and vaccination. We describe the admissible and maximal robust positively invariant (MRPI) sets of these two models via the theory of barriers. We show… ▽ More We present a detailed set-based analysis of the well-known SIR and SEIR epidemic models subjected to hard caps on the proportion of infective individuals, and bounds on the allowable intervention strategies, such as social distancing, quarantining and vaccination. We describe the admissible and maximal robust positively invariant (MRPI) sets of these two models via the theory of barriers. We show how the sets may be used in the management of epidemics, for both perfect and imperfect/uncertain models, detailing how intervention strategies may be specified such that the hard infection cap is never breached, regardless of the basic reproduction number. The results are clarified with detailed examples. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Comments: 28 pages, 5 figures, accepted for publication in PLOS ONE

MSC Class: 34H05 (primary); 92D30 (secondary); 37N35; 37N25

Optimal control of centrifugal spreader

Authors: Franz Rußwurm, Pavel Osinenko, Stefan Streif

Abstract: Achieving an evenly distributed fertilization spread pattern is a complex technical task. A corresponding control algorithm must account for the tractor movement, the settings of the spreader, the prescribed dosage as well as machine constraints. It dictates, in particular, the fertilization process needs be estimated ahead to achieve an optimized spread pattern. The presented work is concerned wi… ▽ More Achieving an evenly distributed fertilization spread pattern is a complex technical task. A corresponding control algorithm must account for the tractor movement, the settings of the spreader, the prescribed dosage as well as machine constraints. It dictates, in particular, the fertilization process needs be estimated ahead to achieve an optimized spread pattern. The presented work is concerned with the development of a predictive control scheme for optimized fertilizer application using modeling of the tractor moving on the field and the spread pattern in form of a crescent behind the tractor. In particular, the form of the spread pattern is modeled via four normal distributions, two for each side of the pattern. The control goal is to achieve a desired fertilizer distribution on the field. The study presents three algorithms for comparison: a one-step optimization and two approaches using model-predictive control, one with a simplified model of the spread pattern in the prediction horizon, and one with a comprehensive one model, respectively. The best results are obtained with model-predictive control using the comprehensive model. △ Less

Submitted 27 May, 2021; originally announced May 2021.

Comments: 6 pages, 6 figures, IFAC World Congress

MSC Class: 37M05; 93B45; 93C15 ACM Class: G.1.6; G.1.10

Extraction of a computer-certified ODE solver

Authors: Grigory Devadze, Lars Flessing, Stefan Streif

Abstract: Reliably determining system trajectories is essential in many analysis and control design approaches. To this end, an initial value problem has to be usually solved via numerical algorithms which rely on a certain software realization. Because software realizations can be error-prone, proof assistants may be used to verify the underlying mathematical concepts and corresponding algorithms. In this… ▽ More Reliably determining system trajectories is essential in many analysis and control design approaches. To this end, an initial value problem has to be usually solved via numerical algorithms which rely on a certain software realization. Because software realizations can be error-prone, proof assistants may be used to verify the underlying mathematical concepts and corresponding algorithms. In this work we present a computer-certified formalization of the solution of the initial value problem of ordinary differential equations. The concepts are performed in the framework of constructive analysis and the proofs are written in the \texttt{Minlog} proof system. We show the extraction of a program, which solves an ODE numerically and provide some possible optimization regarding the efficiency. Finally, we provide numerical experiments to demonstrate how programs of a certain high level of abstraction can be obtained efficiently. The presented concepts may also be viewed as a part of preliminary work for the development of formalized nonlinear control theory, hence offering the possibility of computer-assisted controller design and program extraction for the controller implementation. △ Less

Submitted 6 April, 2021; originally announced April 2021.

Comments: arXiv admin note: text overlap with arXiv:2006.09884

On performance bound estimation in NMPC with time-varying terminal cost

Authors: Lukas Beckenbach, Stefan Streif

Abstract: Model predictive control (MPC) schemes are commonly designed with fixed, i.e., time-invariant, horizon length and cost functions. If no stabilizing terminal ingredients are used, stability can be guaranteed via a sufficiently long horizon. A suboptimality index can be derived that gives bounds on the performance of the MPC law over an infinite-horizon (IH). While for time-invariant schemes such in… ▽ More Model predictive control (MPC) schemes are commonly designed with fixed, i.e., time-invariant, horizon length and cost functions. If no stabilizing terminal ingredients are used, stability can be guaranteed via a sufficiently long horizon. A suboptimality index can be derived that gives bounds on the performance of the MPC law over an infinite-horizon (IH). While for time-invariant schemes such index can be computed offline, less attention has been paid to time-varying strategies with adapting cost function which can be found, e.g., in learning-based optimal control. This work addresses the performance bounds of nonlinear MPC with stabilizing horizon and time-varying terminal cost. A scheme is proposed that uses the decay of the optimal finite-horizon cost and convolutes a history stack to predict the bounds on the IH performance. Based on online information on the decay rate, the performance bound estimate is improved while the terminal cost is adapted using methods from adaptive dynamic programming. The adaptation of the terminal cost leads to performance improvement over a time-invariant scheme with the same horizon length. The approach is demonstrated in a case study. △ Less

Submitted 1 March, 2021; originally announced March 2021.

MSC Class: 49N35

On MPC without terminal conditions for dynamic non-holonomic robots

Authors: Franz Rußwurm, Willem Esterhuizen, Karl Worthmann, Stefan Streif

Abstract: We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essenti… ▽ More We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essentially solved beforehand, despite the fact that the linearization is not stabilizable. We propose an approach successfully solving the task at hand by combining the theory of barriers to characterize the viability kernel and an MPC framework based on so-called cost controllability. Moreover, we present a numerical case study to derive quantitative bounds on the required length of the prediction horizon. To this end, we investigate the boundary of the viability kernel and a neighbourhood of the origin, i.e. the most interesting areas. △ Less

Submitted 3 June, 2021; v1 submitted 18 February, 2021; originally announced February 2021.

Comments: 6 pages, 2 figures, Submitted to NMPC for possible publication

MSC Class: 34H15; 37M05; 65P99; 93B45; 93C15 ACM Class: G.1.6; G.1.10

On inf-convolution-based robust practical stabilization under computational uncertainty

Authors: Patrick Schmidt, Pavel Osinenko, Stefan Streif

Abstract: This work is concerned with practical stabilization of nonlinear systems by means of inf-convolution-based sample-and-hold control. It is a fairly general stabilization technique based on a generic non-smooth control Lyapunov function (CLF) and robust to actuator uncertainty, measurement noise, etc. The stabilization technique itself involves computation of descent directions of the CLF. It turns… ▽ More This work is concerned with practical stabilization of nonlinear systems by means of inf-convolution-based sample-and-hold control. It is a fairly general stabilization technique based on a generic non-smooth control Lyapunov function (CLF) and robust to actuator uncertainty, measurement noise, etc. The stabilization technique itself involves computation of descent directions of the CLF. It turns out that non-exact realization of this computation leads not just to a quantitative, but also qualitative obstruction in the sense that the result of the computation might fail to be a descent direction altogether and there is also no straightforward way to relate it to a descent direction. Disturbance, primarily measurement noise, complicate the described issue even more. This work suggests a modified inf-convolution-based control that is robust w. r. t. system and measurement noise, as well as computational uncertainty. The assumptions on the CLF are mild, as, e. g., any piece-wise smooth function, which often results from a numerical LF/CLF construction, satisfies them. A computational study with a three-wheel robot with dynamical steering and throttle under various tolerances w. r. t. computational uncertainty demonstrates the relevance of the addressed issue and the necessity of modifying the used stabilization technique. Similar analyses may be extended to other methods which involve optimization, such as Dini aiming or steepest descent. △ Less

Submitted 8 February, 2021; originally announced February 2021.

Comments: Accepted for publication in IEEE TRANSACTIONS ON AUTOMATIC CONTROL; 8 pages, 3 figures

Transient Stability Analysis of Power Grids with Admissible and Maximal Robust Positively Invariant Sets

Authors: Tim Aschenbruck, Willem Esterhuizen, Stefan Streif

Abstract: The energy transition is causing many stability-related challenges for power systems. Transient stability refers to the ability of a power grid's bus angles to retain synchronism after the occurrence of a major fault. In this paper a set-based approach is presented to assess the transient stability of power systems. The approach is based on the theory of barriers, to obtain an exact description of… ▽ More The energy transition is causing many stability-related challenges for power systems. Transient stability refers to the ability of a power grid's bus angles to retain synchronism after the occurrence of a major fault. In this paper a set-based approach is presented to assess the transient stability of power systems. The approach is based on the theory of barriers, to obtain an exact description of the boundaries of admissible sets and maximal robust positively invariant sets, respectively. We decompose a power system into generator and load components, replace couplings with bounded disturbances and obtain the sets for each component separately. From this we deduce transient stability properties for the entire system. We demonstrate the results of our approach through an example of one machine connected to one load and a multi-machine system. △ Less

Submitted 11 January, 2021; originally announced January 2021.

Comments: 8 pages, 8 figures, published in at - Automatisierungstechnik

MSC Class: 93A15; 93-08; 93D99

Journal ref: Automatisierungstechnik, 68(12), 1011-1021 (2020)

On the Turnpike to Design of Deep Neural Nets: Explicit Depth Bounds

Authors: Timm Faulwasser, Arne-Jens Hempel, Stefan Streif

Abstract: It is well-known that the training of Deep Neural Networks (DNN) can be formalized in the language of optimal control. In this context, this paper leverages classical turnpike properties of optimal control problems to attempt a quantifiable answer to the question of how many layers should be considered in a DNN. The underlying assumption is that the number of neurons per layer -- i.e., the width o… ▽ More It is well-known that the training of Deep Neural Networks (DNN) can be formalized in the language of optimal control. In this context, this paper leverages classical turnpike properties of optimal control problems to attempt a quantifiable answer to the question of how many layers should be considered in a DNN. The underlying assumption is that the number of neurons per layer -- i.e., the width of the DNN -- is kept constant. Pursuing a different route than the classical analysis of approximation properties of sigmoidal functions, we prove explicit bounds on the required depths of DNNs based on asymptotic reachability assumptions and a dissipativity-inducing choice of the regularization terms in the training problem. Numerical results obtained for the two spiral task data set for classification indicate that the proposed estimates can provide non-conservative depth bounds. △ Less

Submitted 8 January, 2021; originally announced January 2021.

A comprehensive dynamic growth and development model of Hermetia illucens larvae

Authors: Murali Padmanabha, Alexander Kobelski, Arne-Jens Hempel, Stefan Streif

Abstract: Larvae of Hermetia illucens, also commonly known as black soldier fly (BSF) have gained significant importance in the feed industry, primarily used as feed for aquaculture and other livestock farming. Mathematical model such as Von Bertalanffy growth model and dynamic energy budget models are available for modelling the growth of various organisms but have their demerits for their application to t… ▽ More Larvae of Hermetia illucens, also commonly known as black soldier fly (BSF) have gained significant importance in the feed industry, primarily used as feed for aquaculture and other livestock farming. Mathematical model such as Von Bertalanffy growth model and dynamic energy budget models are available for modelling the growth of various organisms but have their demerits for their application to the growth and development of BSF. Also, such dynamic models were not yet applied to the growth of the BSF larvae despite models proven to be useful for automation of industrial production process (e.g. feeding, heating/cooling, ventilation, harvesting, etc.). This work primarily focuses on develo** a model based on the principles of the afore mentioned models from literature that can provide accurate mathematical description of the dry mass changes throughout the life cycle and the transition of development phases of the larvae. To further improve the accuracy of these models, various factors affecting the growth and development such as temperature, feed quality, feeding rate, moisture content in feed, and airflow rate are developed and integrated into the dynamic growth model. An extensive set of data were aggregated from various literature and used for the model development, parameter estimation and validation. Models describing the environmental factors were individually validated based on the data sets collected. In addition, the dynamic growth model was also validated for dry mass evolution and development stage transition of larvae reared on different substrate feeding rates. The developed models with the estimated parameters performed well highlighting its application in decision-support systems and automation for large scale production. △ Less

Submitted 13 August, 2020; originally announced August 2020.

Prototypical Description and Controller Design for a Set of Systems Using v-gap Based Clustering

Authors: Lukas Munser, Arne-Jens Hempel, Grigory Devadze, Stefan Streif

Abstract: We present an approach to design stabilizing controllers for a set of linear systems without restrictions regarding their modeling order. To this end, the systems are treated as abstract objects in the space of the $ν$-gap metric. Via a cluster analysis the set of systems is split into v-gap similar clusters which are treated separately. For this purpose we provide an algorithm that constructs an… ▽ More We present an approach to design stabilizing controllers for a set of linear systems without restrictions regarding their modeling order. To this end, the systems are treated as abstract objects in the space of the $ν$-gap metric. Via a cluster analysis the set of systems is split into v-gap similar clusters which are treated separately. For this purpose we provide an algorithm that constructs an explicit prototype system by generalizing the information of a given set of systems. Applying this algorithm to each cluster a set of prototype systems is obtained. Given these prototypes we design controllers in such a way that all systems assigned to a cluster will be stabilized by a corresponding controller. The approach is demonstrated for a set of 80 linear systems. △ Less

Submitted 15 July, 2020; originally announced July 2020.

Comments: Accepted for publication at the IFAC WC 2020

PoCET: a Polynomial Chaos Expansion Toolbox for Matlab

Authors: Felix Petzke, Ali Mesbah, Stefan Streif

Abstract: We introduce PoCET: a free and open-scource Polynomial Chaos Expansion Toolbox for Matlab, featuring the automatic generation of polynomial chaos expansion (PCE) for linear and nonlinear dynamic systems with time-invariant stochastic parameters or initial conditions, as well as several simulation tools. It offers a built-in handling of Gaussian, uniform, and beta probability density functions, pro… ▽ More We introduce PoCET: a free and open-scource Polynomial Chaos Expansion Toolbox for Matlab, featuring the automatic generation of polynomial chaos expansion (PCE) for linear and nonlinear dynamic systems with time-invariant stochastic parameters or initial conditions, as well as several simulation tools. It offers a built-in handling of Gaussian, uniform, and beta probability density functions, projection and collocation-based calculation of PCE coefficients, and the calculation of stochastic moments from a PCE. Efficient algorithms for the calculation of the involved integrals have been designed in order to increase its applicability. PoCET comes with a variety of introductory and instructive examples. Throughout the paper we show how to perform a polynomial chaos expansion on a simple ordinary differential equation using PoCET, as well as how it can be used to solve the more complex task of optimal experimental design. △ Less

Submitted 10 July, 2020; originally announced July 2020.

Comments: 6 pages, 4 figures, Accepted for the 21st IFAC WC 2020

Stacked adaptive dynamic programming with unknown system model

Authors: Pavel Osinenko, Thomas Göhrt, Grigory Devadze, Stefan Streif

Abstract: Adaptive dynamic programming is a collective term for a variety of approaches to infinite-horizon optimal control. Common to all approaches is approximation of the infinite-horizon cost function based on dynamic programming philosophy. Typically, they also require knowledge of a dynamical model of the system. In the current work, application of adaptive dynamic programming to a system whose dynami… ▽ More Adaptive dynamic programming is a collective term for a variety of approaches to infinite-horizon optimal control. Common to all approaches is approximation of the infinite-horizon cost function based on dynamic programming philosophy. Typically, they also require knowledge of a dynamical model of the system. In the current work, application of adaptive dynamic programming to a system whose dynamical model is unknown to the controller is addressed. In order to realize the control algorithm, a model of the system dynamics is estimated with a Kalman filter. A stacked control scheme to boost the controller performance is suggested. The functioning of the new approach was verified in simulation and compared to the baseline represented by gradient descent on the running cost. △ Less

Submitted 8 July, 2020; originally announced July 2020.

Journal ref: IFAC-PapersOnLine, 50(1), 4150-4155 (2017)

A reinforcement learning method with closed-loop stability guarantee

Authors: Pavel Osinenko, Lukas Beckenbach, Thomas Göhrt, Stefan Streif

Abstract: Reinforcement learning (RL) in the context of control systems offers wide possibilities of controller adaptation. Given an infinite-horizon cost function, the so-called critic of RL approximates it with a neural net and sends this information to the controller (called "actor"). However, the issue of closed-loop stability under an RL-method is still not fully addressed. Since the critic delivers me… ▽ More Reinforcement learning (RL) in the context of control systems offers wide possibilities of controller adaptation. Given an infinite-horizon cost function, the so-called critic of RL approximates it with a neural net and sends this information to the controller (called "actor"). However, the issue of closed-loop stability under an RL-method is still not fully addressed. Since the critic delivers merely an approximation to the value function of the corresponding infinite-horizon problem, no guarantee can be given in general as to whether the actor's actions stabilize the system. Different approaches to this issue exist. The current work offers a particular one, which, starting with a (not necessarily smooth) control Lyapunov function (CLF), derives an online RL-scheme in such a way that practical semi-global stability property of the closed-loop can be established. The approach logically continues the work of the authors on parameterized controllers and Lyapunov-like constraints for RL, whereas the CLF now appears merely in one of the constraints of the control scheme. The analysis of the closed-loop behavior is done in a sample-and-hold (SH) manner thus offering a certain insight into the digital realization. The case study with a non-holonomic integrator shows the capabilities of the derived method to optimize the given cost function compared to a nominal stabilizing controller. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: Submitted to IFAC 2020

Nonsmooth stabilization and its computational aspects

Authors: Pavel Osinenko, Patrick Schmidt, Stefan Streif

Abstract: This work has the goal of briefly surveying some key stabilization techniques for general nonlinear systems, for which, as it is well known, a smooth control Lyapunov function may fail to exist. A general overview of the situation with smooth and nonsmooth stabilization is provided, followed by a concise summary of basic tools and techniques, including general stabilization, sliding-mode control a… ▽ More This work has the goal of briefly surveying some key stabilization techniques for general nonlinear systems, for which, as it is well known, a smooth control Lyapunov function may fail to exist. A general overview of the situation with smooth and nonsmooth stabilization is provided, followed by a concise summary of basic tools and techniques, including general stabilization, sliding-mode control and nonsmooth backstep**. Their presentation is accompanied with examples. The survey is concluded with some remarks on computational aspects related to determination of sampling times and control actions. △ Less

Submitted 2 July, 2020; v1 submitted 24 June, 2020; originally announced June 2020.

Comments: Submitted to IFAC 2020

MSC Class: 34H15

A Hierarchical Architecture for the Coordination of an Ensemble of Steam Generators

Authors: Stefano Spinelli, Elia Longoni, Marcello Farina, Felix Petzke, Stefan Streif, Andrea Ballarino

Abstract: This work presents a hierarchical architecture for the optimal management of an ensemble of steam generators, which needs to jointly sustain a common load. The coordination of independent subsystems is provided by a multi-layer control scheme. A high-level optimizer computes the optimal shares of production to be allocated to single generators. At medium level, a robust tube-based model predictive… ▽ More This work presents a hierarchical architecture for the optimal management of an ensemble of steam generators, which needs to jointly sustain a common load. The coordination of independent subsystems is provided by a multi-layer control scheme. A high-level optimizer computes the optimal shares of production to be allocated to single generators. At medium level, a robust tube-based model predictive control (MPC) is proposed to track the time-varying demand of the ensemble using a centralized, but aggregated model, whose order does not scale with the number of subsystems. At low level, decentralized controllers are in place to stabilize the internal boiler pressure. The control architecture enables the dynamic modification of the ensemble configuration and plug and play operations. Simulation results are reported to demonstrate the potentialities of the proposed approach. △ Less

Submitted 22 June, 2020; originally announced June 2020.

Computer-assisted proofs for Lyapunov stability via Sums of Squares certificates and Constructive Analysis

Authors: Grigory Devadze, Victor Magron, Stefan Streif

Abstract: We provide a computer-assisted approach to ensure that a given continuous or discrete-time polynomial system is (asymptotically) stable. Our framework relies on constructive analysis together with formally certified sums of squares Lyapunov functions. The crucial steps are formalized within of the proof assistant Minlog. We illustrate our approach with various examples issued from the control syst… ▽ More We provide a computer-assisted approach to ensure that a given continuous or discrete-time polynomial system is (asymptotically) stable. Our framework relies on constructive analysis together with formally certified sums of squares Lyapunov functions. The crucial steps are formalized within of the proof assistant Minlog. We illustrate our approach with various examples issued from the control system literature. △ Less

Submitted 17 June, 2020; originally announced June 2020.

Comments: 21 pages

A method of online traction parameter identification and map**

Authors: Alexander Kobelski, Pavel Osinenko, Stefan Streif

Abstract: Fuel consumption of heavy-duty vehicles such as tractors, bulldozers etc. is comparably high due to their scope of operation. The operation settings are usually fixed and not tuned to the environmental factors, such as ground conditions. Yet exactly the ground-to-propelling-unit properties are decisive in energy efficiency. Optimizing the latter would require a means of identifying those propertie… ▽ More Fuel consumption of heavy-duty vehicles such as tractors, bulldozers etc. is comparably high due to their scope of operation. The operation settings are usually fixed and not tuned to the environmental factors, such as ground conditions. Yet exactly the ground-to-propelling-unit properties are decisive in energy efficiency. Optimizing the latter would require a means of identifying those properties. This is the central matter of the current study. More specifically, the goal is to estimate the ground conditions from the available measurements, such as drive train signals, and to establish a map of those. The ground condition parameters are estimated using an adaptive unscented Kalman filter. A case study is provided with the actual and estimated ground condition maps. Such a map** can be seen as a crucial milestone in optimal operation control of heavy-duty vehicles. △ Less

Submitted 23 April, 2021; v1 submitted 12 June, 2020; originally announced June 2020.

Comments: Accepted for publication at the IFAC WC 2020

Journal ref: IFAC-PapersOnLine Volume 53, Issue 2, 2020, Pages 13933-13938

Model Predictive Control of a Food Production Unit: A Case Study for Lettuce Production

Authors: Murali Padmanabha, Lukas Beckenbach, Stefan Streif

Abstract: Plant factories with artificial light are widely researched for food production in a controlled environment. For such control tasks, models of the energy and resource exchange in the production unit as well as those of the plant's growth process may be used. To achieve minimal operation cost, optimal control strategies can be applied to the system, taking into account the availability of resources… ▽ More Plant factories with artificial light are widely researched for food production in a controlled environment. For such control tasks, models of the energy and resource exchange in the production unit as well as those of the plant's growth process may be used. To achieve minimal operation cost, optimal control strategies can be applied to the system, taking into account the availability of resources by control reference specification. A particular advantage of model predictive control (MPC) is the incorporation of constraints that comply with actuator limitations and general plant growth conditions. In this work, a model of a production unit is derived including a description of the relation between the actuators' electrical signals and the input values to the model. Furthermore, a preliminary model based state tracking control is evaluated for production unit containing Lettuce. It could be observed that the controller is capable to track the reference while satisfying the constraint under changing weather conditions and resource availability. △ Less

Submitted 12 June, 2020; originally announced June 2020.

Maintaining Hard Infection Caps in Epidemics via the Theory of Barriers

Authors: Willem Esterhuizen, Tim Aschenbruck, Jean Lévine, Stefan Streif

Abstract: Research in epidemiology often focusses on designing interventions that result in the number of infected individuals asymptotically approaching zero, without considering that this number may peak at high values during transients. Recent research has shown that a set-based approach could be used to address the problem, and we build on this idea by applying the theory of barriers to construct admiss… ▽ More Research in epidemiology often focusses on designing interventions that result in the number of infected individuals asymptotically approaching zero, without considering that this number may peak at high values during transients. Recent research has shown that a set-based approach could be used to address the problem, and we build on this idea by applying the theory of barriers to construct admissible and invariant sets for an epidemic model. We describe how these sets may be used to choose intervention strategies that maintain infection caps during epidemics. We also derive algebraic conditions of the model parameters that classify a system as being either comfortable, comfortable-viable, viable, or desperate. △ Less

Submitted 23 March, 2020; originally announced March 2020.

Comments: 6 pages, 3 figures

MSC Class: 92D30 (primary); 93C15 (secondary)

Sustainability Analysis of Interconnected Food Production Systems via Theory of Barriers

Authors: Tim Aschenbruck, Willem Esterhuizen, Murali Padmanabha, Stefan Streif

Abstract: Controlled environment agriculture (CEA) is used for efficient food production. Efficiency can be increased further by interconnecting different CEA systems (e.g. plants and insect larvae or fish and larvae), using products and by-products of one system in the other. These interconnected systems define an overall system that can be described by models of interacting species. It is necessary to ide… ▽ More Controlled environment agriculture (CEA) is used for efficient food production. Efficiency can be increased further by interconnecting different CEA systems (e.g. plants and insect larvae or fish and larvae), using products and by-products of one system in the other. These interconnected systems define an overall system that can be described by models of interacting species. It is necessary to identify system parameters (e.g. initial species concentration, harvest rate, feed quality, etc.) such that the resources are not exhausted. For such systems with interacting species, modelled by the Lotka-Volterra equations, a set-based approach based on the recent results of the theory of barriers to exactly determine the so-called admissible set (also known as viability kernel) and the maximal robust positively invariant set is presented. Using an example of a larvae-fish based production system, steps to obtain special trajectories which are the boundaries of the admissible set are shown. This admissible set is used to prevent the under and over population of the species in the CEA. Furthermore, conditions of the system parameters are stated, such that the existence of these trajectories can be guaranteed. △ Less

Submitted 20 March, 2020; originally announced March 2020.

Comments: 6 pages, 3 figures

MSC Class: 93A99 (primary); 92B99 (secondary)

Recursive feasibility of continuous-time model predictive control without stabilising constraints

Authors: Willem Esterhuizen, Karl Worthmann, Stefan Streif

Abstract: We consider sampled-data Model Predictive Control (MPC) of nonlinear continuous-time control systems. We derive sufficient conditions to guarantee recursive feasibility and asymptotic stability without stabilising costs and/or constraints. Moreover, we present formulas to explicitly estimate the required length of the prediction horizon based on the concept of (local) cost controllability. For the… ▽ More We consider sampled-data Model Predictive Control (MPC) of nonlinear continuous-time control systems. We derive sufficient conditions to guarantee recursive feasibility and asymptotic stability without stabilising costs and/or constraints. Moreover, we present formulas to explicitly estimate the required length of the prediction horizon based on the concept of (local) cost controllability. For the linear-quadratic case, cost controllability can be inferred from standard assumptions. In addition, we extend results on the relationship between the horizon length and the distance of the initial state to the boundary of the viability kernel from the discrete-time to the continuous-time setting. △ Less

Submitted 2 March, 2021; v1 submitted 17 March, 2020; originally announced March 2020.

Comments: 17 pages, 1 figure. As published in IEEE Control Systems Letters

MSC Class: 93C15 (primary); 93C10; 34H05; 49N10 (secondary)

Journal ref: in IEEE Control Systems Letters, vol. 5, no. 1, pp. 265-270, Jan. 2021

Half-Gain Tuning for Active Disturbance Rejection Control

Authors: Gernot Herbst, Arne-Jens Hempel, Thomas Göhrt, Stefan Streif

Abstract: A new tuning rule is introduced for linear active disturbance rejection control (ADRC), which results in similar closed-loop dynamics as the commonly employed bandwidth parameterization design, but with lower feedback gains. In this manner the noise sensitivity of the controller is reduced, paving the way for using ADRC in more noise-affected applications. It is proved that the proposed tuning gai… ▽ More A new tuning rule is introduced for linear active disturbance rejection control (ADRC), which results in similar closed-loop dynamics as the commonly employed bandwidth parameterization design, but with lower feedback gains. In this manner the noise sensitivity of the controller is reduced, paving the way for using ADRC in more noise-affected applications. It is proved that the proposed tuning gains, while rooted in the analytical solution of an algebraic Riccati equation, can always be obtained from a bandwidth parameterization design by simply halving the gains. This establishes a link between optimal control and pole placement design. △ Less

Submitted 10 January, 2022; v1 submitted 9 March, 2020; originally announced March 2020.

Journal ref: 21st IFAC World Congress (IFAC-PapersOnLine, Volume 53, Issue 2, 2020)

Design and validation of a low cost programmable controlled environment for study and production of plants, mushroom, and insect larvae

Authors: Murali Padmanabha, Stefan Streif

Abstract: Use of commercial growth chambers for study of biological processes involved in biomass growth and production pose certain limitations on the nature of studies that can be performed in them. Optimization of biomass rearing and production process requires quantitative study of environment influences on the organism and eventually the products and byproducts consumed and produced. This work presents… ▽ More Use of commercial growth chambers for study of biological processes involved in biomass growth and production pose certain limitations on the nature of studies that can be performed in them. Optimization of biomass rearing and production process requires quantitative study of environment influences on the organism and eventually the products and byproducts consumed and produced. This work presents a low cost modular system designed to facilitate quantitative study of growth processes and resource exchanges in organisms such as plants, fungi and insect larvae. The proposed system constitutes of modular units each performing a specific function. A novel compact thermoelectric cooler based unit is designed for conditioning the air. Sensor cluster for measuring gas concentrations, air properties (temperature, humidity, pressure), and growing medium properties is implemented and tested. An actuator cluster for resource exchange and a wiring and control scheme for light spectrum adjustment is proposed. A three tier hierarchical software framework consisting of an open-source cloud platform for data aggregation and user interaction, embedded firmware for microcontroller, and an application development framework for test automation and experiment regime design is developed and presented. A series of experiments and tests were performed using the designed hardware and software to evaluate its capabilities and limitations. This controlled environment was used to study the photosynthesis and its dependency on temperature and light intensity in Ocimum basilicum. In a second experiment, evolution of metabolic activity of Hermetia illucens larvae over its larval phase was studied and the metabolic products and byproducts were quantitatively measured. △ Less

Submitted 7 October, 2019; originally announced October 2019.

Model predictive control with stage cost sha** inspired by reinforcement learning

Authors: Lukas Beckenbach, Pavel Osinenko, Stefan Streif

Abstract: This work presents a suboptimality study of a particular model predictive control with a stage cost sha** based on the ideas of reinforcement learning. The focus of the suboptimality study is to derive quantities relating the infinite-horizon cost function under the said variant of model predictive control to the respective infinite-horizon value function. The basis control scheme involves usual… ▽ More This work presents a suboptimality study of a particular model predictive control with a stage cost sha** based on the ideas of reinforcement learning. The focus of the suboptimality study is to derive quantities relating the infinite-horizon cost function under the said variant of model predictive control to the respective infinite-horizon value function. The basis control scheme involves usual stabilizing constraints comprising of a terminal set and a terminal cost in the form of a local Lyapunov function. The stage cost is adapted using the principles of Q-learning, a particular approach to reinforcement learning. The work is concluded by case studies with two systems for wide ranges of initial conditions. △ Less

Submitted 27 April, 2020; v1 submitted 6 June, 2019; originally announced June 2019.

Comments: 2 figures

MSC Class: 93C10; 93C40; 93C55

On Maximal Robust Positively Invariant Sets in Constrained Nonlinear Systems

Authors: Willem Esterhuizen, Tim Aschenbruck, Stefan Streif

Abstract: In this technical communique we study the maximal robust positively invariant set for state-constrained continuous-time nonlinear systems subjected to a bounded disturbance. Extending results from the theory of barriers, we show that this set is closed and that its boundary consists of two complementary parts, one of which we name the invariance barrier, which consists of trajectories that satisfy… ▽ More In this technical communique we study the maximal robust positively invariant set for state-constrained continuous-time nonlinear systems subjected to a bounded disturbance. Extending results from the theory of barriers, we show that this set is closed and that its boundary consists of two complementary parts, one of which we name the invariance barrier, which consists of trajectories that satisfy the maximum principle. △ Less

Submitted 1 March, 2021; v1 submitted 3 April, 2019; originally announced April 2019.

Comments: 6 pages, 3 figures. As published in Automatica

MSC Class: 37B35 (Primary); 93C15 (Secondary); 34H05

Journal ref: Automatica, 119, 109044 (2020)

Practical sample-and-hold stabilization of nonlinear systems under approximate optimizers

Authors: Pavel Osinenko, Lukas Beckenbach, Stefan Streif

Abstract: It is a known fact that not all controllable systems can be asymptotically stabilized by a continuous static feedback. Several approaches have been developed throughout the last decades, including time-varying, dynamical and even discontinuous feedbacks. In the latter case, the sample-and-hold framework is widely used, in which the control input is held constant during sampling periods. Consequent… ▽ More It is a known fact that not all controllable systems can be asymptotically stabilized by a continuous static feedback. Several approaches have been developed throughout the last decades, including time-varying, dynamical and even discontinuous feedbacks. In the latter case, the sample-and-hold framework is widely used, in which the control input is held constant during sampling periods. Consequently, only practical stability can be achieved at best. Existing approaches often require solving optimization problems for finding stabilizing control actions exactly. In practice, each optimization routine has a finite accuracy which might influence the state convergence. This work shows, what bounds on optimization accuracy are required to achieve prescribed stability margins. Simulation studies support the claim that optimization accuracy has high influence on the state convergence. △ Less

Submitted 22 June, 2018; v1 submitted 6 March, 2018; originally announced March 2018.

Comments: 6 pages, 2 figures

MSC Class: 34H15

Journal ref: IEEE Control Systems Letters, vol. 2, issue 4, pp. 569-574, October 2018

Analysis of extremum value theorems for function spaces in optimal control under numerical uncertainty

Authors: Pavel Osinenko, Stefan Streif

Abstract: The extremum value theorem for function spaces plays the central role in optimal control. It is known that computation of optimal control actions and policies is often prone to numerical errors which may be related to computability issues. The current work addresses a version of the extremum value theorem for function spaces under explicit consideration of numerical uncertainties. It is shown that… ▽ More The extremum value theorem for function spaces plays the central role in optimal control. It is known that computation of optimal control actions and policies is often prone to numerical errors which may be related to computability issues. The current work addresses a version of the extremum value theorem for function spaces under explicit consideration of numerical uncertainties. It is shown that certain function spaces are bounded in a suitable sense i.e. they admit finite approximations up to an arbitrary precision. The proof of this fact is constructive in the sense that it explicitly builds the approximating functions. Consequently, existence of approximate extremal functions is shown. Applicability of the theorem is investigated for finite--horizon optimal control, dynamic programming and adaptive dynamic programming. Some possible computability issues of the extremum value theorem in optimal control are shown on counterexamples △ Less

Submitted 22 June, 2018; v1 submitted 18 September, 2017; originally announced September 2017.

Comments: 28 pages

Journal ref: IMA Journal of Mathematical Control and Information (2018)

A note on constructive treatment of eigenvectors

Authors: Pavel Osinenko, Grigory Devadze, Stefan Streif

Abstract: The eigenvalue problem plays a central role in linear algebra and its applications in control and optimization methods. In particular, many matrix decompositions rely upon computation of eigenvalue-eigenvector pairs, such as diagonal or Jordan normal forms. Unfortunately, numerical algorithms computing eigenvectors are prone to errors. Due to uncomputability of eigenpairs, perturbation theory and… ▽ More The eigenvalue problem plays a central role in linear algebra and its applications in control and optimization methods. In particular, many matrix decompositions rely upon computation of eigenvalue-eigenvector pairs, such as diagonal or Jordan normal forms. Unfortunately, numerical algorithms computing eigenvectors are prone to errors. Due to uncomputability of eigenpairs, perturbation theory and various regularization techniques only help if the matrix at hand possesses certain properties such as the absence of non-zero singular values, or the presence of a distinguishable gap between the large and small singular values. Posing such a requirement might be restrictive in some practical applications. In this note, we propose an alternative treatment of eigenvectors which is approximate and constructive. In comparison to classical eigenvectors whose computation is often prone to numerical instability, a constructive treatment allows addressing the computational uncertainty in a controlled way. △ Less

Submitted 14 July, 2016; originally announced July 2016.

Comments: 12 pages

MSC Class: 15A18; 93F60; 03F65 ACM Class: G.1.3; I.2.8

A Probabilistic Approach to Robust Optimal Experiment Design with Chance Constraints

Authors: Ali Mesbah, Stefan Streif

Abstract: Accurate estimation of parameters is paramount in develo** high-fidelity models for complex dynamical systems. Model-based optimal experiment design (OED) approaches enable systematic design of dynamic experiments to generate input-output data sets with high information content for parameter estimation. Standard OED approaches however face two challenges: (i) experiment design under incomplete s… ▽ More Accurate estimation of parameters is paramount in develo** high-fidelity models for complex dynamical systems. Model-based optimal experiment design (OED) approaches enable systematic design of dynamic experiments to generate input-output data sets with high information content for parameter estimation. Standard OED approaches however face two challenges: (i) experiment design under incomplete system information due to unknown true parameters, which usually requires many iterations of OED; (ii) incapability of systematically accounting for the inherent uncertainties of complex systems, which can lead to diminished effectiveness of the designed optimal excitation signal as well as violation of system constraints. This paper presents a robust OED approach for nonlinear systems with arbitrarily-shaped time-invariant probabilistic uncertainties. Polynomial chaos is used for efficient uncertainty propagation. The distinct feature of the robust OED approach is the inclusion of chance constraints to ensure constraint satisfaction in a stochastic setting. The presented approach is demonstrated by optimal experimental design for the JAK-STAT5 signaling pathway that regulates various cellular processes in a biological cell. △ Less

Submitted 10 November, 2014; originally announced November 2014.

Comments: Submitted to ADCHEM 2015

Stability for Receding-horizon Stochastic Model Predictive Control

Authors: Joel A. Paulson, Stefan Streif, Ali Mesbah

Abstract: A stochastic model predictive control (SMPC) approach is presented for discrete-time linear systems with arbitrary time-invariant probabilistic uncertainties and additive Gaussian process noise. Closed-loop stability of the SMPC approach is established by appropriate selection of the cost function. Polynomial chaos is used for uncertainty propagation through system dynamics. The performance of the… ▽ More A stochastic model predictive control (SMPC) approach is presented for discrete-time linear systems with arbitrary time-invariant probabilistic uncertainties and additive Gaussian process noise. Closed-loop stability of the SMPC approach is established by appropriate selection of the cost function. Polynomial chaos is used for uncertainty propagation through system dynamics. The performance of the SMPC approach is demonstrated using the Van de Vusse reactions. △ Less

Submitted 14 March, 2015; v1 submitted 19 October, 2014; originally announced October 2014.

Comments: American Control Conference (ACC) 2015